No. The block format is not different with segwit. The only thing different is that any transactions spending segwit outputs must be in the witness extended format (the format with marker and flag bytes and txwitness field). But the block format itself is not different.
Can I understand it as, whether a transaction applies to SegWit or not, depends on the sender address, not receptor address nor the way it choose to send?