That depends on how those bitcoins were received.
If wallet B received 20 payments of 0.05 BTC all to that same address, then wallet B has 20 unspent outputs that it needs to spend. This means that the fees for spending from wallet B will be much greater than the fees required for sending from wallet A.
If wallet B received only 1 payment of 1.0 BTC to that address, then wallet B has only 1 unspent output that it needs to spend. This means that the fees for spending from wallet A will be much greater than the fees required for sending from wallet B.
The size (in bytes) of a bitcoin transaction is not effected by the number of addresses you are using, it is effected by the number of unspent outputs you have.
If we have 10 unspent outputs in a wallet, instead of sending to one address, if it sends to 10 different addresses, the fee will also be much greater?
If we have different addresses in a wallet with different amount of unspent outputs, the choice of which output to be spent choosing by the wallet will affect the size of the transaction?