Is the number of coin control inputs going to matter? is it going to affect the transaction speed or its just a matter of privacy?
Like others said yes it increases the size of your transaction but the transaction speed depends on the fee you set.
And for me, it is better not to use coin control to consolidate all of your UTXO while the recommended fee from mempool.space is cheap because if the network is again congested in the future you would pay a much higher fee due to many UTXO so I do recommend don't use coin control instead let it merge all UTXO it would benefit you in the future when the network is congested.