Let's say you have 2 UTXOs and they are both assosicated with the same address.
One is worth 0.2 BTC and the other one is worth 0.3 BTC. If you want to make transaction paying 0.1 BTC, you can use each of UTXOs you want. You can also use both UTXOs.
But the fees will still be calculated using all inputs??
As other members have pointed out, the fee you need to pay varies depending on the transaction size. What you need to set when creating a transaction is the fee rate and your wallet will take care of calculating the flat fee to pay. The more inputs and outputs in your transaction, the bigger its size which means higher fees.
Your wallet will not create an output for the fee sent to the miner. Miners just collect whatever the difference between the sum of the inputs and the sum of outputs.