Can you set up bittrex to charge you in btc instead of neo for the transfer?
Not possible, you will always be charged in the Crypto you transfer.
Re rounding, I would ask Neo support if you lost 0.9 Neo or just need to transfer another 0.1 to have the full size again
thx