Ok, after looking at my etherscan.io and adding all the transactions and mining deposits, it appears that the ethereum never went anywhere.
It's just confusing because on my ledger nano s it has a minus in front of the eth transaction to poloniex and there isn't a plus coming back to me to reflect a refund.
I apologize for the drama.
Mods feel free to delete these posts.