Yes, install the bitcoin-qt on your server and mention your server ip instead of localhost and your port and username and password of the wallet.
Or if you do not want to install, you can use blockchain api to use it instead.
thats the trouble im having finding my wallet port and user name
you can find in the configuration file in your wallet. Or if you are having too much problem or you do not know what to do, use blockchain json api.
https://blockchain.info/api/json_rpc_apiUse host : rpc.blockchain.info
username : your wallet identifier
password : your wallet password
port : 443 for SSL (or 80 if you use http://)