Most miners only support stratum so they can't directly connect to the daemon.  It's best to set up your own mining pool software such as node-cryptonote-pool, point it to your daemon and mine to it.