Hi,
IMHO best way is to make main wallet software without non-general features, like GPU or CPU miner or server.
Miner or server software will change, optimalizations will come, maybe we don't want rebuilding - we want clean and elegant wallet, with as low AV software triggers as possible :-)
Nothing holds us from making another version with miners included, name it "dev wallet" for more "pro" crypto users.
M.