I wouldn't keep a private key with the application.

You could certainly have an application that creates Bitcoin transactions, that another service could then sign.