It's not feasible today under present conditions because you'd be competing with the network of computers. But if the hashing difficulty were to drop down to the same level it was at one hour after the genesis block was mined, it would become possible to mine this way. Remember, not so long ago "computer" was a job title!

My point stands, it is absolutely possible to mine bitcoin with pencil and paper. However, under present conditions it is extremely improbable that you would ever solve a single block within your lifetime.

In any case, Bitcoin would be far less adversely affected than you in this hypothetical scenario.