I always try to improve upon my idea whenever I feel it has been taken
If you start a company where there are no competitors, you will most likely fail. A seed, planted where other plants exist, has a much better chance of flourishing than a seed planted in a desert.

Securing success depends on having that trait that kills off competition, not avoiding it. Google killed Yahoo because its search scaled without increasing payroll. Its crawler and PageRank automated the categorization process that Yahoo was doing via people. Google didn't avoid competing with Yahoo on search. Instead, Google partnered with Yahoo to handle stuff Yahoo couldn't deal with, until the day people started abandoning Yahoo for Google directly. Its differentiator won the choice conflict.