You need to understand that their are some people that are very negative in nature, they can never tell you the positive side of things, they will always look for excuses for you not to do it.
So my honest advice is that if you are really convince on what you want to do, just act on it, taking advice from negative minded set of people will only bring you discouragement and loss of interest.