This is all part of the process to adoption. its something bitcoin has to survive to grow. Its also commonly agreed upon that speculation will help it get from where it was to where its going.
its price has to rise over time. For anything with a rising price, its going to attract speculation. this is especially true because regardless of bitcoins ups and downs it always ends up higher. This is vary attractive to speculators. i dont think it can be helped and it also helps bitcoin find its price.