I don't pretend to know how the universe started, if there was even a start. This is a very difficult scientific problem, experimentation is not very useful, at least not with our current capabilities. I don't see any logical way to go from there to the existence of a god. In fact, the existence of a god doesn't even solve the problem, because the question simply becomes, how did that god start/appear/was created ?
A fair and deep question that deserves a reply. Below is an essay by Perry Marshal that tackles this very question it describes one way to infer the existence of God. The essay is s bit long but this is a deep topic.