I have no religious beliefs. The thing that trips me up is how is there matter in the first place if none can ever be created? Why was there stuff at a single point at some time

The "matter/information can't be created or destroyed" thing only applies to closed systems within their own operational bounds. It's about logical consistency within a closed set, but that tells us nothing about where the closed set itself came from. All the energy from the big bang/first universal iteration was loaned from somewhere else. The how and why of this is probably going to remain a mystery forever because our simulations of the laws of physics can't go back to before the big bang.

So the nature of the big bang and why anything exists is one of the big open-ended philosophy-of-science questions that there isn't an easy falsifiable answer to. It's up to interpretation. I have my own theories on the topic but any guess is as good as another.

From the good old classic "Because God Did It™" to "bubble universes that foam out from a hyperdimensional substrate with random laws of physics/math that sometimes allow for observation and life" and everything in between. It's all the same to me because we can't prove anything one way or the other.