I’m not considering any notion of “before the big bang”.
Many descriptions of cosmology fail to clarify the distinction between our observable universe and the entire universe. The observable universe is indeed bounded by a sphere, centered on us, that shrinks back to a point if we look back in time to the limit of the Big Bang. This leads to the misconception that the entire universe started at a point, and is bounded by a spherical edge, expanding in preexisting space.
Although the entire universe may not be infinite, I think it’s best to start with an assumption that it is - because if your conception of cosmology can’t accommodate that, you probably have some misconceptions in there.
I think the 1-dimensional “ants on a stretchy band” model is probably the best analogy. The expansion of space is the band stretching, meaning that ants that are locally stationary on the band move further apart. But assume that the band is infinite, just goes on forever without any ends. It’s not entirely clear quite what that means, but I think it clarifies some aspects of the model. Looking forward in time, the band expands, making points further apart; looking back in time, it contracts, making points closer together. But it has no ends, it just disappears off into infinity however close together or far apart things become.
Now, if you consider the observable universe for a particular ant standing at one particular place on the band, that just represents the line-segment of the band centered on that ant. And if you look back in time, that segment shrinks, tending to the limit of a point centered on that ant at the Big Bang. But there’s nothing special about that one point - it’s just defined by where that one ant happens to be standing. More generally, looking back in time toward the Big Bang is not the process of shrinking the entire band to any one particular point, it is the process of all points on this infinitely long band tending to become mutually closer to one another - while the total extent of the band remains infinite, it has no ends. And the Big Bang itself is the undefinied limit where the distance between any two points on the infinitely long band approaches zero.
A singularity is not the same thing as a “point in space”. A singularity is the infinity-times-zero limit where the model breaks.
The bottom line is that if you haven’t somehow got to grips with
(a) there are no edges to the expansion of space;
(b) the Big Bang happened everywhere
then you need to keep working on your understanding to find an analogy that works for you.