Hi was wondering if anyone had this issue and knows how to fix it?

We’re playing Minecraft on server on my PlayStation. I host a world for me and my friends, I have a 9-5 job and a lot of them don’t.

When I leave in the morning I turn the server on so they can play, when I do this I’m the only person online. After a little while the server will change to a single player world and my friends won’t be able to join. It’s super strange.

When my friends are already online and I go AFK for hours and come back the world is fine and is still an online game.

If anyone knows an answer as to why this is happening or has a fix it would be greatly appreciated because it driving me nuts.