My first rule is to not take too much input. Being a parent and group leader can be tricky. Do what you love and can manage, if someone wants more, invite them to contribute. If they want different, encourage them to start another group.
Next to that is consistency. Set a schedule you can commit to and people will be more likely to show up. Don’t be frustrated if it takes time for people to show up, another great reason to love your activities whether you have company or not.
Good luck and have fun!