Public just means anyone can join and post in it. If you want to choose who you want in your group, choose Moderated. Or if you want to invite your own members, choose Invite Only.
To create one of those, click here. Enter a name for your group, and then a description of your group in the boxes provided. Then click save, and you've made a group. :]