To create a new device group click the "+" button (marked in red below).
A form will open on the right-hand side. Enter a name for it and configure this group. Additionally, you can change and edit the configurations later, if needed. If you have selected "Create a new playlist", a new playlist will be created automatically when a new device group is created.