To create a new device group click the "+" button (red marked).
A form opens on the right-hand side. Enter a name for it and configure this group. This can be done at a later stage as well. If you have selected "Create a new playlist", a new playlist will be created automatically with the creation of the new device group.