You may already know this Azure AD feature, in preview for quite some time already, called Administrative Units (AUs). This feature allows you to create a container to store Azure resources which then can be used to delegate administrative tasks, during this preview period this can contain only users and groups and is only manageable using PowerShell (New-AzureADAdministrativeUnit).
Once logged on your Azure AD, reach out the Administrative Units blade
Then you can create your administrative unit using the Add button – off course if you already used the PowerShell command, your existing AU’s will be displayed there too
Once you have created your AU, you can then add users and/or groups into it as well as managing delegated permissions by using assigning the limited Azure AD roles to the team in charge of managing this AU