Hi @jwnz
For Hide "Azure AD", go to make.powerapps.com and select your portal and click on Settings as per screenshot


Select Azure Active Directory and click on Disable.

After all these steps please clear the cache and check.
--------------------------
If you like this post, give a Thumbs up. Where it solved your query, Mark as a Solution so it can help other people!