Hi @erincannon1
When you delete weblink sets then it resets the hidden page that is the expected behaviour. I am wondering your review page name is different from than internal name (Localized Content).

Could you post your screenshot of the review page like above.
Try the below steps:
1. In Portal management > Under content > Web Pages
2. Select your review page > Scroll down until you see "Localized Content"
3. Select the Review page > Click Edit> Change the name to something else (Ex: another page)
4. Click Save and close and then save and close
In Portal Studio > Press "Sync configuration"
One final thing> Clear your cache by going to the following URL.
Going to your portal service page: https://<your_portal>.powerappsportals.com/_services/about
Press the " Clear Cache" button and then in your portal studio do the "Sync configuration" again.
Hope it helps.
------------
If you like this post, give a Thumbs up. Where it solved your request, Mark it as a Solution to enable other users find it.