Hi Matthew
Using the action "Update Event (V4)" there is no way to the attendees will not get a notification when you add someone to the meting, I found a post with the same problem you have and someone trying a different approach, it might works for you.
My workaround was to instead forward the invite to the event by doing the following:
1) Schedule the event manually and invite only myself
2) Create a utility flow to search and find the email message ID of the email that triggered when i scheduled the calendar event in step 1
3) In my actual flow, used the 'forward an email (V2)' and used the message ID of the email that i captured in step
Hope this helps.
Cheers.