Hi there. I am trying to trigger a Dataflow from Power Automate. The Dataflow was configured directly in the Power Platform with my personal account. I have a Service Principal that I want to use for the connections in my solution. Specifically I am trying to do the following
1. Create a Power Query Dataflows connection with the credentials of the SP

2. Use that connection to trigger the Dataflow refresh from my flow.

When using the connection that is under my personal account I can select all the dataflows in the 'Dataflows' dropdown in the connector input window.
However when using the connection under the SP I get the following error when trying to select the dataflows.

Error Message:
Could not retrieve values. The dynamic invocation request failed with error: { "Message": "The backend request failed with error code '403'", "Reason": "Forbidden", "WorkspaceType": "Environment", "OperationId": "ListDataflowsForRefreshDataflow", "ClientRequestId": "XXXXXXXXXXXXXXXXXXXXX", "ClientRequestUrl": "https://australia-001.azure-apim.net/apim/dataflows/shared-dataflows- XXXXXXXXXXXXXXXXXXXXX /api/group/ XXXXXXXXXXXXXXXXXXXXX -australia/listdataflows/forrefreshdataflow?workspaceType=Environment" }.
The Service Principal has System Administrator Security Role in the Environment of the Dataflow. Also the SP has been given the floowing Azure API permissions:

Any clues would be much appreciated?