For reference, the pattern I am using is as detailed here: https://www.tachytelic.net/2021/06/power-automate-flow-batch-create-sharepoint-list-items/
I have a fairly heavy amount of data being passed through various flows. The data starts as an Excel table, which is uploaded to SharePoint via a flow triggered within a PowerApp. Data is taken from the table and transferred into a SharePoint list using the Send an HTTP request to SharePoint batch method, as above. The data is then packaged up and sent off for processing and manipulation outside the Power Platform. Once that manipulation is complete, the data is picked up again by another flow and written back into the same SharePoint list, using row IDs and a similar batch API method to make bulk modifications to the existing records.
Here is the issue: until about 3 weeks ago this had worked perfectly, for upwards of a year. All of a sudden, I am now experiencing timeouts with the batch API approach. Note that I'm not talking about entire Send an HTTP request to SharePoint actions timing out, I'm talking about individual items within each batch that I am sending with this method timing out. See the screenshot attached for an example of this. The screenshot shows 2 items from the outputs of the Send an HTTP request to SharePoint action, the first item acting as expected while the second one times out.
I have tried reducing the batch size when using the batch API. Until a couple of weeks ago I was using the max of 1000 items, I've steadily been reducing this to try and reduce the errors to the point that I am now using a size of 80-100 in all instances of this pattern. Not only does this not eliminate errors (it perhaps reduces them although the jury is out on that), it also results in these flows taking 10x longer to execute.
Is this something that anyone else has experience dealing with? Is there any way I can handle these item-by-item timeouts within Send an HTTP request to SharePoint? Is there any more reliable way to make bulk updates and uploads to a SharePoint list that I can trust not to lose data?
Please let me know if you need anything else from me, I'm at my wits end as nothing has changed but now I have important flows that can't be trusted to work reliably.

Report
All responses (
Answers (