Flow to add 7600 items in a Sharepoint list is slow

(0) Share

Report

Posted on by manu59

Hi,

I need to add 7600 items in a Sharepoint list.

In my flow, I use 2 "Apply to each" actions :

first one gives19 items
second one gives 400 items

Total items to add is 7600 items =19 * 400

In order to provide the execution speed of the first "for each", I set Concurrency Control to "On" and "Degree of Parallelism" to 20

But the flow duration is 27 minutes.

It seems to be a long duration ... what do you think about ?

for each.JPG

Categories:

Building flows

I have the same question (0)

All responses (4)

Answers (1)

Verified answer

Brad_Groux 4,556 on at

Like (1)

Report

The SharePoint REST API has stringent throttling limits that affects the speed of large batch jobs. With that said, your performance is directly related to the fact that you are utilizing nested loops. Also, Degree of Parallelism can be raised up to 50 - so you may want to give that a shot.

Please review the Limits and configuration in Power Automate documentation and this Tuning your Flow for performance blog post for more.

👨🏻‍💻 If this reply answers your question or solves your issue, please ACCEPT AS SOLUTION ☑️. If you find this reply helpful, please consider giving it a LIKE 👍.

Was this reply helpful? Yes No
v-alzhan-msft on at

Like (0)

Report

Hi @manu59 ,

Please take a try with @Brad_Groux 's solution.

Best regards,
Alice

Community Support Team _ Alice Zhang
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Was this reply helpful? Yes No
Automata-BBAU 24 on at

Like (1)

Report

7600 item in 27 minutes is PRETTY GOOD actually, if you are talking about Microsoft speeds. I can barely add 100 items in an hour with a do until, and with an apply to each is much worse. Also, if you are using an array to get data from (and add it to Sharepoint) you can't really use parallelism, because it can't really define which item is ready and which is not, so it duplicates and misses data randomly, so take care.

Was this reply helpful? Yes No
takolota1 4,974 Moderator on at

Like (0)

Report

SharePoint batch create 1000 records per minute: https://www.tachytelic.net/2021/06/power-automate-flow-batch-create-sharepoint-list-items/?amp

Was this reply helpful? Yes No