Skip to main content

Notifications

Power Automate - Building Flows
Unanswered

Concurrency in Apply to Each control causing duplicates

(0) ShareShare
ReportReport
Posted on by 34

I have a flow that extracts data from an XML file and sends it to an application via an API.

 

With no concurrency, the flow takes about 1.5 ours and inserts 3300 records. The application has a duplicate checker and it confirms none of the entries are duplicates.

 

To speed it up, I added concurrency. I had to cancel the flow after ~3 minutes because it had inserted over 7,500 records including over 4,000 duplicates, and was still running.

 

PA Issue.png

 

(You can ignore that it says action failed, there are a couple of items out of the 3,300 that failed but all 3,300 were processed so this is a red-herring).

 

That implies that rather than processing multiple items concurrently (but over all still once each) it is actually processing every item multiple times.

 

Is this a bug, because that doesn't seem remotely useful? Is there a setting or something I need to check?

  • creativeopinion Profile Picture
    creativeopinion 10,135 on at
    Concurrency in Apply to Each control causing duplicates
    @DaveConnors It's hard to offer any recommendations without seeing the logic behind your flow. In edit mode, click on each action to expand it. Upload a screenshot of your full flow.
     
    In the meantime, you might be interested in these YT Tutorials:
     
     

    In this video tutorial I’ll show you 3 practical ways to use the Filter Array action and how to use it properly.
    1️⃣ Cross-Referencing Data
    2️⃣ Filtering by Key
    3️⃣ Substring Matching

    Did you know that the Condition action has a limit of 10 conditions? Although it might look like the Filter Array action can only accept one condition—this is not true. By using the advanced mode you can enter multiple conditions into a Filter Array action with an expression.

    IN THIS VIDEO:
    ✓ 3 Ways to Use the Filter Array Action
    ✓ How to use the Scope Action to Group Actions
    ✓ How to Check the Number of Items returned from a Filter Array Action
    ✓ How to Cross-Reference Data in Excel with a SharePoint List
    ✓ How the Filter Array Action Works
    ✓ How to Access the Dynamic Content from a Filter Array Action
    ✓ How to Filter Items by a Key
    ✓ How to Filter Items by Matching a Substring
    ✓ How to Use Multiple Conditions in a Filter Array Action

    ---

    In this tutorial—I’m going to show you a quicker way to get the dynamic content from your Filter Array action—and it doesn’t require writing an expression.

    IN THIS VIDEO:
    ✓ How to Loop Through Filter Array Results in Power Automate
    ✓ Using Apply to Each with Filtered Arrays
    ✓ The Easiest Way to Access Dynamic Content from Filter Array
    ✓ Fixing Nested Apply to Each Actions
    ✓ When to Use Value vs. Body Dynamic Content
    ✓ Simplifying Power Automate Flows with Filter Array
    ✓ Troubleshooting Filter Array and Apply to Each Issues

    ---

    In this video tutorial I’ll go over how to avoid these common mistakes when using the Apply to Each action in a Power Automate flow:
    1️⃣ Looping through a Single Item
    2️⃣ Creating Unnecessary Nested Loops
    3️⃣ Looping through an Unfiltered Array

    At the end of the video I share a few helpful insights when it comes to using the Apply to Each action in your flow.

    IN THIS VIDEO:
    ✓ How to avoid the Apply to Each action with a single item array
    ✓ How to use the item() function to access dynamic content in an array
    ✓ How to prevent unnecessary nested Apply to Each action loops
    ✓ How to use the Select action
    ✓ How to convert an array to a string with the Select action
    ✓ How to use the Filter Query field
    ✓ How to count the number of items in an array
    ✓ How to use a condition control
    ✓ How to use the concurrency control
    ✓ How to set a top count
    ✓ How to use Compose actions for troubleshooting
     
     
     
    Hope this helps!

    Consider giving me a ❤️ if you liked my response!

    👉 Level up your Power Automate skills by checking out my tutorials on YouTube
    👉 Tips and Tricks on TikTok and Instagram
  • SM-21011402-0 Profile Picture
    SM-21011402-0 2 on at
    Concurrency in Apply to Each control causing duplicates
    Able to find any solution on this? Even I am getting similar situations.
  • joe-sai Profile Picture
    joe-sai 18 on at
    Re: Concurrency in Apply to Each control causing duplicates

    Did you ever figure this out? I am having the same issue

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Microsoft Kickstarter Events…

Register for Microsoft Kickstarter Events…

Announcing Our 2025 Season 1 Super Users!

A new season of Super Users has arrived, and we are so grateful for the daily…

Announcing Forum Attachment Improvements!

We're excited to announce that attachments for replies in forums and improved…

Leaderboard

#1
WarrenBelz Profile Picture

WarrenBelz 145,666

#2
RandyHayes Profile Picture

RandyHayes 76,287

#3
Pstork1 Profile Picture

Pstork1 64,996

Leaderboard