Skip to main content

Notifications

Power Automate - General Discussion
Suggested answer

Safest Pagination Threshold Limit

(1) ShareShare
ReportReport
Posted on by 4
Is there a safest threshold limit that I can use for a scheduled and manually triggered flows? For example, if I have more than 100,000 items that I need to process in one SP list/table alone, I can set my pagination to the maximum threshold limit of 100,000, as per my online research.  Will there be an impact to the succeeding flows that will be running if I set the pagination to a 100,000 limit? Will it cause long-running flows? 
Categories:
  • lbendlin Profile Picture
    lbendlin 7,597 on at
    Safest Pagination Threshold Limit
    If you have that many items in your SharePoint List you should start asking yourself if maybe a SQL Server database (or similar) would be a better option.
  • power01 Profile Picture
    power01 4 on at
    Safest Pagination Threshold Limit
    Thanks for the helpful answer! I have another question: is there a way to identify which ID has the highest number of rows in a specific table or list? For example, if I need to process a batch of 100 IDs, and the table contains an 'ID' column with duplicate rows/values, it would be helpful to know which ID has the highest row count. For instance, ID 1A might have 100 rows, ID 1B might have 50 rows, and ID 1C might have 80 rows, and so on. Knowing this would be useful because if the pagination limit isn’t set correctly, there’s a risk that some rows might not be processed in the next run.
  • Suggested answer
    FLMike Profile Picture
    FLMike 29,105 on at
    Safest Pagination Threshold Limit
    Hi,
     
    There is no different if you break it down into smaller chunks, "per se". If you are triggering this flow 10000 times it isn't going to matter if you do 2k chunks or 45 at a time, it won't work.
     
    You should make sure this flow has Concurrence turned on for the trigger and set to 1, so no more than 1 copy at a time can be running.
     
    It's also impossible to tell you what impact. If you are a customer that has 3 flows, this is one and the others fire 1 time every 10 years.. is not the same as finding out someone has 10 of these types of flows and 300 others all working at the same time.
     
    There is no "safe" threshold for pagination as it relates to performance. it takes understanding the entire environment ecosystem.
     
    For me I do not like to do 100K at a time. I want to get as many done in smaller batches 10-20K so that I can more readily see and gauge performance and timing.
     
    I would make it configurable as an Environment Variable. then run some tests for yourself. This way you can test, without redeploying each time you change the pagination size.
     

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Microsoft Kickstarter Events…

Register for Microsoft Kickstarter Events…

Announcing Our 2025 Season 1 Super Users!

A new season of Super Users has arrived, and we are so grateful for the daily…

Announcing Forum Attachment Improvements!

We're excited to announce that attachments for replies in forums and improved…

Leaderboard

#1
WarrenBelz Profile Picture

WarrenBelz 145,422

#2
RandyHayes Profile Picture

RandyHayes 76,287

#3
Pstork1 Profile Picture

Pstork1 64,711

Leaderboard