Skip to main content

Notifications

Announcements

Replay: Power Platform Community AMA - Copilot Studio | April
Welcome to the Power Platform Communities
News and Announcements icon
Community site session details

Community site session details

Session Id : jyHwo+pBpKw+ejE/LbrTv9
Power Platform Community / Forums / Power Automate - General Discussion / Failed to get data mor...
Power Automate - General Discussion
Answered

Failed to get data more than 5000 when using Recurrence

Like (1) ShareShare
ReportReport
Posted on 16 Oct 2024 00:49:42 by veracruz 45
Hello, I need help with getting more than 5000 data in one flow.
 
I use Recurrence as the trigger but then I got this error because I set the pagination to 100000 (my data is up to 60000).
 
I tried to filter the data in list rows present in the table step by filtering the Delay column which value is greater than or equals -7, but it didn't work.
 
I can't break the data into a smaller chunk, so is there any way to make the limit bigger so I can get all the data in one go without getting such a limit? So I can use the recurrence for scheduled email.
 
Thank you!
Categories:
Process Advisor
  • SB-21040730-0 Profile Picture
    SB-21040730-0 2 on 21 Apr 2025 at 07:31:31
    Failed to get data more than 5000 when using Recurrence
    Please help me to set up this flow. I have been searching for a solution since months.
  • Suggested answer
    SaiRT14 Profile Picture
    SaiRT14 1,966 Super User 2025 Season 1 on 19 Oct 2024 at 20:31:31
    Failed to get data more than 5000 when using Recurrence

    Steps to Implement Pagination with a Do Until Loop in Power Automate:

    1. Turn on Pagination for Get Items:

      • Go to the settings of the Get Items action and enable Pagination. Set the Threshold to a high enough number (e.g., 100,000) if your dataset exceeds the default 5,000 limit.

    2. Do Until Loop Structure:

      • Wrap the Get Items action inside a Do Until loop. This loop will continue running until you've processed all the items (i.e., until no more items are retrieved).

    3. Use SkipToken for Pagination:

      • If you have many pages of items to process, use the @odata.nextLink (also called SkipToken) to paginate through the results. This is automatically returned by the Get Items action when there are more items to fetch.
  • veracruz Profile Picture
    veracruz 45 on 16 Oct 2024 at 06:23:16
    Failed to get data more than 5000 when using Recurrence
    Hii @FLMike,
     
    So this is a bit of my flow, I use List rows present in table, is that okay to use that one? The one that has a lot of data is in "System". 
    Also, I'm a bit confused with what kind of condition should I use inside Do Until? And how to get the result of Do Until step for the input of the next step? In this case is for my Filter array Null.
     
    Thanks in advance!
     
  • Verified answer
    Michael E. Gernaey Profile Picture
    Michael E. Gernaey 41,398 Super User 2025 Season 1 on 16 Oct 2024 at 05:58:12
    Failed to get data more than 5000 when using Recurrence
    Hi
     
    So helping you is difficult as you didn't share your flow.
     
    But the issue is simple, you need to add a Do Until, and loop through all the iterations of the Pagination.
     
    Your flow almost assuredly has a Get Items, which only gets 5000, but you do this one and exit. You need to wrap your Get Items in a Do Until loop
     
    Do Until 
    Condition: (make up something that will force your flow to keep looping until this condition is set)
     
    Inside do until
      -GetItems(asdfasdf) // here is where you need to have pagination and something to DEFINE what's in a page, so it grabs the values between X and Y, and then     the
        Apply to Each
        Inputs GetItems
              -Process items.
         End of Apply to each
    end of do Until
     
    So think of it, like having two Loops. An outter and an inner. your Get items/Apply to each is the internal, where you update the Filter each "iteration of the Outer loop akka the Do Until", until all rows are processed, then you can set some flag (boolean) that makes the Do until stop looping

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

News and Announcements

Replay: Power Platform Community AMA - Copilot Studio | April
Welcome to the Power Platform Communities

Quick Links

Understanding Microsoft Agents - Introductory Session

Confused about how agents work across the Microsoft ecosystem? Register today!

Markus Franz – Community Spotlight

We are honored to recognize Markus Franz as our April 2025 Community…

Kudos to the March Top 10 Community Stars!

Thanks for all your good work in the Community!

Leaderboard

#1
WarrenBelz Profile Picture

WarrenBelz 146,702 Most Valuable Professional

#2
RandyHayes Profile Picture

RandyHayes 76,287 Super User 2024 Season 1

#3
Pstork1 Profile Picture

Pstork1 66,030 Most Valuable Professional

Leaderboard

Featured topics

How to Ask for Help with Your Power Automate Workflow

Product updates

Microsoft Power Platform Community release plans