Unanswered

Dataverse exporting table with flow over 5000 rows

(0) Share

Report

Posted on by ckserra33

421

Hi everyone. I am trying to create a backup CSV file of a dataverse table using flow. This deposits the CSV file into my One Drive and the Flow is working correctly it just will not pull in any more than 5000 rows. The table has 23,000 rows.

Ive searched and see many have this issue but not a definitive answer. I have tried with pagination on and set to 5000/300 and 1000. Ive set row count to 30,000.

Not sure where to go from here. My admin says I have a limit of 40k with my license.

Any help would be great, thank you!

Chris

Categories:

Building Power Apps

I have the same question (0)

All responses (9)

Answers (0)

Sort by

Pstork1 69,601 Most Valuable Professional on at

Like
a
(0)

Report
Copy link

Link copied!

I assume you are using a loop to save the entries and that you have an Office 365 Power Apps license. If that is the case then your license limits you to loops no bigger than 5,000. Using pagination you can get all the records, but can only process 5,000 in a single Apply to each loop. You need a medium or high performance profile to process larger loops. That means a paid license. This is the documentation that explains.

Limits and configuration - Power Automate | Microsoft Learn

Was this reply helpful? Yes No
ckserra33 421 on at

Like
a
(0)

Report
Copy link

Link copied!

HI @Pstork1 Thanks for the response. I have the Power automate free, Office 365 and PowerApps per user plan. If I am reading it right the per user plan is medium performance. Also included a screen shot of my flow, I am not sure if I am using a loop. Thanks again!

Was this reply helpful? Yes No
Pstork1 69,601 Most Valuable Professional on at

Like
a
(0)

Report
Copy link

Link copied!

I agree, with that licensing you should be at a medium performance profile. There is also a 5,000 row limit on the Dataverse connector if you don't implement pagination. Here's an article on how to do pagination.

Power Automate | How to Get More Than 100,000 Rows From a Dataverse Table - Encore Business Solutions

Was this reply helpful? Yes No
ckserra33 421 on at

Like
a
(0)

Report
Copy link

Link copied!

Ive tried that as well with multiple values, currently at 50k with no change.

Was this reply helpful? Yes No
ckserra33 421 on at

Like
a
(0)

Report
Copy link

Link copied!

And row count well over the 25000 rows in the table

Was this reply helpful? Yes No
Pstork1 69,601 Most Valuable Professional on at

Like
a
(0)

Report
Copy link

Link copied!

Set the Row Count itself much lower. When you turn on pagination that becomes the default page size. It should be somewhere between 100-500

Was this reply helpful? Yes No
ckserra33 421 on at

Like
a
(0)

Report
Copy link

Link copied!

When I set the row count to something lower, like 300, thats how many rows it gives me in the CSV file. Tried 300 and it gave me 300

Was this reply helpful? Yes No
Pstork1 69,601 Most Valuable Professional on at

Like
a
(0)

Report
Copy link

Link copied!

Are you setting the row count and the pagination threshold to the same number? It should be 50K for the threshold and 500 for the row count.

Was this reply helpful? Yes No
ckserra33 421 on at

Like
a
(0)

Report
Copy link

Link copied!

Yessir, at 50,000 and 500 it downloads 500 rows

Was this reply helpful? Yes No