Processing more than 5000 records

(0) Share

Report

Posted on by NPrice99

1,302

I have a Dataverse table which has 48,000 records.

I want to process the table 5,000 records at a time.

When I have processed a record I stamp it as "Done".

The idea being that after I have done the first 5,000, I can rerun the PowerAutomate flow by looking for records where the forementioned column does not have 'Done' in it.

So the question is when I run the PowerAutomate Flow for the second time and I set the Row Count to 5,000, does the List Rows with filter set to - not(contains(<column_Name>,'Done')) actually work or does it pick up the first 5,00 records all have which have the column set to 'Done' so does not actually find any records to process ?

Thanks In Advance.

Nigel

Categories:

General topics

I have the same question (0)

All responses (3)

Answers (0)

Sort by

Matthy79 4,188 Super User 2024 Season 1 on at

Like (0)

Report
Copy link

Link copied!

It will work and filter the next 5000 rows but if you want to process that much data in Power Automate you will soon get throttled.

Was this reply helpful? Yes No
NPrice99 1,302 on at

Like (0)

Report
Copy link

Link copied!

if i cannot use PowerAutomate what should i use ? the data is in Dataverse.

Was this reply helpful? Yes No
Matthy79 4,188 Super User 2024 Season 1 on at

Like (0)

Report
Copy link

Link copied!

You can upgrade your license or change to logic apps (other license model). But you should always look a t the flow if you can skip actions there. Apply to each (or do loop) is always a multiplier. So if you get rid of one action inside your loop, you will skip 5000 action each run. Be aware of that.

Was this reply helpful? Yes No