You’re offline. This is a read only version of the page.
I want to use a power automate process to insert data from a daily csv file into a customer dataverse table, however, there is the 5000 pagination restriction. What would be the best way to do this? Thanks for the advice. Also, is there a way (after the initial data load) to check for any existing records to either update, skip, or add new (from future files)?
Hi @iskguy
if you got premium plan then you can increase this limit, otherwise might need to do some work around as mentioned in below article.
http://thebaretta.blogspot.com/2018/09/microsoft-flow-apply-to-each-limitation.html
I am parsing already to JSON and I get the error when trying to write the rows in the Apply to Each: Unable to process template language expressions for action 'Apply_to_each' at line '0' and column '0': 'The number of foreach items limit exceeded for action 'Apply_to_each': maximum '5000' and actual '116320'.'.
Please check the approach below to implement pagination in powerautomate
https://www.c-sharpcorner.com/article/simple-paging-with-fetchxml-on-lists-in-power-automate/
Hi @iskguy ,
Please refer following example article for this..
https://manueltgomes.com/microsoft/powerautomate/how-to-parse-csv-file/
since this parses CSV to JSON and imports one row at at time, I guess it should resolve this 5k limit issue....
hope this helps..
#1
WarrenBelz
637
Most Valuable Professional
#2
stampcoin
570
Super User 2025 Season 2
#3
Power Apps 1919
473
Share
Report
All responses (
Answers (
