web
You’re offline. This is a read only version of the page.
close
Skip to main content

Announcements

News and Announcements icon
Community site session details

Community site session details

Session Id :
Power Platform Community / Forums / Power Apps / Insert 100000 rows fro...
Power Apps
Answered

Insert 100000 rows from csv file

(0) ShareShare
ReportReport
Posted on by 402

I want to use a power automate process to insert data from a daily csv file into a customer dataverse table, however, there is the 5000 pagination restriction.  What would be the best way to do this?  Thanks for the advice.  Also, is there a way (after the initial data load) to check for any existing records to either update, skip, or add new (from future files)?

I have the same question (0)
  • MayankP Profile Picture
    464 on at

    Hi @iskguy ,

     

    Please refer following example article for this..

     

    https://manueltgomes.com/microsoft/powerautomate/how-to-parse-csv-file/

     

    since this parses CSV to JSON and imports one row at at time, I guess it should resolve this 5k limit issue....

     

    hope this helps..

  • Mira Ghaly Profile Picture
    11,415 Moderator on at

    @iskguy 

    Please check the approach below to implement pagination in powerautomate

     

    https://www.c-sharpcorner.com/article/simple-paging-with-fetchxml-on-lists-in-power-automate/

     

     

  • iskguy Profile Picture
    402 on at

    Thanks for the reply, but this article I already did see and this is getting data OUT of dataverse, not writing to it.

  • iskguy Profile Picture
    402 on at

    I am parsing already to JSON and I get the error when trying to write the rows in the Apply to Each: Unable to process template language expressions for action 'Apply_to_each' at line '0' and column '0': 'The number of foreach items limit exceeded for action 'Apply_to_each': maximum '5000' and actual '116320'.'.

  • Verified answer
    Mira Ghaly Profile Picture
    11,415 Moderator on at

    @iskguy 

    Have you considered using Dataflows ?

  • iskguy Profile Picture
    402 on at

    The error I get is coming out of Power automate.  Is that the dataflow, or is dataflow something different?

  • MayankP Profile Picture
    464 on at

    Hi @iskguy 

     

    if you got premium plan then you can increase this limit, otherwise might need to do some work around as mentioned in below article.

    http://thebaretta.blogspot.com/2018/09/microsoft-flow-apply-to-each-limitation.html

     

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Season of Sharing Community Challenge Launch!

Jump in, show your community spirit, and win prizes!

Kudos to our 2025 Community Spotlight Honorees

Expanding mentorship, skilling, and AI innovation

Congratulations to the May Top 10 Community Leaders!

These are the community rock stars!

Leaderboard > Power Apps

#1
Valantis Profile Picture

Valantis 483

#2
WarrenBelz Profile Picture

WarrenBelz 399 Most Valuable Professional

#3
11manish Profile Picture

11manish 327

Last 30 days Overall leaderboard