web
You’re offline. This is a read only version of the page.
close
Skip to main content

Notifications

Announcements

Welcome to the Power Platform Communities
Season of Giving Solutions is Here!
Explore Copilot Studio Forums, Blogs & Galleries!
News and Announcements icon
Community site session details

Community site session details

Session Id :
Power Platform Community / Forums / Power Apps / Periodical uplaod data...
Power Apps
Unanswered

Periodical uplaod data to dataverse (100k+ rows)

(0) ShareShare
ReportReport
Posted on by SimonRA

Hello,

 

I am looking for a way to update a table from an excel file (100k+ row) every nigth.

I am doing it with power automate, deleting the entire table and then uploading every row.

This process takes a while (I am already using parallelism).

 

Does someone found a solution to make it faster?

 

Thanks for your help.

 

Categories:
Microsoft Dataverse with Power Apps
I have the same question (0)
  • Drew Poggemann Profile Picture
    Drew Poggemann 9,287 Most Valuable Professional on at

    Hi @SimonRA ,

    Have you thought about trying dataflows?  Create and use dataflows in Microsoft Power Platform - Power Query | Microsoft Learn

     

    Not sure if a possibility or not based on your data condition but you might want to see if there is a way to reduce the number of records you need to process by comparing the records in Excel to the day before records and only send changes or new records to Dataverse.

  • ivan_apps Profile Picture
    ivan_apps 2,187 Moderator on at

    Definitely dataflows and I would try to calculate the delta first so you only push updates.

    Not sure if your data requirements but I’d be careful of deletion since your are also removing any references those rows had to other tables. That may be ok in your use case but worth bringing up.

     

    I haven’t tested Graph API myself at scale but I have read that it performs much faster at reading and analyzing excel files than the excel connector. It may perhaps improve your pre-processing time if you can’t use dataflows.

    https://www.matthewdevaney.com/fastest-way-to-read-large-excel-table-in-power-automate/

  • satishs Profile Picture
    satishs 11 on at

    I have done this with ADF and Kingswaysoft .  So you this is coming from any datasource you can do this vai these tools. they also support Upserts .

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

News and Announcements

Welcome to the Power Platform Communities
Season of Giving Solutions is Here!
Explore Copilot Studio Forums, Blogs & Galleries!

Quick Links

Forum hierarchy changes are complete!

In our never-ending quest to improve we are simplifying the forum hierarchy…

Ajay Kumar Gannamaneni – Community Spotlight

We are honored to recognize Ajay Kumar Gannamaneni as our Community Spotlight for December…

Congratulations to the November Top 10 Community Leaders!

These are the community rock stars!

Leaderboard > Power Apps

#1
WarrenBelz Profile Picture

WarrenBelz 793 Most Valuable Professional

#2
Michael E. Gernaey Profile Picture

Michael E. Gernaey 333 Super User 2025 Season 2

#3
Power Platform 1919 Profile Picture

Power Platform 1919 268

Last 30 days Overall leaderboard

Featured topics

Auto-Populate field Power Pages
Gallery Tabs - Show or Hide Tabs based on Field Value
How to patch multiple records at once
Enable Copilot for end users in model-driven apps
Question for everyone : How are you using Create Text GPT in AI Builder?
Community content - sample components, blogs etc. - Link to this page (http://aka.ms/PCFdemos)
Welcome to the Power Apps forum!

Product updates

Microsoft Power Platform Community release plans