Unanswered

Using Data source with large data sets.

(0) Share

Report

Posted on by Srikanth96

Hello All,

I am creating a power apps application with SharePoint as the data source and I am required to move data from an excel file that has 26 columns and around 70000 rows. I have managed to do this with MS Access where I have linked the Excel file to Access and ran an append query to transfer the data to SharePoint. My client wishes to move this process out of MS Access.

What are the alternatives for moving data from Excel to SharePoint provided that I do not have a premium license for PowerApps/Power Automate?

Categories:

Building Power Apps

I have the same question (0)

All responses (4)

Answers (0)

Sort by

Power Platform 1919 2,205 Super User 2026 Season 1 on at

Like (0)

Report
Copy link

Link copied!

Hi @Srikanth96,

If you’re planning to move data from Excel to SharePoint, you can achieve this using Power Automate. Instead of using Apply to each for every record (which can slow things down), consider using an HTTP request to SharePoint. This approach is much faster and more efficient for bulk upserts.

Was this reply helpful? Yes No
Arun K Rajan 25 on at

Like (0)

Report
Copy link

Link copied!

Hi,

To push data to SharePoint from Excel i would suggest 2 options either use some import apps from SharePoint store like Import Excel then you can map the columns and push the data but it is good for one time activity to the same list. and other option will be by using powershell this will be more robust and you will have full control the PS Script will look like below.

Connect-PnPOnline -Url "your tenant url till site name" -UseWebLogin

$excel = Import-Excel "your excel location "
foreach ($row in $excel) {
Add-PnPListItem -List "your list name" -Values @{
Column1 = $row.Column1
Column2 = $row.Column2
# ... map all 26 columns
}
}

first try with some small list and see how it is working for you then prepare the script and push the data to your actual list.

if you have PowerAutomate then below solution suggested byPower Apps 1919 will work easily.

if you need any help please let us know.

Regards,

Arun

Was this reply helpful? Yes No
Srikanth96 40 on at

Like (0)

Report
Copy link

Link copied!

@Power Apps 1919 I have tried using batch processing to send the data from excel to SharePoint but there is a pagination bottleneck of 5000 in the 'List rows present in a table' step in power automate:

When I tried to change it to a higher threshold, it gives me an error related to licensing:

Was this reply helpful? Yes No
Power Platform 1919 2,205 Super User 2026 Season 1 on at

Like (0)

Report
Copy link

Link copied!

Hi @Srikanth96,
Not sure what happened, i am able to get all the rows: (please check my setting, this can help) -- i am using onedrive to access the excel file
sample pic: (this table has 28 columns and 70K rows) but it took around 10 mins to the result

result:

Was this reply helpful? Yes No