Answered

Dataflow to Dataverse only 5000 rows

(0) Share

Report

Posted on by sncueto

Hi,

We are using Dataflow in order to import masive data into dataverse, but recently realized that only 5000 rows were imported (we tested XML and Excel files). I´ve been looking at documentation and I haven't seen specified this limitation. It´s a real limitation? Or is there a way for importing a bigger amount of rows? (pagination or increasing somehow the number of rows).

Regards and thank you for your help.

Categories:

Microsoft Dataverse

Dataflows

All responses (9)

Answers (1)

Naresh_Bittu 4 on at

Like (0)

Report

Re: Dataflow to Dataverse only 5000 rows

Yes i imported from excel(not from dataverse table) to Dataverse(D365) custom table , i seen millions of records in advanced find too.
LoongWang on at

Like (0)

Report

Re: Dataflow to Dataverse only 5000 rows

How to using pagination in dataflow?
Michael E. Gernaey 42,422 Super User 2025 Season 1 on at

Like (0)

Report

Re: Dataflow to Dataverse only 5000 rows

Hi,

You are taking records from one table to another in the same instance?

Also by default the max records retreived BEFORE you need to use the token to get more is 5K. So it sounds like either A) you only have 5k records or B) you aren't using pagination to continue to get records.
Cheers
If you like my answer, please Mark it as Resolved, and give it a thumbs up, so it can help others
Thank You
Michael Gernaey MCT | MCSE | Ex-Microsoft
https://gernaeysoftware.com
LinkedIn: https://www.linkedin.com/in/michaelgernaey
LoongWang on at

Like (0)

Report

Re: Dataflow to Dataverse only 5000 rows

How to do this? Using dataflow from Dataverse Table to Dataverse Table only 5000 rows.
LoongWang on at

Like (0)

Report

Re: Dataflow to Dataverse only 5000 rows

How to do this? Using dataflow from Dataverse Table to Dataverse Table only 5000 rows.
Naresh_Bittu 4 on at

Like (0)

Report

Re: Dataflow to Dataverse only 5000 rows

Hi Guys,

Dataflows can be used to import millions of records in an hours.

I have done POC and adding the results here, we can import 1 lakh of records from excel with in 14 to 18 mins
& we can import 1 millions of records form excel with in 3 hr.

Regards,
Naresh B2
sncueto 19 on at

Like (0)

Report

Re: Dataflow to Dataverse only 5000 rows

Hi @sauravraj62 ,
Sorry for delay, we were using Dataflow to load some unestructured Excel data into Dataverse table. It seems that only 5000 records were loaded but doing deeper checks we saw that it was only related to the limits of recovering records for our kind of license, so everything was ok.

Regards
sauravraj62 Microsoft Employee on at

Like (0)

Report

Re: Dataflow to Dataverse only 5000 rows

Hey @sncueto ,
Which query you used and where? Can you please share some context on the same?
I'm also facing similar kind of issue. Copied 0.1M rows in dataverse table but it's showing only top 5000 rows.

Thanks in advance.
Verified answer

sncueto 19 on at

Like (0)

Report

Re: Dataflow to Dataverse only 5000 rows

After analyzing it further, we realized that the process was running correct, it´s just that Dataverse mention that only have 5000 records, but the fetchxml count query finds the correct number. Just in case happens the same to other.

Regards.