Skip to main content

Notifications

Power Automate - Using Connectors
Unanswered

Run a query against a dataset doesn't show all data

(1) ShareShare
ReportReport
Posted on by 30

Hello All,

 

I am using the 'Run a query against a dataset' connector, and last week I was able to get all 67,000 rows (10 columns) back using this connector, however when using it now this week I am only able to get 58,000 rows (roughly 10,000 less than before) no matter what I do. The connector obviously is able to bring the amount of rows I need back, but I am not able to figure out how to get it to work again. I have tried creating another flow similar to this, I have tested that the query and it shows that the number of rows is correct, it just doesn't seem to work when entered into power automate. 

Has anyone else experienced this and if so how did you fix it. I need all rows to come back at once and to my knowledge I am not hitting any limits. 

 

Please help! 

 

Emily Pollard

  • KC-05022245-0 Profile Picture
    KC-05022245-0 2 on at
    Run a query against a dataset doesn't show all data
    I think it is the Actions Per Workflow limit discussed HERE.  The limit is 500 and that's what I run into.  Output from Run a query against a dataset just stops at 500.  Seems ridiculously low to me.  I'm still searching for a way to deal with this.
  • pmohno Profile Picture
    pmohno 5 on at
    Re: Run a query against a dataset doesn't show all data

    How did you limit the batch size? Was it in query itself or through power automate flow?

  • Rimelflash Profile Picture
    Rimelflash 4 on at
    Re: Run a query against a dataset doesn't show all data

    Thanks, Now it works. After limiting the batch size 2000 rows, now it is able to grab all the columns. 

  • lkkkhgg Profile Picture
    lkkkhgg 9 on at
    Re: Run a query against a dataset doesn't show all data

    It works regardless of the amount of column, but you may need to reduce the batch size. In your case, a batch size of 2000 rows would  work.

  • Rimelflash Profile Picture
    Rimelflash 4 on at
    Re: Run a query against a dataset doesn't show all data

    I think this video solves grabbing rows more than 100K. It seems possible if we have less columns (5-15). But if we have more than 50/60 columns than 'Run a Query against dataset' does not show all the rows. I have a dataset around 5000 rows, If I add all the columns (more than 50), I only get 2227 rows. 

  • rsalam Profile Picture
    rsalam 8 on at
    Re: Run a query against a dataset doesn't show all data

    Do you have measure column? If so you have to define the measure when running the query. 

  • JegErAlan Profile Picture
    JegErAlan 4 on at
    Re: Run a query against a dataset doesn't show all data

    Thanks.  I saw that work-around, and planned on using it if folks still want the larger dump.  Seemed a lot of hoops to jump through.

    But thanks for the response!

  • lkkkhgg Profile Picture
    lkkkhgg 9 on at
    Re: Run a query against a dataset doesn't show all data

    we fixed it, check out this video:

     

    Export MORE THAN 100k rows of Power BI data to CSV using Power Automate | No ROW limits! - Bing video

  • JegErAlan Profile Picture
    JegErAlan 4 on at
    Re: Run a query against a dataset doesn't show all data

    Best I can tell is that there is some total data limit in the "Run a query against a dataset" call.  If I add more columns (more data), I get less rows.  I've been searching, but I haven't seen any documentation that speaks to the limit, whether it can be changed, etc.

     

    I even looked at the raw JSON output of the query step, and its records were limited.  (That is, in my case, it wasn't the "Create CSV table" next step that was causing the limit.)

  • lkkkhgg Profile Picture
    lkkkhgg 9 on at
    Re: Run a query against a dataset doesn't show all data

    I have the exact same issue in multiple flows, I have no idea what is causing this

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Microsoft Kickstarter Events…

Register for Microsoft Kickstarter Events…

Announcing Our 2025 Season 1 Super Users!

A new season of Super Users has arrived, and we are so grateful for the daily…

Announcing Forum Attachment Improvements!

We're excited to announce that attachments for replies in forums and improved…

Leaderboard

#1
WarrenBelz Profile Picture

WarrenBelz 145,636

#2
RandyHayes Profile Picture

RandyHayes 76,287

#3
Pstork1 Profile Picture

Pstork1 64,942

Leaderboard

Featured topics