web
You’re offline. This is a read only version of the page.
close
Skip to main content

Announcements

News and Announcements icon
Community site session details

Community site session details

Session Id :
Power Platform Community / Forums / Power Apps / Collecting 30 000 reco...
Power Apps
Unanswered

Collecting 30 000 records onStart

(0) ShareShare
ReportReport
Posted on by 2

Hey all, I have a problem. I have a datasource with tons of record. I figured out the way to collect them all, but the only collumn I see in my collection is ID. I've placed this query onStart in App. How can I assure that all the collumns will be collected? 

 

Refresh('[dbo].[Picklist]');
Concurrent(
 ClearCollect(
 col1,
 Filter(
 '[dbo].[Picklist]',
 ID >= 1 && ID <= 2000
 )
 ),
 ClearCollect(
 col2,
 Filter(
 '[dbo].[Picklist]',
 ID >= 2001 && ID <= 4000
 )
 ),
 ClearCollect(
 col3,
 Filter(
 '[dbo].[Picklist]',
 ID >= 4001 && ID <= 6000
 )
 ),
 ClearCollect(
 col4,
 Filter(
 '[dbo].[Picklist]',
 ID >= 6001 && ID <= 8000
 )
 ),
 ClearCollect(
 col5,
 Filter(
 '[dbo].[Picklist]',
 ID >= 8001 && ID <= 10000
 )
 ),
 ClearCollect(
 col6,
 Filter(
 '[dbo].[Picklist]',
 ID >= 10001 && ID <= 12000
 )
 ),
 ClearCollect(
 col7,
 Filter(
 '[dbo].[Picklist]',
 ID >= 12001 && ID <= 14000
 )
 ),
 ClearCollect(
 col8,
 Filter(
 '[dbo].[Picklist]',
 ID >= 14001 && ID <= 16000
 )
 ),
 ClearCollect(
 col9,
 Filter(
 '[dbo].[Picklist]',
 ID >= 16001 && ID <= 18000
 )
 ),
 ClearCollect(
 col10,
 Filter(
 '[dbo].[Picklist]',
 ID >= 18001 && ID <= 20000
 )
 ),
 ClearCollect(
 col11,
 Filter(
 '[dbo].[Picklist]',
 ID >= 20001 && ID <= 22000
 )
 ),
 ClearCollect(
 col12,
 Filter(
 '[dbo].[Picklist]',
 ID >= 22001 && ID <= 24000
 )
 ),
 ClearCollect(
 col13,
 Filter(
 '[dbo].[Picklist]',
 ID >= 24001 && ID <= 26000
 )
 ),
 ClearCollect(
 col14,
 Filter(
 '[dbo].[Picklist]',
 ID >= 26001 && ID <= 28000
 )
 ),
 ClearCollect(
 col15,
 Filter(
 '[dbo].[Picklist]',
 ID >= 28001 && ID <= 30000
 )
 ),
 ClearCollect(
 col16,
 Filter(
 '[dbo].[Picklist]',
 ID >= 30001 && ID <= 32000
 )
 ),
 ClearCollect(
 col17,
 Filter(
 '[dbo].[Picklist]',
 ID >= 32001 && ID <= 34000
 )
 ),
 ClearCollect(
 col18,
 Filter(
 '[dbo].[Picklist]',
 ID >= 34001 && ID <= 35000
 )
 )
);
ClearCollect(
 colCombined,
 col1,
 col2,
 col3,
 col4,
 col5,
 col6,
 col7,
 col8,
 col9,
 col10,
 col11,
 col12,
 col13,
 col14,
 col15,
 col16,
 col17,
 col18
)

 



and my collections: 

Andrzej2nl_0-1706716265979.png

 

Categories:
  • CNT Profile Picture
    10,921 Super User 2024 Season 1 on at

    @Andrzej2nl You can use ShowColumns to get all the columns you want. But a word of caution: Getting 30K records could give a performance hit to your App.

     

    Please remember to give a 👍 and accept my solution as it will help others in the future.

  • Andrzej2nl Profile Picture
    2 on at

    @CNT , could you please show me the implementation you think of? 

  • CNT Profile Picture
    10,921 Super User 2024 Season 1 on at

    @Andrzej2nl It depends on the functionality of the App. But as a best practice we should load only the data that is needed at any point. Can you share more about your App. Screen shots would be helpful too.

     

    Please remember to give a 👍 and accept my solution as it will help others in the future.

  • TheRobRush Profile Picture
    11,128 Moderator on at

    Yah @CNT  is definitely right here, should not be a need to view 30k records at same time, it's not even humanly possible. Better to delegate well and let the app load what is needed, as needed.

  • WarrenBelz Profile Picture
    156,528 Most Valuable Professional on at

    Hi @Andrzej2nl ,

    I will throw in some thoughts here as well that I believe are relevant. Assuming you are using SharePoint here, the ID column is only Delegable for Equals = and is not Delegable for Greater Than > or Less Than <, so what you have posted simply will not work. To make a collection bigger than 2,000 items, you need a "shadow ID" numeric column in the list populated with the ID (or any other sequential and unique number you want). I have a blog on the process that may be useful.

    However the main concern is that there is a very good reason that your Data Row Limit is capped at 2,000 and it is related to performance. I have found that anything over 5-8k (depending on the number of fields) slows down considerably with anything other than a very basic query and consequently 30k would be probably unworkable.

     

     

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Season of Sharing Community Challenge Winners!

Congratulations to our community stars!

Kudos to our 2025 Community Spotlight Honorees

Expanding mentorship, skilling, and AI innovation

Congratulations to the July Top 10 Community Leaders!

These are the community rock stars!

Leaderboard > Power Apps

#1
11manish Profile Picture

11manish 409 Super User 2026 Season 2

#2
Mohsin Ali Profile Picture

Mohsin Ali 328

#3
WarrenBelz Profile Picture

WarrenBelz 252 Most Valuable Professional

Last 30 days Overall leaderboard