15
Hi, Dataverse has around 40K rows in the table and we basically need to fetch every row to allow the end user to filter out rows that the user wants to see. Currently this takes around 30s to load. Is there any way to cache or preload or other tricks or optimization that we could do to improve the performance of the view. Goal is to get it cached or perform fast so on daily basis the first load could take little longer. Jq ueryis optimized, issue lies when we are getting the data.
Hi @Matias30 ,
sounds good.
Could you close the thread, so others don't have to look into it?
Once you establish your new table, you can post your results to give others the chance of the same approach.
--------------------------------------------------------------------------------------
Hope that helps.
If the post solves your problem, please mark it as solution. If it helps, consider a thumbs up.
I know how to do it, thanks anyway. We are planning to use Power automate to eliminate and modify data we need with a whole new dataverse table to have, I dont know, about 10-15% of rows of the original count. That way we can get rid of some of the jquery too.
Hi @Matias30,
unfortunately I don't think that it will improve you flows much. 40k rows for clients to choose from seems a lot. Can you use dates to decrease the amount of rows.
What you could try as well is using liquid code to get the data and use that in a table where you can filter rows and items. As liquid is server side rendered it could be faster the only thing is that you will need to create the table, filter and submit options yourself. But it could be a solution for your problem.
I was afraid of that. And the 40k wont even be the highest number of rows. Unfortunately the primary goal is to have all the data in one list(not my wish), but probably have to start thinking about splitting that data in to other table and do the mapping etc when retrieving the data to dataverse. Do you see that the issue would improve if we for example would have a column (there is one column which is same for some rows kind of like everything is siblings) that would indicate this is the first value, and we would use that in a list filter, or is the issue still same with the large amount of data it has to go through?
Hi @Matias30,
by using the list view most of your options are currently optimized from Microsoft itself. 40k Rows are quiet a lot.
Next step to improve loading times is really dependent on your dataset.
Is there a row which has not that many unique items. Or could you set such a column?
You could than use different views on different pages, prefiltered to that specific item and reduce the loading time. So maybe 10k rows for 4 unique categories. Would that be a way for you?
Hi @Lucas001 thanks for replying, we are using list view to make the view and then have quite a bit custom code. Basically we are doing quite a bit of elimination and we will only leave some of the data visible, for example we remove every duplicate based on one column with jquery.
Share
Report
All responses (
Answers (
