Unanswered

Load time issues

(0) Share

Report

Posted on by Matias30

Hi, Dataverse has around 40K rows in the table and we basically need to fetch every row to allow the end user to filter out rows that the user wants to see. Currently this takes around 30s to load. Is there any way to cache or preload or other tricks or optimization that we could do to improve the performance of the view. Goal is to get it cached or perform fast so on daily basis the first load could take little longer. Jq ueryis optimized, issue lies when we are getting the data.

Categories:

General topics

I have the same question (0)

All responses (9)

Answers (1)

Lucas001 2,429 Super User 2025 Season 2 on at

Like (0)

Report

Hi @Matias30,

how do you get the data?
Are you using a list view to show and filter the data, fetchXML, JsonParse?

Was this reply helpful? Yes No
Matias30 15 on at

Like (0)

Report

Hi @Lucas001 thanks for replying, we are using list view to make the view and then have quite a bit custom code. Basically we are doing quite a bit of elimination and we will only leave some of the data visible, for example we remove every duplicate based on one column with jquery.

Was this reply helpful? Yes No
Lucas001 2,429 Super User 2025 Season 2 on at

Like (0)

Report

Hi @Matias30,

by using the list view most of your options are currently optimized from Microsoft itself. 40k Rows are quiet a lot.
Next step to improve loading times is really dependent on your dataset.

Is there a row which has not that many unique items. Or could you set such a column?
You could than use different views on different pages, prefiltered to that specific item and reduce the loading time. So maybe 10k rows for 4 unique categories. Would that be a way for you?

Was this reply helpful? Yes No
Matias30 15 on at

Like (0)

Report

I was afraid of that. And the 40k wont even be the highest number of rows. Unfortunately the primary goal is to have all the data in one list(not my wish), but probably have to start thinking about splitting that data in to other table and do the mapping etc when retrieving the data to dataverse. Do you see that the issue would improve if we for example would have a column (there is one column which is same for some rows kind of like everything is siblings) that would indicate this is the first value, and we would use that in a list filter, or is the issue still same with the large amount of data it has to go through?

Was this reply helpful? Yes No
Lucas001 2,429 Super User 2025 Season 2 on at

Like (1)

Report

Hi @Matias30,

unfortunately I don't think that it will improve you flows much. 40k rows for clients to choose from seems a lot. Can you use dates to decrease the amount of rows.

What you could try as well is using liquid code to get the data and use that in a table where you can filter rows and items. As liquid is server side rendered it could be faster the only thing is that you will need to create the table, filter and submit options yourself. But it could be a solution for your problem.

Was this reply helpful? Yes No
Matias30 15 on at

Like (0)

Report

Thanks for answering Lucas, will probably discuss about the need of new table then.

Was this reply helpful? Yes No
Lucas001 2,429 Super User 2025 Season 2 on at

Like (0)

Report

What I mean is creating a table with liquid inside you Powerpage not in dataverse.
If you need some hints here let me know.

Was this reply helpful? Yes No
Matias30 15 on at

Like (0)

Report

I know how to do it, thanks anyway. We are planning to use Power automate to eliminate and modify data we need with a whole new dataverse table to have, I dont know, about 10-15% of rows of the original count. That way we can get rid of some of the jquery too.

Was this reply helpful? Yes No
Verified answer

Lucas001 2,429 Super User 2025 Season 2 on at

Like (0)

Report

Hi @Matias30 ,

sounds good.
Could you close the thread, so others don't have to look into it?

Once you establish your new table, you can post your results to give others the chance of the same approach.
--------------------------------------------------------------------------------------

Hope that helps.

If the post solves your problem, please mark it as solution. If it helps, consider a thumbs up.

Was this reply helpful? Yes No