Overview
List Rows is filtering a set of data from a Dataverse table and returns 500k+ records.
The filter query is then executing another set of filter criteria on the data that comes out of the List Rows connector.
The issue is, there are a number of items which are added to this table based upon popularity of a users selection. Thereby the data exceeds 500k+ for particular items.
These items go through the filter query and despite the filter being correct, the output is always an empty array. This results in me returning an error message to the user which is incorrect.
I have tracked the record based off the filter criteria manually through the tables and the records exist. But the filter still doesn't work.
Data is continuously added everyday and now the number of items this is happening to is increasing as time passes.
I have opened a microsoft ticket but the response hasnt been as helpful as I expected and has taken a month with not much response from them.
I have 2 questions:
- Does the filter query connector have a throttling limit? as I havent found any documentation to suggest this is the case
- If the above is true and there is a throttling limit, would archiving or deactivating records retrieve less datarows when listing/filtering?
- Has anyone else experienced this issue and come to a resolution?
To note:
- I cannot provide the data examples as the data is sensitive
- I did not build this flow or application so my response to questions asked may take a bit longer if I dont have the immediate answer