Power Automate

Filter Array Connector stopped working

(1) Share

Report

Posted on by LA07K1

Please note

I did not build this app, thereby my responses may take a bit longer than usual.
Dataverse table 'Pricing' holds 1.7m+ Rows.
I cannot provide certain data or tables due to sensitivity of data.

Overview

I have a flow which in short looks at pricing parts based on a service bus message.

The app has been used for over a year now and the size of data which the filter is operating on increases as time passes.

The issue is the filter always outputs an empty array. I have manually checked the tables and the output should exist.

Furthermore, this is a Production only issue. The exact same process is followed in UAT for the same Parts and it executes as expected.

The only difference being the amount of data being filtered.

Initially the issue only occurred for one part, however it is now causing multiple failures as more parts are added into the data table.

The data is needed in the table for audit purposes hence why it is not being deleted.

The filter can experience between 1 to 50k+ records going through it at one time.

Questions

Is there a limitation on the number of rows a filter query can process in power automate?

If the above is yes, Is there any way to mitigate this issue i.e. archiving/deactivating records?

Screenshot

*Outputs in 'Filter Rows' is a composed filter query done previously in the flow i.e. xyz eq GUIDvalue

Filter Query

@and(equals(item()?['prefix_Table/column'], variables('RequestMessageObject')?['item0']), equals(item()?['prefix_Table/column2'], variables('RequestMessageObject')?['item1']), equals(toLower(item()?['prefix_Table/LookupTable/column3']), toLower(variables('RequestMessageObject')?['item2'])), equals(item()?['prefix_Table2/column4'], 'true'))

Categories:

Building flows

I have the same question (0)

All responses (2)

Answers (0)

Suggested answer

Michael E. Gernaey 53,433 Super User 2025 Season 2 on at

Like (0)

Report

Hi

TMI lol but its better to have too much than not enough.

The answer is, yes there is a limit to how much its going to full back and if your Filter is NOT delegatable, then you might even get 0, if all the ones you should get back from a sequential perspective, they come after the top 500 or top 2000 depending on the delegation configuration.

My real suggestion would be to do this

1. Create a SUPER Simple canvas app with 2 things

-a button

-a text label

2. Run a flow or simply open one that ran before and "failed"

3. Grab the syn tax of the filter from the Run

4. Go into the power app, and into the button code and run that filter against the data source.

5. First, now you can see if anything is being delegated.

and if so or not, you can put all the rows into a collection

then in the label put Text(CountRows(collectionName))

And see how many it returns so we can figure out if its a bug in your filter, the data or a delegation issue.

Was this reply helpful? Yes No
LA07K1 6 on at

Like (0)

Report

Hey @FLMike,

Thanks for your response,

Doesn't the delegation limits you specified relate specifically to powerfx expressions within PowerApps?

The flow doesnt depend on any power app filter query, it is using the Filter Array Connector within power automate.

I cant find any documentation to suggest there is a limit to how many records it can process.

Also with your suggestion, I cannot add any unmanaged solutions into Production or add any extra applications.

But the data exists, the filter also works, and has worked for a year but it is failing now for specific parts as the data size grows

Was this reply helpful? Yes No