Process 50K+ Record using Power Automate

(1) Share

Report

Posted on by sachinsoni441

125

Hi everyone,

I am planning to work on Power Automate with an Office 365 E3 license. My Power Automate flow will be begins with a 'When an HTTP request is received' trigger, which receives a JSON array containing 40,000 to 50,000 records from another platform.

I need to process these records based on specific conditions to send 'nudges' on different time via Microsoft Teams using the 'Post adaptive card and wait for a response' action.

Note: The logic will also involve the 'Run a prompt' (AI) action for data translation, 'Compose' steps, and 'Apply to each' loops, and I only have Dataverse (CDS) for storage as option.

What is the best approach to implement this scenario effectively in Power Automate?

Categories:

Using flows

I have the same question (0)

All responses (3)

Answers (0)

Sort by

Suggested answer

Srini007 3,483 Super User 2026 Season 1 on at

Like
a
(1)

Report
Copy link

Link copied!

Hi @sachinsoni441,

First of all I want to mention that for the office E3 license you can use only the standard actions but to you use when a HTTP request is received trigger or doing any Dataverse related that will require a premium license

(If this answers your question you can mark as Answered and give it a Like, it helps others to find the answers)

Regards,

Srini

Was this reply helpful? Yes No
Suggested answer

Riyaz_riz11 4,204 Super User 2026 Season 1 on at

Like
a
(1)

Report
Copy link

Link copied!

Hi,

Split the 40-50K records into child flows using HTTP trigger pagination. Office 365 E3 limits Apply to Each to 5K items and throttles large arrays. Send JSON in 5K batches (add 'page' param), process each batch in child flow with Dataverse batch upserts for storage, schedule Teams nudges via delays/parallel branches. Use 'Run a prompt' sparingly inside loops with concurrency=20 to avoid AI throttling.

If I have answered your question, please mark it as the preferred solution ✅ . If you like my response, please give it a Thumbs Up 👍.
Regards,
Riyaz

Was this reply helpful? Yes No
sachinsoni441 125 on at

Like
a
(0)

Report
Copy link

Link copied!

Hi

@Srini007 @Riyaz_riz11

Thank you for your response,
Thank you for the detailed breakdown of the E3 approach. I understand that the 5,000-item limit and HTTP pagination are necessary workarounds for my current license. However, to simplify the architecture and increase reliability for 50,000 records, I am prepared to upgrade to a Power Automate Premium (per user) or Power Automate Process license.

Given that I will now have access to Premium Connectors, higher Power Platform Request (PPR) limits, and the 100,000-item loop capacity, how should I redesign this flow?

Was this reply helpful? Yes No