web
You’re offline. This is a read only version of the page.
close
Skip to main content

Announcements

News and Announcements icon
Community site session details

Community site session details

Session Id :
Power Platform Community / Forums / Power Apps / Behavior of AI Builder...
Power Apps
Answered

Behavior of AI Builder when accessed by parallel requests

(0) ShareShare
ReportReport
Posted on by 13

What behavior can I expect, if I have 1 AI Builder block and 10 or 100 requests are executed simultaneously to analyze a form? Let’s take 100 and that one request against my current model takes 20s at the moment

 

- Do they get queued? So results are returned back one by one. The last one in queue would need to wait 2000 seconds? Is there a time out?

- Does the service only except a limited amount of requests? Like 10 get their result fairly fast. 90 are gettinging on error immediately?

- Do they all get processed at the time and yield a resource error like out of memory or similar? Do they return in 2000 seconds?

 

thank you for sharing some insights

Categories:
  • Verified answer
    CedrickB Profile Picture
    Microsoft Employee on at

    We are supporting concurrent requests which allows to process up to several thousand files per hours.
    So if you set a degree of parallelism of 30 and the unit time to process your form is 15s, then the total delay to get your 30 items processed shouldn't be significantly higher than the 15s required for one document.

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Season of Sharing Community Challenge Winners!

Congratulations to our community stars!

Kudos to our 2025 Community Spotlight Honorees

Expanding mentorship, skilling, and AI innovation

Congratulations to the July Top 10 Community Leaders!

These are the community rock stars!

Leaderboard > Power Apps

#1
11manish Profile Picture

11manish 402 Super User 2026 Season 2

#2
Mohsin Ali Profile Picture

Mohsin Ali 328

#3
WarrenBelz Profile Picture

WarrenBelz 296 Most Valuable Professional

Last 30 days Overall leaderboard