cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Highlighted
Frequent Visitor

Behavior of AI Builder when accessed by parallel requests

What behavior can I expect, if I have 1 AI Builder block and 10 or 100 requests are executed simultaneously to analyze a form? Let’s take 100 and that one request against my current model takes 20s at the moment

 

- Do they get queued? So results are returned back one by one. The last one in queue would need to wait 2000 seconds? Is there a time out?

- Does the service only except a limited amount of requests? Like 10 get their result fairly fast. 90 are gettinging on error immediately?

- Do they all get processed at the time and yield a resource error like out of memory or similar? Do they return in 2000 seconds?

 

thank you for sharing some insights

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted
Power Apps
Power Apps

Re: Behavior of AI Builder when accessed by parallel requests

We are supporting concurrent requests which allows to process up to several thousand files per hours.
So if you set a degree of parallelism of 30 and the unit time to process your form is 15s, then the total delay to get your 30 items processed shouldn't be significantly higher than the 15s required for one document.

View solution in original post

1 REPLY 1
Highlighted
Power Apps
Power Apps

Re: Behavior of AI Builder when accessed by parallel requests

We are supporting concurrent requests which allows to process up to several thousand files per hours.
So if you set a degree of parallelism of 30 and the unit time to process your form is 15s, then the total delay to get your 30 items processed shouldn't be significantly higher than the 15s required for one document.

View solution in original post

Helpful resources

Announcements
Community Conference

Power Platform Community Conference

Find your favorite faces from the community presenting at the Power Platform Community Conference!

Watch Now

Experience what’s next for Power Apps

See the latest Power Apps innovations, updates, and demos from the Microsoft Business Applications Launch Event.

Power Platform ISV Studio

Power Platform ISV Studio

ISV Studio is designed to become the go-to Power Platform destination for ISV’s to monitor & manage published applications.

secondImage

Power Platform 2020 release wave 2 plan

Features releasing from October 2020 through March 2021

Users online (4,741)