I have a flow that can create up to 3,500 SharePoint tasks in one "Apply to Each" (it has to create 7 tasks, Monday through Sunday) for 500 entities).
I'm leery of using the Concurrency control since this is a SharePoint Online list and it can take up to 3 minutes to delete 100 items from this large list (it holds up to 950,000 items and there are 15 fields in each item, one of which can be an extensive multi-line notes field).
Does anyone have experience with using Concurrency in an "Apply to each" that can create so many tasks? I'm afraid that hitting the SharePoint list with so many writes at once would make it skip records or hang up. However, it would be nice to make the flow run faster by perhaps setting the concurrency to 10?
Correct, but that's not what I'm asking. In my Flow, each "Apply to Each" can create up to 3,500 SharePoint items, so the 5,000 limit is not an issue. The issue is:
How many "Create Item" commands can a SharePoint list deal with concurrently?
I assume that a SharePoint list can't handle 3,500 simultaneous commands to "Create Item". But is it safe to ask it to create 20 concurrently. Note that the SharePoint list can have as many as 950,000 items in it.
As of 07/23/2021, I was able to use a SharePoint Create Item action within an Apply to Each running at 13 concurrency within another Apply to Each running at 15 concurrency, so 13 x 15 = 195 Create Item actions at a time.
This could go for a few hours before getting throttled.
I couldn't get it to run anything much higher than this, so I think the concurrent request limit for SharePoint is currently around 200 for a few thousand rows of data. If you want to do more than a few thousand actions, then I suggest drastically reducing the concurrency to achieve about 100 actions per minute or less and using exponential retry policies to avoid being throttled. Plus you may be limited in the number of flow actions per day based on your licenses.
Here are more resources about this:
Check out the News & Announcements to learn more.
Participate in the Power Virtual Agents Community Challenge
Power Platform release plan for the 2021 release wave 2 describes all new features releasing from October 2021 through March 2022.
Check out our new Discover Your Career Path blog post series and get all the details.