cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Anonymous
Not applicable

Apply to Each limitation

Hello,

 

I've had a look around and not found an answer to this one yet;

 

I've created a flow that copies all the files from a Box folder to a Dropbox folder every x hours. The flow works fine, however the Apply to Each action seems to have a 100 iteration limit - I only see 100 files in the Dropbox folder, and 100 actions on review.

 

The issue is that we have 150+ (and potentially growing) files in Box. Is there a way to increase this limit or a workaround that will copy all the files?

 

Thanks.

1 ACCEPTED SOLUTION

Accepted Solutions
Anonymous
Not applicable

I beleive this was fixed in a recent update

 

Advanced options under 'Get Items' has a maximum get count which you can manually set to whatever you want

View solution in original post

15 REPLIES 15
v-micsh-msft
Community Support
Community Support

Hi @Anonymous,

 

Please check the article below for the limits under Microsoft Flow:

Limits and configuration in Microsoft Flow

109.PNG

So I don't think the issue here is caused by the Apply to Each limitation.

Would you please share some details about the flow configuration, are you using the Box->List files and Folders in a folder action?

In addition, please verify the Body output of the Box->List files and folders in a folder action, confirm that it has all the files loaded.

 

Regards,

Michael

Community Support Team _ Michael Shao
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
Anonymous
Not applicable

Hi @v-micsh-msft,

 

Thanks for looking at this. Yes, I'm using the List files and folders action. I just checked this and it looks like this might be the culptit as I can only see 100 items in the List action results.

 

Here's a copy of the flow as it is now. Are you aware why the List action might be only pulling 100 items?

 

Flow

Anonymous
Not applicable

Answer to this would be great as I am looking at a smilar issue.

I'm currently having this issue with a SP list - apply to each on every item in the list. It does not iterate beyond 100

Anonymous
Not applicable

I beleive this was fixed in a recent update

 

Advanced options under 'Get Items' has a maximum get count which you can manually set to whatever you want

I see that now, appears to have fixed it. Thank you!

 

My existing flows have defaulted to 100 items instead of 512 FYI

Anonymous
Not applicable

I just checked, and this has resolved for my flow too. I didn't have to change anything it just updated.

Flow.PNG

 

Thanks All.

ErichH
Kudo Kingpin
Kudo Kingpin

I have the same issue today. I had 157 items in the sharepoint list, used an ODATA filter string to get the relevant 119 records.

 

yet only 100 records are read by "GET ITEM"

 

Start of FlowStart of FlowPart 2 of flowPart 2 of flowexpanding on the condition where the apply to each is programmed.expanding on the condition where the apply to each is programmed.

see also

https://powerusers.microsoft.com/t5/Building-Flows/get-items-only-returns-100-records/td-p/136883

I do not see an advance setting selection...is there another workaround?  Thanks so much for your help!

Never mind!  I answered my own question.  The pagination is on the get items, not at each... Thanks!

ptempleton
Helper II
Helper II

I am having this issue as well... I do not see an advanced setting for adding more iterations.  I have a folder that receives 300+ files a day and a flow that moves the files out of the received folder into a processing folder but it is only moving 100 files.  This is creating a major bottle neck on file processing.

prashanthspark
New Member

I am facing an issue where Get Items consume 3ms whereas Apply to Each takes 5 days 

I have been iterating on a large list having 15k+ items which show the threshold already as it crossed 5k limit

 

As a workaround, I tried breaking the item limit < 2500 per each based on ID to run the parallel power automate instance (all instance are separate on their own)

 

Any idea how can we tune this - "Apply To Each loop"

 

prashanthspark_0-1616644813153.png

 

  

@prashanthspark  following this to know any suggestions/solution as well.

I found that if iterating through more than 1000 records will cause the flow to run disproportionately slower (e.g. 500 records take 1.5 hours, but 1500 records take 24+ hours). And when I break them up manually into separate instances, it runs much faster. Would love to know how I can optimize this.

Or does anyone know how to build a flow which can automatically break the 'apply to each' loops to 500 records each (e.g. if 2100 records, break it into 5 loops: 500 + 500 + 500 + 500 + 100)

Anonymous
Not applicable

apply all.JPG

Can you use apply all to update all the rows in a excel table? Essentially this would reset the table to have all internal columns updated. I have tried update a row but the flow tends to get very long one for each person.

I am having the exact same problem. When I filter the results to 500 records or so, the flow runs in a few minutes. But I have to run the flow to 8,000 records. So it runs for days.

 

Did you ever find a solution to split the apply to each in 500 records batch?

Helpful resources

Announcements
Power Automate News & Announcements

Power Automate News & Announcements

Keep up to date with current events and community announcements in the Power Automate community.

Community Calls Conversations

Community Calls Conversations

A great place where you can stay up to date with community calls and interact with the speakers.

Power Automate Community Blog

Power Automate Community Blog

Check out the latest Community Blog from the community!

Top Solution Authors
Users online (2,728)