timeout error in flow with large data sets and long calculations?

[Oskarkuus]

I cant figure out why my flow is failing.

At exaclty 10 minutes i get the error "Flow run timed out. Please try again."

I have a very large data set, sharepoint list. It have about 40000 rows.

I do calculations with about 2000-4000 rows at a time. I cant filter it down any more.

I use get items connectior to the sharepoint list

then use the get items filter settings to filter on values in columns

then i use compose to count the rows

and a variable to increment values.

i have tried to put a delay after each apply to each, read somewhere that it could help to delay the flow if some kind of count limit?

i would be very sad if i cant use my flow since it is so awesome and do exaclty what i need 😄

[Pstork1]

Take a look at the following limits for Microsoft Flow.  I suspect you are running into issues with maximum processing limits and timeouts. You may need to refactor your application to be more efficient.  I would try to help, but the screenshot comes across at such poor resolution its impossible to make out any details.  You'll need to break it down into multiple images.

https://docs.microsoft.com/en-us/flow/limits-and-config

[Oskarkuus]

Here are a few pictures

I took screens of the largest/heaviest calculations. The rest is way smaller.

I have read about filter arrays but i dont understand how to use them together with get items....

My flow is already sooo long it is hard to work in it. I wish there was a way to make it more compact and give a better overview when adding multiple stages like i do now.

[v-bacao-msft · Accepted solution]

Hi @Oskarkuus ,

You could try to set Apply to each and improve the degree of Parallelism to improve the execution efficiency of the action in Apply to each.

Please take a try and see if this improves your current situation.

Image reference:

Best Regards,