Manipulating all SharePoint list data

[Zango]

Hi,

I am trying to create a trends list that should collate totals from a couple of different lists that I can fill periodically (every week or every month or so).

I wrote some javascript to test I knew what I wanted to get from the rest api and manipulated the data like I wanted ready to post back and create a new item in the trends list.

I have tried to rewrite this using MSFlow but seem to be having some performance issues.

First i initialize a variable called NextLink with the rest query for all items (if more than 100 items it returns a nextLink parameter which I use to replace this)

I also initialize a variable for an empty array

Then I start a do until condition because I want to put all items into the array not just the first 100

In this do until I use the "Send an HTTP request to sharepoint" action as a get request with my NextLink variable as the Uri.

Here I parse the JSON body then use an Apply to each condition to push all items into my array

After this I use a condition to check the nextLink property from the items.

If its null i set my NextLink variable to be "nolink" (this is the the text i am checking for in the do until)

if it is set to a value I know I need to make another request with this new NextLink

I use a compse function to format this into the string that needs to go into the Send an HTTP request to SharePoint as it has to be just the rest call not the full link that the property provides, then set my NextLink

When the do until is complete I show the array to see that I have all the data, and I do which is great.

The overview of the flow if it helps looks like this

HOWEVER it is taking more than 10 minutes to run this flow, it takes seconds in js 

Am I doing something wrong or is this just a limitation of flow?

[v-bacao-msft]

Hi @Zango ,

If Flow run successfully, you could try to configure Settings in Apply to each to shorten the execution time.

Image reference:

Hope it helps.

Best Regards,

[Zango]

Unfortunately this hasn't helped - with the parrallel option on and set to 50 it has upped the duration even more 😮