cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Anonymous
Not applicable

Only 500 rows added in SQL

Hi,

When I am loading items from share point to SQL it loads only 500 rows but my share point list has more than 8000 lines.

 

Any idea how to solve this?

1 ACCEPTED SOLUTION

Accepted Solutions
Dual Super User
Dual Super User

Re: Only 500 rows added in SQL

By default Flow connectors only handle a maximum of 500 records.  If you want to process more than that then you need to add a loop and process the records in batches of 500. For a SharePoint list the easiest way to do this is by filtering on the ID field in the list.



-------------------------------------------------------------------------
If I have answered your question, please mark your post as Solved.
If you like my response, please give it a Thumbs Up.

View solution in original post

3 REPLIES 3
Dual Super User
Dual Super User

Re: Only 500 rows added in SQL

By default Flow connectors only handle a maximum of 500 records.  If you want to process more than that then you need to add a loop and process the records in batches of 500. For a SharePoint list the easiest way to do this is by filtering on the ID field in the list.



-------------------------------------------------------------------------
If I have answered your question, please mark your post as Solved.
If you like my response, please give it a Thumbs Up.

View solution in original post

Anonymous
Not applicable

Re: Only 500 rows added in SQL

Thanks a lot for quick response!

 

Could you please show or tell some example for share point list?

 

Annotation 2019-08-03 014217.jpg

Dual Super User
Dual Super User

Re: Only 500 rows added in SQL

Hi @Anonymous 

 

You can go to settings of the Get Items action and set limit to 5000

This should fetch 5000 records

Same thing for the for loop

Capture.PNG

 

If you have Flow P1 or P2 license you can expand this threshold to 100,000

 

Since you have 8k records you would have to fire get items query in a loop

example - fetch 5000 items first

then process it into sql

 

then again run same loop for next 5k items and process

 

 

 

Regards,

Reza Dorrani

 

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly

Helpful resources

Announcements
thirdimage

Power Automate Community User Group Member Badge

Fill out a quick form to claim your user group badge now!

firstImage

Incoming: New and improved badges!

We've given our badges an overhaul and also added some brand new ones!

fifthimage

Microsoft Learn

Learn how to build the business apps that you need.

sixthImage

Power Platform World Tour

Find out where you can attend!

seventhimage

Webinars & Video Gallery

Watch & learn from the Power Automate Community Video Gallery!

Top Kudoed Authors (Last 30 Days)
Users online (6,007)