cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Highlighted
Anonymous
Not applicable

Only 500 rows added in SQL

Hi,

When I am loading items from share point to SQL it loads only 500 rows but my share point list has more than 8000 lines.

 

Any idea how to solve this?

1 ACCEPTED SOLUTION

Accepted Solutions
Super User
Super User

Re: Only 500 rows added in SQL

By default Flow connectors only handle a maximum of 500 records.  If you want to process more than that then you need to add a loop and process the records in batches of 500. For a SharePoint list the easiest way to do this is by filtering on the ID field in the list.



-------------------------------------------------------------------------
If I have answered your question, please mark your post as Solved.
If you like my response, please give it a Thumbs Up.

View solution in original post

3 REPLIES 3
Super User
Super User

Re: Only 500 rows added in SQL

By default Flow connectors only handle a maximum of 500 records.  If you want to process more than that then you need to add a loop and process the records in batches of 500. For a SharePoint list the easiest way to do this is by filtering on the ID field in the list.



-------------------------------------------------------------------------
If I have answered your question, please mark your post as Solved.
If you like my response, please give it a Thumbs Up.

View solution in original post

Anonymous
Not applicable

Re: Only 500 rows added in SQL

Thanks a lot for quick response!

 

Could you please show or tell some example for share point list?

 

Annotation 2019-08-03 014217.jpg

Super User
Super User

Re: Only 500 rows added in SQL

Hi @Anonymous 

 

You can go to settings of the Get Items action and set limit to 5000

This should fetch 5000 records

Same thing for the for loop

Capture.PNG

 

If you have Flow P1 or P2 license you can expand this threshold to 100,000

 

Since you have 8k records you would have to fire get items query in a loop

example - fetch 5000 items first

then process it into sql

 

then again run same loop for next 5k items and process

 

 

 

Regards,

Reza Dorrani

 

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly

Helpful resources

Announcements
firstImage

Microsoft Business Applications Virtual Launch Event

Watch the event on demand for an in-depth look at the new innovations across Dynamics 365 and the Microsoft Power Platform.

firstImage

Watch Sessions On Demand!

Continue your learning in our online communities.

Power Platform 2019 Release Wave 2 Plan

Power Platform 2019 Release Wave 2 Plan

Features releasing from October 2019 through March 2020.

thirdimage

Flow Community User Group Member Badge

Fill out a quick form to claim your user group badge now!

fifthimage

Microsoft Learn

Learn how to build the business apps that you need.

sixthImage

Power Platform World Tour

Find out where you can attend!

seventhimage

Webinars & Video Gallery

Watch & learn from the Flow Community Video Gallery!

Users Online
Currently online: 453 members 4,977 guests
Please welcome our newest community members: