cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Anonymous
Not applicable

Only 500 rows added in SQL

Hi,

When I am loading items from share point to SQL it loads only 500 rows but my share point list has more than 8000 lines.

 

Any idea how to solve this?

1 ACCEPTED SOLUTION

Accepted Solutions
Pstork1
Dual Super User
Dual Super User

By default Flow connectors only handle a maximum of 500 records.  If you want to process more than that then you need to add a loop and process the records in batches of 500. For a SharePoint list the easiest way to do this is by filtering on the ID field in the list.



-------------------------------------------------------------------------
If I have answered your question, please mark your post as Solved.
If you like my response, please give it a Thumbs Up.

View solution in original post

3 REPLIES 3
Pstork1
Dual Super User
Dual Super User

By default Flow connectors only handle a maximum of 500 records.  If you want to process more than that then you need to add a loop and process the records in batches of 500. For a SharePoint list the easiest way to do this is by filtering on the ID field in the list.



-------------------------------------------------------------------------
If I have answered your question, please mark your post as Solved.
If you like my response, please give it a Thumbs Up.
Anonymous
Not applicable

Thanks a lot for quick response!

 

Could you please show or tell some example for share point list?

 

Annotation 2019-08-03 014217.jpg

Hi @Anonymous 

 

You can go to settings of the Get Items action and set limit to 5000

This should fetch 5000 records

Same thing for the for loop

Capture.PNG

 

If you have Flow P1 or P2 license you can expand this threshold to 100,000

 

Since you have 8k records you would have to fire get items query in a loop

example - fetch 5000 items first

then process it into sql

 

then again run same loop for next 5k items and process

 

 

 

Regards,

Reza Dorrani

 

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly

Helpful resources

Announcements
Power Platform Conf 2022 768x460.jpg

Join us for Microsoft Power Platform Conference

The first Microsoft-sponsored Power Platform Conference is coming in September. 100+ speakers, 150+ sessions, and what's new and next for Power Platform.

MPA Virtual Workshop Carousel 768x460.png

Register for a Free Workshop

Learn to digitize and optimize business processes and connect all your applications to share data in real time.

Power Automate Designer Feedback_carousel.jpg

Help make Flow Design easier

Are you new to designing flows? What is your biggest struggle with Power Automate Designer? Help us make it more user friendly!

Users online (2,116)