Showing results for 
Search instead for 
Did you mean: 
New Member

Looping Through Web Page and Scraping Account Data, PAD Stops Grabbing Data After First

Could you help with a puzzle? I'm scraping data from a web form holding user data. I use a loop as described in this MS page. This was working remarkably well, pulling data from each page load. I continued to develop the flow, however, and something broke. The flow now scrapes the data on the first page load, then will not do so on the following pages. 


Since the site is private, I thought I could share the flow using the screen shots, below. 


PAD Problem.1.pngPAD Problem.2.png

Memorable Member
Memorable Member

Hi @flugruger 


In line #27, could you try going to the URL instead of back and check what happens.

Also give some wait time for the page to load.

New Member

Thanks, @VJR . This website is a pain. I can't go directly to the URL. I can't even reload a page without it taking me back to the log-in. 


I'm new to PAD... have you folks had good luck with it scaping sites? For me with this site, it is failing. The JQuery references can be unique, but PAD still isn't grabbing the data. 


Any suggestions or advice?

Advocate I
Advocate I

@flugruger Yes, pretty successful with data extraction. As long as the selector order/count remains the same, you should be able to use it without issue. I could provide more guidance if you could indicate if you're attempting to extract single information or tables. 

Helpful resources

2022 Release Wave 1 760x460.png

2022 Release Wave 1 Plan

Power Platform release plan for the 2022 release wave 1 describes all new features releasing from April 2022 through September 2022.

Community Connections 768x460.jpg

Community & How To Videos

Check out the new Power Platform Community Connections gallery!

Users online (2,920)