Web Scraping Documentation

[ghdunn]

Hi all,

Can anyone provide any documentation or tutorials on web scraping?

I would like to be able to go to Amazon, enter an author, and then scape key fields from each entry on the book list.

Power BI has a Web Scraping by example capability, but it has constraints in that it cant click on  to the next page.

Other RPA products have capabilities to do this 'by example' ...and both click on to the next page AND click into each individual page...I was wondering if UI path had any of this functionality currently.

Gerald

[yashag2255 · Accepted solution]

Hey @ghdunn 

So Ui Flows in Power Automate use Selenium as an extension to record web/ browser based UI Flows. You might want to check how to scrape data from a web page using selenium and be able to replicate that with the UI Flows. As about documentation, there is no documentation in place as of now to outline a step by step approach to what you have mentioned. 

Hope this Helps!

If this reply has answered your question or solved your issue, please mark this question as answered. Answered questions helps users in the future who may have the same issue or question quickly find a resolution via search. If you liked my response, please consider giving it a thumbs up. THANKS!

[ghdunn]

interestingly, selenium seems to kick off a script in amazon which just hangs and I haven't been able to find a solution to that,

but the general point about selenium being the 'engine' of RPA is useful to know...thanks