cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
bigdan
New Member

Performance issue: "Get details of element on web page"

Hi Community!
I have a web crawler that accesses a webpage and extracts data from there via "Get details of element on web page".
This is super slow, each access takes around 1 second.
Both Chrome and Edge face the same issue.

 

Any idea on how I could fix this?

Thanks a lot! 

 Daniel

unnamed.jpg

1 ACCEPTED SOLUTION

Accepted Solutions
bigdan
New Member

Thank you very much @yoko2020 .
I couldnt get the invoke web service to work because it is a Struts action.
But I found a workaround: 
Instead of getting the details of the web page one by one, I just get the web page text once as string, and parse it.
Thanks for the help, it is much better now!


View solution in original post

2 REPLIES 2
yoko2020
Responsive Resident
Responsive Resident

@bigdan 

- Use invoke web service combine with convert json to custom object (if the website output is in json)

- Use invoke web service combine with regex (if the website output is not in json)

 

You should not using web automation action to crawl big records. It is very slow.

bigdan
New Member

Thank you very much @yoko2020 .
I couldnt get the invoke web service to work because it is a Struts action.
But I found a workaround: 
Instead of getting the details of the web page one by one, I just get the web page text once as string, and parse it.
Thanks for the help, it is much better now!


Helpful resources

Announcements
Power Platform Conf 2022 768x460.jpg

Join us for Microsoft Power Platform Conference

The first Microsoft-sponsored Power Platform Conference is coming in September. 100+ speakers, 150+ sessions, and what's new and next for Power Platform.

MPA Virtual Workshop Carousel 768x460.png

Register for a Free Workshop

Learn to digitize and optimize business processes and connect all your applications to share data in real time.

Power Automate Designer Feedback_carousel.jpg

Help make Flow Design easier

Are you new to designing flows? What is your biggest struggle with Power Automate Designer? Help us make it more user friendly!

Top Solution Authors
Top Kudoed Authors
Users online (1,588)