How I get href links for elements has no links ?

[zin45]

Hi

I want to scrap https://bubble.io/videos youtube links but the tip/course blue area has no href so how I get the link ?

[Kaif_Siddique]

The element is not having YouTube link. So i would suggest first click on it and copy url from next page.

[VJR]

If nothing else works use Move mouse to text on screen (OCR) and send a mouse click. 

[zin45]

Thanks guys can you please provide more details about the actions and loop I need to use ? I am beginner with power automate 

[VJR · Accepted solution]

If you want to extract the hyperlinks use as below

1. Launch browser (Chrome/Edge)

2. Choose the Extract data from web page action

(look up the internet for some videos on how to use this action -> Power Automate Desktop : Web Data Extraction - Extract Data from Web Page - YouTube)

Right click on the "How to use.." and then the ones mentioned below in yellow highlighted 

Then go to the Advanced settings of the Live web helper window

Make changes to the selector as below

html > body > div:eq(1) > div:eq(3) > div > div:eq(1) > div:eq(0) > div

div > div > div > div:eq(1) > a

href

The Live web helper window now shows the list of hyperlinks

After running the process you should now see all the hyperlinks in a datatable variable

The website you are working on also has pagination

So you need to use set element as pager to get the links of the other pages as shown in below video

Extract Data from Multiple Web Pages In Power Automate Desktop - YouTube

Best wishes!

[zin45]

Many thanks

When the short menu appear and try to go the mouse pointer to next menu the menu always close and disappear !!

Another problem the automation reach last page 13 and keep pressing on this page instead I want to store the urls in csv file so I tried like this:

[zin45]

WebAutomation.LaunchChrome.LaunchChrome Url: $'''https://bubble.io/videos''' WindowState: WebAutomation.BrowserWindowState.Normal ClearCache: False ClearCookies: False WaitForPageToLoadTimeout: 60 Timeout: 60 BrowserInstance=> Browser IF (WebAutomation.IfWebPageContains.WebPageDoesNotContainText BrowserInstance: Browser Text: $'''13 OF 13''') THEN WebAutomation.ExtractData.ExtractTableUsingPagingFromAllPages BrowserInstance: Browser Control: $'''html > body > div:eq(1) > div:eq(3) > div > div:eq(1) > div:eq(0) > div''' ExtractionParameters: {[$'''div > div > div > div:eq(1)''', $'''Own Text''', $'''''', $'''Value #1'''], [$'''div > div > div > div:eq(1) > a''', $'''Href''', $'''''', $'''Value #2'''] } PagerCssSelector: $'''html > body > div:eq(1) > div:eq(3) > div > div:eq(1) > div:eq(1) > div:eq(2) > button''' PostProcessData: True TimeoutInSeconds: 60 ExtractedData=> DataFromWebPage END File.WriteToCSVFile.WriteCSV VariableToWrite: DataFromWebPage CSVFile: $'''C:\\Users\\iuser3\\Documents\\bubble.csv''' CsvFileEncoding: File.CSVEncoding.UTF8 IncludeColumnNames: True IfFileExists: File.IfFileExists.Overwrite ColumnsSeparator: File.CSVColumnsSeparator.SystemDefault

[zin45]

[zin45]

Moving from here to here is a big pain

[VJR]

Follow as below to get links of all 13 pages.

After running the process:

You will get 0 to 116 ie; 117 links

Either you can write the above DataFromWebpage variable to a csv using Write to CSV.

Or store it in Excel spreadsheet in the Extract data from webpage action.

[zin45]

but just in case I did not know there still 13 pages 

[VJR]

@zin45 

Add UI element for the below and read its value using Get details of element on webpage

After reading it will give you this

Then using string functions read the value after the word "of" which is 13.

Use Crop Text

This will give the value 13

Pass this value to the number of pages to process.

[zin45]

I think I got all of them thanks to VJR if someone want to learn bubble they are attached.