Share
ReportHi
I want to scrap https://bubble.io/videos youtube links but the tip/course blue area has no href so how I get the link ?
You’re offline. This is a read only version of the page.
Hi
I want to scrap https://bubble.io/videos youtube links but the tip/course blue area has no href so how I get the link ?
I think I got all of them thanks to VJR if someone want to learn bubble they are attached.
Add UI element for the below and read its value using Get details of element on webpage
After reading it will give you this
Then using string functions read the value after the word "of" which is 13.
Use Crop Text
This will give the value 13
Pass this value to the number of pages to process.
Follow as below to get links of all 13 pages.
After running the process:
You will get 0 to 116 ie; 117 links
Either you can write the above DataFromWebpage variable to a csv using Write to CSV.
Or store it in Excel spreadsheet in the Extract data from webpage action.
WebAutomation.LaunchChrome.LaunchChrome Url: $'''https://bubble.io/videos''' WindowState: WebAutomation.BrowserWindowState.Normal ClearCache: False ClearCookies: False WaitForPageToLoadTimeout: 60 Timeout: 60 BrowserInstance=> Browser IF (WebAutomation.IfWebPageContains.WebPageDoesNotContainText BrowserInstance: Browser Text: $'''13 OF 13''') THEN WebAutomation.ExtractData.ExtractTableUsingPagingFromAllPages BrowserInstance: Browser Control: $'''html > body > div:eq(1) > div:eq(3) > div > div:eq(1) > div:eq(0) > div''' ExtractionParameters: {[$'''div > div > div > div:eq(1)''', $'''Own Text''', $'''''', $'''Value #1'''], [$'''div > div > div > div:eq(1) > a''', $'''Href''', $'''''', $'''Value #2'''] } PagerCssSelector: $'''html > body > div:eq(1) > div:eq(3) > div > div:eq(1) > div:eq(1) > div:eq(2) > button''' PostProcessData: True TimeoutInSeconds: 60 ExtractedData=> DataFromWebPage END File.WriteToCSVFile.WriteCSV VariableToWrite: DataFromWebPage CSVFile: $'''C:\\Users\\iuser3\\Documents\\bubble.csv''' CsvFileEncoding: File.CSVEncoding.UTF8 IncludeColumnNames: True IfFileExists: File.IfFileExists.Overwrite ColumnsSeparator: File.CSVColumnsSeparator.SystemDefault
Many thanks
When the short menu appear and try to go the mouse pointer to next menu the menu always close and disappear !!
Another problem the automation reach last page 13 and keep pressing on this page instead I want to store the urls in csv file so I tried like this:
If you want to extract the hyperlinks use as below
1. Launch browser (Chrome/Edge)
2. Choose the Extract data from web page action
(look up the internet for some videos on how to use this action -> Power Automate Desktop : Web Data Extraction - Extract Data from Web Page - YouTube)
Right click on the "How to use.." and then the ones mentioned below in yellow highlighted
Then go to the Advanced settings of the Live web helper window
Make changes to the selector as below
html > body > div:eq(1) > div:eq(3) > div > div:eq(1) > div:eq(0) > div
div > div > div > div:eq(1) > a
href
The Live web helper window now shows the list of hyperlinks
After running the process you should now see all the hyperlinks in a datatable variable
The website you are working on also has pagination
So you need to use set element as pager to get the links of the other pages as shown in below video
Extract Data from Multiple Web Pages In Power Automate Desktop - YouTube
Best wishes!
#1
WarrenBelz
146,670
Most Valuable Professional
#2
RandyHayes
76,287
Super User 2024 Season 1
#3
Pstork1
66,004
Most Valuable Professional
All responses (
Answers (
