Hi MS Community
I'm new to Power Automate, and am trying to create a flow that will extract text data from each item on a webpage (web scraping project). Only problem is that the data is not available on the first webpage "parent page". To get to the item data, I must click on an item from the parent page which then takes me to another webpage (same web-site, but item specific) "item page" where my desired data is stored. I've seen the tutorials on how to extract data from webpages, but am having trouble finding resources on how to create a program which: clicks on each item, extracts data from that item page, returns to parent page, and then repeats for all items. Any direction / guidance would be greatly appreciated.
Have you actually read the reply by @Pavel_NaNoi above? It's explained there, but your screenshot does not follow his suggestion. Please modify your extraction so it matches his and then it should work.
I'm unable to extract the urls, could you help me with that
Alright this would usually be a simple problem you just got a bit unlucky with the website, here's what to do:
To get the desired effect, do the following:
Use the "Extract data from web page" action, select at least two items, get their text for example and it should look like this:
once that is done go into the advanced options (bottom left corner of the panel that you see on the right in this image)
and here change the values seen as in the following image:
should look like this:
this allows you to get every single hyperlink to every product that was extracted from this page, so you can simply use a for loop with a "go to web page" action followed by another "extract data from web page" action to extract whatever data / text you want.
In essence the problem here was that the webpage was just too imbued and the selector had a hard time finding what it needed.
Hope this helps.
Example of Parent Page, and a subsequent item page:
Parent Page Link: https://weedmaps.com/brands/stiiizy/products
WarrenBelz
146,771
Most Valuable Professional
RandyHayes
76,287
Super User 2024 Season 1
Pstork1
66,091
Most Valuable Professional