web
You’re offline. This is a read only version of the page.
close
Skip to main content

Notifications

Announcements

Community site session details

Community site session details

Session Id :
Power Platform Community / Forums / Power Automate / Power Automate - Websc...
Power Automate
Unanswered

Power Automate - Webscraping help

(0) ShareShare
ReportReport
Posted on by

Hi MS Community

 

I'm new to Power Automate, and am trying to create a flow that will extract text data from each item on a webpage (web scraping project). Only problem is that the data is not available on the first webpage "parent page". To get to the item data, I must click on an item from the parent page which then takes me to another webpage (same web-site, but item specific) "item page" where my desired data is stored. I've seen the tutorials on how to extract data from webpages, but am having trouble finding resources on how to create a program which: clicks on each item, extracts data from that item page, returns to parent page, and then repeats for all items. Any direction / guidance would be greatly appreciated.

I have the same question (0)
  • Community Power Platform Member Profile Picture
    on at
  • Verified answer
    Pavel_NaNoi Profile Picture
    1,074 on at

    Alright this would usually be a simple problem you just got a bit unlucky with the website, here's what to do:

    To get the desired effect, do the following:

    Use the "Extract data from web page" action, select at least two items, get their text for example and it should look like this:

    Pavel_NaNoi_1-1651744446428.png

    once that is done go into the advanced options (bottom left corner of the panel that you see on the right in this image)

    and here change the values seen as in the following image:

    Pavel_NaNoi_2-1651744769803.png

    should look like this:

    Pavel_NaNoi_3-1651744799728.png

    this allows you to get every single hyperlink to every product that was extracted from this page, so you can simply use a for loop with a "go to web page" action followed by another "extract data from web page" action to extract whatever data / text you want.

     

    In essence the problem here was that the webpage was just too imbued and the selector had a hard time finding what it needed.

     

    Hope this helps.

  • ishanjayn Profile Picture
    3 on at

    ishanjayn_0-1697695675485.png

    I'm unable to extract the urls, could you help me with that 

     

  • Agnius Bartninkas Profile Picture
    Most Valuable Professional on at

    Have you actually read the reply by @Pavel_NaNoi above? It's explained there, but your screenshot does not follow his suggestion. Please modify your extraction so it matches his and then it should work.

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Forum hierarchy changes are complete!

In our never-ending quest to improve we are simplifying the forum hierarchy…

Ajay Kumar Gannamaneni – Community Spotlight

We are honored to recognize Ajay Kumar Gannamaneni as our Community Spotlight for December…

Leaderboard > Power Automate

#1
Michael E. Gernaey Profile Picture

Michael E. Gernaey 538 Super User 2025 Season 2

#2
Tomac Profile Picture

Tomac 405 Moderator

#3
abm abm Profile Picture

abm abm 252 Most Valuable Professional

Last 30 days Overall leaderboard