web
You’re offline. This is a read only version of the page.
close
Skip to main content

Announcements

News and Announcements icon
Community site session details

Community site session details

Session Id :
Power Platform Community / Forums / Power Automate / Power Automate - Websc...
Power Automate
Answered

Power Automate - Webscraping help

(0) ShareShare
ReportReport
Posted on by Microsoft Employee

Hi MS Community

 

I'm new to Power Automate, and am trying to create a flow that will extract text data from each item on a webpage (web scraping project). Only problem is that the data is not available on the first webpage "parent page". To get to the item data, I must click on an item from the parent page which then takes me to another webpage (same web-site, but item specific) "item page" where my desired data is stored. I've seen the tutorials on how to extract data from webpages, but am having trouble finding resources on how to create a program which: clicks on each item, extracts data from that item page, returns to parent page, and then repeats for all items. Any direction / guidance would be greatly appreciated.

  • Community Power Platform Member Profile Picture
    Microsoft Employee on at
  • Verified answer
    Pavel_NaNoi Profile Picture
    1,074 on at

    Alright this would usually be a simple problem you just got a bit unlucky with the website, here's what to do:

    To get the desired effect, do the following:

    Use the "Extract data from web page" action, select at least two items, get their text for example and it should look like this:

    Pavel_NaNoi_1-1651744446428.png

    once that is done go into the advanced options (bottom left corner of the panel that you see on the right in this image)

    and here change the values seen as in the following image:

    Pavel_NaNoi_2-1651744769803.png

    should look like this:

    Pavel_NaNoi_3-1651744799728.png

    this allows you to get every single hyperlink to every product that was extracted from this page, so you can simply use a for loop with a "go to web page" action followed by another "extract data from web page" action to extract whatever data / text you want.

     

    In essence the problem here was that the webpage was just too imbued and the selector had a hard time finding what it needed.

     

    Hope this helps.

  • ishanjayn Profile Picture
    3 on at

    ishanjayn_0-1697695675485.png

    I'm unable to extract the urls, could you help me with that 

     

  • Agnius Bartninkas Profile Picture
    Most Valuable Professional on at

    Have you actually read the reply by @Pavel_NaNoi above? It's explained there, but your screenshot does not follow his suggestion. Please modify your extraction so it matches his and then it should work.

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Season of Sharing Community Challenge Winners!

Congratulations to our community stars!

Kudos to our 2025 Community Spotlight Honorees

Expanding mentorship, skilling, and AI innovation

Leaderboard > Power Automate

#1
Mohsin Ali Profile Picture

Mohsin Ali 423

#2
11manish Profile Picture

11manish 308 Super User 2026 Season 2

#3
M Bilal Khan Profile Picture

M Bilal Khan 177

Last 30 days Overall leaderboard