Skip to main content

Notifications

Community site session details

Community site session details

Session Id : +X4C1sMbGEybFBZjtQXrtO
Power Automate - Power Automate Desktop
Answered

Loop through multiple links on web page and get details

Like (0) ShareShare
ReportReport
Posted on 28 Oct 2021 11:43:46 by 54

Hi All,

 

I am new to PowerAutomate Desktop and I want to know how can I achieve this.

 

1. Open web browser(chrome) and paste a URL.

2. This URL has multiple links which open in a different page if clicked.

3. Click link and extract some information from each clicked link.

 

I am able to do all of the above process with suggestions provided by @Highboy , however only for one of the first link(or any link) on that URL. I want to repeat this process for all links available on that URL and grab all information. I tried Web recorder also but it does not go back to the URL and opens second link and so on. I tried adding it one by one and it works however number of links on the URL(web page) will keep on changing daily.

 

Please suggest. Let me know if you need further details.

 

@Highboy  Can you please help.

 

Regards,

Awadhesh

  • Abe-S Profile Picture
    2 on 16 Jul 2024 at 14:50:51
    Re: Loop through multiple links on web page and get details

    Hi @Highboy 

    I'm trying to extract data from this link and I'm encountering a challenge. There are about 30-35 listings on each page, and each listing has a "Contact Us" button that contains the information I need. My goal is to automate the following process:

    1. Click on the "Contact Us" button for a listing to extract the required information.
    2. Return to the listing page.
    3. Repeat the process for the next "Contact Us" button.
    4. Continue this for all listings on the current page.
    5. Move to the next page and repeat the process for all pages.

    Could you please guide me on how to achieve this efficiently?

    Thank you!

  • divyasingh Profile Picture
    8 on 08 May 2024 at 05:04:56
    Re: Loop through multiple links on web page and get details

    Hi @MichaelAnnis  @ I have around 800+ links in a website, I want to click on each link and once the links opens either on new tab or the same tab to go to this link scroll down to "Attached File" Section and scan/read/identify all the links available in attached file section, sometime it may be 1 sometime it may be 8 or more, how to automate this, initially I have been able to extract all those 800+ links in my excel sheet, please suggest how to proceed

  • Marzie1 Profile Picture
    8 on 11 Apr 2024 at 15:42:21
    Re: Loop through multiple links on web page and get details

    Hi @Deenuji ,
    this does not work. I want to iterate through different websites which I have open in chrome and download a pdf in each, rename and save!
    I do not have only one website, I have more than 6 websites. which daily change.
    how to launch all of them and go one by one to them to download pdf, rename and save in my wish folder?

    Thanks
    Any help would be appreciated.

  • Deenuji_Loganathan_ Profile Picture
    6,105 Super User 2025 Season 1 on 11 Apr 2024 at 14:12:51
    Re: Loop through multiple links on web page and get details

    @Marzie1 
    Have you tried the below approach:

     

    After Launching the browser, use "Extract data from webpage"

     

    Once you drag "Extract data from webpage" action to the PAD editor -> Double click and open it (do not close it) -> While keeping this action open, go to the website -> You will automatically get a "Live web helper" -> Right click on the first link and select the href link element -> Then Ctrl left click. The first link should be added to the Live Web helper box -> Click Finish

     

     

    Deenuji_0-1712844720739.png

     

    For more details: https://powerusers.microsoft.com/t5/Power-Automate-Desktop/Extracting-Links-from-a-webpage/td-p/1573070

     


    Thanks,
    Deenuji Loganathan 👩‍💻
    Automation Evangelist 🤖
    Follow me on LinkedIn 👥

    -------------------------------------------------------------------------------------------------------------
    If I've helped solve your query, kindly mark my response as the solution ✔ and give it a thumbs up!👍 Your feedback supports future seekers 🚀

     
  • Marzie1 Profile Picture
    8 on 11 Apr 2024 at 14:07:29
    Re: Loop through multiple links on web page and get details

    Hi @BzshBzsh ,
    my problem is near to your problem not 100%.
    I want to iterate to multiple websites and download a pdf in each, rename and save in specific folder. Currently I use the data table option, manually enter the website links( 5 to 6 websites), place & name of the pdf there then loop through downloading the pdf & renaming. (Basically I create the data table manually by hand, see the picture please)
    my question now: is there a solution not to manually enter my website links and name file in the data table and automatically go to those websites in chrome ( Grab all URLs) one by one and download the pdf, rename and save in the wished folder? 
    basically what I want to achieve is:
    1) go to all the websites that I have open in chrome. more than 5 links. each day different links I have.
    2)download a pdf from each website
    3) save it in a wished folder
    I appreciate your time in advance!
    can you help please.


  • MichaelAnnis Profile Picture
    5,721 Super User 2025 Season 1 on 16 Dec 2023 at 00:45:35
    Re: Loop through multiple links on web page and get details

    should post your own.  Anyway, if you are using Chrome, you can send keys Ctrl + l (lowercase L).  This highlights the top bar, then you can Ctrl + c to copy, and then write it back to Excel.

     

    Good luck!

  • dklynch81 Profile Picture
    2 on 14 Dec 2023 at 19:18:49
    Re: Loop through multiple links on web page and get details

    Hello, I have created a power automate loop that loops through thousands of excel item codes, pastes them into a website search bar, searches the item code, and pulls up that specific webpage. What I am trying to do is once I reach the webpage I'm trying to auto copy the URL and then loop back to the next item code and grab every URL link automatically. Right now, the flow I've made only saves the first URL and doesn't grab any others. How do i fix this in my loop to grab every URL with each new page the loop creates? Please see a snap shot of my code: @Highboy 

    dklynch81_0-1702581483904.pngdklynch81_1-1702581507610.png

     

  • gillgamm Profile Picture
    63 on 02 Aug 2023 at 21:59:08
    Re: Loop through multiple links on web page and get details

    @Highboy I'm having trouble when I get to the loop I want to set up. Once I get to a certain web page and filter the information, I want to click each link, pull information from that page and then go back to the search results page.  The image with Lines 23-31 is where I want to set up the loop or for each action so that it will go to each link, extract the information, write to my Excel file and then move on to the next link in the search results.

  • shivani2 Profile Picture
    4 on 09 Mar 2023 at 12:40:11
    Re: Loop through multiple links on web page and get details

    Would you be able to give a proper instruction for this. I am trying to do something similar to this, but i am struggling to do it. 

    My problem statement is defined in steps below:

    1. I am logging into the website.

    2. Go to the proper section in website from where i have to download multiple excels. 

    3. Click on links for downloading the excels. 

     

    Implemented Solution:

    1. I was able to login to the website. 

    2. Was able to go the appropriate section in the website. 

    3. Stored all the links on the website in the excel. 

     

    Problem: When i apply the loop in the extracted links, it is downloading the excel from the same link again and again. 

    I want to download different excels from the extracted links. I am attaching my sequence of the flow. Please let me know where i am going wrong.  

     

    shivani2_0-1678365591343.png

     

  • shivani2 Profile Picture
    4 on 28 Feb 2023 at 07:35:20
    Re: Loop through multiple links on web page and get details

    Hi @Highboy 

    I want to download the files by clicking from the multiple links on webpage. 

    I am hoping it is the same thing as mentioned in the post. But i am stuck after doing the step of extracting links from the webpage. how do i proceed further. from downloading the files from these links. 

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Understanding Microsoft Agents - Introductory Session

Confused about how agents work across the Microsoft ecosystem? Register today!

Warren Belz – Community Spotlight

We are honored to recognize Warren Belz as our May 2025 Community…

Congratulations to the April Top 10 Community Stars!

Thanks for all your good work in the Community!

Leaderboard > Power Automate - Power Automate Desktop

#1
eetuRobo Profile Picture

eetuRobo 18 Super User 2025 Season 1

#2
Nived_Nambiar Profile Picture

Nived_Nambiar 10 Super User 2025 Season 1

#3
stampcoin Profile Picture

stampcoin 6

Overall leaderboard