Loop through multiple links on web page and get details

(0) Share

Report

Posted on by awadheshyona

Hi All,

I am new to PowerAutomate Desktop and I want to know how can I achieve this.

1. Open web browser(chrome) and paste a URL.

2. This URL has multiple links which open in a different page if clicked.

3. Click link and extract some information from each clicked link.

I am able to do all of the above process with suggestions provided by @Highboy , however only for one of the first link(or any link) on that URL. I want to repeat this process for all links available on that URL and grab all information. I tried Web recorder also but it does not go back to the URL and opens second link and so on. I tried adding it one by one and it works however number of links on the URL(web page) will keep on changing daily.

Please suggest. Let me know if you need further details.

@Highboy Can you please help.

Regards,

Awadhesh

Categories:

Power Automate Desktop

I have the same question (0)

All responses (27)

Answers (1)

Verified answer

Highboy 1,183 Super User 2024 Season 1 on at

Like (2)

Report

I am not sure i understand what you are trying to do.
Could you attach a screenshot of the webpage you are working with?

But this could work
Use "Extract data from web page" to extract all the links, and loop throuh all of them - no need to go back to first page.

Was this reply helpful? Yes No
awadheshyona 54 on at

Like (2)

Report

That is really helpful @Highboy This is what I was trying to achieve and it worked. Thanks once again.

Was this reply helpful? Yes No
BzshBzsh 15 on at

Like (0)

Report

Hi, @awadheshyona @Highboy

I am trying to do the same thing or at least something very similar. I have a web page with 116 links on it. Each link takes me to a contact page where I need the Name, Phone, Fax and Address. I would like all the results to show up in 1 excel sheet with 116 rows. Using the example, I was able to save the links, have the webpage load and have the first link spit out the right data, then it loops, opens the next link but spits out a blank excel document. What am I missing? Also, I'm not sure if this matters but some of the links don't have a fax number.

Was this reply helpful? Yes No
BzshBzsh 15 on at

Like (1)

Report

I got it figured out!
I needed to save my extracted data as a variable and then use that variable to write it to an excel sheet.
Here is what my loop looks like.

Was this reply helpful? Yes No
mhenderson95 2 on at

Like (1)

Report

Would you be able to post a screenshot of the entire flow you put together? I am trying to do something very similar and keep hitting a wall!

Was this reply helpful? Yes No
BzshBzsh 15 on at

Like (1)

Report

You may not need all the excel steps and you could simply launch excel before your loop starts. I have mine set up to copy the current data from sheet 1, paste it into sheet 2, erase the data from sheet 1 and then paste the new information into sheet 1. I then have conditional formatting set in my excel to check for differences between the 2 sheets. This may not be the best way to have it set up but it seems to work for me. Hopefully you have luck too.

Was this reply helpful? Yes No
Powerlearnerd 20 on at

Like (1)

Report

Hi All,

I am new to PowerAutomate Desktop and I want to know how can I achieve this.

1. Open web browser(chrome) and paste a URL.
2. This URL has multiple links which open in a different page if clicked.
3. Click link and extract some information from each clicked link.
4. Then store all information in one excel file

I am able to do all of the three above processes, however with the fourth step I struggle as it is then opening all the results in different new excel files. I want the information to be stored in only one excel file. Does somebody know the answer to this problem.

Please suggest. Let me know if you need further details.

Was this reply helpful? Yes No
Powerlearnerd 20 on at

Like (1)

Report

Hi Highboy,
Could you help me out with a similar sturggle cause I'm desperately looking for an answer. I also would like to loop thourgh multiple links on a web page and get the details. I want to enter a product name in www.exporthub.com and then webscrape all information of indivual webpages from suppliers. Hope you could help me out.

Was this reply helpful? Yes No
BzshBzsh 15 on at

Like (1)

Report

I had a similar problem and solved it above. When you are extracting data in your loop you need to save it as a variable not excel. Then use "get first free row" then "Write to excel worksheet". At this step you will pick your variable that you saved. Then finally "Increase Variable" by 1. Check my screenshot and let me know if it helps you.

Was this reply helpful? Yes No
Powerlearnerd 20 on at

Like (1)

Report

Hi @BzshBzsh,
I very much appreciate your reply.

I noticed your prior contributions before but still I can't manage to get the right results. I included a screenshot of the whole flow I made so you can see what is lacking.

I want to scrape from these engineered wood suppliers on Export Hub
for each of them their - Business nature, - Country region etc. when you click on their link.

Could you indicate where in my flow there is a mistake. Much appreciation in advance.

Was this reply helpful? Yes No