Extract data from web page.

Like (0) Share

Report

Posted on 13 Jan 2023 18:49:08 by macebul

Hello!

I am still very new to Power Automate, but I want to learn more and I would appreciate your expertise.

I am using a desktop flow to try and extract data from a web page. I have used this action to retrieve other data, but I can't get this specific data to work.

I would like to retrieve the URL associated with the "Contact Us" button. This is what I see when I try to follow the steps associated with the "Extract data from web page" action.

Web Scrape - Data Extract 01.png

Previously, I have just clicked on the URL from the menu and it has worked, but it doesn't appear as an option for me here.

I have also tried to "Click link on web page" to open the URL and then "Get details of web page" to save that URL address. However, the resulting data is the URL of the original tab with the "Contact Us" button on it.

Web Scrape - Link and Get Details.png

I would greatly appreciate help with extracting data (URL) from a web page using the first method or (as a second choice) help with getting the correct URL after clicking the link.

Thank you so much!

I have the same question (0)

All responses (6)

Answers (0)

macebul 6 on 15 Jan 2023 at 19:15:05

Like (0)

Report

Re: Extract data from web page.

@momlo
Thank you for looking into this more.

Here is the search that I performed:

https://www.alibaba.com/trade/search?fsb=y&IndexArea=product_en&CatId=&tab=verifiedManufactory&SearchText=water+activated+tape

Could you help me get started with the jquery selectors? I'm still very new to all of this and I'm not familiar with how to do that.

I'm not sure if this is helpful information, but my goal is to speed up my manufacturer searches. Ultimately, I would like to be able to do a search and then record the manufacture's name, their company URL, and their contact URL that I can then write into an Excel file. The only thing that the flow doesn't do correctly right now is extracting the proper vendor contact URL.

Thank you!

Was this reply helpful? Yes No
momlo 1,527 Super User 2024 Season 1 on 15 Jan 2023 at 17:59:46

Like (0)

Report

Re: Extract data from web page.

Hi @macebul
I found this page, but it does not contain the "Contact us" button. Can you share the exact link?
I see that they use JS to generate links in various places, so I think I would go with jquery selectors using ":contains" specific text and clicking those with JS

https://carpettape.en.alibaba.com/factory.html

Was this reply helpful? Yes No
macebul 6 on 15 Jan 2023 at 13:35:56

Like (0)

Report

Re: Extract data from web page.

Thank you for trying to help!

What site is that? It is a manufacturer search on Alibaba.
Did you try to select the parent UI element to see if it holds href? I believe so, but I didn't see any href for this button.
Of child element? I believe so, but I didn't see any href for this button.
Other method would be ti use javascript to click the button. I'm sorry, but I'm not familiar with this. Where would I go to do that?

Thank you!

Was this reply helpful? Yes No
macebul 6 on 15 Jan 2023 at 13:32:26

Like (0)

Report

Re: Extract data from web page.

@VJR Thank you for trying to help!

Method 1.)

I tried this and I changed the UI element to any option that I could find for that button, but it only returned the URL for the original search and not for the Contact button.

Method 2.)

This is what I see for the specific button when I try to inspect the website for that button:

I tried to click around on other elements on the website and I could find an href elsewhere, but just not by the "Contact Us" button.

Here is what the whole thing looks like:

I'm sorry that I'm not well-versed in all of this, but I'll try!

Was this reply helpful? Yes No
VJR 7,635 on 15 Jan 2023 at 03:54:32

Like (0)

Report

Re: Extract data from web page.

Hi @macebul

Use Get details of element on webpage.

In the UI element box select the UI element for the Contact us button.

In the Attribute name select href.

-----------------------------------------------------------------------------------------------------------

On the other hand the UI element you have added reads as a <Span> which won't have a href.

So either it does not have a href because of the way the website has been coded, or you have incorrectly added the UI element for the Contact us.

First follow the above 3 steps and if it does not give you the link then check below.

Right click manually on the Contact us and choose Inspect element.

What do you see?

Do you see the href of that button like the below or is there something else?

Wanted to write more but that would confuse you even more as a newbie in PAD :).

So lets hear back what you get in both the cases explained above.

Was this reply helpful? Yes No
momlo 1,527 Super User 2024 Season 1 on 14 Jan 2023 at 17:49:44

Like (0)

Report

Re: Extract data from web page.

What site is that?
Did you try to select the parent UI element to see if it holds href?
Of child element?
Other method would be ti use javascript to click the button

Was this reply helpful? Yes No