Answered

Extract data from web page list

(0) Share

Report

Posted on by ubaid2

I have created flow to extract customers reviews from web page against item codes but the issue is it is extracting data for some codes.

Website URL: https://www.target.com/

Item Code:

064-03-8708---working fine

064-15-0009---Getting Error (unable to extract data from webpage)

Thanks

Categories:

Power Automate Desktop

I have the same question (0)

All responses (9)

Answers (1)

Agnius Bartninkas Most Valuable Professional on at

Like (0)

Report
Copy link

Link copied!

You should try to make a copy of your Extract data from web page action and capture the same values from the item that fails. Then see if the selectors generated are the same. It is likely that they differ slightly and you might need to modify it to work for all cases.

I could not reproduce the issue, as I don't know how to find the specific items, nor do I know what data exactly you're trying to scrape.
-------------------------------------------------------------------------
If I have answered your question, please mark it as the preferred solution.
If you like my response, please give it a Thumbs Up.
If you are interested in Power Automate, you might want to follow me on LinkedIn at https://www.linkedin.com/in/agnius-bartninkas/

Was this reply helpful? Yes No
ubaid2 12 on at

Like (0)

Report
Copy link

Link copied!

when I create a separate Extract data from web page for the one which fail it is fetching the data but the selector values are same for both codes.

To reproduce the at your end first go to https://www.target.com/
search item code in search bar
then click on reviews
after that you will be able to see all the reviews of this product.

Thanks

Was this reply helpful? Yes No
Agnius Bartninkas Most Valuable Professional on at

Like (0)

Report
Copy link

Link copied!

I cannot reproduce this, as the search doesn't load any results at all for me.
Maybe it fails because the page is a bit slow to load the results? Have you watched it run? Is the page loaded fully when the flow tries to extract data?

Was this reply helpful? Yes No
ubaid2 12 on at

Like (0)

Report
Copy link

Link copied!

I think the website is not allowed in your region you will have to use VPN to access it, when I run my flow webpage get loaded successfully

Was this reply helpful? Yes No
Agnius Bartninkas Most Valuable Professional on at

Like (0)

Report
Copy link

Link copied!

Well, I don't have a VPN that would allow me to load the page, so, again, I cannot reproduce this. I would suggest adding a Wait for web page content action to wait for the page to load before trying to extract the values.

If the selectors are the same, the only reason I can think of that could cause a failure is the data not loading.

Was this reply helpful? Yes No
ubaid2 12 on at

Like (0)

Report
Copy link

Link copied!

sorry for the confusion, I have checked again CSS selector and found that Base CSS Selector is not the same for both items, how can I make CSS selector dynamic

Item Code: 064-03-8708
Base CSS Selector: html > body > div:eq(0) > div:eq(1) > div > main > div:eq(2) > div:eq(11) > div:eq(7) > div
CSS Selector: div > div > div > div > div:eq(0) > div:eq(2)

Item Code: 064-15-0009
Base CSS Selector: html > body > div:eq(0) > div:eq(1) > div > main > div:eq(2) > div:eq(13) > div:eq(7) > div
CSS Selector: div > div > div > div > div:eq(0) > div:eq

Thanks

Was this reply helpful? Yes No
Agnius Bartninkas Most Valuable Professional on at

Like (0)

Report
Copy link

Link copied!

It seems like your table can be positioned in different places on the web page and this causes the fail. It is technically a different object.

You might want to either have both actions there and add some error handling so that if the first one fails, the second one is attempted, or add a If web page contains action and check which element is available.
-------------------------------------------------------------------------
If I have answered your question, please mark it as the preferred solution.
If you like my response, please give it a Thumbs Up.
If you are interested in Power Automate, you might want to follow me on LinkedIn at https://www.linkedin.com/in/agnius-bartninkas/

Was this reply helpful? Yes No
ubaid2 12 on at

Like (0)

Report
Copy link

Link copied!

the positioning of the table in web page is on same place, but there is just one div which is changing, is it possible to make that div dynamic?

Was this reply helpful? Yes No
Verified answer

Agnius Bartninkas Most Valuable Professional on at

Like (0)

Report
Copy link

Link copied!

The fact it looks the same to the human eye does not mean it is the same.
You can pass a variable in the div value in the selector, but you still need to know what value to pass. So, like I mentioned, either do the Extract data from web page with different values in the div until it finally succeeds (handling the error so that the flow doesn't stop if extraction fails), or use If web page contains with a different div value until you find one that exists and then use that in the extraction.
-------------------------------------------------------------------------
If I have answered your question, please mark it as the preferred solution.
If you like my response, please give it a Thumbs Up.
If you are interested in Power Automate, you might want to follow me on LinkedIn at https://www.linkedin.com/in/agnius-bartninkas/

Was this reply helpful? Yes No