Power automate Web Scraping review

(0) Share

Report

Posted on by s3135977

i want to web scrap from a website to excel,

let say on amazon i want to web scrap the title, cost and the rating of books on amazon,

so getting the title and cost is the easy part, but how do we get the rating of the books to come across to excel? any idea

Categories:

Power Automate Desktop

I have the same question (0)

All responses (7)

Answers (1)

Agnius Bartninkas Most Valuable Professional on at

Like (0)

Report

We would need more details to what you have tried and what doesn't work.
If you don't know where to begin, the first step is using the Extract data from web page action and capturing the values you need.
See this video for a basic guide: https://youtu.be/WXK0u2yXLrU

-------------------------------------------------------------------------
If I have answered your question, please mark it as the preferred solution.
If you like my response, please give it a Thumbs Up.
If you are interested in Power Automate, you might want to follow me on LinkedIn at https://www.linkedin.com/in/agnius-bartninkas/

Was this reply helpful? Yes No
s3135977 22 on at

Like (0)

Report

hi thank you for your reply,
that is the youtube i been looking at to do some testing, im doing the same thing as what is in that example, which is working. but i try to add the field where the rating is but the result in excel are blank

Was this reply helpful? Yes No
Verified answer

Agnius Bartninkas Most Valuable Professional on at

Like (0)

Report

You are likely targetting the wrong element there. It likely has some child element where the actual value is stored. Try inspecting it with your browser's developer tools to figure out what you need to extract the data from.
-------------------------------------------------------------------------
If I have answered your question, please mark it as the preferred solution.
If you like my response, please give it a Thumbs Up.
If you are interested in Power Automate, you might want to follow me on LinkedIn at https://www.linkedin.com/in/agnius-bartninkas/

Was this reply helpful? Yes No
s3135977 22 on at

Like (0)

Report

Thank you for your reply again Agnius, yes you are correct i was selecting the wrong element

so now i have tried to convert what i have learnt into my own environment, its rating returning blank i have check this time if i have select the right element which i have,
from what i known it seem i have to play around with the CSS selector
so in the CSS selector this is what i have for rating
html > body > div:eq(0) > div:eq(0) > main > div > div > div > div:eq(3) > article:eq(0) > div:eq(0) > a > div:eq(1) > div:eq(1) > fieldset

from viewing the source code on the page it stop one step before getting the rating
here is the code

Was this reply helpful? Yes No
Agnius Bartninkas Most Valuable Professional on at

Like (0)

Report

The element you have highlighted is the star icons. You also have the text next to it. Try expanding some of the other <span> elements and see if any of them have "4.5" as the actual text value. And then try extracting that.
-------------------------------------------------------------------------
If I have answered your question, please mark it as the preferred solution.
If you like my response, please give it a Thumbs Up.
If you are interested in Power Automate, you might want to follow me on LinkedIn at https://www.linkedin.com/in/agnius-bartninkas/

Was this reply helpful? Yes No
s3135977 22 on at

Like (0)

Report

Thank you again to replying to my post Agnius, i have expand all the span after that label nothing around there that say 4.5 stars. i was thinking is there a way where we can pull from the source code return it as a text? since the 4.5 already in the source code we can use that?

Was this reply helpful? Yes No
Agnius Bartninkas Most Valuable Professional on at

Like (0)

Report

Yes, you can use the Get details of web page action and make it extract the page source. This will give you the source HTML that you could then parse with Parse text using regular expressions.
-------------------------------------------------------------------------
If I have answered your question, please mark it as the preferred solution.
If you like my response, please give it a Thumbs Up.
If you are interested in Power Automate, you might want to follow me on LinkedIn at https://www.linkedin.com/in/agnius-bartninkas/

Was this reply helpful? Yes No