Unanswered

scroll down scrape table

(0) Share

Report

Posted on by dpevergreen

I have successfully navigated to the webpage that contains my table of interest. There is daily commentary on this page which varies in length changing the position of the table on the page. There are several tables, but I am only interested in one. How do I get PAD to navigate to and scrape the data from the desired table?

Thank you

Screenshot -

Categories:

Power Automate Desktop

I have the same question (0)

All responses (14)

Answers (0)

MichaelAnnis 5,727 Moderator on at

Like (0)

Report
I don't deal with a lot of web scraping, but scrolling down I might be able to help with:

Option 1:
send keys {Control}(f)
send keys SpotGamma (or something else that ONLY appears in this table)
send keys {Enter}

Option 2:
Loop
If image exists (the image being something that will always appear in your table)
Get Data from Web Page
Exit Loop
End If
Send Keys {PageDown}
End Loop

Was this reply helpful? Yes No
dpevergreen 10 on at

Like (0)

Report

I am a newbie. I expected to scroll down to "(±pts):" which is unique text contained on this table. Fail.

Was this reply helpful? Yes No
MichaelAnnis 5,727 Moderator on at

Like (0)

Report

The second and 3rd send keys below should each be their own action. My guess is it sent "send keys" directly into the 'find text' field in the web browser.

Was this reply helpful? Yes No
dpevergreen 10 on at

Like (0)

Report

Do you mean like this?

Was this reply helpful? Yes No
MichaelAnnis 5,727 Moderator on at

Like (0)

Report

Yes

Was this reply helpful? Yes No
dpevergreen 10 on at

Like (0)

Report

Please don't lose patience with me...
I am on the page that contains the data I am searching for but it still does not work. Nothing seems tp happen. When I manually use the Control f function, it works

Was this reply helpful? Yes No
MichaelAnnis 5,727 Moderator on at

Like (0)

Report

Are the parenthesis actually part of the text you are looking for? If not, take them out. They aren’t needed.

Was this reply helpful? Yes No
Henrik_M 2,021 Super User 2024 Season 1 on at

Like (0)

Report

The visual position of the table in the browser should be completely irrelevant. Have you tried using the Extract data from web page action to pull the data??

Was this reply helpful? Yes No
dpevergreen 10 on at

Like (0)

Report

Henrik,

I simply don't know how to use "extract data from webpage. I am older and not a programmer. Are there simple examples on this forum. Pulling one table from a webpage and storing it in excel should be straight forward with a little knowledge. Can you point me in the right direction or screen shot a simple PAD example.

Thank you
Dave

Was this reply helpful? Yes No
Henrik_M 2,021 Super User 2024 Season 1 on at

Like (0)

Report

Check out the steps here:

https://docs.microsoft.com/en-us/power-automate/desktop-flows/automation-web#web-data-extraction

Was this reply helpful? Yes No