web
You’re offline. This is a read only version of the page.
close
Skip to main content

Announcements

News and Announcements icon
Community site session details

Community site session details

Session Id :
Power Platform Community / Forums / Power Automate / Scrape Website Doesn't...
Power Automate
Answered

Scrape Website Doesn't Finish

(0) ShareShare
ReportReport
Posted on by 6

I've got my PowerAutomate all finished and it goes through all 50 pages that it has found. But the problem is that the script doesn't get to the Excel step because it keeps clicking on the next page part. I'm lost on exactly how to tell it to "know" when it is finished. I used the "RECORD" function to scrape data from a site, and I clicked on the fields and then I clicked on the Pager field, and that's it. 

Can someone help? Image below of my script.

 

AudiJames_0-1646614777031.png

 

  • Guriga Profile Picture
    188 on at

    Guriga_0-1646669036500.png

     

    Guriga_1-1646669083633.png

     

    I tested for the 1st page. It's working perfectly.

     

  • Verified answer
    Pavel_NaNoi Profile Picture
    1,074 on at

    Found the issue to your problem and have made a fix for it, the problem was as follows:

    -Your code is 100% correct, but the website you're on has a lot of very horrible selectors, namely the pager selector, it is not changing state when its clicked or reaches the end, i.e. the only thing that changes is its colour and I think hyperlink state? either way, its impossible for PAD at the moment to spot this, I tried all sorts of selectors for this, I'm sure there's someone out there that knows better than me on this topic. If the pager element either disappeared or changed state this issue wouldn't occur.

     

    As for the fix, please email me at ploktionov@automationoutcomes.co.uk I'll send you over a text file with the automation, (Now attached to this post, as I now can put zip files in messages) in there copy-paste the text into your PAD automation, literally just CTRL+V the text from the .txt file anywhere in your Main flow and it should paste the work-around that I've devised for you which looks something like this:

    Pavel_NaNoi_0-1646669590543.png

    2023 September Pavel here - for anyone else who stumbles upon this, note that this wont be a solution to your specific problem, but the old code can still help in understanding, so I've attached it to this post now (and I've been asked for this code quite a few times now, so might as well!). Note, it will throw some errors due to the difference in versions from back then and now, but can be easily resolved by replacing the UI Elements. Feel free to email me / message me if you need help with your problem similar to this, I'll help when I can.

  • AudiJames Profile Picture
    6 on at

    Thanks again for your help -- those pager settings can be rather tricky depending on the site!

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Season of Sharing Community Challenge Winners!

Congratulations to our community stars!

Kudos to our 2025 Community Spotlight Honorees

Expanding mentorship, skilling, and AI innovation

Leaderboard > Power Automate

#1
Mohsin Ali Profile Picture

Mohsin Ali 389

#2
11manish Profile Picture

11manish 345 Super User 2026 Season 2

#3
M Bilal Khan Profile Picture

M Bilal Khan 308

Last 30 days Overall leaderboard