Answered

Extract data from multiple pages get stuck on pagination

(0) Share

Report

Posted on by Ignus

Hello, I've succesfully built my flow on PowerAutomate Desktop in order to scrape data from web. It works like a charm until i try to scrape data from multiple pages. Infact when the flow reaches last page I see the "next page" button (which is not clickable but still present in the html) blinking and flow can't be completed. How to deal with it?

Categories:

Power Automate Desktop

I have the same question (0)

All responses (10)

Answers (1)

fraenK 2,125 on at

Like (0)

Report

What's different in the html code between the previous pages and last page regarding the next page element? You probably need to modify the selector to include the <a> element, if this is missing on the last page.

Was this reply helpful? Yes No
Ignus 5 on at

Like (0)

Report
Here the difference in html:

<ul class="pull-right pagination"> <li><a href="https://www.somedomain.com/page2" title="Next Page<span class="piped-left icon-text-group"> <svg width="14" height="14" class="icon-svg"> <use xlink:href="#arrow"></use> </svg> <span class="visible-xs">Next</span> </span> </a></li> <li class="disabled"><a role="button" class="disabled" onclick="return false"> <span class="piped-left hidden-xs"> <svg width="14" height="14" class="icon-svg"> <use xlink:href="#double-arrow"></use> </svg> </span> </a></li> </ul>

last page :

<ul class="pull-right pagination"> <li class="disabled"><a role="button" class="disabled" onclick="return false"> <span class="piped-left icon-text-group"> <svg width="14" height="14" class="icon-svg"> <use xlink:href="#arrow"></use> </svg> <span class="visible-xs">Next</span> </span> </a></li> <li class="disabled"><a role="button" class="disabled" onclick="return false"> <span class="piped-left hidden-xs"> <svg width="14" height="14" class="icon-svg"> <use xlink:href="#double-arrow"></use> </svg> </span> </a></li> </ul>

the selector I'm using on it: ul.pull-right.pagination > li:nth-child(1) > a[href]
also tried with ul.pull-right.pagination > li:nth-child(1) > a[href*=http]
or ul.pull-right.pagination > li:nth-child(1) > a[title] but nothing changes

Was this reply helpful? Yes No
Verified answer

fraenK 2,125 on at

Like (1)

Report

You need to include that the class of element <a> is not equal to "disabled"

Was this reply helpful? Yes No
josephblake3 6 on at

Like (0)

Report

🙄

Was this reply helpful? Yes No
josephblake3 6 on at

Like (0)

Report
Thank you, but how/what?

My page goes to page 29 and the next button doesn’t go further but I don’t know how to tell the selector that.

This what I have in my CSS Spector field in Advanced Settings:

table[id="ctl00_Body_WaitListRadGrid_ctl00"] > tfoot > tr > td > table > tbody > tr > td > div:eq(2) > a:eq(0) > img, html > body > form > div:eq(2) > div > div:eq(3) > table > tfoot > tr > td > table > tbody > tr > td > div:eq(2) > a:eq(0) > img

It works great for fewer pages or the first page. Any help would be much appreciated.

Was this reply helpful? Yes No
kjhaveri 2 on at

Like (0)

Report

Hi,
I am also facing the same issue in my website from where i have to scarp data the bot is always pressing next button after reaching the last page number . please help me out hot to stop that

Was this reply helpful? Yes No
Mukram 2 on at

Like (0)

Report

Hello, I've succesfully built my flow on PowerAutomate Desktop in order to scrape data from web. It works like a charm until i try to scrape data from multiple pages. Infact when the flow reaches last page I see the "next page" button (which is not clickable but still present in the html) blinking and flow can't be completed. How to deal with it?

Was this reply helpful? Yes No
robertmc 9 on at

Like (0)

Report

Hello! Can you advise how you were able to solve this? I'm having the same issue.

Was this reply helpful? Yes No
Agnius Bartninkas Most Valuable Professional on at

Like (1)

Report

Don't use the pager functionality in Extract data from web page. It doesn't work with most pages. Build a loop and extract each page individually. See this tutorial for reference: https://www.youtube.com/watch?v=yvoUBwCqdn0&ab_channel=AndersJensen

Was this reply helpful? Yes No
robertmc 9 on at

Like (1)

Report

That worked perfectly. Thank you so much for sharing!

Was this reply helpful? Yes No