@Squeaky, I'm having very much the same problem. I have a site with tables, 20 rows per page. There are 73 rows total, so four pages. At the bottom of the page are the numbers 1 through 4 for the pages, then a 'Next' button, then a 'Last' button. I get two different sets of problems, depending on the run.
Works fine:
Why on earth is there an option for max web pages to process if it's set to 'Only the first'? Anyway, for a single page it works.
In this screenshot I use 'Next' for the pager.
Now I have to set the extraction differently. Here's what I get - why is there no field for max pages here, where it belongs?
Shouldn't this be something like 'all available' with another field for 'up to a maximum of', or similar? I'm stumped. But it is what it is.
Depending on the run, two things happen.
First, it usually just fails to extract the table. Second, less frequently, it extracts everything but keeps banging the 'Next' button, and will not stop, regardless of what error settings I try. The page was created with Angular, which may be part of the problem, I don't know. Frustrating though, and sounds like something similar to what you're dealing with.
EDIT: I have partial success now, but only partial, with the extraction set to 'only the first page' and the max number of pages set to 4 (why does that even work?). I also discovered the pager element had disappeared from the 'Advanced' settings, which was part of my problem. I've been unable to get the 'live web helper' to re-select the pager element from the context menu, so I've added it as a CSS selector manually in advanced settings. I'd be interested to know if anyone else has that problem.
So that gets rid of the non-extraction problem.
Perhaps my 'all available' problem is due not to anything in PAD, but on the web page. The Next button is disabled when I reach the last page, but PAD still sees it and keeps banging on it like a cop trying to serve an arrest warrant.😁
For this I may have to first find the 'Next' element, move to the first button to its left, extract the text on the button, put that in a variable, and then set the max number of web pages to that variable.
@Squeaky, I get the sinking feeling I'm not helping you much here. Sorry about that.
Regards,
burque505
