web page data extract - pagination issue

(1) Share

Report

Posted on by mrdave

Hi - hope somebody can help with this

I'm trying to extract data from https://www.screwfix.ie/search?search=clearanceviewall on multiple pages

The pagination works on the first page, but on page 2 it fails and completes the flow.

The CSS selector appears to be the same for the button on each page

#container-main > div._21o_S5.store-locator-container.cpFvx9 > div > div.agr5rQ > div.oWZhYo > div._2O_FF6.cB3s3C > div.kPXqh5 > nav > button:nth-child(3)

it works fine on .com but not on .ie 😕

Any ideas?

Categories:

Power Automate Desktop

I have the same question (0)

All responses (6)

Answers (0)

Sort by

Ezhilvannan_V 178 on at

Like (0)

Report
Copy link

Link copied!

Step:1

Extact required data

step 2:
Go to page page 1 to page 45 right arrow, select set element as pager.

step 3:

give Finish

step 4 :

just give all available, and save, It will extract all page data's

Please accept as a solution if its works for you.

Was this reply helpful? Yes No
mrdave 18 on at

Like (0)

Report
Copy link

Link copied!

Thanks for trying, that is exactly what I have done.....but it stops on page 2.

I also use a input variable to capture the number of pages and use that variable instead of all available, because on the UK site it keeps trying to hit the button and never ends.

Was this reply helpful? Yes No
Ezhilvannan_V 178 on at

Like (0)

Report
Copy link

Link copied!

Hi @Highboy you have any work around for this issue?

Was this reply helpful? Yes No
joelzehring 208 on at

Like (0)

Report
Copy link

Link copied!

We're experiencing the same issue extracting data from a paginated HTML table. It's currently working in our production environment because the flow was last updated with Power Automate for Desktop version 2.26. In our Development environment, where we've updated to version 2.27, this error occurs on multiple machines.

Was this reply helpful? Yes No
Community Power Pla... Microsoft Employee on at

Like (0)

Report
Copy link

Link copied!

I am having the same issue

Was this reply helpful? Yes No
momlo 1,527 Super User 2024 Season 1 on at

Like (1)

Report
Copy link

Link copied!
@mrdave

When I have a similar situation where the site is built in a way it messes up with pagination, I often search for alternative ways, such as navigating via URL parameters.

I took a look at the IE site and saw that:

You can extract a number of pages

You can navigate the pages by changing URL parameters

Example:
Show the first 100 elements on the page, starting with item 0 (that equals the first page)
https://www.screwfix.ie/search?search=clearanceviewall&page_size=100&page_start=0
Show the next 100 items (equal to page no.2)
https://www.screwfix.ie/search?search=clearanceviewall&page_size=100&page_start=100

Show the next 100 items (equal to page no.3)
https://www.screwfix.ie/search?search=clearanceviewall&page_size=100&page_start=200

So knowing that, what you can do:

1. Go to the first page to display 100 items

https://www.screwfix.ie/search?search=clearanceviewall&page_size=100&page_start=0

2. Extract the number of pages to %NoOfPages%

3. Loop from 0 to %NoOfPages - 1%

4. In each loop iteration
- set %PageStart% = %LoopIndex * 100%
- build URL = https://www.screwfix.ie/search?search=clearanceviewall&page_size=100&page_start=%PageStart%

- navigate to page url

- extract 100 items into TempTable

- Merge FinalTavle with TempTable

Was this reply helpful? Yes No