Unanswered

Extract data from webpage

(0) Share

Report

Posted on by tamdoan2802

Hello Everyone,

I am a newbie with Power Automate Desktop and having a difficulty with extraction the data from webpage.
As I want to extract the data from website with multiple pages and design a basic flow following: Launching a Website -> Extract Data -> Save in Exel -> Close
However, at the step "Extract data from webpage" when choosing "max webpage to proceed", I typed in 50 but the Process run infinitely and does not stop after 50 pages. (In the flow, the step is still staying at "Extract data from webpage")
Then I modified the page number of 30 then the process can run to the final step with the output of an Exel file.
Can you please explain me the reasons for this case or advise another flow desgin to capture the data (the number of pages I want to extract is more than 3000)
Thank in advance!!!

Categories:

Power Automate Desktop

I have the same question (0)

All responses (6)

Answers (0)

Sort by

Riyaz_riz11 4,150 Super User 2026 Season 1 on at

Like (0)

Report
Copy link

Link copied!

Hi @tamdoan2802 ,

Just use this action after extraction of elements use the below set elements as pager so it will be extract whole data as expected.

If it helps Mark as solution and if likes give a thumbs up

Regards,

Thanks

1 people found this reply helpful.

Was this reply helpful? Yes No
Agnius Bartninkas Most Valuable Professional on at

Like (0)

Report
Copy link

Link copied!

The paging functionality is not great in general in PAD. I would suggest instead extracting the values from each page into individual tables and run that in a loop until you process all pages. See this tutorial for an idea on how to do that: https://www.youtube.com/watch?v=yvoUBwCqdn0&ab_channel=AndersJensen

-------------------------------------------------------------------------
If I have answered your question, please mark it as the preferred solution. If you like my response, please give it a Thumbs Up.

I also provide paid consultancy and development services using Power Automate. If you're interested, DM me and we can discuss it.

Was this reply helpful? Yes No
tamdoan2802 6 on at

Like (0)

Report
Copy link

Link copied!

Hi @Ahammad_Riyaz
Firstly, I would like to express my sincere thanks for your comment.
As you mentioned about "Set element as pager", I've already chosen this for the extraction process.
The main point I want to focus is about the number of page that this PAD can process is limitted within 30 pages and When I increase the number of pages more than 30, this process became infinite run and did not stop.

Was this reply helpful? Yes No
tamdoan2802 6 on at

Like (1)

Report
Copy link

Link copied!

Hi @Agnius
First of all, I would say that the guidance in your proposed videos truly solve my cases. However, I found that this solution requires some knowledge relating to web coding language and functionality that are quite complicated to me now.
But the great thing that you mentioned about using Looping to repeat each pages may bring up me a way worth trying.
I will check this way and post the results after succeeding.
Thank you so much.

Was this reply helpful? Yes No
Agnius Bartninkas Most Valuable Professional on at

Like (0)

Report
Copy link

Link copied!

I believe the way the author of the video explains things should be detailed enough even for a beginner. But if it seems to complex, you might as well try watching more of their videos, or post a follow-up question here with more details on what you're struggling with.

-------------------------------------------------------------------------
If I have answered your question, please mark it as the preferred solution. If you like my response, please give it a Thumbs Up.

I also provide paid consultancy and development services using Power Automate. If you're interested, DM me and we can discuss it.

Was this reply helpful? Yes No
Riyaz_riz11 4,150 Super User 2026 Season 1 on at

Like (0)

Report
Copy link

Link copied!

Hi @tamdoan2802

I got your problem what you are facing same challenges even i am also faced, you can use get details(i mean total page number present in screen ) in that webpage it may be may be 35 or anything whatever it was present in webpage.

After that extracted variable pass inside the extract datatable action the number of pages you can pass so it may be not like infinity.

-------------------------------------------------------------------------
If I have answered your question, please mark it as the preferred solution. If you like my response, please give it a Thumbs Up.

Regards,

Ahammad Riyaz

Was this reply helpful? Yes No