Unanswered

Not selectng all the titles while scraping data

(0) Share

Report

Posted on by Ada1998

We created this automatisation that is selecting all the names in Power BI list with access to report.
We craped the data and power automate selected all the names autmaticly. Later when names were exported into excel we saw there are only names that are showed on the screen but not also the names that are lower.

Example: There are 36 people, that power automate selectes.
in excel we can see only first 21 of them, others are not exported.

There is only one page so pager doesn't really work.
Does anyone know how to solve this?

Categories:

Power Automate Desktop

I have the same question (0)

All responses (8)

Answers (0)

Sort by

Nived_Nambiar 18,138 Super User 2026 Season 1 on at

Like (0)

Report
Copy link

Link copied!

Hi @Ada1998

Is there any button something like load more which needs to be click so that more data gets loaded in your power bi page which prevents from extracting the data ?

Was this reply helpful? Yes No
Ada1998 16 on at

Like (0)

Report
Copy link

Link copied!

Hey, no there is no button just a list of names.
since I can't show you the original, this is the example how it looks like: https://www.ssa.gov/oact/babynames/decades/century.html

no buttons, no pages only list... there is only an option to scroll lower on the side (scroll thing that every webiste has) till the bottom

Was this reply helpful? Yes No
Nived_Nambiar 18,138 Super User 2026 Season 1 on at

Like (0)

Report
Copy link

Link copied!

So could you confirm whether the PAD while scraping details from website was scraping 21 data only not 36 ?

Was this reply helpful? Yes No
Ada1998 16 on at

Like (0)

Report
Copy link

Link copied!

Yes. We checked to be sure and it was very clear that only names that appears on the screen are in excel file, al the names below are missing.

Was this reply helpful? Yes No
Agnius Bartninkas Most Valuable Professional on at

Like (0)

Report
Copy link

Link copied!

It might be that the list on the page is divided into sections that encapsulate a part of the data. Try making a copy of your Extract data from web page action and then try capturing the names that are not currently scraped. Then compare the selector generated by the action with the one you used originally. There might be some items that have a different :eq() parameter there that you could likely remove to have all of your data scraped at once.
-------------------------------------------------------------------------
If I have answered your question, please mark it as the preferred solution. If you like my response, please give it a Thumbs Up.
I also provide paid consultancy and development services using Power Automate. If you're interested, DM me and we can discuss it.

Was this reply helpful? Yes No
Ada1998 16 on at

Like (1)

Report
Copy link

Link copied!

Did not work. I fixes the situation ro add two steps in the flow where letter size goes in browser goes on minimum. Than it works.

Was this reply helpful? Yes No
Agnius Bartninkas Most Valuable Professional on at

Like (0)

Report
Copy link

Link copied!

It might be that your page is infused with a lot of JavaScript that loads only the entries that are visible on the screen. When that is the case, PAD will only extract what's visible, because that's what is loaded.
Most pages like that also have an exposed API that you could use, and that usually work much better. But zooming out is also an option, sure.

Was this reply helpful? Yes No
Pavel_NaNoi 1,074 on at

Like (0)

Report
Copy link

Link copied!

Might be easier to have the bot do this rather than bothering with Extract data from window:

"However, you can export a table from the Power BI desktop to Excel by selecting a table in the “Data” view, then right-clicking and selecting “Copy” for a column or “Copy Table” for the full table. To access the data, just paste it into an Excel file."

Source - https://intellipaat.com/blog/export-power-bi-data-to-excel/?US#:~:text=However%2C%20you%20can%20export%20a,it%20into%20an%20Excel%20file.

Was this reply helpful? Yes No