Announcements
Hi everyone,
I am running into a problem where I am only able to extract the first n number of requested elements from a site.
Is this a common problem, and how do I fix it?
@LauraBrunetto
Could you please elaborate your issue? If possible please share screenshot of your flow after hiding all the sensitiveThanks,Deenuji Loganathan 👩💻Automation Evangelist 🤖Follow me on LinkedIn 👥 -------------------------------------------------------------------------------------------------------------If I've helped solve your query, kindly mark my response as the solution ✔ and give it a thumbs up!👍 Your feedback supports future seekers 🚀 info if any?
You may need to check "use paging" and configure or, on some websites, scroll down before extracting the data, so that more items appear.
By explaining the process in more detail, we can help.
This is not a common problem, but it happens on some sites, depending on what you are trying to extract and how the site is built.
What action are you using to extract those elements? Are they all visible within the site when you extract them? Can you share a link to the site (if it is publicly accessible) with some details of what you're trying to extract?
Yeah scrolling down usually works, but this time I am stuck trying to scroll in a div element, is being a bit of a pain, since I'm unsure of the syntax.
Site is sadly not publicly available.
this is how I try to extract the data.
I think it's beacuse the div element isn't fully loaded that it doesn't work.
In case if your JavaScript is not working then use send keys like below and just loop based on length of your webpage:
Thanks,Deenuji Loganathan 👩💻Automation Evangelist 🤖Follow me on LinkedIn 👥 -------------------------------------------------------------------------------------------------------------If I've helped solve your query, kindly mark my response as the solution ✔ and give it a thumbs up!👍 Your feedback supports future seekers 🚀
Implemented it sadly doesn't seem to do the trick.
This is the relevant section
these are the settings I am currently using to get the href
Under review
Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.
Congratulations to our community stars!
Expanding mentorship, skilling, and AI innovation
These are the community rock stars!
Stay up to date on forum activity by subscribing.
David_MA 227 Super User 2026 Season 2
11manish 221 Super User 2026 Season 2
Mohsin Ali 132