I would assume your page loads the values as you scroll using JS and thus at a given time it only "contains" the data that is visible on the screen. If that is true, these sorts of pages are usually a pain to navigate.
If that is the case, what you might have to do, is make sure that you keep extracting your data before processing each row, so that you make sure you're clicking on the right one. I have done something like that a few times. Not because of the scroll changing the ordinal position of a row, but sometimes simply because processing a value would take me to another page, and then once I had returned, new values could have popped up in the meantime, sending previous values down in the list.
So, I would initially capture the entire list to know what I'm processing, but before I process any row, I would capture the list again to find the position of the current value I'm looking for.
-------------------------------------------------------------------------
If I have answered your question, please mark it as the preferred solution. If you like my response, please give it a Thumbs Up.
I also provide paid consultancy and development services using Power Automate. If you're interested, DM me and we can discuss it.