Unanswered

Performance issue: "Get details of element on web page"

(0) Share

Report

Posted on by bigdan

Hi Community!
I have a web crawler that accesses a webpage and extracts data from there via "Get details of element on web page".
This is super slow, each access takes around 1 second.
Both Chrome and Edge face the same issue.

Any idea on how I could fix this?

Thanks a lot!

Daniel

Categories:

Power Automate Desktop

I have the same question (0)

All responses (2)

Answers (1)

yoko2020 495 on at

Like (0)

Report

@bigdan
- Use invoke web service combine with convert json to custom object (if the website output is in json)
- Use invoke web service combine with regex (if the website output is not in json)

You should not using web automation action to crawl big records. It is very slow.

Was this reply helpful? Yes No
Verified answer

bigdan 9 on at

Like (0)

Report

Thank you very much @yoko2020 .
I couldnt get the invoke web service to work because it is a Struts action.
But I found a workaround:
Instead of getting the details of the web page one by one, I just get the web page text once as string, and parse it.
Thanks for the help, it is much better now!

Was this reply helpful? Yes No