How to click dynamic UI element in application?

(0) Share

Report

Posted on by Kingmir

Hi, peers

I have one question when using the Power Automation Desktop. Here's the simplified version of my real problem.

Take OneNote for example, If I need to select note sections repeatedly, and input random figure in every related note page?

I am wondering whether "Select menu option in Window" or "Click UI element in window" can fulfill my needs.

Thanks advance for your answering and read.

Categories:

Power Automate Desktop

All responses (4)

Answers (1)

Sort by

Verified answer

geavgous Microsoft Employee on at

Like
a
(1)

Report
Copy link

Link copied!

Hi @Kingmir ,

Thanks for trying out Power Automate! In this challenging case, the actions seem correct, in case NotePad is used from the desktop side and not on the browser where you will have to switch to web automation.
However, when you deal with dynamic IDs, the selector you create should also be a bit more advanced, which requires some advanced knowledge.
You can capture a UI element, and try to modify it, or even create it from scratch, so that it can recognize and capture elements, the IDs of which keep changing after each reload.
So instead of tracking a UI element by it's ID, you can use other attributes like, name e.t.c.

Thanks
George
Kingmir 8 on at

Like
a
(0)

Report
Copy link

Link copied!

Hi, George

thanks for your prompt reply~ 🌺

As I mentioned before, OneNote is just an example to illustrate my real problem. The real problem is to build one automation flow on a internal system without Web version, therefore, unfortunately, no web automation can be used.

Your suggestion really insights me, I have tried switching ID, like following (Sorry, I only installed mandarin version😁, and don't know how to change, it's another obstacle when I watch tutoring videos, mapping by relative location and icons)

First, I capture UI ID for "New1" and "New2", by comparing, I found the only difference between two UI element is the yellow part.
So I find the difference place, and change 1 to %LoopIndex%
But in this way, nothing can be clicked, I don't know how to solve this.
Kingmir 8 on at

Like
a
(0)

Report
Copy link

Link copied!

Hi, George

Wahahahaha!!! Thanks to you, I just find out the solution~
Click the yellow button, switching to editable version, choosing variable here.
Don't know the difference, but it works!

Woooooeeeeeee

Thanks, George
geavgous Microsoft Employee on at

Like
a
(1)

Report
Copy link

Link copied!

It's great @Kingmir that it worked! In case you consider this issue solved, please go ahead and mark it as resolved! Happy to help with anything else you might need 🙂
Thanks,
George