web
You’re offline. This is a read only version of the page.
close
Skip to main content

Notifications

Announcements

Community site session details

Community site session details

Session Id :
Power Platform Community / Forums / Power Automate / UI Flow, Desktop App- ...
Power Automate
Unanswered

UI Flow, Desktop App- Left Click not working

(0) ShareShare
ReportReport
Posted on by

I seek to make the desktop playback function actually do a recorded cleft click. 

After successfully:

1. loading an app (VNC Viewer)

2. right clicking the correct shortcut link to open the context window

3. selecting "Connect" in said context window

4. closes the VNC window

5. as a result of step 3, a new window, named "Web/Ax 4 (webax1) - VNC Viewer", is opened

6. enters saved input (login info)

7. presses "enter" to login

at this point, the window name (Web/Ax 4 (webax1) - VNC Viewer) remains the same, but no more context windows are allowed- AKA, "right click" does nothing- within this window. 

 

the code trips on the last step. I need the program to left click one more time, selecting a specific server group to monitor. 

 

The selector code for the left click action:

 

 

 

{
 "type": "WinUIA",
 "parameters": {
 "elementStack": [{
 "automationId": "",
 "boundingRectangle": "37,0,1809,1020",
 "className": "vwr::CDesktopWin",
 "controlType": "50032",
 "frameworkId": "Win32",
 "name": "Web/Ax 4 (webax1) - VNC Viewer",
 "localizedControlType": "Window",
 "xOffset": 185,
 "yOffset": 522
 }],
 "elementXPath": "/Window[@ClassName=\"vwr::CDesktopWin\"][@Name=\"Web/Ax 4 (webax1) - VNC Viewer\"]",
 "desktopNodeXPath": "/Pane[@ClassName=\"#32769\"][@Name=\"Desktop 1\"]",
 "applicationInfo": {
 "applicationId": "xZ1RsWpjOEq0MKcQY5Wtkg=="
 }
 }
}

 

 

 

I have adjusted

 

 

 

"xOffset": 185,
"yOffset": 522

 

 

 

to point to exactly where the mouse needs to click, but this code seems to bring the "mouse" to the center of the screen and, if it clicks, it clicks empty space.

I need the last left click to actually... click. What am I missing? 
Thanks in advance! 

Categories:
I have the same question (0)
  • v-alzhan-msft Profile Picture
    on at

    Hi @Anonymous ,

     

    I would make a test on my side and when the issue is reproduced on my side, I would reply here and provide a proper solution to you.

     

    Best regards,

    Alice       

    Community Support Team _ Alice Zhang
    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

  • Bretzeli Profile Picture
    13 on at

    Same here with 2.29.127.23042 and automation of Microsoft Flight Simulator 2020 a MS product.

     

    * NON Elevated OR Elevated

    Not working as per: 

    Can't interact with desktop application - Power Automate | Microsoft Learn

     

    Left Mouse click worked now not anymore or not like we want it to be. 

     

    UIAutomation.Click will not work since we need the window name and that has the version in it which changed with very update.

     

    We tried all options none of them works reliable:

     

    MouseAndKeyboard.SendMouseClick.Click ClickType: MouseAndKeyboard.MouseClickType.LeftButtonDown MillisecondsDelay: 2
    MouseAndKeyboard.SendMouseClick.Click ClickType: MouseAndKeyboard.MouseClickType.LeftButtonUp MillisecondsDelay: 3
    MouseAndKeyboard.SendMouseClick.Click ClickType: MouseAndKeyboard.MouseClickType.LeftClick MillisecondsDelay: 0

     

     

     

     

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Forum hierarchy changes are complete!

In our never-ending quest to improve we are simplifying the forum hierarchy…

Ajay Kumar Gannamaneni – Community Spotlight

We are honored to recognize Ajay Kumar Gannamaneni as our Community Spotlight for December…

Leaderboard > Power Automate

#1
Michael E. Gernaey Profile Picture

Michael E. Gernaey 501 Super User 2025 Season 2

#2
Tomac Profile Picture

Tomac 323 Moderator

#3
abm abm Profile Picture

abm abm 237 Most Valuable Professional

Last 30 days Overall leaderboard