I am running power automate desktop on windows VM.
My script does the following work:
- launches the browser, launch my website
- Enters the credentials.
- Click the submit
- Records the page load time.
I am running this script in loop , it runs every 10 mins. Reason for running it in VM is to run irrespective of whether my laptop is on or off.
Scripts runs perfect, when i open a remote desktop connection to VM and keep it open.
If i close the remote desktop connection to VM script is failing to enter credentials.
It launches the browser but it is not able to enter credentials in the specified UI elements.
I feel there is some issue with UI elements.
I need help.
Any leads??
Error message:
Correlation Id: e30caec9-81bb-46ce-b0f5-3a008d571694
Some simulated input commands were not sent successfully. The most common reason for this happening are the security features of Windows including User Interface Privacy Isolation (UIPI). Your application can only send commands to applications of the same or lower elevation.
Similarly certain commands are restricted to Accessibility/UIAutomation applications.
Refer to the project home page and the code samples for more information.: Microsoft.Flow.RPA.Desktop.Modules.SDK.ActionException: Failed to write text in form field. ---> System.Exception: Some simulated input commands were not sent successfully.
The most common reason for this happening are the security features of Windows including User Interface Privacy Isolation (UIPI). Your application can only send commands to applications of the same or lower elevation. Similarly certain commands are restricted to Accessibility/UIAutomation applications. Refer to the project home page and the code samples for more information.
at WindowsInput.WindowsInputMessageDispatcher.DispatchInput(INPUT[] inputs)
at WindowsInput.MouseSimulator.MoveMouseToPositionOnVirtualDesktop(Double absoluteX, Double absoluteY)
at Microsoft.Flow.RPA.Desktop.UIAutomation.DesktopCore.InputSimulator.MouseSimulatorProxyBase.MoveMouseToPosition(Point point)
at Microsoft.Flow.RPA.Desktop.Modules.WebAutomation.Common.WebAutomationRuntime.PerformClickAtElement(IWebAutomationBrowser browser, String cssSelectorForElement, ClickType clickType, RectangleEdgePoint mousePositionRelativeToElement, Int32 offsetX, Int32 offsetY)
at Microsoft.Flow.RPA.Desktop.Modules.WebAutomation.Common.WebAutomationRuntime.<>c_DisplayClass36_0.<PopulateTextFieldOnWebPagePhysical>b_0(Boolean wait, IWebAutomationBrowser browser)
at Microsoft.Flow.RPA.Desktop.Modules.WebAutomation.Common.WebAutomationRuntime.<>c_DisplayClass11_0`1.<ExecuteWebAutomationActionCore>b_0()
at Microsoft.Flow.RPA.Desktop.UIAutomation.Core.Utilities.Clock.Execute[T](TimeSpan timeout, TimeSpan period, Func`1 action, Func`2 successCondition)
at Microsoft.Flow.RPA.Desktop.Modules.WebAutomation.Common.WebAutomationRuntime.ExecuteWebAutomationActionCore[T](IWebAutomationBrowser automationBrowser, WebAutomationOptions webAutomationOptions, Func`3 coreFunction, Predicate`1 successCondition)
at Microsoft.Flow.RPA.Desktop.Modules.WebAutomation.Common.WebAutomationRuntime.ExecuteWebAutomationAction[T](IWebAutomationBrowser webBrowserInstanceVariant, WebAutomationOptions webAutomationOptions, Func`3 coreFunction)
at Microsoft.Flow.RPA.Desktop.Modules.WebAutomation.Common.WebAutomationRuntime.PopulateTextFieldOnWebPagePhysical(IWebAutomationBrowser webBrowserInstanceVariant, String cssSelectorForFormFieldElement, String textValue, Boolean emulateTyping, Boolean unfocusTextFieldAfterFillingIt, WebAutomationOptions webAutomationOptions, PopulateTextModeEnum operation)
at Microsoft.Flow.RPA.Desktop.Modules.WebAutomation.Common.WebAutomationRuntime.PopulateTextFieldOnWebPage(IWebAutomationBrowser webBrowserInstance, String cssSelectorForFormFieldElement, String textValue, String dialogButtonToPress, Boolean emulateTyping, Boolean waitForPageToLoad, Int32 courseOfActionIfDialogAppears, Boolean unfocusTextFieldAfterFillingIt, Int32 operationMode, Boolean usePhysicalKeyboard, TimeSpan waitForPageToLoadTimeout)
at Microsoft.Flow.RPA.Desktop.UIAutomation.AutomationServer.Host.WebAutomationRuntimeService.<>c_DisplayClass24_0.<PopulateTextFieldOnWebPage>b_0(IWebAutomationBrowser b)
at Microsoft.Flow.RPA.Desktop.UIAutomation.AutomationServer.Host.WebAutomationRuntimeService.<>c_DisplayClass31_0.<GetBrowserAndExecute>b_0(IWebAutomationBrowser b)
at Microsoft.Flow.RPA.Desktop.UIAutomation.AutomationServer.Host.WebAutomationRuntimeService.GetBrowserAndExecute[T](Func`2 action, WebBrowserInfo browserInfo)
at Microsoft.Flow.RPA.Desktop.UIAutomation.AutomationServer.Host.WebAutomationRuntimeService.PopulateTextFieldOnWebPage(WebBrowserInfo webBrowserInfo, String cssSelectorForFormFieldElement, String textValue, String dialogButtonToPress, Boolean emulateTyping, Boolean waitForPageToLoad, Int32 courseOfActionIfDialogAppears, Boolean unfocusTextFieldAfterFillingIt, Int32 operationMode, Boolean usePhysicalKeyboard, TimeSpan waitForPageToLoadTimeout)
--- End of remote exception stack trace ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at Microsoft.Flow.RPA.Desktop.UIAutomation.Shared.Rpc.RpcDispatchProxy`1.GetRemoteResultOrThrow(RemoteMethodCallResponse response, Type expectedResultType)
at Microsoft.Flow.RPA.Desktop.UIAutomation.Shared.Rpc.RpcDispatchProxy`1.Invoke(MethodInfo targetMethod, Object[] args)
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Reflection.DispatchProxyGenerator.Invoke(Object[] args)
at generatedProxy_1.PopulateTextFieldOnWebPage(WebBrowserInfo , String , String , String , Boolean , Boolean , Int32 , Boolean , Int32 , Boolean , TimeSpan )
at Microsoft.Flow.RPA.Desktop.Modules.WebAutomation.Actions.WebAutomationRuntimeServiceProxy.<>c_DisplayClass25_0.<PopulateTextFieldOnWebPage>b_0(IWebAutomationRuntimeService s)
at Microsoft.Flow.RPA.Desktop.Modules.WebAutomation.Actions.WebAutomationRuntimeServiceProxy.<>c_DisplayClass32_0.<ExecuteSafe>b_0(IWebAutomationRuntimeService s)
at Microsoft.Flow.RPA.Desktop.Modules.WebAutomation.Actions.WebAutomationRuntimeServiceProxy.ExecuteSafe[T](Func`2 action, TimeSpan timeout)
at Microsoft.Flow.RPA.Desktop.Modules.WebAutomation.Actions.WebAutomationRuntimeServiceProxy.ExecuteSafe(Action`1 action, TimeSpan timeout)
at Microsoft.Flow.RPA.Desktop.Modules.WebAutomation.Actions.WebAutomationRuntimeServiceProxy.PopulateTextFieldOnWebPage(WebBrowserInfo webBrowserInfo, String cssSelectorForFormFieldElement, String textValue, String dialogButtonToPress, Boolean emulateTyping, Boolean waitForPageToLoad, Int32 courseOfActionIfDialogAppears, Boolean unfocusTextFieldAfterFillingIt, Int32 operationMode, Boolean usePhysicalKeyboard, TimeSpan waitForPageToLoadTimeout)
at Microsoft.Flow.RPA.Desktop.Modules.WebAutomation.Actions.PopulateTextFieldBase.<Execute>b__37_0(IWebAutomationRuntimeService s)
at Microsoft.Flow.RPA.Desktop.Modules.WebAutomation.Actions.WebAutomationActionBase.<>c_DisplayClass4_0.<PerformWebAutomationWithLogging>b_0(IWebAutomationRuntimeService s)
at Microsoft.Flow.RPA.Desktop.Modules.WebAutomation.Actions.WebAutomationActionBase.PerformWebAutomationWithLogging[T](Func`2 action, WebAutomationRuntimeLogData requestData, Func`3 resultData)
at Microsoft.Flow.RPA.Desktop.Modules.WebAutomation.Actions.PopulateTextFieldBase.Execute(ActionContext context)
--- End of inner exception stack trace ---
at Microsoft.Flow.RPA.Desktop.Modules.WebAutomation.Actions.PopulateTextFieldBase.Execute(ActionContext context)
at Microsoft.Flow.RPA.Desktop.Robin.Engine.Execution.ActionRunner.Run(IActionStatement statement, Dictionary`2 inputArguments, Dictionary`2 outputArguments)
