Re: Are there any way to increase timeout value of Action node
We are also facing this issue and getting error after (approx 2 minutes) and seems like PVA times out just before the response is received from LLM. Error is also confusing and does not indicate any proper reason.
Error from PVA: Sorry, something went wrong. Error code: SystemError. Conversation ID: b5093709-9fee-4927-8e51-92f3a4137d91. Time (UTC): 3/28/2024 12:48:27 PM.
In our case, we have an http call which calls LLM (AzureOpenAI) and it takes little over 2 minutes and depending on the model and data, it can take even more time but normally request gets processed within 3 minutes. We can see in our application log that LLM is sending the response and before that response goes to PVA, PVA is showing above error. It seems like PVA gives this error if response is not received in 100 seconds or 2 minute (not exactly sure for PVA timeout value as could not find in PVA documentation).
Using PVA with LLM will practically take more time depending on data and model used. In our case, all the services are used from Microsoft Azure OpenAI and if Microsoft thinks that PVA should get response within 100 seconds then you should optimize LLM response in Azure to be faster. If you restrict user to not allow to change this timeout value then PVA is truely useless for many usecases and Microsoft should clearly indicate in bold letters that the response has to come in 100 seconds or do not use PVA as it is wasting lot of development time and customers gets frustrated. Also error should clearly indicate the reason and should not be generic message.
We found one setting in http request setting for request timeout as per attached screenshot and we have also configured it to 3 minutes but it does not seem to be using that setting. Is that a bug in that setting? what is the use of that setting?
I hope someone from copilot studio team can provide quick answer here. Thanks in advance.