You’re offline. This is a read only version of the page.
Announcements
5
Hi everyone,
I'm currently in the process of rolling out GenAI via Teams to my company.
I have released two apps so far:
First App: A simple GPT-4 connection for 1-to-1 chat via Teams and Azure OpenAI. For this, I utilized Azure OpenAI Services, CoPilot Studio, and Power Automate to manage aspects like chat history and session-based responses.
Second App: An Azure Prompt Flow Endpoint that utilizes the "Chat with your own data" service.
Both apps employ Power Automate to establish the connection with the LLM.
However, I'm facing two issues:
I have already found the KB article on setting up the Azure ML endpoint: https://learn.microsoft.com/en-us/azure/machine-learning/prompt-flow/how-to-enable-streaming-mode?view=azureml-api-2
Setting this up is not a big issue, but how do I adapt the requirements for CoPilot Studio and Power Automate to handle the streamed texts?
Has anyone already done this, or is there another way to achieve it?
I look forward to your answers, and thank you very much!
Stefan
Hi @HenryJammes, I went ahead and submitted using the link you shared here.
Does it need to be reviewed and then updated by staff before showing:
https://portal.productboard.com/fdeco3ykgkwvchtg4qbdowug/tabs/1-under-consideration
How do I know if the idea is actually being reviewed? Once it is added, I would like to share with other colleagues and developers at other large companies so they can upvote.
@Stefan3000 - We are also having similar setup like you I assume, for each user question we have 1 Azure open AI call + Azure Search + 1 Azure open AI call again, please check these areas you should be able to get it.
Hi @Stefan3000
Copilot Studio doesn't support streamed messages -- at least not in its current architecture.
If this is an important requirement, may I ask that you submit a feature request detailing the business case, here: aka.ms/CopilotStudioFeatureRequest?
Henry
Hi @ManikandanS ,
thanks for your reply.
We have a RAG-powered Azure Endpoint in place, which I can't get under 10-15% timeout rate.
I have found a way to handle long HTTP calls:
Unfortunatly the way which describes how to get the URI of the specific action doesn't work.
Is their a new way to get the URL of the HTTP action, so that I can build a loop to check if the status is 200 or 202?
Thank you!
Does anybody know how to get the URL of a
Hi @Stefan3000 ,
We have also undergone the same situation and don't think we have a way to show streaming response using power automate and co pilot studio. What we did from our side is we checked the other layers of system like Azure Open AI, Azure Search to speed up the overall turnaround time, thus improved our state and now we managed to send response to user question without timeout issues 99% of time.
Stay up to date on forum activity by subscribing. You can also customize your in-app and email Notification settings across all subscriptions.
Share
Report
All responses (
Answers (
