Unanswered

Generative answers node doesn't provide answers using Azure OpenAI Connection

(0) Share

Report

Posted on by Skandula

I have a azure cognitive search index that my GPT35Turbo model is grounded on, the model provides answers based on the grounded data in Azure OpenAI Playground. But when I deploy this to a PVA in (East US Region), the PVA chat bot doesn't provide any answers from the generative answers node.

Checked the connection properties and data source parameters, everything looks okay. Am I missing anything?

@HenryJammes

All responses (9)

Answers (0)

Skandula 17 on at

Like (1)

Report

Re: Generative answers node doesn't provide answers using Azure OpenAI Connection

I ran into numerous issues in trying to accomplish this solution the way it is today, with quite a few improvisations to fit my requirements, but the posts below gave me a solid start.

Deploy your ChatGPT based model securely using Microsoft Teams, Power Virtual Agent and Azure OpenAI
Revolutionize your Enterprise Data with ChatGPT: Next-gen Apps w/ Azure OpenAI and Cognitive Search - Microsoft Community Hub
@HenryJammes did the trick.

Hope this helps!
sikder_al 24 on at

Like (0)

Report

Re: Generative answers node doesn't provide answers using Azure OpenAI Connection

@skandula1406 Any tutorial on how you did the cognitive search and feed it to OpenAI model? Spent the whole day trying to find a solution, looks like I have go with the Flow too.
sikder_al 24 on at

Like (0)

Report

Re: Generative answers node doesn't provide answers using Azure OpenAI Connection

yeah. keyword search and semantic search neither worked. Tried both GPT-4 and GPT35-Turbo too.
Skandula 17 on at

Like (0)

Report

Re: Generative answers node doesn't provide answers using Azure OpenAI Connection

Have tried both simple and semantic search, neither worked 😞
Skandula 17 on at

Like (0)

Report

Re: Generative answers node doesn't provide answers using Azure OpenAI Connection

While this gets resolved, I’ve deployed the chatbot using flows.

Here are the high level steps-
1. send user query as input to flow
2. query cognitive search index (Http - Post or Get)
3. feed the results of the query from step 2 to Azure OpenAI instance along with the system message.
4. capture response from OpenAI GPT model and send it back to PVA.

I would’ve preferred conversation boosting to leverage open conversation without having to direct the user to pre-defined topics, but this solution works well for now.
Skandula 17 on at

Like (1)

Report

Re: Generative answers node doesn't provide answers using Azure OpenAI Connection

No luck yet, MSFT support has been looking into it for over a week now. Will update here once I hear something.
sikder_al 24 on at

Like (0)

Report

Re: Generative answers node doesn't provide answers using Azure OpenAI Connection

@skandula1406 @HenryJammes
Same thing is happening to me. Did you find a way to make it work? Thanks!
Jameslew_MSFT on at

Like (0)

Report

Re: Generative answers node doesn't provide answers using Azure OpenAI Connection

It's worth also verifying that your index isn't configured for vector or semantic search while PVA is configured for basic search.
HenryJammes on at

Like (0)

Report

Re: Generative answers node doesn't provide answers using Azure OpenAI Connection

Hi @skandula1406

Nothing comes to mind when looking at your configuration.
Can you open a support request so this can be investigated in more details?
Get Help + Support in Power Platform - Power Platform | Microsoft Learn

Henry