Answered

Integrating PVA in Azure Data

(0) Share

Report

Posted on by jthacker

H all,

I want to connect my Azure Data (from a Cognitive Search resource) using PVA Conversation Booster and I want to ask if anyone has experienced using the Model Data configuration. Any help or advice is much appreciated.

Thank you!

Categories:

Calling actions from Copilot Studio

I have the same question (0)

All responses (13)

Answers (1)

HenryJammes Microsoft Employee on at

Like (1)

Report
Copy link

Link copied!

Hi @jthacker,

Quick question: are you planning the configuration from the Azure OpenAI studio?
Today, this is from where you should start creating a PVA chatbot connected to Azure OpenAI on your data.
See: https://powerusers.microsoft.com/t5/General/Azure-OpenAI-on-your-data-deploying-to-a-different-environment/m-p/2316247/thread-id/6412

Henry

Was this reply helpful? Yes No
jthacker 54 on at

Like (0)

Report
Copy link

Link copied!

Thanks @HenryJammes

Was this reply helpful? Yes No
jthacker 54 on at

Like (0)

Report
Copy link

Link copied!

Thank @HenryJammes
I have one inquiry though "How do you address random inputs or characters from users like "3q453q5" or "\xsvsdvsvsv" or "dsdsadadad"? When I enter random characters after a sensible query, PVA just repeat its response and not really responding properly like "Im sorry I didnt get that".

Hope you can help.

Was this reply helpful? Yes No
HenryJammes Microsoft Employee on at

Like (0)

Report
Copy link

Link copied!

I'm not sure I follow, do you have a screenshot?

Unrecognized user utterances trigger the UnrecognizedIntent trigger.
It first goes through the Conversational Boosting system topic.
If no answer is returned by Generative Answers, it continues to the Fallback topic.

Henry

Was this reply helpful? Yes No
jthacker 54 on at

Like (0)

Report
Copy link

Link copied!

Sorry about that.

Im stress testing the bot from azure openai and deployed in PVA. And after a response from a bot I tried prompting it with random letters and/or texts see photo below. How can we fix this issue?

Thank you @HenryJammes

Was this reply helpful? Yes No
HenryJammes Microsoft Employee on at

Like (0)

Report
Copy link

Link copied!

Thank you @jthacker - I see. Interesting. Let me flag @Jameslew_MSFT

Was this reply helpful? Yes No
HenryJammes Microsoft Employee on at

Like (0)

Report
Copy link

Link copied!

@jthacker do you also experience the same in the Azure OpenAI studio?

Was this reply helpful? Yes No
jthacker 54 on at

Like (0)

Report
Copy link

Link copied!

Yes @HenryJammes the same thing happens. If it helps, I added my data from azure search service.
I tried adjusting the parameters but performance did not improve.

Was this reply helpful? Yes No
HenryJammes Microsoft Employee on at

Like (1)

Report
Copy link

Link copied!

If it happens in the Azure OpenAI studio, I'm guessing it's fair to expect the same to happen in PVA.
How have you setup the temperature or top P that control how deterministic or random the response is?

I get the model to respond that they can't find an answer:

Was this reply helpful? Yes No
jthacker 54 on at

Like (0)

Report
Copy link

Link copied!

Thats interesting @HenryJammes . I tried to copy your P control but it doesnt fix the issue. Interestingly after a few tries, it happens more in PVA.

Do you think it has something to do with the way I loaded the data?
How did you load yours?

Additionally, may I also ask what is the meaning of this error? I'm getting this often

Thanks!

Was this reply helpful? Yes No