Skip to main content

Notifications

Copilot Studio - Calling Actions from Copilot S...
Answered

Integrating PVA in Azure Data

(0) ShareShare
ReportReport
Posted on by 54

H all, 

 

I want to connect my Azure Data (from a Cognitive Search resource) using PVA Conversation Booster and I want to ask if anyone has experienced using the Model Data configuration. Any help or advice is much appreciated. 

 

jthacker_0-1693853214026.png

 

Thank you!

Categories:
  • Verified answer
    HenryJammes Profile Picture
    HenryJammes on at
    Re: Integrating PVA in Azure Data

    Hi @jthacker,

     

    As it turns out to be more an Azure OpenAI question than a PVA one, can you raise this on the Microsoft Q&A?

    Ask a question - Microsoft Q&A

     

    Henry

  • jthacker Profile Picture
    jthacker 54 on at
    Re: Integrating PVA in Azure Data

    Hi @Jameslew_MSFT 

    Thank you for the response. I really dont think that they are account numbers or other codes as Im familiar with the documents. I tried it a few times, entering random letters and numbers but response from bot are either a copy of the previous response or a more detailed explanation of the previous prompt. It's really weird. 

  • Re: Integrating PVA in Azure Data

    Agree with Henry on this last point; if a data source comes back with a valid answer, we have no other signal to indicate to us that the input was gibberish.  It's even possible for some data sources that that may have been an account number or some other code that was intentional to hit a specific doc.

  • jthacker Profile Picture
    jthacker 54 on at
    Re: Integrating PVA in Azure Data

    Thats interesting @HenryJammes . I tried to  copy your P control but it doesnt fix the issue. Interestingly after a few tries, it happens more in PVA.

     

    jthacker_1-1694038029461.png

     

    Do you think it has something to do with the way I loaded the data? 

    How did you load yours? 

     

    Additionally, may I also ask what is the meaning of this error? I'm getting this often

    jthacker_0-1694039086082.png

     

    Thanks!

     

  • HenryJammes Profile Picture
    HenryJammes on at
    Re: Integrating PVA in Azure Data

    If it happens in the Azure OpenAI studio, I'm guessing it's fair to expect the same to happen in PVA.

    How have you setup the temperature or top P that control how deterministic or random the response is?

     

    I get the model to respond that they can't find an answer:

    HenryJammes_1-1694036863443.png

     

  • jthacker Profile Picture
    jthacker 54 on at
    Re: Integrating PVA in Azure Data

    Yes @HenryJammes  the same thing happens. If it helps, I added my data from azure search service.

    I tried adjusting the parameters but performance did not improve. 

  • HenryJammes Profile Picture
    HenryJammes on at
    Re: Integrating PVA in Azure Data

    @jthacker do you also experience the same in the Azure OpenAI studio?

  • HenryJammes Profile Picture
    HenryJammes on at
    Re: Integrating PVA in Azure Data

    Thank you @jthacker - I see. Interesting. Let me flag @Jameslew_MSFT 

  • jthacker Profile Picture
    jthacker 54 on at
    Re: Integrating PVA in Azure Data

    Sorry about that. 

     

    Im stress testing the bot from azure openai and deployed in PVA. And after a response from a bot I tried prompting it with random letters and/or texts see photo below. How can we fix this issue?

     

    jthacker_0-1694035489890.png

     

    Thank you @HenryJammes 

  • HenryJammes Profile Picture
    HenryJammes on at
    Re: Integrating PVA in Azure Data

    I'm not sure I follow, do you have a screenshot?

     

    Unrecognized user utterances trigger the UnrecognizedIntent trigger.

    It first goes through the Conversational Boosting system topic.

    If no answer is returned by Generative Answers, it continues to the Fallback topic.

     

    Henry

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Microsoft Kickstarter Events…

Register for Microsoft Kickstarter Events…

Announcing Our 2025 Season 1 Super Users!

A new season of Super Users has arrived, and we are so grateful for the daily…

Announcing Forum Attachment Improvements!

We're excited to announce that attachments for replies in forums and improved…

Leaderboard

#1
WarrenBelz Profile Picture

WarrenBelz 145,434

#2
RandyHayes Profile Picture

RandyHayes 76,287

#3
Pstork1 Profile Picture

Pstork1 64,722

Leaderboard

Featured topics