Skip to main content

Notifications

Community site session details

Community site session details

Session Id : z+a9gkb14IMo9ZQEnlyu20
Copilot Studio - General
Unanswered

References are wrong in copilot PVA response.

Like (0) ShareShare
ReportReport
Posted on 29 Feb 2024 05:38:28 by 4

Signed up for the trial in one of my tenants today to play around with the studio. I probably have not configured something correctly, but I cannot seem to find out what to change in order to get reference to be correct. The response is right, but the reference is obviously wrong. I will read through the docs soon.

 

TotallyRad_0-1709184852581.png

 

 

Categories:
  • jbaum02s Profile Picture
    6 on 03 May 2024 at 14:39:02
    Re: References are wrong in copilot PVA response.

    We are experiencing this issue as well. The answer is somewhat correct except one of the programs mentioned is not, but then the citation has nothing to do with the text referenced in the chat. 

     

  • LRPettit Profile Picture
    2 on 12 Apr 2024 at 12:46:32
    Re: References are wrong in copilot PVA response.

    It has been over a month and we are still experiencing this exact issue.  Is this going to get fixed?

  • TotallyRad Profile Picture
    4 on 14 Mar 2024 at 19:26:29
    Re: References are wrong in copilot PVA response.

    There are a couple things that can be done that I have found. One could be to specify keywords within triggers and provide generative nodes to those which eliminates the fallback error I initially posted. Another interesting thing is that specific nodes can be set to omit specific document sources within their yaml as explained here:
    https://learn.microsoft.com/en-us/microsoft-copilot-studio/nlu-documents#disable-documents-as-a-data-source-for-a-generative-answers-node

  • Jason_Crag Profile Picture
    3 on 14 Mar 2024 at 15:56:13
    Re: References are wrong in copilot PVA response.

    Until those improvements release (which, by the way, are we able to see when those are coming out?), is there anything we can do ourselves to improve the reference accuracy?

  • HenryJammes Profile Picture
    on 06 Mar 2024 at 17:29:08
    Re: References are wrong in copilot PVA response.

    There are a couple of improvements being released in the next couple of weeks that should improve hallucination and citation issues.

  • theMac Profile Picture
    on 06 Mar 2024 at 17:24:10
    Re: References are wrong in copilot PVA response.

    I experienced the same thing: in many cases answer is ok but references are off-topic

  • jfastreN Profile Picture
    2 on 06 Mar 2024 at 15:56:36
    Re: References are wrong in copilot PVA response.

    Hello, I have the exact same issue. Initially, generated answer is OK, references to documents are OK just after setting the data sources to one of my folders. When asking the exact same questions a few hours later, the text is a bit different but still OK, but document references are totally wrong. As I asked to cite sources, wrong documents are cited also in the answer. I did not change anything in the indexed folder. By wrong document, I mean that the content of the proposed document is not at all related to the question nor the answer given, while the answer is still relevant. Looks like something gets broken in the index.

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Understanding Microsoft Agents - Introductory Session

Confused about how agents work across the Microsoft ecosystem? Register today!

Warren Belz – Community Spotlight

We are honored to recognize Warren Belz as our May 2025 Community…

Congratulations to the April Top 10 Community Stars!

Thanks for all your good work in the Community!

Leaderboard

#1
WarrenBelz Profile Picture

WarrenBelz 146,745 Most Valuable Professional

#2
RandyHayes Profile Picture

RandyHayes 76,287 Super User 2024 Season 1

#3
Pstork1 Profile Picture

Pstork1 66,091 Most Valuable Professional

Leaderboard