web
You’re offline. This is a read only version of the page.
close
Skip to main content

Announcements

News and Announcements icon
Community site session details

Community site session details

Session Id :
Power Platform Community / Forums / Copilot Studio / AI invents answers, wh...
Copilot Studio
Unanswered

AI invents answers, which are not defined in the data source

(0) ShareShare
ReportReport
Posted on by 3

Hello! We recently defined a data source, in a Word document, but when questions are asked about topics NOT in that document, the AI makes up answers, which we don't want to happen. I tried changing the moderation to "high" but the same situation still occurs.
Do you know any other alternative that could help me?
thank you so much

Categories:
I have the same question (0)
  • HenryJammes Profile Picture
    Microsoft Employee on at

    Can you open a support request so this can be investigated further?
    Get Help + Support in Power Platform - Power Platform | Microsoft Learn

     

    Please provide these as part of the case description:

     

    Technical details:

    Tenant ID:

    Environment ID:

    Bot ID:

    Conversation ID (type "/debug conversationid" in chat canvas)

    Use the thumb down buttonIn the test pane, click on the thumb down button shown when Copilot Studio returns an inconsistent answer so that contextual data on the inconsistent answers are recorded.  

    botContent.zip snapshot:  Please attach the botContent.zip file for the conversation where you experienced the issue (from the test pane, click ... and "save snapshot")

     

    Issue description and details:

    User utterance

    Actual generated answer: 

    Expected generated answer (or explanation of what is wrong with the generated answer):

    Generative Answer source(s) (documents and/or URLs): 

     

    Screenshots:

    Please paste or add screenshots as attachments.

  • ajinkyadeshmukh Profile Picture
    6 on at

    Hi, did you find any solution on this?

  • citron-truc Profile Picture
    394 on at

    Good morning,

    From what I understand, changing moderation blocks toxic answers but doesn't check that the answers are correct. If you want to keep only truthful answers, you should check the temperature and the top_p parameters.

    A combination that worked for getting truthful yet entertaining answers was temperature = 0.1 and top_p = 0.4

    Have a great day !

  • ajinkyadeshmukh Profile Picture
    6 on at

    Good morning!!

     

    Thanks for your reply, I was thinking of changing the same things but where can we change that? Do we have option in the copilot studio to change those things? It would be helpful if I got that.

  • citron-truc Profile Picture
    394 on at

    For azure openai, it is in the connection properties. Other types of generative answers rely on microsoft copilot to extract the information from the document so I'm not sure you can modify directly the parameters of the model.

  • ajinkyadeshmukh Profile Picture
    6 on at

    ya, thanks

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Introducing the 2026 Season 1 community Super Users

Congratulations to our 2026 Super Users!

Kudos to our 2025 Community Spotlight Honorees

Congratulations to our 2025 community superstars!

Leaderboard > Copilot Studio

#1
Valantis Profile Picture

Valantis 279

#2
Romain The Low-Code Bearded Bear Profile Picture

Romain The Low-Code... 222 Super User 2026 Season 1

#3
Arild Aarnes Profile Picture

Arild Aarnes 64 Super User 2026 Season 1

Last 30 days Overall leaderboard