web
You’re offline. This is a read only version of the page.
close
Skip to main content

Notifications

Announcements

Community site session details

Community site session details

Session Id :
Power Platform Community / Forums / Copilot Studio / Why does Create Genera...
Copilot Studio
Unanswered

Why does Create Generative Answers Responding with Information not in Custom Data?

(0) ShareShare
ReportReport
Posted on by 3

Hi all, I created a simple Copilot to try out Create Generative Answers node.

weljo_web_1-1713467782829.png

 

The custom data source is a Table with the following information:

[ {
"Content": "Create An Email Signature - , click where you want the element to appear, and then do <strong>any</strong> of the following: Options How to To add. Then click OK To add a hyperlink Click Insert Hyperlink, type in the <strong>information</strong> or browse to a hyperlink",
"Title": "Create An Email Signature"
},
{
"Content": "What is a cookie? - contain <strong>information</strong> <strong>about</strong> your visit to the web page, as well as <strong>any</strong> <strong>information</strong> you've volunteered. In this way, a web server can gather <strong>information</strong> <strong>about</strong> which web pages are used the most, and which often use cookies that record <strong>any</strong> personal <strong>information</strong> you enter, as well as <strong>any</strong> items in your",
"Title": "What is a cookie"
},
{
"Content": "How to Deal with Spam - email address verbally or on paper, think carefully <strong>about</strong> whether or not you want to receive <strong>any</strong> to the spam problem by producing <strong>any</strong> of it yourself! In particular, learn <strong>about</strong> chain mail address to other spammers. It is critical that you pause and think before replying to <strong>any</strong> spam",
"Title": "How to Deal with Spam"
},
{
"Content": "Opening a text editor - Opening the company provided text editor is easy. Simply double click on the icon of the provided text editor in your Desktop!",
"Title": "Opening a text editor"
} ]

Notice that there is no reference to Outlook nor Word. However, if I ask the chatbot, "What is Outlook?" or "What is Word?", it returns a response.

weljo_web_0-1713467477592.png

 

While the responses look credible, I find it contrary to Generative answers - Microsoft Copilot Studio | Microsoft Learn:

  • Find, collate, and parse relevant information from a specified source. This source can be your company's website, or from multiple sources, including Sharepoint and OneDrive for Business.

 

Why does Create Generative Answers Responding with Information not in Custom Data? Is there a configuration that I missed to restrict the source?

Categories:
I have the same question (0)
  • Umianta Profile Picture
    290 on at

    Hi @weljo_web 

    There seems to be a bug in the Generative Answers capability in Copilot Studio.

    It appears that behind the scenes, the model is responding based on the data it was trained on, rather than using custom data.

    I also attempted to use your dataset and received a similar response. See below:

    Umianta_0-1713478706420.png

     

     

    If my response has addressed your query, kindly mark your post as Solved.

    If you found my response helpful or it provided you with a direction to proceed, please give it a Thumbs Up. Your Kudos are appreciated. You can accept multiple posts as solutions.

    If you're still encountering any issues or challenges, please don't hesitate to inform me so I can assist you further. I'm here to help.

    Cheers ,

    Umesh Khandelwal

     

  • HenryJammes Profile Picture
    on at

    This indeed looks like a bug. Can you open a support request please? https://learn.microsoft.com/en-us/power-platform/admin/get-help-support 

  • Umianta Profile Picture
    290 on at

    Thanks @HenryJammes  . I have opened a support request regarding this issue.

  • InesMarques Profile Picture
    2 on at

    Hello,

    Just out of curiosity, has this issue been solved?

    The same is happening to me, generative answer are just adding or making up information to questions that do have an answer in the source documents, instead of simply using what is there.

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Forum hierarchy changes are complete!

In our never-ending quest to improve we are simplifying the forum hierarchy…

Ajay Kumar Gannamaneni – Community Spotlight

We are honored to recognize Ajay Kumar Gannamaneni as our Community Spotlight for December…

Leaderboard > Copilot Studio

#1
Michael E. Gernaey Profile Picture

Michael E. Gernaey 273 Super User 2025 Season 2

#2
Romain The Low-Code Bearded Bear Profile Picture

Romain The Low-Code... 271 Super User 2025 Season 2

#3
S-Venkadesh Profile Picture

S-Venkadesh 101 Moderator

Last 30 days Overall leaderboard