Not include citation in CoPilot

Like (5) Share

Report

Posted on 5 Feb 2024 11:33:11 by Shruthi86

Hello,

While using generative AI and providing answers to end users, I do not want my copilot to include the Citation or reference document from which it is referencing as it may contain sensitive information. How can I restrict it while i still use the uploaded files as reference only in the background?

Categories:

General

All responses (26)

Answers (0)

Suggested answer

CU18020552-0 2 on 18 Feb 2025 at 06:07:44

Like (1)

Report

Not include citation in CoPilot

To remove the citations we have to make the response to be in the form of "Record" instead of "String" , we can do that by changing the "Save LLM Response" to "Complete (Recommended)" in the Advance section of Generative Node properties.

Then to access the content from the Record we should use the variable "TypeofCusinies.Text.Content" or you can access the variable using the fx formula "Topic.TypeofCusinies.Text.Content".
This gives the same content which is given when the response is in the form of String.

Note: This example is taken with respect to my variable name you can use different variable name as per your requirement.
Enab 3 on 22 Jan 2025 at 06:07:18

Like (0)

Report

Not include citation in CoPilot

Okay Guys! so as per my understanding, we are to put substitute citations with blank references in "Conversational boosting" topic. But that topic isn't always checked. What if the question asked by the user, is actually present in knowledge document: word to word. In that case what should I do to hide the references and citations?
Suggested answer

CU20061832-0 2 on 20 Jun 2024 at 18:47:54

Like (1)

Report
Not include citation in CoPilot

Perhaps the worst thing you have ever seen but it works. Don't think Copilot will surface more than 10 citations. Saving gen ai response as a record and referencing in send a message using the power fx formula below.

Substitute( Substitute( Substitute( Substitute( Substitute( Substitute( Substitute( Substitute( Substitute( Substitute(topic.answer.text.content, "[1]", ""), "[2]", "" ), "[3]", "" ), "[4]", "" ), "[5]", "" ), "[6]", "" ), "[7]", "" ), "[8]", "" ), "[9]", "" ), "[0]", "" )
Suggested answer

Javs24 2 on 16 Jun 2024 at 19:24:49

Like (2)

Report

Not include citation in CoPilot

I share my code to remove the [n] text citations that would be applied after add 'responseCaptureType: FullResponse' in the code editor:

If(!IsBlank(Find(" [1]",Topic.Answer.Text.Content)),Left(Topic.Answer.Text.Content,Find(" [1]",Topic.Answer.Text.Content)-1)&".",Topic.Answer.Text.Content)
jaymumford 16 on 30 Apr 2024 at 13:52:53

Like (0)

Report

Re: Not include citation in CoPilot

Great Q. My sense is that what you are really saying is that you want response, say "We report through 3 frameworks: GRI, CDP, and SASB [1][2]." to be "We report through 3 frameworks: GRI, CDP, and SASB." - Meaning, w/o the "[1][2]." My guess is that we have to intercept the response, put that in a record, then somehow use JSON to replace [n] with nothing; basically, "replace" away the values thru, say [5]. I don't see any record.property that doesn't have the [1][n] embedded in it.
Freddie_B 60 on 23 Apr 2024 at 14:24:05

Like (1)

Report

Re: Not include citation in CoPilot

You're a legend @lonewolf1 ! I realized I was putting the reponseCaptureType in the wrong indentation.

Thank you so much for you help
lonewolf1 29 on 23 Apr 2024 at 13:51:58

Like (7)

Report

Re: Not include citation in CoPilot

Sure thing.
first click on your "create Generative Answers" node (aka generative node), then click on advanced.

Click on select a variable and then create a new variable (lets call it var1)

after you have created the variable, if the generative node your are modifying is NOT inside the 'conversational boosting' Topic, you will see that the copilot studio will automatically set the variable type to 'String'. If your Generative node is inside the booting conversation topic then you will see that it is defined as a record.

To the best of my knowledge, if the generative node output is set to String, the answer it returns will include citations. to fix this issue you would need to save the generative node output as 'Record' to make this change, you need to open the code editor of your topic

Next, find the section of the code that is related to the generative node

to change the output of generative node from "string" to "record" add the line 'responseCaptureType: FullResponse' to the end of the generative node part of code:

Close the code editor, and click on Generative node properties again. now you should see that var1 has changed from String to Record.

Next, I want to show the AI response to the user so I place a message node and select what type of a response I want to be shown. (only text, text and references, only references ,...)

Ps. the Var1.Speech is used when you are using voice instead of typing ( I think lol)
I hope it helps!
Freddie_B 60 on 23 Apr 2024 at 13:14:47

Like (0)

Report

Re: Not include citation in CoPilot

Hi @lonewolf1,

Could you explain me that better? How can you name your generative node output as a variable. I think I am confused 😅.

Thanks
lonewolf1 29 on 23 Apr 2024 at 13:00:21

Like (0)

Report
Re: Not include citation in CoPilot

I am making a document based QA bot and I am thinking of converting my PDFs to Json but unlike your case, I need the Responses to have references. If I can have your advice on the following 3 questions :
Would I still have references returned if I use JSON instead of Pdf?
I have Screenshots in my pdf document that should be included in the response but the Generative node can only return Text, do you happen to know how to fix it for pdf or JSON? ( I only have premium license for copilot studio, so I cant finish this project with Azure services)
Have you considered JSONl? I know that copilot doesn't accept JSONl but it is good to have the database in this format for possible future fine tuning
My Pdf file is a software guide and some of the screenshots are from the software environment that have to be part of the answer generative node creates.
Thank you in advance
lonewolf1 29 on 23 Apr 2024 at 12:51:44

Like (0)

Report

Re: Not include citation in CoPilot

My pleasure!! Dont forget that the Generative Node output should be saved as "Record".
If you are using "Generative" nodes outside of the "conversation boosting" topic , you will not have the option to select "Full response" as Generative node output. To fix that, open "Code Editor" of your topic (right up corner of screen) and add 'responseCaptureType: FullResponse' to your generative node. Now you will have the generative node output as a Record and you can choose what to display.

To be honest the microsoft guide for copilot studio is really bad and unorganized! We have to figure things ourselves lol I saw it by chance when I was looking at the variables in send message node.