Unanswered

Enhancing CoPilot to Provide Accurate Responses from Diverse Manuals in SharePoint Document Library

(0) Share

Report

Posted on by Mitchelvdh

Hi everyone,

I'm working on building a CoPilot that reads manuals from SharePoint. The goal is to assist technicians in installing specific products for customers.
I've successfully established a connection with SharePoint through app registration, allowing me to read manuals (PDFs) from a SharePoint document library.

Example scenario:

I have installation manuals for, for instance:

TV: Samsung Installation Manual.pdf
TV: LG Installation Manual.pdf
Washing Machine: AEG Installation Manual.pdf
Chromast Installation Manual.pdf
etc., etc., etc.

What is going 'wrong':

When I ask a question like, 'How do I set up Wifi on my LG TV?', it provides answers from all different manuals. As we know, setting up Wifi is not the same on every TV, or at least not the same steps.

I've tried adjusting the CoPilot content moderation to:

High: I get no answer
Medium: I get an answer, but it's incorrect
Low: I get an answer, but it's an even worse answer

Are there specific techniques that I'm missing? How can I approach this situation more effectively?

I appreciate all responses and would love to hear your perspective on how I can improve this!

Categories:

General topics

I have the same question (0)

All responses (4)

Answers (0)

Audrie101 on at

Like (1)

Report

Thank you for your patience @Mitchelvdh . Yes, there are things you can do to target the content based on the consumer target TV. Here is something you may want to consider:

Have you set up an entity for the devices (you may choose to have an entity for each device type as well)? This would enable Copilot to recognize terms in the prompt related to that specific device.

Create and use entities (contains video) - Microsoft Copilot Studio | Microsoft Learn

Please let me know if you are able to do this.

(Also, will you check using standard search on SharePoint that typing the prompt finds the right document. This is just to check that the PDF text is being read.)

Standing by to continue helping you.

Was this reply helpful? Yes No
remidyon on at

Like (0)

Report

Hi @Mitchelvdh
Just a side note: generative answers only support document <3MB - so make sure all the PDFs you have on your Sharepoint site are under that size otherwise they won't be taken in account.

If results are not to your expectations with Sharepoint I would recommend you upload your documents directly to your copilot which will leverage semantic indexing and will help a lot with the quality on response (especially when multiple documents are talking about similar topics)

Was this reply helpful? Yes No
theMac on at

Like (0)

Report

I'm interested in this conversation, I did the same thing for my copilot uploading a lot of products's pdf to it (not using Sharepoint).
I see Copilot reads inside pdfs but often it reports references from wrong pdfs (it answers about a product but using references related to other products).
In wich way the "... set up an entity for the devices (you may choose to have an entity for each device type as well)" helps Copilot to point the right pdf? Have I to target it or Copilot does this automatically just because it has a recognized entity? (I mean, having an entity recognized Copilot filters pdfs by itself using the entities or have I to tell to it to do that, and in this second case how have I to do that?)
thank you

Was this reply helpful? Yes No
remidyon on at

Like (1)

Report

Hello @theMac
If Copilot answers the question but provide the wrong citation/reference link then it is a bug and you should open a support ticket - there is nothing you can do to correct this (entity recognition will not change that)

Was this reply helpful? Yes No