Unanswered

Make the agent answer the questions

(2) Share

Report

Posted on by RA-13050725-0

Hi everyone,

I'm currently working on building an agent in Copilot Studio and need some assistance. My idea is to create a knowledge base with a set of questions. Users should be able to upload documents in the chat, and the agent should then retrieve information from these attached documents to answer the questions in the knowledge base.

For example, the agent's response could look like this: "Question 1 - [answer], retrieved from the attached document."

"Question 2 - [answer], retrieved from the attached document"

etc etc.

Also it will be set up to not use internet, it will only get information from det questionairy and the attached documents from the user.

I have tried in different ways but it will not work, have anyone tried something similair?

I would appreciate any tips and advice on how to best implement this. Thanks in advance!

Best regards,

Categories:

General topics

I have the same question (0)

All responses (2)

Answers (0)

Romain The Low-Code... 2,124 Super User 2025 Season 2 on at

Like (1)

Report

hello, it seems you are trying from declarative agent from M365 copilot.

If you try from the real copilot studio, it's quiet fast to achieve

On the home page of you agent you have a checkbox to uncheck about "using only base knowledge" .

About uploading document and asking question about it : it's the basic way and need nothing to do.

But you can add manually the document to the knowledge base by click on knowledge and add document.

If you want to use document from user and them to the KB, you need a sharePoint KB and add them with power automate, you will need some help or folow some tutorial about power automate.

Was this reply helpful? Yes No
RA-13050725-0 9 on at

Like (0)

Report

Hello.

I have tested both in the application and via the 'real' Copilot studio. In the real studio, I have done exactly as you described, but the problem I encounter is that it doesn't quite perform its task. I have about 200 questions that the agent is supposed to have in its knowledge base. I tried to insert one Word document with all the questions numbered, and I have tested similarly with a SharePoint file. I have also tried to split the 200 questions into 5 smaller files with about 50 questions each and asked the agent to analyze the attached documents and first answer the questions in file A, then B, then C, and so on. The agent starts answering the questions; you can see in the chat how it generates a response, and sometimes it answers the questions correctly, but sometimes it responds the same to all questions, saying it can't find any answers in the attached documents. When it has gone through a number of questions, it stops and responds, 'This answer was filtered by the AI system.' So it has never managed to complete its task without stopping each time.

In the application, it actually works better. There, I have inserted 5 different files with 50 questions per file. Then I have added 5 prompts named 'answer the questions from document A, B, C, and so on.' The problem then is that with the first prompt, the agent answers all the questions correctly. But when you ask it to answer the questions in the other documents, it only answers about half of them.

Was this reply helpful? Yes No