Copilot Studio - Topic Creation & Management

Help to improve my agent repsonses

Like (2) Share

Report

Posted on 31 Mar 2025 14:54:20 by KA-31031447-0

We have built our first agent, a very simple agent who's only knowledge base is a sharepoint site containing our company master documents, which are in a folder structure based on the docuement type (quality form, standard operating procedure etc).

We have had some success with this for content searches, however for anything associated to document authors or titles it is lacking and frustratingly I cannot see how to improve it.

For example, the prompt:

"List all documents that have the prefix "BMSP" in there title"

The typical response is along the lines off:

"The documents with BMSP as there title prefix include:

BMSP001 - xxxxxxxxxxx

BMSP002 - xxxxxxxxxxx"

It typically return between two and five of this specific document type when there are a total 17

No matter how much I try and force the prompt for "all", "every" etc it still behaves the same.

I cannot see anything in studio to get better results, any help appreciated.

TIA

Kevin

Categories:

General

All responses (2)

Answers (0)

w.p 4,371 on 06 Apr 2025 at 08:07:04

Like (1)

Report

Help to improve my agent repsonses

LLMs for generative AI are designed to summarize information based on grounded knowledge. They don't list all files by default.

To list all files, you may need to use an action call flow and retrieve the info.
Suggested answer

w.p 4,371 on 06 Apr 2025 at 05:53:00

Like (1)

Report

Help to improve my agent repsonses

It started with 4 files. I managed to show more by adding "show top 20 files" into the agent instructions.

I haven't spent much time tweaking the agent, but the result is unreliable. Sometimes it shows only 10 files, and the file names don't always start with my preferred prefix text. I suggest using something else for prefix file searching.