Skip to main content

Notifications

Community site session details

Community site session details

Session Id : SSAamH4XXj9TvpHSR9pADR
Copilot Studio - Topic Creation & Management
Suggested answer

Help to improve my agent repsonses

Like (2) ShareShare
ReportReport
Posted on 31 Mar 2025 14:54:20 by
We have built our first agent, a very simple agent who's only knowledge base is a sharepoint site containing our company master documents, which are in a folder structure based on the docuement type (quality form, standard operating procedure etc).
We have had some success with this for content searches, however for anything associated to document authors or titles it is lacking and frustratingly I cannot see how to improve it.
 
For example, the prompt:
"List all documents that have the prefix "BMSP" in there title"
 
The typical response is along the lines off:
"The documents with BMSP as there title prefix include:
BMSP001 - xxxxxxxxxxx
BMSP002 - xxxxxxxxxxx"
 
It typically return between two and five of this specific document type when there are a total 17
 
No matter how much I try and force the prompt for "all", "every" etc it still behaves the same.
 
I cannot see anything in studio to get better results, any help appreciated.
 
TIA
Kevin
 
Categories:
  • w.p Profile Picture
    4,083 on 06 Apr 2025 at 08:07:04
    Help to improve my agent repsonses

    LLMs for generative AI are designed to summarize information based on grounded knowledge. They don't list all files by default.

    To list all files, you may need to use an action call flow and retrieve the info.

  • Suggested answer
    w.p Profile Picture
    4,083 on 06 Apr 2025 at 05:53:00
    Help to improve my agent repsonses
    It started with 4 files. I managed to show more by adding "show top 20 files" into the agent instructions.

    I haven't spent much time tweaking the agent, but the result is unreliable. Sometimes it shows only 10 files, and the file names don't always start with my preferred prefix text. I suggest using something else for prefix file searching.

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Understanding Microsoft Agents - Introductory Session

Confused about how agents work across the Microsoft ecosystem? Register today!

Warren Belz – Community Spotlight

We are honored to recognize Warren Belz as our May 2025 Community…

Kudos to the March Top 10 Community Stars!

Thanks for all your good work in the Community!

Leaderboard

#1
WarrenBelz Profile Picture

WarrenBelz 146,731 Most Valuable Professional

#2
RandyHayes Profile Picture

RandyHayes 76,287 Super User 2024 Season 1

#3
Pstork1 Profile Picture

Pstork1 66,075 Most Valuable Professional

Leaderboard

Featured topics

Loading started
Loading complete