web
You’re offline. This is a read only version of the page.
close
Skip to main content

Notifications

Announcements

Community site session details

Community site session details

Session Id :
Copilot Studio
Suggested Answer

Building a Q&A Bot

(4) ShareShare
ReportReport
Posted on by 4
I'm trying to build a bot in Studio that can connect to a documentation and file repository. I assume SharePoint is the best option, but I'm open to suggestions. The repository needs to be shared by a small group of people who can add to it as they wish.
I set up a bot in Studio that walked me through a few simple steps, and soon I had a chatbot in my Teams that was answering questions. However, I've encountered a few problems. The bot isn't answering questions about some of the files, and it seems unreliable at times, occasionally failing to respond throughout the day.
Are there any insights I'm missing? The documentation I found seems outdated, with several unnecessary or unclear steps. Am I approaching this the best way, or does anyone have suggestions on how I could improve this process?
 
The ultimate goal of this exercise it to store shared documentation in that repository and be able to quickly query the bot for details about the documentation. 
 
Categories:
I have the same question (0)
  • w.p Profile Picture
    8,339 Super User 2025 Season 2 on at
    i'd suggest turning off the allow ai use it's knowledge.
  • Launchpad_McQuack Profile Picture
    4 on at
    How will that help? 
  • w.p Profile Picture
    8,339 Super User 2025 Season 2 on at
    Turn off the option to ensure the agent uses only the specific knowledge sources you provided.
  • BabyBots Profile Picture
    243 on at
    Do the document types you're training the bot on vary? 
     

    🚀 Automate. Optimize. Innovate. 🚀

    Helping businesses streamline workflows and maximize efficiency with Microsoft Power Platform. Let’s transform your processes and unlock new possibilities!

    Explore BabyBots.ai
  • CU22041912-0 Profile Picture
    2 on at
    Alright, I'll try it. 
  • Suggested answer
    Romain The Low-Code Bearded Bear Profile Picture
    2,183 Super User 2025 Season 2 on at
    Hello, you choosed a good use case for a first try. SharePoint is a good idea and could help you to understand many way of using copilot studio.

    First about documentation : i suggest you this official technical reference with a lot of information about knowledge source :
    - Limitation (size , content type, etc)
    - way of retrieve information
     
     
    Copilot studio use Retrieval Augmented generation to answer to the question. (call RAG).
    It's a 3 step process :
    - First understand the question
    - Search and retrieve information
    - Generate answer.
     
    To have better answer each of those step are important.
     
    - Search and retrieve -> here is the main and easy part for you : in the link i provided you have many way :
     
    - toggle of "Allow the agent to use general knowledge" : shut it down when you are begining : if you let it "on" it will use "internet information" to answer : better to remove it now
     
    - Tenant graph grounding : in the settings of the copilot studio, in generative AI TAB you could try "Enhanced search results" : look for limits and condition of activation in the previous link
     
    - Generative orchestration : at first you will think it s only usefull to orchestrate "action" but it does many more : it help understanding of the question and use AI to choose the knowledge sources and how to use it
     
    Now what happen if it's not enought ?
     
    Copilot studio is not chatGPT : just giving "a big sharepoint libary" and create a " GPT like" is not the way to go. I will recommand you to imagine to split you sharepoint libary in folder (5 or 10) , each folder for a specific content and create a knowledge source for each of them (when you provided the link you could target a folder) 
    Then give a description and name for each source.
    Then the generative orchestration will use only folder wich are best for the question.
     
    Still not enought ?
     
    Time to look on how topics work and prepare specific question or content type to beeing focus on special document or folder. in the topics, clic edit and select the knowledge source you have (could be a single document or a folder)
     
    Still not enought ?
     
    At this moment it's quiet complicated to go further without going deep in AI understanding :) but there are still solution :) 
     
    Hope it help you :)   if it s the solution for you : remind to click on "this is the answer" :) it's very important

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Forum hierarchy changes are complete!

In our never-ending quest to improve we are simplifying the forum hierarchy…

Ajay Kumar Gannamaneni – Community Spotlight

We are honored to recognize Ajay Kumar Gannamaneni as our Community Spotlight for December…

Leaderboard > Copilot Studio

#1
Michael E. Gernaey Profile Picture

Michael E. Gernaey 279 Super User 2025 Season 2

#2
Romain The Low-Code Bearded Bear Profile Picture

Romain The Low-Code... 200 Super User 2025 Season 2

#3
S-Venkadesh Profile Picture

S-Venkadesh 94 Moderator

Last 30 days Overall leaderboard