web
You’re offline. This is a read only version of the page.
close
Skip to main content

Announcements

Welcome to the Power Platform Communities
Register Today: Microsoft Business Applications Update- April 15th
Your Invited to Keeping It Real with the Power Platform
News and Announcements icon
Community site session details

Community site session details

Session Id :
Power Platform Community / Forums / Copilot Studio / Issue with Search Ret...
Copilot Studio
Answered

Issue with Search Retrieval When Scaling to Larger Document Sets (20 → 2500 Documents)

(0) ShareShare
ReportReport
Posted on by SA-09120954-0 4

Hi Team,

I am experiencing an issue with the retrieval functionality in my system. When adding a small set of 20 documents from my local storage, the chatbot is able to provide accurate answers with references from the documents. However, when I scale this to 2500 documents, the system fails to return any results, even though I know the answer exists in the documents, as it was working correctly with the smaller set.

Screenshot 2024-12-09 at 11.03.58.png
Categories:
General topics
I have the same question (0)
  • Verified answer
    Artur Stepniak Profile Picture
    Artur Stepniak 1,539 Moderator on at
    Hello,
     
    if you have a big number of documents, it'll be really hard for it to work properly as it's too much for a single model deployment. You'd need to think about approaching it differently - instead of uploading 2500 files, you could store the data on SP list or in Dataverse table. That way the model could use RAG to retrieve the data based on ODATA filter, instead of relying only on index search. Otherwise, it'll totally get lost in those documents. 
     
    In case of any other questions, let me know. If the answer helped you, mark it, so that others can benefit from it.
     
    Best regards,
     
    Artur Stepniak
  • SA-09120954-0 Profile Picture
    SA-09120954-0 4 on at
    Thank you Artur

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

News and Announcements

Welcome to the Power Platform Communities
Register Today: Microsoft Business Applications Update- April 15th
Your Invited to Keeping It Real with the Power Platform

Quick Links

Introducing the 2026 Season 1 community Super Users

Congratulations to our 2026 Super Users!

Kudos to our 2025 Community Spotlight Honorees

Congratulations to our 2025 community superstars!

Congratulations to the March Top 10 Community Leaders!

These are the community rock stars!

Leaderboard > Copilot Studio

#1
Valantis Profile Picture

Valantis 619

#2
chiaraalina Profile Picture

chiaraalina 171 Super User 2026 Season 1

#3
Haque Profile Picture

Haque 143

Last 30 days Overall leaderboard

Featured topics

Announcing the "Microsoft Copilot Studio ❤️ MCP" lab
Block PII/PCI in Copilot Studio agent user prompt
Welcome to the Copilot Studio forum!

Product updates

Microsoft Power Platform Community release plans