web
You’re offline. This is a read only version of the page.
close
Skip to main content

Announcements

News and Announcements icon
Community site session details

Community site session details

Session Id :
Power Platform Community / Forums / Copilot Studio / Problems retrieving in...
Copilot Studio
Suggested Answer

Problems retrieving info from knowledge source

(0) ShareShare
ReportReport
Posted on by 8
Hi everyone, 
 
I've created an academic tutor agent designed to help students with their assignments. The main knowledge source for this agent is a large (1000 page) pdf of a social studies textbook. It's important that the agent only refer to the content of the textbook when answering student's questions and that it not use other soruces (including web and "general knowledge").   
 
The trouble is, when I shut off, "Use general knowledge" and "Use information from web" in the settings, the agent frequently gives the following error in response to queries: “no information was found that could help answer this," despite the fact that the relevant information is present in the textbook.
 
I was troubleshooting with Copilot and it suggested the following: 
1. Verify the pdf is actually text (possible OCR issue). I checked and I CAN select, copy, and paste text from the textbook, so I don't think that's the issue.
2. Consider breaking the pdf into smaller chunks (30 to 80 pages) with clear headers, section titles, and a consistent structure -> I haven't tried this, yet.
 
Is there anything else I should consider doing to fix this problem?
 
 
Categories:
I have the same question (0)
  • Suggested answer
    CU04022132-0 Profile Picture
    12 on at
    How did you add the PDF?
    Is it uploaded or hosted on SharePoint?
     
    Have you checked the activity to see if this landed on any topic? 
     
    Usually what I do is go to the fallback topic and point the knowledge there also.
  • SG-04021642-0 Profile Picture
    8 on at
    @CU04022132-0 Thanks for your reply. 
     
    I uploaded the file. It proccessed, and the status is "ready."
     
    Regarding your topic question: I'm a newb with this, so bear with me - In the "test your agent" section, I clicked on the "I'm sorry, I'm not sure how to help with that" response I got.
     
    That opened the topic window I think? It shows a flow of events starting with "Trigger" and moves downward to other events including, "condition," "all other conditions," "topic..." (see attachment "fallback"). 
     
    Is this the "fallback topic" you're referring to? 
     
     
    fallback.png
  • Alan San Agustin Profile Picture
    4 on at
    Hi,

    Just try to figure out if your issue is with the PDF (reference document) or your settings.
    First, leave all of your settings the same and change the reference document to a much simple one, like a 2 page document, with very simple Q&A.
    then ask the agent a question. If you get the correct response, then it may be from your Knowledge source.

    You could try to break the pdf into smaller chunks. But another thing to consider is the type of context that is in the 1000 page pdf.
    Being a social studies textbook, does it contain things like war, crime or any sensitive topics that might get flagged as sensitive or harmful?
     
    Let me know how it goes.
  • David_MA Profile Picture
    14,956 Super User 2026 Season 1 on at
    Do you have Acrobat Professional or whatever Adobe calls the version that comes with Adobe Creative Suite (not Acrobat Reader). If so, try opening the pdf in it and then saving it as a Microsoft Word document. Then use the Word file as your knowledge source. While I've got limited experience with Copilot Studio, I have found that Word files perform better as knowledge sources than PDF files.
     
    As others have suggested, I would also break your PDF into smaller chunks. Based on how RAG retrieval works, you'll get better responses. I am currently building an agent based on a book. At first, I tried it with one large pdf file of about 300 pages. Poor results. There are 37 chapters in the book, so I exported it to 37 pdf files. Better results, but still lots of issues. Finally, I exported the book to separate Word documents, and this has proven go generate much better responses.
     
    Although I still wasn't completely happy with the results yet. I did one more thing, which was to add metadata to the start of each Word document to give the AI grounding information of what could be found in the chapter. For example:
     
    Document Type: Novel Chapter
    Series Title: A Scout’s Honor
    Chapter Number: 3
    Chapter Title: Our Own Thing
    Primary Characters: Wayne Eichenbraut (one of Léo’s best friends), Léo Hill, Carol Hill (Léo’s mother), Mémé (Léo’s grandmother), Timmy Hill (Léo’s little brother), Buddy Carpenito (one of Léo’s best friends), Mr. Telford (mentioned; Scoutmaster)
    Setting(s): The Eichenbraut home, Lowell/Greater Lawrence area — early evening, spring 1943, The Dion family home, Neighborhood streets leading toward Partridge Hill for Boy Scout meeting
    Narrative Role: This chapter shifts the lens fully onto the boys’ world, illustrating how wartime anxiety seeps into everyday family life. It contrasts domestic warmth—hermit bars, chemistry sets, radio broadcasts—with the looming tension of blackout drills and family members serving overseas. It deepens Wayne’s emotional arc through his fear for his brother Harris, explores Léo’s worries about his father in the Army Air Corps, and highlights how the boys create small acts of mischief (the stink bomb) as a way to reclaim agency in a world dominated by war and adult concerns. The chapter also reinforces themes of friendship, boyhood resilience, and the intrusion of global conflict into local routines.
    Notes to AI: Use this file when specifically asked about the events of Chapter 3 (“Our Own Thing”). You may reference other chapters to explain character arcs, the boys’ emotional development, or connections to the broader wartime narrative, including the Navy Yard visit and their increasing awareness of national service.
     
  • David_MA Profile Picture
    14,956 Super User 2026 Season 1 on at
    I did a little searching, and there seems to be supported evidence that using Word documents as a knowledge source over pdf provides better results. You can read more at Different Copilot responses with identical PDF and DOCX content: Causes and solutions – 4sysops
  • SG-04021642-0 Profile Picture
    8 on at
     
    Hi, Alan. Thanks for your reply. 
     
    I exported a 25 page section from the 1000 page pdf. This section was about the Civil War. My prompt was, "I need to write a paper on the Civil War." I got the usual, "I'm sorry, I'm not sure how to help that."
     
    I exported a smaller, 2 page section next. Same prompt, and same result. 
     
    I realize the prompt is vague and this is intentional. Part of the agent's instructions is to seek clarity from the student ("Is this a paper for school?" "What is the specific assignment about the Civil War," etc.). 
     
    I took your advice, though, and asked it simple question with a direct answer in the text. The prompt was, "what crop did the South's economy rely upon?" When using both the 25 page and the 2 page .pdf, the Agent responded with an accurate answer instead of "I'm sorry, I'm not sure how to help with that." When I asked that same question using the full textbook though, I got the "I'm sorry, I'm not sure how to help with that."
     
    So, the agent sucessfully answered a simple question when the pdfs were smaller, but could not answer a simple question with the large pdf. The agent could not respond to vague questions regardless of the size of the knowledge file .pdf. When "use general knowledge" is switched on, the agent can answer vague questions and they follow the instructions to seek clarity from the student. The problem is, as I mentioned in my initial post, it's important that "use general knowledge" be shut off to force the agent to only use the content of the textbook when answering sudent's questions. 
     
    If you have any further input, I'd appreciate it! Thank you for the time spent so far...
     
     

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Season of Sharing Community Challenge Launch!

Jump in, show your community spirit, and win prizes!

Kudos to our 2025 Community Spotlight Honorees

Expanding mentorship, skilling, and AI innovation

Congratulations to the May Top 10 Community Leaders!

These are the community rock stars!

Leaderboard > Copilot Studio

#1
Valantis Profile Picture

Valantis 277

#2
11manish Profile Picture

11manish 206

#3
sannavajjala87 Profile Picture

sannavajjala87 156 Super User 2026 Season 1

Last 30 days Overall leaderboard