We have an agent in Copilot Studio that uses Azure AI Search as a knowledge base. When we ask it a question that should return 10 -20 responses, we only get the top 3 - 5. This appears to be by design so as not to "overwhelm the user." How do we override this default behavior?
We have tried prompt engineering to tell the agent to always return as many results as possible but that doesn't work. We are currently using a workaround to use a Tool with an HTTP request to a Function that calls Azure AI Search. We then parse that respsonse to get what we want. We don't want to do this every time we use Azure AI Search as a knowledgebase.
There are few things to know when using Azure AI Searh :
- Number of answer and structure of answer is decide by the index : so it's about index configuration to decide the content to send to copilot studio
- Copilot studio limit to a very small size the answer and often 5 is "ok"
asking for 20 answer is not "good idea" for "RAG agent" : RAG is not business intelligence and that s why by default it refuse to answer so many result.
Solution
Solution 1 : Modifye Index to send more result but 20 will probably be too much for copilot studio answer limit and will crash. But easy try
Solution 2 : create an azure foundry agent dedicated to this kind of question and use it inside a topic : inside of topic you could replace the copilot studio native engine with a Azure AI foundry Agent you train to answer like you need
Hope this help :)
Was this reply helpful?YesNo
Under review
Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.