Answered

Azure AI Search knowledge source does not work

(3) Share

Report

Posted on by p1zang

Hello,

We are using Azure AI Search for our inhouse developed chatbot and it works really well. Now I try to connect the same indexes to Agent in Copilot Studio. I made necesarry changes to indexes so they are properly displayed in Copilot:

When I try to ask a question I get following error:

Error Message: The output returned from the connector was too large to be handled by the agent. Try reducing its size by utilizing available connector filters or by limiting the number of configured action outputs. Error Code: AsyncResponsePayloadTooLarge Conversation Id: bb6b70b6-5d6f-4db9-abe9-8a77e06292c8 Time (UTC): 2025-06-01T17:29:48.606Z

Can I somehow limit the number of documents returned? Or maybe the reason is diffrent?

Categories:

General topics

I have the same question (0)

All responses (5)

Answers (1)

Verified answer

Romain The Low-Code... 2,122 Super User 2025 Season 2 on at

Like (0)

Report

hello :) i had run into several problem with AI Search, i managed to resolve them,

First : check if you are at minimum in S1 plan, Copilot studio recently force the usage of semantic (you could confirme by reading log) so need a plan with semantic :)

Second : it use 2024 - 07 - 01 as model for embedding, ensure you used this one when you test in the index playground

Last : Copilot studio don't care about vector since the work is done at Azure side : try to remove them from the index answer (uncheck the option in Azure index and then re-init + re-index )

Last : i have more information / detail in this previous post but it's globally the same as here with more detail. Before clicking, if this answer resolved you problem or helped you :

Please check the good answer button, it's important :)

https://community.powerplatform.com/forums/thread/details/?threadid=750841fa-383a-f011-b4cc-7c1e520dbb77

Was this reply helpful? Yes No
p1zang 24 on at

Like (1)

Report

Today I started to check the logs according to very informative answer from Romain and... everything worked! No changes from my side - I just run a question in an agent and Azure AI Search correctly provided the context and Agent was able to give a proper answer. Magic.

Was this reply helpful? Yes No
Romain The Low-Code... 2,122 Super User 2025 Season 2 on at

Like (0)

Report

oOo @p1zang thank you so much for your feedback :) it's so rare, you make my evening great ^^

Now, since you are a Azure Ai Search hero :

let's try to integrate an azure AI foundry model directly into you'r agent to feel greater magic :D (just be carefull, it cost money so desactivated everything very quickly - same problem it need Standard plan to have it work ) :

if you wana see some dark magic with azure ai search and ai foundry in copilot studio, and not afraid of reading subtittle , feel free to go on my youtube channel (link in my profil) : i have a video of my intervention at the Azure global 2025 conference about Azure AI and copilot studio and i show some tricks and AI foundry integration :) (voice in french sorry ^^)

Was this reply helpful? Yes No
p1zang 24 on at

Like (1)

Report

I was learning French for 4 years and I am very greatfull for English subtitles :D.

The cost is indeed an issue. I am working in a pretty big organization and we already pay ten of thousands of EUR per month for Azure resources + additional fees for O365. What bothers me is a cost of simple answer for agent that is using premium connector and generative answer - I remember I calculated it to 0.3 EUR which is pretty high. I know we can buy Copilot license but for 1000 employees generates to much cost.

Anyway, I have seen your Youtube and particullary: (99) Copilot Studio: The new option that makes Excel & SharePoint as reliable as Azure AI Search - YouTube. That is a game changer! This is exactly what I was trying to resolve in Azure AI Search. My idea was to create Power App to copy the date to storage account and then create an indexer and use AI Search in an agent. I tested it yesterday and it worked! And today i learned it does not make any sense as MS already implemented it with Dataverse :D.

Thanks for shareing that one! I am testing it now.

The only thing that is still out of reach is OneDrive knowledge? Isn't it?

Was this reply helpful? Yes No
Romain The Low-Code... 2,122 Super User 2025 Season 2 on at

Like (0)

Report

@p1zang the new option work with one drive too ;) did you try it ? (i admit i only try sharepoint with it)

Was this reply helpful? Yes No