I've got a copilot using generative AI on an internal SharePoint site. I've configured manual authentication and SSO per the online guides and all seems to be working ok having published the Copilot to Teams - we can ask the copilot questions and it is sometimes answering with content from the SharePoint site.
What we are finding though is that sometimes the copilot responds with a "I'm sorry, I'm not sure how to help with that. Can you try rephrasing?" when there is definitely an answer on the SharePoint. Sometimes asking the exact same question a second time will result in the copilot providing the correct answer from the SharePoint but, not always. Sometimes issuing a "restart" and then asking the exact same question again also seems to result with the correct answer from the SharePoint.
I've enabled Application Insights and it is logging away but, the only thing I notice is that when I ask a question and get a "I'm sorry, I'm not sure how to help with that. Can you try rephrasing?" response, Application Insights seems to just show the copilot using the fallback topic with no real information as to why. Are there any other logs that I can check which might highlight any reasons for the inconsistencies or is this expected behaviour when using generative AI?