Applies to Product - Microsoft Copilot Studio
What’s happening?
The customer is experiencing issues with AI hallucinations after disabling the option to allow the AI to use its general knowledge. Despite setting the AI to only use a specified knowledge source, the AI seems to be mixing its learned knowledge with the specified information when answering questions.
Reason:
The AI's learning algorithm may not effectively compartmentalize knowledge sources, leading to unintended integration of general knowledge in responses. The setting to disable the AI's use of general knowledge may not be functioning as intended, allowing the AI to access and use its general knowledge base despite the restriction.
Resolution:
- Confirm that the setting "Allow AI to use general knowledge" is turned off.
- Ensure that the AI is configured to rely solely on the specified knowledge source, such as a SharePoint site.
- Review the AI's learning and feedback logs to identify potential sources of the hallucinations.
- Check if there have been any recent changes to the knowledge source that might have affected the AI's responses.
- Monitor for specific topics or types of questions that seem to trigger these hallucinated responses more frequently.
- If issues persist, consider consulting additional documentation or support resources related to AI configuration and troubleshooting.