Agent - Conversational Boosting as it relates to RAG and LLM Source

(0) Share

Report

Posted on by Nicer_Atl

174

Hi group.

Can anyone shed light on the role the "Conversational Boosting" system topic plays in "Search Sources"? In restricting sources to RAG documents in 1.) the Knowledge settings tab, 2.) in a Create Generative Answers node in a custom trigger and 3.) in the Conversational Booting system trigger, my agent insists on generating responses using "general knowledge from the LLM".

In other words, I have turned off general references and using Web Search everywhere I know to, yet when testing the Agent, it keeps saying the main reference it used was "This response was generated by using general knowledge from the LLM." This results in no valid answers, even though the answers are in the "Other (RAG) Sources listed in the same window".

Categories:

Copilot Studio skills development

I have the same question (0)

All responses (2)

Answers (0)

Sort by

SM01 8 on at

Like
a
(0)

Report
Copy link

Link copied!

Generally conversational boosting is a system topic that helps in giving responses from public websites/external data sources if the query doesn't match with existing knowledge sources using generative answers node. For RAG operation the agent would fallback to this topic if there is no matching knowledge source or custom topic for the query.

You can try following this below steps if not done yet -

1. Turn off the web search in overview

2. Turn off LLM general knowledge from settings

3. Check in conversational boosting topic - generative answers node : whether general knowledge is turned off or not. If its on, disable it and try re-running the prompt.

Also would suggest to configure the knowledge sources in the conversational boosting generative node as well and try.

Was this reply helpful? Yes No
Suggested answer

Nicer_Atl 174 on at

Like
a
(0)

Report
Copy link

Link copied!

Thanks for the reply. Self-solved the issue.

Root cause:

The RAG source was being stored in SharePoint and was not one of the file types supported by Semantic Chunking of SharePoint sources. (SharePoint indexing is done via Graph Search). Example; indexing of .MarkDown document not supported. .docx is.

Was this reply helpful? Yes No