You’re offline. This is a read only version of the page.
4
Hello Everyone,
I am developing a bot hooked up to our website using GenAI.
I have noticed that the language recognition has been extremely poor. One example of this is if you ask "How do I register my dog?" this is on the website but it will not provide an answer. If you say "I want to register my dog" it provides the answer on how to register your dog.
Does anyone know if there anything I can do to fix this as I have tried te moderation and a system prompt.
Thank you
Hi @CoastalFox
Our team looked into it, and after some investigation into our relevance filtering stage, we discovered that this case was actually not caused by relevance filtering, but rather blocked by content moderation due to the Australian favored term for spay/neuter (desexing) being misinterpreted as inappropriate under the Azure OpenAI content moderation policy (which we don’t own).
The ‘poor quality language recognition’ with different phrasings of the question was actually the question biasing the model in how it answered. So the direct question “how do I register my dog?” elicited a more verbatim answer that used the Australian terminology and was therefore blocked, while the less direct request got a more paraphrased answer and wasn’t blocked.
Since lowering the moderation level didn’t alleviate the issue, that means the term is considered high severity. So other mitigations could be to avoid having that term used in answers by modifying the language used on your website, or customizing your bot with custom instructions that the terms spay/neuter or sterilization are preferred in answers about pets.
Henry
Apologies for the delay, I set it at bot level.
Hello
I tried adding the https://www.devonport.tas.gov.au/ website in my bot and I got the right answer in both scenarios. Not sure what is not working on your end. How did you define the genAI source? at the bot level or in a topic?
Hi Remidyon,
I have tried lowering the moderation levels and I am still having that issue.
Thank you
#1
Pablo Roldan
33
#2
Romain The Low-Code...
25
#3
stampcoin
10
Share
Report
All responses (
Answers (
