web
You’re offline. This is a read only version of the page.
close
Skip to main content

Announcements

News and Announcements icon
Community site session details

Community site session details

Session Id :
Power Platform Community / Forums / Copilot Studio / Poor Quality Language ...
Copilot Studio
Unanswered

Poor Quality Language Recognition

(0) ShareShare
ReportReport
Posted on by 4

Hello Everyone,

 

I am developing a bot hooked up to our website using GenAI.

 

I have noticed that the language recognition has been extremely poor. One example of this is if you ask "How do I register my dog?" this is on the website but it will not provide an answer. If you say "I want to register my dog" it provides the answer on how to register your dog. 

 

Does anyone know if there anything I can do to fix this as I have tried te moderation and a system prompt.

 

Thank you 

Screenshot 2023-11-17 093741.png

Categories:
I have the same question (0)
  • HenryJammes Profile Picture
    Microsoft Employee on at

    Hi @CoastalFox -

     

    Thank you for reporting this issue.
    We're tracking this.

     

    Henry

  • remidyon Profile Picture
    Microsoft Employee on at

    Have you tried lowering the moderation level to medium or low in the generative AI configuration?

  • CoastalFox Profile Picture
    4 on at

    Hi Remidyon,

    I have tried lowering the moderation levels and I am still having that issue.

     

    Thank you 

  • remidyon Profile Picture
    Microsoft Employee on at

    Hello

    I tried adding the https://www.devonport.tas.gov.au/ website in my bot and I got the right answer in both scenarios. Not sure what is not working on your end. How did you define the genAI source? at the bot level or in a topic?

     

    remidyon_0-1700665360043.png 

     

    remidyon_1-1700665474155.png

     

     

  • CoastalFox Profile Picture
    4 on at

    Apologies for the delay, I set it at bot level.

  • HenryJammes Profile Picture
    Microsoft Employee on at

    Hi @CoastalFox 

     

    Our team looked into it, and after some investigation into our relevance filtering stage, we discovered that this case was actually not caused by relevance filtering, but rather blocked by content moderation due to the Australian favored term for spay/neuter (desexing) being misinterpreted as inappropriate under the Azure OpenAI content moderation policy (which we don’t own).

    The ‘poor quality language recognition’ with different phrasings of the question was actually the question biasing the model in how it answered. So the direct question “how do I register my dog?” elicited a more verbatim answer that used the Australian terminology and was therefore blocked, while the less direct request got a more paraphrased answer and wasn’t blocked.

     

    Since lowering the moderation level didn’t alleviate the issue, that means the term is considered high severity. So other mitigations could be to avoid having that term used in answers by modifying the language used on your website, or customizing your bot with custom instructions that the terms spay/neuter or sterilization are preferred in answers about pets.

     

    Henry

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Introducing the 2026 Season 1 community Super Users

Congratulations to our 2026 Super Users!

Kudos to our 2025 Community Spotlight Honorees

Congratulations to our 2025 community superstars!

Congratulations to the April Top 10 Community Leaders!

These are the community rock stars!

Leaderboard > Copilot Studio

#1
Valantis Profile Picture

Valantis 639

#2
Vish WR Profile Picture

Vish WR 293

#3
Haque Profile Picture

Haque 216

Last 30 days Overall leaderboard