Unexpected Behavior of Copilot published on MS Teams and Web

(1) Share

Report

Posted on by SO-08101019-0

Copilot has unexpected behavior when published on Teams and Web. It completely ignores few set of actions configured inside the topic and directly brings the response. I have attached the screenshots for reference.

Topic that we have configured:

The Response that we get from Teams completely ignores the message that we have configured inside the topic. And this happens randomly. Most of the times we get the expected response. But How do I make sure this issue doesn't happen again.

Categories:

General topics

I have the same question (0)

All responses (4)

Answers (0)

Suggested answer

Vinoth Selvam 1,590 Super User 2025 Season 2 on at

Like (1)

Report
Hi SO-08101019-0,

I can understand that you have enabled the Generative AI mode, where Copilot uses its intelligence to choose the relevant Topics or Action based on the input prompt from the user.

Here are some suggestions which i can tell you,

Please make sure that every Action and Topic that you configure are distinct. Meaning that try to provide proper description so that LLM is able to pick up the correct topic or action based on the question. Sometimes if multiple topic matches, then response will not be as expected.

If you're using third-party services integrations (datadog) could sometimes get delays or failures that cause Copilot to skip steps. You can monitor external service health and response times.

Consider configuring error handling in Power Automate or Copilot Studio. For example, you can set up retries or fallback actions, if a step like fetching from Datadog fails.

Hope it is helpful.

Thanks.

Was this reply helpful? Yes No
SO-08101019-0 12 on at

Like (0)

Report

Hello Vinoth,

Thank for your reply, however I have only configured one topic for this usecase. What happens is it randomly changes the output, Let me give you an example.

This is the Expected Output when it runs without any issues:

But sometimes it completely misses the first 3 messages and adds this error into the end.

Even though it calls the same topic and works perfectly fine on Copilot Studio Test Environment.

Was this reply helpful? Yes No
Suggested answer

SummitKumar 69 on at

Like (1)

Report

Hi, I suggest if you can do additional monitoring with Copilot studio kit and try testing it , you can get inner exception detail from kit to understand this behaviour - See -Power-CAT-Copilot-Studio-Kit/ANALYZE_TEST_RESULTS.md at main · microsoft/Power-CAT-Copilot-Studio-Kit (github.com)

See this blog - how to test - Test your custom copilot with Power CAT Copilot Studio Kit - Forward Forever

Log files are your best to understand whats happening for failed scenarios.

See sample test result -

Was this reply helpful? Yes No
Vinoth Selvam 1,590 Super User 2025 Season 2 on at

Like (1)

Report

Dear SO-08101019-0,

You can try the monitoring suggested by SummitKumar.

This could be the only way to find out if there are any issues.

Thanks.

Was this reply helpful? Yes No