Can I retrieve the thumbs up/down and comment added by user via Application Insights?

(2) Share

Report

Posted on by dhruvp29

I am working on exploration to determine where the Thumbs up/down and comments are stored for custom agents built via Copilot Studio.

I got the results in Dataverse table named ConversationTranscript .

However, I was trying to get the same in Application Insight as it becomes easy to build report on that data directly but I am not able to find the results.

Can anyone please confirm if humbs up/down and comment added by user are recorded in Application Insights?

P.S. I want to capture the OOTB feedback mechanism, no custom feedback is implemented. Just thumbs up/down and comments we add.

Categories:

Bot analytics

I have the same question (0)

All responses (3)

Answers (0)

Sort by

Suggested answer

Vish WR 2,244 on at

Like (1)

Report
Copy link

Link copied!

@dhruvp29

No, the Out-of-the-Box (OOTB) thumbs up/down feedback and comments are not recorded in Application Insights by default.

pplication Insights for Copilot Studio primarily captures Trace and Request events related to node execution and message flow. Since the OOTB "Thumbs" UI is a system-level component that sends data directly to the back-end feedback service (and subsequently Dataverse), it bypasses the telemetry pipeline that feeds your App Insights resource.

Replace the OOTB thumbs with an Adaptive Card. Use the Log custom event action to send the rating and comment directly to Application Insights as customDimensions

Was this reply helpful? Yes No
Suggested answer

11manish 1,922 on at

Like (2)

Report
Copy link

Link copied!
No — the out-of-the-box thumbs up/down and comments from Copilot Studio are not sent to Application Insights.

For agents built with Microsoft Copilot Studio:

Feedback (+ comments) is stored in Microsoft Dataverse

specifically in tables like ConversationTranscript

The same feedback is not emitted to Application Insights by default

Was this reply helpful? Yes No
Suggested answer

Valantis 4,803 on at

Like (1)

Report
Copy link

Link copied!

Hi @dhruvp29,

Microsoft docs confirm: feedback data (thumbs up/down and comments) is stored in the ConversationTranscript table in Dataverse. That's the primary store.

For Application Insights specifically, the OOTB thumbs up/down reactions are not sent as a dedicated telemetry event. However if you have Application Insights connected to your agent, the GenerativeAnswers custom event does include a feedback field in its SerializedData custom dimension. You can extract it with this Kusto query:

customEvents
| where name == "GenerativeAnswers"
| extend cd = todynamic(customDimensions)
| extend conversationId = tostring(cd.conversationId)
| extend message = tostring(cd.Message)
| extend result = tostring(cd.Result)
| extend SerializedData = tostring(cd.SerializedData)
| extend feedback = tostring(todynamic(replace_string(SerializedData,"$","")).value)
| project timestamp, conversationId, message, result, feedback
| order by timestamp desc

This is confirmed from Microsoft's own Dynamics 365 guidance docs with an example query.

The limitation: this only captures feedback linked to GenerativeAnswers events. If the thumbs up/down was on a non-generative response (scripted topic answer), it may not appear there. For complete feedback coverage across all response types, Dataverse ConversationTranscript remains the authoritative source.

Ref: https://learn.microsoft.com/en-us/dynamics365/guidance/resources/copilot-studio-appinsights

Best regards,

Valantis

✅ If this helped solve your issue, please Accept as Solution so others can find it quickly.

❤️ If it didn’t fully solve it but was still useful, please click “Yes” on “Was this reply helpful?” or leave a Like :).

🏷️ For follow-ups @Valantis.

📝 https://valantisond365.com/

💼 LinkedIn

▶️ YouTube

Was this reply helpful? Yes No