web
You’re offline. This is a read only version of the page.
close
Skip to main content
Community site session details

Community site session details

Session Id : WB14GV9MoeZvMP5C5abrvB
Copilot Studio - General
Unanswered

Copilot Studio Kit - Agent Configuration Settings

Like (2) ShareShare
ReportReport
Posted on 5 Jun 2025 00:00:49 by
Hey Community,
 
I am trying to register my agent in Copilot Kit for Evaluation & Observability. When I try to create a Generative Agent created in Copilot Studio, I have to add a bunch of details like Dataverse URL, AgentID etc. As I am not an IT Infra guy, I am finding it hard to understand what settings to apply for Direct Line. The agent is configured currently to authenticate using "Authenticate with Microsoft" option. 
 
 
I was able to fetch dataverse URL as well as Agent iD but I don't know what options to select for direct line and user authentication too. 
 
 
Thanks in advance for helping
 
Categories:
  • psimolin Profile Picture
    Microsoft Employee on 05 Jun 2025 at 16:29:57
    Copilot Studio Kit - Agent Configuration Settings
    Hello,
     
    At this time, Copilot Studio Kit does not support "Authenticate with Microsoft"-option. We are investigating how to add support for this. No authentication and Manual authentication with Entra ID v2 with SSO work.
     
    I recommend creating a new (temporary) "hello world" type of agent with no authentication and configure that in the Copilot Studio Kit agent configuration. Create a test set, one simple "helllo world" Response Match test case and start a test run just to make sure that everything works as expected. i.e. the Kit is able to reach your agent and is able to get responses back.
     
    Minimum setup only needs the Base configuration and Direct Line settings. Everything else can be left disabled. If you enable "Channel security" from "Direct Line Settings", you can copy paste the secret from your Copilot Studio Agent "Settings" -> "Security" -> "Web channel security" and pick either secret 1 or secret 2.
     
    Here are more details on the settings:
     
    User Authentication section -> if your agent requires authentication (only manual authentication entra id v2 + sso supported for now)
    Results Enrichment -> this is required for generative answers
    Conversation Transcript Enrichment -> this is required for topic match
    Generative AI testing -> this is required for generative answers
     
    Best regards,
    Petri Simolin
    PM of Copilot Studio Kit
     
  • Suggested answer
    stampcoin Profile Picture
    3,644 Super User 2025 Season 2 on 05 Jun 2025 at 13:36:43
    Copilot Studio Kit - Agent Configuration Settings
    Those Articles will give you more details regarding this.
     
     
     

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Announcing our 2025 Season 2 Super Users!

A new season of Super Users has arrived, and we are so grateful for…

Paul Stork – Community Spotlight

We are honored to recognize Paul Stork as our July 2025 Community…

Congratulations to the June Top 10 Community Leaders!

These are the community rock stars!

Leaderboard > Copilot Studio

#1
Michael E. Gernaey Profile Picture

Michael E. Gernaey 169 Super User 2025 Season 2

#2
Romain The Low-Code Bearded Bear Profile Picture

Romain The Low-Code... 150

#3
sandeep_angara Profile Picture

sandeep_angara 75 Super User 2025 Season 2