Copilot Studio

Import Export Test Set Issue: Testing method not imported

(1) Share

Report

Posted on by AG-16030512-0

After exporting test set, and reimporting them again, the testing method of all test cases are not imported.

Steps to reproduce :

1. Create a test set

2. Add test question and add some test methods to it, like capability use, keyword match

3. Add tools to capability use, and keywords to keyword match

4. Export the Test set

5. Reimport it.

Expected Behaviour:

The test set with all test questions and there test methods are imported.

Current Behaviour:
The test methods are not imported, the test set and test questions are.

I have added the screenshot of the excel file downloaded as well.

Is this a known issue and is there a workaround so that i can edit the excel file so that test methods and there answers are also imported ?

Categories:

Calling actions from Copilot Studio

I have the same question (0)

All responses (4)

Answers (0)

Sort by

Suggested answer

David_MA 14,546 Super User 2026 Season 1 on at

Like (0)

Report
Copy link

Link copied!

I don't have a ton of experience with Copilot Studio yet, but I believe this is the expected behavior. You choose the test method after you import the question/response pairs. Once imported, open the evaluation plan and on the right side are the options to configure the test method(s) (like in your screen shot).

I base this on the information in the sample template:

I've always taken the highlighted text to mean that when you import an evaluation plan, it will set the test method to the default, and you can change it once imported.

Was this reply helpful? Yes No
AG-16030512-0 19 on at

Like (0)

Report
Copy link

Link copied!

@David_MA The official document does write that it supports it, https://learn.microsoft.com/en-us/microsoft-copilot-studio/analytics-agent-evaluation-create Testing Method, but i could not add the same.

The reason for trying to do this is because I need to be able to test the tool use with capability method in copilot agents, However it caches the data, after the first call and to fix i need to delete and update the test sets by https://community.powerplatform.com/forums/thread/details/?threadid=23710c0e-ff20-f111-8341-000d3a54c86a,

To make it easier I thought of simply deleting and adding the csv.

Any help regarding the above is needed.

Was this reply helpful? Yes No
David_MA 14,546 Super User 2026 Season 1 on at

Like (0)

Report
Copy link

Link copied!

I guess we'll need to see if someone else has more insight. The link to the page you referenced notes: [This article is prerelease documentation and is subject to change.]. Maybe this is a feature that has not been released yet. I exported an evaluation set that I have and is configured to multiple methods, and it did not export the csv file with any test method values. And if it is possible to define a different test method for each question, I have not found a way to do that.

Was this reply helpful? Yes No
AG-16030512-0 19 on at

Like (0)

Report
Copy link

Link copied!

Thanks for the help @David_MA , hopefully some one will have more insight.

Was this reply helpful? Yes No