Copilot Studio - Asking questions and not executing commands automatically

(0) Share

Report

Posted on by RJ-18041328-0

Hi,

I made things very simple, even though Copilot Studio is not autonomous. Below the configuration of the AGENT and the TEST

AGENT

INPUT FIELDS FOR THE TOOL "Create Item" (WELCOME and RESPONSIBLE)

QUESTIONS

- Why the Agent asks me for the Welcome and Responsible? It's indicated in the instructions and also in the input field.

- Why do I need to click "Allow" for the connection?

Also before adding the tool, the agent was able to read the Welcome.docx knowledge file.

Thanks

Categories:

Autonomous Agents - Challenge

I have the same question (1)

All responses (10)

Answers (1)

Michael E. Gernaey 52,851 Super User 2025 Season 2 on at

Like (0)

Report

Copilot Studio - Asking questions and not executing commands automatically

HI @RJ-18041328-0

So I would have to see your sharepoint lists and your document and if you are using a topic or just an agent flow or a tool (just a single action?) but let me start off by saying you have not added SharePoint as a knowledge source, and you will also be asked to connection (more details below)

Also, you have to allow the connection due to what its doing. Its based on the agent flow / instructions and Connection itself, since its probably NOT set to run as the Creator of the Agent or the Flow, it us using Run As User and you have to approve it first, otherwise someone could create an agent that some CEO just uses and when they connect the agent goes off an steals all the money because the CEO is just letting it do whatever as they have NO idea what the agent is really doing on their behalf..

It's a security thing.

To validate your Knowledge Sources, which btw you ONLY added 1, you did not Add the SharePoint lists as Knowledge sources, I would create a simple topic that you ask it a question that it uses your word document as the knowledge source for and validate that it finds the data.. If it doesnt then it won't work with instructions.

Martin is that you :-)

Was this reply helpful? Yes No
RJ-18041328-0 50 on at

Like (0)

Report

Copilot Studio - Asking questions and not executing commands automatically

Hi Michael, I am sending attached on that post the video that I made with the explanations, please let me know if it's not clear. Thanks for the help

PowerUpVideo.mp4

Was this reply helpful? Yes No
Verified answer

timl 36,319 Super User 2025 Season 2 on at

Like (2)

Report

Copilot Studio - Asking questions and not executing commands automatically

Hi @RJ-18041328-0

I tested this and it works ok for me. What I suggest is that you modify the description for the Welcome field in your "Create Item (WELCOME and RESPONSIBLE)" tool to be more precise and to use the exact phrase "knowledge source document'. Here's what I used

The second thing to do is to reiterate this in the instructions.

Third, it's important to correctly reference the tool in the instructions. In my screenshot above, note how 'Create Welcome Message' is highlighted in the instructions. To do this, edit your instructions and type the / character to insert your "Create Item (WELCOME and RESPONSIBLE)". It should then be highlighted like my example above.

In my WelcomeMessage document, I added placeholder fields like so.

When I triggered this, it retrieved the message correctly from the Word document.

It also correctly generated the welcome text in the SharePoint list.

Therefore, could you try modifying your instructions and tool description to more closely match what I used to see if that solves the problem?

Was this reply helpful? Yes No
RJ-18041328-0 50 on at

Like (1)

Report

Copilot Studio - Asking questions and not executing commands automatically

Hi @timl , thanks a lot for your reply.

I did every single modification you asked me to do, just modified the lists names to match with my environement.

The Welcome Input of the tool "Create Welcome Message"

but mysteriously it keeps me asking about the message.

1 - Is it mandatory in an autonomous agent to create a flow? (In that exemple I don't use a flow)

2 - Do you think it can be related to the environement?

OBSERVATION!!!!

When I ask the chat directly, without passing by the trigger:

1 - It retrieves the Welcome Message using the Welcome.docx knowledge document

2 - It doesn't retrieve the Responsible for area RH

3 - When I tell it to search in the 'New Employee Responsible', it identifies the list (green highlight) but it doesn't refer to it as we can see in the last question it only refers to the Welcome.docx (red highlight) in every single question.

Why?

Thanks

Was this reply helpful? Yes No
timl 36,319 Super User 2025 Season 2 on at

Like (2)

Report

Copilot Studio - Asking questions and not executing commands automatically

Hi @RJ-18041328-0

Many thanks for your detailed reply. In response to these issues:

>>1 - Is it mandatory in an autonomous agent to create a flow? (In that exemple I don't use a flow)

Yes, it's necessary for there to be a flow. This would normally be created automatically when you create the trigger. If there's something wrong with that flow, that would be an explanation for the issue you're seeing. In the screenshot I posted, you'll notice the first action that runs when executed by the trigger is the 'Search Sources' action. This is missing in the video you posted, so it may well be something wrong in the flow that's the cause of this.

The flow should look like this and contain these 2 steps only.

>>2 - Do you think it can be related to the environement?

I don't think this related to the environment. I created my example above in my developer environment in the PowerUp tenant which should match the setup you have.

With regards to your observation about the agent not correctly retrieving the manager, it might be related to it struggling to lookup the record based on an SharePoint Choice field. I'll see if I can reproduce this.

-------------------------------
At this point, it might be worth creating a new agent from scratch to see if it works better.

I would suggest just starting off with the SharePoint and single Welcome.docx knowledge source, and seeing if the agent references Welcome.docx when triggered autonomously. If that works, I would then add in the additional knowledge source and retest. If that then works, I would then add the tool/flow to create the record in SharePoint.

Hopefully doing it step by step like this might work better.

Was this reply helpful? Yes No
RJ-18041328-0 50 on at

Like (1)

Report

Copilot Studio - Asking questions and not executing commands automatically

Hi Tim,

yes that's what I guessed, no mandatory Flow but that was the answer I got from the facilitator in Copilot Q&A. So, not just Copilot Studio is very instable with different answers from the exact same tests, I am also getting bad support.

I had already started like 10 new Agents from scratch, I got tired, so I just wanna finish that challenge. If it's not the environment problem then I hope not to work with Copilot anymore until it gets stable and as it is today certainly not recommend to any of my clients. I am done, I will try to figure out just to finish the challenge.

Thanks for your time, I really appreciate your help.

I will check your answers to close the thread, thanks a lot

Was this reply helpful? Yes No
timl 36,319 Super User 2025 Season 2 on at

Like (0)

Report

Copilot Studio - Asking questions and not executing commands automatically

Sorry to hear about all these issues you've experience. I get how frustrating it is.

If there's anything we can do to help you try to complete the challenge, feel free to post again.

Was this reply helpful? Yes No
RJ-18041328-0 50 on at

Like (0)

Report

Copilot Studio - Asking questions and not executing commands automatically

Tim, every test with same trigger values can bring me new different output values.

Exemple, in "test 1" it can get the data fine (or not), but in "test 2" with same test values it can create a Welcome Message from it's 'head' and add it to the email field, in "test 3" email it can come blank.... I repeat, all that without modifying the Agent, just repeating the test with the exact same record and trigger. It's insane! I am definitely out of Copilot Studio, just want to upload a working solution and never more for a long time I hope.

I asked about the possibility of being the environement because I was enrolled in a different cohort, they gently created that new environement for me (and I appreciate that) so I have 2 environements and maybe something was missing on that new environement or whatever but it's incredible instable and irritating. I tried both environements, same weird results

It's being 1 month stuck with Copilot "alucinations" since before my first post https://community.powerplatform.com/forums/thread/details/?threadid=00edf204-e1bb-f011-bbd3-000d3a192937. I don't know if you can do anything to help, you already did great effort, I don't know what else could be done.

I will redo a new Agent from the thousandth time, try to be as simple and clear as possible (as I have already being doing so far)

Was this reply helpful? Yes No
RJ-18041328-0 50 on at

Like (0)

Report

Copilot Studio - Asking questions and not executing commands automatically

Hey Tim, just to give you un update, I could finish the challenge even if the feeling about autonomous agent is still shaken. Beside that, the conversational challenge I did in 30 minutes, so on that side I am happy with Copilot performance.

So as a resume for my autonomous agent :

1 - (Fail)

I tried creating a new record in a Sharepoint list with new employee, responsible and welcome message.

Knowledge sources : Sharepoint list NewResponsibleEmployee and word document WelcomeMessage.docx

2 - (Fail)

I tried sending a teams message using a tool flow witht the welcome message inside the flow

Knowledge sources : Sharepoint list NewResponsibleEmployee

3 - (Success)

I used a Teams connector as a tool to post a message to teams channel

Knowledge sources : Sharepoint list NewResponsibleEmployee

Despite being sure that it should have worked in both scenarios, as a conclusion for me things worked better using directly the teams connector as a tool.

I am sending the video attached.

Thanks a lot for your time and help my friend, really appreciate.

Have a good day,

Renato

PowerUpChallenge_...

Was this reply helpful? Yes No
timl 36,319 Super User 2025 Season 2 on at

Like (0)

Report

Copilot Studio - Asking questions and not executing commands automatically

Hi Renato,

Thanks very much for the update.

I'm glad you completed the challenge, despite all the difficulties. It's very useful to know that using Teams connector worked better for you.

This is very valuable feedback, so I'll make sure to pass this back to the organisers of the program.

Have a good day too,

Tim

Was this reply helpful? Yes No