web
You’re offline. This is a read only version of the page.
close
Skip to main content

Announcements

News and Announcements icon
Community site session details

Community site session details

Session Id :
Power Platform Community / Forums / Copilot Studio / Copilot Studio Generat...
Copilot Studio
Suggested Answer

Copilot Studio Generative issues

(2) ShareShare
ReportReport
Posted on by 14
I'm experiencing a frustrating issue with Copilot Studio where my custom agent completely ignores its instructions despite having Generative AI and orchestration enabled (GPT-4o model).
 
The agent partially recognizes its name from the instructions but provides only generic Power Platform information instead of following any behavioral guidelines.
 
For example, when asked "How can you help me with HR processes?", instead of responding according to instructions about analysing workflows and suggesting automations, it gives generic descriptions of Power Automate and Power Apps.
 
I've tried everything: simplifying instructions from detailed to single sentences, modifying the Fallback topic to remove blocking conditions, creating override topics with generative answer nodes, clearing cache, testing in incognito mode, and even removing all special formatting.
 
The agent IS generating AI responses (so generative AI works), but it seems to use some default template rather than my custom instructions. Has anyone experienced this issue where instructions are completely ignored even though the agent is clearly using generative AI? Using Copilot Studio web version with full orchestration enabled.
 
 
Any issues out there?
Categories:
I have the same question (2)
  • Suggested answer
    Michael E. Gernaey Profile Picture
    53,963 Moderator on at
     
    If you can please provide some more specific details
     
    1. Are you using Generative Question Asking Nodes? 
    2. Or are you simply saying you have GenAI etc on?
     
    I am asking as if its the Nodes, then can you show pictures of how you have it configured from a Knowledge base perspective as well as the instructions?

    If not, can you share the instructions as well as what Knowledge Sources you have?
     
    Lastly, based on the sample Question, I would not expect Generative AI to be good, because I would have instructions to tell it to look at HR knowledge sources versus generalized list of knowledge sources it can look through while also being open to general answers as its going to make it give... weird answers instead of specific to your own content.
     
    Anything you can share as it relates to your overall instructions, knowledge sources, types of Questions you expect to ask etc etc.
     
    Now, you can leave on GenAI, heck you could even have public sites (dont lol but you could), but you would need to, as I mentioned, tell it to only grab HR answers from HR Data sources., 
     

    If these suggestions help resolve your issue, Please consider Marking the answer as such and also maybe a like.

    Thank you!
    Sincerely, Michael Gernaey
  • CF-13080859-0 Profile Picture
    14 on at
    Thanks Michael I will go off and get more info.
     
    I build them without topics and Nodes usually relying on the Instructions, and all has been fine. I have been triggering tools, even calculating things just using the instruction, but just very recently, although I follow my standard method, create agent, give it name description and Instruction, turn on or check GenAI, Turn off use general knowledge and turn off web knowledge. That always set me off well.
     
    Now I do that, ask a question, and I see it initially write a response, as the instruction would instruct, but then basically it crashes out of that, and goes to a topic? I kill the topics and it just gives I don't know how to answer that.
     
    It feels like an error, I dumbed my instruction write down to "If asked about what you can do respond with the following.........." I ask the question "What can you do" and it states it can not answer that?
     
    Thanks again
  • CF-13080859-0 Profile Picture
    14 on at
    I dont want to use topics Just the instruction.
     
    I have created a NEW agent Generative AI is on. I have turned everything else off and created the following instruction to test:
     

    I am Morgan, a Business Analyst specialising in Microsoft Power Platform automation for UK organisations.

     

    Diagnostic test: If someone types exactly "morgan banana test", I respond with exactly: "Diagnostic confirmed - Morgan instruction processing active. I am your Business Analyst ready to help with process automation."

     

    Normal behaviour: For other messages, I introduce myself as Morgan, mention that I help automate business processes using Power Platform, and ask which specific process they want to improve. I use UK spelling and terminology.

     

    I have then tested by inputting:

     

    morgan banana test

     

    Normally that would return Diagnostic confirmed - Morgan instruction processing active. I am your Business Analyst ready to help with process automation.

     

    but instead I get:

     

     

     

     

  • Suggested answer
    Romain The Low-Code Bearded Bear Profile Picture
    2,876 Super User 2026 Season 1 on at
    if i see correctly : 

    - no knowledge
    - no general knowledge
    - no web knowledge
     
    how do you intend the agent to have any information to help you ? (i think something is missing on the screenshot) : the bot know nothing except really basic language and comportment.
     
    then : instruction are nont intented to be use to choose "what to answer" : topic are here of this purpose. Instruction are 
    - global comportment
    - Autonomous agent Step answer
     
    they are not here to replace a topic but if you really want to go this way use the " / " to target action/topic relatated to your instruction to have more accuracy.
  • CF-13080859-0 Profile Picture
    14 on at
    Thankyou, I think i mislead. I know how agents work it has had knowledge, and that how I intend it to work, but I have removed in order to hone in on the issue as instructed.
     
    I have had agents work where it behaves as instructed, but it has stopped.
     
    Dont worry if you cant help.
  • NR-14082142-0 Profile Picture
    2 on at
     
    I'm working on fixing a separate issue but came across this thread. Thought I may be able to shed some light.
     
    I see you added knowledge, then removed it, as it was not responding as wished per instructions (on the home page / general area I assume you mean and not via topics and nodes). 
     
    The LLM is Copilot, which is a pretrain model - you have three settings and you can use the AI generative aspect but without knowledge you would need to also have on the web access toggle. Under setting (top right, within the 3 dots, there is also another setting re generative AI switch this on. However, the Agent is not designed to be trained or have memory. It purely reply's from web searching and scrapping. Replies would note at the bottom that they may not be correct...when that AI generative toggle is off it goes and if run solely from knowledge sources. 
     
    The agent works, once you have 1+ 365 licences under your tenant, by one giving an increased MB per file to 500mb not 20mb, for knowledge uploads i.e. PDFs etc, and it then allows indexing but again this is with added knowledge. Vastly helps scope of what you can feed into the Agent.
     
    Once knowledge is added, you can use the new orchestration (essentially aiding RAG) to better allow the agent to understand and choose which resource to use - they become tokenized at this stage. Without this on it's far more hit an miss. 
     
    The generative AI toggle and ability does not allow you to train the agent - it has no memory in that manner. It technically does not even with knowledge documents or sources live scan them, they become indexed as noted above, pre studied in effect - linked key words, phrases and relationships and so on taking place by the agent in the background (this is as when it's RAG'ed it and tokenized words and phrases etc with similar meaning or overlap, become linked - it becomes a series of numbers representations - we never see this). Then a far better bot response is generated.
     
    Instruction do very little, if you want key instructions set nodes, from scratch placing instruction in a step by step manner breaking the initial convo down and how the Agent responds - design like decision tree to begin (you can use JSON or YMAL code later on for dynamic aspects - this is where I get stuck... the joys). Once working, combine nodes and remove steps, making the interaction of the bot smoother with less steps. 
     
    The best manner to get responses is to prompt how, i.e.  I want to know or help me with XZ - provide a link, or show me the document it's in or site it is on.... if using knowledge sources (add them back) but turn AI generation off as it confuses your agent. 
     
    If you want the agent in Teams, under the copilot settings in Teams where the agent shows as that is the LLM generative side, not the agent, you can set the 'pre text of how to respond rule wise as you noted reply as XYZ, do not use Em dashed etc'. 
     
    The above is how I have been working so far - hopefully, helpful but here's to  hoping you have already sorted your issue :)
     
     
  • Suggested answer
    CF-13080859-0 Profile Picture
    14 on at
    As An FYI to all if Interested.
     
    This was a BUG due to a major UI Update today in Copilot Studio. 
     
    My Banana test:
     
    Instruction:
     

    I am Morgan, a Business Analyst specialising in Microsoft Power Platform automation for UK organisations.

     

    Diagnostic test: If someone types exactly "morgan banana test", I respond with exactly: "Diagnostic confirmed - Morgan instruction processing active. I am your Business Analyst ready to help with process automation."

     

    Normal behaviour: For other messages, I introduce myself as Morgan, mention that I help automate business processes using Power Platform, and ask which specific process they want to improve. I use UK spelling and terminology.

     

    It Worked ! I was not going mad, you dont need Knowledge attached for an agent to work and it should use the instruction to return things like this.

     

     

     

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Season of Sharing Community Challenge Launch!

Jump in, show your community spirit, and win prizes!

Kudos to our 2025 Community Spotlight Honorees

Expanding mentorship, skilling, and AI innovation

Congratulations to the May Top 10 Community Leaders!

These are the community rock stars!

Leaderboard > Copilot Studio

#1
Valantis Profile Picture

Valantis 306

#2
11manish Profile Picture

11manish 174

#3
chiaraalina Profile Picture

chiaraalina 102 Super User 2026 Season 1

Last 30 days Overall leaderboard