Answered

Copilot Studio published agent gives different answers to maker and to users

(2) Share

Report

Posted on by DŠ-01081257-0

Hello everyone,

I'm developing an agent in Copilot Studio using a simple RAG setup. The agent draws knowledge from SharePoint, with certain documents uploaded directly from SP as unstructured data into Dataverse. The following features are enabled:

Tenant Graph grounding
Dataverse Search
M365 Copilot license is active in the tenant
The agent is running in a development environment with preview features
The language is set to Czech

The issue arises when the agent is published to specific users for testing via Teams and M365. As the maker, I receive relevant and well-cited answers, even when testing through the same Teams and M365 channels. However, test users receive different results—often irrelevant answers or no response at all—even when asking the exact same question.

Has anyone experienced similar behavior? Any ideas on what might be causing this discrepancy or how to troubleshoot it?

Thanks in advance for your help!

Best regards,
David Šafařík

Categories:

General topics

I have the same question (0)

All responses (9)

Answers (2)

Sort by

KP-01081357-0 3 on at

Like (0)

Report
Copy link

Link copied!

I have also been struggling with this. I have the exact same set up. If you find anything PLEASE update!

Was this reply helpful? Yes No
Bezanca 688 Super User 2026 Season 1 on at

Like (0)

Report
Copy link

Link copied!

Hey DŠ-01081257-0

Do you have the Microsoft 365 Copilot licence?

Do your users have the Microsoft 365 Copilot licence?

Do your users have access to the SharePoint document library?

Thanks,

Was this reply helpful? Yes No
DŠ-01081257-0 24 on at

Like (1)

Report
Copy link

Link copied!

Hi Bezanca

I don't have the Microsoft 365 Copilot licence. I am using an account dedicated for Copilot Studio.

Some of my users have the Microsoft 365 Copilot licence.

All users have access to the SharePoint document library through group permissions.

Thanks

Does this answe

Was this reply helpful? Yes No
Verified answer

trice602 16,277 Super User 2026 Season 1 on at

Like (2)

Report
Copy link

Link copied!

Hi there!

Your permissions are different than the other users and is the root cause. Make sure everyone has the same permissions and licensing.

------------------------------------------------

⭐ If this was helpful, please like and check the box below "Does this answer your question" to help others find this too!

Always glad to help! 💯💯💯💯💯

Tom

Follow me on LinkedIn - Thomas Rice, PMP | LinkedIn

Was this reply helpful? Yes No
Bezanca 688 Super User 2026 Season 1 on at

Like (2)

Report
Copy link

Link copied!

Hi DŠ-01081257-0

You also mentioned you have documents in dataverse - have you also double checked the users dataverse security roles are the same as yours?

Thanks

Bezanca

Was this reply helpful? Yes No
Verified answer

Ekta Gupta 98 on at

Like (1)

Report
Copy link

Link copied!

Hi User,

Please verify the security role of testers. Unless they have the same privilege as you have on the dataverse entities, result will not match.

Please like and verify if it works. Thanks

Was this reply helpful? Yes No
DŠ-01081257-0 24 on at

Like (1)

Report
Copy link

Link copied!

Hi all,

Thanks for the inputs. I'd like to clarify that I have the same access permissions to the SP library as the users. The agent is able to cite some documents for the user. What the users get is mostly false positives - meaning the agent uses a knowledge source which is not related to the question.

The library we are using is a subset copy of another library. Some documents were copied manually, some were copied through some form of automation. I was not responsible for the creation of the new library so I don't have specific details.

What's weird to me is that some documents only on sharepoint, not on dataverse, seem to be inaccessible to the users. Even though we all have the same access rights to the library. We even tested this, specifically asking the agent about a certain document, which we know the users have access to. The agent still gave irrelevant answer.

Regarding the dataverse security roles. The testers are not assigned as users in the environment. I will try to add some users and give them the same security roles as I have, to test this.

Thanks

Was this reply helpful? Yes No
Suggested answer

DŠ-01081257-0 24 on at

Like (1)

Report
Copy link

Link copied!

I added the test users to the dev environment and gave them the same security roles as I have. They now get the same responses as I do.

Was this reply helpful? Yes No
Bezanca 688 Super User 2026 Season 1 on at

Like (1)

Report
Copy link

Link copied!

Excellent news DŠ-01081257-0
So it just came down to the Dataverse security roles. Thanks for confirming back to us! This will be useful for others in the future.

Was this reply helpful? Yes No