Answered

Can't get internal Sharepoint Site to show in Generative results

(0) Share

Report

Posted on by ZackC

I have a bot set up using the Copilot Studio. If I insert my public site, the bot will return annotated results as expected and seen in the demos. However, when I remove the public website, and instead insert a Sharepoint site (M365, hosted), the bot acts completely ignorant and won't answer anything meaningful.

In Studio under Generative AI, I see my intranet URL listed and Studio correctly identified that URL as a "SharePoint and OneDrive" Data Source.

I've tried to follow the learn.micorosft.com documentation for using SharePoint information but those steps aren't working, and some of the screenshots show areas that I can't find inside of Studio.

Are there any logs or debuging steps that I should be looking at here?

All responses (10)

Answers (1)

Verified answer

ZackC 15 on at

Like (0)

Report

Re: Can't get internal Sharepoint Site to show in Generative results

This was the primary problem. This should be set up as "Manual". There are two sets of documentation to fully configure it.

This YouTuber shows much of the process, but skips over the difficult part:
Getting Started with Copilot Studio Part 2: How to connect your own Copilot to SharePoint - YouTube

The documentation that he refers to are these two Microsoft articles:
Use content on SharePoint or OneDrive for Business for generative answers - Microsoft Copilot Studio | Microsoft Learn

Configure user authentication with Microsoft Entra ID - Microsoft Copilot Studio | Microsoft Learn

As someone else pointed out below, the documentation calls for using the "Entra ID" but that has apparently been renamed to "Azure Active Directory v2".
ZackC 15 on at

Like (0)

Report

Re: Can't get internal Sharepoint Site to show in Generative results

I'm still struggling to get it to work reliably, but I have it partially working now. My biggest hang up was that I wasn't putting the correct ID and Secret in the Copilot Studio. The ID comes from the Application itself in Azure, then the Secret is the piece that's starred out inside of the keys that get created.

It's kind of confusing because the Secret also has an ID with it, but that's the wrong ID.
JDel1 2 on at

Like (0)

Report

Re: Can't get internal Sharepoint Site to show in Generative results

Thanks for checking.
I guess I must be hitting the 3MB file size limit then. I will make a few more tests.

Does anyone know about a log that would help me understand what CoPilot is doing?
Pstork1 66,277 Most Valuable Professional on at

Like (0)

Report

Re: Can't get internal Sharepoint Site to show in Generative results

Assuming that your ClientID and Secret are correct those are the settings that work for me.
Jdel 2 on at

Like (0)

Report

Re: Can't get internal Sharepoint Site to show in Generative results

Hi;

I have the same issue. And I came across the same authentication procedure but I cannot make it work.

The idea is to register an Azure enterprise App with Microsoft Graph permissions (Sites.ReadAll + Files.ReadAll) and configure the relevant Client ID and Secret inside the Copilot Authentication parameters blade. The user would then authenticate and Copilot would use the token to access the content using the user's scope.

So far this has not worked. The procedure (https://learn.microsoft.com/en-us/microsoft-copilot-studio/configuration-authentication-azure-ad) advises to select Entra ID as the service provider but this choice is not available.
Here is what I have in CoPilot:
This is the Enterprise app permissions (probably too wide but I'm still trying to figure this out):
This the app token redirection settings (as per the above tutorial):
Am I missing something here? CoPilot is not able to list the files upon being asked so I assume it has no access.
citron-truc 389 on at

Like (0)

Report

Re: Can't get internal Sharepoint Site to show in Generative results

Good morning,
I hope you are doing well. I had a look at the documentation and found this :
On this page : https://learn.microsoft.com/en-us/microsoft-copilot-studio/nlu-generative-answers-sharepoint-onedrive
Have a lovely day !
ZackC 15 on at

Like (0)

Report

Re: Can't get internal Sharepoint Site to show in Generative results

I made multiple attempts at asking it "What is XX" or "When is YY", where XX and YY are keywords for vendors or projects that were on the SharePoint site. I tried brand new articles, as well as older stuff just in case it was some sort of timing issue. I also asked it more general questions like "What's the latest news according to the company intranet."

All of these wound up with zero context, and eventually in an endless loop where it would say that it couldn't escalate my chat to an associate.

I believe @Pstork1 above hit the nail on the head regarding the authentication. I'm still working to get that straightened out, but I think I misread or was misinformed when I originally read about the Authentication modes. I'll update the thread once I get that finalized.
Expiscornovus 31,709 Most Valuable Professional on at

Like (0)

Report

Re: Can't get internal Sharepoint Site to show in Generative results

Hi @ZackC,

Out of interest, what type of prompts did you use when testing your Generative answers?

Was it something simple like:

List all documents on the xx site?

Or was it something more specific to list content or content within the files itself of your site?
ZackC 15 on at

Like (0)

Report

Re: Can't get internal Sharepoint Site to show in Generative results

I'm set to Only for Teams and Power Apps. I thought I read that was the appropriate option as it would effectively pass through the user context from whoever is using the bot in Teams. But maybe I'm misunderstanding that setting.
Pstork1 66,277 Most Valuable Professional on at

Like (0)

Report

Re: Can't get internal Sharepoint Site to show in Generative results

What is your authentication setting under security for the bot? For Generative AI to work with SharePoint online I believe the bot needs to be set for manual authentication against Azure AD.