Provide a reasoned summary across multiple documents in a SharePoint Library

Like (0) Share

Report

Posted on 9 Dec 2024 10:30:22 by The_General

I am trying to build a Copilot Studio Agent that will be available to both M365 Copilot users and non Copilot users.

The purpose of the agent is to answer questions based on the content on PPT and PDF files in a SharePoint library of User Experience feedback relating to a specific group of products.

The challenge I have right now is that the Copilot Studio Agent provides a summary but it only ever references one file not an array of files to show it has reasoned over multiple sources.

A couple of question examples are:-

* What capabilities do Department Leads/Heads value most?

* How did people react to the new Navigation structure in APP-X?

I have tried pre-pending my questions with the following to give guidance, context and scope but still nothing more than a single document response comes back

Please create a reasoned response to the following question based on the content of multiple documents in the SharePoint library. The documents are user experience reports containing views from different user groups. Use the entire knowledge library as your source. Provide a summary in bullet points, and reference up to the top 10 files that were used to generate the response.

Interestingly when I use the Copilot SharePoint agent I get a really good reasoned response with reference links to multiple files.

Am I trying to do something that Copilot Studio Agents cannot do - this would be really disappointing if it is.

Categories:

General

All responses (4)

Answers (0)

Suggested answer

Artur Stepniak 1,526 Super User 2025 Season 1 on 10 Dec 2024 at 10:57:30

Like (0)

Report

Provide a reasoned summary across multiple documents in a SharePoint Library

Hello,

you can review the licensing cost for pay-as-you-go here: https://www.linkedin.com/posts/jukkaniiranen_copilotstudio-powerplatform-azure-activity-7267889838350106625--7lR/. It's related to Copilot Studio, but I assume that it'll apply to SP agents also. You'd need to review though if it's worth to pay 0.01$/message instead of 25000 messages/200$. Overall bulk licensing is cheaper.

In case of any other questions, let me know. If the answer helped you, mark it, so that others can benefit from it.

Best regards,

Artur Stepniak
The_General 17 on 10 Dec 2024 at 09:22:06

Like (0)

Report

Provide a reasoned summary across multiple documents in a SharePoint Library

Thanks for the input.

I think Microsoft have also come up with an approach as listed in the Message Center yesterday.

[Microsoft 365 Copilot, SharePoint Online] New Pay-as-you-go billing model for Agents in SharePoint [MC952883]

Not sure what the pricing is going to be yet though.

Kind Regards

Graham
Suggested answer

Artur Stepniak 1,526 Super User 2025 Season 1 on 10 Dec 2024 at 07:49:59

Like (1)

Report

Provide a reasoned summary across multiple documents in a SharePoint Library

Hello,

if SP agent is giving you good answers, have you tried to create an agent from the library by pressing a button? See:

That way you can alter behaviour a little bit. I'd suggest you to stick to SP agents if you're using SP as a knowledge source. I see that it works a lot better than creating it from within Copilot Studio - probably the framework is a bit different.

What you could also consider is just to use Copilot SP agent. What you'd need from licensing perspective you can read here: https://support.microsoft.com/en-us/office/get-started-with-agents-in-sharepoint-69e2faf9-2c1e-4baa-8305-23e625021bcf.

In case of any other questions, let me know. If the answer helped you, mark it, so that others can benefit from it.

Best regards,

Artur Stepniak
SaiRT14 1,983 Super User 2025 Season 1 on 09 Dec 2024 at 20:14:11

Like (0)

Report

Provide a reasoned summary across multiple documents in a SharePoint Library

Multi-document aggregation, combining the SharePoint Agent with Copilot Studio or integrating Microsoft Graph APIs can be an effective solution.