Unanswered

Analyzing files in autonomous agent and access to Document Processor Managed Agent (preview)

(3) Share

Report

Posted on by Andlin

Hi,

I am working on a POC for an autonomous agent that will evaluate incoming requests for proposals. The request consists of a mail with some relevant information in the body and a bunch of more or less structured attachments (PDF, DOCX, XLSX).

We will trigger the agent when an incoming mail lands in a certain mailbox using a mail trigger in PA, store the attachments in a SharePoint Document Set. Then we want the agent to, based on its knowledge, to do its magic and analyze and assess the content of the mail body and the attachments.

We have created an agent in Copilot Studio that does some of the work. However, we would like to have a better way of analyzing and assessing the attachments. I have been looking into the Document Processors Managed Agent but for some reason it isn't available in Copilot Studio, at least not yet. Is there a way to enable it or activate some kind of preview mode in Copilot Studio?

Or is there another smart way of analyzing the files? For example, by using a Tool in the agent (SharePoint - "Get file content" or SharePoint - "Get file content using path" and thus giving the agent access to the files that way.

Any tips or suggestions would be highly appreciated.

All the best, Andreas

Categories:

Autonomous agents

I have the same question (0)

All responses (3)

Answers (0)

Suggested answer

Jared on at

Like (0)

Report

I can't comment on the Document Processors Managed Agent, but for your use case, I have a few recommendations:

1. Agree with your approach of processing the mail in power automate to get the files.

2. Once you've got the file, and trigger the agent, I'd use the OneDrive GetFileContent tool (https://learn.microsoft.com/en-us/connectors/onedriveforbusiness/#get-file-content-using-path) -- and you can read the file into the context window. Sadly, this will only work with smaller files. (2k character limit)

3. For the absolute best processing capabilities, you'll likely need to get a bit more complex, treating large unstructured content vs structured data (excel) differently. For unstructured, you'd drop those files into a directory, use AI Foundry to process them (Some accelerator samples here - GitHub - Azure-Samples/chat-with-your-data-solution-accelerator) - then connect to that from copilot studio. Clearly not ideal from a low code perspective, but more features coming in the future! For structured, you'd want to get the excel into a structured format, and build queries against it.

Was this reply helpful? Yes No
JB-11071708-0 2 on at

Like (0)

Report

Like you, I've been trying to get access to the Document Processor Managed Agent. I've checked weekly to see if it's present, but it hasn't shown up within agent inventory. Has anyone gotten access to the Document Processor? If so, how? I believe I followed the preliminary documentation, but no joy.

Was this reply helpful? Yes No
Ceren Moderator on at

Like (0)

Report

Thank you for your interest in the Document Processor agent. The agent is currently in public preview, which means it can be accessed from a preview (early access environmen) environment. To use it, please make sure the environment "get new features early" toggle enabled:

Hope this helps, thank you!

Was this reply helpful? Yes No