Hello Everyone,
I have been testing an approach to send prompts and attachments to an agent using REST APIs via Postman, and I wanted to share my observations to see if anyone else has experienced the same behavior.
We are sending JSON payloads that include the prompt along with attachment binaries (Base64 encoded). The API endpoint being used is:
https://directline.botframework.com/v3/directline/conversations
After testing multiple payload structures and scenarios, we noticed that the APIs work correctly when sending simple prompts. However, when attachments are included in the payload, the agent does not seem to process them correctly.
Scenarios tested and observed outcomes:
• Simple agent with one tool to retrieve an account record
Working as expected.
• Agent to read a document and update values in Dataverse
Returns a response stating that the attachment was not provided, even though the attachment is included in the payload.
• Agent to read a document without updating Dataverse
Returns generated/made-up values and presents them as if they were read from the document.
Additional observations:
• Attachments are passed in the payload as Base64-encoded content.
• The same behavior occurs when calling the API directly via Postman and when triggering the agent through Cloud Flow.
• The issue only appears when attachments are involved. Prompt-only scenarios work correctly.
• We also tried a few other payload structures and combinations, but they only work when attachments are not included in the request.
Has anyone successfully processed document attachments through the Direct Line API with an agent?
If there are any specific requirements, recommended payload formats, or configuration steps for handling attachments in document-processing scenarios, I would really appreciate any guidance.
Thank you!