Unanswered

AI Form Processor - Automatically Insert PDF File from Flow in PowerApp

(0) Share

Report

Posted on by sbeattie

I've been trying to create a PowerApp to process forms and take specific data fields from them. I am using a flow to find the form on Box.com and insert the PDF file into my PowerApp. I also have an AI setup to extract this data but it requires the user to find the file on the computer before scanning the document.

Is it possible to link the file found on Box.com by the flow to be automatically run through the Form Processing AI on my app?

Thanks

Categories:

AI Builder

I have the same question (0)

All responses (11)

Answers (1)

JoeF-MSFT on at

Like (1)

Report

Re: AI Form Processor - Automatically Insert PDF File from Flow in PowerApp

Hi @sbeattie,

What you can also do is execute form processing in Flow, store the extracted fields in a datastore like CDS and retreive these extracted data in a PowerApp. https://docs.microsoft.com/en-us/ai-builder/form-processing-model-in-flow

Would this work for your scenario?

Was this reply helpful? Yes No
sbeattie 13 on at

Like (0)

Report

Re: AI Form Processor - Automatically Insert PDF File from Flow in PowerApp

Thanks for the quick reply @JoeF-MSFT , I had previously seen the option to put the AI into a flow but was unable to find the Predict connector for processing the documents in the list of actions on Flow, as mentioned in the webpage you linked?

Was this reply helpful? Yes No
JoeF-MSFT on at

Like (0)

Report

Re: AI Form Processor - Automatically Insert PDF File from Flow in PowerApp

Hi @sbeattie,

To see the predict action, you will need to create the Flow inside a solution. More info on how to do this here: https://docs.microsoft.com/en-us/flow/create-flow-solution

Was this reply helpful? Yes No
sbeattie 13 on at

Like (0)

Report

Re: AI Form Processor - Automatically Insert PDF File from Flow in PowerApp

Great, this seems to be on the right track @JoeF-MSFT . What would the code be for passing the document into the form processor from Box.com? In the attached photo I swapped "string(triggerBody()?['file']?['contentBytes'])" for the link to the Box.com file extracted in the step above, this gave me an error?

Screenshot (5).png

Was this reply helpful? Yes No
JoeF-MSFT on at

Like (1)

Report

Re: AI Form Processor - Automatically Insert PDF File from Flow in PowerApp

Hi @sbeattie,

Good to see the progress! Try using the following expression:

string(outputs('Get_file_content_using_path')?['body']) as shown on the following screenshot.

Was this reply helpful? Yes No
sbeattie 13 on at

Like (0)

Report

Re: AI Form Processor - Automatically Insert PDF File from Flow in PowerApp

@JoeF-MSFTUnfortunately I am still getting an error where the file is passeed to the Prediction action. This is the error message I received. I tried changiny "body" to "File_Content" but this still gave an error.

"After parsing a value an unexpected character was encountered: Path 'base64Encoded', line 19, position 44"

Was this reply helpful? Yes No
Verified answer

JoeF-MSFT on at

Like (2)

Report

Re: AI Form Processor - Automatically Insert PDF File from Flow in PowerApp

Hi @sbeattie,

Can you try with the following expression? base64(outputs('Get_file_content_using_path')?['body'])

Was this reply helpful? Yes No
sbeattie 13 on at

Like (0)

Report

Re: AI Form Processor - Automatically Insert PDF File from Flow in PowerApp

Briliant, that's got the flow working @JoeF-MSFT . Within the PowerApp, when I try to add the flow to a button I get an error Failed during http send request?

Was this reply helpful? Yes No
JoeF-MSFT on at

Like (0)

Report

Re: AI Form Processor - Automatically Insert PDF File from Flow in PowerApp

We're almost there @sbeattie. 🙂

Are you calling the Flow from PowerApps like this, where in Flow you have a PowerApps trigger? https://docs.microsoft.com/en-us/powerapps/maker/canvas-apps/using-logic-flows

Was this reply helpful? Yes No
sbeattie 13 on at

Like (0)

Report

Re: AI Form Processor - Automatically Insert PDF File from Flow in PowerApp

Yes @JoeF-MSFT , when I go to select the Flow to assign to a button within the PowerApp it displays an error. "Failed during http send request"

Was this reply helpful? Yes No