AI Form Processor - Automatically Insert PDF File from Flow in PowerApp

[sbeattie]

I've been trying to create a PowerApp to process forms and take specific data fields from them. I am using a flow to find the form on Box.com and insert the PDF file into my PowerApp. I also have an AI setup to extract this data but it requires the user to find the file on the computer before scanning the document. 

Is it possible to link the file found on Box.com by the flow to be automatically run through the Form Processing AI on my app?

Thanks

[JoeF-MSFT]

Hi @sbeattie,

What you can also do is execute form processing in Flow, store the extracted fields in a datastore like CDS and retreive these extracted data in a PowerApp. https://docs.microsoft.com/en-us/ai-builder/form-processing-model-in-flow

Would this work for your scenario?

[sbeattie]

Thanks for the quick reply @JoeF-MSFT , I had previously seen the option to put the AI into a flow but was unable to find the Predict connector for processing the documents in the list of actions on Flow, as mentioned in the webpage you linked? 

[JoeF-MSFT]

Hi @sbeattie,

To see the predict action, you will need to create the Flow inside a solution. More info on how to do this here: https://docs.microsoft.com/en-us/flow/create-flow-solution

[sbeattie]

Great, this seems to be on the right track @JoeF-MSFT . What would the code be for passing the document into the form processor from Box.com? In the attached photo I swapped "string(triggerBody()?['file']?['contentBytes'])" for the link to the Box.com file extracted in the step above, this gave me an error?

[JoeF-MSFT]

Hi @sbeattie,

Good to see the progress! Try using the following expression: 

string(outputs('Get_file_content_using_path')?['body']) as shown on the following screenshot.

[sbeattie]

@JoeF-MSFTUnfortunately I am still getting an error where the file is passeed to the Prediction action. This is the error message I received. I tried changiny "body" to "File_Content" but this still gave an error. 

"After parsing a value an unexpected character was encountered:  Path 'base64Encoded', line 19, position 44"

[JoeF-MSFT · Accepted solution]

Hi @sbeattie,

Can you try with the following expression? base64(outputs('Get_file_content_using_path')?['body'])

[sbeattie]

Briliant, that's got the flow working @JoeF-MSFT . Within the PowerApp, when I try to add the flow to a button I get an error Failed during http send request? 

[JoeF-MSFT]

We're almost there @sbeattie. 🙂

Are you calling the Flow from PowerApps like this, where in Flow you have a PowerApps trigger? https://docs.microsoft.com/en-us/powerapps/maker/canvas-apps/using-logic-flows