cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Highlighted
Microsoft
Microsoft

Poor consistency / accuracy of form processing AI model

Am working on a POC to build a PO scanning PowerApps + Form processing model. The app intent is to serve 10 different PO formats and we've build 10 different models for it. My challenge is during the testing from PowerApps, the data capture is very inconsistent / inaccurate. Up to 50% inaccuracy which is pretty high given that we're potentially automating this process.

 

Q : What are the options in improving the model accuracy? We're not able to re-train it and only recreate it every single time.

4 REPLIES 4
Highlighted

Re: Poor consistency / accuracy of form processing AI model

Hi @leehsiang ,

 

You are right, you can't retrain a form processing model.  What do your documents look like, could you share a sample?

 

What I have found is that only very simple documents can be processed and sometimes it doesn't work for documents that you think it should.  It's a bit of trial and error.

 

As an alternative, I am currently looking at Form Recogniser on Azure but haven't tested it out yet. Could be worth a try https://azure.microsoft.com/en-in/services/cognitive-services/form-recognizer/

Highlighted
Power Apps
Power Apps

Re: Poor consistency / accuracy of form processing AI model

Hi @leehsiang,

 

Thanks for sharing feedback on your usage of AI Builder.

 

Validate that the forms that you are using follow the requirements and optimization as documented here: https://docs.microsoft.com/en-us/ai-builder/form-processing-model-requirements

 

We are working on enabling re-training in an upcoming update as well as adding the ability to manually tag fields which are not automatically detected to improve model accuracy, so stay tuned. 🙂

 

Also note that AI Builder Form Processing is built upon Azure Form Recognizer service, so you should get similar results and expect future improvements in both.

Highlighted
Microsoft
Microsoft

Re: Poor consistency / accuracy of form processing AI model

Hello Joe,

 

Agree with you while the documents quality do affect the outcome. However at this point of time is more of try-and-error and requires further manual interventions. 

 

Have looked at the release notes for April 2020 https://aka.ms/PowerPlatformReleaseNotes and do no see the update you mention. Is it stg to land soon?

Highlighted
Power Apps
Power Apps

Re: Poor consistency / accuracy of form processing AI model

Hi @leehsiang,

 

Thanks for the question. 

 

You can find the release notes for 2020 release wave 1 for Form Processing here: https://docs.microsoft.com/en-us/power-platform-release-plan/2020wave1/ai-builder/form-processing

Helpful resources

Announcements
secondImage

Demo-Extravaganza 2020

Check out these cool Power Apps & vote on your favorite!

secondImage

Robotic Process Automation

Let's talk about the solution provided by Microsoft for Robotic Process Automation (RPA)

secondImage

Community Highlights

Check out whats happening in Power Apps

secondImage

Community User Group Member Badges

FIll out a quick form to claim your community user group member badge today!

secondImage

Power Platform 2020 release wave 2 plan

Features releasing from October 2020 through March 2021

Users online (11,404)