cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Prajakta05
Helper II
Helper II

Confusion Matrix for Data Extracted by AI Builder - Form Processing Model

Can we create confusion matrix for the data extracted (fields) using AI Builder Custom Form Processing Model ?

If no then, is there any other way to measure the correctness of the model (Other than confidence score) ?

1 ACCEPTED SOLUTION

Accepted Solutions
JoeF-MSFT
Power Apps
Power Apps

Hi @Prajakta05,

 

Today the way to check the correctness of the model is by indeed looking at the confidence scores for each field. We also return a field named Collection confidence score which indicates if the document that has been processed has a layout for which the model has been trained for or not. 

JoeFMSFT_0-1645658034346.png

 

In just a few weeks from now, we'll be releasing an update to the model summary page that will display an accuracy score for the model and each field/table/checkbox after training that can give an indication if the model is ready to use for production, or needs more data to improve. Here is an exclusive sneak peek 👀

 

JoeFMSFT_1-1645658825114.png

JoeFMSFT_2-1645658948624.png

 

View solution in original post

2 REPLIES 2
JoeF-MSFT
Power Apps
Power Apps

Hi @Prajakta05,

 

Today the way to check the correctness of the model is by indeed looking at the confidence scores for each field. We also return a field named Collection confidence score which indicates if the document that has been processed has a layout for which the model has been trained for or not. 

JoeFMSFT_0-1645658034346.png

 

In just a few weeks from now, we'll be releasing an update to the model summary page that will display an accuracy score for the model and each field/table/checkbox after training that can give an indication if the model is ready to use for production, or needs more data to improve. Here is an exclusive sneak peek 👀

 

JoeFMSFT_1-1645658825114.png

JoeFMSFT_2-1645658948624.png

 

Prajakta05
Helper II
Helper II

Thanks !

Looking forward for the Model Summary Update.

Helpful resources

Announcements
Microsoft 365 Conference – December 6-8, 2022

Microsoft 365 Conference – December 6-8, 2022

Join us in Las Vegas to experience community, incredible learning opportunities, and connections that will help grow skills, know-how, and more.

Top Solution Authors
Top Kudoed Authors
Users online (5,948)