cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
johnjohn123
Post Prodigy
Post Prodigy

Can the AI Form Processing get the data from the forms even if the forms are part of a larger document

We are working on registration system, and we have mainly those forms:-

 

1) car registration

 

2) driving licenses

 

3) personal Id

 

Now on the happy scenario, each of the uploaded document inside SharePoint online document library will contain only one of the above forms, so we can train our form processing to get the data.. but our customer mentioned that on  some scenarios one document might contain the 3 forms joint on a single pdf file.. while on other scenarios we might have an anonymous documents on the first 2 pages and then one of the forms on the 3rd or 4th pages..

 

so my question is, if the current AI form building can get the data from the above forms even if the forms are part of a larger document?

 

 

For example we have these scenarios:-

 

1) uploaded document contains only one driving license >> supported

2) uploaded document contains only one car registration >> supported

3) uploaded document contains only one personal id >> supported

 

-------

 

4) uploaded document contains random pages on the first N pages then on the N+1 page it has the driving license or car registration or personal id .

5) uploaded document contains 3 pages where each page contain one of the 3 forms...

 

 

 

1 REPLY 1
JoeF-MSFT
Power Apps
Power Apps

Hi @johnjohn123,

 

Good to see the progress you are making on this project.

 

Answering the questions to your scenarios:

 

  • #4: Yes, AI Builder Form Processing can handle this case. Note that every page in the document will be processed, and therefore each page will consume AI Builder credits. If you know the page where the form you want to extract data from is located, you can use the Pages input in the form processing action in Power Automate: Use the form processing model in Power Automate - AI Builder | Microsoft Docs
  • #5: This one is more tricky as each form processign model should be trained to handle 1 type of form. There are a number of things you can do here:
    • Split the PDF in different pages, so each document is in a different page.
    • Use the Pages input in the form processign action in Power Automate and specify in which page is located each form and process each in a different iteration: Use the form processing model in Power Automate - AI Builder | Microsoft Docs
    • Train a form processing model to handle documents that contain the 3 forms. You will need to train with at least 5 sample documents where this happens. 

 

I hope this helps.

 

Helpful resources

Announcements
UG GA Amplification 768x460.png

Launching new user group features

Learn how to create your own user groups today!

Community Connections 768x460.jpg

Community & How To Videos

Check out the new Power Platform Community Connections gallery!

Welcome Super Users.jpg

Super User Season 2

Congratulations, the new Super User Season 2 for 2021 has started!

Carousel 2021 Release Wave 2 Plan 768x460.jpg

2021 Release Wave 2 Plan

Power Platform release plan for the 2021 release wave 2 describes all new features releasing from October 2021 through March 2022.

Top Kudoed Authors
Users online (1,368)