cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
johnjohn123
Super User
Super User

Can the AI Form Processing get the data from the forms even if the forms are part of a larger document

We are working on registration system, and we have mainly those forms:-

 

1) car registration

 

2) driving licenses

 

3) personal Id

 

Now on the happy scenario, each of the uploaded document inside SharePoint online document library will contain only one of the above forms, so we can train our form processing to get the data.. but our customer mentioned that on  some scenarios one document might contain the 3 forms joint on a single pdf file.. while on other scenarios we might have an anonymous documents on the first 2 pages and then one of the forms on the 3rd or 4th pages..

 

so my question is, if the current AI form building can get the data from the above forms even if the forms are part of a larger document?

 

 

For example we have these scenarios:-

 

1) uploaded document contains only one driving license >> supported

2) uploaded document contains only one car registration >> supported

3) uploaded document contains only one personal id >> supported

 

-------

 

4) uploaded document contains random pages on the first N pages then on the N+1 page it has the driving license or car registration or personal id .

5) uploaded document contains 3 pages where each page contain one of the 3 forms...

 

 

 

1 REPLY 1
JoeF-MSFT
Power Apps
Power Apps

Hi @johnjohn123,

 

Good to see the progress you are making on this project.

 

Answering the questions to your scenarios:

 

  • #4: Yes, AI Builder Form Processing can handle this case. Note that every page in the document will be processed, and therefore each page will consume AI Builder credits. If you know the page where the form you want to extract data from is located, you can use the Pages input in the form processing action in Power Automate: Use the form processing model in Power Automate - AI Builder | Microsoft Docs
  • #5: This one is more tricky as each form processign model should be trained to handle 1 type of form. There are a number of things you can do here:
    • Split the PDF in different pages, so each document is in a different page.
    • Use the Pages input in the form processign action in Power Automate and specify in which page is located each form and process each in a different iteration: Use the form processing model in Power Automate - AI Builder | Microsoft Docs
    • Train a form processing model to handle documents that contain the 3 forms. You will need to train with at least 5 sample documents where this happens. 

 

I hope this helps.

 

Helpful resources

Announcements
Power Platform Conf 2022 768x460.jpg

Join us for Microsoft Power Platform Conference

The first Microsoft-sponsored Power Platform Conference is coming in September. 100+ speakers, 150+ sessions, and what's new and next for Power Platform.

New Ideas Forum MPA.jpg

A new place to submit your Ideas for Power Automate

Announcing a new way to share your feedback with the Power Automate Team.

MPA Virtual Workshop Carousel 768x460.png

Register for a Free Workshop

Learn to digitize and optimize business processes and connect all your applications to share data in real time.

MPA Licensing.jpg

Ask your licensing questions at the Power Automate AMA!

Join Priya Kodukula and the licensing team, super users and MVPs to find answers to your questions on Power Automate licensing.

Top Solution Authors
Users online (3,460)