cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
johnjohn123
Post Prodigy
Post Prodigy

Can i extract text from an image and populate the extract data inside sharepoint

Hi All,

 

I have the following scenario, but not sure How/IF i can implement it using Power Automate and SharePoint list:-

 

1) We have a club registration cards which include VIP member and Regular member.

2) the 2 cards types have different info and different layout.

3) we want to scan the documents using scanner >> upload the scanned image to SharePoint document library  >> then run a Power automate workflow which will check the image type (VIP card or Regular member card)

4) then based on this to populate the following data into a SharePoint custom list:-

 

- Content type (VIP or Regular)

- First Name

- Middle Name

- Last Name

- Registration number

- Role (Only for VIP cards)

- Member image

- Expiry date

- Issue date

- Department (Only for VIP cards)

 

 

I heard that Power automate provides an OCR capabilities, so how i can benefit from it? on the other side there is SharePoint Syntex which allow us to use AI capabilities to extract data.. so not sure from where i need to start? and which approach i can follow? Power App OCR or SharePoint Syntex and how i should utilize the correct approach?

 

Thanks

 

 

Here is a general sample of a Regular Member card:-

 

Pics2.png

1 ACCEPTED SOLUTION

Accepted Solutions
JoeF-MSFT
Power Apps
Power Apps

Hi @johnjohn123,

 

One way to OCR those registrations cards is by using AI Builder Text Recognizer as suggested by @PrasadAthalye. Just note that Text Recognizer will give you all the text present in the card, so you will need to a way to parse and extract the right information. 

An easier approach can be to use AI Builder Form Processing, where you can train a custom AI model to extract the fields you want. The following tutorial will walk you how to achieve this: Get started with Form processing in AI Builder - Learn | Microsoft Docs since you have two card layouts, you will need to define two collections in your model.

Hope this helps. Let us know how it goes!

View solution in original post

6 REPLIES 6
PrasadAthalye
Super User
Super User

You can use following AI Builder ready template and alter it to save the output to SharePoint List.

 

Go to AI Builder Menu - Build and you can select Extract text from images and then select Using Flow.

 

PrasadAthalye_0-1624814150340.png

 

Please Like and Mark this as Answer if it resolves your Issue.

Power Automate Community
johnjohn123
Post Prodigy
Post Prodigy

@PrasadAthalye  thanks for the reply, but which ready template i need to use? is it the form processing? can you provide a screen shot?

Thanks

Use this one ...

 

PrasadAthalye_0-1624971876412.png

 

Please Like and Mark this as Answer if it resolves your Issue.

Power Automate Community
JoeF-MSFT
Power Apps
Power Apps

Hi @johnjohn123,

 

One way to OCR those registrations cards is by using AI Builder Text Recognizer as suggested by @PrasadAthalye. Just note that Text Recognizer will give you all the text present in the card, so you will need to a way to parse and extract the right information. 

An easier approach can be to use AI Builder Form Processing, where you can train a custom AI model to extract the fields you want. The following tutorial will walk you how to achieve this: Get started with Form processing in AI Builder - Learn | Microsoft Docs since you have two card layouts, you will need to define two collections in your model.

Hope this helps. Let us know how it goes!

View solution in original post

@JoeF-MSFTyes i think AI Builder Form Processing is the way to go.

Thanks

Form Processing works better with PDFs. I see following note so you should ensure that Images are high quality.

 

"You can use images or PDFs of your documents to train your model, but text-embedded PDFs will provide the best results. Images should be as high-quality as possible to avoid any issues in detecting text."

 

I would still try Text Recognizer...

Please Like and Mark this as Answer if it resolves your Issue.

Power Automate Community

Helpful resources

Announcements
UG GA Amplification 768x460.png

Launching new user group features

Learn how to create your own user groups today!

Community Connections 768x460.jpg

Community & How To Videos

Check out the new Power Platform Community Connections gallery!

M365 768x460.jpg

Microsoft 365 Collaboration Conference | December 7–9, 2021

Join us, in-person, December 7–9 in Las Vegas, for the largest gathering of the Microsoft community in the world.

Top Solution Authors
Top Kudoed Authors
Users online (1,185)