Can i extract text from an image and populate the extract data inside sharepoint

(0) Share

Report

Posted on by johnjohn123

3,514

Hi All,

I have the following scenario, but not sure How/IF i can implement it using Power Automate and SharePoint list:-

1) We have a club registration cards which include VIP member and Regular member.

2) the 2 cards types have different info and different layout.

3) we want to scan the documents using scanner >> upload the scanned image to SharePoint document library >> then run a Power automate workflow which will check the image type (VIP card or Regular member card)

4) then based on this to populate the following data into a SharePoint custom list:-

- Content type (VIP or Regular)

- First Name

- Middle Name

- Last Name

- Registration number

- Role (Only for VIP cards)

- Member image

- Expiry date

- Issue date

- Department (Only for VIP cards)

I heard that Power automate provides an OCR capabilities, so how i can benefit from it? on the other side there is SharePoint Syntex which allow us to use AI capabilities to extract data.. so not sure from where i need to start? and which approach i can follow? Power App OCR or SharePoint Syntex and how i should utilize the correct approach?

Thanks

Here is a general sample of a Regular Member card:-

Categories:

Building flows

I have the same question (0)

All responses (7)

Answers (1)

Sort by

PrasadAthalye on at

Like (0)

Report
Copy link

Link copied!

You can use following AI Builder ready template and alter it to save the output to SharePoint List.

Go to AI Builder Menu - Build and you can select Extract text from images and then select Using Flow.

Was this reply helpful? Yes No
johnjohn123 3,514 on at

Like (0)

Report
Copy link

Link copied!

@PrasadAthalye thanks for the reply, but which ready template i need to use? is it the form processing? can you provide a screen shot?
Thanks

Was this reply helpful? Yes No
PrasadAthalye on at

Like (0)

Report
Copy link

Link copied!

Use this one ...

Was this reply helpful? Yes No
Verified answer

JoeF-MSFT Microsoft Employee on at

Like (1)

Report
Copy link

Link copied!

Hi @johnjohn123,

One way to OCR those registrations cards is by using AI Builder Text Recognizer as suggested by @PrasadAthalye. Just note that Text Recognizer will give you all the text present in the card, so you will need to a way to parse and extract the right information.

An easier approach can be to use AI Builder Form Processing, where you can train a custom AI model to extract the fields you want. The following tutorial will walk you how to achieve this: Get started with Form processing in AI Builder - Learn | Microsoft Docs since you have two card layouts, you will need to define two collections in your model.

Hope this helps. Let us know how it goes!

Was this reply helpful? Yes No
johnjohn123 3,514 on at

Like (1)

Report
Copy link

Link copied!

@JoeF-MSFTyes i think AI Builder Form Processing is the way to go.
Thanks

Was this reply helpful? Yes No
PrasadAthalye on at

Like (0)

Report
Copy link

Link copied!

Form Processing works better with PDFs. I see following note so you should ensure that Images are high quality.

"You can use images or PDFs of your documents to train your model, but text-embedded PDFs will provide the best results. Images should be as high-quality as possible to avoid any issues in detecting text."

I would still try Text Recognizer...

Was this reply helpful? Yes No
Siddharth2 2 on at

Like (0)

Report
Copy link

Link copied!

CAN ANYONE TELL HOW TO ACHEIVE THIS PROCESS WITHOUT USING PREMIUM ACTIONS LIKE TEXT RECOGNISER , PLEAS PLEASE HELP , PLEASE GIVE WHOLE PROCESS WITH IMAGES FOR BETTER UNDERTANDING

Was this reply helpful? Yes No