Multiple document types - how to detect which model to use

(0) Share

Report

Posted on by Lucian

256

Hi,

I would like to create a document processing process, but on the same service email address I receive multiple document types. Because of the language (Romanian) and some specific fields I cannot use the prebuilt models, and I have to create custom models for each document type.

Let's say there are three model types:

Invoices
Receipts
Activity Reports

From what I've found until now - one approach is to use the "predict" action with each of the model. The problem with this approach is that will consume a lot of AI Builder credits, especially when the model types will increase.

I cannot detect document type based on sender, because the same sender could attach different document types, so the detection should be at the document level.

So, is there a way to determine the "document type" and after that to use the right model for it? Which AI Builder model would better achieving this task: Entity Extraction, Category classification or else (assuming that I probably need to use "Text recognition" along the way)?

Kind Regards,

Lucian

Categories:

AI Builder

I have the same question (0)

All responses (7)

Answers (1)

Verified answer

Antoine2F on at

Like (2)

Report

Hi,
Recommendation is to use Text Recognition upfront.
It should be enough and it consumes only 3 credits/Image.
Using text recognition output, search for specific text pattern (eg: 'Invoice' or 'Project') to determine the type of document so you can then call the appropriate model.

Was this reply helpful? Yes No
Lucian 256 on at

Like (0)

Report

Hello @Antoine2F ,

Thank you for your suggestion, it seems reasonable, and I will have to give it a try. My concern with this approach is that may exist situation when I will have an invoice for a specific project, and how could I choose when both words will be detected.

Additionally, because you mentioned "it consumes only 3 credits/Image", I would to know where these credits are mentioned in Microsoft documentation. 😁

The only information I found until now is the AI Builder Calculator which mention for "Text recognition" model in the "Customer usage example" - "company needs 1 million service credits for 50,000 photos" which will result in 20 service credits per image.

Is there any other (and clearer) information about how these credits are consumed by each model?

Kind Regards,
Lucian

Was this reply helpful? Yes No
Antoine2F on at

Like (1)

Report

Hello Lucian
Detailed consumption rate can be found in Microsoft Power Apps and Power Automate Licensing guide (pdf).
Link to this guide is given here Licensing overview for Microsoft Power Platform - Power Platform | Microsoft Learn
Here is the direct link : https://go.microsoft.com/fwlink/?linkid=2085130
Rate card is page 23 in February 2023 version. Note this guide can be updated every month or so.

Hope this helps!

Was this reply helpful? Yes No
Lucian 256 on at

Like (0)

Report

Hello @Antoine2F ,

Thank you for all the detailed information.

Kind Regards,
Lucian

Was this reply helpful? Yes No
jk_one Moderator on at

Like (1)

Report

Hi Lucian,

We've also now added an AI Builder activity monitoring page (in preview) in the Power Automate portal, where you can track credit usage of different models : Activity monitoring (preview) | Microsoft Learn

Hope that helps !
JK

Was this reply helpful? Yes No
Lucian 256 on at

Like (0)

Report

Hi @jk_one ,

Niiiice! Is very usefull! Now I could clearly see that @Antoine2F was right (only 3 credits)! 😁
It's easier now to check the credits consumption. It would be nice to have the flow run id or something to "link" that information to the flow that executed that actions.

Thank you very much for pointing me this.

Kind Regards,
Lucian

Was this reply helpful? Yes No
jk_one Moderator on at

Like (1)

Report

Hi Lucian,
Thank you for the feedback!
Adding the link to the flow/app is indeed on our roadmap.
Best regards,
JK

Was this reply helpful? Yes No