web
You’re offline. This is a read only version of the page.
close
Skip to main content

Notifications

Announcements

Community site session details

Community site session details

Session Id :
Power Platform Community / Forums / Power Apps / AI Builder Invoice Mod...
Power Apps
Unanswered

AI Builder Invoice Model doesn't train properly when using collections

(1) ShareShare
ReportReport
Posted on by 31

I'm trying to build an invoice processing model in AI builder that can work across multiple types of invoice from multiple vendors; at first glance, it *seems* like the solution is to create multiple collections, one for each vendor/invoice layout - then tag all my training files, and train the model.

 

However, I'm running into 2 major issues: for some collections, no matter how many times I correct the auto-detected fields to the appropriate data within a collection, the model never seems to retain this info; for reference, I have 10 collections, ranging from 5 to 45 documents apiece, for a total of 230 total tagged documents.

 

When I go to train the model, the numbers of detected fields don't match the actual numbers of fields I've tagged; for example, every single tagged document contained a correctly identified "InvoiceID" field, but on the training step, it only shows 21.

 

Every document within a collection contains the same fields, but not every collection does. It seems to be averaging its detection scores based on the total number of documents, and not per-collection, and it seems to be averaging its internal detection rules across all of the collections, instead of per collection.

 

If that's the case, what's the use in even using the collections?

Categories:
I have the same question (0)
  • plarrue Profile Picture
    Moderator on at

    Hi @SescoDev ,

     

    What type of documents did you select to build your custom model ? Structured, Unstructured or Invoices?

     

    Thanks

  • SescoDev Profile Picture
    31 on at

    I used invoices - this is specifically regarding the invoice processing model in AI Builder.

     

    For some reason, during the “train” step of the guided workflow, the configuration seems to lose multiple instances of multiple tags across the collections used for the model. For example: I have 236 tagged documents across 11 collections, and each of them has an identified, populated, and tagged invoiceID field. So I would expect when training that the model stats would reflect 236 instances of that field. The only way to restore the missing tags is to reopen  each collection, and manually click through the entire item carousel for that collection - which consumes credits. It’s clearly a backend flaw, and it’s artificially inflating my credit consumption.

  • Bidhan-ghimire Profile Picture
    7 on at

    Hello, were you able to resolve the issue. I'm also facing similar issue.

  • SescoDev Profile Picture
    31 on at

    Unfortunately, I was not. I ended up changing the entire project over to Syntex in Sharepoint. The cost of AI Builder credits, the lack of transparency on credit usage, and the poor performance of AI Builder overall led me to abandon using PowerPlatform for my invoice processing needs. Once again Microsoft has massively over-promised and under-delivered.

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Forum hierarchy changes are complete!

In our never-ending quest to improve we are simplifying the forum hierarchy…

Ajay Kumar Gannamaneni – Community Spotlight

We are honored to recognize Ajay Kumar Gannamaneni as our Community Spotlight for December…

Leaderboard > Power Apps

#1
WarrenBelz Profile Picture

WarrenBelz 796 Most Valuable Professional

#2
Michael E. Gernaey Profile Picture

Michael E. Gernaey 327 Super User 2025 Season 2

#3
Power Platform 1919 Profile Picture

Power Platform 1919 268

Last 30 days Overall leaderboard