Unanswered

Document Processing Toolkit for GCCH

(0) Share

Report

Posted on by stosloskie

Hello,

I am new to the community and looking to see whether anyone has successfully created a solution similar to Power Automate's "Document Automation Toolkit." This solution is only on commercial tenants and the latest roadmap indicates this toolkit is not on the radar of the team.

I have been successful in the extraction of documents using AI Builder and a custom AI model, but the problem is when there is a need for human in the loop validation. My initial thought is to create a power app to review any document needing review, but it does not seem like there is a very intuitive solution available for selecting data points, etc.. Is there any sort of action, similar to the training portion of custom model, where I can "retrain" my model with human validated data?

Categories:

GCC, GCCH, DoD - Federal App Makers (FAM)

I have the same question (0)

All responses (2)

Answers (0)

Sort by

JayHangan Microsoft Employee on at

Like
a
(0)

Report
Copy link

Link copied!
Try this:
To create a model that can be trained with human validated data, you can follow these steps:
Create a new AI Builder model.
Upload your training data.
Use the Data Labeling feature to label your data points.
Train your model with the labeled data.
Once your model is trained, you can use it to extract data from documents. If there is a need for human in the loop validation, you can use Power Apps to create an app that allows users to review and validate the extracted data.

Was this reply helpful? Yes No
stosloskie 2 on at

Like
a
(0)

Report
Copy link

Link copied!

Thanks Jay,

I have already started down this route and have hit quite a few inconvenient issues along the way. There isn't a very intuitive control for reviewing and selecting data from a document, something similar to the training process would be incredibly helpful here. For now all I saw was to add a PDF viewer to my Power App and have to copy/paste any data from the viewer to a text input. I was reaching out to see if anyone in this space has built anything similar already as I'm taking a first shot at it.

Was this reply helpful? Yes No