Unanswered

SharePoint syntex doesn't detect handwritten form data

(0) Share

Report

Posted on by Community Power Pla... Microsoft Employee

Hi All,

I created a SharePoint syntex AI Builder form processing model to extract medical insurance claim forms data.

I have used a few examples of medical insurance claim forms pdf files. few of them are handwritten forms and the rest are electronic forms.

Note:

Yellow highlighted: handwritten form data.
Green highlighted: extracted data from a handwritten form using a form processing model.

Click here for the test pdf which I am using to train my model.

The results that I get are quite good, but the model still makes quite a lot of mistakes.

I wanted to know if the prebuilt AI models are self-learning.

If not, what is the best way to improve this model?

Categories:

AI Builder

All responses (4)

Answers (0)

Sort by

Antrod Microsoft Employee on at

Like
a
(0)

Report
Copy link

Link copied!

Hi @Anonymous ,

Thanks for sharing this feedback!
We are working on integrating with the latest Azure AI form recognizer which should improve recognition of checkboxes (should come around October/November). Not sure it helps for the other fields though.

Can you tell us if you have good confidence score for your training set?
Community Power Pla... Microsoft Employee on at

Like
a
(0)

Report
Copy link

Link copied!

Thanks for the information @Antrod,

Yes, I have a good confidence score.
but when I am extracting data using my model then it doesn't detect some fields which I have mentioned above.

And I am facing 1more issue from yesterday.
Now I am unable to publish my model to SharePoint.

I have also posted this query in the community forum. But didn't get a response yet. Please help me to resolve this issue.

Thank you.
Antrod Microsoft Employee on at

Like
a
(0)

Report
Copy link

Link copied!

Thanks for letting us know. It can happen that AI doesn't recognize properly when characters are similar, even for a human look (6 and G for example). We are working on facilitating manual review for AI Builder predictions that could help in the cases where fields are not correctly formatted or missing.

About your issue, I'll address it to our technical experts. Can you tell me by private message (or using this email: aihelpen@microsoft.com) your environment id and after which action exactly you are getting this error?
Community Power Pla... Microsoft Employee on at

Like
a
(0)

Report
Copy link

Link copied!

Hi @Antrod ,
Thanks for the information.

The "model publish" issue has been resolved by replacing "_" from " " in tag field names.