Power Platform Community Forum Thread Details

I am trying to develop a model to "read" and capture data from a fixed format document which contains handwritten data and signatures. It is progressing reasonably well except for a choice field.

The question is were any implants fitted during their lifetime ? and the answer is printed as Yes and No - the respondent then circles the answer as either "yes or "no"

I have tried using this as a text field and as a checkbox but I am not sure what the best approach is to record the choice

Any guidance would be welcome

Roger

Categories:

AI Builder

This scenario shows a common limitation in AI Builder form processing. Handwritten circles introduce ambiguity. Expecting a clean Yes or No directly from the model leads to unstable results. The reliable approach is to let the model extract signals, then apply judgement in the flow.

The model performs better when it focuses on regions, not intent. Decision logic belongs in Power Automate, not inside the AI model.

Key recommendations.

Do not use checkbox or boolean fields for circled responses. Handwritten marks reduce confidence.
Split the Yes and No areas into separate capture regions. Treat each region independently.
Configure both regions as text fields. Train on detecting ink presence rather than reading text.
Include imperfect samples during training. Partial circles, light marks, and empty fields matter.
Apply decision rules in Power Automate. Resolve Yes or No based on which region contains extracted content.
Add a review path when both regions return values or both return empty results.

This approach accepts uncertainty upfront and controls it downstream. Results stay consistent across real documents, not curated samples.

Thank you!
Did I answer your question? Mark my post as a solution!
Proud to be a Super User!