Unanswered

Category classification "InvalidTrainingInput"

(0) Share

Report

Posted on by Community Power Pla...

I have been testing out smaller batches of data before going off and tagging a massive repository of entries we have at my company, while doing so I have run into "InvalidTrainingInput" come up almost every time except one where I made fake data. I have tried having two tags per data entry as mentioned by a person in a post at the beginning of the year but that doesn't seem to work. I need to know how to properly tag the data and what is wrong with this small batch before going off and tagging the 20k entries. There is no specific error in reference to what is invalid about the training input is there anything that can be done about this??

Categories:

AI Builder

I have the same question (0)

All responses (3)

Answers (0)

Norah on at

Like (0)

Report

HI @Anonymous

We have a doc update in progress trying to give our customers a better explanation about how to prepare data for category classification. It is going to be published soon, but let me summarize some good tips here.

Before you build a category classification model - AI Builder | Microsoft Docs

1. each tag needs to have 10 distinct text examples

2. each tag needs to have a minimum of 10 distinct text samples where it isn't used. So if you have a file of 20 records, but only 1 tag, it's not going to train.

3. A table needs to have at least 2 tags, each one must have 10 text samples.

4. You can define up to 200 distinct tags. Each tag is a category that will be identified and extracted from the given text.

5. Each sample of text data must have fewer than 5,000 characters.

So a minimum possible set here is 20 records, 1 tag per record, and 10 distinct examples for one tag, 10 distinct examples for the rest tag.

If you still encounter same issue, please email us at aihelpen@microsoft.com. And please help create an idea in the ideas forum to raise the request of better error messaging and fix suggestions, it will help us prioritize the work item.

Thanks

Norah

Was this reply helpful? Yes No
Community Power Pla... on at

Like (0)

Report

Hello @Norah

In the sidebar when trying to train the AI it mentions that "The model needs at least 10 examples per tag for training. All tags that have less than 10 text items will be filtered out" does this mean that when tagging its fine to just have a few tags that only have single/under 10 entries because it will be filtered out automatically? Or is that something I would still have to look for when tagging things? I ask this because I have tried to train it with 300 tagged entries that should follow those guidelines and it still says the input is invalid.

Was this reply helpful? Yes No
Norah on at

Like (0)

Report

Yes to "its fine to just have a few tags that only have single/under 10 entries because it will be filtered out automatically"

In the 300 tagged entries, how many tags you have? how many entries per tag? For each tag, do you have at least 10 entries that don't have this tag? If it's fine with you, you can send us your data (remove all PIIs and sensitive data) to aihelpen@microsoft.com.

Thanks

Norah

Was this reply helpful? Yes No