AI Builder Model Stuck In Training Forever (Form Processing)

(0) Share

Report

Posted on by AshutoshRai

Hi!

I was trying to train a model to look for the completion score.

I uploaded multiple images of the page of which we would get the screenshot. It's been hours but the status is 'Training'?

Any idea what's wrong ?

Categories:

AI Builder

I have the same question (0)

All responses (36)

Answers (0)

JoeF-MSFT Microsoft Employee on at

Like (1)

Report
Copy link

Link copied!

Hello, thank you for letting us know about this. We're aware of an incident that is impacting some trainings from being completed. We're currently investigating to solve this. Apologies for the inconvenience!

Was this reply helpful? Yes No
AshutoshRai 8 on at

Like (0)

Report
Copy link

Link copied!

Thanks for reply, do lemme know if it's solved

Was this reply helpful? Yes No
antoinec Microsoft Employee on at

Like (2)

Report
Copy link

Link copied!

Hi Ashutosh, We're progressively wrapping mitigation for this incident. Things should be back to normal everywhere within the next hour at most. Apologies for the inconvenience, this was a new failure class for us ... we'll learn tons from it about how to prevent it from happening again in the future, and solving it better should something similar happen.

Antoine

Was this reply helpful? Yes No
antoinec Microsoft Employee on at

Like (0)

Report
Copy link

Link copied!

And we're 100% back to normal. Do let us know if you're still hitting issues.

Was this reply helpful? Yes No
TimAustinMills 5 on at

Like (0)

Report
Copy link

Link copied!

Im still having the same issue - model started training over 22 hours ago.

Was this reply helpful? Yes No
TimAustinMills 5 on at

Like (0)

Report
Copy link

Link copied!

Note mine is stuck - retraining not training

Was this reply helpful? Yes No
antoinec Microsoft Employee on at

Like (0)

Report
Copy link

Link copied!

Hum ... sorry for the continued inconvenience. We're looking into it and will update the thread once we've found more. If you could send me the URL of your model in a private forum message, it could help us pinpoint your specific issue.

Was this reply helpful? Yes No
antoinec Microsoft Employee on at

Like (0)

Report
Copy link

Link copied!

Hi Tim, after looking into some more, we've identified that some issues might have taken up to 48 extra hours to resolve through a consistency job. Our assessment is that all models should now be in a recoverable state. Are you still seeing issues on your end?

Was this reply helpful? Yes No
timau 2 on at

Like (0)

Report
Copy link

Link copied!

Yes it resolved a few hours later. Thanks

Was this reply helpful? Yes No
Alberto_B 6 on at

Like (1)

Report
Copy link

Link copied!

Dear All,

I'm currently having the same issue. The custom AI model that I created is stuck in training mode since several hours. I tried to delete the model but the operation doesn't work. In the meantime I cannot add any new table with data. Is there any chance to abort the training operation?

Any help would be appreciated.
Thank you
Alberto

Was this reply helpful? Yes No