I cannot get the AI model to accept my base64 encoded image from a HTTP request - while opening the file manually works - Help

(0) Share

Report

Posted on by ConsiglioriWim

Hello Fellow Automaters,

I'm running into an issue with calling the AI model (running a standard cats vs dogs detection using the Kaggle set).

When I open the file with the content to be detected with a manual trigger, it works fine

A very simple flow to open a file, and we see the contents of the file converted to base64, and passed on the AI Model. It runs without errors (except from detecting, need to add more samples ...)

Schermafbeelding 2021-09-17 om 11.40.35.png

Run the flow manually

Schermafbeelding 2021-09-17 om 11.41.19.png

The file is imported and the content is converted to base64, the content is passed on to the AI model

Schermafbeelding 2021-09-17 om 11.41.41.png

And succes!

Schermafbeelding 2021-09-17 om 11.41.55.png

However, when I tried to post this same image as base64 content through a HTTP requests, the model refuses to accept the input and fails. Imho it is exactly the same content ( opened the image and used base64encode.org to encode it).

This is the HTTP flow request

Schermafbeelding 2021-09-17 om 11.49.14.png

The HTTP POST request I send from Postman

Schermafbeelding 2021-09-17 om 11.49.42.png

The HTTP requests gets processed normally and base64 encoded image is stored in the Image attribute

Schermafbeelding 2021-09-17 om 11.50.27.png

However when passing the Image to the AI model, it fails with a bad request, even though the content of the image attribute is exactly the same as when I'm running it with a manual trigger.

Schermafbeelding 2021-09-17 om 11.50.47.png

What am I doing wrong? HELP!

Categories:

AI Builder

I have the same question (0)

All responses (8)

Answers (2)

Verified answer

Antrod Moderator on at

Like (0)

Report

Hi @ConsiglioriWim ,

Did you try to convert the explicitly convert the base64 string to binary using base64ToBinary?

Thanks

Was this reply helpful? Yes No
ConsiglioriWim 19 on at

Like (0)

Report

No, why would I do that? The AI model expects base64, not binary. I tried by sending a url to the JPEG image, downloading it with a HTTP GET requests and saving it locally on my OneDrive and passing that to the Model. Didn't work either. Or is there an image object that can open that JPEG file and pass that object to the model, like the open file manual method?

Was this reply helpful? Yes No
Antrod Moderator on at

Like (0)

Report

AI Builder actions require an explicit conversion to work properly.

I made the test with Form processing models and it worked (I think it's the same with object detection):

1- Converted my file using the base64 encoder you provided
2- Passed it as a string to my model fails as in your example:

3- If I convert the base64 to binary it now works properly:

Hope that helps solve your issue.

Was this reply helpful? Yes No
ConsiglioriWim 19 on at

Like (0)

Report

Hi @Antrod
Can you just expand the F(x) for calling the Base64 on the Variable, for getting the correct syntax? Thx
I need to apply that on the image attribute. I get an error for F(x) Base64ToString('image')

Was this reply helpful? Yes No
Antrod Moderator on at

Like (0)

Report

Sure, I just converted the string variable representing the file: base64ToBinary(variables('MyFileBase64String'))

Let us know if that works for you!

Was this reply helpful? Yes No
Antrod Moderator on at

Like (0)

Report

Note that if the string representation of your file is within double quote you may get this error:
If possible try to avoid double quoting your string.

Was this reply helpful? Yes No
Verified answer

ConsiglioriWim 19 on at

Like (1)

Report

@Antrod
Calling base64ToBinary instead of base64ToString did the trick ! Thanks a lot!!!!!!

Was this reply helpful? Yes No
Antrod Moderator on at

Like (1)

Report

Awesome 🙂
Wish you a great automation journey with AI Builder!

Was this reply helpful? Yes No