Using power automate to tag images uploaded into sharepoint using AI builder models

Like (0) Share

Report

Posted on 31 Aug 2022 10:31:20 by Teflonreis

Hello everyone

I already have the AI builder models. And need to build a flow that tags images uploaded into sharepoint using the models.

AI builder models categorize images. The labels are ones such as "outdoor or indoor", "with cables or without cables", "empty room or not empty room" etc.

Flow testing shows that the models really do predict the tags. Uploaded room full of stuff and got correctly predicted as "not empty room".

Finally, I want to add an "not empty room" tag to the image on sharepoint. And find the image using the sharepoint search bar like microsoft is already doing here .

Have not found anything related to that yet. Hope you can help me at this point.

Many thanks kind regards

Categories:

AI Builder

All responses (9)

Answers (1)

Teflonreis 45 on 02 Sep 2022 at 14:32:44

Like (0)

Report

Re: Using power automate to tag images uploaded into sharepoint using AI builder models

thanks Antrod

Will do that.
Antrod Moderator on 02 Sep 2022 at 14:25:54

Like (1)

Report

Re: Using power automate to tag images uploaded into sharepoint using AI builder models

If you manage to create the flow that can create the tag automatically I guess that makes sense but I don't know if that's possible, you can give it a try 🙂

If you are struggling creating that image tag, you can try to ask the question in the "Building flow" section, some flow experts may help you Building Flows - Power Platform Community (microsoft.com)

Let us know how your automation journey is going, I'm curious to see your scenario up and running 🙂
Teflonreis 45 on 02 Sep 2022 at 14:16:17

Like (0)

Report

Re: Using power automate to tag images uploaded into sharepoint using AI builder models

Hi @Antrod

If I want to scale it up for - say 1000 images - I could make the following flows?
1. flow that creates the tag manually
2. throwaway flow to get the defined value in sharepoint "funny format"
3. update items flow where I replace
"Value": "not empty room|4c289689-cce2-4fd1-b40d-dc962a685fc9"

replace with

Does it make sense for 100plus images?
I am inclined to give up on this image library ins sharepoint idea where each uploaded image gets tagged automatically.

Thanks for your help and answers 🙂
Antrod Moderator on 02 Sep 2022 at 14:06:04

Like (1)

Report

Re: Using power automate to tag images uploaded into sharepoint using AI builder models

Hi @Teflonreis ,

Indeed if you try to add a string in the image tags it won't word because it's not recognized by SharePoint. You need to first create your tag manually in your SharePoint library, then create a throwaway flow just to see how SharePoint defined the value for it (See second bullet point in my previous answer) and then you get the name that you value that you will be able to use.

In my case I created in SharePoint the tag "Not empty room" and SharePoint created a value called "Not empty room|a08c1622-..." this is th value you should use in your main flow to file in the image tags in the Update file properties action.
Teflonreis 45 on 02 Sep 2022 at 13:57:34

Like (0)

Report

Re: Using power automate to tag images uploaded into sharepoint using AI builder models

Hi @Antrod

I have a follow up question.
In your workaround, the "image tags value" in "Update files properties" has an interesting format.

In my flow, I tried not adding any tags to my images manually, but with the following flow.
The format and output of the AI builder predict action should be a simple string

The prediction is "no cabling and trays". Inserted it into Update files properties "Image tags" but gives me a formatting error.

But received the error
"The data returned from the tagging UI was not formatted correctly\r\nclientRequestId: a6e2b693-639d-40b1-aef0-c20d13cd3769\r\nserviceRequestId: a6e2b693-639d-40b1-aef0-c20d13cd3769"

Do you have any suggestions?
Thank you so much for the support.
Teflonreis 45 on 31 Aug 2022 at 12:06:54

Like (0)

Report

Re: Using power automate to tag images uploaded into sharepoint using AI builder models

Thanks a lot. Will get back to it with help of your suggestions 😄
Antrod Moderator on 31 Aug 2022 at 12:03:09

Like (1)

Report

Re: Using power automate to tag images uploaded into sharepoint using AI builder models

It should be possible yes, Power Automate is broadly used to process batches of data.

But the best thing is to try it 🙂 You can use the trigger detecting that a file is created in your SharePoint folder and for each file run the AI Builder model and the update file properties.

Let us know if you have more questions!
Teflonreis 45 on 31 Aug 2022 at 11:54:16

Like (0)

Report

Re: Using power automate to tag images uploaded into sharepoint using AI builder models

Hello @Antrod

Thanks for the quick response. Very interesting approach to update file properties in flow!
In the question I am talking about a single image. In real life, I am thinking of hundreds of images and 10 tags per image. From your experience, is it feasable for me in power automate?
Want to automate the tagging process so far that when somebody adds an image, it gets tagged automatically. And I can search it using the search bar.
Verified answer

Antrod Moderator on 31 Aug 2022 at 11:35:52

Like (2)

Report
Re: Using power automate to tag images uploaded into sharepoint using AI builder models

Hi @Teflonreis ,

Thanks for reaching out, very interesting scenario! It's indeed not easy to find how to update image tags in SharePoint from Power Automate. I managed to do it with a little trick:
Go to your SharePoint library, add manually the tag you want to include in the image tags columns, for example "Not empty room":

Run a flow to get the tag value that actually identifies the tag

Then use this value when you need to update file properties in your flow:

Hope that helps!