Unanswered

Analyze Video Stream of a cam

(0) Share

Report

Posted on by Ingo67

Hi.

I am able to get video stream from the devices cam with help of "camera1.stream". Now I want to detect, if a Light (centered in the middle of the image) is switched on or of. Is this possible (e. g. with help of Flow or else)?

best regards

Categories:

Building Power Apps

I have the same question (0)

All responses (3)

Answers (0)

rubin_boer 4,841 Super User 2024 Season 1 on at

Like (0)

Report

hi there @Ingo67 , short answer is yes, it is possible. the image detection can be done using ai builder or azure cognitive services. About your use case how often do you wish to run the check? you could store the images with a time stamp and run some analysis on those images.

Steps to get this done

1. capture the stream and store it

2. analyze the images with object identification (python's OpenCV is you wish to do go this way or azure teaching the model what an image with light ON looks like and one with light OFF)

3. Run the analysis

Power Apps will be a small component of this solution, Power Automate will do the heavy lifting.

Maybe someone here has done something like this, if not its an interesting one using PowerApps as the capturing app and i will look into it for you. how different does the light on/off images look like?

Regards

Was this reply helpful? Yes No
Ingo67 2 on at

Like (0)

Report

Hi rubin_boer.

Thank you for the fast response.
I need to analyze the videostrem of the cam on the fly (live in seconds). So I do not want to store any image. Would that be possible too?

Was this reply helpful? Yes No
rubin_boer 4,841 Super User 2024 Season 1 on at

Like (0)

Report

hi @Ingo67 PowerApps (or my knowledge thereof) is a bit limited to do this kind of analysis in the app without using azure or ai builder.
having said that if you can isolate the image to have the colors as just blue (i assume a blue can be zoomed into when light is off) for on and white for light on then you can convert those images every 5 seconds in power apps.

Lets get the strings for 3 images:

Base: Set(_JSON,JSON(Image2.Image,JSONFormat.IncludeBinaryData));
Compare1: Set(_JSON2,JSON(Image2_1.Image,JSONFormat.IncludeBinaryData));
Compare2: Set(_JSON3,JSON(Image2_2.Image,JSONFormat.IncludeBinaryData))

Assume base is the blue you can compare the json string of the others to blue. note these are single color comparisons.

Image 1 (Light is on)

Image 2 (light is off)

Image 3 (something else)

Json strings

Check the images

Set(_Check1,ForAll(Sequence(Len(JSON_Label.Text),1),{checkval:If(Mid(_JSON,Value,1)=Mid(_JSON2,Value,1),1,0)}));
Set(_Check2,ForAll(Sequence(Len(JSON_Label.Text),1),{checkval:If(Mid(_JSON,Value,1)=Mid(_JSON3,Value,1),1,0)}))

Blue image = 63.64% (light ison)

Mixed Images = 59.68% (something else - maybe cam moved)

White image: 100% light is on

Its not the cleanest but it will work if you get to isolate the colors. Maybe you can work with this or someone else can give more insight.

Was this reply helpful? Yes No