Hi everyone 
This is a topic I’ve wanted to do for a long time, especially the « Ask the AI a question from scenes » part (even without an image) to be able to receive proactive notifications from the AI (futuristic!)
Since I was working on the ChatGPT part this morning I developed this feature, which wasn’t very complicated with the new vision API of GPT-4o mini
Ask the AI to describe a camera image
In a scene, it becomes possible to ask the AI to react to a camera image:
Which then sends me a notification to my phone; for example, here there was nothing on the camera:
Ask the AI to take an action based on a camera
If we go further, it’s possible to take the garage camera and react based on the car that just arrived:
I took an image from the internet of a garage with this exact car, and I get:
Now, let’s change the car description:
This time, the AI understands what’s happening and warns me:
This is pretty crazy!!!
The possibilities are endless
This feature is quite futuristic, and since it’s possible to inject variables into the message, it enables a lot of things
- Analyze the day’s weather report and write me a short summary sent to my phone every morning at 8 AM
- If the alarm goes off at my house, create a message that summarizes what’s happening: sensor states, image analysis, etc.. — all combined into a single message!
- Analysis of any image, whether the image comes from a camera at my home or from an online stream — everything is possible
- and many more!!
What do you think?
Edit: Posted on Twitter here