Gladys Assistant 4.48: Proactive AI arrives in Gladys Assistant!

@laguiche it’s an image taken when the scene was triggered :slight_smile:

I can’t stop getting a message.
I get a Telegram every minute with a message saying that no car is detected.

Triggers

Device state change
Camera Ext (Presence)
Run the scene after the condition has been valid for: 1 min

Actions

Ask the AI:
If you see a blue Renault ZOE with a license plate that ends with ZS, notify me that the ZOE is arriving, otherwise do not notify me
Attach an image
Input

No image received

Netatmo Presence Camera (with presence detection and recognition of vehicles, people, animals, objects)

So you’re not crazy, this feature isn’t live in production yet :smiley:

This development required two components:

  • A local component, to handle ChatGPT replies of the « No response » type, and do nothing
  • A Gladys Plus / ChatGPT-side component to handle this new type of reply in « No response » mode

Version 4.49 deployed the local component:

(It’s in the release notes: Gladys Assistant 4.49 : Déclencheurs avec délai dans les scènes! )

But I was waiting for 4.49 to be widely rolled out before deploying the Gladys Plus component, otherwise it could cause issues if ChatGPT responded in « no response » mode while the client didn’t handle it.

I’ll do that deployment on Friday! I’ll keep you posted

Yes, that reassures me :exploding_head:

Hi everyone!

In the scene action « Ask the AI », it is now possible to not have any responses!!

For example, you can ask the AI to analyze a camera image, and only notify you if there’s an issue:

You can also ask the AI to analyze sensor values:

In short, anything is possible!!

You now have an AI available in your home that can silently monitor your place until it detects a problem :wink:

I’m curious to know what you’ll do with this feature — feel free to tell me what you’ve set up!

Hello @pierre-gilles
I’m using a scene with the AI,

at the end of this action we see

does this mean that the AI uses this camera only to make its comment, or does it also send an image from the camera in question along with the comment?
Thanks for the answer :wink:

Hi @Psoy !

Good question, it means the AI uses that camera only to make its comment.

If you want to receive the image by message, you need to add a « Send a camera image » block :slight_smile:

Hi @pierre-gilles,

I’m bumping this thread but I hadn’t really looked into AI until now..

I see all the prompts you make and they look great but when I try simple prompts they don’t work:

Hi, none of the prompts you tested are part of the features available right now :smiley:

The list of available features is here:

Edit : For the bathroom temperature, that should work. Are you sure of the room name and that you have a temperature sensor in that room?

However, for me the real strength of AI in Gladys lies in scenes rather than live control.

You can send a camera image in scenes, or a complex prompt based on sensor values, and have a continuous analysis of a situation, with possible control « IF situation XX occurs, THEN do this », or « IF you see this situation THEN notify me, otherwise do nothing »

OK I see, thanks.

For the bathroom, yes I have a sensor:


I managed, but it’s not practical:

Maybe a silly question, but… do you have Gladys Plus?

I just tested it, and indeed you have to insist. Actually, it’s not a prompt issue, but rather that ChatGPT hallucinates.

One minute apart, with the exact same prompt:

![Screenshot 2025-10-09 at 11.12.33|690x375](upload://b