Gladys Assistant 4.79: Smarter AI, Enhanced Voice Assistant and More Matter Devices

Hello everyone,

The v4.79 version of Gladys is out :slight_smile:

:robot: Artificial Intelligence

This version brings several improvements to the AI agent:

  • Scene creation: Schema correction + timeout increase to fix a scene creation bug reported by @GBoulvin and @Jluc.
  • Better error handling: clearer feedback when the AI does not respond.
  • Tool calls via Telegram: On Telegram, you can now see tool calls as on the web

  • New tools:
    • Web Request: the agent can query APIs or web pages. This is a personal need that I implemented, and it’s ultra convenient!
    • Compare Times: time comparison

These new tools allow you to do very powerful things, for example, fetch the opening hours of a business and tell you if the business is currently open! Super convenient in scenes via the « Ask the AI » action.

The possibilities are endless!


:studio_microphone: Voice Assistant

  • Stop button to interrupt an ongoing response.
  • Microphone detection: If no sound has been recorded, Gladys displays an error message.

:house: Matter

Extended support for new types of devices:

  • Vacuum cleaners
  • NO₂ sensors (nitrogen dioxide index)
  • Fans

:satellite_antenna: Zigbee2mqtt

  • Update to Zigbee2mqtt 2.12.0
  • Support for the SONOFF SNZB-01M remote control (4 buttons)

:wrench: Node-RED

  • Version selector to switch to a major version of Node-RED directly from the Gladys interface.

Convenient for switching to v5 which has just been released!

:warning: Be careful, make sure the modules you use are compatible with v5!


:clapper_board: Scenes

  • Expanded value field for sensor thresholds
  • Back button to navigate more easily in the scene editor.

:cloud: Gladys Plus

  • When a remote user is deleted on Gladys Plus, the corresponding local user is automatically deleted on your instance.

:clipboard: Full Changelog

As always, the update is automatic within 24 hours if you use Watchtower, or you can do it manually by going to « Settings » → « System ».

Happy updating everyone! :tada:

Little test via Telegram and there seems to be an issue, it seems :thinking:


And the AI creating a scene without me asking, I find that more than questionable :face_with_steam_from_nose:

EDIT: in the end, no scene was created

Thanks for the feedback! I’ll try to reproduce it. Sometimes the AI doesn’t feel the need to call the tools at its disposal. I think the fact that it’s a « pump » isn’t a word that fits in the lexical field of things to turn on/off like a light, that must play a role :grinning_face_with_smiling_eyes:

The AI worked perfectly fine in 4.78:


However, tonight before upgrading to 4.79, the AI did some weird things and stopped working, even though at 1:00 PM I was able to start it without any issues and no debug logs:

Regarding Matter, I do have the updates for NO2 and the fan, thank you! :smiling_face:
However, I see ‹ Add to Gladys › even though the services already exist and have the exact same name.

When I click on Add, it updates device 28 with the NO2 (and therefore not a new service) but I can’t do the same for 27, nothing happens.

There are some weird things with the AI’s answers today or maybe my question wasn’t clear :flushed_face:

I don’t think this is related to 4.79, I also made changes on the Gladys Plus server side!

Before I was using exclusively Gemma 4 as a model, and now I’m using a mix of Gemma 4 for image analysis, and Mistral Small 3.2 for text.

The reason is that Gemma 4 hallucinates quite a bit, more than Mistral, but Mistral is less good at analyzing images.

I think I’ll have to retest with other models to find a more versatile model :slightly_smiling_face:

I need to create a dataset of examples to run my tests and evaluate the performance of a model in the case of Gladys.

Regarding your feedback on Matter, I don’t have the answer right now :slightly_smiling_face: I’ll let you know when I’ve had a chance to look into it!