Gladys Assistant 4.80: Matter, Netatmo, Tuya and AI 🚀

[pierre-gilles]

Hello everyone!

Lots of new features lately

This version 4.80 brings many stability improvements, fixes for Matter, Netatmo, and Tuya, as well as several new features around AI.

AI

The AI agent continues to improve with two new features:

• Added a new tool sensor.set-state, allowing the agent to directly modify the state of certain sensors when requested. For example, you can use the AI to read an image from a camera looking at a meter, and store the value read from the image in a virtual device. You can also automatically read a license plate and store the read number in a virtual device!

• Added a button to download the AI debugging context in JSON format, making it easier to diagnose issues and communicate with the community.

The weekly reports generated by the AI now appear in the background tasks (Settings → Tasks), allowing you to track their execution and easily identify any potential errors. A random delay has also been added before their generation to avoid simultaneous server overload.

Matter

This version further improves Matter compatibility:

• Added local temperature reporting on compatible devices.
• More robust connection process.
• Enhanced logs for easier debugging.
• Several fixes on Matter fans.
• Fixed a bug where a device’s unique identifier was changed during its update.
• Reading the initial state of device features on startup.
• Errors during device registration are now displayed directly in the interface.

Matter.js has also been updated to version 0.17.3, which is a major advancement, bringing:

• Support for the Matter 1.5 / 1.5.1 specification, improving compatibility with the latest devices.
• A reduction in memory consumption of 20 to 50%, allowing Gladys to run even more smoothly.

Integrations

Tuya

The Tuya integration continues to mature:

• New common mapping layer to improve device management in local and cloud modes.
• Added an assistant to automatically create a GitHub ticket when a device is partially or not supported.

Netatmo

Two important improvements have been made:

• Restoration of automatic OAuth token refresh.
• More resilient automatic reconnection in case of authentication errors, including during business API calls.

Zigbee2MQTT

Zigbee devices now display their IEEE address as well as a direct link to open the device in Zigbee2MQTT, making diagnosis and configuration easier. Don’t forget to add the URL of your Zigbee2MQTT interface in the settings to use this feature

Bug Fixes

This version also fixes several issues:

• Fixed a bug on scenes using the next sunrise trigger.
• Fixed an issue preventing device backup when energy_parent_id was invalid.

Thanks to Contributors

A big thank you to everyone who contributed to this version: @cicoub13, @Terdious, and @Will_71.

And thank you to the entire Gladys community for your feedback, testing, and contributions that help the project continue to move forward quickly!

As always, Gladys will update automatically within 24 hours if you use Watchtower, otherwise you can do it with one click in the settings.

Don’t forget to set up Telegram to receive an alert on your phone when Gladys updates!

See the full release notes.

[pierre-gilles]

For anyone experiencing unsatisfactory AI responses, please feel free to send me the AI debug JSON in a private message right after the relevant conversation. This really helps me debug and improve the prompt!

@mutmut I think you had some issues last week?

[mutmut]

A big round of applause for this fantastic update, guys

@pierre-gilles

@mutmut I think you had some issues last week?

Yes, I should retest to check, but when I look at the weekly report, it seems correct (well, I think so) and very clear.

@pierre-gilles

Don’t forget to add the URL of your Zigbee2mqtt interface in the settings to take advantage of this feature

I have an issue because I don’t see where I need to enter this, even though I think I had it before (unless I’m crazy) (I have an existing installation):

And so I have nothing for the addresses in all my devices:

[prohand]

I also looked for it and found it.
You need to click on Modify here:

And you will be able to fill in here:

[Will_71]

@mutmut on my end I had to restart Gladys for the update to be applied

[mutmut]

Thanks @Will_71, after restarting Gladys, the new field to fill in that @prohand shows has appeared. It’s strange that the update via Gladys didn’t automatically show this field. The links are present on my devices, and I see that I have 2 that no longer have a link (old modules removed), a bit of cleaning will do some good