Gladys Assistant 4.77: A voice assistant in Gladys 🎙️

[pierre-gilles]

A new version of Gladys is available with several nice improvements

New Voice Assistant Widget

You can now add a Voice Assistant widget directly to your dashboard.

Démonstration Assistant Vocal Gladys Assistant 4.77

Practical on a wall-mounted tablet, a smartphone

I’m open to your feedback, it’s primarily a first proof of concept that could evolve to include more voices in Gladys if you find it useful!

I wonder if it wouldn’t be practical to have an open route in the Gladys Plus API to also trigger this mechanism from a Tasker on Android / Shortcuts on iOS.

Gauge Widget: Customizable Color Thresholds

Thanks to the contribution of @Terdious, the Gauge widget becomes even more flexible.

It is now possible to define customizable color thresholds to instantly visualize if a value is in a low, normal, or critical range.

Perfect for monitoring temperatures, humidity, electricity consumption, or any other important indicator.

System Log Download

Troubleshooting a problem becomes easier.

A new button now allows you to easily download system logs from Gladys settings, making it easier to share information when requesting assistance.

Tuya Integration Improvements

The Tuya integration continues to progress thanks to the work of @Terdious:

• Local support for Tuya 3.4 protocol
• Local support for Tuya 3.5 protocol
• Various stability and compatibility improvements

Great news for Tuya device users who want to keep local control of their equipment.

Full Changelog

Comparing v4.76.0...v4.77.0 · GladysAssistant/Gladys

Happy updating to everyone!

[guim31]

Small issue with the video @pierre-gilles

[pierre-gilles]

Oh bother, I had scheduled it for tonight so it had changed from « Unlisted » to « Private until published ».

I made it public instead

[guim31]

These improvements are so great, I love the gauges, they’re going to be very useful for me!!

[pierre-gilles]

I’m introducing the voice assistant in a YouTube video

Alexa est officiellement dépassée : voici le futur

If you test it, give me your feedback, I’m open to suggestions to improve the assistant!!

[guim31]

I just tried the voice assistant, it’s so cool!!

A few remarks:

• The assistant can’t pronounce temperatures correctly. Every time I ask, it displays the right value, but the voice says something barely understandable.
• I think the widget’s UI looks a bit out of place (I think the blue background is intentional) but what bothers me is the gradient of the button to speak, it looks like an Apple icon while the rest of the design is rather flat.

That’s it for my first tests!! Great job, this feature is really a added value. Both a very practical thing, but also a good marketing tool in my opinion!

[pierre-gilles]

Thanks for the tests @guim31!

@guim31

the assistant doesn’t pronounce temperatures correctly.

I’ve also noticed that the TTS API regularly gets the units wrong (ppm, °C, etc.). I think it’s because I’m using a « flash » model that’s optimized for latency:

I chose this model because it’s ultra-responsive, which is nice for a voice assistant.

The other models are probably more accurate, but less fast.

I’m following the developments, I’m sure we’ll have a Flash 3.5 that’s more accurate soon

@guim31

but what bothers me is the gradient of the button to speak, it looks like an icon from Apple while the rest of the design is rather flat.

Ok thanks for the feedback I find it rather nice myself, but you’re right, it’s a bit different from the rest of the interface!

@guim31

great job, it’s really an added value this feature. Both a very practical thing, but also a good marketing tool in my opinion!

Thanks! Yes, the idea is also to show that we’re not at all behind on these current topics. On the contrary, I think we’re rather ahead.

I want the public to understand that Gladys is today a complete solution, which fully takes advantage of the AI revolution we are experiencing.

In any case, the start of the video on YouTube is excellent, so I think I hit the mark with this feature!

[Jluc]

My computer doesn’t have an activated microphone, and when I click to speak, the AI goes into standby mode and I can no longer interrupt the process. After a few minutes, the AI provides various tips in English to try to capture the message.

[pierre-gilles]

Thanks for the feedback, I hadn’t thought of that case

I made two changes:

• The « Speak » button becomes « Stop » while speaking, to allow manually stopping the recognition

• If no voice is detected, an error message appears instead of sending an empty recording to the AI:

Voice Assistant: Add stop button & microphone detection (#2554)

This will be included in the next version of Gladys!