IA & micro dans Gladys plus

Hello,

I am taking the liberty of creating a topic to share my questions and suggestions after a few days of using this very practical service:

  • Can the default AI be modified? (in the discussion tab and/or Telegram, the « auto » model never answers my simple questions)
  • Can the microphone be manually turned off? (if there is background noise, it often doesn’t stop)
  • Suggestion: Put users, Gladys Plus user management, and remote users in the same tab (or make it easier to create a new user)

Thanks!

@Damien I unfortunately won’t be able to answer all of that, but thanks for the questions :slight_smile:
However, I’ve modified your title and category to make it clearer.

And you should make a feature request for your suggestion, that way it separates the help you might need and future functions.

I have a suggestion:

  • be able to change the size of the « voice assistant » widget :slight_smile:

Hi @Damien,

Thanks for your feedback! I’ll address each point one by one. I think these are mostly settings that aren’t necessarily easy to find :slightly_smiling_face:

1. Change the default AI

I’d like to understand what you mean by « never respond ». Can you give me 2-3 examples of questions, and exactly what Gladys responds? Nothing at all, the message « The request to the Artificial Intelligence API failed », or an off-topic answer?

2. Stop the microphone manually

Yes, it’s possible: during listening, the round button of the widget displays « Stop », just click on it (same with the microphone button of the Discussion tab). Be careful, this cancels the request: what has been recorded is not sent.

Otherwise, the recording stops automatically as soon as you stay silent for more than a second. In all cases, it stops after 30 seconds, and then what you said is sent. Gladys measures the ambient noise before you speak to adapt to it. But a strong and continuous background noise (TV, music, hood…) can prevent it from detecting the silence, hence what you observe. Speaking closer to the microphone helps a lot.

3. The users

I understand the confusion, but these are 3 different things:

  • Settings → Users: the accounts of your Gladys instance, at home (name, language, role, Telegram…). This is where you create a new user.
  • Settings → Plus Users (visible only when you go through plus.gladysassistant.com): the Gladys Plus accounts, i.e. the people who can access remotely. This is where you invite someone by email.
  • Settings → Gladys Plus → Remote Users: the security step. You validate, from home, the encryption keys of each Gladys Plus user. This is intentionally separate: even our servers cannot give access to your home without this local validation.

To give remote access to someone, the order is therefore:

  1. Create their account in Users.
  2. Invite them in Plus Users.
  3. Once their Gladys Plus account is created, authorize them locally in Gladys Plus → Remote Users.
  4. At their first connection to Gladys Plus, they choose which Gladys user to link their account to.

Maybe you wanted to say that we could improve the user experience of adding a user?

4. Size of the « Voice Assistant » widget

The width is already adjustable with the dashboard layout. In edit mode, you can create sections of 1 to 6 columns, and make a column « wide » with the button next to the trash can, at the top of the column. To have a smaller widget, put it in a section with more columns, or in a normal column next to a wide column. The height, however, is not adjustable for now.

Let me know if this answers your questions!

Thank you for taking the time to look at these points in detail.

  1. Default AI. Here is an example:

The « auto » model most often responds to a simple temperature or humidity request, where other models always respond precisely (I have IKEA timmerflotte sensors).

  1. Manually stopping the microphone

Indeed, I would like to be able to press the stop button when I finish talking to it. I will try to speak closer to the microphone to avoid ambient noise.

  1. Users

With your clarifications, I understand the differences between these different pages well, but indeed, I think the experience when adding a user can be optimized.

  1. Size of the « Voice Assistant » widget: you answered perfectly, thank you!

Thanks for the screenshot, it’s perfect: you can see exactly what’s happening, and it’s not you, it’s a bug on our end :slightly_smiling_face:

1. The AI in « Auto »

In your screenshot, the AI correctly calls the tool that reads your sensors, but with "room": "No room". « No room » is a special room in Gladys: it groups devices that are not placed in any room. The model used in « Auto » understands this as « no specific room = the whole house ». Gladys therefore only looks among devices without a room. It doesn’t find any humidity sensors there, and the AI concludes that there are none in the house. The other models leave this field empty, and correctly read all your sensors.

I will fix this on Gladys’ side so that this trap no longer exists. In the meantime, you can:

  • choose another model in the « AI Model » menu (be careful, it reverts to « Auto » when you reload the page, and Telegram always stays in « Auto ») ;
  • specify the room in your question, for example « what is the humidity in the living room ? ».

2. The « Stop » button

Good point: when you press « Stop » during listening, it would make more sense to send what you said rather than cancel everything. I’ll look into changing that.

3. Users

Great, glad it’s clearer! For the improvement of adding a user, you can create a feature request, as suggested by @mutmut, by describing how you would have liked it to work? This allows others to discuss and vote.

4. Widget size

Perfect :+1:

that was the initial suggestion: that we could choose the default AI model from those offered with Gladys in the settings

Hi everyone!

This topic is now in development.

A PR has been opened to send the voice recording when you press the button while listening:

Feel free to follow the PR, test (optional, especially for small requests) and give your feedback here if needed.

Hi everyone!

This topic is now in development.

A PR has been opened to stop « whole house » readings from filtering on « No room »:

Don’t hesitate to follow the PR, test (optional, especially for small requests) and give your feedback here if needed.

I understand the idea, but I don’t plan to add this setting, and it’s intentional: the « Auto » mode exists to optimize the cost and speed of requests.

In « Auto », Gladys Plus uses:

  • mistral-small-3.2-24b-instruct-2506 for simple queries (turning on a light, reading a sensor, asking for the weather…);
  • qwen3.5-397b-a17b for creating scenes, which requires more reasoning.

Setting another model as default would mean using a more expensive and slower model to turn on a simple light bulb, whereas Mistral Small does this very well.

Here’s the pricing grid that I pay for inference:

Source: Model-as-a-service Solutions Pricing | Scaleway

The Plus subscription costs €8.33 per month, and it also funds remote access, backups, and voice. Routing all requests through a more expensive model is not economically sustainable: it would require increasing the price of the Plus subscription!

The other models in the menu are mainly there for testing: preparing the next « default » model if prices change, or comparing the behavior of several models when looking for a bug. If I suggested choosing a more powerful one earlier, it was only to help you out until the fix. The goal remains to have « Auto » as the sole default model.

And in your case, it’s not a lack of model power: it’s the « No room » bug I mentioned earlier. Once fixed, the « Auto » mode should correctly answer your questions about temperature and humidity.

If you still want a more powerful model, it’s possible since version 5.3 with your own API key. Install an AI provider integration (there’s already a Claude integration in the catalog, for example), then select it in Integrations → Artificial Intelligence → AI Provider. You then choose the model you want in the integration settings, and it is used everywhere: the Discussion, Telegram, and the « Ask AI » scenes. Requests are then billed directly by this provider.

@pierre-gilles, re-reading that…

… step 4 surprises me, and I had never paid attention to it: does this mean that a Gladys Plus user connecting for the first time can choose to use any local Gladys account rather than the one I created for them? Shouldn’t this be chosen by the admin in step 2?

Currently yes, the reasoning was that on the instance you « trust » others in your family, but it’s true that we can do better!

That’s a very good idea! :smiley:

Do you need me to make a feature request for that?

No, no need, I’ll take care of it this morning :slight_smile:

Anything that can help improve the understanding/UX of Gladys Plus is super important feedback!

So I’ll take advantage of this. In Gladys Plus, I’ve already thought that we should:

  • be notified when several consecutive nightly backups fail (one night without a backup can be a one-time issue and it’s not a big deal)
  • have a way to reset the 2FA without having to go through you

Everything is live in v5.3.1: