# New AI architecture: Gladys becomes a real AI agent šŸ¤– **URL:** \ **Category:** ActualitĆ©s\ **Created:** [May 28, 2026, 3:13pm UTC](https://community.gladysassistant.com/t/nouvelle-architecture-ia-gladys-devient-un-vrai-agent-ia/10241 "2026-05-28T15:13:09Z")\ **Posts on this page:** 20\ **Page:** 1
**Author:** ![pierre-gilles](https://gladys-assistant-community.b-cdn.net/user_avatar/community.gladysassistant.com/pierre-gilles/32/5886_2.png) [@pierre-gilles](https://community.gladysassistant.com/u/pierre-gilles)\ **Post date:** [May 28, 2026, 3:13pm UTC](https://community.gladysassistant.com/t/nouvelle-architecture-ia-gladys-devient-un-vrai-agent-ia/10241/1 "2026-05-28T15:13:09Z")
Hi everyone, Since I integrated AI into Gladys, the promise was there but the reality remained limited: you asked a question, the AI answered. One input, one output. No intermediate reasoning, no real autonomy. ![gladys-ai-agent-before](https://gladys-assistant-community.b-cdn.net/uploads/default/original/3X/f/d/fd1713f1a1a7fa05c6d216bf9c16eb2e5c4a3788.png) What Iā€™m announcing today changes all that in depth!! šŸ˜ƒ ### Gladys can now Ā« think Ā» before answering You may know Claude Code, Anthropicā€™s development agent that, faced with a complex problem, breaks it down, iterates, uses tools, adaptsā€¦ until it finds the solution. Itā€™s exactly this model that Iā€™ve applied to Gladys. ![gladys-ai-agent-now](https://gladys-assistant-community.b-cdn.net/uploads/default/original/3X/1/9/19be43489b9b74f295ba745c9fe3ec841102eee9.png) From now on, when you ask Gladys a question, it no longer just tries to formulate an answer. It **acts**. It can chain several tool calls in succession to achieve its goals: - What is the current CO2 level in the living room? - Turn on the living room lights and turn off the fan - Show me my energy consumption over the last month - Create a scene that every morning at 7 a.m., sends me a message with the CO2 level in the living room, the kitchen, and the status of my doors. - Create a scene that, when there is movement in my garage, sends a photo from my camera to the AI, and checks if the car is indeed my red Tesla Model 3. If so, the AI should not respond, otherwise the AI should warn me that an unknown car is there. Requests that would have required several manual manipulations, or that simply didnā€™t work before! This work is partly based on the MCP server developed by @bertrandda, which Iā€™ve integrated into this new architecture! Thanks to him! ### A redesigned interface to be really usable I took the opportunity to completely overhaul the chat interface. Clearer, more fluid, really usable on mobile. ![Capture dā€™eĢcran 2026-05-28 aĢ€ 13.34.31](https://gladys-assistant-community.b-cdn.net/uploads/default/original/3X/d/2/d209f96133a6763d09e54f61d0b7ad7f7b7f77c1.jpeg) ![Capture dā€™eĢcran 2026-05-28 aĢ€ 15.18.15](https://gladys-assistant-community.b-cdn.net/uploads/default/original/3X/2/0/20dd81ce35e1362c4c3eda7bc7b01f14ae2fc285.jpeg) Each tool call is displayed in a readable way in the conversation, so you can understand what Gladys is doing, and you can easily diagnose if something is not going as expected. ![Capture dā€™eĢcran 2026-05-28 aĢ€ 14.05.21](https://gladys-assistant-community.b-cdn.net/uploads/default/original/3X/4/6/469c27134e6c5087d04ea93b6fa889969c618fe4.jpeg) #### Telegram, Nextcloud Talk: it works too Do you use Gladys on the go via Telegram or Nextcloud Talk? The improved agent is also available on these channels. You therefore have access to all this power from your phone, without opening the web interface. ![Capture dā€™eĢcran 2026-05-28 aĢ€ 16.21.08](https://gladys-assistant-community.b-cdn.net/uploads/default/original/3X/0/2/02d8d956b054b41fe8f408e890fd495f7de34c75.jpeg) #### Try it now, itā€™s free First, update Gladys to v4.76.0! Then, you need Gladys Plus. And Iā€™m offering you [1 month of full trial, no credit card](https://gladysassistant.com/fr/plus/?utm_source=forum&utm_campaign=gladys-agent-ia) šŸ™‚ Each account has **3,000 requests per month + 500 image analysis requests**. Thatā€™s more than enough to explore what the agent can do, and Iā€™m curious to read your feedback on what works, what surprises you, and what youā€™d like to see next!! šŸ˜ƒ For the AI model, Iā€™ve reached the limits of Mistral Small 3.2 with this tool, and for now Iā€™ve switched to Gemma 4, still at Scaleway, hosted in France, with your data entirely private šŸ”’ Of course, there may be bugs and Iā€™m open to your feedback šŸ™‚ ---
**Author:** ![pierre-gilles](https://gladys-assistant-community.b-cdn.net/user_avatar/community.gladysassistant.com/pierre-gilles/32/5886_2.png) [@pierre-gilles](https://community.gladysassistant.com/u/pierre-gilles)\ **Post date:** [May 28, 2026, 3:21pm UTC](https://community.gladysassistant.com/t/nouvelle-architecture-ia-gladys-devient-un-vrai-agent-ia/10241/2 "2026-05-28T15:21:57Z")
---
**Author:** ![pierre-gilles](https://gladys-assistant-community.b-cdn.net/user_avatar/community.gladysassistant.com/pierre-gilles/32/5886_2.png) [@pierre-gilles](https://community.gladysassistant.com/u/pierre-gilles)\ **Post date:** [May 28, 2026, 3:28pm UTC](https://community.gladysassistant.com/t/nouvelle-architecture-ia-gladys-devient-un-vrai-agent-ia/10241/3 "2026-05-28T15:28:15Z")
Itā€™s live at my place, everythingā€™s going smoothly šŸ˜Ž ![IMG1756](https://gladys-assistant-community.b-cdn.net/uploads/default/original/3X/9/0/906d14704bfdc9aa229958f13880caca9c9833f5.jpeg) ---
**Author:** ![guim31](https://gladys-assistant-community.b-cdn.net/user_avatar/community.gladysassistant.com/guim31/32/4840_2.png) [@guim31](https://community.gladysassistant.com/u/guim31)\ **Post date:** [May 28, 2026, 3:30pm UTC](https://community.gladysassistant.com/t/nouvelle-architecture-ia-gladys-devient-un-vrai-agent-ia/10241/4 "2026-05-28T15:30:54Z")
Now THATā€™S news!!! I canā€™t wait to try it out!! ---
**Author:** ![b3n.0](https://gladys-assistant-community.b-cdn.net/user_avatar/community.gladysassistant.com/b3n.0/32/3458_2.png) [@b3n.0](https://community.gladysassistant.com/u/b3n.0)\ **Post date:** [May 28, 2026, 3:33pm UTC](https://community.gladysassistant.com/t/nouvelle-architecture-ia-gladys-devient-un-vrai-agent-ia/10241/5 "2026-05-28T15:33:16Z")
ENNNNOOOOOOOOORME Really great! Thanks, Iā€™m a big fan. I just tried it and I think Iā€™m going to multiply the scenes, all those I imagined and was too lazy to do! ---
**Author:** ![pierre-gilles](https://gladys-assistant-community.b-cdn.net/user_avatar/community.gladysassistant.com/pierre-gilles/32/5886_2.png) [@pierre-gilles](https://community.gladysassistant.com/u/pierre-gilles)\ **Post date:** [May 28, 2026, 3:36pm UTC](https://community.gladysassistant.com/t/nouvelle-architecture-ia-gladys-devient-un-vrai-agent-ia/10241/6 "2026-05-28T15:36:10Z")
If you find this cool, we can expand the list of Ā« tools Ā» that the AI can use. For now, the available tools are: - ā€¹ camera.get-image ā€ŗ - ā€¹ scene.create ā€ŗ - ā€¹ scene.start ā€ŗ - ā€¹ device.get-state ā€ŗ - ā€¹ device.turn-on-off ā€ŗ - ā€¹ device.get-history ā€ŗ But honestly, anything is possible, and itā€™s very easy to add. Iā€™m basing this on the work of @bertrandda on the MCP server + the new `scene.create` action that I created myself šŸ™‚ ---
**Author:** ![jparbel](https://gladys-assistant-community.b-cdn.net/letter_avatar_proxy/v4/letter/j/d6d6ee/32.png) [@jparbel](https://community.gladysassistant.com/u/jparbel)\ **Post date:** [May 28, 2026, 4:04pm UTC](https://community.gladysassistant.com/t/nouvelle-architecture-ia-gladys-devient-un-vrai-agent-ia/10241/7 "2026-05-28T16:04:04Z")
Thanks @pierre-gilles I just tested it, it works great. Well done for all the new features of the past few months, youā€™ve been busy. Also thanks to @bertrandda ---
**Author:** ![pierre-gilles](https://gladys-assistant-community.b-cdn.net/user_avatar/community.gladysassistant.com/pierre-gilles/32/5886_2.png) [@pierre-gilles](https://community.gladysassistant.com/u/pierre-gilles)\ **Post date:** [May 28, 2026, 4:07pm UTC](https://community.gladysassistant.com/t/nouvelle-architecture-ia-gladys-devient-un-vrai-agent-ia/10241/8 "2026-05-28T16:07:20Z")
Thanks @jparbel thatā€™s nice šŸ˜Š ---
**Author:** ![guim31](https://gladys-assistant-community.b-cdn.net/user_avatar/community.gladysassistant.com/guim31/32/4840_2.png) [@guim31](https://community.gladysassistant.com/u/guim31)\ **Post date:** [May 28, 2026, 4:11pm UTC](https://community.gladysassistant.com/t/nouvelle-architecture-ia-gladys-devient-un-vrai-agent-ia/10241/9 "2026-05-28T16:11:29Z")
Wow thatā€™s really cool! ![image](https://gladys-assistant-community.b-cdn.net/uploads/default/original/3X/b/9/b9b28e64b4ae061d6ef85ea6ddf9f7f862531a2a.jpeg) But I had a small mishap when creating a scene on my end: ![image](https://gladys-assistant-community.b-cdn.net/uploads/default/original/3X/1/b/1bd22a50bc8612776ca6e6427fd041fb4644b731.jpeg) ---
**Author:** ![pierre-gilles](https://gladys-assistant-community.b-cdn.net/user_avatar/community.gladysassistant.com/pierre-gilles/32/5886_2.png) [@pierre-gilles](https://community.gladysassistant.com/u/pierre-gilles)\ **Post date:** [May 28, 2026, 4:32pm UTC](https://community.gladysassistant.com/t/nouvelle-architecture-ia-gladys-devient-un-vrai-agent-ia/10241/10 "2026-05-28T16:32:11Z")
For scene creation failures, it happens, and I think many of you will have failures on this first draft. What you shared with me is perfect, Iā€™ll try to see where the AI trips up. Iā€™ll then refine the prompt and the schema to make it work! šŸ˜Š ---
**Author:** ![guim31](https://gladys-assistant-community.b-cdn.net/user_avatar/community.gladysassistant.com/guim31/32/4840_2.png) [@guim31](https://community.gladysassistant.com/u/guim31)\ **Post date:** [May 28, 2026, 4:59pm UTC](https://community.gladysassistant.com/t/nouvelle-architecture-ia-gladys-devient-un-vrai-agent-ia/10241/11 "2026-05-28T16:59:57Z")
I asked again with exactly the same Ā« prompt Ā» and the scene was created!! However, instead of the Ā« Send a message Ā» block, it used an Ā« Ask the AI Ā» block ![image](https://gladys-assistant-community.b-cdn.net/uploads/default/original/3X/4/c/4cb2e546823dda668a7bb313c3384db6800254c9.jpeg) ---
**Author:** ![McFlyPartages](https://gladys-assistant-community.b-cdn.net/user_avatar/community.gladysassistant.com/mcflypartages/32/15670_2.png) [@McFlyPartages](https://community.gladysassistant.com/u/McFlyPartages)\ **Post date:** [May 28, 2026, 5:02pm UTC](https://community.gladysassistant.com/t/nouvelle-architecture-ia-gladys-devient-un-vrai-agent-ia/10241/12 "2026-05-28T17:02:27Z")
Hi @pierre-gilles This seems very very promising. A few questions: > [@pierre-gilles](#): > > Creates a scene that every morning at 7 a.m. sends me a message with the CO2 level in the living room, the kitchen, and the status of my doors. ~~Does this mean it can create scenes in Gladys on its own? Or is it directly a scene where it keeps your request? Because in this case, you still need to add a trigger for it.~~ I got my answer in a post above. > [@pierre-gilles](#): > > For the AI model, I have reached the limits of Mistral Small 3.2 with this tool, and for now I have switched to Gemma 4, still at Scaleway, hosted in France, with your data entirely private šŸ”’ Iā€™m not an AI expert, but I donā€™t understand this sentence. Does the AI run on the Scaleway server? Or are the requests only made by this server? Because in this case, itā€™s hitting the cloud of the AI operator, so not really private? In any case, this is very good work. ---
**Author:** ![pierre-gilles](https://gladys-assistant-community.b-cdn.net/user_avatar/community.gladysassistant.com/pierre-gilles/32/5886_2.png) [@pierre-gilles](https://community.gladysassistant.com/u/pierre-gilles)\ **Post date:** [May 28, 2026, 5:37pm UTC](https://community.gladysassistant.com/t/nouvelle-architecture-ia-gladys-devient-un-vrai-agent-ia/10241/13 "2026-05-28T17:37:01Z")
> [@McFlyPartages](#): > > Is the AI running on the Scaleway server? Yes! I only use Open-Weight models, hosted in France at Scaleway ---
**Author:** ![lmilcent](https://gladys-assistant-community.b-cdn.net/user_avatar/community.gladysassistant.com/lmilcent/32/7023_2.png) [@lmilcent](https://community.gladysassistant.com/u/lmilcent)\ **Post date:** [May 28, 2026, 8:40pm UTC](https://community.gladysassistant.com/t/nouvelle-architecture-ia-gladys-devient-un-vrai-agent-ia/10241/14 "2026-05-28T20:40:02Z")
What a great update šŸ¤©! Thanks to @bertrandda for the MCP server and @pierre-gilles for all the efforts and integration! So far, Iā€™ve managed to convince my partner a little bit with the temperature sensors in the houseā€™s rooms, maybe this AI agent will push her over the edge into automation? šŸ˜† ---
**Author:** ![pierre-gilles](https://gladys-assistant-community.b-cdn.net/user_avatar/community.gladysassistant.com/pierre-gilles/32/5886_2.png) [@pierre-gilles](https://community.gladysassistant.com/u/pierre-gilles)\ **Post date:** [May 29, 2026, 2:53pm UTC](https://community.gladysassistant.com/t/nouvelle-architecture-ia-gladys-devient-un-vrai-agent-ia/10241/15 "2026-05-29T14:53:05Z")
With this new AI Agent brick, it unlocks a lot of possibilities. I had fun creating a widget on the home screen that would allow you to send voice commands with one click: [![](https://img.youtube.com/vi/SjpPLeE9IZU/maxresdefault.jpg "Assistant vocal Gladys dĆ©mo") ](https://www.youtube.com/watch?v=SjpPLeE9IZU) Would you be interested in this in Gladys? šŸ˜ƒ ---
**Author:** ![prohand](https://gladys-assistant-community.b-cdn.net/user_avatar/community.gladysassistant.com/prohand/32/15713_2.png) [@prohand](https://community.gladysassistant.com/u/prohand)\ **Post date:** [May 29, 2026, 3:14pm UTC](https://community.gladysassistant.com/t/nouvelle-architecture-ia-gladys-devient-un-vrai-agent-ia/10241/16 "2026-05-29T15:14:19Z")
Great idea for controlling your smart home with your voice šŸ™‚ So it works on mobile and it uses the deviceā€™s microphone on which you launch the web interface, I suppose? ---
**Author:** ![pierre-gilles](https://gladys-assistant-community.b-cdn.net/user_avatar/community.gladysassistant.com/pierre-gilles/32/5886_2.png) [@pierre-gilles](https://community.gladysassistant.com/u/pierre-gilles)\ **Post date:** [May 29, 2026, 3:15pm UTC](https://community.gladysassistant.com/t/nouvelle-architecture-ia-gladys-devient-un-vrai-agent-ia/10241/17 "2026-05-29T15:15:23Z")
> [@prohand](#): > > So it works on mobile and it uses the microphone of the device on which you launch the web interface, I assume? Yes, itā€™s the browserā€™s microphone! ---
**Author:** ![pierre-gilles](https://gladys-assistant-community.b-cdn.net/user_avatar/community.gladysassistant.com/pierre-gilles/32/5886_2.png) [@pierre-gilles](https://community.gladysassistant.com/u/pierre-gilles)\ **Post date:** [May 29, 2026, 3:53pm UTC](https://community.gladysassistant.com/t/nouvelle-architecture-ia-gladys-devient-un-vrai-agent-ia/10241/18 "2026-05-29T15:53:53Z")
I created a dedicated topic: > [@Commande vocale sur le tableau de bord](https://community.gladysassistant.com/t/commande-vocale-sur-le-tableau-de-bord/10244): > > Salut Ć  tous ! La nouvelle brique [Agent IA](https://community.gladysassistant.com/t/nouvelle-architecture-ia-gladys-devient-un-vrai-agent-ia/10241) dĆ©bloque pas mal de choses pour Gladys, et notamment la partie Ā« Commande vocale Ā» devient super intĆ©ressante slight_smile Jā€™ai fais un petit poc que je voulais vous partager : [[Assistant vocal Gladys dĆ©mo] ](https://www.youtube.com/watch?v=SjpPLeE9IZU) Si vous voulez tester, je mets Ć  disposition une image Docker : gladysassistant/gladys:gladys-stt Niveau Speech To Text, jā€™utilise un modĆØle Open-Weight (whisper-large-v3) hĆ©bergĆ© sur Scaleway en France ! Je pense que cette fonctā€¦ ---
**Author:** ![StephaneB](https://gladys-assistant-community.b-cdn.net/user_avatar/community.gladysassistant.com/stephaneb/32/15443_2.png) [@StephaneB](https://community.gladysassistant.com/u/StephaneB)\ **Post date:** [May 29, 2026, 4:16pm UTC](https://community.gladysassistant.com/t/nouvelle-architecture-ia-gladys-devient-un-vrai-agent-ia/10241/19 "2026-05-29T16:16:42Z")
Gotta admit it allows for interesting exchanges, itā€™s cool! I just tried it: ![IMG7211](https://gladys-assistant-community.b-cdn.net/uploads/default/original/3X/a/3/a3ab465b50ceaa6cda9a9e413ebca3b63f258367.jpeg) Well, itā€™s not great in terms of reactivity, the answer came 40 seconds after the question šŸ„² (and I did other tests with the same kind of delayā€¦) Is this due to the power of my mini-pc? Or is it inherent to the different data exchanges and reasoning steps with the AI server, and therefore I canā€™t do anything about it? ---
**Author:** ![pierre-gilles](https://gladys-assistant-community.b-cdn.net/user_avatar/community.gladysassistant.com/pierre-gilles/32/5886_2.png) [@pierre-gilles](https://community.gladysassistant.com/u/pierre-gilles)\ **Post date:** [May 29, 2026, 4:23pm UTC](https://community.gladysassistant.com/t/nouvelle-architecture-ia-gladys-devient-un-vrai-agent-ia/10241/20 "2026-05-29T16:23:54Z")
> [@StephaneB](#): > > Is this due to the power of my mini-PC? Or is it inherent to the different data exchanges and reasoning steps with the AI server? No, itā€™s due to the different steps, but itā€™s true that on Telegram, you donā€™t see the steps as you do on the web! I could send the steps on Telegram to make it clearer. [Next page](https://community.gladysassistant.com/t/nouvelle-architecture-ia-gladys-devient-un-vrai-agent-ia/10241.md?page=2)