Model your house in 3D and integrate it into Gladys Assistant

Feature requests
1

Hello everyone!

I just came across this very interesting video on Home Assistant :

They show a 3D representation of the house as a dashboard, and I find it really nice for visualizing your home automation setup.

I wanted to know:

  • Does this feature already exist on Gladys Assistant?

  • Or, would it be possible to develop it in the future?

**Thanks in advance for

2

Hi @WaFid !

Great idea — I think it was discussed a long time ago but it wasn’t a priority, logically we needed more integrations first.

Now that Gladys is mature and getting more and more visibility, it’s worth proposing the feature. It’s still a big job to develop something high-quality and easy to use. Do you have any ideas about how this could take shape in Gladys? How would you imagine it?

Having very detailed requests with sometimes initial proposals like diagrams is super useful to start discussing the topic. @pierre-gilles can then give his opinion and reuse the work to develop the feature. And as he says so well, it’s almost the biggest part of the job: thinking about what exactly, how it’s used, what the practical cases are, the usage scenarios, etc.

Even without being a developer you can help with that!

3

Yes, you’re right, I’ll try to think about it but it seems insurmountable lol.

4

Hello everyone,

So I asked ChatGPT how it could help me achieve this… I imagine that not even having my Gladys Assistant yet, some might think I’m getting ahead of myself… you’re probably right, but when I have an idea in my head, it’s hard for me to stop :slight_smile:.

:backhand_index_pointing_right: Goal

Create an external 3D web interface (outside the Gladys dashboard) representing a house/apartment, synchronized with Gladys via its APIs, allowing for example:

  • visualize lights that are on directly in the 3D house

  • click on a lamp in the 3D to turn it on / off

  • display the real state of devices in real time

:warning: Important :

  • this project is not intended to be integrated into the Gladys dashboard

  • it does not involve any modification of the core

  • Gladys would remain only the home automation brain, the 3D being a simple graphical client

:brick: Technical principle (high level)

  • 3D model of the house (Sweet Home 3D / Blender, export glTF)

  • Web page using three.js

  • Connection to Gladys via:

    • REST API (reading/commanding devices)

    • optionally MQTT for real-time sync

  • Display on a wall tablet or browser

:backhand_index_pointing_right: As far as I know, Gladys does not offer a native 3D floorplan, but its APIs make this type of project possible without complicating the system core.

I can’t confirm the existence of an equivalent turnkey project for Gladys today; the idea would therefore be more of an experimental community repo, for those who find it fun or interesting.

:red_question_mark: Questions to the community

  • Would this type of 3D interface interest you?

  • Would some be willing to:

    • think about the architecture?

    • test a POC?

    • contribute on the JS / MQTT side?

The goal is not photorealism, but a “wow” visual tool, optional, with no impact on Gladys stability.

Thanks for your feedback :slightly_smiling_face:

:world_map: Community roadmap (realistic)

:bullseye: Vision

An optional, independent 3D web client, capable of:

  • reading Gladys states

  • sending commands

  • visually representing the house

:green_circle: Phase 1 — MVP (simple and achievable)

Goal: prove that it works

  • 1 room

  • 1 light ON/OFF

  • REST API only (polling every 2–5 s)

  • Very simple 3D model (cube/room)

  • Local hosting

:check_mark: Expected result:

When the light is ON in Gladys → it lights up in the 3D

When I click in the 3D → Gladys receives the command

:yellow_circle: Phase 2 — Usable daily

Goal: make it pleasant

  • Multiple rooms

  • Multiple lights

  • Brightness control

  • Clear mapping:

    • 3D object ⇄ Gladys device_feature

  • Tablet-responsive interface

:blue_circle: Phase 3 — Real-time & immersion

Goal: fluidity

  • Switch to MQTT for instant sync

  • Smooth transition animations

  • Hue color handling

  • Visual states (off / on / dimming)

:purple_circle: Phase 4 — Community opening

Goal: adoption

  • Public GitHub repo

  • Clear README (installation, mapping, limits)

  • Examples of 3D models

  • Possible contributions:

    • UI

    • perf

    • accessibility

:warning: Assumed limitations (to be clearly displayed)

  • :cross_mark: not integrated with Gladys

  • :cross_mark: not official support

  • :cross_mark: requires web / JS basics

  • :cross_mark: community maintenance

:brain: Philosophy (aligned with Gladys)

Keep Gladys simple, robust and readable,

and allow those who want to go further to do so without weighing down the core,

5

Good idea to also think this through with ChatGPT, so it’s more concrete on how to clearly define the need — use this post as inspiration: https

6

If it can help, to give some pointers, I started this thread a few years ago already! Time flies!!

1 Like