OpenAI GPT-3 AI available in Gladys Assistant 🤯

[jparbel]

The answers are a bit off, to say the least!

We stopped 6 in 3 min!!

[guim31]

It’s simply because it’s not within this system’s area of expertise.
The point is to show understanding of complex things: data in a particular context, language that is very understandable and relevant.

Ask it to explain a concept to you: what is war / what is inflation / etc…
The answers are almost always VERY relevant and very clear.
Then you ask it to explain again as if you were a child… And that’s astonishing!

[jparbel]

@guim31
I completely agree with you, but I did want to test the system’s limits.
What « bothers » me is that a response is given anyway, even if wrong, rather than answering ‹ I don’t know ›

[cce66]

In short, this AI is ready to throw itself into politics…or maybe it’s already writing the speeches of those who govern us !!

[jparbel]

@cce66
You mean we’re in the middle of ultracrepidarianism?

[cce66]

@jparbel

ultracrepidarianism

Absolutely, and it would surely be tinged with verbal logorrhea if she also had the ability to speak

[tiboys]

@jparbel

ultracrepidarianism

That’s not wrong!

[pierre-gilles]

Thanks everyone for testing, I hope you like this integration!

I have a question for everyone here regarding the next step of this development.

For me the next step is to add device control to the integration.

Which commands do you want in this integration?

Commands can be to perform an action in Gladys, or to request information from Gladys.

In the case of a request for information coming from Gladys, I will make a clear authorization button so that the user can authorize, if they want, this integration to use information coming from Gladys (for example if the user says « give me the living room temperature », the information has to come from somewhere, that’s the kind of info I’m talking about)

@jparbel

We stopped 6 in 3 min!!

The data is not « live »; GPT-3 was trained on a fixed dataset dating from 2021.

Nothing related to current events or highly variable information will come out well from GPT-3 (at least the current version of GPT-3. Maybe with GPT-4… )

As for our use in Gladys: text understanding and classification of home automation commands + « basic conversations » + « simple everyday questions » + « historical/philosophical questions », I find that it’s fantastic!

[tiboys]

Great job.

For me they would be switch commands, scene triggers, information retrieval (device value, temperature, camera, ..).

Coupled with Telegram, that would be practical.
Thank you for all this work

[Terdious]

First of all, thanks @pierre-gilles for this integration. I think at least a few of us had thought about this possibility, but didn’t expect it to happen so quickly without even having had time to talk about it ^^ Well done.

@pierre-gilles

Which commands do you want in this integration?

For the first step:

• Commands,
• Information coming from Gladys. Authorization by button seems fine to me; it just needs to be clear for those who, rightly, are wary or want to fully manage their personal information. On your side it must not be able to cause you problems in the future, though, as @Phil says

@Phil

but what about sending personal data to a computer system not hosted in France / Europe? If a user requests the application of the GDPR (yes I’m playing devil’s advocate, but these are questions better asked beforehand) … and therefore requests all the personal data held by Gladys …

• Previously sent external information.

For a possible 2nd step:

• Trigger scenes as suggested by @tiboys.

For a possible 3rd or 5th step ^^:

• Keep a personalized context if possible (in a database?) to replace « Groups » the Alexa way. I’ll explain with an example:
  • ‹ The « Bedroom1 » belongs to the groups « GroundFloor », « Bedrooms » and « Dry rooms » › and that it integrates it by default without anything else.
  • The day you need to modify:
    • ‹ Can you tell me which groups the room « Bedroom1 » belongs to ›,
    • answer: ‹ « Bedroom1 » belongs to the groups « GroundFloor », « Bedrooms » and « Dry rooms » ›,
    • request: ‹ Ok modify all these groups by adding « Bedroom2 » ›
• Perform configuration actions in Gladys (with a message advising to make a backup beforehand ^^), for example creating or modifying scenes as suggested by @guim31.

Questions:

• When we start a conversation, is it like in ChatGPT where our discussion becomes part of the context? Or for each request are previous answers omitted and only the context you provided remains?
• Currently past conversations are automatically deleted (I don’t know the timing). Will that always be the case? Can we consider a button to clear the history? Can we consider multiple chat rooms with different contexts as a result?

[cce66]

For me the POC side is fine, but seeing the usefulness it might have within Gladys is another matter!
Je pense qu’il serait plus important de développer autour de ce qui peut attirer plus de monde c’est à dire l’intégration de matériel (j’ai soumis l’idée d’une intégration http par exemple pour ppouvoir créer comme dans MQTT des objets controlables par commande http), ce qui m’attires avec Gladys c’est la facilité de mise en oeuvre mais et surtout la confidentialité des données et l’utilité d’intégration de chose comme Alexa est secondaire et le développement ou l’intégration d’une solution de reconnaissance vocale et TTS (Text to speech) comme dans Gladys 3 devrait être prioritaire ! Ce qui serait bien serait d’avoir un module qui permettent d’installer désinstaller plus facilement le docker nodered car avec lui il y a des modules de reco vocale et TTS autonome « facilement » interfaçable avec Gladys sans que l’on soit obligé de passer pas des solutions tierces pas forcement pérennes sous la même forme et pas avares de nos données (Alexa ChaG

[jparbel]

Thanks @pierre-gilles for your clarifications regarding the validity of GPT-3’s responses, I understand better now.
In the context of Gladys, GPT-3 can, indeed, be useful for producing a specific synthesis of our home automation, or for providing answers that are not directly accessible from Gladys.

For other « generalist » areas, it can allow Gladys to stand out compared to the competition, and bring a real added value (if you know how to ask the right questions!!!).

That said, everyone has their own sensitivity, and we can understand that some people do not wish to use it in their personal home automation setup, hence the usefulness of being able to subscribe to different plans.

Well done, in any case, @pierre-gilles, for all these new features.

[Phil]

@pierre-gilles
FYI : OpenAI launches ChatGPT Plus, starting at $20 per month • TechCrunch

[pierre-gilles]

If I summarize the different requests:

• Control switches/lights (On/Off)
• Trigger a scene
• Ask for the temperature of a room
• Retrieve the camera image of a room

@Terdious

lorsque nous engageons une discussion, est-ce que comme dans ChatGPT notre discussion rentre dans le contexte ?

Yes there is context! If you talk to it about the same topic, Gladys keeps the history and remembers what you’re talking about Example:

@Terdious

Actuellement les discussions passées sont effacées automatiquement (je ne sais pas la temporalité). Est-ce que ce sera toujours le cas ?

It’s only when you leave the page and come back; it’s due to the nature of this « temporary » demo in Gladys. It won’t be the case when it goes into the « Discussion » tab

@Terdious

Peut-on envisager plusieurs salons de discussion avec du coup un contexte différent ?

At most we can keep the « temporary » integration that lets you have a fresh context each time, but well, we’ll see if that’s really that useful ^^

@Terdious

Garder un contexte personnalisé si possible (en base de donnée ?) pour remplacer les « Groupes » façon Alexa. Je m’explique par exemple :

We’re out of context here If we want groups of devices in Gladys, we can code groups, but I don’t think that has anything to do with GPT-3.

[elfedagger]

Good evening,
And the speech, is that feasible?

[pierre-gilles]

@elfedagger That’s another matter entirely

[pierre-gilles]

A little preview of what awaits you very soon in Gladys

The next version of Gladys will include a more advanced version of this OpenAI integration:

• Integration available in the native chat and in Telegram
• On/off control of lights
• Launching scenes ( A first!! )
• Camera images
• Room temperature

This second iteration will be activatable with one click for those who want it:

Given the current commands, this integration does not send any information about your instance to GPT-3, the responses for the temperature for example are generated locally.

If we want to improve the quality of the responses, we can in a future iteration transmit sensor information if the user wishes (probably via a toggle).

I can’t wait to put this in your hands

[Bruno94]

And all that by saying " OK GLADYS " ?

[pierre-gilles]

It’s only textual

[guim31]

Awesome, I love it well done Pierre-Gilles