• fubarx@lemmy.ml
    link
    fedilink
    English
    arrow-up
    6
    ·
    2 months ago

    Their LLM integration is super cool. I messed with it for a previous job. Way better than Alexa or Google Home.

    • __init__@programming.dev
      link
      fedilink
      English
      arrow-up
      4
      ·
      2 months ago

      I have really been wanting to try it out. Is there any good off the shelf hardware that you can use as “smart speakers” for it yet?

      • fubarx@lemmy.ml
        link
        fedilink
        English
        arrow-up
        4
        ·
        2 months ago

        https://www.espressif.com/en/news/ESP32-S3-BOX-3

        There’s a model with a more expensive dock, or one without. The one without worked fine. But it had to be the Box 3 not Box 2. It worked pretty well and you could create custom images to indicate whether it was listening, thinking, etc.

        Instructions here: https://www.home-assistant.io/voice_control/s3_box_voice_assistant/

        The box isn’t powerful enough to run an LLM itself. It’s just good enough as an audio conduit. You can either use their cloud integration with ChatGPT, or now, Anthropic Claude. But if you had a powerful Home Assistant server, say an Nvidia Jetson or a PC with a beefy Nvidia GPU, you could run local models like Llama and have better privacy.

        This is from earlier this year. I imagine they’ve advanced more since then.