If you follow me on any social media outlets, you’ve surely seen me post bits and pieces of information about the home automation platform that I’ve been building, as a hobby, for the last two years. J.A.R.V.I.S. (Jeremy’s Astute Residential Virtual Intelligent System) is still very much a work-in-progress, but it has reached the point where it is stable enough to use it every day. Once I feel that I’m at a 1.0 release state, I’ll release all the code, mechanical designs, electrical designs, etc, under open source licenses.
In the meanwhile, here’s an update on the system… J.A.R.V.I.S. was just featured as a cover story in the Wall Street Journal, and was the topic of a WSJ video! Check out the video below:
And for those of you wanting some more technical details, watch this video update that I posted on YouTube a few weeks ago:
I realize that many readers of my blog are probably yearning for even more technical details, and I promise to deliver them once I’ve done some more work polishing the system. To hold you over, here’s a list of some of the things that the system can currently do:
- Control Phillips Hue Lightbulbs and lightstrips (on/off, absolute/relative brightness, color)
- Control ceiling lights connected to Z-Wave wall dimmer Switches (on/off, brightness)
- Control AC lamps (on/off)
- Control Music (Google Play Music Unlimited Account – Play/Pause, Stop, Next, Previous, Choose playlist/artist/song/radio, volume control)
- Report the weather (any location or day up to one week away)
- Perform knowledge queries (i.e. “Jarvis: What is machine learning?”)
- Open/Close Shades or Blinds
- Communicate over a natural language spoken voice interface (TTS and speech synthesis)
- Communicate over a natural language chat (IM) interface
- Maintain real-time state across all system components (ie. turning the lights off at the wall switch will immediately update the control panel to reflect that the lights are off)
- Secure REST API and Websocket interface for all functions makes adding clients and endpoints easy
- Set/Trigger Alarm clocks that can initiate macros (ie. Alarm clock turns the lights on, opens the shades, reports the weather, and plays music)
- LED speech and processing animations
- Lots of other things with more to come!
J.A.R.V.I.S. is made possible with the use of many open source software tools and platforms. They will all be credited in the source code when I release it. I often post snippets of J.A.R.V.I.S. on instagram as I’m working on it, so follow me on instagram if you wanna keep up with my progress. If you have any questions about J.A.R.V.I.S., please feel free to post them here or on twitter and I’ll be happy to answer them.
wow this is so Awesome!! well, i am more interested in the lights part of it! i am trying to work on a final year project that involves directing a beam of light to a desired spot!.
i am so impressed! the dawn of a new era!
This may be the most important Next Big Thing. Hopefully, you’re working on it furiously!
Hey Jeremy, can you make a tutorial on voice recognition, because I always wanted to try it but didn’t now how.
Man this is really cool, never quit on this project.
This is awesome, every geeky kid dream house. I want to start my own, where would you recomend me to start? If you could point out some learning material it would be great!
I am your fan haha
This is super cool! I am looking to do something like this in my office at home. Can I get some input from you on what you used or is there a tutorial or anything I can start with and ask you basic questions about?
What you have accomplished in two years begins to be a dream for me. I want to understand all this and know where to start using Jarvis.
This is a great build Mr.Blum, it seriously blew my mind away.
Could you send me the designs of the PCB for the display and the raspberry Pi 3 IMG file please, I’d like to implement this at home as it is very nice.
Good job! I like your page.
Hey, could you send me the OS and the pinout/schematic for that display? It would be really helpful, Thanks!