There is no need to open an app, or to even unlock the phone first. Shake your phone to turn the lamp on or off. This is probably my most used interface – it’s also the most simple. For example, when the alarm goes off in the morning, it can open the shades, turn the lights on, announce the weather, and start playing music. Macros are automatic actions taken by the system to control various things. The light switches are connected to the Phillips Hue Hub, so I’m able to maintain state across the system when the light switches are used. Although I can control my lights with voice, IM, macros, or other means, I can also still simply tap the light switches to control my lights. is to not disable existing mechanisms for home control. Also includes temperature and humidity sensing, a gesture sensor (wave to silence alarm clock), and a room occupancy sensor (Automatically turns off display when room is vacant to save power, and automatically turns screen back on when somebody enters the room).Īn important goal of J.A.R.V.I.S.
It has a big button to initiate voice requests, and manual dials and buttons so I can control my lights and music from my nightstand without having to use voice if I don’t want. It includes a 10 inch screen that shows system state (lights, weather, room conditions, alarm settings, etc). I built a control interface from scratch. So, if somebody else uses the light switches to turn on my lights, for example, I’ll get an instant message saying that. It also asyncronously notifies of system state changes over the IM interfaces. I can ask the system to do something, like opening the shades, and it will reply to confirm that it has done it. A simple web app enables me to have a two-way conversation with J.A.R.V.I.S. I use the same message parsing system to handle instant messages. Natural Language Instant Messaging Interface.“Please turn on the lights” is understood just as easily as “lights on” even if the former phrase has not been directly trained into the system). Wit.ai, a machine learning natural language processing platform, enables me to handle natural voice requests (i.e. Currently, the only microphone resides on the Command Center, but it’s a conference room mic that can easily hear me from anywhere in my room. Voice is my primary means of interacting with the system. These are the various ways that J.A.R.V.I.S. I can turn the lights on via voice or via wall switches – the lights are the control and the voice/switches are interfaces). For the most part, any of the interfaces can be used to trigger any of the controls (i.e. and I to exchange information (screens, voice, buttons, etc.). system to be highly modularized and distributed, so that features can be added with relative easily explain what the platform is capable of, let me break it up into two categories: interfaces and controls. I do hope to open source all the mechanical components, electrical designs, block diagram, and software…but only once I’ve gotten it to be a bit more polished.įor a quick run-through of some of JARVIS’s capabilities, check out the video below: I fiddle with it on nights and weekends, and I am not developing it to commercialize it – I’m purely interested in automating my home, and learning new things along the way. After seeing Tony Stark’s awe-inspiring AI from the Iron Man movies, I knew I had to have one of my own. stands for “Jeremy’s Astute Residential Virtual Intelligent System.” Is that a backronym? Yes.