Smart home

Smart Mirror / Human Interaction Interface

In smart home environments, an intelligent mirror is an increasingly popular choice for a central user interface, as it provides a smooth, pleasant and unobtrusive control instance for the entire apartment. Personalized information from the outside world and from the house itself converges in this mirror, and certain aspects can be controlled.

In order to personalize the displays and to provide a natural form of control, the use of neural networks is a popular choice, however, the required computing performance typically also leads to high power consumption and poor energy efficiency. Although the computing performance of embedded solutions for neural networks increases, there is no capability of calculating several large networks simultaneously. LEGaTO addresses this problem by the development of a cognitive edge AI platform, capable of handling such use cases without using a cloud computing solution.

Using available off-the-shelf components and existing toolchains for implementation of the smart mirror or other smart home technologies leads to high power consumption. Although this is feasible for a demonstrator, it is a critical showstopper for using the technology in a real-world scenario.

With the help of the LEGaTO cognitive edge AI platform and the LEGaTO toolchain, the processing can be distributed to energy-efficient microserver modules. These show a high degree of application-specific performance, e.g., Nvidia Xavier-based microservers with integrated tensor cores offer a good solution for most neural networks, while FPGA-based microservers are a perfect fit for preprocessing of the sensor data. This combination of several heterogenous microservers allows reaching an acceptable performance for the application while keeping the power consumption at a reasonable level.


Smart Home use case in the LEGaTO system



Official repository for a MagicMirror² prototype, developed within LEGaTO, is available here.


Scientific publications



Event Date Materials
Teratec Forum 2020 13-14 October 2020 Exhibition
Embedded World 2020 25-27 February 2020 Slides: "LEGaTO: A low energy toolset for heterogeneous computing
ISC High Performance 2019 16-20 June 2019 Exhibition
Teratec Forum 2019 11-12 June 2019 Exhibition
Hannover Messe (Trade Fair) 2019 1-5 April 2019 Exhibition



Medium Date Article
LEGaTO website March 2020 New video about the LEGaTO SmartMirror
LEGaTO website March 2020 LEGaTO is presented at Embedded World 2020
EE Times February 2020 Embedded World: Strong Show of AI, IoT and Security Despite Major Absences
Primeur Magazine February 2020 Efficient and energy-aware LEGaTO SmartMirror will be showcased at Embedded World 2020 February 2020 Efficient and Energy-Aware “LEGaTO SmartMirror”
LEGaTO website February 2020 Efficient and energy-aware LEGaTO SmartMirror will be showcased at Embedded World 2020
HiPEAC info January 2020 Bright sparks - Tackling the energy challenge in computing systems
LEGaTO website April 2019 Mirror, mirror on the wall, which is the smartest of them all? LEGaTO’s smart mirror is presented at Hannover Fair Trade 2019
LEGaTO website August 2019 Powering HPC and AI applications through intelligent management of resources - A glimpse into the LEGaTO runtime system