Smart Mirror / Human Interaction Interface
In smart home environments, an intelligent mirror is an increasingly popular choice for a central user interface, as it provides a smooth, pleasant and unobtrusive control instance for the entire apartment. Personalized information from the outside world and from the house itself converges in this mirror, and certain aspects can be controlled.
In order to personalize the displays and to provide a natural form of control, the use of neural networks is a popular choice, however, the required computing performance typically also leads to high power consumption and poor energy efficiency. Although the computing performance of embedded solutions for neural networks increases, there is no capability of calculating several large networks simultaneously. LEGaTO addresses this problem by the development of a cognitive edge AI platform, capable of handling such use cases without using a cloud computing solution.
Using available off-the-shelf components and existing toolchains for implementation of the smart mirror or other smart home technologies leads to high power consumption. Although this is feasible for a demonstrator, it is a critical showstopper for using the technology in a real-world scenario.
With the help of the LEGaTO cognitive edge AI platform and the LEGaTO toolchain, the processing can be distributed to energy-efficient microserver modules. These show a high degree of application-specific performance, e.g., Nvidia Xavier-based microservers with integrated tensor cores offer a good solution for most neural networks, while FPGA-based microservers are a perfect fit for preprocessing of the sensor data. This combination of several heterogenous microservers allows reaching an acceptable performance for the application while keeping the power consumption at a reasonable level.
Official repository for a MagicMirror² prototype, developed within LEGaTO, is available here.
|Teratec Forum 2020||13-14 October 2020||Exhibition|
|Embedded World 2020||25-27 February 2020||Slides: "LEGaTO: A low energy toolset for heterogeneous computing”|
|ISC High Performance 2019||16-20 June 2019||Exhibition|
|Teratec Forum 2019||11-12 June 2019||Exhibition|
|Hannover Messe (Trade Fair) 2019||1-5 April 2019||Exhibition|
|LEGaTO website||March 2020||New video about the LEGaTO SmartMirror|
|LEGaTO website||March 2020||LEGaTO is presented at Embedded World 2020|
|EE Times||February 2020||Embedded World: Strong Show of AI, IoT and Security Despite Major Absences|
|Primeur Magazine||February 2020||Efficient and energy-aware LEGaTO SmartMirror will be showcased at Embedded World 2020|
|MesseKompakt.de||February 2020||Efficient and Energy-Aware “LEGaTO SmartMirror”|
|LEGaTO website||February 2020||Efficient and energy-aware LEGaTO SmartMirror will be showcased at Embedded World 2020|
|HiPEAC info||January 2020||Bright sparks - Tackling the energy challenge in computing systems|
|LEGaTO website||April 2019||Mirror, mirror on the wall, which is the smartest of them all? LEGaTO’s smart mirror is presented at Hannover Fair Trade 2019|
|LEGaTO website||August 2019||Powering HPC and AI applications through intelligent management of resources - A glimpse into the LEGaTO runtime system|