This article introduces a new smart house, the Intelligent Sweet Home, developed at the Korea Advanced Institute of Science and Technology (KAIST), Korea, for testing advanced concepts for independent living for elderly and physically handicapped individuals. The work focuses on human-friendly technical solutions for motion/mobility assistance, health monitoring, and advanced human-machine interfaces that provide easy control of both assistive devices and home-installed appliances. The smart house behaves in accordance with the users commands, the users intentions, and the users current health status. Various interfaces based on hand gestures, voice, body movement and posture, and the health monitoring system were studied and tested. This article emphasizes the structure of the system. ? ISAROB 2007.