Pervasive Sensing and AI in Intelligent ICU

Important information related to the visual assessment of patients, such as facial expressions, head and extremity movements, posture, and mobility are captured sporadically by overburdened nurses, or are not captured at all. Consequently, these important visual cues, although associated with critical indices such as physical functioning, pain, delirious state, and impending clinical deterioration, often cannot be incorporated into clinical status. The overall objectives of this project are to sense, quantify, and communicate patients' clinical conditions in an autonomous and precise manner, and develop a pervasive intelligent sensing system that combines deep learning algorithms with continuous data from inertial, color, and depth image sensors for autonomous visual assessment of critically ill patients. The central hypothesis is that deep learning models will be superior to existing acuity clinical scores by predicting acuity in a dynamic, precise, and interpretable manner, using autonomous assessment of pain, emotional distress, and physical function, together with clinical and physiologic data.