Abstract: The enclosed embodiments are directed to tracking caloric expenditure using a camera. In an embodiment, a method comprises: obtaining face tracking data associated with a user; determining a step cadence of the user based on the face tracking data; determining a speed of the user based on the step cadence and a stride length of the user; obtaining device motion data from at least one motion sensor of the device; determining a grade of a surface on which the user is walking or running based on at least one of the device motion data or the face tracking data; and determining an energy expenditure of the user based on the estimated speed, the estimated grade and a caloric expenditure model.

Abstract: Embodiments are disclosed for posture and motion monitoring using mobile devices. In an embodiment, a method comprises: obtaining motion data obtained from at least one motion sensor worn by a user; obtaining at least one frame of skeletal data of the user based on at least one of camera data or depth data; calibrating, with the at least one processor, the motion data and skeletal data to determine a calibration offset; synchronizing the motion data and skeletal data; generating, with the at least one processor, a body pose of the user by: aligning reference frames of the synchronized motion data and the synchronized skeletal data using the calibration offset; estimating the body pose of the user based on the aligned motion data and skeletal data; and classifying, using a machine learning model, the estimated body pose of the user.