Abstract: Example systems, devices, media, and methods are described for presenting a virtual guided tour in the display of an eyewear device in an augmented reality experience. A guided tour application implements and controls the capturing of frames of video data within a field of view of the camera. The image processing system detects, in the captured frames of video data, one or more containers in the physical environment. The method includes retrieving data associated with the detected container and its contents from libraries and internet searches. A contextual overlay based on the retrieved data is presented on the display along with an avatar for playing messages, responding to commands and queries using speech recognition, and presenting guided tours. The experience includes virtual product tastings and guided tours through farms and related facilities.

Abstract: Example systems, devices, media, and methods are described for presenting a virtual guided fitness experience using the display of an eyewear device in augmented reality. A guided fitness application implements and controls the capturing of frames of motion data using an inertial measurement unit (IMU) and video data from one or more cameras. The method includes detecting exercise motions (with or without equipment) as well as detecting and counting repetitions. Relevant data about detected motions or equipment is retrieved and used to curate the guided fitness experience. A current rep count is presented on the display along with an avatar for playing messages, performing animated demonstrations, responding to commands and queries using speech recognition, and presenting guided fitness instructions through text, audio, and video.

Abstract: Example systems, devices, media, and methods are described for presenting a virtual guided fitness experience using the display of an eyewear device in augmented reality. A guided fitness application implements and controls the capturing of frames of motion data using an inertial measurement unit (IMU) and video data from one or more cameras. The method includes detecting exercise motions (with or without equipment) as well as detecting and counting repetitions. Relevant data about detected motions or equipment is retrieved and used to curate the guided fitness experience. A current rep count is presented on the display along with an avatar for playing messages, performing animated demonstrations, responding to commands and queries using speech recognition, and presenting guided fitness instructions through text, audio, and video.

Abstract: Example systems, devices, media, and methods are described for presenting a virtual guided tour in the display of an eyewear device in an augmented reality experience. A guided tour application implements and controls the capturing of frames of video data within a field of view of the camera. The image processing system detects, in the captured frames of video data, one or more containers in the physical environment. The method includes retrieving data associated with the detected container and its contents from libraries and internet searches. A contextual overlay based on the retrieved data is presented on the display along with an avatar for playing messages, responding to commands and queries using speech recognition, and presenting guided tours. The experience includes virtual product tastings and guided tours through farms and related facilities.