Abstract: A control method of a user interface may include: detecting an occupant from an image input from a camera; estimating a skeleton of the occupant; estimating a relative position of a finger of the occupant based on the estimated skeleton; determining a projection position based on the relative position of the finger, and projecting a projection image on the projection position by an image projector and playing the projection image.

Abstract: A display device including a display unit having a display panel and a camera; a posture adjustment driving unit configured to adjust a posture of the display unit; and a controller configured to control the camera to capture a first image of a viewer viewing the display unit when the display unit is positioned at a first height, control the posture adjustment driving unit to move the display unit to a second height different than the first height, control the camera to capture a second image of the viewer viewing the display unit when the display unit is positioned at the second height, correct at least one of the first image and the second image based on orientation information of the display unit on capturing the first image and the second image, generate a 3D body mesh of the viewer using the first image and the second image, calculate a viewer-optimized display unit posture setting based on the 3D body mesh, and control the posture adjustment driving unit to move the display unit to a height correspondin

Abstract: A method for operating a voice trigger is provided. In some implementations, the method is performed at an electronic device including one or more processors and memory storing instructions for execution by the one or more processors. The method includes receiving a sound input. The sound input may correspond to a spoken word or phrase, or a portion thereof. The method includes determining whether at least a portion of the sound input corresponds to a predetermined type of sound, such as a human voice. The method includes, upon a determination that at least a portion of the sound input corresponds to the predetermined type, determining whether the sound input includes predetermined content, such as a predetermined trigger word or phrase. The method also includes, upon a determination that the sound input includes the predetermined content, initiating a speech-based service, such as a voice-based digital assistant.

Abstract: A method of determination of a trajectory of a living tissue, in which subsequent frames representing images of living tissue are acquired with at least a first imaging device and at least a first segment of a trajectory of the living tissue is determined with a use of relative displacements of at least first subset of subsequent frames and recalculation thereof to coordinates corresponding to time of frame acquisition to form a vector Tm elements tm wherein element tm is at least one coordinate of living tissue, element tm of vector Tm is determined with a use of relative displacements pm,k of at least two preceding frames.

Abstract: A third controller of a control device executes obtaining a taken image obtained by imaging an operator, making a projector display a first display image including the taken image, detecting an operation gesture corresponding to processing to be executed by the control device from the taken image, generating a second display image based on the operation gesture, and making the projector display the second display image.

Abstract: In some examples, an electronic device includes a network interface to connect to a computer network, a display port operating as a display input, an input/output port, memory having a plurality of profiles, and a processor coupled to the memory. In some examples, the processor is to change an operation of the input/output port based on a profile of the plurality of profiles. In some examples, the processor is to change the display port from the display input to a display output based on the profile of the plurality of profiles.

Abstract: Head-mounted augmented reality (AR) devices can track pose of a wearer's head to provide a three-dimensional virtual representation of objects in the wearer's environment. An electromagnetic (EM) tracking system can track head or body pose. A handheld user input device can include an EM emitter that generates an EM field, and the head-mounted AR device can include an EM sensor that senses the EM field. EM information from the sensor can be analyzed to determine location and/or orientation of the sensor and thereby the wearer's pose. The EM emitter and sensor may utilize time division multiplexing (TDM) or dynamic frequency tuning to operate at multiple frequencies. Voltage gain control may be implemented in the transmitter, rather than the sensor, allowing smaller and lighter weight sensor designs. The EM sensor can implement noise cancellation to reduce the level of EM interference generated by nearby audio speakers.

Abstract: A region of space may be monitored for the presence or absence of one or more control objects, and object attributes and changes thereto may be interpreted as control information provided as input to a machine or application. In some embodiments, the region is monitored using a combination of scanning and image-based sensing.

Abstract: This relates generally to intelligent automated assistants and, more specifically, to provide a handsfree notification management system. An example method includes displaying one or more notifications by the electronic device. In response to displaying the one or more notifications, the method includes detecting a visual interaction of a user with the one or more notifications, identifying a notification from the one or more notifications based on the visual interaction, receiving a speech input related to the notification from the user, determining one or more actions associated with the notification based on the speech input, and performing the one or more actions.

Abstract: A position indicator that electrostatically interacts with a sensor includes: a casing having a pen shape; a conductive core body including a pen tip that protrudes from an opening on one end in the axial direction of the casing; a conductor surrounding the core body; a signal transmitting circuit which, in operation, generates a signal that electrostatically interacts with the sensor, and supplies the generated signal to the core body; and a control circuit which, in operation, produces different electrostatic interactions with the sensor by performing a first control operation that sets the conductor in a state of being grounded while the signal is sent out from the pen tip of the core body to the sensor, and performing a second control operation that sets the conductor in a state different from the state of being grounded.

Abstract: A coordinate reception unit receives time series spatial coordinates of an object to be detected. The spatial coordinates include a coordinate in a first direction, a coordinate in a second direction intersecting the first direction, and a coordinate in a third direction intersecting the first direction and the second direction. When a predetermined first condition related to a change in the coordinate in the first direction is satisfied at a first point of time and then a predetermined second condition related to a change in the coordinate in the first direction is satisfied at a second point of time, a function execution unit executes a process in electronic equipment that is a target of control, based on the coordinate in the second direction and the coordinate in the third direction at one or more points of time between the first point of time and the second point of time.

Abstract: A data processing apparatus includes receiving circuitry to receive graphics data for at least a portion of a virtual environment, the graphics data including a plurality of virtual objects, a machine learning model trained to output data indicative of an object classification for one or more of the virtual objects in dependence upon the graphics data, assignment circuitry to assign one or more of the virtual objects to one or more virtual object groups in dependence upon the object classification for one or more of the virtual objects, where the virtual objects assigned to a same virtual object group have a same object classification, and control circuitry to share first interaction data associated with a first virtual object assigned to a virtual object group with a second virtual object assigned to the virtual object group to thereby permit use of the first interaction data for the second virtual object in response to a user interaction with the second virtual object in the virtual environment.

Abstract: There is provided a controller for receiving input from a user, including: a plurality of input elements, each operating to receive respective operative input from a user, the respective operative input being processed and transmitted to an external apparatus for manipulating an application program during execution; a memory having a plurality of sets of profile data stored therein, each set of profile data includes a respective profile ID in association with respective location information indicative of where a respective one of the input elements is located on the controller; a communication unit operating to receive a user-selected one of the plurality of sets of profile data; and a control unit operating to control the controller based on the selected profile data set received from the communication unit.

Abstract: Presented herein are techniques in which a device detecting a phrase spoken in an online collaboration session between a plurality of users, the phrase being spoken by a first user to one or more second users. The device determines that the phrase indicates an issue with a quality of user experience of the online collaboration session, labels a log of metrics associated with the online collaboration session with a time stamp corresponding to a time when the phrase was spoken, to provide a labeled log of metrics; and performs one or more actions to improve the user experience based on detecting the phrase.

Abstract: A communication terminal device acquires audio including voice of own user using own device; acquires visual information for enabling formation of three-dimensional data of object in predetermined user space; identifies viewpoint position of own user on basis of visual information on user space; transmits, to another device, image transmission information based on visual information on user space and audio transmission information based on audio; displays, on basis of image transmission information transmitted from other device, on display surface having fixed relative position relative to shared virtual space, in which first virtual space in which user space is fixedly arranged and second virtual space in which user space of other device is fixedly arranged are arranged at predetermined relative positions and relative angles, image of shared virtual space which can be viewed from viewpoint position of own user; and outputs audio on basis of audio transmission information transmitted from other device.

Abstract: Provided is a method of learning a target object implemented on a computer-aided design program of an authoring computing device using a virtual viewpoint camera, including displaying a digital model of a target object that is a target for image recognition, setting at least one observation area surrounding the digital model of the target object and having a plurality of viewpoints on the digital model, generating a plurality of pieces of image data obtained by viewing the digital model of the target object at the plurality of viewpoints of the at least one observation area, and generating object recognition library data for recognizing a real object implementing the digital model of the target object based on the generated plurality of pieces of image data.

Abstract: According to various embodiments, an electronic device using a millimeter wave comprises: a first antenna array; a second antenna array; a communication circuit; and at least one processor, wherein the at least one processor may be configured to: control the communication circuit to output a first signal through the first antenna array; when a first reflected signal acquired from the first signal reflected by an object is received through the second antenna array, determine the range between the object and the electronic device on the basis of the first reflected signal; determine an output period of a second signal on the basis of the determined range; control the communication circuit to output the second signal through the first antenna array according to the determined output period; and when a second reflected signal acquired from the second signal reflected by the object is received through the second antenna array, identify an attribute of the object on the basis of the second reflected signal.

Abstract: Systems and methods for providing partial passthrough video to a user of a virtual reality device are disclosed herein. Providing the partial passthrough video can include detecting a hand passthrough trigger event and identifying a hand passthrough video feed. Providing partial passthrough video can further include aligning the hand passthrough video feed with a virtual environment presented to a user by the virtual environment and, based on the aligning of the hand passthrough video feed with the virtual environment, overlaying the hand passthrough video feed on the virtual environment.

Abstract: System and methods for gesture-based control are described. In some embodiments, a system may include a wearable device having a biopotential sensor and a wrist motion sensor. The biopotential sensor may be configured to output a first data stream indicating actions of a person's hand. The system may further include a second device configured to output a second data stream, which may also indicate the actions of the person's hand. The system may be configured to analyze the first and second data streams to train a machine learning interpreter to classify actions of a person's hand based on at least biopotential data.

Abstract: A processing method for a request for a digital service in an interactive environment, where the method includes: generating an enriched request based on an interpretation of signals received from a multimodal set of human-machine interactions resulting from human-machine interactions coming from coordinated actions of a plurality of distinct users in the interactive environment, where each human-machine interaction, considered individually, is only indicative of one simple request and where the enriched request triggers sending at least one command.

Abstract: Techniques are disclosed, whereby graphical information for a first image frame to be rendered is obtained at a first device, the graphical information comprising at least depth information for at least a portion of the pixels within the first image frame. Next, a regional depth value may be determined for a region of pixels in the first image frame. Next, the region of pixels may be coded as either a “skipped” region or a “non-skipped” region based, at least in part, on the determined regional depth value for the region of pixels. Finally, if the region of pixels is coded as a non-skipped region, a representation of the region of pixels may be rendered and composited with any other graphical content, as desired, to a display of the first device; whereas, if the region of pixels is coded as a skipped region, the first device may avoid rendering the region.

Abstract: This disclosure describes systems, methods, and devices related to robotic drive control device. A robotic device may receive an indication associated with pressing an actuator on a handheld device, wherein the handheld device controls a movement of an end effector of the robotic device. The robotic device may record a home location associated with where the actuator was pressed in space. The robotic device may determine an orientation of the handheld device. The robotic device may detect a movement of the handheld device from the home location to a second location in space. The robotic device may cause the end effector of the robot to move in the same orientation as the handheld device from a stationary position that is associated with the home location while continuing to move the end effector even when the handheld device stops moving at the second location.

Abstract: In an example, an apparatus comprises logic, at least partially comprising hardware logic, to receive an input from one or more detectors proximate a display to present an output from a graphics pipeline, determine that a user is not interacting with the display, and in response to a determination that the user is not interacting with the display, to reduce a frame rendering rate of the graphics pipeline. Other embodiments are also disclosed and claimed.

Abstract: A plural-panel touchpad and palm rest base chassis assembly for an information handling system may comprise a base chassis having an upper portion including a keyboard opening, a touchpad opening for insertion of a touchpad assembly having a touchpad surface panel comprising polycarbonate impregnated thermoplastic fiberglass, and palm rest support surfaces supporting palm rest surface panels. The touchpad surface panel and the palm rest surface panels may have front edges and side edges defining a front and side boundary of the base chassis respectively and also defining the keyboard opening. A lightguide layer may be joined to the touchpad surface panel and to a touchpad printed circuit board assembly (PCBA) to illuminate touch buttons. The touchpad assembly is mechanically and operatively coupled to the base chassis upper portion via top-mounted fasteners disposed through a support bracket to palm rest support surfaces and concealed by the palm rest surface panels.

Abstract: Provided are a hand pose estimation method, a device and a computer storage medium. The method may include: determining a classification logic map corresponding to each of a plurality of key-points, the plurality of key-points may represent key nodes of a skeleton of a target hand skeleton, a first key-point may be any one of the plurality of key-points; determining, based on a preset classification map and the classification logic map corresponding to the first key-point, co-ordinate information of the first key-point; and obtaining a pose estimation result of the target hand, in response to determining the co-ordinate information corresponding to each of the plurality of key-points.

Abstract: A camera integrates a magnet at one end of a cylindrical housing to magnetically attract and attach the camera to a front side of a peripheral display, such as to support a video conference through an information handling system interfaced with the display. Camera orientation at a display panel front face is detected, such as with an accelerometer or with analysis of a visual image captured by the camera module, so that the camera orientation is presented with an orientation indicator at the camera front face, such as an LED that illuminates with a predetermined color to indicate an upright vertical orientation. In one alternative embodiment, a gimble interfaced with the camera module and cylindrical housing actuates to adjust the camera module to the upright vertical orientation.

Abstract: This disclosure describes a system that allows a user to communicate via social networking from a game controller. These social networking notifications may be displayed on a screen of the game controller. In addition to the game controller, the disclosed system may comprise an app, on a device external from the game controller, that is also able to display the social networking notifications.

Abstract: A virtual reality tracker includes a first part and a second part. The first part includes a plurality of first light-emitting diodes (LEDs) and an inner measurement unit (IMU). The inertial measurement unit is used for measuring the acceleration and the triaxial angular velocity of the first part. The second part includes a plurality of second light-emitting diodes. Moreover, the first part and the second part are connected by a flexible component.

Abstract: This disclosure provides an in-vehicle mid-air gesture-based interaction method, an electronic apparatus, and a system, and relates to the field of intelligent vehicle technologies. The method includes: obtaining a first mid-air gesture detected by a camera; and starting, when a preset response operation corresponding to the first mid-air gesture matches a first user who initiates the first mid-air gesture, the preset response operation corresponding to the first mid-air gesture in response to the first mid-air gesture. The method can be used in an in-vehicle mid-air gesture-based interaction scenario, reduce a mid-air gesture operation rate, and improve driving safety and interaction experience.

Abstract: An optical system for a virtual retina display and a gesture detection of a user of the virtual retina display. The optical system includes a projector unit, an image source, and an image processing unit. The projector unit includes a first, second, and a third light source, and a first controllable deflection unit for scanning deflection of first, second, and third light beams. The optical system further includes a second deflection unit designed to transmit the first and second scanned light beams and to deflect the third light beam into a gesture detection area of the user. The optical system further includes a deflection unit, onto which the image content is projectable and which is configured to direct the projected image content and the second light beam onto an eye of a user.

Abstract: A wrist-mounted system for tracking hand poses includes one or more cameras mounted to a wearable band. In some examples, the one or more cameras are low profile and may be located less than 15 mm, and preferably less than 10 mm, of the wrist of the user. In some examples, a system includes a wearable band and one or more imaging sensors. The one or more imaging sensors are disposed to have a field of view that is anatomically distal when the wearable band is coupled to an arm of the user. The one or more imaging sensors each define an optical axis spaced from the wearable band of less than 15 mm, and preferably less than 10 mm. The image data may come from a single camera mounted on the back of the wrist which captures images of the surface contours of the back of the hand to infer hand poses and gestures.

Abstract: Systems and methods are disclosed for device movement-based authentication. One method comprises receiving contextual data from one or more sensors of a user device and determining a device movement pattern based on the received contextual data. The determined device movement pattern is compared with a device movement-based signature associated with a user of the user device. If the determined device movement pattern matches the device-movement based signature within a predetermined threshold, the user is authenticated for an electronic transaction. If the determined device movement pattern does not match the device-movement based signature, a notification indicating authentication failure is sent to the user device.

Abstract: The present disclosure is directed to selective gesture recognition for handheld device gestures. An example method includes receiving, by a handheld interactive object, movement information descriptive of a gesture performed with the handheld interactive object. The method includes selecting a local and/or remote machine-learned model for processing the movement information. The movement information can be processed to identify a gesture action corresponding to the movement information. The local and/or remote machine-learned model can be selected based on user input data and/or a complexity of the movement information. In response to selecting the local machine-learned model, the method includes processing the movement information according to the local machine-learned model and communicating a message to a remote device based on the result.

Abstract: Apparatus and associated methods relate to an array of individually readable distance sensors disposed along a first axis on a platform and configurable to detect penetration of a first plane containing the first axis, and an array of individually controllable light emitting indicators disposed on the platform along at least a second axis and configurable to emit visual indicia to a user out of the first plane. The visual indicia may, for example, be associated with the detected penetration. A reconfigurable predetermined detection window may, for example, be generated by associating adjacent sensors detecting input during a teaching operation. The detection window may, for example, be further generated by determining at least one distance threshold profile as a function of input received from the adjacent sensors during the teaching operation. Various embodiments may advantageously enable efficient configuration of generic sensing and indication units.

Abstract: A method for capturing motion of an object, the method comprising: installing at least one marker on the object; bringing the object having the at least one marker installed thereon in an acquisition volume; arranging at least two event-based light sensors such that respective fields of view of the at least two event-based light sensors cover the acquisition volume, wherein each event-based light sensor has an array of pixels; receiving events asynchronously from the pixels of the at least two event-based light sensors depending on variations of incident light from the at least one marker sensed by the pixels; and processing the events to position the at least one marker within the acquisition volume and capture motion of the object.

Abstract: A system for performing synergistic object tracking and pattern recognition for event representation includes a computing platform having processing hardware and a system memory storing a software code. The processing hardware is configured to execute the software code to receive event data corresponding to one or more propertie(s) of an object, to generate, using the event data, a location data estimating a location of each of multiple predetermined landmarks of the object, and to predict, using one or both of the event data and the location data, a pattern corresponding to the propertie(s) of the object. The processing hardware is further configured to execute the software code to update, using the predicted pattern, the location data, and to merge the updated location data and the predicted pattern to provide merged data.

Abstract: A device receives an image including image data of a scale model of a vehicle, and processes the image data, with a model, to identify a make, a model, and a year represented by the scale model. The device determines augmented reality (AR) vehicle information based on the make, the model, and the year represented by the scale model of the vehicle, and provides the AR vehicle information to enable a user device to associate the AR vehicle information with the image of the scale model of the vehicle. The device receives an input associated with the AR vehicle information, and determines updated AR vehicle information based on the input associated with the AR vehicle information. The device provides the updated AR vehicle information to enable the user device to associate the updated augmented reality vehicle information with the image of the scale model of the vehicle.

Abstract: An information handling system mouse includes a position sensor that detects movement and a push button that detects button press inputs for communication to an information handling system. The position sensor detects positions with a high sensitivity having a higher power consumption or a low sensitivity having a lower sensitivity. The push button detects button press inputs with a high scan rate having a higher power consumption or a low scan rate having a lower power consumption. The mouse configures to plural high and low power consumption modes based upon a detected usage pattern and/or a command from an information handling system, such as to adapt the mouse to use by different applications executing on the information handling system.

Abstract: A grippable haptic device includes an input device that receives a user input, a 9-axis sensor that detects movement of a hand of the user, a vibrator that provides a tactile sensation to the user, and a motion sensor that detects whether the user grips the grippable haptic device. An insole-type haptic device includes an input device that receives a user input, a plurality of 9-axis sensors that detect movement of a foot of the user, a vibrator that provides a tactile sensation to a sole of the foot of the user, and a plurality of pressure sensors that are distributed across the insole-type haptic device and measure a pressure exerted at each position of the sole of the user.

Abstract: Presenting an image of a scene may include capturing an image of a scene by a camera of an electronic device, wherein the electronic device comprises the camera and a display, and wherein the camera and the display have a first spatial relationship, determining a second spatial relationship between a viewpoint and the display of the electronic device, warping the image to obtain an image of a first portion of the scene based on the first spatial relationship and the second spatial relationship, and presenting the warped image on the display, wherein, from the viewpoint, the image of the first portion of the scene is substantially contiguous with a second portion of the scene visible outside an edge of the electronic device.

Abstract: Some examples of the disclosure are directed to methods for application-based spatial refinement in a multi-user communication session including a first electronic device and a second electronic device. While the first electronic device is presenting a three-dimensional environment, the first electronic device receives an input corresponding to a request to move a shared object in the three-dimensional environment. In accordance with a determination that the shared object is an object of a first type, the first electronic device moves the shared object and an avatar of a user in the three-dimensional environment in accordance with the input. In accordance with a determination that the shared object is an object of a second type, different from the first type, and the input is a first type of input, the first electronic device moves the shared object in the three-dimensional environment in accordance with the input, without moving the avatar.

Abstract: The present disclosure generally relates to techniques and interfaces for managing media playback devices. In some embodiments, the techniques include varying a feedback based on movement of a computer system toward or away from an external device. In some embodiments, the techniques include displaying an interface that includes controls for controlling media playback on an external device when the computer system and the external device are playing media. In some embodiments, the techniques include performing operations at a computer system in response to an input having a size that is less than or greater than a size threshold. In some embodiments, the techniques include performing different operations at a computer system when status lights have states that indicate different states of the computer system.

Abstract: A method performed by a device (e.g., touch controller) includes deriving a pen position, and transmitting a report indicating the derived pen position to a host computer. The report includes a first area storing position data indicating the derived position and a second area storing non-position data different from the position data. The method includes securing a buffer area for retaining a plurality of the reports in a memory, deriving the pen position at each determined scanning time, and generating a report including the position data indicating the derived position. The method includes storing the report in the buffer area and, in response to obtaining the non-position data, writing the non-position data in the second area of each of one or more of the reports stored in the buffer area. The method includes transmitting the plurality of the reports stored in the buffer area to the host computer.

Abstract: A system and method of repositioning input control devices includes an operator workstation for controlling a computer-assisted device includes an input control device for use by an operator, one or more sensors, and a controller coupled to the one or more sensors and the input control device. The controller is configured to determine whether the operator is interacting with the input control device using the one or more sensors and in response to determining a lack of operator interaction with the input control device, determine a trajectory for moving the input control device from a current position or orientation toward a desired position or orientation, and move the input control device along the trajectory. In some embodiments, the controller is further configured to stop movement of the input control device along the trajectory in response to detecting a stopping condition.

Abstract: An image capturing apparatus including a first image capturing section for capturing an image of an object, a second image capturing section for performing image capturing in a rear direction, and an operation section configured to receive an operation input by a user. In a case where no operation on the operation section is performed after an image of an object has been captured by the first image capturing section, whether or not a user has intention of capturing an image is determined based on an image captured by the second image capturing section. In a case where it is determined that the user does not have the intention of capturing an image, the first image capturing section is set o a first operation state rather than a second operation state larger in power consumption than the first operation state.

Abstract: The present disclosure provides a system and method for monitoring the cognitive state of a patient based on eye image data. The patient monitoring system including a camera unit configured for recording images of an eye of the patient, and a data processing sub-system in data communication with the camera and being operable to (i) receive and process eye image data from said camera, (ii) classify said eye image data into gestures and identify such gestures indicative of the cognitive state of the patient, and (iii) transmit a signal communicating said cognitive state to a remote unit. The system may further include an actuator module and an output unit wherein said output may be an automated medical questionnaire.

Abstract: An information handling system stylus transmits a wireless signal at a writing tip to enhance touch detection of the writing tip by a touchscreen display and receives wireless signals from the touchscreen display at a receiving antenna. To enhance control of wireless energy distributed at the writing tip, the receiving antenna is selectively coupled to the writing tip, such as by transitioning from a float of the receiving antenna to an interface with the stylus power source at transmit by the writing tip. Charge at the receiving antenna helps to shape the energy distribution from the writing tip, such as to match the energy distribution of other styluses in use at the touchscreen display.

Abstract: A method of interpreting a digit-to-digit gesture based on roll values for a wrist-wearable device is disclosed. The method includes, receiving an indication at a first point in time that a user donning the wrist-wearable device is providing a digit-to-digit gesture in which one of the user's digits touches another of the user's digits without contacting the display of the wearable device. The method further includes, in accordance with a determination that the digit-to-digit gesture is provided while data indicates that the wrist-wearable device has a first roll value, causing a target device in communication with the wearable device to perform a first input command and receiving another indication at a second point in time that is after the first point in time that the user is providing the digit-to-digit gesture again, causing the target device to perform a second input command that is distinct from the first input command.

Abstract: Methods and systems for gesture-based control of a device are described. An input frame is processed to determine a location of a distinguishing anatomical feature in the input frame. A virtual gesture-space is defined based on the location of the distinguishing anatomical feature, the virtual gesture-space being a defined space for detecting a gesture input. The input frame is processed in only the virtual gesture-space, to detect and track a hand. Using information generated from detecting and tracking the at least one hand, a gesture class is determined for the at least one hand. The device may be a smart television, a smart phone, a tablet, etc.

Abstract: A motion sensory and imaging device capable of acquiring imaging information of the scene and providing at least a near real time pass-through of imaging information to a user. The sensory and imaging device can be used stand-alone or coupled to a wearable or portable device to create a wearable sensory system capable of presenting to the wearer the imaging information augmented with virtualized or created presentations of information.