Abstract: Content of an electronic message can be presented to a recipient of the electronic messaging. At least one visible user gesture made by the recipient while reviewing the content can be identified using an image capture device. Based on the visible user gesture(s), at least one sentiment of the recipient while reviewing the content can be determined. At least one response indicator can be selected to represent the sentiment(s) of the recipient while reviewing the content. Each response indicator can include a predefined graphic. The response indicator(s) can be inserted into electronic message.

Abstract: A system includes a kiosk configured to collect information associated with a traveler. The information includes information from a passport of the traveler, a photograph of the traveler, and travel-related information associated with the traveler. The system also includes a camera configured to obtain an image of the traveler approaching or within a specified portion of a customs/border enforcement area. The system further includes at least one computing device configured to receive the information from the kiosk, provide at least a portion of the information to an external system, and receive a disposition code from the external system. The disposition code identifies whether the traveler is allowed to pass the customs/border enforcement area. The at least one computing device is also configured to receive the image, perform facial recognition to identify the traveler, and provide at least some of the information to an agent associated with the customs/border enforcement area.

Abstract: The present disclosure is directed to a method and system for scanning an object or environment with a ranging sensor. The method involves rotating a ranging sensor around a rotation reference point and associating the distances measured with the ranging sensor with rotation measurements from a rotation sensor fixed to the ranging sensor. The associated data is used to populate a data plot or data table to be used to generate three-dimensional models.

Abstract: Embodiments of the present invention provide systems and methods to detect a moving anatomic feature during a treatment sequence based on a computed and/or a measured shortest distance between the anatomic feature and at least a portion of an imaging system.

Abstract: Systems and methods for generating high resolution 3D images of the entire human skin comprising at least two sets of cameras, a first set being sensitive to UV light while the second set being sensitive to visible frequencies of light, wherein subsets of each camera set are focused at different focal distances; wherein the system provides a rotatable structure wherein the two sets of cameras are mounted adjacent to the source of light; wherein the rotatable structure is engaged to a program that can define the point of rotation, so as to allow for a reproducible mechanism to take images along the path of rotation.

Abstract: A capsule endoscopic system is disclosed, where the system comprises a capsule device and a docking device. The capsule device comprises a battery, a secondary coil, and a capsule housing to enclose the battery and the secondary coil in a sealed environment, where the capsule device consists of a first end and a second end in a longitudinal direction of the capsule device, and the battery is located in proximity to the first end and the secondary coil is located in proximity to the second end. The docking device comprises an opening on the docking device, a primary coil to generate an alternating magnetic field, and a primary core. The capsule endoscopic system is arranged so that the primary coil is wrapped around at least a portion of the primary core.

Abstract: A non-contact biometric identification system includes a hand scanner that generates images of a user's palm. Images are acquired using light of a first polarization at a first time that show surface characteristics such as wrinkles in the palm while images acquired using light of a second polarization at a second time show deeper characteristics such as veins. Within the images, the palm is identified and subdivided into sub-images. The sub-images are subsequently processed to determine feature vectors present in each sub-image. A current signature is determined using the feature vectors. A user may be identified based on a comparison of the current signature with a previously stored reference signature that is associated with a user identifier.

Abstract: Exemplary embodiments relate to uses of face detection in video, and especially in video calls. In some embodiments, face detection may be used to center a camera shot by maintaining a face in the center of a screen. The centering may be applied selectively, such as by overriding centering if the user is looking off-screen. The video may also be cropped to better fit a face in a screen, or to allow multiple faces to appear on screen. In some embodiments, emphasizing the face over the background (or parts of the face over the whole face) allows for improvement in video call performance. Moreover, these techniques can be used to bring certain areas of a camera shot into focus while de-emphasizing the background (or vice versa).

Abstract: A method includes using a computing platform to extract audio and video segments from current video data of a person; apply a first trained supervised machine learning (ML) model to the video segment to produce a first probability distribution of emotional states of the person; and apply a second trained supervised ML model to the audio segment to produce a second probability distribution of the emotional states of the person. The first and second probability distributions are used by the computing platform to produce a third probability distribution of mismatch-based emotional states of the person. The third probability distribution is based on mismatches between the first and second probability distributions.

Abstract: In a watching assistance system that assists watching over a subject on a bed, a region setting unit performs processing of receiving a region setting image captured by an imaging device, specifying an approximate position of the bed from the region setting image by object detection, and specifying a bed region by extracting a contour of the bed from a local range including the approximate position.

Abstract: The present disclosure relates to an image processing apparatus and method, data, and a recording medium by which the invisibility of corresponding point detection can be improved. A pattern picked up image obtained by image pickup, by an image pickup section, of a predetermined structured light pattern projected by a projection section and having a plurality of, for example, patterns 101-1 and 102-2 and so forth, each of which has a luminance distribution of a Gaussian function like, for example, a curve 102-1 or 102-2, disposed therein, is used to detect corresponding points between a projection image projected by the projection section and a picked up image picked up by the image pickup section. The present disclosure can be applied, for example, to an image processing apparatus, a projection apparatus, an image pickup apparatus, a projection image pickup apparatus, a control apparatus, a projection image pickup system and so forth.

Abstract: Left and right ear HRTF coefficients are determined for an end user, one each for each of a plurality of head orientations, and provided to the end user on a portable recording medium, or via the Internet, etc. The user can then implement the files on audio played on the user's headphones, with the file corresponding to the user's head orientation being selected as the user moves his head to ensure the sound as perceived by the user remains emanating from a fixed external location. The user's personal HRTF may be generated using panoramic images of the ears, such as multiple 2D images or 3D imaging.

Abstract: Various embodiments of the present invention relates to an electronic device and a method for providing a user interface (UI). The electronic device for providing a UI comprises: a display for displaying a UI: and a processor connected to the display, wherein the processor is configured to: display a UI including an object, having a first size, for executing at least one function of an application which is executed by the electronic device; detect an moment of the electronic device on the basis of data acquired through a sensor of the electronic device; and display a UI including the object, the size of which is changed from the first size in the UI to a second size, on the basis of the detected movement and information indicating the frequency of user inputs detected from the object.

Abstract: In a database, product image data is accumulated. A search portion acquires product image data having the image characteristics information that is the same as or similar to the image characteristics information that indicates the characteristics of the image of input image data from the database for the input image data. A search server outputs information on another product that is different from the product corresponding to the product image data together with the product image data acquired by the search portion.

Abstract: An occupant monitoring device for a vehicle in which an occupant sits on a seat provided in an occupant compartment includes an imaging device and a plurality of light projectors. The imaging device is configured to capture an image of a plurality of occupants sitting side-by-side in a vehicle width direction. The plurality of light projectors are provided in correspondence with a plurality of seat positions of the seat and are configured to project light toward the seated occupants.

Abstract: A system that assists in treatment includes circuitry configured to generate three-dimensional body data of a patient using data obtained from a three-dimensional measurement unit, obtain a tomographic image of the patient from a body tomographic measurement apparatus, execute an examination assist process, which aligns the three-dimensional body data with the tomographic image, execute a treatment plan assist process, which make a treatment plan that specifies a posture of the patient when treatment is performed using the tomographic image and the three-dimensional body data that are aligned with each other, and execute a treatment assist process, which outputs a treatment instruction based on the posture specified in the treatment plan.

Abstract: A method of authenticating a user of a wearable electronic device includes emitting light into a dorsal side of a forearm near a wrist of the user; receiving, using a light field camera, remissions of the light from the dorsal side of the forearm near the wrist of the user; generating a light field image from the remissions of the light; performing a synthetic focusing operation on the light field image to construct at least one image of at least one layer of the forearm near the wrist; extracting a set of features from the at least one image; determining whether the set of features matches a reference set of features; and authenticating the user based on the matching. In some embodiments, the method may further include compensating for a tilt of the light field camera prior to or while performing the synthetic focusing operation.

Abstract: A treadmill includes a frame. The frame includes a first side member, a second side member, and a cross-member coupled to and extending between the first side member and the second side member. The treadmill also includes a belt coupled to the frame and configured to rotate about the cross-member. The treadmill also includes a light source coupled to the first side member, the second side member, and the cross-member and a controller configured to control the light source.

Abstract: A surgical simulation device includes a support structure and animal tissue carried in a tray. A simulated human skeleton is carried by the support structure above the animal tissue and includes simulated human skin. A camera images the animal tissue and an image processor receives images of markers positioned on the ribs and animal tissue and forms a three-dimensional wireframe image. An operating table is adjacent a local robotic surgery station as part of a robotic surgery station and includes at least one patient support configured to support the patient during robotic surgery. At least one patient force/torque sensor is coupled to the at least one patient support and configured to sense at least one of force and torque experienced by the patient during robotic surgery.

Abstract: A process is provided for conducting an eye examination using a mobile device, the process comprising capturing a first image of an object using a camera of a mobile device set to a fixed focusing distance; determining, with reference to the first image, an absolute size of the object; capturing a second image of the object using the camera of the mobile device; determining, with reference to the second image, a distance from the mobile device to the object; providing an indication via the mobile device to move the mobile device relative to the object; and receiving input from the mobile device in response to the eye examination program.

Abstract: A method is provided for generating a personalized Head Related Transfer Function (HRTF). The method can include capturing an image of an ear using a portable device, auto-scaling the captured image to determine physical geometries of the ear and obtaining a personalized HRTF based on the determined physical geometries of the ear. In addition, a system and a method in association with the system are also provided for customizing audio experience. Customization of audio experience can be based on derivation of at least one customized audio response characteristic which can be applied to an audio device used by a person. Finally, methods and systems are provided for rendering audio over headphones with head tracking enabled by, for example, exploiting efficiencies in creating databases and filters for use in filtering 3D audio sources for more realistic audio rendering and also allowing greater head movement to enhance the spatial audio perception.

Abstract: A method includes receiving, at a portable device, information associated with a traveler. The information includes information from a passport of the traveler, a photograph of the traveler, and travel-related information associated with the traveler. The method also includes wirelessly transmitting at least a portion of the information to an external system and receiving a disposition code from the external system. The disposition code indicates whether the traveler is allowed to pass a customs/border enforcement area or is required to enter the customs/border enforcement area for additional processing. The method further includes presenting the disposition code or information associated with the disposition code on a display of the portable device.

Abstract: An out-of-head localization filter determination system according to an embodiment includes headphones, a microphone unit, an out-of-head localization device, and a server device. The out-of-head localization device transmits user data based on measurement data to the server. The server device includes a data storage unit configured to store a plurality of first and second preset data acquired for a plurality of persons being measured, a comparison unit configured to compare the user data with the plurality of second preset data, and an extraction unit configured to extract first preset data from the plurality of first preset data based on a comparison result.

Abstract: Disclosed herein are techniques for eye tracking in near-eye display devices. In some embodiments, an illuminator for eye tracking is provided. The illuminator includes a light source configured to be positioned within a field of view of an eye of a user; a first reflector configured to shadow the light source from a field of view of a camera; and a second reflector configured to receive light from the light source that is reflected by the eye of the user, and to direct the light toward the camera.

Abstract: Provided are an operation method for a camera operation apparatus, the method including the steps of: obtaining a bio-signal of a user from a wearable sensor; determining, based on the bio-signal, whether a state of a user is a stable state; setting the camera to a low power mode if the state of the user is a stable state; determining the type of bio-signal if the state of the user is not a stable state; and setting the camera to a mode in accordance with the type of the bio-signal.

Abstract: A method for positioning a body region of a patient for a radiography acquisition by a radiography system includes providing an examination requirement for the body region, pre-positioning the body region in the radiography system for the radiography acquisition, pre-positioning an acquisition unit of the radiography system for the radiography acquisition, producing a three-dimensional positioning acquisition of the body region using a 3D camera system, and producing a preview image from the three-dimensional positioning acquisition. A patient model is generated from the three-dimensional positioning acquisition and the preview image is produced from the patient model, and the preview image depicts a representation as if made using the acquisition unit of the radiography system. The method further includes outputting at least one of the preview image and positioning information based on the preview image. Another embodiment may use an apparatus and computer readable medium to execute the method above.

Abstract: A system and method are provided for targeting marketing content to a user. A user's photographic likeness, in some embodiments as a still image, live moving image, or animated moving image, are altered to simulate the application of selected marketing content onto the photographic likeness. The marketing content is selected from a set of marketing content comprising input color, marketing content associated with an advertisement, or marketing content associated with a set of search results. The marketing content is selected based on a comparison of a user profile to target profiles of the set of marketing content.

Abstract: A method to detect a finger press in an augmented reality (AR) workspace. The method includes obtaining, using an image sensor, an image of the AR workspace, where the image includes an icon of a graphic user interface (GUI), where the GUI is hovered over by a hand of a user, extracting, by a computer processor based at least on a skin tone color filter, a hand candidate from the image of the AR workspace, extracting, by the computer processor based on a pre-determined confidence measure, a finger candidate from a contour of the hand candidate, and detecting, by the computer processor based on a location of the finger candidate with respect to the icon of the GUI, the finger press performed by the hand of the user.

Abstract: A display device includes a display panel displaying an image on one surface thereof, a substrate including a first surface and a second surface, wherein the first surface faces the display panel, and a first touch sensor provided between the display panel and the substrate, wherein the substrate includes a recess on the first surface, and the first touch sensor is arranged on at least a portion of the recess.

Abstract: The present teachings provides a palm vein identification device and a palm vein identification method. The method may comprise: acquiring a target palm vein image of a user; extracting a region of interest (ROI) from the target palm vein image of the user; acquiring feature data corresponding to the ROI, wherein the feature data are obtained by binarization processing; and comparing the feature data corresponding to the target palm vein image against feature data corresponding to a registered original palm vein image to perform identification on the target palm vein image of the user, wherein the feature data corresponding to the registered original palm vein image are obtained by calculation in advance.

Abstract: Systems and methods for tracking user movement during physical fitness activities are presented. A camera tracks movements of objects of interest in a field of view thereof during an exercise routine to log, instruct and provide feedback data to assist the user in reaching fitness goals. The user can also share his data with friends or teammates, for example through social media or in a client-server environment.

Abstract: A virtual reality apparatus comprises an image generator to generate images representing a virtual environment, for display to a user by a head mountable display to be worn by that user. The virtual environment includes an avatar representation of the user positioned within the virtual environment so that the user's viewpoint of the virtual environment substantially corresponds to the viewpoint of the avatar corresponding to that user. One or more user controls are provided with which predetermined inputs may be selected by the user. The image generator is responsive to selection of a predetermined input by the user to correspondingly configure a face of the avatar representing that user. The image generator is arranged to generate respective facial configurations of the avatar for display to other users viewing the virtual environment.

Abstract: An infrared face authentication system and method, having an infrared lamp, a camera having at least infrared responsive pixels proximate to the infrared lamp and a processor connected to the infrared lamp and camera, wherein the infrared lamp and camera are responsive to the processor, wherein the processor receives a facial image from the camera illuminated by the infrared lamp and determines whether the facial image is comprised of epidermis and if the facial image is comprised of epidermis whether the facial image matches an enrolled facial image and if the facial image matches the enrolled facial image an authentication is output.

Abstract: Systems, methods, and non-transitory computer readable media decentralizes biometric enrollment. A server receives a request to enroll a user for biometric authentication in association with a unique ID, generates an activation code corresponding to the unique ID, and sends the activation code to the user. A user device receives and validates the activation code. If the activation code is valid, the user device is enabled to: capture at least one biometric image, and to send the biometric image to the server. The server receives at least one biometric image from the user device in response to the activation code and extracts features from at least one biometric image to generate a biometric template based upon the extracted features to enroll the user for biometric authentication without requiring the user to visit a central location to provide at least one biometric image.

Abstract: A system for detecting a person being interested in a target includes a camera configured to capture an image of a location in front of a target area, a memory configured to store instructions and position information with respect to the target area, and a processor that executes the instructions to perform operations including receiving the image from the camera, detecting a face of person within the image, detecting a face direction in accordance with the detected face, and determining whether the person looks at the target area in accordance with the detected face direction and the stored position information with respect to the target area.

Abstract: A virtual reality apparatus comprises an image generator to generate images representing a virtual environment, for display to a user by a head mountable display to be worn by that user. The virtual environment includes an avatar representation of the user positioned within the virtual environment so that the user's viewpoint of the virtual environment substantially corresponds to the viewpoint of the avatar corresponding to that user. One or more user controls are provided with which predetermined inputs may be selected by the user. The image generator is responsive to selection of a predetermined input by the user to correspondingly configure a face of the avatar representing that user. The image generator is arranged to generate respective facial configurations of the avatar for display to other users viewing the virtual environment.

Abstract: A method and an apparatus for controlling a running status of a wearable electronic device, where the method includes determining a posture of a wearable electronic device, where the posture includes a stationary posture and a moving posture, and controlling a running status of the wearable electronic device according to the posture. According to the method and the apparatus for controlling a running status of a wearable electronic device, the posture of the wearable electronic device is monitored using, for example, a gyroscope signal from a mobile phone, whether a user is using the wearable electronic device is determined, and the running status of the wearable electronic device is determined without using a light sensor, which reduces manufacturing costs of the wearable electronic device.

Abstract: A system and method for selectively enrolling new pattern information in a way that reduces incorrect mapping or reduces overuse of previously mapped pattern information using a multi-match model. A method for dynamically enrolling a pattern-under-test into a pattern template, the pattern template including a set of template elements, may include a) determining a number N of template elements of the set of template elements matched by the pattern-under-test, wherein N is greater than one; b) establishing a multi-match mode for a dynamic enrollment of the pattern-under-test into the pattern template; and c) enrolling dynamically the pattern-under-test responsive to the multi-match mode.

Abstract: A smart phone is used to accomplish measurement of a wound surface area, when at least one flat marker device, which is a predefined reference, is placed near the wound and photographed by a smart phone.

Abstract: An electronic device is provided. The electronic device includes an optical sensor, the optical sensor comprising a lighting device configured to emit light, a sensor layer including an array of sensors configured to detect first image information corresponding to an object from light reflected by the object, and a filter layer including openings configured to transmit the light reflected by the object, the filter layer disposed on the sensor layer, wherein the first image information is different from an image of the object identified with naked eyes. The electronic device may be diversified according to embodiments.

Abstract: An optical fingerprint sensor is provided. The optical fingerprint sensor includes a sensing module. The sensing module includes a light sensing layer and a light filter layer disposed above the light sensing layer. The light sensing layer includes a plurality of photo detectors arranged in a sensing array. The light filter layer includes a plurality of collimators. The collimators are divided into a plurality of collimator groups corresponding to the photo detectors, and the number of collimator groups is equal to the number of photo detectors. Each of the collimator groups comprises the same number of collimators arranged in a specific pattern and disposed above the corresponding photo detector. The photo detectors receive reflected light from a user's finger through the collimators of the corresponding collimator groups.

Abstract: A wearable apparatus is provided for capturing and processing images from an environment of a user. In one implementation, the wearable apparatus is used for identifying a contextual situation related to a wearer. The wearable apparatus includes a wearable image sensor configured to capture a plurality of images from an environment of the wearer. The wearable apparatus further includes at least one processing device. The at least one processing device is programmed to analyze the plurality of images to identify the contextual situation related to the wearer; determine information associated with the contextual situation; and cause the transmitter to transmit the determined information to a device paired with the wearable apparatus to cause the paired device to provide at least one alert to the wearer based on the determined information associated with the contextual situation.

Abstract: The invention provides an optical fingerprint sensor including: an image sensing layer having an array composed of a plurality of sensing blocks; a collimating layer disposed on the image sensing layer and having a plurality of through holes penetrating from the top surface to the bottom surface of the collimating layer; a light guiding layer disposed in the collimating layer, and a glass cover layer disposed on the light guiding layer, the top surface of the glass cover layer receiving a finger touch, wherein the image resolution of the optical fingerprint sensor is defined by the number of sensing blocks, and there are a plurality of through holes directly above each of the sensing blocks.

Abstract: Each user terminal apparatus is connected with a service business enterprise system by a connection business enterprise system in a state that a live image can mutually be transmitted through the service business enterprise system. An user beforehand sets its live image to be appropriately utilized as an advertisement medium, and chooses selling goods to be advertised. A live image transmitted from the user terminal apparatus of the user who performed the aforesaid setting receives a superposed image, for example, by the superposing the T shirt of the user or the like with the image signal of the selling goods as the advertisement object in the service business enterprise system, and then the processed live image signal is transmitted to the user terminal apparatus of a communication companion.

Abstract: An image of a pinna is captured. Based on the image of the pinna, a non-linear transfer function is determined which characterizes how sound is transformed at the pinna. A signal is output indicative of one or more audio cues to facilitate spatial localization of sound via the pinna, where the one or more audio cues is based on the non-linear transfer function.

Abstract: A device, system and a method extract physiological information indicative of at least one vital sign of a subject. To provide a high motion robustness, an input interface is configured to obtain at least two detection signals derived from detected electromagnetic radiation transmitted through or reflected from a skin region of a subject. Each detection signal includes wavelength-dependent reflection or transmission information in a different wavelength channel. At least two pulse signals are computed from said at least two detection signals using different signature vectors for the computation of each pulse signal. Quality indicator values are computed for the pulse signals indicating a characteristic of the respective pulse signal. Physiological information indicative of at least one vital sign is derived from the signature vector resulting in the pulse signal with the best quality indicator value and/or from the pulse signal.

Abstract: A medication confirmation method and apparatus for confirming administration of medication employing an inhalable medication administration apparatus. The method of an embodiment of the invention includes the steps of capturing one or more video sequences of a user administering medication employing the inhalable medication administration apparatus, storing the captured one or more video sequences, capturing one or more audio sequences of the user administering medication employing the inhalable medication administration apparatus and storing the captured one or more audio sequences. At least one of the stored video sequences and at least one of the stored audio sequences are then analyzed to confirm that the user has properly administered the medication.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for reinforcement learning using goals and observations. One of the methods includes receiving an observation characterizing a current state of the environment; receiving a goal characterizing a target state from a set of target states of the environment; processing the observation using an observation neural network to generate a numeric representation of the observation; processing the goal using a goal neural network to generate a numeric representation of the goal; combining the numeric representation of the observation and the numeric representation of the goal to generate a combined representation; processing the combined representation using an action score neural network to generate a respective score for each action in the predetermined set of actions; and selecting the action to be performed using the respective scores for the actions in the predetermined set of actions.

Abstract: An apparatus for identifying a fake fingerprint includes a housing, a prism, a first light source unit, a second light source unit, a sensor unit and a control unit. The prism is disposed in the internal space of the housing. The first light source unit irradiates light in the internal space to allow the light to pass through the prism. The second light source unit irradiates light to allow the light not to pass the prism. The sensor unit acquires a first image through the first light source unit and a second image through the second light source unit. The control unit identifies a fake fingerprint on the basis of a result acquired by comparing the first image and the second image. The housing includes a light irradiating unit that fixes and supports the second light source unit to form a predetermined angle with the fingerprint contact surface.

Abstract: Disclosed are laryngoscopes and other devices that include both a visualization feature and a suction component, to eliminate debris and bodily fluids and secretions that may accumulate on the visualization component. The devices may include one or more of the fluid intake ports that may be sized and located proximate to the operational ends of the visual-aid components, e.g., the camera lens or LED, to maintain a clean field of view for operation of the component. The internal passageways of the device are configured, dimensioned and/or shaped to facilitate desired fluid flow characteristics, flow rate, and/or pressure rates and facilitate methods of manufacturing the device.