Abstract: A surface data acquisition, storage, and assessment system for detecting and quantifying similarities or differences between scanned surface data before and after the surface has been acted upon by a surface altering element.

Abstract: Determining the position and orientation (or “pose”) of an augmented reality device includes capturing an image of a scene having a number of features and extracting descriptors of features of the scene represented in the image. The descriptors are matched to landmarks in a 3D model of the scene to generate sets of matches between the descriptors and the landmarks. Estimated poses are determined from at least some of the sets of matches between the descriptors and the landmarks. Estimated poses having deviations from an observed location measurement that are greater than a threshold value may be eliminated. Features used in the determination of estimated poses may also be weighted by the inverse of the distance between the feature and the device, so that closer features are accorded more weight.

Abstract: A hand-held device for obtaining a three-dimensional topological surface profile of a tire, the device comprising: a base comprising an aperture; a light source arranged in use to generate an elongate pattern of light, and to project said pattern through the aperture onto a rolling surface of the tire; a detector arranged to image a region of the rolling surface of the tire; a plurality of pairs of guide wheels mounted on respective axles mounted on the base, wherein the guide wheels on adjacent axles are linked by gears; and a rotary encoder arranged to generate a signal corresponding to rotation of an axle.

Abstract: Methods and apparatus to generate photo-realistic three-dimensional models of a photographed environment are disclosed. An apparatus includes an object position calculator to determine a three-dimensional (3D) position of an object detected within a first image of an environment and within a second image of the environment. The apparatus further includes a 3D model generator to generate a 3D model of the environment based on the first image and the second image. The apparatus also includes a model integrity analyzer to detect a difference between the 3D position of the object and the 3D model. The 3D model generator automatically modifies the 3D model based on the difference in response to the difference satisfying a confidence threshold.

Abstract: A tangible object virtualization station including a base capable of stably resting on a surface and a head component unit connected to the base. The head component unit extends upwardly from the base. At an end of the head component opposite the base, the head component comprises a camera situated to capture a downward view of the surface proximate the base, a lighting array that directs light downward toward the surface proximate the base. The tangible object virtualization station further comprises a display interface included in the base. The display interface is configured to hold a display device in an upright position and connect the display device to the camera and the lighting array.

Abstract: In one embodiment of the present disclosure, an example system may receive a plurality of frames from at least one image sensor associated with a mobile device, at least one of the plurality of frames containing an image of a wound; display a real time video including at least a portion of the plurality of frames and a visual overlay indicating a desired position of the wound; detect, based on at least part of the plurality of frames, that the wound is in the desired position; display an indication to move the mobile device in a desired direction; receive motion data from at least one motion sensor associated with the mobile device; detect that the mobile device has moved in the desired direction; and display an additional indication on the mobile device.

Abstract: A three-dimensional facial shape estimating device (300) includes a face image acquiring unit (301) configured to acquire a plurality of image frames that capture a subject's face; a face information acquiring unit (302) having, preset therein, a predetermined number of facial feature points, the face information acquiring unit (302) being configured to acquire, for each of the plurality of image frames, face information that indicates a position of each of the predetermined number of facial feature points of the subject's face within the image frame; and a three-dimensional shape estimating unit (303) configured to perform mapping of each of the predetermined number of facial feature points of the subject's face between the plurality of image frames based on the face information of each of the plurality of image frames and to estimate the three-dimensional shape of the subject's face based on a result from the mapping.

Abstract: A method, system and computer readable storage media for visualizing to a patient a magnified dental treatment site. By obtaining raw data from a stereo camera recording a dental treatment site, an enlarged, well-lit and spatially displayed view of the dental treatment site may be visualized in real time in augmented reality and virtual reality systems for diagnoses and treatment planning.

Abstract: Disclosed is an electronic device including an image obtaining device configured to obtain at least one pieces of image data, at least one sensor to sense movement of a user, a display, at least one processor electrically connected to the image obtaining device, the at least one sensor, and the display, and a memory electrically connected to the at least one processor to store instructions that when executed, cause the processor to obtain multiple pieces of first image data through the image obtaining device while obtaining data associated with a first movement of the user through the at least one sensor, obtain multiple pieces of second image data through the image obtaining device while obtaining data associated with a second movement of the user through the at least one sensor, process the multiple pieces of first image data through a first image processing scheme corresponding to the first movement and output a processing result through the display, and process the multiple pieces of second image data thr

Abstract: A computer device and method for managing multiple electronic sensors is provided where a server receives building condition data from a motion sensor, analyzes the received data, and activates (or reconfigures) a camera sensor to capture an image of the inhabitants present within the building; the server then identifies the inhabitant of the building and retrieves profile data associated with the identified inhabitant; the server then, based on the profile data, generates an instruction to modify one or more conditions within the building (e.g., the environmental conditions of the building) and transmits the instruction to one or more devices (e.g., an environmental device) within the building.

Abstract: The embodiments disclose a method and device for liveness detection and a computer-readable storage medium. The method includes that: a first image collected by a first image sensor of a binocular camera is acquired, and a second image collected by a second image sensor of the binocular camera is acquired: binocular matching processing is performed on the first image and the second image to obtain parallax information of the first image and the second image; and a Iiveness detection result is obtained according to the parallax information. By adopting the embodiments of the present disclosure, the accuracy of liveness detection can be improved.

Abstract: Systems, methods, and devices useful in medical procedures, such as, e.g., aesthetic and/or reconstructive surgeries, are described. The system may be an imaging system that includes a database and a computer system configured to create, modify, and/or display three-dimensional images created from digital image data of an anatomical region of a subject. The digital image data may be obtained with an imaging device such as a scanner.

Abstract: Disclosed herein a method of removing a point cloud outlier and an apparatus implementing the method. The method includes: arranging a point cloud obtained from a laser scanner along at least a first direction; selecting, neighboring first-axis points, between which a separation degree satisfies an inspection start threshold condition, as a first leading-side representative point and a first trailing-side representative point; selecting a first leading-side outlier candidate and a first trailing-side outlier candidate based on a first leading-side separation degree and a first trailing-side separation degree; and determining the first leading-side outlier candidate and the first trailing-side outlier candidate as a first outlier point, when the number of the outlier candidates satisfies an allowable threshold condition.

Abstract: A method for scene reconstruction includes generating a depth estimate and a first pose estimate from a current image. The method also includes generating a second pose estimate based on the current image and one or more previous images in a sequence of images. The method further includes generating a warped image by warping each pixel in the current image based on the depth estimate, the first pose estimate, and the second pose estimate. The method still further includes controlling an action of an agent based on the second warped image.

Abstract: Provided are a data processing method and apparatus, an electronic device and a storage medium. The data processing method comprises: according to a reference depth value and an actual depth value of a key point of a target in an image, converting first 2D coordinates of the key point into second 2D coordinates, wherein the second 2D coordinates and the reference depth value constitute a first 3D feature of the key point; and based on the first 3D feature, obtaining a 3D posture of the target.

Abstract: An optical device includes a first electrode layer, a first alignment layer, a liquid crystal layer, a second alignment layer, and a second electrode layer being arranged in turn along a light transmission direction; wherein the first electrode layer comprises a first electrode, a second electrode, and a first impedance membrane arranged between the first electrode and the second electrode, and the first electrode and the second electrode are respectively arranged on opposite ends of the first impedance membrane; the second electrode layer has a structure similar to that of the first electrode layer. The four electrodes form a light transmission hole being shaped as a parallelogram. The present invention solves the problem that the focal length of the liquid crystal lens cannot be accurately adjusted due to the instability of the impedance of the impedance membrane of the present liquid crystal lens.

Abstract: A main video sequence of a live action scene is captured along with ancillary device data to provide corresponding volumetric information about the scene. The volumetric data can then be used to visually remove or replace objects in the main video sequence. A removed object is replaced by the view that would have been captured by the main video sequence had the removed object not been present in the live action scene at the time of capturing.

Abstract: An image capturing apparatus comprises a capture unit (101) for capturing images of a scene. A tracker (103) dynamically determines poses of the capture unit and a pose processor (105) determines a current pose of the capture unit (101) relative to a set of desired capture poses. The pose may include a position and orientation of the capture unit (101). A display controller (107) is coupled to the pose processor (105) and is arranged to control a display to present a current capture pose indication, the current capture pose indication comprising an indication of a position of the current pose of the capture unit (101) relative to the set of desired capture poses in a direction outside an image plane of capture unit (101). In some embodiments, the set of desired capture poses may be adaptively updated in response to data captured for the scene.

Abstract: Some embodiments of location estimation methods may (1) facilitate the task of efficiently finding the location of a mobile platform in scenarios in which the uncertainties associated with the coordinates of the map features are anisotropic and/or non-proportional, and/or (2) facilitate decoupling of location estimation from feature estimation. Some embodiments of feature estimation methods may (1) facilitate the combining of environmental descriptions provided by two or more mobile platforms, and/or (2) facilitate decoupling of a data aggregation from feature re-estimation.

Abstract: Techniques are provided for estimation of human orientation and facial pose, in images that include depth information. A methodology embodying the techniques includes detecting a human in an image generated by a depth camera and estimating an orientation category associated with the detected human. The estimation is based on application of a random forest classifier, with leaf node template matching, to the image. The orientation category defines a range of angular offsets relative to an angle corresponding to the human facing the depth camera. The method also includes performing a three dimensional (3D) facial pose estimation of the detected human, based on detected facial landmarks, in response to a determination that the estimated orientation category includes the angle corresponding to the human facing the depth camera.

Abstract: Improvement in the accuracy of estimating the position of a mobile entity even while traveling or if there is an error in the calibration performed utilizing: a mobile entity; an imaging device provided in the mobile entity; and an information processing device for determining a first movement amount by which a detection point that is the same object has moved on the basis of a first image and a second image acquired by the imaging device and a second movement amount by which the mobile entity has moved while the first image and the second image were acquired, determining the accuracy of recognizing the detection point acquired by the imaging device on the basis of the first movement amount and the second movement amount, and estimating the position of the mobile entity on the basis of the accuracy of recognition and position information that pertains to the detection point.

Abstract: A distance to an object is estimated with a monocular camera that estimates a distance from a moving object to feature points on an image from an imaging device mounted on the moving object. The distance estimator sets one or more feature points on the image acquired from the imaging device at a first timing and detects the feature point on the image acquired from the imaging device at a second timing. The distance estimator also determines the movement amount of the feature point on the image between the first timing and the second timing and determines the movement amount of the moving object between the first and second timings. The distance estimator then estimates the distance from the moving object to the feature point based on the movement amount on the image and the movement amount of the moving object between the first and second timings.

Abstract: A portable photogrammetry studio for topographical digitisation of stationary surfaces, such as human body surfaces, including at least one high-resolution digital camera to photograph said surface; one or more light sources capable of illumination of said surface; and a mechanised viewing system that is capable of providing different views of said surface to said camera; such that multiple pictures may be taken of said surface from multiple different positions by each said camera. The human body surface is prepared, preferably by coating with a texturiser.

Abstract: An information processing apparatus presenting information to an operator operating an image pickup device includes an image-pickup range setting portion setting an image pickup range over which an image can be taken by the image pickup device, a position and orientation calculation portion calculating a position and orientation of the image pickup device by using the image taken by the image pickup device, an evaluation portion evaluating an image pickup situation in the image pickup range, set by the image-pickup range setting portion, on the basis of the position and orientation calculated by the position and orientation calculation portion, and a guide information presentation portion presenting, in accordance with evaluation by the evaluation portion, guide information for guiding an operation of the image pickup device on a display device.

Abstract: A system configured to provide a three-dimensional representation of a physical environment. The three-dimensional representation including annotation data associated with particular objects and/or viewpoints of the three-dimensional representation. In some cases, the viewpoints may be rendered using image data associated with a photograph captured from a corresponding viewpoint within the physical environment.

Abstract: Disclosed herein are a movable object and a movable object control method. The movable object control method may include acquiring an image of a movable object's surroundings, acquiring a signal having strength changing depending on a location of the movable object, generating a map on the basis of the signal and the image of the surroundings of the movable object, and applying the map to an algorithm to acquire a learned algorithm.

Abstract: A process determines a position of an image capture device with respect to a physical object. The position corresponds to a vantage point for an initial image capture of the physical object performed by the image capture device at a first time. Further, the process generates an image corresponding to the position. In addition, the process displays the image on the image capture device. Finally, the process outputs one or more feedback indicia that direct a user to orient the image capture device to the image for a subsequent image capture at a second time within a predetermined tolerance threshold of the vantage point.

Abstract: An image display system is provided and includes: at least one first projection unit, configured to project rays of N images on a first plane, so that the rays of the N images are projected on N first regions of the first plane, where the N images are images of a target object photographed based on N angles, and N?2; and at least one first refraction unit, configured on the first plane, and configured to perform refraction processing on the rays of the images projected on the first regions, so that the rays of the N images are collected on a common display region. In this way, presentation of a three-dimensional image can adapt to a human eye viewing habit.

Abstract: A method and system of converting stereo video content to multi-view video content combines an Eulerian approach with a Lagrangian approach. The method comprises generating a disparity map for each of the left and right views of a received stereoscopic frame. For each corresponding pair of left and right scanlines of the received stereoscopic frame, the method further comprises decomposing the left and right scanlines into a left sum of wavelets or other basis functions, and a right sum wavelets or other basis functions. The method further comprises establishing an initial disparity correspondence between left wavelets and right wavelets based on the generated disparity maps, and refining the initial disparity between the left wavelet and the right wavelet using a phase difference between the corresponding wavelets. The method further comprises reconstructing at least one novel view based on the left and right wavelets.

Abstract: A movement assisting device includes an imaging unit to take first and second images of an imaging unit from first and second viewpoints; a first calculator to calculate, using the first and second images, first position and orientation of the imaging unit at the first viewpoint and calculate second position and orientation of the imaging unit at the second viewpoint; a second calculator to calculate, using the first and second positions and the first and second orientations, and calculate a first angle between a first axis based on a first optical axis of the imaging unit at the first viewpoint, and a second axis based on a second optical axis at the second viewpoint; a third calculator to calculate the next viewpoint positioned in direction of increase of the first angle; and an output unit to output information prompting movement of the imaging unit in direction of the next viewpoint.

Abstract: An image processing system configured to process perceived images of an environment includes a central processing unit (CPU) including a memory storage device having stored thereon a computer model of the environment, at least one sensor configured and disposed to capture a perceived environment including at least one of visual images of the environment and range data to objects in the environment, and a rendering unit (RU) configured and disposed to render the computer model of the environment forming a rendered model of the environment. The image processing system compares the rendered model of the environment to the perceived environment to update the computer model of the environment.

Abstract: A system tracks poses of a passive object using fiducial markers on fiducial surfaces of a polygonal structure of the object using image data captured by a camera. The system includes an object tracking controller that generates an estimated pose for a frame of the image data using an approximate pose estimation (APE), and then updates the estimated pose using a dense pose refinement (DPR) of pixels. The APE may include minimizing reprojection error between projected image points of the fiducial markers and observed image points of the fiducial markers in the frame. The DPR may include minimizing appearance error between image pixels of the fiducial markers in the frame and projected model pixels of the fiducial markers determined from the estimated pose and the object model. In some embodiments, an inter-frame corner tracking (ICT) of the fiducial markers may be used to facilitate the APE.

Abstract: An image pickup apparatus, includes a first optical system and a second optical system which generate two optical images having mutual parallax; and one image sensor which captures the two optical images, wherein each of the first optical system and the second optical system has a different focusing unit, further includes a first frame which holds some of lenses in the first optical system, a second frame which holds the image sensor; and a third frame which holds lenses in the first optical system other than the lenses held by the first frame, and lenses in the second optical system, wherein the first frame is movable in a direction of optical axes with respect to the third frame, and the second frame is movable in a direction of optical axes with respect to the third frame.

Abstract: A system for allowing a virtual object to interact with other virtual objects across different spaces within an augmented reality (AR) environment and to transition between the different spaces is described. An AR environment may include a plurality of spaces, each comprising a bounded area or volume within the AR environment. In one example, an AR environment may be associated with a three-dimensional world space and a two-dimensional object space corresponding with a page of a book within the AR environment. A virtual object within the AR environment may be assigned to the object space and transition from the two-dimensional object space to the three-dimensional world space upon the detection of a space transition event. In some cases, a dual representation of the virtual object may be used to detect interactions between the virtual object and other virtual objects in both the world space and the object space.

Abstract: Some systems include a memory, and a processor coupled to the memory, wherein the processor is configured to: identify one or more spatial markers in a medical data-based image of a patient, identify one or more spatial markers in a real-time perceived image of the patient, wherein the one or more spatial markers in the medical data-based image correspond to an anatomical feature of the patient and the one or more spatial markers in the real-time perceived image correspond to the anatomical feature of the patient, superimpose the medical data-based image of the patient with the real-time perceived image of the patient, and align the one or more spatial markers in the medical data-based image with the respective one or more spatial markers in the real-time perceived image.

Abstract: A system for acquiring a 3D digital representation of a physical object, the system comprising: A scanning station comprising an object support for receiving a physical object; an image capturing device operable to capture two or more images of a physical object when the physical object is placed on the object support, wherein the two or more images are taken from different view points relative to the physical object; and a processor configured to process the captured two or more images and to create a 3D digital model of the physical object.

Abstract: Systems and methods for analyzing image data to automatically ensure image capture consistency are described. According to certain aspects, a server may access aerial and other image data and identify a set of parameters associated with the capture of the image data. The server may access a corresponding set of acceptable image capture parameters, and may compare the set of parameters to the set of acceptable parameters to determine whether image data is consistent with the set of acceptable parameters. In some embodiments, if the image data is not consistent, the server may generate a notification or instruction to cause an image capture component to recapture additional image data.

Abstract: A candidate human head is found in depth video using a head detector. A head region of light intensity video is spatially resolved with a three-dimensional location of the candidate human head in the depth video. Facial recognition is performed on the head region of the light intensity video using a face recognizer.

Abstract: A sensor apparatus may include an array of protruding members that each extend outward in a different radial direction from a central axis, each protruding member including a projector that projects structured light into a local environment, one or more cameras that capture reflections of the structured light from the local environment, and another camera that captures visible-spectrum light from the local environment. The sensor apparatus may also include one or more localization devices for determining a location of the sensor apparatus. Various other apparatuses, systems, and methods are also disclosed.

Abstract: A camera system captures images from a set of cameras to generate binocular panoramic views of an environment. The cameras are oriented in the camera system to maximize the minimum number of cameras viewing a set of randomized test points. To calibrate the system, matching features between images are identified and used to estimate three-dimensional points external to the camera system. Calibration parameters are modified to improve the three-dimensional point estimates. When images are captured, a pipeline generates a depth map for each camera using reprojected views from adjacent cameras and an image pyramid that includes individual pixel depth refinement and filtering between levels of the pyramid. The images may be used to generate views of the environment from different perspectives (relative to the image capture location) by generating depth surfaces corresponding to the depth maps and blending the depth surfaces.

Abstract: A smartphone may be freely moved in three dimensions as it captures a stream of images of an object. Multiple image frames may be captured in different orientations and distances from the object and combined into a composite image representing an three-dimensional image of the object. The image frames may be formed into the composite image based on representing features of each image frame a set of points in a three dimensional depth map. Coordinates of the points in the depth map may be estimated with a level of certainty. The level of certainty may be used to determine which points are included in the composite image. The selected points may be smoothed and a mesh model may be formed by creating a convex hull of the selected points. The mesh model and associated texture information may be used to render a three-dimensional representation of the object on a two-dimensional display.

Abstract: Different full screen content is displayed on the same television at the same time from the perspective of the viewer by displaying as the content as two full screen sequential frames. The different full screen content may be provided as a single combined frame signal such as a side-by-side, top-bottom, or checkerboard signal which is then displayed as two sequential full screen frames. Configured glasses such as polarized or shutter are used to view the different content as full screen content where one pair of configured glasses views an initial one of the sequential frames but blocks the subsequent one and another pair of configured glasses blocks the initial one of the sequential frames and views the subsequent one. Shutter glasses have both lenses open during the initial frame and both closed during the subsequent one. For polarized glasses, the initial frame has a polarization matching both lenses of one pair of glasses while the subsequent frame has a polarization that differs from both lenses.

Abstract: Some embodiments of location estimation methods may (1) facilitate the task of efficiently finding the location of a mobile platform in scenarios in which the uncertainties associated with the coordinates of the map features are anisotropic and/or non-proportional, and/or (2) facilitate decoupling of location estimation from feature estimation. Some embodiments of feature estimation methods may (1) facilitate the combining of environmental descriptions provided by two or more mobile platforms, and/or (2) facilitate decoupling of a data aggregation from feature re-estimation.

Abstract: A movement recognition system includes an inertial sensor, a depth sensor, and a processor. The inertial sensor is coupled to an object and configured to measure a first unit of inertia of the object. The depth sensor is configured to measure a three dimensional shape of the object using projected light patterns and a camera. The processor is configured to receive a signal representative of the measured first unit of inertia from the inertial sensor and a signal representative of the measured shape from the depth sensor and to determine a type of movement of the object based on the measured first unit of inertia and the measured shape utilizing a classification model.

Abstract: A method is provided for calibrating a stereo imaging system by using at least one camera and a planar mirror. The method involves obtaining at least two images with the camera, each of the images being captured from a different camera position and containing the mirror view of the camera and a mirror view of an object, thereby obtaining multiple views of the object. The method further involves finding the center of the picture of the camera in each of the images, obtaining a relative focal length of the camera, determining an aspect ratio in each of the images, determining the mirror plane equation in the coordinate system of the camera, defining an up-vector in the mirror's plane, selecting a reference point in the mirror's plane, determining the coordinate transformation from the coordinate system of the image capturing camera into the mirror coordinate system, and determining a coordinate transformation.

Abstract: Described embodiments provide a method of generating an image of a region of interest of a target object. A plurality of concentric circular scan trajectories are determined to sample the region of interest. Each of the concentric circular scan trajectories have a radius incremented from an innermost concentric circular scan trajectory having a minimum radius to an outermost concentric circular scan trajectory having a maximum radius. A number of samples are determined for each of the concentric circular scan trajectories. A location of each sample is determined for each of the concentric circular scan trajectories. The locations of each sample are substantially uniformly distributed in a Cartesian coordinate system of the target object. The target object is iteratively rotated along each of the concentric circular scan trajectories and images are captured at the determined sample locations to generate a reconstructed image from the captured images.

Abstract: An apparatus and method for measuring the position of a stereo camera. The apparatus for measuring a position of the camera according to an embodiment includes a feature point extraction unit for extracting feature points from images captured by a first camera and a second camera and generating a first feature point list based on the feature points, a feature point recognition unit for extracting feature points from images captured by the cameras after the cameras have moved, generating a second feature point list based on the feature points, and recognizing actual feature points based on the first feature point list and the second feature point list, and a position variation measurement unit for measuring variation in positions of the cameras based on variation in relative positions of the actual feature points.

Abstract: A three-dimensional shape measurement apparatus includes an imaging unit that successively outputs two-dimensional images captured, a memory unit that stores the two-dimensional images outputted by the imaging unit, a three-dimensional shape model generation unit which generates a three-dimensional shape model, based on the two-dimensional images and stores the three-dimensional shape model in the memory unit, a region calculation unit that calculates, based on the two-dimensional images and the three-dimensional shape model stored in the memory unit, a measurement-completed region in the two-dimensional images, and a display image generation unit that generates, based on the measurement-completed region, a display image from the two-dimensional images.

Abstract: Methods and apparatuses are disclosed for assisting a user in performing a three dimensional scan of an object. An example user device to assist with scanning may include a processor. The user device may further include a scanner coupled to the processor and configured to perform a three dimensional scan of an object. The user device may also include a display to display a graphical user interface, wherein the display is coupled to the processor. The user device may further include a memory coupled to the processor and the display, the memory including one or more instructions that when executed by the processor cause the graphical user interface to display a target marker for a three dimensional (3D) scan and display a scanner position marker to assist in moving the scanner to a preferred location and direction.

Abstract: A method of colorizing a 3D point cloud includes receiving the 3D point cloud, receiving a 2D color image acquired by a camera, creating a 2D intensity image of the 3D point cloud based on intrinsic and extrinsic parameters of the camera, generating a set of refined camera parameters by matching the 2D intensity image and the 2D color image, creating a depth buffer for the 3D point cloud using the set of refined camera parameters, determining a foreground depth for each respective pixel of the depth buffer, and coloring the point cloud by, for each respective point of the 3D point cloud: upon determining that the respective point is in the foreground, assigning a color of a corresponding pixel in the 2D color image to the respective point; and upon determining that the respective point is not in the foreground, not assigning any color to the respective point.