Abstract: An enhanced control, in which a guide line is defined relative to an object in a user interface, items aligned with the guide line are displayed without obscuring the object. A selected item is output based on receiving a selection of one of the displayed items.

Abstract: Methods, apparatus, systems, and articles of manufacture to optimize pipeline execution are disclosed. An example apparatus includes at least one memory, machine readable instructions, and processor circuitry to execute the machine readable instructions to determine a value associated with a first location of a first pixel of a first image and a second location of a second pixel of a second image by calculating a matching cost between the first location and the second location, generate a disparity map including the value, and determine a minimum value based on the disparity map corresponding to a difference in horizontal coordinates between the first location and the second location.

Abstract: A six degrees of freedom (6 DoF) positioning tracking device and method, and an electronic apparatus are provided. The device includes at least three tracking cameras, an inertial navigation unit and a computation processing unit, where the at least three tracking cameras are distributed at preset angles and are configured to obtain image data in a current environment and transmit the image data to the computation processing unit; the inertial navigation unit is configured to obtain state information of the 6 DoF positioning tracking device in the current environment and transmit the state information to the computation processing unit; and the computation processing unit is configured to determine 6 DoF data of the 6 DoF positioning tracking device relative to the current environment according to the image data and the state information.

Abstract: A distance estimation system comprised of a laser light emitter, two image sensors, and an image processor are positioned on a baseplate such that the fields of view of the image sensors overlap and contain the projections of an emitted collimated laser beam within a predetermined range of distances. The image sensors simultaneously capture images of the laser beam projections. The images are superimposed and displacement of the laser beam projection from a first image taken by a first image sensor to a second image taken by a second image sensor is extracted by the image processor. The displacement is compared to a preconfigured table relating displacement distances with distances from the baseplate to projection surfaces to find an estimated distance of the baseplate from the projection surface at the time that the images were captured.

Abstract: A detector (110) for determining at least one material property of at least one object (112) is proposed.

Abstract: An electronic apparatus is provided. The electronic apparatus according to the disclosure may include a memory configured to store instructions, and a processor configured to execute the instructions to control a display to display an image captured via a camera, and a first guideline, recognize an object in the image based on the first guideline, render a virtual object to replace the object, generate an augmented reality image including the virtual object that is located in an area where the object is located in the image; and control the display to display the augmented reality image.

Abstract: An image processing method includes: calculating a rotation matrix to eliminate vertical parallax by converting stereo image captured by stereo camera as if it is image captured by camera rotated about an origin of camera coordinate system, wherein the stereo image includes left image obtained by left camera and right image obtained by right camera; calculating a rotation matrix to adjust the horizontal parallax of the left image and a rotation matrix to adjust the horizontal parallax of the right image; calculating a geometric transformation matrix for the stereo image based on each camera characteristic matrix representing lens characteristics, the rotation matrix for eliminating vertical parallax, and the rotation matrices for adjusting horizontal parallax; and generating new stereo image in which vertical parallax is eliminated and horizontal parallax is adjusted by performing image warping for the stereo image captured by the stereo camera based on the calculated geometric transformation matrix.

Abstract: An electronic device includes a display screen, a first lens module, a fingerprint sensor, and a first driving mechanism. The first lens module, the fingerprint sensor, and the first driving mechanism are disposed close to a non-display surface of the display screen. The fingerprint sensor is configured to receive an optical signal transmitted through the display screen and the first lens module to collect fingerprint information. The first driving mechanism is configured to drive the first lens module to move, so as to change a fingerprint information collection area of the fingerprint sensor.

Abstract: Embodiments are directed to a sensing system that employs beams to scan paths across an object such that sensors may the beams reflected by the scanned object. Events may be provided based on the detected signals and the paths such that each event may be associated with a sensor and event metrics. Crossing points for each sensor may be determined based on where the paths intersect the scanned object such that events associated with each sensor are associated with the crossing points for each sensor. Each crossing point of each sensor may be compared to each correspondent crossing point of each other sensor. actual crossing points may be determined based on the comparison and the crossing points for each sensor. Position information for each sensor may be determined based on the actual crossing points.

Abstract: There is provided a control device including: a control unit that performs driving control of a vehicle. The control unit temporarily continues automated traveling of the vehicle on a basis of a surrounding environment estimated by a remaining function of a compound eye camera, in a case where a malfunction of the compound eye camera used in recognition of the surrounding environment is detected during execution of automated driving control for the vehicle.

Abstract: An optical imaging device for a microscope comprises a first optical system configured to form a first optical image corresponding to a first region of a sample in accordance with a first imaging mode, a second optical system configured to form a second optical image corresponding to a second region of said sample, wherein said first and second regions spatially coincide in a target region of said sample and said first and second imaging modes are different from each other, a memory storing first distortion correction data suitable for correcting a first optical distortion caused by said first optical system in said first optical image, second distortion correction data suitable for correcting a second optical distortion caused by said second optical system in said second optical image, and transformation data suitable for correcting positional misalignment between said first and second optical images, and a processor which is configured to process first image data representing said first optical image based

Abstract: The present invention discloses a multiple camera sensor system and a method for any application and for a large number of different fields. The present invention is solving certain problems related to existing camera technology issues by introducing the possibility of getting several different camera inputs from the same source or moving shots/images without physically moving any cameras. It will minimize the physical presence of existing camera technology, size, weight and design and also to large extent avoid physical laws like gravity, vibrations, acceleration, retardation and speed. This may be implemented by means of a software virtually moving camera using multiple cameras sensors mounted consecutively along some attachment solution. This attachment solution may include e.g. tape or strips. The invention can be utilized in areas like industry and production support, medical appliances, AV production, Video Conferencing, Broadcast, Surveillance and Security among others.

Abstract: A high-speed optical tracking with compression and CMOS windowing for tracking applications that require high-speed and/or low latency when delivering pose (orientation and position) data. The high-speed optical tracking with compression and CMOS windowing generally includes an optical tracking system (10) that sense fiducial (22) and by extension markers (20). The markers can either be integrated on tools (20) handled by an operator (e.g. surgeon) (50) or fixed on the subject to track (e.g. patient) (40). The low-level processing (101, 107, 140) is realized within the tracking system to reduce the overall data to be transferred and considerably reduce the processing efforts. Pose data (127) are finally computed and transferred to a PC/monitor (30,31) or to tablet (60) to be used by an end-user application (130).

Abstract: Systems, devices and methods for augmented reality guidance of surgical procedures using multiple head mounted displays or other augmented reality display devices are described. In addition, systems, devices and methods using head mounted displays or other augmented reality display systems for operating surgical robots and/or imaging systems are described.

Abstract: A behavior control system includes: a behavior control device for changing a behavior of a moving body; an imaging device for acquiring images ahead of the moving body; and a control device for controlling the behavior of the moving body based on the images acquired by the imaging device. The control device includes: a feature point extraction unit configured to extract feature points from the images acquired by the imaging device; a straight moving state storing unit configured to store, as a reference feature point state, a feature point state when the moving body is in a straight moving state, the feature point state being obtained based on a temporal change of the feature points; and a moving body control unit configured to control the behavior control device when the feature point state obtained based on the temporal change of the feature points differs from the reference feature point state.

Abstract: Devices, systems, and methods are provided for enhanced sensor alignment. A device may determine a first array of displacement sensors proximate to a first test structure. The device may determine a second array of displacement sensors proximate to a second test structure. The device may apply a test condition to the first array, the second array, the first test structure, and the second test structure. The device may collect a first output from applying the test condition to the first test structure. The device may collect a second output from applying the test condition to the second test structure. The device may generate a first deviation vector associated with the first output. The device may generate a second deviation vector associated with the second output. The device may determine a first design status of the first structure based on the first deviation vector. The device may determine a second design status of the second structure based on the second deviation vector.

Abstract: Calibrating cameras in a rig, including: projecting light patterns onto surfaces of objects in a capture volume; capturing image data of the light patterns projected onto the surfaces of the objects using the cameras; and processing the captured image data to estimate a calibration data of the cameras, wherein processing the image data to estimate the calibration data includes measuring distortions in the light patterns.

Abstract: A wearable display system can automatically recognize a physical remote or a device that the remote serves using computer vision techniques. The wearable system can generate a virtual remote with a virtual control panel viewable and interactable by user of the wearable system. The virtual remote can emulate the functionality of the physical remote. The user can select a virtual remote for interaction, for example, by looking or pointing at the parent device or its remote control, or by selecting from a menu of known devices. The virtual remote may include a virtual button, which is associated with a volume in the physical space. The wearable system can detect that a virtual button is actuated by determining whether a portion of the user's body (e.g., the user's finger) has penetrated the volume associated with the virtual button.

Abstract: A method for controlling a robotic arm in a robotic surgical system includes defining a reference plane at a predetermined reference location for a robotic arm, where the robotic arm includes a plurality of joints, and driving at least one of the plurality of joints to guide the robotic arm through a series of predetermined poses substantially constrained within the reference plane.

Abstract: Embodiments are directed to a sensing system that employs beams to scan paths across an object such that sensors may the beams reflected by the scanned object. Events may be provided based on the detected signals and the paths such that each event may be associated with a sensor and event metrics. Crossing points for each sensor may be determined based on where the paths intersect the scanned object such that events associated with each sensor are associated with the crossing points for each sensor. Each crossing point of each sensor may be compared to each correspondent crossing point of each other sensor. Actual crossing points may be determined based on the comparison and the crossing points for each sensor. Position information for each sensor may be determined based on the actual crossing points.

Abstract: A teleoperated system includes a master grip and a ratcheting system coupled to the master grip. The ratcheting system is configured to align the master grip with a slave instrument commanded by the master grip by determining grip rotation values describing an orientation of the master grip, determining instrument rotation values describing an orientation of the instrument, determining an orientation error between an orientation of the master grip and the orientation of the instrument based on the grip rotation values and the instrument rotation values, and reducing the orientation error by low pass filtering the grip rotation values or the instrument rotation values.

Abstract: A computer-implemented medical data processing method for controlling a geometric status of a mechatronic articulable arm. Current geometric status data is acquired describing a current geometric status of the mechatronic articulable arm defined by a set of current spatial relationship between connected elements of the mechatronic articulable arm. Changed geometric status data describing a changed geometric status of the mechatronic articulable arm defined by a set of changed spatial relationship between the connected elements is determined based on current device position data, the current geometric status data, changed device position data, and device definition data. Instruction data describing an instruction for changing the geometric status of the mechatronic articulable arm from the current geometric status to the changed geometric status is determined. The instruction describes changes from the current spatial relationship to the changed spatial relationship.

Abstract: A system includes a manipulator arm configured to support an instrument having an end effector, the manipulator arm including a distal portion, a proximal portion coupled to a base, and a multitude of joints between the distal portion and the base, the multitude of joints providing sufficient degrees of freedom to allow a range of differing joint states of the multitude of joints for a state of the distal portion. The system also includes a processor coupled to the manipulator arm. The processor is configured with a manipulation mode and a clutch mode, the clutch mode selected from the group consisting of: an arm-null-perpendicular-clutch mode, a port-null-perpendicular-clutch mode, and an arm-port-null-perpendicular-clutch mode. The processor is configured to operate the multitude of joints in accordance with at least one of the manipulation mode and the various clutch modes.

Abstract: The present invention is directed to a tool having a wrist mechanism that provides pitch and yaw rotation in such a way that the tool has no singularity in roll, pitch, and yaw. In one embodiment, a minimally invasive surgical instrument includes an elongate shaft having a working end, a proximal end, and a shaft axis between the working end and the proximal end; and an end effector. A wrist member has a flexible tube including an axis extending through an interior surrounded by a wall. The wall of the flexible tube includes a plurality of lumens oriented generally parallel to the axis of the flexible tube. The wrist member has a proximal portion connected to the working end of the elongate shaft and a distal portion connected to the end effector.

Abstract: Optical center calibration may include obtaining one or more parameters for optical center calibration, obtaining an input image captured by an image capture device using a lens, and determining a calibration circle using the parameters and the input image. Determining the calibration circle may include extracting rays using the input image, estimating contours using the input image and the rays, and estimating the calibration circle using the input image and the contours. The calibration may be iteratively improved by repeating calibration based on the input image and a previous iteration of optical center calibration.

Abstract: An image processing device includes a rotation processor, a parallax image generator, and a rotation controller. The rotation processor makes rotation processing including rotating first left and right images in a stereo image, to generate second left and right images. The parallax image generator calculates corresponding left and right image points in the second left and right images, to generate a parallax image. The rotation controller obtains a coordinate point to calculate an amount of angular change in a rotation angle in the rotation processing. The coordinate point indicates relation of a first positional difference in a horizontal direction and a second positional difference in a vertical direction, between first and second positions. The first and second positions are respective positions of the left and right image points in the second left and right images.

Abstract: An electronic apparatus is provided. The electronic apparatus according to the disclosure may include a memory configured to store instructions, and a processor configured to execute the instructions to control a display to display an image captured via a camera, and a first guideline, recognize an object in the image based on the first guideline, render a virtual object to replace the object, generate an augmented reality image including the virtual object that is located in an area where the object is located in the image; and control the display to display the augmented reality image.

Abstract: A camera system includes: a first camera and a second camera; a camera adaptor box; and a camera control unit.

Abstract: A method, a processing device, and a system for object tracking are proposed. The method includes the following steps. Imaging capturing is performed on an actual scene by using a primary camera and at least one secondary camera to respectively generate a primary image and at least one secondary image. Image stacking is performed on the primary image and the at least one secondary image to generate a stacked image. Position information and depth information of each object in the stacked image are computed. Whether there exist same objects among the objects in the stacked images is determined based on the position information and the depth information of each of the objects.

Abstract: A terminal such as a folding-screen smartphone includes a first body and a second body; a rotating shaft coupled to the first body and the second body, and configured to change an angle between the first body and the second body through rotation of the rotating shaft. The terminal also includes a first camera in the first body configured to photograph a target object and obtain a first image in response to a photographing instruction and a second camera in the second body configured to photograph the target object and obtain a second image in response to the photographing instruction. A processing component coupled to the first body and the second body is configured to determine the angle between the first body and the second body and obtain a target image by splicing the first image and the second image according to the angle.

Abstract: A grossing station comprising a table and a hood connected to the table. The grossing station also comprises a quick release camera system secured to a surface of the hood, wherein the quick release camera system is detachable from the hood for close up angles and zoomed location still or video images of the body or material being examined on a surface of the grossing station.

Abstract: A method for dynamically measuring deformation of a rotating-body mold, including: (S1) subjecting an overall outer surface of the rotating-body mold to three-dimensional measurement to acquire an initial point cloud data; (S2) shooting, by a multi-camera system, the mold from different angles to obtain three-dimensional coordinates of marking points and coding points on the overall outer surface of the rotating-body mold; (S3) rotating the mold, and repeatedly photographing the marking points and the coding points on the mold surface under different angle poses; and calculating three-dimensional coordinates of the marking points and the coding points; and (S4) predicting a point cloud data of the outer surface under different angle poses based on a conversion relationship among the marking points to analyze a deformation degree of the mold during a rotation process.

Abstract: Systems and methods are provided for producing a road layout model. The method includes capturing digital images having a perspective view, converting each of the digital images into top-down images, and conveying a top-down image of time t to a neural network that performs a feature transform to form a feature map of time t. The method also includes transferring the feature map of the top-down image of time t to a feature transform module to warp the feature map to a time t+1, and conveying a top-down image of time t+1 to form a feature map of time t+1. The method also includes combining the warped feature map of time t with the feature map of time t+1 to form a combined feature map, transferring the combined feature map to a long short-term memory (LSTM) module to generate the road layout model, and displaying the road layout model.

Abstract: The three-dimensional measurement apparatus includes a light projecting unit projects, onto a target, a pattern in which data is encoded, an image capturing unit captures an image of the target onto which the pattern is projected, and a calculation unit calculates positions of a three-dimensional point group based on positions of the feature points and the decoded data, in which the pattern includes unit patterns that each expresses at least two bits and are used in order to calculate the positions of the three-dimensional point group, the unit patterns each includes a first region and a second region that has an area that is larger than an area of the first region, and an area ratio between the first region and the second region is at least 0.3 and not more than 0.9.

Abstract: A space registration system includes a display apparatus, an image sensor, a processor, and a plane mirror. The display apparatus has an inherent display coordinate system which defines a coordinate of the virtual space. The image sensor has an inherent sensor coordinate system which defines a coordinate of the real space. The processor analogizes a transformation equation of the sensor coordinate system and the display coordinate system by means of symmetry of an incidence angle and a reflection angle of light with respect to the mirror surface, compares a coordinate of the reflection image with respect to the display coordinate system with a known coordinate of the reflection image with respect to the sensor coordinate system, and adjusts the transformation equation of the sensor coordinate system and the display coordinate system.

Abstract: A calibration apparatus for executing a camera calibration for each of a plurality of cameras mounted on an object so that image capturing ranges of two of the plurality of cameras overlap each other, the calibration apparatus includes an image obtaining unit configured to obtain first and second images captured by the two cameras, a temporary link structure forming unit configured to form a temporary link structure by using the first and second images including images of markers sets, a link angle determining unit configured to determine an effective link angle to form an effective link structure from the temporary link structure, and a parameter determining unit configured to determine a parameter for positioning at least one of the cameras on the basis of the effective link angle.

Abstract: A control processing unit simultaneously drives cameras to produce images of a measuring object, the control processing unit searches corresponding point on a comparative image produced by one of the cameras for a representative point in a reference image produced by the other camera, and the control processing unit computes a three-dimensional coordinate corresponding to a coordinate using the coordinate of each point correlated by the search. The control processing unit also obtains a shift amount at the corresponding point specified by the search to an epipolar line specified based on a coordinate of a representative point on the reference image side or a parameter indicating a relationship between the cameras, and the control processing unit supplies the shift amount as an evaluation value indicating accuracy of three-dimensional measurement along with three-dimensional measurement result.

Abstract: Disclosed is a camera module and a method for compensating images of the camera module, the method including: photographing respective images by a main camera mounted with an OIS unit and a sub camera; extracting a first image of a particular subject using the image photographed by the main camera, and extracting a second image of the particular subject using the image photographed by the sub camera; and driving the OIS unit of the main camera to compensate images so that the first image can be matched to the second image.

Abstract: There is provided a calibration apparatus for a camera module capable of calibrating the difference in optical characteristics between left and right images of a binocular camera module in real time by capturing images of a plurality of rotating test boards. The calibration apparatus of a camera module includes: a test unit including two or more mutually connected test boards, the test boards having images captured by a camera module and rotating at a pre-set angle; and a calibration unit receiving the images of the test boards captured by the camera module and calibrating optical characteristics thereof.

Abstract: Disclosed herein are an apparatus and method for correcting an error in a stereoscopic image. The apparatus includes two cameras, a region extraction unit, a phase difference calculation unit, an error value extraction unit, and an error analysis unit. The cameras capture left and right images forming the stereoscopic image. The region extraction unit extracts the main regions of interest from each of the images. The phase difference calculation unit calculates the difference in phase between the main regions of interest of the left image and the main regions of interest of the right image. The error value extraction unit extracts the value of a camera disposition error, corresponding to locations of the two cameras, based on the difference in phase. The error analysis unit determines whether the value of the camera disposition error is within a set range, and corrects the error in the stereoscopic image.

Abstract: Online camera calibration methods have been proposed whereby calibration information is extracted from the images that the system captures during normal operation and is used to continually update system parameters. However, such existing methods do not cope well with structure-poor scenes having little texture and/or 3D structure such as in a home or office environment. By considering camera families (a set of cameras that are manufactured at least partially in a common manner) it is possible to provide calibration methods which are suitable for use with structure-poor scenes. A prior distribution of camera parameters for a family of cameras is estimated and used to obtain accurate calibration results for individual cameras of the camera family even where the calibration is carried out online, in an environment which is structure-poor.