Abstract: A system for testing and/or training the vision of a user is disclosed herein. The system includes at least one camera, a visual display device having an output screen, and a data processing device operatively coupled to the at least one camera and the visual display device. In one embodiment, the data processing device is programmed to determine a head position, head velocity, and/or head speed of a user during a vision test or vision training routine from a plurality of images of the head of the user captured by the at least one camera. In another embodiment, the data processing device is programmed to determine, based upon an input signal received from a user input device, a contrast display setting for a screen background relative to at least one visual target, the contrast display setting enabling the user to gradually adapt to increasing levels of visual stimulation.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for rendering three-dimensional virtual objects within real-world environments. Virtual rendering of a three-dimensional virtual object can be altered appropriately as a user moves around the object in the real-world through utilization of a redundant tracking system comprising multiple tracking sub-systems. Virtual object rendering can be with respect to a reference surface in a real-world three-dimensional space depicted in a camera view of a mobile computing device.

Abstract: A method and system for automatically processing point cloud based on reinforcement learning are provided. The method for automatically processing point cloud based on reinforcement learning according to an embodiment of the present disclosure includes scanning to collect a point cloud (PCL) and an image through a lidar and a camera; calibrating, by a controller, to match locations of the image and the point cloud through reinforcement learning that maximizes a reward including geometric and luminous intensity consistency of the image and the point cloud; and meshing, by the controller, the point cloud into a 3D image through reinforcement learning that minimizes a reward including a difference between a shape of the image and a shape of the point cloud.

Abstract: Various implementations disclosed herein include devices, systems, and methods that render a reflective surface of a computer-generated reality (“CGR”) object based on synthesis in a CGR environment. In order to render a reflective surface of the CGR object, one exemplary implementation involves synthesizing an environment map of a CGR environment representing a portion of a physical scene based on observed characteristics of the physical scene. In an implementation, generation of a complete environment map includes identifying pixels of the environment map with no corresponding texture and generating synthesized texture based on textural information associated with one or more camera images of the physical scene. In an implementation, a CGR object is rendered in the CGR environment, wherein an appearance of a reflective surface of the CGR object is determined based on the complete environment map of the CGR environment.

Abstract: An optical device can include: an incident light polarizer positioned to receive incident light and configured to polarize incident light such that polarized incident light is directed to a cornea of a subject; at least one corneal light polarizer, wherein the at least one corneal light polarizer is positioned to receive reflected light from the cornea of the subject and polarize the reflected light to a second polarization; at least one rotating mechanism; and at least one receiver. The receiver can be at least one viewing port optically coupled with the at least one corneal light polarizer or an imaging device (e.g., optical detector). The at least one rotating mechanism is: coupled with the incident light polarizer; coupled with the at least one corneal light polarizer; or coupled with the incident light polarizer and the at least one corneal light polarizer.

Abstract: An ophthalmologic apparatus includes an optical scanner, an interference optical system, an intraocular distance calculator, an image correcting unit, and a controller. The optical scanner is disposed at an optically substantially conjugate position with a first site of a subject's eye. The interference optical system is configured to split light from a light source into reference light and measurement light, to project the measurement light onto the subject's eye via the optical scanner, and to detect interference light between returning light of the light from the subject's eye and the reference light via the optical scanner. The image forming unit is configured to form a tomographic image of the subject's eye corresponding a first traveling direction of the measurement light deflected by the optical scanner, based on a detection result of the interference light.

Abstract: A pupil tracking system including a light source for illuminating a viewer's eye, an aperture located to pass light from the light source after retro-reflection from the viewer's pupil, the aperture sized and shaped to pass the light from the light source and block at least a portion of other light arriving at the aperture, and a light sensor for tracking a location of a spot produced by the light from the light source which passed the aperture. Related apparatus and methods are also described.

Abstract: Embodiments of the present invention are directed to facilitating region of interest preservation. In accordance with some embodiments of the present invention, a region of interest preservation score using adaptive margins is determined. The region of interest preservation score indicates an extent to which at least one region of interest is preserved in a candidate image crop associated with an image. A region of interest positioning score is determined that indicates an extent to which a position of the at least one region of interest is preserved in the candidate image crop associated with the image. The region of interest preservation score and/or the preserving score are used to select a set of one or more candidate image crops as image crop suggestions.

Abstract: A method and system for acquiring images of a target area by acquiring (S1) a first image of the target area with a first image sensor; acquiring (S2) a second image of said target with a second image sensor; and preprocessing the first and second images by 1) performing a spatial 5 transform (S3) at least one of said first and second images in order to compensate for different image acquisition angles, and 2) at least partly removing (S4) undesired reflexes from the first and second images to form first and second reflex reduced images. With the present invention, it is still possible to eliminate or reduce 10 unwanted reflexes, even though the viewing angles of the two frames are different.

Abstract: In some embodiments, a synthetic (virtual) orthopedic treatment device (e.g. a virtual external fixator representing a physical fixator attachable to a patients anatomic structure) is displayed concurrently in two views (e.g. anterior-posterior and lateral) along corresponding digital medical images (e.g. X-rays), and rotation/translation user input received along one of the images is used to concurrently control both displays of the orthopedic treatment device to reflect the rotation/translation user input.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for rendering three-dimensional virtual objects within real-world environments. Virtual rendering of a three-dimensional virtual object can be altered appropriately as a user moves around the object in the real-world through utilization of a redundant tracking system comprising multiple tracking sub-systems. Virtual object rendering can be with respect to a reference surface in a real-world three-dimensional space depicted in a camera view of a mobile computing device.

Abstract: Disclosed are various examples for augmented reality based image protection in enterprise settings. In one example, a managed camera application can generate an artificial reality based camera user interface using image data from a field of view of a camera. An indoor position can be identified using global positioning system (GPS) and indoor positioning data. A sector of the field of view can be identified as a protected image area that depicts a protected or confidential object, and the user interface can be updated to include an AR user interface element that is generated relative to the protected image area that is identified.

Abstract: Examples are disclosed that relate to utilizing image sensor inputs from different devices having different perspectives in physical space to construct an avatar of a first user in a video stream. The avatar comprises a three-dimensional representation of at least a portion of a face of the first user texture mapped onto a three-dimensional body simulation that follows actual physical movement of the first user. The three-dimensional body simulation of the first user is generated based on image data received from an imaging device and image sensor data received from a head-mounted display device both associated with the first user. The three-dimensional representation of the face of the first user is generated based on the image data received from the imaging device. The resulting video stream is sent, via a communication network, to a display device associated with a second user.

Abstract: The present invention relates to a method to provide a mean temporal spatial isochrone (TSI) path relating to an ECG feature (wave form) of interest, such as the activation of the heart from a single point (QRS), relative to the heart in a torso while using an ECG measurement from an ECG recording device.

Abstract: Certain example embodiments relate to an electronic device, including a user interface, and processing resources including at least one processor and a memory. The memory stores a program executable by the processing resources to simulate a view of an image through at least one viewer-selected product that is virtually interposed between a viewer using the electronic device and the image by performing functionality including: acquiring the image; facilitating viewer selection of the at least one product in connection with the user interface; retrieving display properties associated with the at least one viewer-selected product; generating, for each said viewer-selected product, a filter to be applied to the acquired image based on retrieved display properties; and generating, for display via the electronic device, an output image corresponding to the generated filter(s) being applied to the acquired image. The electronic device in certain example embodiments may be a smartphone, tablet, and/or the like.

Abstract: An artificial potential field path planning method and an apparatus based on obstacle classification solve the problem of path and motion uncertainty in steering a flexible needle in soft tissue. The apparatus includes an image sensing system, a control module, an execution system and an upper PC. Using the apparatus, the method includes: the image sensing system obtains real-time images of the puncture environment, identifies a target and obstacles from the real-time images, classifies the obstacles, and calculates total potential energy of points in the current environment based on artificial potential field. With a curvature constraint and an optimization index for the flexible needle, the path planning module carries out static path planning to obtain an initial path and the needle entry point, then conducts dynamic path planning to determine the path for steering the flexible needle in the soft tissue accordingly.

Abstract: A system for ocular assistance is disclosed. The plurality of subsystem includes an ocular condition registration subsystem, configured to register one or more users. The plurality of subsystem includes an ocular calibration subsystem, configured to determine a plurality of ocular settings. The plurality of subsystem includes a device configuration identification subsystem, configured to determine a plurality of device settings for each of one or more device associated with the registered one or more users. The plurality of subsystem includes a screen customization subsystem, configured to determine values corresponding to the plurality of ocular settings based on a pre-stored look up table and determined plurality of device settings. The screen customization subsystem modifies current values corresponding to the plurality of ocular settings to the determined values. The system modifies or rectifies the screen images or texts for suffering users.

Abstract: Computing an output image of a dynamic scene. A value of E is selected which is a parameter describing desired dynamic content of the scene in the output image. Using selected intrinsic camera parameters and a selected viewpoint, for individual pixels of the output image to be generated, the method computes a ray that goes from a virtual camera through the pixel into the dynamic scene. For individual ones of the rays, sample at least one point along the ray. For individual ones of the sampled points, a viewing direction being a direction of the corresponding ray, and E, query a machine learning model to produce colour and opacity values at the sampled point with the dynamic content of the scene as specified by E. For individual ones of the rays, apply a volume rendering method to the colour and opacity values computed along that ray, to produce a pixel value of the output image.

Abstract: Systems and methods for object detection. The methods comprise: obtaining, by a computing device, an image comprising a plurality of color layers superimposed on each other; generating at least one first additional layer using information contained in a road map (where the first additional layer includes ground height information, ground depth information, drivable geographical area information, map point distance-to-lane center information, lane direction information, or intersection information); generating a modified image by superimposing the first additional layer on the color layers; and causing, by the computing device, control of a vehicle's operation based on the object detection made using the modified image.

Abstract: A method for planning the insertion of bone cement into an orthopedic void of a vertebra. A three dimensional preoperative image of the vertebra is used and the voxels are analyzed to provide the voxel absorption levels. The absorption levels are transformed into mechanical properties of regions of the vertebra, such that a three dimensional mesh of the mechanical properties of the vertebra is generated. An entry point and an entry angle are selected on the vertebra, through which to inject bone cement into the void. Then, using the known viscosity of the bone cement, and using the entry point and entry angle, a finite elements analysis may be performed on the mesh to simulate the propagation of the bone cement into the orthopedic void. The simulation is repeated using different operational parameters until said propagation of said bone cement is deemed satisfactory.