Abstract: A method for planning the insertion of bone cement into an orthopedic void of a vertebra. A three dimensional preoperative image of the vertebra is used and the voxels are analyzed to provide the voxel absorption levels. The absorption levels are transformed into mechanical properties of regions of the vertebra, such that a three dimensional mesh of the mechanical properties of the vertebra is generated. An entry point and an entry angle are selected on the vertebra, through which to inject bone cement into the void. Then, using the known viscosity of the bone cement, and using the entry point and entry angle, a finite elements analysis may be performed on the mesh to simulate the propagation of the bone cement into the orthopedic void. The simulation is repeated using different operational parameters until said propagation of said bone cement is deemed satisfactory.

Abstract: A surgery system includes a contactless control panel, an infrared camera, a computer and a display. The contactless control panel includes control areas which are arranged in a predetermined pattern and are coated with infrared reflective material to reflect infrared radiation. The infrared camera captures an infrared image of the control areas. The computer performs image recognition on the infrared image, determines, based on the predetermined pattern stored in advance and a result of the image recognition, which one of the control areas is masked, and generates a device control signal based on a function corresponding to the one of the control areas that is determined to be masked. The display device displays images based on the device control signal.

Abstract: A tessellation method uses both vertex tessellation factors and displacement factors defined for each vertex of a patch, which may be a quad, a triangle or an isoline. The method is implemented in a computer graphics system and involves calculating a vertex tessellation factor for each corner vertex in one or more input patches. Tessellation is then performed on the plurality of input patches using the vertex tessellation factors. The tessellation operation involves adding one or more new vertices and calculating a displacement factor for each newly added vertex. A world space parameter for each vertex is subsequently determined by calculating a target world space parameter for each vertex and then modifying the target world space parameter for a vertex using the displacement factor for that vertex.

Abstract: Automatic display unit backup during failures of one more display units through the utilization of graphic user interface objects defined for control transfer and reversion after resolution of the failures is provided herein. A system can comprise a memory operatively coupled to a processor that executes stored executable components comprising a first controller, a second controller, and a failure indication component that provides a first notification based on a first detection of a first failure at the second controller, and a second notification based on a second detection of a second failure at the first controller. Further, the executable components can comprise a control transfer component that automatically transfers control of a second display unit from the v controller to the first controller based on the first notification, or control of a first display unit from the first controller to the second controller based on the second notification.

Abstract: Configurations are disclosed for a health system to be used in various healthcare applications, e.g., for patient diagnostics, monitoring, and/or therapy. The health system may comprise a light generation module to transmit light or an image to a user, one or more sensors to detect a physiological parameter of the user's body, including their eyes, and processing circuitry to analyze an input received in response to the presented images to determine one or more health conditions or defects.

Abstract: The disclosed computer-implemented method may include identifying a set of action units (AUs) associated with a face of a user. Each AU may be associated with a muscle group engaged by the user to produce a viseme associated with a sound produced by the user. The method may also include, for each AU in the set of AUs, determining a set of AU parameters associated with the AU and the viseme. The set of AU parameters may include (1) an onset curve, and (2) a falloff curve. The method may also include (1) detecting that the user has produced the sound, and (2) directing a computer-generated avatar to produce the viseme in accordance with the set of AU parameters in response to detecting that the user is producing the sound. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: New techniques are described herein for providing a user-friendly interface for adjusting dose distribution values during optimization of a radiation application plan. In an embodiment, a graphical user interface is provided that provides an image of a target area for a radiation application, and a graphical overlay of a dose distribution disposed over the target area that visually represents the optimized dose distribution according to the input dose parameters. In one or more embodiments, the dose distribution may be automatically calculated from input parameters supplied by a user through the graphical user interface prior to optimization. A user (such as a clinician, radiation oncologist, or radiation therapy operator, etc.) is able to modify the visualization of the dose distribution volume during optimization via a user input device in conjunction with the graphical user interface and have the modification adjusted in real-time.

Abstract: A method for detecting a loop closure is described. A device accesses pose information and a three-dimensional map of feature points generated by a visual inertia system of the device. The device splits the pose information into a translational part and a rotational part. The device limits the translational part to two-dimensional coordinates and estimates two-dimensional information of the limited translational part based on an accumulator voting space. The device determines an updated pose of the device based on the estimated two-dimensional information, the rotational part, and the three-dimensional map. The pose information is updated with the updated pose.

Abstract: A binocular brightness sensitivity measurement method based on a wearable display device includes: loading a first test image and a second test image which has a brightness different from that of the first test image respectively for two eyes of a user under test; adjusting the brightness of the first test image and/or the second test image until a predefined brightness sensitivity perception test condition is fulfilled; acquiring a brightness difference between the first test image and the second test image; and determining a binocular brightness sensitivity of the user under test based on the brightness difference.

Abstract: A method comprises: collecting first point cloud data under a static scenario around a target collecting point; building a static background mesh model under the static scenario around the target collecting point according to the first point cloud data; collecting a second point cloud data of a target frame under a dynamic scenario after a dynamic obstacle moves around the target collecting point; annotating the point cloud of dynamic obstacle in the second point cloud data corresponding to the target frame, according to the static background mesh model. Through the technical solution of the present disclosure, it is feasible to automatically annotate the point cloud of the dynamic obstacle, effectively save manpower and annotation time spent in annotating the dynamic obstacle point cloud, and thereby effectively improve the efficiency of annotating the dynamic obstacle.

Abstract: A method and an apparatus are provided for providing a dolly zoom effect by an electronic device. A first image with a first depth map and a second image with a second depth map are obtained. A first synthesized image and a corresponding first synthesized depth map are generated using the first image and the first depth map respectively. A second synthesized image and a corresponding second synthesized depth map are generated using the second image and the second depth map respectively. A fused image is generated from the first synthesized image and the second synthesized image. A fused depth map is generated from the first synthesized depth map and the second synthesized depth map. A final synthesized image is generated based on processing the fused image and the fused depth map.

Abstract: Embodiments of the present disclosure provide a method for adding a special effect to a video, an electronic device and a storage medium. First portrait edge information of a first frame is determined based on the portrait foregrounds of the first frame and a previous frame. A fluctuation offset based on a playback time and a fluctuation parameter is added to the first portrait edge information to obtain second portrait edge information. The second portrait edge information is superimposed on the first frame to obtain a second frame having the special effect.

Abstract: A measuring instrument attachment assist device which includes: a coordinate detector which detects coordinates of predetermined feature points from an image obtained by capturing an image of a subject; a conversion parameter calculator which calculates a projection conversion parameter for converting the coordinates of the feature points in a model image into the coordinates obtained by the detection; a designating unit which designates a position of a measuring instrument attached to the subject in the model image; a coordinate converter which converts a coordinate of the position designated by using the designating unit, by using the projection conversion parameter; and a display which displays the coordinate obtained by the conversion by the coordinate converter, on the image obtained by the capturing.

Abstract: A virtual operating room (OR) is generated that includes virtual surgical equipment based on existing OR models and existing equipment models. Sensor feedback is received that defines a physical OR having physical equipment, the physical equipment including a surgical robotic system within the physical OR. The virtual OR and the virtual surgical equipment is updated based on the sensor feedback. A layout of the virtual surgical equipment is optimized in the virtual OR. The virtual OR and the virtual surgical equipment are rendered on a display.

Abstract: A tessellation method uses tessellation factors defined for each vertex of a patch which may be a quad, a triangle or an isoline. The method is implemented in a computer graphics system and involves comparing the vertex tessellation factors to a threshold. If the vertex tessellation factors for either a left vertex or a right vertex, which define an edge of an initial patch, exceed the threshold, the edge is sub-divided by the addition of a new vertex which divides the edge into two parts and two new patches are formed. New vertex tessellation factors are calculated for each vertex in each of the newly formed patches, both of which include the newly added vertex. The method is then repeated for each of the newly formed patches until none of the vertex tessellation factors exceed the threshold.

Abstract: Planning surgical robotic workflow with a surgical robotic system can include generating a virtual surgical environment, the virtual surgical environment including a virtual surgical robotic arm and a virtual patient. A workspace can be determined in the virtual patient. A position of a virtual tool, attached to the virtual surgical robotic arm, can be determined. A position of the virtual surgical robotic arm can be determined to maintain a reach of the virtual tool in the workspace.

Abstract: To optimize the compilation of shaders for execution within an application, a computer system discovers the context in which the shaders are executed. The application is compiled and executed on a target platform. Snapshots of the application during execution are captured. A snapshot includes data and commands passed between the central processing unit and the graphics processing unit of the target platform to generate a single frame of graphics data. The shaders used in these snapshots are identified. These shaders are compiled with a number of different permutations of available compiler options, resulting in sets of differently compiled shaders. The snapshot is re-executed with the sets of differently compiled shaders, and performance is measured. The set of compiler options that results in compiled shaders providing better performance can be used as the set of compilation parameters for the set of shaders for this application.

Abstract: An image processing apparatus includes an input interface to acquire an image, and first to fourth controllers. The first controller performs image processing on the image. The second controller performs correction on an optical distortion in the image. The third controller performs recognition on the image. The fourth controller superimposes a result of the recognition onto the image and outputs a resulting image. The first controller can perform first and second image processing. The second controller can perform first and second correction processing. The third controller receives an input of the image, and outputs information indicating a location of a recognized object. The fourth controller receives an input of the image, and superimposes a drawing indicating the location of the recognized object onto a corresponding location in the image.

Abstract: A method for improving performance of generation of digitally represented graphics. The method comprises: receiving a first representation of a base primitive; providing a set of instructions associated with vertex position determination; executing said retrieved set of instructions on said first representation of said base primitive using bounded arithmetic for providing a second representation of said base primitive, and subjecting said second representation of said base primitive to a culling process. A corresponding apparatus and computer program product are also presented.

Abstract: A method and system of using multiple image cameras or multiple image and depth cameras to capture a target object. Geometry and texture are reconstructed using captured images and depth images. New images are rendered using geometry based rendering methods or image based rendering methods.