Abstract: A display control apparatus that performs rendering on volume data generated based on a signal obtained by receiving a photoacoustic wave generated by an object irradiated with light includes a first unit configured to obtain positional information of a surface of the object, a second unit configured to set a region inside the object between a surface located at a first distance from the surface of the object and a surface located at a second distance from the surface of the object as a display region on the basis of the positional information of the surface of the object, and a third unit configured to perform the rendering on the volume data in a manner that the display region and a region except for the display region can be discriminated from each other.

Abstract: At least one processor of an apparatus functions as a generation unit that identifies at least an outer edge of a specific region in a surface layer of an object and that generates outer edge candidates, and a control unit that selects an outer edge candidate based on an instruction from a user among the generated outer edge candidates.

Abstract: An optical tissue imaging system includes a probe for insertion into a transparent cylindrical capillary. The capillary includes an internal cylindrical channel that extends along a central axis. The capillary is inserted into tissue of a subject, and the probe may rotate and translate within the capillary. The probe may include a mirror configured to reflect light to the tissue outside of the cylindrical capillary.

Abstract: The present disclosure provides a system and method for medical imaging. The method may include obtaining a preliminary image and scanning data of a subject acquired using a scanner. The method may also include determining a regularization parameter for a regularization item of an objective function based at least in part on the scanning data, wherein the regularization parameter includes at least two of a first component characterizing quality of the scanning data, a second component characterizing the scanner, or a third component characterizing a feature of the subject. The method may further include generating an image of the subject by reconstructing the preliminary image based on the objective function.

Abstract: Methods and systems are described for assessing a vessel obstruction. The methods and systems obtain a volumetric image dataset of a myocardium and at least one coronary vessel, wherein the myocardium comprises muscular tissue of the heart. A three-dimensional (3D) image corresponding to a coronary vessel of interest is created from the volumetric image dataset. Feature data that represents features of both the myocardium and the coronary vessel of interest is generated. At least some of the feature data is determined by a first machine learning-based model based on the 3D image. A second machine learning-based model is used to determine at least one parameter based on the feature data, wherein the at least one parameter represents functionally significant coronary lesion severity of the coronary vessel of interest.

Abstract: A method to acquire dental images of a patient with a support defining a chamber that is in communication with an outside of said chamber via a first opening and via a second opening. The method includes the following steps: fixing a mobile phone in front of the second opening; positioning the first opening in front of a mouth of the patient; and acquiring at least one dental image by means of the mobile phone.

Abstract: Machine learning systems and methods are disclosed for prediction of wound healing, such as for diabetic foot ulcers or other wounds, and for assessment implementations such as segmentation of images into wound regions and non-wound regions. Systems for assessing or predicting wound healing can include a light detection element configured to collect light of at least a first wavelength reflected from a tissue region including a wound, and one or more processors configured to generate an image based on a signal from the light detection element having pixels depicting the tissue region, determine reflectance intensity values for at least a subset of the pixels, determine one or more quantitative features of the subset of the plurality of pixels based on the reflectance intensity values, and generate a predicted or assessed healing parameter associated with the wound over a predetermined time interval.

Abstract: An apparatus, system, and method for fluorescence imaging with stray light reduction is described. The system including a light source to provide a first illumination of a scene to induce fluorescence from the scene, an image sensor to capture a fluorescence image of the scene during the first illumination, and a controller coupled to the light source, the image sensor, and memory that includes instructions that when executed by the controller causes the system to perform operations. The operations including comparing a first color channel value to a second color channel value of a given pixel included in the fluorescence image to identify one or more pixels of the fluorescence image as being affected by stray light. The operations further including generating a stray light image mask based, at least in part, on the one or more pixels of the fluorescence image identified as being affected by the stray light.

Abstract: An image processing method includes: calculating an area of a first label of a first medical image of a plurality of medical images with a plurality of labels; obtaining a first determination result based on whether the area of the first label is greater than a threshold value; obtaining a second determination result based on whether a second medical image of the medical images adjacent to the first medical image includes a second label overlapping a first projection area of the first label on the second medical image; and selectively deleting the first label on the first medical image according to the first determination result and the second determination result. The present disclosure further provides an image processing system to perform the image processing method.

Abstract: The disclosure relates to an image segmentation method and apparatus, and a computer program thereof. The image segmentation apparatus according to the disclosure may include an encoding module configured to obtain a plurality of feature maps having different resolutions with respect to an input image, using an artificial neural network including one or more residual blocks, and a decoding module configured to generate one prediction map from pairs of adjacent feature maps among the plurality of feature maps in bracket-shaped manner, wherein the decoding module performs one or more decoding rounds, each decoding round includes one or more ATF modules that generate a combined feature map using a high-resolution feature map having a higher resolution among an adjacent feature map pair constituting the feature map generated in the previous round and a low-resolution feature map having a lower resolution thereof, and the decoding round is repeatedly performed until the one prediction map is generated.

Abstract: Methods, systems, and devices for graphics processing are described. A device may receive an image including a set of pixels. The device may render a first subset of pixels in each bin of a set of bins during a first rendering pass, and defer rendering a second subset of pixels and a third subset of pixels in each bin of the set of bins during the first rendering pass. The second subset of pixels may include edge pixels and the third subset of pixels may be between the first subset of pixels and the second subset of pixels. The device may render the second subset of pixels and the third subset of pixels in each bin of the set of bins during a second rendering pass based on rendering the first subset of pixels. The device may then output the image based on the first and second rendering pass.

Abstract: An image processing apparatus includes an acquisition unit configured to acquire image data, a calculation unit configured to calculate, for each unit region of the image data, a confidence that the unit region is an extraction subject, the confidence as the extraction subject being calculated for each unit region of the image data by inputting the image data into a trained model of a neural network that has been trained using images of an existing extraction subject or a region of interest as training data, a modification unit configured to modify a reference value of the confidence, which is used to extract a region of interest, an extraction unit configured to extract the region of interest on the basis of the calculated confidence of each unit region and the modified reference value, and a display unit configured to display the extracted region of interest.

Abstract: Systems, methods, and computer software are disclosed for acquiring images during delivery of a radiation beam, the images capturing at least a portion of a shape representative of a radiation field generated by a radiation delivery system that includes a radiation source configured to deliver the radiation beam.

Abstract: Embodiments of the subject matter described herein relate to generating a decision tree based on data pre-statistics. A plurality of data samples for a node of the decision tree are obtained, and the plurality of data samples have corresponding feature values with respect to a first feature. A target range is determined from a plurality of predefined numerical ranges so that the number of feature values falling into the target range is greater than a predetermined threshold number. Then, the remaining of the feature values other than the feature values falling into the target range are assigned to the respective numerical ranges, and the feature values falling into all the numerical ranges are counted based on the assignment of the remaining of the feature values, for allocation of the plurality of data samples to child nodes of the node. Accordingly, the data processing efficiency is substantially improved.

Abstract: An apparatus and method for encoding objects in a camera-captured image with a deep neural network pipeline including multiple convolutional neural networks or convolutional layers. After identifying at least a portion of the camera-capture image, a first convolutional layer is applied to the at least the portion of the camera-captured image and multiple subregion representations are pooled from the output of the first convolutional layer. One or more additional convolutions are performed. At least one deconvolution is performed and concatenated with the output of one or more convolutions. One or more final convolutions are performed. The at least the portion of the camera-captured image is classified as an object category in response to an output of the one or more final convolutions.

Abstract: Certain aspects of the present disclosure are directed to methods and apparatus for predicting subject motion using probabilistic models. One example method generally includes receiving training data comprising a set of subject pose trees. The set of subject pose trees comprises a plurality of subsets of subject pose trees associated with an image in a sequence of images, and each subject pose tree in the subset indicates a location along an axis of the image at which each of a plurality of joints of a subject is located. The received training data may be processed in a convolutional neural network to generate a trained probabilistic model for predicting joint distribution and subject motion based on density estimation. The trained probabilistic model may be deployed to a computer vision system and configured to generate a probability distribution for the location of each joint along the axis.

Abstract: The disclosure provides human-tracking methods, systems, and storage media. The method includes: acquiring a plurality of human point clouds of a current frame from a plurality of cameras; generating a total point cloud of the current frame by integrating the plurality of human point clouds of the current frame; acquiring a plurality of human point clouds of a next frame from the plurality of cameras; acquiring a total point cloud of the next frame by integrating the plurality of human point clouds of the next frame; and performing human tracking based on the total point cloud of the current frame and the total point cloud of the next frame.

Abstract: Techniques are disclosed for aligning fiducial markers that commonly exist in each of multiple different N-dimensional (N-D) data sets. Notably, the N-D data sets are at least three-dimensional (3D) data sets. A first set and a second set of N-D data are accessed. A set of one or more fiducial markers that commonly exist in both those sets are identified. Based on the fiducial markers, one or more transformations are performed to align the two sets. Performing this alignment process results in at least a selected number of the common fiducial markers that exist in the two sets being within a threshold alignment relative to one another.

Abstract: A time-of-flight camera for generating a depth map indicating distance(s) to target(s) includes a processor and multi-pixel time-of-flight image sensor. The camera: (a) determines, at each pixel, a plurality of phase-correlation values associated with at least one exposure duration and at least one phase offset; (b) determines for each pixel an accumulated correlation in response to the plurality of phase-correlation values; and (c) generates the depth map in response to a plurality of the accumulated correlations. A set of accumulated correlations may be determined in response to a plurality of sets of phase-correlation values such that each accumulated correlation is associated with one unique phase offset in response to each set of phase-correlation values being associated with one exposure duration, the depth map being generated in response to a plurality of sets of accumulated correlations. A computer-implemented method of generating a depth map using a time-of-flight image sensor is provided.

Abstract: A method for determining a trailer characteristic includes disposing a camera at a rear portion of a vehicle so as to have a field of view rearward, providing a control having an image processor, and hitching a tongue of a trailer to a hitch ball of the vehicle. Location of a portion of the trailer relative to the camera is determined via processing of captured image data. Responsive to the determination of the location of the portion of the trailer relative to the camera, a subregion of the imaging array of the camera is determined that includes the determined portion of the trailer, and processing at the control is enhanced at the determined subregion during processing of subsequent frames of captured image data to determine location of the portion of the trailer relative to the vehicle centerline in the subsequent frames of captured image data.

Abstract: A method for determining the position of a real object and displaying a virtual object linked to the real object in an augmented reality display device is provided. For this purpose, a tracking system is used to detect a position of the real object) at different consecutive measurement times and in each case to calculate an estimated position for the measurement times. A reliability value is determined on the basis of the detected position of the real object and of the estimated position of the real object and shown in the augmented reality display device. The present method furthermore discloses a corresponding augmented reality system having an augmented reality display device for displaying a real object and a virtual object linked to the real object).

Abstract: Tracking units for facial features with advanced training for natural rendering of human faces in real-time are provided. An example device receives a video stream, and upon detecting a visual face, selects a 3D model from a comprehensive set of head orientation classes. The device determines modifications to the selected 3D model to describe the face, then projects a 2D model of tracking points of facial features based on the 3D model, and controls, actuates, or animates hardware based on the facial features tracking points. The device can switch among an example comprehensive set of 35 different head orientation classes for each video frame, based on suggestions computed from a previous video frame or from yaw and pitch angles of the visual head orientation. Each class of the comprehensive set is trained separately based on a respective collection of automatically marked images for that head orientation class.

Abstract: The present invention relates to a pose estimation method of an interventional medical device using a single-view X-ray image which is captured using a bendable interventional medical device equipped with a plurality of radiopaque markers and using an X-ray source. The pose estimation method includes an operation (a) of defining a circle assuming that the interventional medical device is bent at a constant curvature, an operation (b) of extracting a position value of the marker from an X-ray image obtained by the X-ray source projecting X-rays onto the markers, and an operation (c) of setting a projection plane and estimating a shape of the circle using a position value of the marker extracted from a projected image obtained by perspective-projecting the circle onto the projection plane and using the position value of the marker extracted from the X-ray image.

Abstract: A computer implemented method includes capturing images of an environment via a camera, detecting image features in the environment based on the captured images, the image features including at least one web feature derived from a fiducial web formed of a collection of non-repeating intersecting lines applied to an object in the environment, and estimating a camera pose based on the detected image features including the at least one web feature.

Abstract: A method and system for measuring the alignment between a substrate and a platform upon which it is disposed by using image processing algorithms are described herein. These algorithms automate the detection of edges of a microscope slide and the platform in a digital image. A reference line pattern in an image of the platform can be used to detect platform edges based on a computed location of the reference line pattern in the image.

Abstract: A pose estimation training system includes: a first model configured to generate a first 6 degrees of freedom (DoF) pose of a first camera that captured a first image from a first domain; a second model configured to generate a second 6 DoF pose of a second camera that captured a second image from a second domain, where the second domain is different than the first domain; a discriminator module configured to, based on first and second outputs from the first and second encoder modules, generate a discriminator output indicative of whether the first and second images are from the same domain; and a training control module configured to, based on the discriminator output, selectively adjust at least one weight value shared by the first model and the second model.

Abstract: A system or method can analyze symbols on a set of objects having different sizes. The system can identify a characteristic object dimension corresponding to the set of objects. An image of a first object can be received, and, a first virtual object boundary feature (e.g., edge) in the image can be identified for the first object based on the characteristic object dimension. A first symbol can be identified in the image, and whether the first symbol is positioned on the first object can be determined, based on the first virtual object boundary feature.

Abstract: In an approach to estimating product inventory count, one or more computer processors receive one or more images of one or more products residing on a product storage location from an image capturing device. Based on the received images, one or more computer processors determine a count of the one or more products. One or more computer processors determine a confidence in the count of the one or more products. In response to determining the confidence is below a threshold, one or more computer processors calculate a recommended position of the image capturing device to produce an improved image of the one or more products. One or more computer processors transmit instructions to the image capturing device to move to the recommended position. One or more computer processors determine whether the image capturing device is in the recommended position.

Abstract: A biological substance quantification method of quantifying an expression amount of a specific biological substance in a target sample stained by using a fluorescent dye accumulated particle bondable to the specific biological substance. The method includes: inputting a first fluorescent image obtained by image capturing of the target sample; extracting a bright spot portion from the first fluorescent image and calculating a first luminance value; and calculating a number of the fluorescent dye accumulated particle included in the bright spot portion by using the first luminance value, a second luminance value of a bright spot portion extracted from a second fluorescent image obtained by image capturing of a standard sample, and a distribution of a third luminance value of each bright spot portion in a third fluorescent image obtained by image capturing of a preparation on which the fluorescent dye accumulated particle is dispersed without aggregating.

Abstract: The present invention relates to a system and a method for calibration between coordinate systems of a 3D camera and a medical imaging apparatus and an application thereof.

Abstract: Embodiments facilitate the calibration of cameras in a live action scene using drones. In some embodiments, a method configures a plurality of reference cameras to observe at least one portion of the live action scene. The method further configures one or more moving cameras having unconstrained motion to observe one or more moving objects in the live action scene and to observe at least three known reference points associated with the plurality of reference cameras. The method further receives reference point data in association with the one or more moving cameras, where the reference point data is based on the at least three known reference points. The method further computes a location and an orientation of each moving camera of the one or more moving cameras based on one or more of the reference point data and one or more locations of one or more reference cameras of the plurality of reference cameras.

Abstract: Optical center calibration may include obtaining one or more parameters for optical center calibration, obtaining an input image captured by an image capture device using a lens, and determining a calibration circle using the parameters and the input image. Determining the calibration circle may include extracting rays using the input image, estimating contours using the input image and the rays, and estimating the calibration circle using the input image and the contours. The calibration may be iteratively improved by repeating calibration based on the input image and a previous iteration of optical center calibration.

Abstract: Embodiments disclosed herein provide for a system and method for recalibrating an augmented reality experience in mobile devices using a plurality of physical markers. The system and methods provide for realigning the digital representation to the physical world using known physical locations associated with the physical markers that map directly to the digital representation.

Abstract: An image processing method comprising steps of obtaining a first map representing a region outside a dynamic range of an input image based on a signal value in the input image and a threshold of the signal value, and inputting input data including the input image and the first map and executing a recognition task or a regression task.

Abstract: A data processing system comprises encoding circuitry operable to encode arrays of data elements, decoding circuitry operable to decode encoded versions of arrays of data elements, and consumer circuitry operable to use arrays of data elements. Data indicative of a resolution that is to be used by the consumer circuitry for at least one region of the array of data elements is provided to the encoding circuitry, and the encoding circuitry uses the data indicative of the resolution that is to be used by the consumer circuitry to control the generation of the representation for representing at least one block that the array of data elements is divided into.

Abstract: Certain example embodiments relate to an electronic device, including a user interface, and processing resources including at least one processor and a memory. The memory stores a program executable by the processing resources to simulate a view of an image through at least one viewer-selected product that is virtually interposed between a viewer using the electronic device and the image by performing functionality including: acquiring the image; facilitating viewer selection of the at least one product in connection with the user interface; retrieving display properties associated with the at least one viewer-selected product; generating, for each said viewer-selected product, a filter to be applied to the acquired image based on retrieved display properties; and generating, for display via the electronic device, an output image corresponding to the generated filter(s) being applied to the acquired image. The electronic device in certain example embodiments may be a smartphone, tablet, and/or the like.

Abstract: A computing device generates an initial data visualization according to a visual specification that specifies a data source, a plurality of visual variables, and a plurality of data fields from the data source. The device determines a visualization region based on a display size of the initial data visualization. The device generates a modified data visualization from the initial data visualization according to the determined visualization region, including: (i) identifying a plurality of elements of the initial data visualization, (ii) for each element of the plurality of identified elements, determining a respective semantic weight for the respective element, (iii) grouping the elements into one or more element layers according to the determined semantic weights, (iv) computing spatial metrics for the elements, and (v) executing one or more generalization operations on the elements in accordance with the one or more computed spatial metrics. The computing device displays the modified data visualization.

Abstract: A method for distributing information includes producing a symbol to be overlaid on at least one primary image presented on a first display screen, the symbol encoding a specified digital value in a set of color elements having different, respective colors. A message is received from a client device containing an indication of the specified digital value decoded by the client device upon capturing and analyzing a secondary image of the first display screen. In response to the message, an item of information relating to the primary image is transmitted to the client device, for presentation on a second display screen associated with the client device.

Abstract: The present disclosure relates to systems, non-transitory computer-readable media, and methods for utilizing visual constraint guides to automatically transform digital design objects within a digital document based on transformation of intersecting visual constraint guides. In particular, in one or more embodiments, the disclosed systems generate visual constraint guides and identifies digital design objects intersecting the visual constraint guides. Further, the disclosed systems can receive user input transforming the visual constraint guide. In response, the disclosed systems can transform both the visual constraint guide and associated digital design objects based on the received transformation. More specifically, the design guide system can transform the digital design objects relative to the visual constraint guide while maintaining distribution and alignment constraints of the digital design objects relative to the visual constraint guide.

Abstract: There are provided a font creation apparatus, a font creation method, and a font creation program capable of generating, from small-number character images having a desired-to-be-imitated style, a complete font set for any language having the same style as the character images. A feature amount extraction unit (40) receives a character image (32) of a first font having a desired-to-be-imitated style and extracts a first feature amount of the first font of the character image (32). An estimation unit (42) estimates a transformation parameter between the extracted first feature amount and a second feature amount of a reference second font (34). A feature amount generation unit (44) generates a fourth feature amount of a second font set to be created by transforming a third feature amount of a complete reference font set (36) based on the estimated transformation parameter.

Abstract: Concepts and technologies are disclosed herein for identifying vulnerabilities associated with a premises and generating and/or presenting augmented reality display data to aid in selecting security components to protect the vulnerabilities identified. A processor can execute a security vulnerability assistant service. A request from a user device can be received. The request can comprise image data of a premises. An object captured by the image data can be identified, and a determination can be made whether the object is associated with a vulnerability. In response to determining that the object is associated with a vulnerability, augmented reality display data can be generated. The augmented reality display data can include a virtual object for overlaying on an image of the object presented by the user device.

Abstract: A user may create an avatar and/or animated sequence illustrating a particular object or living being performing a certain activity, using images of portions of the object or living being extracted from a still image or set of still images of the object or living being.

Abstract: Methods and control stream generators for generating a control stream for a tile group comprising at least two tiles, the control stream identifying primitive blocks that are relevant to rendering at least one tile in the tile group.

Abstract: In an example, an apparatus comprises a plurality of execution units; and logic, at least partially including hardware logic, to determine a sub-graph of a network that can be executed in a frequency domain and apply computations in the sub-graph in the frequency domain. Other embodiments are also disclosed and claimed.

Abstract: In examples, a filter used to denoise shadows for a pixel(s) may be adapted based at least on variance in temporally accumulated ray-traced samples. A range of filter values for a spatiotemporal filter may be defined based on the variance and used to exclude temporal ray-traced samples that are outside of the range. Data used to compute a first moment of a distribution used to compute variance may be used to compute a second moment of the distribution. For binary signals, such as visibility, the first moment (e.g., accumulated mean) may be equivalent to a second moment (e.g., the mean squared). In further respects, spatial filtering of a pixel(s) may be skipped based on comparing the mean of variance of the pixel(s) to one or more thresholds and based on the accumulated number of values for the pixel.

Abstract: Disclosed is surface guided cropping in volume rendering of 3D volumetric data from intervening anatomical structures in the patient's body. A digital 3D representation expressing the topography of a first anatomical structure is used to define a clipping surface or a bounding volume which then is used in the volume rendering to exclude data from an intervening structure when generating a 2D projection of the first anatomical structure.

Abstract: A method, computer program, and computer system for point cloud coding is provided. Data corresponding to a point cloud is received, and one or more geometric features are detected from among the data corresponding to the point cloud. A representation is determined for one or more of the detected geometric features, and the received data is encoded or decoded based on the determined representations whereby the point cloud is reconstructed based on the decoded data.

Abstract: Techniques and systems are provided for light estimation. In some examples, a system receives a plurality of frames associated with a scene. The plurality of frames includes a first frame and a second frame occurring after the first frame. The system determines, based on image data of the first frame, a first light estimate associated with the scene. The system also determines, based on image data of the second frame, a second light estimate associated with the scene. The system further generates an aggregate light estimate associated with the scene based on combining the second light estimate with at least the first light estimate.

Abstract: An illumination rendering method and apparatus includes obtaining a first picture at a target viewing angle from a virtual three-dimensional (3D) scene. The first picture includes a virtual object to be subject to illumination rendering in the virtual 3D scene at the target viewing angle. A target virtual light source point set is determined that performs illumination rendering on the virtual object in the first picture. Illumination rendering is performed on the virtual object in the first picture by using the target virtual light source point set. This illumination rendering improves efficiency in rendering on the virtual object in the virtual 3D scene.

Abstract: The system obtains an indication of a shape of a cross-section of an elongated shape, and an orientation of the shape. Based on the shape of the cross-section of the elongated shape and the orientation of the shape, the system creates a nonuniform distribution of random numbers mapping uniformly distributed input values to multiple points on the surface of the elongated shape. The system provides an input value randomly selected from a uniform distribution of random numbers to the nonuniform distribution of random numbers to obtain a point among the multiple sample points on the surface of the elongated shape. The system applies a function to the input value to obtain an indication of a normal associated with the sample point among the multiple sample points. Finally, the system computes an illumination of the elongated shape using the normal.