Abstract: A system for transmitting color and depth information, comprising: an image capturing device capturing a full color image frame of a scene; a depth capturing device capturing a grayscale depth image frame of the scene; a target identifying module for identifying a target in the scene; a bounding box generator configured for generating a bounding box encapsulating the target and for creating bound grayscale depth images and bound full color images; a depth colorizer converting the bound grayscale depth images into a bound full color depth image by linking and normalizing the depth dimension of the bounding box to a transferred color gamut by implementing a transfer function; an image merger that merges the bound full color images and bound full color depth images together into bound merged full color images; and an image encoder compressing the bound merged full color images into an image bitstring.

Abstract: Using deep learning, imaging harmonization among images produced with differing PET tracers is achieved. A method may include providing an original PET image of the brain using an original PET tracer, providing a target PET tracer, and converting, using a deep learning neural network, the original PET image into a target PET image simulating the image that would be obtained had the target PET tracer been used.

Abstract: A microscopy method includes a trained deep neural network that is executed by software using one or more processors of a computing device, the trained deep neural network trained with a training set of images comprising co-registered pairs of high-resolution microscopy images or image patches of a sample and their corresponding low-resolution microscopy images or image patches of the same sample. A microscopy input image of a sample to be imaged is input to the trained deep neural network which rapidly outputs an output image of the sample, the output image having improved one or more of spatial resolution, depth-of-field, signal-to-noise ratio, and/or image contrast.

Abstract: Methods, apparatus and systems for recognizing sign language movements using multiple input and output modalities. One example method includes capturing a movement associated with the sign language using a set of visual sensing devices, the set of visual sensing devices comprising multiple apertures oriented with respect to the subject to receive optical signals corresponding to the movement from multiple angles, generating digital information corresponding to the movement based on the optical signals from the multiple angles, collecting depth information corresponding to the movement in one or more planes perpendicular to an image plane captured by the set of visual sensing devices, producing a reduced set of digital information by removing at least some of the digital information based on the depth information, generating a composite digital representation by aligning at least a portion of the reduced set of digital information, and recognizing the movement based on the composite digital representation.

Abstract: There is provided a computer implemented method of image processing for detection of damage on a vehicle, comprising: accessing a plurality of time-spaced image sequences depicting a region of a vehicle, captured by a plurality of image sensors positioned at a plurality of different views, identifying a plurality of candidate regions of damage in the plurality of time-spaced image sequences, performing a spatiotemporal correlation between the plurality of time-spaced image sequences, identifying redundancy in the plurality of candidate regions of damage corresponding to a common physical location of the vehicle denoting a single physical damage region, and providing an indication of the common physical location of the vehicle corresponding to the single physical damage region.

Abstract: An imaging probe comprises a camera or endoscope with an external detector array, in which the probe is sized and shaped for surgical placement in an eye to image the eye from an interior of the eye during treatment. The imaging probe and a treatment probe can be coupled together with a fastener or contained within a housing. The imaging probe and the treatment probe can be sized and shaped to enter the eye through an incision in the cornea and image one or more of the ciliary body band or the scleral spur. The treatment probe may comprise a treatment optical fiber or a surgical placement device to deliver an implant. A processor coupled to the detector can be configured with instructions to identify a location of one or more of the ciliary body band, the scleral spur, Schwalbe's line, or Schlemm's canal from the image.

Abstract: A method of pre-operatively developing a reverse shoulder arthroplasty plan can include receiving an image of a patient shoulder comprising a humerus and a glenoid. The image can be segmented to develop a 3D shoulder model. Virtual surgery can be performed on the 3D shoulder model to generate a modified shoulder model. The virtual surgery can include resecting and reaming a virtual humerus of the 3D shoulder model, and reaming a virtual glenoid of the 3D shoulder model. Selection of a humeral implant and selection of a glenoid implant can be received. A virtual representation of the humeral implant can be implanted on the virtual humerus and a virtual representation of the glenoid implant on the virtual glenoid to virtually update the modified shoulder model. A range of motion of the patient shoulder can be determined and a reverse shoulder arthroplasty can be finalized based on the range of motion.

Abstract: An image processing apparatus for evaluating cardiac images and a ventricular status identification method are provided. In the method, a region of interest (ROI) is determined from multiple target images, a variation in grayscale values of multiple pixels in the ROIs of each target image is determined, and one or more representative images are obtained according to the variation in the grayscale values. The target image is related to the pixels within an endocardial contour of a left ventricle. A boundary of the ROI is approximately located at two sides of a bottom of the endocardial contour. The ROI corresponds to a mitral valve. The variation in the grayscale values is related to a motion of the mitral valve. The representative image is for evaluating a status of the left ventricle.

Abstract: An object recognition method includes generating a cluster at a fixed period by clustering distance measurement points acquired from an object detection sensor, mapping the cluster to an image captured by an imaging means, setting a region on the image to which the cluster is mapped as a processing region, extracting a feature point from the image in the set processing region, calculating a movement speed of the extracted feature point, and determining whether clusters at different time points are clusters of an identical object based on a difference between positions of two feature points corresponding to the clusters at the different time points and a difference between movement speeds of the two feature points corresponding to the clusters at the different time points.

Abstract: A system and method for determining the locations and types of objects in a plurality of videos. The method comprises pairing each video with one or more sentences describing the activity or activities in which those objects participate in the associated video, wherein no use is made of a pretrained object detector. The object locations are specified as rectangles, the object types are specified as nouns, and sentences describe the relative positions and motions of the objects in the videos referred to by the nouns in the sentences. The relative positions and motions of the objects in the video are described by a conjunction of predicates constructed to represent the activity described by the sentences associated with the videos.

Abstract: A method for medical imaging may include obtaining a plurality of successive images of a region of interest (ROI) including at least a portion of an object's heart. The plurality of successive images may be based on imaging data acquired from the ROI by a scanner without electrocardiography (ECG) gating. The plurality of successive images may be related to one or more cardiac cycles of the object's heart. The method may also include automatically determining, in the plurality of successive images, target images that correspond to at least one of the one or more cardiac cycles of the object's heart.

Abstract: Methods and apparatus for providing attribute-based search of media assets such as video and audio assets, and associated augmented reality functions including dynamic provision of relevant secondary content relating to the identified attribute(s). In one embodiment, media or content assets are ingested into a processing system and processed according to one or more attribute detection, identification, and characterization algorithms. Attributes detected may include for example the presence of tangible items such as clothing or chattels, particular persons such as celebrities, and/or certain contexts such as sporting activities and musical performances, as rendered within the media asset. In one implementation, the characterized assets are provided a unique ID, and stored so as to permit cross-correlation based on, e.g., the identified and characterized attributes. Secondary content (e.g.

Abstract: Disclosed are image based counting systems and methods. Image based counting systems and methods employ one or more imaging devices (e.g., one or more color cameras) and one or more illumination devices (e.g., one or more illumination sources to provide variable and/or dynamic lighting). In some examples, the image based counting system provides illumination to a tray upon which one or more items (e.g., pills) are placed. The illuminated items are then imaged by the one or more imaging devices based on one or more imaging techniques or processes to determine and/or present information associated with one or more properties of the item.

Abstract: Systems and methods reconstruct an image of a subject or object by performing an iterative reconstruction method to produce a plurality of intermediate images and the image of the subject, and transforming at least one selected intermediate image from the plurality of intermediate images using a quasi-projection operator. The quasi-projection operator includes a deep-learning model configured to map the at least one selected intermediate image to at least one regularized intermediate image. In addition, systems and methods for training the deep-learning model using a training data set that includes a plurality of training images and a plurality of corresponding training object images is disclosed.

Abstract: In an aspect, a system for using artificial intelligence to evaluate, correct, and monitor user attentiveness includes a forward-facing camera, the forward-facing camera configured to capture a video feed of a field of vision on a digital screen, at least a user alert mechanism configured to output a directional alert to a user, a processing unit in communication with the forward-facing camera and the at least a user alert mechanism, a screen location to spatial location map operating on the processing unit, and a motion detection analyzer operating on the processing unit, the motion detection analyzer designed and configured to detect, on the digital screen, a rapid parameter change, determine a screen location on the digital screen of the rapid parameter change, retrieve, from the screen location to spatial location map, a spatial location based on the screen location, and generate, using the spatial location, the directional alert.

Abstract: A method of generating a correction plan for correcting a deformed bone includes inputting to a computer system a first image of the deformed bone in a first plane and inputting to the computer system a second image of the deformed bone in a second plane. Image processing techniques are employed to identify a plurality of anatomical landmarks of the deformed bone in the first image. The first image of the deformed bone is displayed on a display device. A graphical of the deformed bone is autonomously generated and graphically overlaid on the first image of the deformed bone on the display device, the graphical template including a plurality of lines, each line connected at each end to a landmark point corresponding to one of the anatomical landmarks. A model of the deformed bone may be autonomously generated based on the graphical template.

Abstract: According to example embodiments, an Image View Aggregator identifies a frontal view of an item within an image. The Image View Aggregator identifies at least one reflection view of the item within the image. Each reflection view of the item having been captured off a corresponding reflective physical surface. The Image View Aggregator extracts the frontal view of the item and each reflection view of the item from the image. The Image View Aggregator generates a representation of the item based at least on the extracted frontal view of the item and each extracted reflection view of the item.

Abstract: The present invention relates to the field of medical monitoring, and in particular non-contact, video-based monitoring of pulse rate, respiration rate, motion, and oxygen saturation. Systems and methods are described for capturing images of a patient, producing intensity signals from the images, filtering those signals to focus on a physiologic component, and measuring a vital sign from the filtered signals. Examples include flood fill methods and skin tone filtering methods.

Abstract: The present disclosure relates to the field of medical monitoring, and, in particular, to non-contact detecting and monitoring of patient breathing. Systems, methods, and computer readable media are described for calculating a change in depth of regions in one or more regions of interest (ROI's) on a patient and assigning one or more visual indicators to the regions based on the calculated changes in depth of the regions over time. In some embodiments, one or more breathing parameter signals corresponding to the regions can be generated and/or analyzed. In these and other embodiments, the one or more visual indicators can be displayed overlaid onto the regions in real-time. In these and still other embodiments, the systems, methods, and/or computer readable media (i) can display one or more generated breathing parameter signals in real-time and/or (ii) can trigger an alert and/or an alarm when a breathing abnormality is detected.

Abstract: Modifications are performed to cause a style of an image to match a different style. A first image is accessed, where the first image has the first style. A second image is also accessed, where the second image has a second style. Subsequent to a deep neural network (DNN) learning these styles, a copy of the first image is fed as input to the DNN. The DNN modifies the first image copy by transitioning the first image copy from being of the first style to subsequently being of the second style. As a consequence, a modified style of the transitioned first image copy bilaterally matches the second style.