Abstract: Disclosed herein are systems and method for determining environment dimensions based on environment pose. In one aspect, the method may include training, with a dataset including a plurality of images featuring an environment and labelled landmarks in the environment, a neural network to identify a pose of an environment. The method may comprise receiving an input image depicting the environment, generating an input tensor based on the input image, and inputting the input tensor into the neural network, which may be configured to generate an output tensor including a position of each identified landmark, a confidence level associated with each position, and a pose confidence score. The method may include calculating a homography matrix between each position in the output tensor along a camera plane and a corresponding position in an environment plane in order to output an image that visually connects each landmark along the environment plane.

Abstract: Various aspects of the subject technology relate to systems, methods, and machine-readable media for outputting filtered visual media content items. Various aspects may include receiving an input frame of a visual media content item. Aspects may also include training a machine learning algorithm based on a dataset of bracketed images. Aspects may include configuring a neural network based on image filtering of the input frame and via a shader component of a graphics processing unit. Aspects may include determining portions of the input frame that are associated with an extent of darkness. Aspects may include performing an image enhancement operation to the portions of the input frame. Aspects may include providing instructions to display an output frame changed by the image enhancement operation.

Abstract: Disclosed is an image segmentation method including receiving an image to be segmented and segmenting the received image by using a neural network learned through a Mumford-Shah function-based loss function.

Abstract: A vehicle information display system includes a digital license plate attachable to a vehicle and having a display able to present electronically readable visual information. This electronically readable visual information is usable to facilitate provision of services, including but not limited to vehicle rental or providing vehicle access to authorized service providers.

Abstract: A method for mitigating motion blur in a visual tracking system is described. In one aspect, a method for selective motion blur mitigation in a visual tracking system includes accessing a first image generated by an optical sensor of the visual tracking system, identifying camera operating parameters of the optical sensor during the optical sensor generating the first image, determining a motion of the optical sensor during the optical sensor generating the first image, determining a motion blur level of the first image based on the camera operating parameters of the optical sensor and the motion of the optical sensor, and determining whether to downscale the first image using a pyramid computation algorithm based on the motion blur level.

Abstract: Embodiments of the disclosure provide systems and methods for estimating an amount of monetary loss to an accident damaged vehicle. An exemplary system includes a communication interface configured to receive one or more accident images taken of an accident damaged vehicle. It also includes a database for storing loss data of one or more past vehicles, and each past vehicle is associated with a historical accident. It further includes a processor coupled to the communication interface and the database. The processor is configured to detect the accident damaged vehicle in the one or more accident images, identify one or more most similar past vehicles, and estimate the amount of monetary loss to the accident damaged vehicle based on the loss data of the one or more past vehicles.

Abstract: The disclosure herein describes generating an inpainted image from a masked image using a patch-based encoder and an unquantized transformer. An image including a masked region and an unmasked region is received, and the received image is divided into a plurality of patches including masked patches. The plurality of patches is encoded into a plurality of feature vectors, wherein each patch is encoded to a feature vector. Using a transformer, a predicted token is generated for each masked patch using a feature vector encoded from the masked patch, and a quantized vector of the masked patch is determined using generated predicted token and a masked patch-specific codebook. The determined quantized vector of the masked patch is included into a set of quantized vectors associated with the plurality of patches, and an output image is generated from the set of quantized vectors using a decoder.

Abstract: Systems and methods for generating simulation data based on real-world dynamic objects are provided. A method includes obtaining two- and three-dimensional data descriptive of a dynamic object in the real world. The two- and three-dimensional information can be provided as an input to a machine-learned model to receive object model parameters descriptive of a pose and shape modification with respect to a three-dimensional template object model. The parameters can represent a three-dimensional dynamic object model indicative of an object pose and an object shape for the dynamic object. The method can be repeated on sequential two- and three-dimensional information to generate a sequence of object model parameters over time. Portions of a sequence of parameters can be stored as simulation data descriptive of a simulated trajectory of a unique dynamic object. The parameters can be evaluated by an objective function to refine the parameters and train the machine-learned model.

Abstract: A method of generating a segmentation outcome which indicates individual instances of one or more object classes for an image in a sequence of images is disclosed.

Abstract: In order to improve early emergence stages discrimination of plants, an early emergence app is proposed based on a neural network optionally with ‘attention’ mechanisms, which detects the number of plants that opened after sowing and are present in the field. This way the farmer can easily determine, if crop density targets are met at an early stage after sowing and optionally receive recommendations on catch crop.

Abstract: An image processing apparatus includes a photographing device, an image processor and a fault diagnostic device. The photographing device outputs image data. The image processor includes an electronic circuit having recognition algorithms respectively for image recognition of a predetermined recognition target included in the image data. The fault diagnostic device determines that a fault occurs in the image processor, based on a condition that a first recognition result of recognizing test image data including a characteristic pattern also included in the recognition target in case of the image processor receiving the test image data is different from an expected value as a second recognition result of recognizing the test image data in case of one of the recognition algorithms receiving the test image data.

Abstract: Embodiments of the present disclosure relate to an image processing method, a device and a computer-readable storage medium. The method includes obtaining a first reference image and a second reference image of a reference object. The method further includes determining a first constraint and a second constraint based on the first reference image and the second reference image. The first constraint is related to a difference between different depth maps of the same reference images, and the second constraint is related to a depth consistency of different reference images. The method further includes training a depth estimation model at least based on the first constraint and the second constraint. In this way, an obtained trained depth estimation model may provide more accurate depth information.

Abstract: Systems and methods are disclosed for predicting one or more medical conditions utilizing digital images and employing artificial intelligent algorithms. The system offers accurate predictions utilizing quantized pre-trained deep learning model. The pre-trained deep learning model is trained on data samples and later refined as the system processes more digital images or new medical conditions are incorporated. One pre-trained deep learning model is used to predict the probability of one or more medical conditions and identify locations in the digital image effected by the one or more medical conditions. Further, one pre-trained deep learning model utilizing additional data and plurality of digital images, forecasts rate of infection and spread of the medical condition over time.

Abstract: An object attribute inference method, a storage medium and an electronic device. The method includes the following steps: training a preset neural network by using a training sample comprising an action sequence and a target object attribute tag; where the action sequence is an interactive action sequence of a human body and an object. In this way, the object attribute inference model obtained through training can recognize the object attributes from the interaction action of the human body and the object, the object attributes include and are not limited to the weight, the shape, the hardness degree and the like of the object, and therefore the inference module obtained through training has the advantages of being universal in object attribute inference and wide in application range.

Abstract: An interaction detection method is provided. The method includes the steps of: acquiring one or more frame images; acquiring pose data of a first object using information on a plurality of feature points detected for the first object from a first frame image; determining occurrence of an interaction of the first object using the pose data of the first object; estimating a region of interest (ROI) of the first object using the information on the plurality of feature points; and acquiring information on a product corresponding to the region of interest of the first object.

Abstract: A method to measure a cognitive load based upon ocular information of a subject includes the steps of: providing a video camera configured to record a close-up view of at least one eye of the subject; providing a computing device electronically connected to the video camera and the electronic display; recording, via the video camera, the ocular information of the at least one eye of the subject; processing, via the computing device, the ocular information to identify changes in ocular signals of the subject through the use of convolutional neural networks; evaluating, via the computing device, the changes in ocular signals from the convolutional neural networks by a machine learning algorithm; determining, via the machine learning algorithm, the cognitive load for the subject; and displaying, to the subject and/or to a supervisor, the cognitive load for the subject.

Abstract: The technology disclosed relates to automatically (e.g., programmatically) initializing predictive information for tracking a complex control object (e.g., hand, hand and tool combination, robot end effector) based upon information about characteristics of the object determined from sets of collected observed information. Automated initialization techniques obviate the need for special and often bizarre start-up rituals (place your hands on the screen at the places indicated during a full moon, and so forth) required by conventional techniques. In implementations, systems can refine initial predictive information to reflect an observed condition based on comparison of the observed with an analysis of sets of collected observed information.

Abstract: Systems and methods are provided for synthesizing information from multiple image series of different kernels into a single image series, and also for converting a single baseline image series of a kernel reconstructed by a CT scanner to image series of various other kernels, using deep-learning based methods. For multi-kernel synthesis, a single set of images with desired high spatial resolution and low image noise can be synthesized from multiple image series of different kernels. The synthesized kernel is sufficient for a wide variety of clinical tasks, even in circumstances that would otherwise require many separate image sets. Kernel conversion may be configured to generate images with arbitrary reconstruction kernels from a single baseline kernel. This would reduce the burden on the CT scanner and the archival system, and greatly simplify the clinical workflow.

Abstract: A method of performing scene-dependent lens shading correction (SD-LSC) is provided. The method includes collecting scene information from a Bayer thumbnail of an input image; generating a standard red green blue (sRGB) thumbnail by processing the Bayer thumbnail of the input image to simulate white balance (WB) and pre-gamma blocks; determining a representative color channel ratio of the input image based on the scene information and the sRGB thumbnail; determining an ideal grid gain of the input image based on the representative color channel ratio and a grid gain of the input image; merging the ideal grid gain and the grid gain of the input image to generate a new grid gain; and applying the new grid gain to the input image.

Abstract: Described herein are systems, methods, and instrumentalities associated with denoising medical images such as fluoroscopic images using deep learning techniques. A first artificial neural network (ANN) is trained to denoise an input medical image in accordance with a provided target noise level. The training of the first ANN is conducted by pairing a noisy input image with target denoised images that include different levels of noise. These target denoised images are generated using a second ANN as intermediate outputs of the second ANN during different training iterations. As such, the first ANN may learn to perform the denoising task in an unsupervised manner without requiring noise-free training images as the ground truth.