Abstract: Provided is a video generation model for performing text-to-video (T2V) or other video generation techniques. The proposed model reduces the computational costs associated with video generation. In particular, unlike traditional T2V methods, the disclosed technology can generate the full temporal duration of a video clip at once, bypassing the need for extensive computation. As one example, a machine-learned denoising diffusion model can simultaneously process a plurality of noisy inputs that correspond to various timestamps spanning the temporal dimension of a video to simultaneously generate synthetic frames for the video that match the timestamps.

Abstract: A spherical designer electromagnetic surface plasmon open resonator is provided. The open resonator includes a resonator inner core and a resonator outer shell. The resonator inner core is located in an inner center of the resonator outer shell, and the resonator inner core and the resonator outer shell are coaxial. The disclosure provides a device that implements the superscattering function for incident waves in all incident directions and in all polarization directions, and a spherical open resonator is implemented. The scattering cross section of the disclosure can be more than five times greater than that of a metal sphere of the same size, and the operating frequency can be flexibly designed. By utilizing the characteristic that the scattering cross section of the spherical designer electromagnetic surface plasmon resonator is much greater than its own geometric cross section, the electromagnetic super-scattering device can be implemented.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for editing images based on decoder-based accumulative score sampling (DASS) losses.

Abstract: A multimedia communication system and computer-implemented method for transmitting auxiliary display content to an end-user communication device to be rendered on a display device with a special effect to emphasize an image included in the auxiliary display content, comprising analyzing image data included in an auxiliary display content to detect an object image or a background image, determining a special effect based on the analysis of the image data, applying the special effect to the auxiliary display content to modify display properties for the auxiliary display content such that the object image is emphasized or pops out, and sending the auxiliary display content with modified display properties to the end-user communication device. The special effect can comprise a non-customization special effect, a simple foreground special effect or a selective foreground special effect.

Abstract: Using artificial intelligence (AI), imagery may be created for content in response to verbal or textual input. The imagery includes an object, such as a product, and a quality of the image is improved using pre-processing techniques before the image is generated and post-processing techniques after the image is generated. The pre-processing may include upscaling the object in the original image, segmenting the object from its background in the captured image, adding an outline or border stroke to the object. The post-processing techniques may include removing the object from the AI-generated background while keeping shadows and other effects in place, blurring portions of the AI-generated background where the object will be positioned, removing the outline from the object, and re-positioning the object in the AI-generated background with the outline removed.

Abstract: A fractional training process can be performed training images to an instance of a machine-learned generative image model to obtain a partially trained instance of the model. A fractional optimization process can be performed with the partially trained instance to an instance of a machine-learned three-dimensional (3D) implicit representation model obtain a partially optimized instance of the model. Based on the plurality of training images, pseudo multi-view subject images can be generated with the partially optimized instance of the 3D implicit representation model and a fully trained instance of the generative image model; The partially trained instance of the model can be trained with a set of training data. The partially optimized instance of the machine-learned 3D implicit representation model can be trained with the machine-learned multi-view image model.

Abstract: To adjust an aspect ratio of an image to match the aspect ratio of a display area for presenting the image, a computing device receives an image having a first aspect ratio, and obtains a second aspect ratio for a display area of a display in which to present the image, where the second aspect ratio is different from the first aspect ratio. The computing device extends the image to include one or more additional features which were not included in the image. Additionally, the computing device automatically crops the extended image around an identified region of interest by selecting a portion of the extended image that has an aspect ratio which matches the second aspect ratio of the display area, and provides the cropped image for presentation within the display area of the display.

Abstract: A multimedia communication system and computer-implemented method for transmitting auxiliary display content to an end-user communication device to be rendered on a display device with a special effect to emphasize an image included in the auxiliary display content, comprising a processor and a transmitter. The processor can be arranged to analyze image data included in an auxiliary display content, detect an object image or a background image in the auxiliary display content based on the analysis of the image data, determine a special effect based on the analysis of the image data, and apply the special effect to the auxiliary display content to modify display properties for the auxiliary display content such that the object image is emphasized or pops-out. The transmitter can be arranged to send the auxiliary display content with modified display properties to an end-user communication device.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training a text-to-image model so that the text-to-image model generates images that each depict a variable instance of an object class when the object class without the unique identifier is provided as a text input, and that generates images that each depict a same subject instance of the object class when the unique identifier is provided as the text input.

Abstract: Automated product identification within hosted and streamed videos is performed based on video content of a video received at an online video platform and text content associated with the video. First embeddings representative of one or more first candidate products are determined based on video content of the video, such as one or more frames selected from within the video. Second embeddings representative of one or more second candidate products are determined based on text content associated with the video, such as a title, description, or transcript of the video. A product candidate index is produced based on the second embeddings. A product identification representative of a product featured in the video is determined based on a comparison of the first embeddings against entries of the product candidate index, such as including by a nearest neighbor search responsive to the comparison. An indication of the product identification is then output at the online video platform.

Abstract: A method includes obtaining first data including a first identifier of a first product determine in association with a content item based on first metadata of the content item. The method further includes obtaining a first confidence value associated with the first product and the content item. The method further includes obtaining second data including a second identifier of the first product and a second confidence value. The method further includes providing the first data and the second data to a trained machine learning model. The method further includes obtaining a third confidence value from the trained machine learning model associated with the first product. The method further includes adjusting second metadata of the content item in view of the third confidence value.

Abstract: A multimedia communication system and computer-implemented method for transmitting auxiliary display content to an end-user communication device to be rendered on a display device with a special effect to emphasize an image included in the auxiliary display content, comprising a processor and a transmitter. The processor can be arranged to analyze image data included in an auxiliary display content, detect an object image or a background image in the auxiliary display content based on the analysis of the image data, determine a special effect based on the analysis of the image data, and apply the special effect to the auxiliary display content to modify display properties for the auxiliary display content such that the object image is emphasized or pops-out. The transmitter can be arranged to send the auxiliary display content with modified display properties to an end-user communication device.

Abstract: Automated product identification within hosted and streamed videos is performed based on video content of a video received at an online video platform and text content associated with the video. First embeddings representative of one or more first candidate products are determined based on video content of the video, such as one or more frames selected from within the video. Second embeddings representative of one or more second candidate products are determined based on text content associated with the video, such as a title, description, or transcript of the video. A product candidate index is produced based on the second embeddings. A product identification representative of a product featured in the video is determined based on a comparison of the first embeddings against entries of the product candidate index, such as including by a nearest neighbor search responsive to the comparison. An indication of the product identification is then output at the online video platform.

Abstract: A multimedia communication system and computer-implemented method for transmitting auxiliary display content to an end-user communication device to be rendered on a display device with a special effect to emphasize an image included in the auxiliary display content, comprising a processor and a transmitter. The processor can be arranged to analyze image data included in an auxiliary display content, detect an object image or a background image in the auxiliary display content based on the analysis of the image data, determine a special effect based on the analysis of the image data, and apply the special effect to the auxiliary display content to modify display properties for the auxiliary display content such that the object image is emphasized or pops-out. The transmitter can be arranged to send the auxiliary display content with modified display properties to an end-user communication device.

Abstract: A multimedia communication system and computer-implemented method for transmitting auxiliary display content to an end-user communication device to be rendered on a display device with a special effect to emphasize an image included in the auxiliary display content, comprising a processor and a transmitter. The processor can be arranged to analyze image data included in an auxiliary display content, detect an object image or a background image in the auxiliary display content based on the analysis of the image data, determine a special effect based on the analysis of the image data, and apply the special effect to the auxiliary display content to modify display properties for the auxiliary display content such that the object image is emphasized or pops-out. The transmitter can be arranged to send the auxiliary display content with modified display properties to an end-user communication device.

Abstract: Methods and systems for mask generation for an image or video are disclosed. In one embodiment, the method for creating a mask associated with an image includes receiving a first input of pixels of the image to be included in the mask. The method further includes receiving a second input of pixels of the image to not be included in the mask. The method also includes creating a classifier to classify each pixel of the image as included in the mask, not included in the mask, or unsure. The method also includes training the classifier using the first input of pixels and the second input of pixels. The method further includes classifying each pixel of the image as included in the mask, not included in the mask, or unsure.

Abstract: A method generates a high dynamic range image by first acquiring a set of images of a scene illuminated by different lighting conditions. The set of images are then combined to generate a high dynamic range image.

Abstract: A camera is configured to adaptively determine camera settings. The camera includes a plurality of sensors elements configured to acquire a current image of a scene according to a current set of camera settings. A number of sensor elements having a set of desirable properties is measured. Then, a next set of camera settings that maximize an overall number of sensor elements having the set of desirable properties is determined to acquire a next better image.

Abstract: A method generates a high dynamic range image by first acquiring a set of images of a scene illuminated by different lighting conditions. The set of images are then combined to generate a high dynamic range image.

Abstract: A camera is configured to adaptively determine camera settings. The camera includes a plurality of sensors elements configured to acquire a current image of a scene according to a current set of camera settings. A number of sensor elements having a set of desirable properties is measured. Then, a next set of camera settings that maximize an overall number of sensor elements having the set of desirable properties is determined to acquire a next better image.