Abstract: A method is provided. The method includes obtaining an enhanced state graph. The enhanced state graph represents a set of objects within an environment and a set of positions of the set of objects. The enhanced state graph includes a set of object nodes, a set of property nodes and a set of goal nodes to represent a set of objectives. The method also includes generating a set of instructions for a set of mechanical systems based on the enhanced state graph. The set of mechanical systems is configured to interact with one or more of the set of objects within the environment. The method further includes operating the set of mechanical systems to achieve the set of objectives based on the set of instructions.

Abstract: A method of labeling a dataset of input samples for a machine learning task includes selecting a plurality of pre-trained machine learning models that are related to a machine learning task. The method further includes processing a plurality of input data samples through each of the pre-trained models to generate a set of embeddings. The method further includes generating a plurality of clusterings from the set of embeddings. The method further includes analyzing, by a processing device, the plurality of clusterings to extract superclusters. The method further includes assigning pseudo-labels to the input samples based on analysis.

Abstract: Disclosed are methods and systems of controlling the placement of micro-objects on the surface of a micro-assembler. Control patterns may be used to cause electrodes of the micro-assembler to generate dielectrophoretic (DEP) and electrophoretic (EP) forces which may be used to manipulate, move, position, or orient one or more micro-objects on the surface of the micro-assembler. The control patterns may be part of a library of control patterns.

Abstract: Embodiments described herein provide a system for generating semantically accurate synthetic images. During operation, the system generates a first synthetic image using a first artificial intelligence (AI) model and presents the first synthetic image in a user interface. The user interface allows a user to identify image units of the first synthetic image that are semantically irregular. The system then obtains semantic information for the semantically irregular image units from the user via the user interface and generates a second synthetic image using a second AI model based on the semantic information. The second synthetic image can be an improved image compared to the first synthetic image.

Abstract: An apparatus comprises an input interface configured to receive a first 3D point cloud associated with a physical object prior to articulation of an articulatable part, and a second 3D point cloud after articulation of the articulatable part. A processor is operably coupled to the input interface, an output interface, and memory. Program code, when executed by the processor, causes the processor to align the first and second point clouds, find nearest neighbors of points in the first point cloud to points in the second point cloud, eliminate the nearest neighbors of points in the second point cloud such that remaining points in the second point cloud comprise points associated with the articulatable part and points associated with noise, generate an output comprising at least the remaining points of the second point cloud associated with the articulatable part without the noise points, and communicate the output to the output interface.

Abstract: The present specification relates to image capture. More specifically, it relates to selective image capture for sensor carrying devices or floats deployed, for example, on the open sea. In one form, data is generated on the sensor carrying devices or floats by an on-board Inertial Measurement Unit (IMU) and is used to automatically predict the wave motion of the sea. These predictions are then used to determine an acceptable set of motion parameters that are used to trigger the on-board camera(s). The camera(s) then capture images. One consideration is that images captured at or near the peak of a wave crest with minimal pitch and roll will contain fewer obstructions (such as other waves). Such images provide a view further into the horizon to, for example, monitor maritime sea traffic and other phenomenon. Therefore, the likelihood of capturing interesting objects such as ships, boats, garbage, birds, . . . etc. is increased.

Abstract: A method is provided. The method includes obtaining sensor data indicative of a set of objects detected within an environment. The method also includes generating a state graph based on the sensor data. The state graph includes a set of object nodes and a set of property nodes. The method further includes obtaining user input data generated based on a natural language input. The method further includes updating the state graph based on the user input data to generate an enhanced state graph. The enhanced state graph includes additional nodes generated based on the user input data. The method further includes generating a set of instructions for a set of mechanical systems based on the enhanced state graph. The method further includes operating the set of mechanical systems to achieve a set of objectives based on the set of instructions.

Abstract: In one embodiment, a method is provided. The method includes obtaining sensor data indicative of a set of objects detected within an environment. The method also includes determining a set of positions of the set of objects and a set of properties of the set of objects based on the sensor data. The method further includes generating a state graph based on the sensor data. The state graph represents the set of objects and the set of positions of the set of objects. The state graph includes a set of object nodes to represent the set of objects and a set of property nodes to represent the set of properties of the set of objects. The state graph is provided to a graph enhancement module that updates the state graph with additional data to generate an enhanced state graph.

Abstract: A method is provided. The method includes obtaining an enhanced state graph. The enhanced state graph represents a set of objects within an environment and a set of positions of the set of objects. The enhanced state graph includes a set of object nodes, a set of property nodes and a set of goal nodes to represent a set of objectives. The method also includes generating a set of instructions for a set of mechanical systems based on the enhanced state graph. The set of mechanical systems is configured to interact with one or more of the set of objects within the environment. The method further includes operating the set of mechanical systems to achieve the set of objectives based on the set of instructions.

Abstract: A method is provided. The method includes obtaining a state graph that represents a set of objects within an environment and a set of positions of the set of objects within the environment. The state graph includes a set of object nodes and a set of property nodes. The method also includes obtaining user input data. The user input data is generated based on a natural language input. The method further includes updating the state graph based on the user input data to generate an enhanced state graph. The enhanced state graph includes additional nodes generated based on the user input data. The method further includes providing the enhanced state graph to a planning module. The planning modules generates instructions for operating a mechanical system based on the enhanced state graph.

Abstract: Embodiments described herein provide a system for facilitating efficient dataset management. During operation, the system obtains a first dataset comprising a plurality of elements. The system then determines a set of categories for a respective element of the plurality of elements by applying a plurality of AI models to the first dataset. A respective category can correspond to an AI model. Subsequently, the system selects a set of sample elements associated with a respective category of a respective AI model and determines a second dataset based on the selected sample elements.

Abstract: A system and method for translating a 3D image into a 2D image is provided. A 3D image of voxels and properties associated with the voxels is analyzed. Each of the voxels in the 3D image is scaled to match a size of an output tile for a 2D image. Colors are added to the 2D image based on the properties of the voxels. Contour lines are added to the 2D image based on changes in altitude represented by the 3D image. The 2D image is output.

Abstract: A method includes defining a model for a liquid while the liquid is positioned at least partially within a nozzle of a printer. The method also includes synthesizing video frames of the liquid using the model to produce synthetic video frames. The method also includes generating a labeled dataset that includes the synthetic video frames and corresponding model values. The method also includes receiving real video frames of the liquid while the liquid is positioned at least partially within the nozzle of the printer. The method also includes generating an inverse mapping from the real video frames to predicted model values using the labeled dataset. The method also includes reconstructing the liquid in the real video frames based at least partially upon the predicted model values.

Abstract: A three-dimensional (3D) printer includes a nozzle and a camera configured to capture a real image or a real video of a liquid metal while the liquid metal is positioned at least partially within the nozzle. The 3D printer also includes a computing system configured to perform operations. The operations include generating a model of the liquid metal positioned at least partially within the nozzle. The operations also include generating a simulated image or a simulated video of the liquid metal positioned at least partially within the nozzle based at least partially upon the model. The operations also include generating a labeled dataset that comprises the simulated image or the simulated video and a first set of parameters. The operations also include reconstructing the liquid metal in the real image or the real video based at least partially upon the labeled dataset.

Abstract: Embodiments described herein provide a system for generating semantically accurate synthetic images. During operation, the system generates a first synthetic image using a first artificial intelligence (AI) model and presents the first synthetic image in a user interface. The user interface allows a user to identify image units of the first synthetic image that are semantically irregular. The system then obtains semantic information for the semantically irregular image units from the user via the user interface and generates a second synthetic image using a second AI model based on the semantic information. The second synthetic image can be an improved image compared to the first synthetic image.

Abstract: A method of image annotation includes selecting a plurality of annotation models related to an annotation task for an image, obtaining a candidate annotation map for the image from each of the plurality of annotation models, and selecting at least one of the candidate annotation maps to be displayed via a user interface, the candidate annotation maps comprising suggested annotations for the image. The method further includes receiving user selections or modifications of at least one of the suggested annotations from the candidate annotation map and generating a final annotation map based on the user selections or modifications.

Abstract: A method utilizes a target substrate has an array of chips on a carrier with a plurality of vacancies and a plurality of donor coupons are incompletely filled with functional chips. A bounding box is defined that encompasses the vacancies on the target substrate. Outcomes are simulated by overlapping a representation of the bounding box over a representation of each of a plurality of donor coupons at a plurality of translational offsets on a substrate plane to determine matches. An optimal one of the outcomes is found at a selected one or more of the donor coupons corresponding one or more offsets. A parallel transfer of the matching functional chips fills the vacancies on the target substrate using the one or more selected donor coupons and corresponding one or more offsets.

Abstract: A method of labeling a dataset of input samples for a machine learning task includes selecting a plurality of pre-trained machine learning models that are related to a machine learning task. The method further includes processing a plurality of input data samples through each of the pre-trained models to generate a set of embeddings. The method further includes generating a plurality of clusterings from the set of embeddings. The method further includes analyzing, by a processing device, the plurality of clusterings to extract superclusters. The method further includes assigning pseudo-labels to the input samples based on analysis.

Abstract: One embodiment can include a system for providing an image-capturing recommendation. During operation the system receives, from a mobile computing device, one or more images. The one or more images are captured by one or more cameras associated with the mobile computing device. The system analyzes the received images to obtain image-capturing conditions for capturing images of a target within a physical space; determines, based on the obtained image-capturing conditions and a predetermined image-quality requirement, one or more image-capturing settings; and recommends the determined one or more image-capturing settings to a user.

Abstract: A system and method for translating a 3D image into a 2D image is provided. A 3D image of voxels and properties associated with the voxels is analyzed. Each of the voxels in the 3D image is scaled to match a size of an output tile for a 2D image. Colors are added to the 2D image based on the properties of the voxels. Contour lines are added to the 2D image based on changes in altitude represented by the 3D image. The 2D image is output.