Patents Assigned to X Development LLC
  • Patent number: 11571809
    Abstract: Techniques are described herein for robotic control using value distributions. In various implementations, as part of performing a robotic task, state data associated with the robot in an environment may be generated based at least in part on vision data captured by a vision component of the robot. A plurality of candidate actions may be sampled, e.g., from continuous action space. A trained critic neural network model that represents a learned value function may be used to process a plurality of state-action pairs to generate a corresponding plurality of value distributions. Each state-action pair may include the state data and one of the plurality of sampled candidate actions. The state-action pair corresponding to the value distribution that satisfies one or more criteria may be selected from the plurality of state-action pairs. The robot may then be controlled to implement the sampled candidate action of the selected state-action pair.
    Type: Grant
    Filed: September 11, 2020
    Date of Patent: February 7, 2023
    Assignee: X DEVELOPMENT LLC
    Inventors: Cristian Bodnar, Adrian Li, Karol Hausman, Peter Pastor Sampedro, Mrinal Kalakrishnan
  • Patent number: 11564357
    Abstract: In embodiments, acquiring sensor data associated with a plant growing in a field, and analyzing the sensor data to extract one or more phenotypic traits associated with the plant from the sensor data. Indexing the one or more phenotypic traits to one or both of an identifier of the plant or a virtual representation of a part of the plant, and determining one or more plant insights based on the one or more phenotypic traits, wherein the one or more plant insights includes information about one or more of a health, a yield, a planting, a growth, a harvest, a management, a performance, and a state of the plant. One or more of the health, yield, planting, growth, harvest, management, performance, and the state of the plant are included in a plant insights report that is generated.
    Type: Grant
    Filed: November 2, 2020
    Date of Patent: January 31, 2023
    Assignee: X Development LLC
    Inventors: William R. Regan, Matthew A. Bitterman, Benoit G. Schillings, David R. Brown, Elliott Grant
  • Patent number: 11565401
    Abstract: Methods and apparatus related to receiving a request that includes robot instructions and/or environmental parameters, operating each of a plurality of robots based on the robot instructions and/or in an environment configured based on the environmental parameters, and storing data generated by the robots during the operating. In some implementations, at least part of the stored data that is generated by the robots is provided in response to the request and/or additional data that is generated based on the stored data is provided in response to the request.
    Type: Grant
    Filed: March 22, 2021
    Date of Patent: January 31, 2023
    Assignee: X DEVELOPMENT LLC
    Inventors: Peter Pastor Sampedro, Mrinal Kalakrishnan, Ali Yahya Valdovinos, Adrian Li, Kurt Konolige, Vincent Dureau
  • Patent number: 11568201
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for determining an artificial neural network architecture corresponding to a sub-graph of a synaptic connectivity graph. In one aspect, there is provided a method comprising: obtaining data defining a graph representing synaptic connectivity between neurons in a brain of a biological organism; determining, for each node in the graph, a respective set of one or more node features characterizing a structure of the graph relative to the node; identifying a sub-graph of the graph, comprising selecting a proper subset of the nodes in the graph for inclusion in the sub-graph based on the node features of the nodes in the graph; and determining an artificial neural network architecture corresponding to the sub-graph of the graph.
    Type: Grant
    Filed: January 30, 2020
    Date of Patent: January 31, 2023
    Assignee: X Development LLC
    Inventors: Sarah Ann Laszlo, Georgios Evangelopoulos, Philip Edwin Watson
  • Publication number: 20230023641
    Abstract: Image data is obtained that indicates an extent to which one or more objects reflect, scatter, or absorb light at each of multiple wavelength bands, where the image data was collected while a conveyor belt was moving the object(s). The image data is preprocessed by performing an analysis across frequencies and/or performing an analysis across a representation of a spatial dimension. A set of feature values is generated using the image preprocessed image data. A machine-learning model generates an output using to the feature values. A prediction of an identity of a chemical in the one or more objects or a level of one or more chemicals in the object(s) is generated using the output. Data is output indicating the prediction of the identity of the chemical in the object(s) or the level of the one or more chemicals in at least one of the one or more objects.
    Type: Application
    Filed: July 11, 2022
    Publication date: January 26, 2023
    Applicant: X Development LLC
    Inventors: Daniel Rosenfeld, Alexander Holiday, Gearoid Murphy, Allen Richard Zhao, Hongxu Ma, Cyrus Behroozi, Derek Werdenberg, Jie Jacquot, Vadim Tschernezki
  • Patent number: 11562497
    Abstract: Implementations are described herein for analyzing a sequence of digital images captured by a mobile vision sensor (e.g., integral with a robot), in conjunction with information (e.g., ground truth) known about movement of the vision sensor, to determine spatial dimensions of object(s) and/or an area captured in a field of view of the mobile vision sensor. Techniques avoid the use of visual indicia of known dimensions and/or other conventional tools for determining spatial dimensions, such as checkerboards. Instead, techniques described herein allow spatial dimensions to be determined using less resources, and are more scalable than conventional techniques.
    Type: Grant
    Filed: September 22, 2021
    Date of Patent: January 24, 2023
    Assignee: X DEVELOPMENT LLC
    Inventor: Yueqi Li
  • Patent number: 11562486
    Abstract: Implementations relate to diagnosis of crop yield predictions and/or crop yields at the field- and pixel-level. In various implementations, a first temporal sequence of high-elevation digital images may be obtained that captures a geographic area over a given time interval through a crop cycle of a first type of crop. Ground truth operational data generated through the given time interval and that influences a final crop yield of the first geographic area after the crop cycle may also be obtained. Based on these data, a ground truth-based crop yield prediction may be generated for the first geographic area at the crop cycle's end. Recommended operational change(s) may be identified based on distinct hypothetical crop yield prediction(s) for the first geographic area. Each distinct hypothetical crop yield prediction may be generated based on hypothetical operational data that includes altered data point(s) of the ground truth operational data.
    Type: Grant
    Filed: January 28, 2021
    Date of Patent: January 24, 2023
    Assignee: X DEVELOPMENT LLC
    Inventors: Cheng-en Guo, Wilson Zhao, Jie Yang, Zhiqiang Yuan, Elliott Grant
  • Patent number: 11554488
    Abstract: Methods, systems, and apparatus, including computer-readable storage devices, for robot navigation using 2D and 3D path planning. In the disclosed method, a robot accesses map data indicating two-dimensional layout of objects in a space and evaluates candidate paths for the robot to traverse. In response to determining that the candidate paths do not include a collision-free path across the space for a two-dimensional profile of the robot, the robot evaluates a three-dimensional shape of the robot with respect to a three-dimensional shape of an object in the space. Based on the evaluation of the three-dimensional shapes, the robot determines a collision-free path to traverse through the space.
    Type: Grant
    Filed: January 25, 2021
    Date of Patent: January 17, 2023
    Assignee: X Development LLC
    Inventor: Benjamin Holson
  • Patent number: 11554485
    Abstract: Generating a robot control policy that regulates both motion control and interaction with an environment and/or includes a learned potential function and/or dissipative field. Some implementations relate to resampling temporally distributed data points to generate spatially distributed data points, and generating the control policy using the spatially distributed data points. Some implementations additionally or alternatively relate to automatically determining a potential gradient for data points, and generating the control policy using the automatically determined potential gradient. Some implementations additionally or alternatively relate to determining and assigning a prior weight to each of the data points of multiple groups, and generating the control policy using the weights.
    Type: Grant
    Filed: July 25, 2019
    Date of Patent: January 17, 2023
    Assignee: X DEVELOPMENT LLC
    Inventor: Seyed Mohammad Khansari Zadeh
  • Patent number: 11553634
    Abstract: Implementations are described herein for analyzing vision data depicting undesirable plants such as weeds to detect various attribute(s). The detected attribute(s) of a particular undesirable plant may then be used to select, from a plurality of available candidate remediation techniques, the most suitable remediation technique to eradicate or otherwise eliminate the undesirable plants.
    Type: Grant
    Filed: October 1, 2019
    Date of Patent: January 17, 2023
    Assignee: X DEVELOPMENT LLC
    Inventors: Elliott Grant, Hongxiao Liu, Zhiqiang Yuan, Sergey Yaroshenko, Benoit Schillings, Matt VanCleave
  • Patent number: 11550971
    Abstract: At least one machine-accessible storage medium that provides instructions that, when executed by a machine, will cause the machine to perform operations. The operations comprise configuring a simulated environment to be representative of a physical device based, at least in part, on an initial description of the physical device that described structural parameters of the physical device. The operations further comprise performing a physics simulation with an artificial intelligence (“AI”) accelerator. The AI accelerator includes a matrix multiply unit for computing convolution operations via a plurality of multiply-accumulate units. The operations further comprise computing a field response in response of the physical device in response to an excitation source within the simulated environment when performing the physics simulation. The field response is computed, at least in part, with the convolution operations to perform spatial differencing.
    Type: Grant
    Filed: January 18, 2019
    Date of Patent: January 10, 2023
    Assignee: X Development LLC
    Inventors: Jesse Lu, Brian Adolf, Martin Schubert
  • Patent number: 11550278
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for causing a transducer to transmit an acoustic input signal into a member of a device. Receiving a detection signal representing reverberations of the input signal traveling within the member from a receiver. Detecting a contact of the member with an object external to the member based on a change in the detection signal, where the change in the detection signal represents an alteration in the reverberations of the input signal caused by the contact of the member with the object. Determining a position along the member of a point of the contact of the member with the object based on the change in the detection signal.
    Type: Grant
    Filed: August 6, 2019
    Date of Patent: January 10, 2023
    Assignee: X Development LLC
    Inventors: Jeffrey Thomas Bingham, Bruce Schena
  • Patent number: 11544920
    Abstract: Implementations are described herein for automatically generating synthetic training images that are usable as training data for training machine learning models to detect, segment, and/or classify various types of plants in digital images. In various implementations, a digital image may be obtained that captures an area. The digital image may depict the area under a lighting condition that existed in the area when a camera captured the digital image. Based at least in part on an agricultural history of the area, a plurality of three-dimensional synthetic plants may be generated. The synthetic training image may then be generated to depict the plurality of three-dimensional synthetic plants in the area. In some implementations, the generating may include graphically incorporating the plurality of three-dimensional synthetic plants with the digital image based on the lighting condition.
    Type: Grant
    Filed: August 31, 2021
    Date of Patent: January 3, 2023
    Assignee: X DEVELOPMENT LLC
    Inventors: Lianghao Li, Kangkang Wang, Zhiqiang Yuan
  • Patent number: 11533861
    Abstract: Methods, systems, and computer-readable media that implement an autonomous or semi-autonomous growth platform used to control live cargo exposures to environmental parameters by changing depth in an offshore environment. For example, the growth platform can be lowered at night so that farmed seaweed can perform luxury uptake of nutrients and raised during the daytime so that the farmed seaweed can capture sunlight.
    Type: Grant
    Filed: April 16, 2021
    Date of Patent: December 27, 2022
    Assignee: X Development LLC
    Inventors: Dominico P. Julian, Charles Nordstrom, Jeff Zerger, Joel Fraser Atwater, Benjamin Lundquist Saenz
  • Patent number: 11536907
    Abstract: A photonic integrated circuit includes a photonic device. The photonic device includes an input region configured to receive an input signal including a plurality of multiplexed channels. The photonic device includes a metastructured dispersive region structured to partially demultiplex the input signal into an output signal and a throughput signal. The output signal includes a channel of the multiplexed channels. The throughput signal includes the remaining channels of the multiplexed channels. The photonic device includes an output region and a throughput region optically coupled with the metastructured dispersive region to receive the output signal and the throughput signal, respectively. The metastructured dispersive region includes a heterogeneous distribution of a first material and a second material that structures the metastructured dispersive region to partially demultiplex the input signal into the output signal and the throughput signal.
    Type: Grant
    Filed: April 21, 2021
    Date of Patent: December 27, 2022
    Assignee: X Development LLC
    Inventors: Joaquin Matres Abril, Carl Jonas Love Einarsson
  • Patent number: 11532080
    Abstract: Implementations are described herein for normalizing counts of plant-parts-of-interest detected in digital imagery to account for differences in spatial dimensions of plants, particularly plant heights. In various implementations, one or more digital images depicting a top of a first plant may be processed. The one or more digital images may have been acquired by a vision sensor carried over top of the first plant by a ground-based vehicle. Based on the processing: a distance of the vision sensor to the first plant may be estimated, and a count of visible plant-parts-of-interest that were captured within a field of view of the vision sensor may be determined. Based on the estimated distance, the count of visible plant-parts-of-interest may be normalized with another count of visible plant-parts-of-interest determined from one or more digital images capturing a second plant.
    Type: Grant
    Filed: November 17, 2020
    Date of Patent: December 20, 2022
    Assignee: X DEVELOPMENT LLC
    Inventors: Zhiqiang Yuan, Bodi Yuan, Ming Zheng
  • Patent number: 11531073
    Abstract: A magnetometer includes an electron spin defect body including a plurality of lattice point defects. A microwave field transmitter is operable to apply a microwave field to the electron spin defect body. An optical source is configured to emit input light of a first wavelength that excites the plurality of lattice point defects of the electron spin defect body from a ground state to an excited state. A first optical fiber has an input end optically coupled to the optical source and an output end. The output end is attached to a first face of the electron spin defect body and is arranged to direct the input light into the first face of the electron spin defect body. A second optical fiber has an output end and an input end. A photodetector is optically coupled to the output end of the second optical fiber.
    Type: Grant
    Filed: December 31, 2020
    Date of Patent: December 20, 2022
    Assignee: X Development LLC
    Inventors: Christian Thieu Nguyen, Stefan Bogdanovic
  • Patent number: 11532400
    Abstract: A system, method, and computer readable media are provided for obtaining a first set of skin data from an image capture system including at least one ultraviolet (UV) image of a user's skin. Performing a correction on the skin data using a second set of skin data associated with the user. Quantifying a plurality of skin parameters of the user's skin based on the first skin data, including quantifying a bacterial load. Quantifying the bacterial load by applying a brightness filter to isolate portions of the at least one UV image containing fluorescence, applying a dust filter, identifying portions of the at least one UV image that contain fluorescence due to bacteria, and determining a quantity of bacterial load in the users skin. Determining, using a machine learning model, an output associated with a normal skin state of the user and a current skin state of the user.
    Type: Grant
    Filed: December 6, 2019
    Date of Patent: December 20, 2022
    Assignee: X Development LLC
    Inventors: Anupama Thubagere Jagadeesh, Brian Lance Hie
  • Patent number: 11526152
    Abstract: In some embodiments, techniques are provided for verifying that a fabrication system can fabricate a proposed segmented design. A paintbrush pattern that represents capabilities of the fabrication system is determined. One or more forbidden patterns that the fabrication system is not capable of fabricating are determined based on the paintbrush pattern. The proposed segmented design is then searched for the forbidden patterns. If any forbidden patterns are found, the proposed segmented design is determined to not be fabricable by the fabrication system. If no forbidden patterns are found, then the proposed segmented design is determined to be fabricable by the fabrication system.
    Type: Grant
    Filed: December 19, 2019
    Date of Patent: December 13, 2022
    Assignee: X DEVELOPMENT LLC
    Inventor: Albin Lee Jones
  • Patent number: D973885
    Type: Grant
    Filed: March 26, 2019
    Date of Patent: December 27, 2022
    Assignee: X Development LLC
    Inventors: Gabriella Levine, Haden Cory, Matthew David Day