Patents Issued in February 14, 2023
  • Patent number: 11580654
    Abstract: Aspects of the present disclosure relate to systems and methods for active depth sensing. An example apparatus configured to perform active depth sensing includes a projector. The projector is configured to emit a first distribution of light during a first time and emit a second distribution of light different from the first distribution of light during a second time. A set of final depth values of one or more objects in a scene is based on one or more reflections of the first distribution of light and one or more reflections of the second distribution of light. The projector may include a laser array, and the apparatus may be configured to switch between a first plurality of lasers of the laser array to emit light during the first time and a second plurality of laser to emit light during the second time.
    Type: Grant
    Filed: June 4, 2020
    Date of Patent: February 14, 2023
    Assignee: QUALCOMM Incorporated
    Inventors: James Wilson Nash, Kalin Mitkov Atanassov, Ioannis Nousias, Mark Ian Roy Muir, Sami Khawam
  • Patent number: 11580655
    Abstract: Examples disclosed herein may involve a computing system that is operable to (i) present, via a visual interface, a virtual shape associated with a three-dimensional (3D) coordinate system, (ii) present, via the visual interface, a visual indicator positioned in proximity to the virtual shape and indicating that a specified spatial parameter of the virtual shape will be modified along a specified dimension of the 3D coordinate system in response to a given type of user input associated with the visual indicator, (iii) while presenting the visual indicator, detect an instance of the given type of user input associated with the visual indicator, and (iv) after detecting the instance of the given type of user input, update the virtual shape that is presented via the visual interface by modifying the specified spatial parameter of the virtual shape along the specified dimension.
    Type: Grant
    Filed: June 25, 2020
    Date of Patent: February 14, 2023
    Assignee: WOVEN PLANET NORTH AMERICA, INC.
    Inventors: Tanner Cotant Christensen, Suneet Rajendra Shah, Newton Ko Yue Der, Brandon Huang, Kim Hoang Nguyen
  • Patent number: 11580656
    Abstract: A point cloud capture system is provided to detect and correct data density during point cloud generation. The system obtains data points that are distributed within a space and that collectively represent one or more surfaces of an object, scene, or environment. The system computes the different densities with which the data points are distributed in different regions of the space, and presents an interface with a first representation for a first region of the space in which a first subset of the data points are distributed with a first density, and a second representation for a second region of the space in which a second subset of the data points are distributed with a second density.
    Type: Grant
    Filed: September 29, 2022
    Date of Patent: February 14, 2023
    Assignee: Illuscio, Inc.
    Inventor: Kevan Spencer Barsky
  • Patent number: 11580657
    Abstract: Method of generating depth estimate based on biometric data starts with server receiving positioning data from first device associated with first user. First device generates positioning data based on analysis of a data stream comprising images of second user that is associated with second device. Server then receives a biometric data of second user from second device. Biometric data is based on output from a sensor or a camera included in second device. Server then determines a distance of second user from first device using positioning data and biometric data of the second user. Other embodiments are described herein.
    Type: Grant
    Filed: August 3, 2020
    Date of Patent: February 14, 2023
    Assignee: SNAP INC.
    Inventors: Piers George Cowburn, David Li, Isac Andreas Müller Sandvik, Qi Pan
  • Patent number: 11580658
    Abstract: Described herein are a system and methods for efficiently using depth and image information for a space to generate a 3D representation of that space. In some embodiments, an indication of one or more points is received with respect to image information, which is then mapped to corresponding points within depth information. A boundary may then be calculated to be associated with each of the points based on the depth information at, and surrounding, each point. Each of the boundaries are extended outward until junctions are identified as bounding the boundaries in a direction. The system may determine whether the process is complete or not based on whether any of the calculated boundaries are currently unlimited in extent in any direction. Once the system determines that each of the boundaries is limited in extent, a 3D representation of the space may be generated based on the identified junctions and/or boundaries.
    Type: Grant
    Filed: May 5, 2020
    Date of Patent: February 14, 2023
    Assignee: LOWE'S COMPANIES, INC.
    Inventor: Mason E. Sheffield
  • Patent number: 11580659
    Abstract: The present invention relates to a method for size estimation by image recognition of a specific target using a given scale. First, a reference objected is recognized in an image and the corresponding scale is established. Then the specific target is searched and the size of the specific target is estimated according to the acquired scale.
    Type: Grant
    Filed: June 22, 2020
    Date of Patent: February 14, 2023
    Assignee: National Applied Research Laboratories
    Inventors: Jyh-Horng Wu, Chien-Hao Tseng, Meng-Wei Lin, Ting-Shuan Yeh, Yi-Hao Hsiao, Shi-Wei Lo, Fang-Pang Lin, Hsin-Hung Lin, Jo-Yu Chang
  • Patent number: 11580660
    Abstract: Systems and methods for navigating a host vehicle. The system may perform operations including receiving, from an image capture device, at least one image representative of an environment of the host vehicle; analyzing the at least one image to identify an object in the environment of the host vehicle; determining a location of the host vehicle; receiving map information associated with the determined location of the host vehicle, wherein the map information includes elevation information associated with the environment of the host vehicle; determining a distance from the host vehicle to the object based on at least the elevation information; and determining a navigational action for the host vehicle based on the determined distance.
    Type: Grant
    Filed: July 23, 2019
    Date of Patent: February 14, 2023
    Assignee: MOBILEYE VISION TECHNOLOGIES LTD.
    Inventors: Ishay Golinsky, Iddo Hanniel, Moshe Shenfeld, Yael Hacohen
  • Patent number: 11580661
    Abstract: A device, method and system for estimating elevation in images from camera devices is provided. The device detects humans at respective positions in images from a camera device, the camera device having a fixed orientation and fixed focal length. The device estimates, for the humans in the images, respective elevations of the humans, relative to the camera device, at the respective positions based at least on camera device parameters defining the fixed orientation and the fixed focal length. The device associates the respective elevations with the respective positions in the images. The device determines, using the respective elevations associated with the respective positions, a function that estimates elevation in an image from the camera device, using a respective image position coordinate as an input. The device provides the function to a video analytics engine to determine relative real-world positions in subsequent images from the camera device.
    Type: Grant
    Filed: November 23, 2020
    Date of Patent: February 14, 2023
    Assignee: MOTOROLA SOLUTIONS, INC.
    Inventor: Chia Ying Lee
  • Patent number: 11580662
    Abstract: An example method includes causing a light projecting system of a distance sensor to project a three-dimensional pattern of light onto an object, wherein the three-dimensional pattern of light comprises a plurality of points of light that collectively forms the pattern, causing a light receiving system of the distance sensor to acquire an image of the three-dimensional pattern of light projected onto the object, causing the light receiving system to acquire a two-dimensional image of the object, detecting a feature point in the two-dimensional image of the object, identifying an interpolation area for the feature point, and computing three-dimensional coordinates for the feature point by interpolating using three-dimensional coordinates of two points of the plurality of points that are within the interpolation area.
    Type: Grant
    Filed: December 22, 2020
    Date of Patent: February 14, 2023
    Assignee: Magik Eye Inc.
    Inventor: Akiteru Kimura
  • Patent number: 11580663
    Abstract: A camera height calculation method that causes a computer to execute a process, the process includes obtaining one or more images captured by an in-vehicle camera, extracting one or more feature points from the one or more images, identifying first feature points that exist over a road surface from the one or more feature points, and calculating a height of the in-vehicle camera from the road surface, based on positions of the identified first feature points.
    Type: Grant
    Filed: March 3, 2021
    Date of Patent: February 14, 2023
    Assignee: FUJITSU LIMITED
    Inventors: Jun Kanetake, Rie Hasada, Haruyuki Ishida, Takushi Fujita
  • Patent number: 11580664
    Abstract: A deep learning-based method for calculating an overhang of a battery includes the following steps: obtaining a training sample image set; training a neural network according to the training sample image set to obtain a segmentation network model; detecting an object detection image of the battery to be detected according to the segmentation network model to obtain a corresponding first binarized image; obtaining top coordinates of each of a positive electrode and a negative electrode of the battery to be detected according to the first binarized image; and calculating the overhang of the battery to be detected according to the top coordinates.
    Type: Grant
    Filed: March 28, 2021
    Date of Patent: February 14, 2023
    Assignee: WUXI UNICOMP TECHNOLOGY CO., LTD.
    Inventors: Jun Liu, Qing Yu, Yanqing Yang, Hua'an Xu
  • Patent number: 11580665
    Abstract: An image positioning system based on upsampling and a method thereof are provided. The image positioning method based on upsampling is to fetch a region image covering a target from a wide region image, determine a rough position of the target, execute an upsampling process on the region image based on neural network data model for obtaining a super-resolution region image, map the rough position onto the super-resolution region image, and analyze the super-resolution region image for determining a precise position of the target. The present disclosed example can significantly improve the efficiency of positioning and effectively reduce the required cost of hardware.
    Type: Grant
    Filed: December 14, 2019
    Date of Patent: February 14, 2023
    Assignee: DELTA ELECTRONICS, INC.
    Inventors: Yu-Cheng Su, Qi-Ming Huang, Yi-Jiun Shen, Hung-Wen Chen
  • Patent number: 11580666
    Abstract: A localization and mapping method is for localizing and mapping a moving apparatus in a moving process. The localization and mapping method includes an image capturing step, a feature point extracting step, a flag object identifying step, and a localizing and mapping step. The image capturing step includes capturing an image frame at a time point of a plurality of time points in the moving process by a camera unit. The flag object identifying step includes identifying whether the image frame includes a flag object among a plurality of the feature points in accordance with a flag database. The flag database includes a plurality of dynamic objects, and the flag object is corresponding to one of the dynamic objects. The localizing and mapping step includes performing localization and mapping in accordance with the image frames captured and the flag object thereof in the moving process.
    Type: Grant
    Filed: November 26, 2020
    Date of Patent: February 14, 2023
    Assignee: Automotive Research & Testing Center
    Inventors: Hung-Pang Lin, Cheng-Kai Wang
  • Patent number: 11580667
    Abstract: A method for characterizing a pose estimation system includes: receiving, from a pose estimation system, first poses of an arrangement of objects in a first scene; receiving, from the pose estimation system, second poses of the arrangement of objects in a second scene, the second scene being a rigid transformation of the arrangement of objects of the first scene with respect to the pose estimation system; computing a coarse scene transformation between the first scene and the second scene; matching corresponding poses between the first poses and the second poses; computing a refined scene transformation between the first scene and the second scene based on coarse scene transformation, the first poses, and the second poses; transforming the first poses based on the refined scene transformation to compute transformed first poses; and computing an average rotation error and an average translation error of the pose estimation system based on differences between the transformed first poses and the second poses.
    Type: Grant
    Filed: November 17, 2021
    Date of Patent: February 14, 2023
    Assignee: Intrinsic Innovation LLC
    Inventors: Agastya Kalra, Achuta Kadambi, Kartik Venkataraman
  • Patent number: 11580668
    Abstract: There is provided an automatic correction method for an onboard camera and an onboard camera device. The automatic correction method includes the following steps: obtaining a lane image with the onboard camera and a current extrinsic parameter matrix, and identifying two lane lines in the lane image; converting the lane image into a top-view lane image, and obtaining two projected lane lines in the top-view lane image for the two lane lines; calculating a plurality of correction parameter matrices corresponding to the current extrinsic parameter matrix according to the two projected lane lines; and correcting the current extrinsic parameter matrix according to the plurality of correction parameter matrices. This can be applied in situations where the vehicle is stationary or travelling for automatic correction on the extrinsic parameter matrix of the onboard camera.
    Type: Grant
    Filed: October 30, 2020
    Date of Patent: February 14, 2023
    Assignee: VIA TECHNOLOGIES, INC.
    Inventor: Meng-Lun Cai
  • Patent number: 11580669
    Abstract: Embodiments are disclosed for determining a context-aware text color recommendation for text at a text location on an image. In particular, in one or more embodiments, the disclosed systems and methods comprise obtaining an image and a text location on the image, identifying at least one color theme based on a color harmonic template associated with the image, modifying the at least one color theme based on characteristics of the image, determining accessibility for at least one color in the at least one color theme based on the text location on the image, and determining a color palette recommendation for text at the text location on the image based on the determined accessibility for the at least one color in the at least one color theme.
    Type: Grant
    Filed: November 9, 2020
    Date of Patent: February 14, 2023
    Assignee: Adobe Inc.
    Inventors: Jose Ignacio Echevarria Vallespi, Shikhar Garg, Saikat Chakrabarty, Nirmal Kumawat
  • Patent number: 11580670
    Abstract: A method of interframe point cloud attribute coding is performed by at least one processor and includes coding a first color attribute of a point of a point cloud to obtain a first reconstructed residual, coding a second color attribute of the point to obtain a second reconstructed residual, and determining a quantization index of the second reconstructed residual, based on the first reconstructed residual and the second reconstructed residual. The method further includes updating the second reconstructed residual, based on the quantization index and the first reconstructed residual.
    Type: Grant
    Filed: December 9, 2021
    Date of Patent: February 14, 2023
    Assignee: TENCENT AMERICA LLC
    Inventors: Sehoon Yea, Arash Vosoughi, Shan Liu
  • Patent number: 11580671
    Abstract: A method, computer program, and computer system is provided for point cloud coding. Data corresponding to a point cloud is received. Hash elements corresponding to attribute values associated with the received data is reconstructed. A size of a hash table may be decreased based on deleting one or more of the hash elements corresponding to non-border regions associated with the attribute values. The data corresponding to the point cloud is decoded based on the reconstructed hash elements.
    Type: Grant
    Filed: May 11, 2021
    Date of Patent: February 14, 2023
    Assignee: TENCENT AMERICA LLC
    Inventors: Xiang Zhang, Wen Gao, Shan Liu
  • Patent number: 11580672
    Abstract: A method of decoding point cloud data comprises obtaining a bitstream that includes an arithmetically encoded syntax element indicating a vertical point position offset within a node of a tree that represents 3-dimensional positions of points in a point cloud represented by the point cloud data; and decoding the vertical point position offset, wherein decoding the vertical point position offset comprises: determining a laser index of a laser candidate in a set of laser candidates, wherein the determined laser index indicates a laser beam that intersects the node; determining a context index based on whether the laser beam is above a first distance threshold, between the first distance threshold and a second distance threshold, between the second distance threshold and a third distance threshold, or below the third distance threshold; and arithmetically decoding a bin of the vertical point position offset using a context indicated by the determined context index.
    Type: Grant
    Filed: April 7, 2021
    Date of Patent: February 14, 2023
    Assignee: Qualcomm Incorporated
    Inventors: Geert Van der Auwera, Louis Joseph Kerofsky, Bappaditya Ray, Adarsh Krishnan Ramasubramonian, Marta Karczewicz
  • Patent number: 11580673
    Abstract: The subject matter described herein includes methods, systems, and computer readable media for mask embedding for realistic high-resolution image synthesis. According to one method for mask embedding for realistic high-resolution image synthesis includes receiving, as input, a mask embedding vector and a latent features vector, wherein the mask embedding vector acts as a semantic constraint; generating, using a trained image synthesis algorithm and the input, a realistic image, wherein the realistic image is constrained by the mask embedding vector; and outputting, by the trained image synthesis algorithm, the realistic image to a display or a storage device.
    Type: Grant
    Filed: June 4, 2020
    Date of Patent: February 14, 2023
    Assignee: Duke University
    Inventors: Yinhao Ren, Joseph Yuan-Chieh Lo
  • Patent number: 11580674
    Abstract: An information distribution apparatus includes an imaging unit configured to capture a captured image including a specific object, an object image acquisition unit configured to acquire an object image of the specific object from the captured image, and a try-on data generation unit configured to generate try-on data based on a registration avatar in a virtual space and the object image.
    Type: Grant
    Filed: August 19, 2020
    Date of Patent: February 14, 2023
    Assignee: JVCKENWOOD Corporation
    Inventors: Masayuki Nagano, Tatsumi Naganuma, Satoru Hirose
  • Patent number: 11580675
    Abstract: Techniques and systems are provided for generating a video from texture images, and for reconstructing the texture images from the video. For example, a texture image can be divided into a number of tiles, and the number of tiles can be sorted into a sequence of ordered tiles. The sequence of ordered tiles can be provided to a video coder for generating a coded video. The number of tiles can be encoded based on the sequence of ordered tiles. The encoded video including the encoded sequence of ordered tiles can be decoded. At least a portion of the decoded video can include the number of tiles sorted into a sequence of ordered tiles. A data file associated with at least the portion of the decoded video can be used to reconstruct the texture image using the tiles.
    Type: Grant
    Filed: May 26, 2021
    Date of Patent: February 14, 2023
    Assignee: Adobe Inc.
    Inventors: Gwendal Simon, Viswanathan Swaminathan, Nathan Carr, Stefano Petrangeli
  • Patent number: 11580676
    Abstract: In a method for embedding user information in webpages, user information of a user who logs into a target website is obtained. The user information is converted into color values. The color values are embedded in a target webpage of the target website. If a webpage is leaked, a user who leaks the webpage can be traced.
    Type: Grant
    Filed: December 16, 2021
    Date of Patent: February 14, 2023
    Assignees: Fu Tai Hua Industry (Shenzhen) Co., Ltd., HON HAI PRECISION INDUSTRY CO., LTD.
    Inventors: Xin Lu, Hui-Feng Liu, Yu-Yong Zhang, Shou-Feng Fan, Fu-Fa Cai
  • Patent number: 11580677
    Abstract: Methods and systems for deep learning based image reconstruction are disclosed herein. An example method includes receiving a set of imaging projections data, identifying a voxel to reconstruct, receiving a trained regression model, and reconstructing the voxel. The voxel is reconstructed by: projecting the voxel on each imaging projection in the set of imaging projections according to an acquisition geometry, extracting adjacent pixels around each projected voxel, feeding the regression model with the extracted adjacent pixel data to produce a reconstructed value of the voxel, and repeating the reconstruction for each voxel to be reconstructed to produce a reconstructed image.
    Type: Grant
    Filed: March 2, 2020
    Date of Patent: February 14, 2023
    Assignee: General Electric Company
    Inventors: Giovanni John Jacques Palma, Razvan Iordache
  • Patent number: 11580678
    Abstract: Various methods and systems are provided for artifact reduction with resolution preservation. In one example, a method includes obtaining projection data of an imaging subject, identifying a metal-containing region in the projection data, interpolating the metal-containing region to generate interpolated projection data, extracting high frequency content information from the projection data in the metal-containing region, adding the extracted high frequency content information to the interpolated projection data to generate adjusted projection data, and reconstructing one or more diagnostic images from the adjusted projection data.
    Type: Grant
    Filed: March 2, 2020
    Date of Patent: February 14, 2023
    Assignee: GE Precision Healthcare LLC
    Inventors: Meghan Yue, Elizabeth Janus Nett, Brian Nett
  • Patent number: 11580679
    Abstract: An information processing apparatus (10) is for supporting work by a user who uses drawings for a plant. The information processing apparatus (10) includes a controller (15). The controller (15) is configured to convert a drawing including elements configuring the plant into an abstract model represented by element information indicating the elements and connection information indicating a connection relationship between the elements. The controller (15) is configured to generate display information, when it is judged that a difference exists between one abstract model based on one drawing and another abstract model based on another drawing, for displaying the differing portion in a different form than another portion.
    Type: Grant
    Filed: December 25, 2020
    Date of Patent: February 14, 2023
    Assignee: YOKOGAWA ELECTRIC CORPORATION
    Inventors: Takahiro Kambe, Tatenobu Seki, Nobuaki Ema, Masato Annen
  • Patent number: 11580680
    Abstract: Embodiments of the present disclosure relate to a data analysis system that may receive data comprising a plurality of raw data items from one or more data sources, such as a monitoring agent located in a monitored network. The received data may be scored using one or more scoring rules and/or algorithms, with raw data items satisfying a score threshold designated as “data item leads.” Raw data items associated with a data item lead may be searched and displayed to the user via an interactive user interface. The data analysis system may be used to execute searches and additional enrichments against the received raw data items. The data analysis system may group received raw data items based upon shared attribute values. The data analysis system may be used to categorize received data and construct timelines, histograms, and/or other visualizations based upon the various attributes of the raw data items.
    Type: Grant
    Filed: December 13, 2019
    Date of Patent: February 14, 2023
    Assignee: Palantir Technologies Inc.
    Inventors: Timothy Yousaf, Drew Dennison, Paul Thoren, Khoa Pham, Eliot Ball, Spencer Tank, John McRaven, Lucas Ray, Jeffrey Tsui
  • Patent number: 11580681
    Abstract: An image processing apparatus includes: an image acquisition unit configured to acquire a photographed image; an editing unit configured to edit the photographed image by executing an action including an application and image processing that is a function of the application; an information acquisition unit configured to acquire photographing information on photographing of the photographed image; a first acquisition unit configured to acquire first history information indicating a history of actions for the photographed image; a second acquisition unit configured to acquire second history information based on at least a history of actions for an image different from the photographed image; and a control unit configured to determine a candidate for an action that is to be executed next on a basis of the first history information and the second history information and perform control to notify the determined candidate.
    Type: Grant
    Filed: March 9, 2021
    Date of Patent: February 14, 2023
    Assignee: Canon Kabushiki Kaisha
    Inventor: Kotaro Kitajima
  • Patent number: 11580682
    Abstract: Systems, methods, and computer readable media for messaging system with augmented reality (AR) makeup are presented. Methods include processing a first image to extract a makeup portion of the first image, the makeup portion representing the makeup from the first image and training a neural network to process images of people to add AR makeup representing the makeup from the first image. The methods may further include receiving, via a messaging application implemented by one or more processors of a user device, input that indicates a selection to add the AR makeup to a second image of a second person. The methods may further include processing the second image with the neural network to add the AR makeup to the second image and causing the second image with the AR makeup to be displayed on a display device of the user device.
    Type: Grant
    Filed: June 29, 2021
    Date of Patent: February 14, 2023
    Assignee: Snap Inc.
    Inventors: Jean Luo, Celia Nicole Mourkogiannis
  • Patent number: 11580683
    Abstract: Systems and methods for image processing are described. One or more embodiments of the present disclosure compare a vector graphics object with a guide line to obtain an attachment point of the vector graphics object, modify the guide line to obtain a guide shape, extend a line through the attachment point to obtain a projected point on the guide shape, divide the guide shape based on the projected point to obtain a partial curve, and modify the vector graphics object based on the partial curve to obtain a modified vector graphics object.
    Type: Grant
    Filed: September 23, 2021
    Date of Patent: February 14, 2023
    Assignee: ADOBE INC.
    Inventors: Arushi Jain, Praveen Kumar Dhanuka
  • Patent number: 11580684
    Abstract: Computer program products, methods, systems, apparatus, and computing entities are provided for an augmented reality display using an actual image of the item. Additionally, the present disclosure provides for a proportionally dimensioned representation of the item in the augmented reality display. In some aspects, a beacon/tag/sensor-based approach may be used. In some aspects, a marker-based approach may be used.
    Type: Grant
    Filed: October 8, 2021
    Date of Patent: February 14, 2023
    Assignee: United Parcel Service of America, Inc.
    Inventors: Andrew Dotterweich, Christopher T. Schenken, Jeffrey Cooper
  • Patent number: 11580685
    Abstract: A computing device is provided, comprising a processor configured to execute a physics engine. The physics engine is configured to, during narrowphase collision detection of a collision detection phase, identify a set of convex polyhedron pairs, each including a first convex polyhedron from a first rigid body and a second convex polyhedron from a second rigid body. The physics engine is further configured to, for each convex polyhedron pair, determine a separating plane. The physics engine is further configured to perform neighbor welding on pair combinations of the convex polyhedron pairs during the narrowphase collision detection to thereby modify the separating planes of at least a subset of the convex polyhedron pairs. The physics engine is further configured to determine collision manifolds for the convex polyhedron pairs, including for the subset of convex polyhedron pairs having the modified separating planes.
    Type: Grant
    Filed: March 12, 2021
    Date of Patent: February 14, 2023
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Petar Mitrovic, Maxwell Simon Abernethy, Alexander Sven Fichtner, David Davidovic, Eoin McLoughlin, Janos Benk, Michael Alexander Buschbeck, Milan Simic, Milos Jovanovic, Nikola Nikolic, Norbert Nemec, Oliver M Strunk, Pavle Josipovic, Pavle Popovic, Rory Mullane
  • Patent number: 11580686
    Abstract: An apparatus and method are described for utilizing volume proxies. For example, one embodiment of an apparatus comprises: a volume subdivision module to subdivide a volume into a plurality of partitions, the apparatus to process a first of the partitions and to distribute data associated with each of the other partitions to each of a plurality of nodes; a proxy generation module to compute a first proxy for the first partition, the first proxy to be transmitted to the plurality of nodes; and a ray tracing engine to perform one or more traversal/intersection operations for a current ray or group of rays using the first proxy; if the ray or group of rays interacts with the first proxy, then the ray tracing engine to send the ray(s) to a second node associated with the first proxy or retrieves data related to the interaction from the second node.
    Type: Grant
    Filed: July 20, 2021
    Date of Patent: February 14, 2023
    Assignee: Intel Corporation
    Inventor: Ingo Wald
  • Patent number: 11580687
    Abstract: A system includes at least one imaging sensor and a processor. The processor is configured to acquire, using the imaging sensor, detected data describing an environment of an autonomous vehicle. The processor is further configured to derive reference data, which describe the environment, from a predefined map, to compute difference data representing a difference between the detected data and the reference data, and to transfer the difference data. Other embodiments are also described.
    Type: Grant
    Filed: December 4, 2019
    Date of Patent: February 14, 2023
    Assignee: OTTOPIA TECHNOLOGIES LTD.
    Inventor: Amit Rosenzweig
  • Patent number: 11580688
    Abstract: A vehicle generates a city-scale map. The vehicle includes one or more Lidar sensors configured to obtain point clouds at different positions, orientations, and times, one or more processors, and a memory storing instructions that, when executed by the one or more processors, cause the system to perform registering, in pairs, a subset of the point clouds based on respective surface normals of each of the point clouds; determining loop closures based on the registered subset of point clouds; determining a position and an orientation of each of the subset of the point clouds based on constraints associated with the determined loop closures; and generating a map based on the determined position and the orientation of each of the subset of the point clouds.
    Type: Grant
    Filed: January 31, 2022
    Date of Patent: February 14, 2023
    Assignee: Pony AI Inc.
    Inventors: Mengda Yang, Weixin Jiang, Chuanchuan Liu
  • Patent number: 11580689
    Abstract: An information display control device displays, in a display region, an image of a virtual object for indicating a position of an object. The device includes: a determiner to determine a size of the virtual object based on the position of the object; a drawer to generate an image of the virtual object by placing the virtual object at the position of the object and performing a perspective projection of the virtual object onto a virtual region with a viewpoint of a user as a reference; a generator to generate a table representing a relationship between grid points in the virtual region and points corresponding to the grid points in a plane including the display region; a transformer to generate a display image of the virtual object by transforming the image of the virtual object using the table; and a controller to display the display image in the display region.
    Type: Grant
    Filed: May 3, 2021
    Date of Patent: February 14, 2023
    Assignee: MITSUBISHI ELECTRIC CORPORATION
    Inventor: Yoshihiro Tomaru
  • Patent number: 11580690
    Abstract: Systems, devices, methods, and computer-readable media for horizon-based navigation. A method can include receiving image data corresponding to a geographical region in a field of view of an imaging unit and in which the device is situated, based on the received image data, generating, by the processing unit, an image horizon corresponding to a horizon of the geographical region and from a perspective of the imaging unit, projecting three-dimensional (3D) points of a 3D point set of the geographical region to an image space of the received image data resulting in a synthetic image, generating, by the processing unit, a synthetic image horizon of the synthetic image, and responsive to determining the image horizon sufficiently correlates with the synthetic image horizon, providing a location corresponding to a perspective of the synthetic image as a location of the processing unit.
    Type: Grant
    Filed: August 31, 2021
    Date of Patent: February 14, 2023
    Assignee: Raytheon Company
    Inventors: James N. Head, Wenkai Qin, Jeffrey S. Klein, Jody D. Verret
  • Patent number: 11580691
    Abstract: A method for generating a three-dimensional (3D) model of an object includes: capturing images of the object from a plurality of viewpoints, the images including color images; generating a 3D model of the object from the images, the 3D model including a plurality of planar patches; for each patch of the planar patches: mapping image regions of the images to the patch, each image region including at least one color vector; and computing, for each patch, at least one minimal color vector among the color vectors of the image regions mapped to the patch; generating a diffuse component of a bidirectional reflectance distribution function (BRDF) for each patch of planar patches of the 3D model in accordance with the at least one minimal color vector computed for each patch; and outputting the 3D model with the BRDF for each patch.
    Type: Grant
    Filed: August 20, 2018
    Date of Patent: February 14, 2023
    Assignee: PACKSIZE LLC
    Inventors: Giulio Marin, Abbas Rafii, Carlo Dal Mutto, Kinh Tieu, Giridhar Murali, Alvise Memo
  • Patent number: 11580692
    Abstract: Various implementations disclosed herein include devices, systems, and methods that generates a three-dimensional (3D) model based on a selected subset of the images and depth data corresponding to each of the images of the subset. For example, an example process may include acquiring sensor data during movement of the device in a physical environment including an object, the sensor data including images of a physical environment captured via a camera on the device, selecting a subset of the images based on assessing the images with respect to motion-based defects based on device motion and depth data, and generating a 3D model of the object based on the selected subset of the images and depth data corresponding to each of the images of the selected subset.
    Type: Grant
    Filed: February 9, 2021
    Date of Patent: February 14, 2023
    Assignee: Apple Inc.
    Inventors: Rafael Saracchini, Tobias Rick, Zachary Z. Becker
  • Patent number: 11580693
    Abstract: Described are systems and method directed to generation of a dimensionally accurate three-dimensional (“3D”) body model of a body, such as a human body, based on two-dimensional (“2D”) images of that body. A user may use a 2D camera, such as a digital camera typically included in many of today's portable devices (e.g., cell phones, tablets, laptops, etc.) and obtain a series of 2D body images of their body from different directions with respect to the camera. The 2D body images may then be used to generate a plurality of predicted body parameters corresponding to the body represented in the 2D body images. Those predicted body parameters may then be further processed to generate a dimensionally accurate 3D model of the body of the user.
    Type: Grant
    Filed: January 21, 2022
    Date of Patent: February 14, 2023
    Assignee: Amazon Technologies, Inc.
    Inventors: David Lawrence Seymore, Prakash Ramu, Aneeb Qureshi, Ita Lifshitz, Anta Imata Safo, Megan Heffernan
  • Patent number: 11580694
    Abstract: Radar, lidar, and other active 3D imaging techniques require large, heavy sensors that consume lots of power. Passive 3D imaging techniques based on feature matching are computationally expensive and limited by the quality of the feature matching. Fortunately, there is a robust, computationally inexpensive way to generate 3D images from full-motion video acquired from a platform that moves relative to the scene. The full-motion video frames are registered to each other and mapped to the scene coordinates using data about the trajectory of the platform with respect to the scene. The time derivative of the registered frames equals the product of the height map of the scene, the projected angular velocity of the platform, and the spatial gradient of the registered frames. This relationship can be solved in (near) real time to produce the height map of the scene from the full-motion video and the trajectory.
    Type: Grant
    Filed: August 28, 2020
    Date of Patent: February 14, 2023
    Assignee: Massachusetts Institute of Technology
    Inventor: Robert Sweeney
  • Patent number: 11580695
    Abstract: A method for a sensor-based and memory-based representation of a surroundings of a vehicle. The vehicle includes an imaging sensor for detecting the surroundings. The method includes: detecting a sequence of images; determining distance data on the basis of the detected images and/or of a distance sensor of the vehicle, the distance data comprising distances between the vehicle and objects in the surroundings of the vehicle; generating a three-dimensional structure of a surroundings model on the basis of the distance data; recognizing at least one object in the surroundings of the vehicle on the basis of the detected images, in particular by a neural network; loading a synthetic object model on the basis of the recognized object; adapting the generated three-dimensional structure of the surroundings model on the basis of the synthetic object model and on the basis of the distance data; and displaying the adapted surroundings model.
    Type: Grant
    Filed: May 9, 2019
    Date of Patent: February 14, 2023
    Assignee: Robert Bosch GmbH
    Inventors: Dirk Raproeger, Lidia Rosario Torres Lopez, Paul Robert Herzog, Paul-Sebastian Lauer, Uwe Brosch
  • Patent number: 11580696
    Abstract: A surveying data processing device includes a point cloud data acquiring unit, a three-dimensional model acquiring unit, a first correspondence relationship determining unit, an extended three-dimensional data generating unit, and a second correspondence relationship determining unit. The point cloud data acquiring unit acquires first point cloud data obtained by laser scanning, at a first viewpoint, and acquires second point cloud data obtained by laser scanning, at a second viewpoint. The three-dimensional model acquiring unit acquires data of a three-dimensional model. The first correspondence relationship determining unit obtains a correspondence relationship between the first point cloud data and the three-dimensional model. The extended three-dimensional data generating unit generates extended three-dimensional data in which the first point cloud data is extended, on the basis of the correspondence relationship.
    Type: Grant
    Filed: August 6, 2020
    Date of Patent: February 14, 2023
    Assignee: Topcon Corporation
    Inventor: You Sasaki
  • Patent number: 11580697
    Abstract: An exemplary method includes maintaining a receiver-side mesh-vertices list, receiving duplicative-vertex information from a sender, and responsively reducing the receiver-side mesh-vertices list in accordance with the received duplicative-vertex information, and rendering, using the reduced receiver-side mesh-vertices list, viewpoint-adaptive three-dimensional (3D) personas of a subject at least in part by weighting video pixel colors from different video-camera vantage points of video cameras that capture video streams of the subject, the weighting being performed according to a respective geometric relationship of each video-camera vantage point to a user-selected viewpoint.
    Type: Grant
    Filed: April 2, 2021
    Date of Patent: February 14, 2023
    Assignee: Verizon Patent and Licensing Inc.
    Inventors: Simion Venshtain, Yi Zhang, Cong Nguyen
  • Patent number: 11580698
    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for rendering three-dimensional captions (3D) in real-world environments depicted in image content. An editing interface is displayed on a client device. The editing interface includes an input component displayed with a view of a camera feed. A first input comprising one or more text characters is received. In response to receiving the first input, a two-dimensional (2D) representation of the one or more text characters is displayed. In response to detecting a second input, a preview interface is displayed. Within the preview interface, a 3D caption based on the one or more text characters is rendered at a position in a 3D space captured within the camera feed. A message is generated that includes the 3D caption rendered at the position in the 3D space captured within the camera feed.
    Type: Grant
    Filed: May 13, 2021
    Date of Patent: February 14, 2023
    Assignee: Snap Inc.
    Inventors: Kyle Goodrich, Samuel Edward Hare, Maxim Maximov Lazarov, Tony Mathew, Andrew James McPhee, Daniel Moreno, Wentao Shang
  • Patent number: 11580699
    Abstract: Systems and methods are described for a media guidance application (e.g., implemented on a user device) that allows users to select any arbitrary position in a virtual reality environment from where to view the virtual reality content and changes a user's perspective based on the selected position.
    Type: Grant
    Filed: May 28, 2021
    Date of Patent: February 14, 2023
    Assignee: ROVI GUIDES, INC.
    Inventors: Jonathan A. Logan, Adam Bates, Hafiza Jameela, Jesse F. Patterson, Mark K. Berner, Eric Dorsey, David W. Chamberlin, Paul Stevens, Herbert A. Waterman
  • Patent number: 11580700
    Abstract: Among other things, embodiments of the present disclosure improve the functionality of computer imaging software and systems by facilitating the manipulation of virtual content displayed in conjunction with images of real-world objects and environments. Embodiments of the present disclosure allow different virtual objects to be moved onto different physical surfaces, as well as manipulated in other ways.
    Type: Grant
    Filed: February 13, 2020
    Date of Patent: February 14, 2023
    Assignee: Snap Inc.
    Inventors: Ozi Egri, David Ben Ezra, Andrew James McPhee, Qi Pan, Eyal Zak
  • Patent number: 11580701
    Abstract: A system for displaying contents on an augmented reality (AR) device comprises a capturing module configured to capture a field of view of a user, a recording module configured to record the captured field of view, a user input controller configured to track a vision of the user towards one or more objects and a server. The server comprises a determination module, an identifier, and an analyser. The determination module is configured to determine at least one object of interest. The identifier is configured to identify a frame containing disappearance of the determined object of interest. The analyser is configured to analyse the identified frame based on at least one disappearance of the object of interest, and generate analysed data. The display module is configured to display a content of the object of interest on the AR device.
    Type: Grant
    Filed: February 20, 2020
    Date of Patent: February 14, 2023
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Gaurav Chaurasia, Ritesh Shreeshreemal
  • Patent number: 11580703
    Abstract: In one embodiment, a computing system may update a first 3D model of a region of an environment based on comparisons between the first 3D model and first depth measurements of the region generated during a first time period. The computing system may determine that the region is static by comparing the first 3D model to second depth measurements of the region generated during a second time period. The computing system may in response to determining that the region is static, detect whether the region changed after the second time period based on comparisons between a second 3D model of the region and third depth measurements of the region generated after the second time period, the second 3D model having a lower resolution than the first 3D model. The computing system may in response to detecting a change in the region, update the first 3D model of the region.
    Type: Grant
    Filed: April 1, 2021
    Date of Patent: February 14, 2023
    Assignee: Meta Platforms Technologies, LLC
    Inventors: Fabian Langguth, Alexander Sorkine Hornung
  • Patent number: 11580704
    Abstract: Various embodiments are provided herein for tracking a user's physical environment, to facilitate on-the-fly blending of a virtual environment with detected aspects of the physical environment. Embodiments can be employed to facilitate virtual roaming by compositing virtual representations of detected physical objects into virtual environments. A computing device coupled to a HMD can select portions of a depth map generated based on the user's physical environment, to generate virtual objects that correspond to the selected portions. The computing device can composite the generated virtual objects into an existing virtual environment, such that the user can traverse the virtual environment while remaining aware of their physical environment. Among other things, the computing device can employ various blending techniques for compositing, and further provide image pass-through techniques for selective viewing of the physical environment while remaining fully-immersed in virtual reality.
    Type: Grant
    Filed: April 9, 2021
    Date of Patent: February 14, 2023
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Andrew D. Wilson, Christian Holz, Eyal Ofek, Jeremy Hartmann