Three-dimension Patents (Class 345/419)
  • Patent number: 11783560
    Abstract: Devices and techniques are generally described for three dimensional room modeling. In various examples, 3D mesh data representing a room may be received. Plane data comprising a plurality of planes may be received. Each plane of the plurality of planes may represent a planar surface detected in the room. In some cases, a first plurality of wall candidates for a 3D model of the room may be determined based at least in part on the plane data. A second plurality of wall candidates for the 3D model of the room may be determined by modifying the first plurality of wall candidates based on a comparison of the first plurality of wall candidates to the 3D mesh data. The 3D model of the room may be generated based at least in part on the second plurality of wall candidates.
    Type: Grant
    Filed: June 3, 2022
    Date of Patent: October 10, 2023
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventors: Mukul Agarwal, Asfand Yar Khan, Tomas F. Yago Vicente, Divyansh Agarwal, Karl Hillesland, Kevin May, Yu Lou, Chun-Kai Wang
  • Patent number: 11783540
    Abstract: A computer system generates an outline of a roof of a structure based on a set of lateral images depicting the structure. For each image in the set of lateral images, one or more rooflines corresponding to the roof of the structure are determined. The computer system determines how the rooflines connect to one another. Based on the determination, the rooflines are connected to generate an outline of the roof.
    Type: Grant
    Filed: May 23, 2022
    Date of Patent: October 10, 2023
    Assignee: Hover Inc.
    Inventors: Ajay Mishra, William Castillo, A. J. Altman, Manish Upendran
  • Patent number: 11782500
    Abstract: A method of simulating physics in a virtual worlds system includes: instantiating a multi-user virtual environment; selecting a plurality of physics hosts from a plurality of client devices based on predefined selection criteria; obtaining a request to modify an object within the multi-user virtual environment; in response to obtaining the request to modify the object, providing the request to the plurality of hosts and instructions to determine a candidate subsequent state of the object; obtaining a plurality of candidate subsequent states of the object, including a respective candidate subsequent state from each of the plurality of physics hosts; determining a subsequent state of the object based on the plurality of candidate subsequent states of the object; and providing the subsequent state of the object to the plurality of client devices and instructions to update their versions of the multi-user virtual environment based on the subsequent state of the object.
    Type: Grant
    Filed: August 23, 2022
    Date of Patent: October 10, 2023
    Assignee: PFAQUTRUMA RESEARCH LLC
    Inventors: Brian Shuster, Aaron Burch
  • Patent number: 11783535
    Abstract: A system and method for capturing a location based experience at an event including a plurality of mobile devices having a camera employed near a point of interest to capture random, crowdsourced images and associated metadata near said point of interest. In a preferred form, the images include depth camera information from prepositioned devices around the point of interest during the event. A network communicates images, depth information, and metadata to build a 3D model of the region, preferably with the location of contributors known. Users connect to this experience platform to view the 3D model from a user selected location and orientation and to participate in experiences with, for example, a social network.
    Type: Grant
    Filed: August 8, 2022
    Date of Patent: October 10, 2023
    Inventors: Charles D. Huston, Chris Coleman
  • Patent number: 11783444
    Abstract: Various implementations disclosed herein include a method performed at an electronic device including one or more processors, a non-transitory memory, an image sensor, and a display device. The method includes obtaining, via the image sensor, an input image that includes an object. The method includes obtaining depth information characterizing the object, wherein the depth information characterizes a first distance between the image sensor and a portion of the object. The method includes determining a distance warp map for the input image based on a function of the depth information and a first offset value characterizing an estimated distance between eyes of a user and the display device. The method includes setting an operational parameter for the electronic device based on the distance warp map and generating, by the electronic device set to the operational parameter, a warped image from the input image.
    Type: Grant
    Filed: September 22, 2020
    Date of Patent: October 10, 2023
    Assignee: APPLE INC.
    Inventors: Tobias Eble, Pedro Manuel Da Silva Quelhas, Raffi A. Bedikian
  • Patent number: 11782427
    Abstract: An industrial virtual reality (VR) system includes visualization processing capabilities that allow an augmented reality (AR) human-machine interface (HMI) application to be tested within a virtual representation of the plant environment. This approach can yield an interactable AR HMI that simulates, within the VR environment, what a wearer of an AR appliance will see while traversing the physical plant. In this way, proper operation of the AR HMI can be verified prior to commissioning of the physical system. This can include ensuring that graphics are tied to the correct data points, confirming correct and non-obtrusive locations of graphics within the user's field of view.
    Type: Grant
    Filed: October 24, 2022
    Date of Patent: October 10, 2023
    Assignee: Rockwell Automation Technologies, Inc.
    Inventors: Ian Mcgregor, Adam Davidson, David Dawkins
  • Patent number: 11783549
    Abstract: A method for observing a virtual environment includes: displaying a first environment screen of an application program, the first environment screen comprising a virtual object in a first scene; receiving a moving operation based on which the virtual object is moved from the first scene to a second scene, the first scene and the second scene being two different scenes of the virtual environment; adjusting, according to the moving operation, a first observation manner in which the virtual environment is observed in the first environment screen to a second observation manner in which the virtual environment is observed in a second environment screen, the second environment screen comprising the virtual object in the second scene; and displaying the second environment screen of the application program.
    Type: Grant
    Filed: February 19, 2021
    Date of Patent: October 10, 2023
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventor: Bojun Liu
  • Patent number: 11783515
    Abstract: A mixed reality system, comprising: a data acquisition device configured to acquire real-world data; an output device for providing the real-world data to a user; and a processing circuitry configured to: obtain (a) data acquired by the data acquisition device, and (b) information of one or more virtual entities having properties enabling determination of simulated effects of the virtual entities on the data; determine the simulated effects of the virtual entities on the data utilizing the properties; and provide the user with output on the output device being a manipulation of the data reflecting the simulated effects.
    Type: Grant
    Filed: May 11, 2022
    Date of Patent: October 10, 2023
    Assignee: ELBIT SYSTEMS LTD.
    Inventors: Amir Sheffer, Ayelet Mashiah, Ofer Livneh, Yoav Ophir
  • Patent number: 11783598
    Abstract: Systems and methods for detecting trailer angle are provided. In one aspect, an in-vehicle control system includes an optical sensor configured to be mounted on a tractor so as to face a trailer coupled to the tractor, the optical sensor further configured to generate optical data indicative of an angle formed between the trailer and the tractor. The system further includes a processor and a computer-readable memory in communication with the processor and having stored thereon computer-executable instructions to cause the processor to receive the optical data from the optical sensor, determine at least one candidate plane representative of a surface of the trailer visible in the optical data based on the optical data, and determine an angle between the trailer and the tractor based on the at least one candidate plane.
    Type: Grant
    Filed: December 6, 2021
    Date of Patent: October 10, 2023
    Assignee: TuSimple, Inc.
    Inventors: Yi Luo, Xiaoling Han, Xue Mei
  • Patent number: 11776196
    Abstract: A graphics processing apparatus comprising bounding volume hierarchy (BVH) construction circuitry to perform a spatial analysis and temporal analysis related to a plurality of input primitives and responsively generate a BVH comprising spatial, temporal, and spatial-temporal components that are hierarchically arranged, wherein the spatial components include a plurality of spatial nodes with children, the spatial nodes bounding the children using spatial bounds, and the temporal components comprise temporal nodes with children, the temporal nodes bounding their children using temporal bounds and the spatial-temporal components comprise spatial-temporal nodes with children, the spatial-temporal nodes bounding their children using spatial and temporal bounds; and ray traversal/intersection circuitry to traverse a ray or a set of rays through the BVH in accordance with the spatial and temporal components.
    Type: Grant
    Filed: July 19, 2022
    Date of Patent: October 3, 2023
    Assignee: INTEL CORPORATION
    Inventors: Sven Woop, Attila Afra, Carsten Benthin, Ingo Wald, Johannes Guenther
  • Patent number: 11775077
    Abstract: The embodiments of the disclosure provide a method for activating a system function, a host, and a computer readable storage medium. The method includes: tracking a hand gesture and accordingly rendering a hand object in a visual content, wherein the hand object comprises one or more finger object; in response to determining that the hand gesture satisfies a predetermined condition, showing at least one icon on the one or more finger object on the hand object, wherein the at least one icon respectively corresponds to at least one system function; and in response to determining that a first icon among the at least one icon is triggered, activating a first system function corresponding to the first icon.
    Type: Grant
    Filed: May 20, 2022
    Date of Patent: October 3, 2023
    Assignee: HTC Corporation
    Inventor: Yi-Hsin Chang
  • Patent number: 11776182
    Abstract: The present disclosure relates to techniques for providing an interactive computer-generated reality environment for creating a virtual drawing using one or more electronic devices. Specifically, the described techniques provide a user with a computer-generated reality environment, which can be based on different types of realities including virtual reality and mixed reality, for creating a virtual drawing on a drawing surface within the computer-generated reality environment. The computer-generated reality environment provides the user with a realistic and immersive experience while creating the virtual drawing.
    Type: Grant
    Filed: February 26, 2021
    Date of Patent: October 3, 2023
    Assignee: Apple Inc.
    Inventor: Edwin Iskandar
  • Patent number: 11777792
    Abstract: The present disclosure relates to a timeline visualization to enable users to more quickly find information and limit the amount of displayed information associated with one or more records. The timeline visualization displays events associated with a record as areas that are positioned along the timeline visualization. In some embodiments, the events displayed on the timeline visualization may be selected based on properties of the events and timeline parameters, such as dimensions of the timeline visualization and the areas to be displayed using the timeline visualization.
    Type: Grant
    Filed: April 4, 2022
    Date of Patent: October 3, 2023
    Assignee: ServiceNow, Inc.
    Inventors: Lisa Sherilyn Henderson, Betsy Cherian
  • Patent number: 11775570
    Abstract: High definition maps for autonomous vehicles are very high resolution and detailed, and hence require storage of a great deal of data. A vehicle computing system provides multi-layered caching makes this data usable in a system that requires very low latency on every operation. The system determines which routes are most likely to be driven in the near future by the car, and ensures that the route is cached on the vehicle before beginning the route. The system provides efficient formats for moving map data from server to car and for managing the on-car disk. The system further provides real-time accessibility of nearby map data as the car moves, while providing data access at optimal speeds.
    Type: Grant
    Filed: July 20, 2021
    Date of Patent: October 3, 2023
    Assignee: NVIDIA CORPORATION
    Inventor: Mark Damon Wheeler
  • Patent number: 11778160
    Abstract: Examples are disclosed that relate to calibration data related to a determined alignment of sensors on a wearable display device. One example provides a wearable display device comprising a frame, a first sensor and a second sensor, one or more displays, a logic system, and a storage system. The storage system comprises calibration data related to a determined alignment of the sensors with the frame in a bent configuration and instructions executable by the logic system. The instructions are executable to obtain a first sensor data and a second sensor data respectfully from the first and second sensors, determine a distance from the wearable display device to a feature based at least upon the first and second sensor data using the calibration data, obtain a stereo image to display based upon the distance from the wearable display device to the feature, and output the stereo image via the displays.
    Type: Grant
    Filed: June 1, 2021
    Date of Patent: October 3, 2023
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Yinan Wu, Navid Poulad, Dapeng Liu, Trevor Grant Boswell, Rayna DeMaster-Smith, Roy Joseph Riccomini, Michael Edward Samples, Yuenkeen Cheong
  • Patent number: 11769290
    Abstract: An apparatus and method are described for using tessellation hardware to generate bounding volume hierarchies (BVHs) and perform other ray tracing operations. For example, one embodiment of an apparatus comprises: a shader to output a plurality of tessellation factors and one or more input surfaces; and a tessellation circuit comprising first circuitry and/or logic to tessellate each input surface to generate a new set of primitives and second circuitry and/or logic to concurrently generate a bounding volume hierarchy (BVH) 1521 based on the new set of primitives.
    Type: Grant
    Filed: December 21, 2021
    Date of Patent: September 26, 2023
    Assignee: Intel Corporation
    Inventors: Carsten Benthin, Gabor Liktor
  • Patent number: 11767752
    Abstract: A method of determining the depth of a sidewall core sample taken from a borehole relative to a reference log of the borehole. The method includes obtaining a reference log recorded on a reference log depth scale and a borehole image log recorded on a borehole image log depth scale of a portion of the borehole from which the sidewall core sample has been taken. The method further includes generating a calibrated borehole image log from the borehole image log and the reference log and identifying a candidate sidewall core image artifact in the calibrated borehole image log. The method also includes assigning a confidence value for the candidate sidewall core image artifact based on a characteristic of the candidate sidewall core image artifact, and determining, using the confidence value, a probability that the sidewall core sample was collected at a certain depth on the reference log depth scale.
    Type: Grant
    Filed: October 2, 2020
    Date of Patent: September 26, 2023
    Assignee: SAUDI ARABIAN OIL COMPANY
    Inventors: Mustafa Ali H Al Ibrahim, Vladislav Torlov, Mokhles Mezghani
  • Patent number: 11770720
    Abstract: In two-dimensional map information showing communication equipment installation structures on which communication equipment is installed, roads, and buildings, a narrow region between the buildings is detected based on a distance of an interval of the buildings adjacent to each other and a predetermined length and a connection line connecting the buildings is imparted to an opened portion of the detected narrow region, a line-of-sight detection line is extended with any one of the communication equipment installation structures set as a start point and the line-of-sight detection line is rotated around the start point, intersections of the line-of-sight detection line and a contour line of the building or the connection line is detected and the intersection at a shortest distance from the start point among the detected intersections is detected as a line-of-sight intersection, and, when the line-of-sight intersection and another line-of-sight intersection belong to the same building, a line-of-sight range lin
    Type: Grant
    Filed: January 8, 2020
    Date of Patent: September 26, 2023
    Assignee: NIPPON TELEGRAPH AND TELEPHONE CORPORATION
    Inventors: Hideyuki Tsuboi, Hideki Toshinaga, Kazuto Goto, Yushi Shirato, Naoki Kita, Takeshi Onizawa
  • Patent number: 11768577
    Abstract: Systems and methods for providing and/or presenting, to a user, a user interface for an environment that includes virtual objects are disclosed. Exemplary implementations may: obtain, from electronic storage, information regarding virtual objects in a virtual three-dimensional space that has a virtual three-dimensional volume; determine a subset of voxels from the set of voxels such that the subset of voxels encompasses a three-dimensional volume that includes at least part of a first external surface of the first virtual object; determine proximity information for the first virtual object; determine a manipulation granularity; adjust the manipulation granularity based on the proximity information; receive particular user input from the user having a particular input magnitude; manipulate the first virtual object within the virtual three-dimensional space in accordance with the received particular user input; and effectuate presentation of the user interface to the user through a client computing platform.
    Type: Grant
    Filed: October 7, 2021
    Date of Patent: September 26, 2023
    Assignee: Meta Platforms Technologies, LLC
    Inventors: Kai Zhou, Daniel Wagner
  • Patent number: 11769295
    Abstract: A system and method for generating a 3D model and/or map of a geographic region is disclosed. A computer designates a geographic region and a number of aircraft, and partitions the designated geographic region into sub-regions, creates waypoints within each sub-region, and plans missions for each aircraft to fly to each waypoint and take pictures. The aircraft are configured to accept and perform missions from the computer, and the computer receives images from the aircraft, assigns each image to a sub-region, and transmits each sub-region and images, as well as instructions, to the computing resource. The computing resource executes the instructions, which perform 3D reconstruction and generate orthophotos and 3D models. The 3D reconstruction comprises trimming distorted portions of the orthophotos and 3D models, and merging the orthophotos and 3D models from each sub-region into a 3D model and/or map of the geographic region.
    Type: Grant
    Filed: June 3, 2021
    Date of Patent: September 26, 2023
    Assignee: Locus Social Inc.
    Inventors: Haowen You, Shaofeng Yang
  • Patent number: 11763513
    Abstract: A method and system for dynamically transferring graphical image processing operations from a graphical processing unit (GPU) to a digital signal processor (DSP). The method includes estimating the number of operations needed for the processing a set of image data; determining the operational limits of a GPU and compare with estimated number of operations and if the operational limits are exceeded; transfer the processing operations to the DSP from the GPU. The transfer can include transferring a portion of executable code for performing the processing operations, and generating a replacement code for the GPU. The DSP can then process a portion of the image data before sending it to the GPU for further processing.
    Type: Grant
    Filed: September 22, 2020
    Date of Patent: September 19, 2023
    Assignee: Texas Instruments Incorporated
    Inventors: Mihir Mody, Hemant Hariyani, Anand Balagopalakrishnan, Jason Jones, Ajay Jayaraj, Manoj Koul
  • Patent number: 11763191
    Abstract: A system and method for providing machine learning algorithms with multi-source, real-time, and context-aware real-world data use in artificial intelligence applications include providing a server and a plurality of elements connected to the server and to each other via a network, each connected element including one or more sensory mechanisms. The server includes a memory and a processor. The memory stores a persistent virtual world system including virtual replicas of real world entities created and edited via a replica editor and updated via multi-source sensory data captured by the sensory mechanisms. Each virtual replica includes data and instructions including multi-source sensory data. The processor is configured to perform data preparation thereby generating machine learning data sets, and to perform machine learning algorithms on the data sets, generating trained machine learning models for holistically inferring new data and optimizing a system composed of real world entities.
    Type: Grant
    Filed: August 20, 2019
    Date of Patent: September 19, 2023
    Assignee: THE CALANY HOLDING S. À R.L.
    Inventor: Cevat Yerli
  • Patent number: 11756280
    Abstract: A system and method for providing multiple faces of a discrete segment of an information board in virtual reality environments includes receiving a control input and displaying one or more added faces to the discrete segment of the information board at a virtual reality display device.
    Type: Grant
    Filed: December 6, 2022
    Date of Patent: September 12, 2023
    Assignee: VR-EDU, INC.
    Inventor: Ethan Fieldman
  • Patent number: 11758187
    Abstract: A sequence of point clouds is encoded as a video by an encoder and transmitted to a decoder which retrieves the sequence of point clouds. Visible points of a point cloud are iteratively projected on projection maps according to at least two centers of projection, to determine a patch data item lists. One of the centers of projection is selected and corresponding image patches are generated and packed into a picture. Pictures and associated patch data item list are encoded in a stream. The decoding method decodes pictures and associated patch data item lists. Pixels of image patches comprised in pictures are un-projected according to data stored in associated patches. The methods have the advantage of encoding every point of point clouds in a manner avoiding artifacts and allowing decoding at video frame rate.
    Type: Grant
    Filed: September 1, 2021
    Date of Patent: September 12, 2023
    Assignee: InterDigital CE Patent Holdings, SAS
    Inventors: Julien Fleureau, Thierry Tapie, Franck Thudor
  • Patent number: 11756334
    Abstract: Systems and techniques are provided for facial expression recognition. In some examples, a system receives an image frame corresponding to a face of a person. The system also determines, based on a three-dimensional model of the face, landmark feature information associated with landmark features of the face. The system then inputs, to at least one layer of a neural network trained for facial expression recognition, the image frame and the landmark feature information. The system further determines, using the neural network, a facial expression associated with the face.
    Type: Grant
    Filed: February 25, 2021
    Date of Patent: September 12, 2023
    Assignee: QUALCOMM Incorporated
    Inventors: Peng Liu, Lei Wang, Kuang-Man Huang, Michel Adib Sarkis, Ning Bi
  • Patent number: 11755688
    Abstract: The present disclosure provides an apparatus and method for training a machine learning engine configured to determine whether an object in a two dimensional (2D) image is in-scope or out-of-scope relative to the one or more 3D objects that includes receiving a 3D model of each of the one or more 3D objects, for each 3D model receiving a set of specifications and thresholds for the 3D model, augmenting the specifications of the 3D model to generate a plurality of augmented 3D models, and generating auxiliary training data based on the plurality of augmented 3D models, and utilizing the auxiliary training data to train the machine learning engine.
    Type: Grant
    Filed: December 21, 2021
    Date of Patent: September 12, 2023
    Assignee: Singulos Research Inc.
    Inventors: Bradley Quinton, Trent McClements, Michael Lee, Scott Chin
  • Patent number: 11752435
    Abstract: Systems and methods for a computer-based process that detects improper behavior of avatars in a computer-generated environment, and marks these avatars accordingly, so that other users may perceive marked avatars as bad actors. Systems of embodiments of the disclosure may monitor avatar speech, text, and actions. If the system detects behavior it deems undesirable, such as behavior against any laws or rules of the environment, abusive or obscene language, and the like, avatars committing or associated with this behavior are marked in some manner that is visually apparent to other users. In this manner, improperly-behaving avatars may be more easily recognized and avoided, thus improving the experience of other users.
    Type: Grant
    Filed: July 15, 2021
    Date of Patent: September 12, 2023
    Assignee: Rovi Guides, Inc.
    Inventors: Govind Raveendranathan Nair, Sangeeta Parida
  • Patent number: 11755910
    Abstract: Systems and methods are disclosed for capturing multiple sequences of views of a three-dimensional object using a plurality of virtual cameras. The systems and methods generate aligned sequences from the multiple sequences based on an arrangement of the plurality of virtual cameras in relation to the three-dimensional object. Using a convolutional network, the systems and methods classify the three-dimensional object based on the aligned sequences and identify the three-dimensional object using the classification.
    Type: Grant
    Filed: August 1, 2022
    Date of Patent: September 12, 2023
    Assignee: SNAP INC.
    Inventors: Yuncheng Li, Zhou Ren, Ning Xu, Enxu Yan, Tan Yu
  • Patent number: 11751823
    Abstract: A first extraction unit that extracts a region of a pulmonary nodule drawn in an image, a second extraction unit that extracts a region of a structure drawn in the image, a setting unit that sets a decision boundary to be at a position away from the pulmonary nodule region by a distance determined on a basis of a size of the pulmonary nodule region, a decision unit that decides whether or not the structure region extracted by the second extraction unit contacts with both a region related to the pulmonary nodule region and the decision boundary, and an acquisition unit that acquires, as a region of a desired structure, the structure region decided by the decision unit to contact with both the pulmonary nodule region and the decision boundary in the structure region extracted by the second extraction unit are included.
    Type: Grant
    Filed: August 6, 2018
    Date of Patent: September 12, 2023
    Assignee: Canon Kabushiki Kaisha
    Inventor: Daisuke Furukawa
  • Patent number: 11756317
    Abstract: Systems and methods for processing point cloud data are disclosed. The methods include receiving a 3D image including point cloud data, displaying a 2D image of the 3D image, and generating a 2D bounding box that envelops an object of interest in the 2D image. The methods further include generating a projected image frame comprising a projected plurality of points by projecting a plurality of points in a first direction. The methods may then include displaying an image frame that includes the 2D image and the 2D bounding box superimposed by the projected image frame, receiving a user input that includes an identification of a set of points in the projected plurality of points that correspond to the object of interest, identifying a label for the object of interest, and storing the set of points that correspond to the object of interest in association with the label.
    Type: Grant
    Filed: September 24, 2020
    Date of Patent: September 12, 2023
    Assignee: ARGO AI, LLC
    Inventors: Wei-Liang Lai, Henry Randall Burke-Sweet, William Tyler Krampe
  • Patent number: 11756227
    Abstract: Systems and techniques are provided for determining and applying corrected poses in digital content experiences. An example method can include receiving, from one or more sensors associated with an apparatus, inertial measurements and one or more frames of a scene; based on the one or more frames and the inertial measurements, determining, via a first filter, an angular and linear motion of the apparatus and a gravity vector indicating a direction of gravitational force interacting with the apparatus; when a motion of the apparatus is below a threshold, determining, via a second filter, an updated gravity vector indicating a direction of gravitational force interacting with the apparatus; determining, based on the updated gravity vector, parameters for aligning an axis of the scene with a gravity direction in a real-world spatial frame; and aligning, using the parameters, the axis of the scene with the gravity direction in the real-world spatial frame.
    Type: Grant
    Filed: May 4, 2021
    Date of Patent: September 12, 2023
    Assignee: QUALCOMM Incorporated
    Inventors: Srujan Babu Nandipati, Pushkar Gorur Sheshagiri, Chiranjib Choudhuri, Ajit Deepak Gupte, Gerhard Reitmayr
  • Patent number: 11756267
    Abstract: A method for navigating in a simulated environment is disclosed herein. A navigation device determines a search space associated with a plurality of viewpoints other than the current viewpoint in a three-dimensional (3D) space for a current viewpoint. The search space comprises a set of 3D coordinates for each of the plurality of viewpoints. The navigation device determines a field of view at the current viewpoint, which is an area associated with a viewing angle and a visible distance. The navigation device determines a target viewpoint in the search space of the current viewpoint based on the field of view at the current viewpoint. The target viewpoint is outside the area of the field of view at the current viewpoint. The navigation device causes display of a guidance user interface (UI) comprising an indicator corresponding to the target viewpoint in the field of view at the current viewpoint.
    Type: Grant
    Filed: May 23, 2022
    Date of Patent: September 12, 2023
    Assignee: Realsee (Beijing) Technology Co., Ltd.
    Inventors: Yiding Wang, Chengjie Li, Jie Bai, Yi Zhu
  • Patent number: 11755176
    Abstract: A node of a collaboration system is provided to establish communication with other nodes, store data identifying graphical targets having locations in a virtual workspace and including locations in the virtual workspace of the identified graphical targets, and compute a mapping of a local client viewport to a local client screen space. The node is configured to render on the local client screen space graphical targets having locations within the local client viewport, provide a user interface to display a list of viewport markers representing viewports, where each viewport defines an area in the workspace, and respond to an input indicating a selected viewport marker from the list of viewport markers, update the local client viewport to match the location and dimensions of the viewport represented by the selected viewport marker, and render on the local client screen space graphical targets having locations within the updated local client viewport.
    Type: Grant
    Filed: September 20, 2021
    Date of Patent: September 12, 2023
    Assignee: Haworth, Inc.
    Inventors: Ariel Jakobovits, Satish Santhakumar, Demian Entrekin
  • Patent number: 11747645
    Abstract: A display device, including a display panel, a stereoscopic structure, and a light control structure, is provided. The stereoscopic structure is disposed on the display panel, wherein the stereoscopic structure includes multiple stereoscopic units, and the stereoscopic units extend in a first direction. The light control structure is disposed between the display panel and the stereoscopic structure, wherein the light control structure includes multiple light control units, and the light control units extend in a second direction. An included angle between the first direction and the second direction is greater than 0 degrees and less than 180 degrees.
    Type: Grant
    Filed: August 9, 2022
    Date of Patent: September 5, 2023
    Assignee: Innolux Corporation
    Inventors: Jui-Jen Yueh, Tsung-Han Tsai, Kuan-Feng Lee
  • Patent number: 11748918
    Abstract: Novel viewpoints may be rendered using arrays of camera images with synthesized viewpoints. Different viewpoints of a scene may be captured via image sensors. Depth information may be determined for the captured viewpoints. An array of images may be generated that includes synthetic viewpoints generated from the captured viewpoints and depth information. A request to render a novel viewpoint may be received. Then novel viewpoint may be rendered using the array of images with synthetic viewpoints.
    Type: Grant
    Filed: September 23, 2021
    Date of Patent: September 5, 2023
    Assignee: Apple Inc.
    Inventors: Felipe Bacim De Araujo E Silva, Dan C Lelescu, Sebastien Eric Gilles Leprince, Gary L Vondran, Jr.
  • Patent number: 11747141
    Abstract: Described are a system (200) and method arranged to provide improved geocoded reference data to a 3D map representation. The system comprises a storage (201) having stored thereupon a 3D map representation comprising a textured 3D representation provided with geocoded reference data and formed based on imagery, the imagery being associated to information relating to at least one imaging device which has captured the imaging. The system comprises further a processor (208) arranged to receive at least one new image associated to information related to an imaging device which has captured the new image, perform registration of the new image to the 3D map representation, determine corresponding points in the new image and the 3D map representation, and determine displacement data for a plurality of 3D positions in the 3D map representation based on the determined corresponding points in the new image and the 3D map representation.
    Type: Grant
    Filed: February 1, 2021
    Date of Patent: September 5, 2023
    Assignee: MAXAR INTERNATIONAL SWEDEN AB
    Inventors: Folke Isaksson, Ola Nygren
  • Patent number: 11748618
    Abstract: A method for obtaining a normal vector, a geometry and a material of a three-dimensional object based on a neural network is provided. The present disclosure provides, based on an idea of “actively irradiating an object with a number of specific patterns, capturing photos at the same time, and obtaining a normal vector of an object by calculating the obtained photos”, an acquisition method combined with a neural network. Further, the method uses the obtained normal vector to optimize a model of the object. This method can also obtain material feature information while obtaining the normal vector. Finally, a high-quality geometric result and a high-quality material acquisition result are obtained jointly. The number of illumination patterns obtained by using this method is small, and the normal vector obtained by the method has high accuracy and the method is not limited to a specific acquisition device.
    Type: Grant
    Filed: March 23, 2021
    Date of Patent: September 5, 2023
    Assignees: ZHEJIANG UNIVERSITY, FACEUNITY TECHNOLOGY CO., LTD.
    Inventors: Hongzhi Wu, Kun Zhou, Kaizhang Kang
  • Patent number: 11748839
    Abstract: A graphics pipeline of a graphics processing unit includes a compressor that receives one or more attributes (positional and non-positional) of a vertex that is output from a vertex shader. The compressor determines a format of the one or more attributes, and separates each attribute into parts based on the format of the attribute. The compressor compresses each respective part of the attribute based on a type of the part. The compressed parts of the attribute are stored in an attribute storage.
    Type: Grant
    Filed: June 8, 2020
    Date of Patent: September 5, 2023
    Inventors: Nilanjan Goswami, Swati Atrish
  • Patent number: 11748932
    Abstract: In various examples there is a method of image processing comprising: storing a real image of an object in memory, the object being a specified type of object. The method involves computing, using a first encoder, a factorized embedding of the real image. The method receives a value of at least one parameter of a synthetic image rendering apparatus for rendering synthetic images of objects of the specified type. The parameter controls an attribute of synthetic images of objects rendered by the rendering apparatus. The method computes an embedding factor of the received value using a second encoder. The factorized embedding is modified with the computed embedding factor. The method computes, using a decoder with the modified embedding as input, an output image of an object which is substantially the same as the real image except for the attribute controlled by the parameter.
    Type: Grant
    Filed: June 29, 2020
    Date of Patent: September 5, 2023
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Marek Adam Kowalski, Stephan Joachim Garbin, Matthew Alastair Johnson, Tadas Baltrusaitis, Martin De la Gorce, Virginia Estellers Casas, Sebastian Karol Dziadzio
  • Patent number: 11748953
    Abstract: In some implementations, a method includes: presenting a synthesized reality (SR) setting associated with predetermined content from a first viewing vector at a first time; presenting a navigation timeline for the predetermined content including a plurality of viewing vector affordances at respective times on the navigation timeline, wherein each viewing vector characterizes how the SR content is displayed at the respective times; detecting an input selecting a respective viewing vector affordance on the navigation timeline associated with a second time within the predetermined content; and, in response to detecting the input selecting the respective viewing vector affordance on the navigation timeline, updating the SR setting in order to present the SR setting from a second viewing vector different from the first viewing vector, wherein the second viewing vector characterizes display of the predetermined content at the second times.
    Type: Grant
    Filed: May 28, 2019
    Date of Patent: September 5, 2023
    Assignee: APPLE INC.
    Inventor: Ian M. Richter
  • Patent number: 11750789
    Abstract: A storage part retains: screen positioning data indicating a position, orientation, and shape of the screen in a reference coordinate space; image capture part positioning data indicating the position and orientation of the user space image capture parts in the reference coordinate space; and three-dimensional data representing a three-dimensional object in the reference coordinate space. A processing part: identifies a user viewpoint position on the basis of the image capture part positioning data and the user space images; generates, on the basis of the user viewpoint position, the screen positioning data, and the three-dimensional data, a display image of the three-dimensional object being viewable as though the three dimensional object had been seen in a virtual space from the user viewpoint position via the screen; and causes said display image to be displayed on the screen of a display.
    Type: Grant
    Filed: June 30, 2022
    Date of Patent: September 5, 2023
    Assignee: VIRTUALWINDOW CO., LTD.
    Inventor: Rui Sato
  • Patent number: 11749655
    Abstract: An icosahedral LED display screen belongs to the field of display screens and includes multiple cabinet main frames. Each cabinet main frame is formed with an accommodating cavity. A side of each cabinet main frame is provided with a flexible PCB, an outer side of the flexible PCB is disposed with LEDs, and an inner side of the flexible PCB is provided with a magnet fixedly therewith. The multiple e.g., twenty cabinet main frames are mutually connected to form an icosahedral sphere which has no end point similar to a football, and polygons that make up the sphere are the same, and therefore the cabinet main frames can be completely covered by the flexible PCBs to eliminate a missing of display at an endpoint and reduce design numbers and complexities of the cabinet main frames and the flexible PCBs. An installation of the LED display screen becomes more convenient.
    Type: Grant
    Filed: May 21, 2021
    Date of Patent: September 5, 2023
    Assignee: SHENZHEN GALAXYPIXEL ELECTRONICS CO., LTD
    Inventors: Ligang Zhao, Guangming Song, Heng Zhan, Youhe Zhang, Lei Liang
  • Patent number: 11740791
    Abstract: In some embodiments, a memory controller in a processor includes a base value cache, a compressor, and a metadata cache. The compressor is coupled to the base value cache and the metadata cache. The compressor compresses a data block using at least a base value and delta values. The compressor determines whether the size of the data block exceeds a data block threshold value. Based on the determination of whether the size of the compressed data block generated by the compressor exceeds the data block threshold value, the memory controller transfers only a set of the compressed delta values to memory for storage. A decompressor located in the lower level cache of the processor decompresses the compressed data block using the base value stored in the base value cache, metadata stored in the metadata cache and the delta values stored in memory.
    Type: Grant
    Filed: October 8, 2021
    Date of Patent: August 29, 2023
    Assignee: Advanced Micro Devices, Inc.
    Inventors: Seyed Mohammad Seyedzadehdelcheh, Xianwei Zhang, Bradford Beckmann, Shomit N. Das
  • Patent number: 11738270
    Abstract: A simulation system including a processor, the processor performs an information acquisition process acquiring real space information obtainable by a recognition process of a real space and user information; a virtual space generation process generating a virtual space corresponding to the real space based on the real space information; an object process that sets a reference point in the virtual space based on the user information and the real space information, and disposes an object of a character in the virtual space based on the reference point; and a display process displaying an image including an image of the character. The object process sets a hit volume based on a position of a user moving body in the virtual space, and performs a process with respect to the character in accordance with a positional relationship between the hit volume and the character when the user performs a given input.
    Type: Grant
    Filed: August 7, 2020
    Date of Patent: August 29, 2023
    Assignee: BANDAI NAMCO Entertainment Inc.
    Inventors: Eiji Iwata, Nobuyuki Morishima
  • Patent number: 11743064
    Abstract: This disclosure describes a computing system that automatically detects users in visual proximity and adds the users to a private collaboration space enabling the users to share digital content. In one example, the computing system includes a video processing engine configured to detect, from first image data representative of a first physical environment that includes a second user, the second user, wherein the first image data is captured by an image capture system of a head-mounted display (HMD) worn by a first user. The computing system also includes a collaboration application configured to add, in response to detection of the second user, the second user to a set of users associated with a private collaboration space in which the set of users access shared digital content, wherein the set of users includes the first user.
    Type: Grant
    Filed: November 4, 2019
    Date of Patent: August 29, 2023
    Assignee: Meta Platforms Technologies, LLC
    Inventor: Vincent Charles Cheung
  • Patent number: 11737685
    Abstract: The present disclosure accurately identifies a posture of a user whose body is supported by a supporting apparatus. A posture identifying device includes: a model preparing section configured to prepare a three-dimensional model from body data; a body part position information obtaining section configured to obtain body part position information from a camera; a shape information obtaining section configured to obtain shape information from a shape sensor; a model correcting section configured to correct a posture in the three-dimensional model according to (i) a position of a specific part indicated by the body part position information and (ii) a shape of a seat indicated by the shape information; and a posture identifying section configured to identify a posture of a user from the posture in the three-dimensional model thus corrected.
    Type: Grant
    Filed: June 2, 2020
    Date of Patent: August 29, 2023
    Assignee: TOYOTA BOSHOKU KABUSHIKI KAISHA
    Inventors: Hiroki Abe, Kenji Kawano, Yoshiomi Nishigaki
  • Patent number: 11740311
    Abstract: A volume rendering image is obtained based on a 3D MRI image by automatically performing appropriate opacity setting. A three-dimensional image of a subject is received, a distribution of pixel values of the three-dimensional image is calculated, a pixel value of a predetermined feature amount is calculated based on the distribution of the pixel values, and opacity is set for each of the pixel value included in the three-dimensional image based on the pixel value of the feature amount. Accordingly, the opacity can be set automatically. The volume rendering image of the three-dimensional image is generated using the opacity.
    Type: Grant
    Filed: December 7, 2021
    Date of Patent: August 29, 2023
    Assignee: FUJIFILM Healthcare Corporation
    Inventors: Yasuo Kawata, Kuniaki Harada
  • Patent number: 11741657
    Abstract: An image processing method includes: determining an area to be processed according to a line feature in an image frame to be processed; building a space model according to the image frame to be processed; and embedding a special effect material to be embedded into the area to be processed according to the space model, to generate a special effect image frame.
    Type: Grant
    Filed: January 28, 2022
    Date of Patent: August 29, 2023
    Assignee: BEIJING XIAOMI MOBILE SOFTWARE CO., LTD.
    Inventors: Yang Sun, Junzeng Du
  • Patent number: 11743439
    Abstract: Methods and systems for managing content items are described. A content item may be separated into components, such as chroma components, luminance components, and audio components. For more efficient management of the content, including for storage and delivery of the content, the separate components may be stored at different locations. For example, chroma components may be stored on a central server, while luminance and audio components are stored at other locations, such as edge servers, or vice versa, to accommodate network efficiency considerations. When content is delivered to a player, two or more separate streams carrying different content components may be delivered to the player.
    Type: Grant
    Filed: November 10, 2021
    Date of Patent: August 29, 2023
    Assignee: Comcast Cable Communications, LLC
    Inventors: Douglas Bay, David Leach
  • Patent number: 11741672
    Abstract: A system may receive imaging data generated by an imaging device directed at a heart. The system may receive a first input operation indicative of a selected time-frame. The system may display images of the heart based on the intensity values mapped to the selected time-frame. The system may receive, based on interaction with the images, an apex coordinate and a base coordinate. The system may calculate, based on the apex coordinate and the base coordinate, a truncated ellipsoid representative an endocardial or epicardial boundary of the heart. The system may generate a four-dimensional mesh comprising three-dimensional vertices spaced along the mesh. The system may overlay, on the displayed images, markers representative of the vertices. The system may receive a second input operation corresponding to a selected marker. The system may enhance the mesh by adjusting or interpolating vertices across multiple time-frames.
    Type: Grant
    Filed: December 14, 2021
    Date of Patent: August 29, 2023
    Assignee: Purdue Research Foundation
    Inventors: Craig J. Goergen, Frederick William Damen