Patents Examined by Sultana M Zalalee
  • Patent number: 11348285
    Abstract: A method of compressing meshes using a projection-based approach, and leveraging the tools and syntax already generated for projection-based point cloud compression is described herein. Similar to the V-PCC approach, the mesh is segmented into surface patches, only the difference is that the segments follow the connectivity of the mesh. Each surface patch (or 3D patch) is then projected to a 2D patch, whereby in the case of the mesh, the triangle surface sampling is similar to a common rasterization approach used in computer graphics. For each patch, the position of the projected vertices is kept in a list, along with the connectivity of those vertices. The sampled surface now resembles a point cloud, and is coded with the same approach used for point cloud compression. Additionally, the list of vertices and connectivity is encoded per patch, and this data is sent along with the coded point cloud data.
    Type: Grant
    Filed: April 27, 2020
    Date of Patent: May 31, 2022
    Assignee: Sony Group Corporation
    Inventors: Danillo Graziosi, Ohji Nakagami, Alexandre Zaghetto, Ali Tabatabai
  • Patent number: 11315299
    Abstract: An image generator generates images of a set of virtual fibers and effects thereon by processing representations of the set of fibers and computing representation of a virtual surface for a fiber clump in the set of virtual fibers from an artist parameter representing a desired artist effect, computing correlations of the vertices from a set of vertices based on associations of the vertices corresponding to the artist parameter, computing a set of relevant vertices using the correlations of the vertices, computing orthogonal gradients to produce a plurality of gradients using a selected vertex and the set of relevant vertices for the fiber clump, and computing the virtual surface of the fiber clump from the plurality of gradients.
    Type: Grant
    Filed: November 13, 2020
    Date of Patent: April 26, 2022
    Assignee: UNITY TECHNOLOGIES SF
    Inventor: Olivier Gourmel
  • Patent number: 11295482
    Abstract: An encoding system comprising a triangle strip identification unit operable to identify a plurality of triangle strips representing at least a portion of a three-dimensional object mesh, an restart identification unit operable to identify one or more restart indices used to signify the start of a new triangle strip, a structure identification unit operable to identify one or more arrangements of triangles within the triangle strips, a data generation unit operable to generate data comprising a set of indices representing the plurality of triangle strips, information identifying the start of a new triangle strip, and information identifying a structure of a given triangle strip for one or more triangle strips, wherein the information identifying the start of a new triangle strip and the information identifying a structure of a given triangle strip are not provided in the set of indices, and a content encoding unit operable to encode the generated data for output.
    Type: Grant
    Filed: March 11, 2021
    Date of Patent: April 5, 2022
    Assignee: Sony Interactive Entertainment Inc.
    Inventor: Sahin Serdar Kocdemir
  • Patent number: 11276246
    Abstract: A color mapping technique that provides an intuitive visualization of surface normals is described. The surface normals can be associated with a mesh for a virtual object to be displayed in augmented reality. The color mapping technique can map a unit sphere in a color space to an octahedron. The vertices of the octahedron can be aligned with prime colors of the color space. To perform the alignment, a rotation and shear matrix can be determined from coordinates for octahedron positions and coordinates of colors in the color space. The rotation and shear can provide that each region of the unit color sphere is dominated by a single prime color, with gradients between prime colors being visually balanced. Surface normals of a mesh for a virtual object can be visualized using the color mapping, and a viewer can readily determine how distant in terms of rotation two surface normals are from each other.
    Type: Grant
    Filed: October 1, 2020
    Date of Patent: March 15, 2022
    Assignee: Magic Leap, Inc.
    Inventor: Kai Berger
  • Patent number: 11263805
    Abstract: The present application discloses method for real-time processing image data based on a rendering engine. The method includes sampling a first set of data in a first pixel arrangement to be displayed as an image in a display screen with pixels in a second pixel arrangement. The method further includes creating a first model mapped with the first set of data to generate a second set of data and a second model mapped with the first set of data to generate a third set of data. Additionally, the method further includes rendering the second set of data using a first shader to output a fourth set of data and rendering the third set of data using a second shader to output a fifth set of data. Furthermore, the method includes superimposing the fourth set of data over the fifth set of data to display a sixth set of data.
    Type: Grant
    Filed: November 21, 2018
    Date of Patent: March 1, 2022
    Assignees: BEIJING BOE OPTOELECTRONICS TECHNOLOGY CO., LTD., BOE Technology Group Co., Ltd.
    Inventors: Xuefeng Wang, Wenyu Li, Jinghua Miao, Bin Zhao, Yukun Sun, Lixin Wang, Xi Li, Yuanjie Lu, Jianwen Suo, Jinbao Peng, Qingwen Fan, Zhifu Li, Hao Zhang, Lili Chen
  • Patent number: 11238645
    Abstract: A method and system of computer graphics rendering implemented upon a processor in communication with a memory device storing a data comprises: loading a data structure representing at least a part of a scene in world space for display into the processor; a transform module transforming the data structure from world space to clip space; a dividing module subdividing the data structure in clip space so as to form child data structures; and a testing module testing which of the plurality of child data structures are within a viewing frustum, so that child data structures outside of the viewing frustum are discarded and a plurality of remaining nodes are retained. The plurality of remaining data structures are subsequently subdivided and tested until the plurality of remaining data structures do not overlap with the viewing frustum. A display module processing the plurality of remaining data structures for generation of an image on a display device.
    Type: Grant
    Filed: April 23, 2020
    Date of Patent: February 1, 2022
    Assignee: Pointerra Technologies Pty Ltd
    Inventor: Shane Douglas
  • Patent number: 11217015
    Abstract: A method and apparatus for rendering a game image are disclosed. The method includes: acquiring a control meeting a preset transparency; generating a mesh model according to the control; synchronously loading the mesh model corresponding to the control in the process of displaying the control on a game image; and respectively rendering pixels of an area which is not covered by the mesh model and pixels corresponding to the control on the game image. The present disclosure solves the problem that pixel culling and rendering cannot be performed on a game image covered by a UI control under the architecture of game engine in the related art.
    Type: Grant
    Filed: February 28, 2019
    Date of Patent: January 4, 2022
    Assignee: NETEASE (HANGZHOU) NETWORK CO., LTD.
    Inventor: Bing Li
  • Patent number: 11217034
    Abstract: [Subject] To provide a size measuring device that can be readily handled and easily used for a size-taking process by even a user who has no specialized size-taking technique, a managing server, a user terminal and a size measuring system. [Means to Solve Problems] The size measuring system is provided with a size measuring device 10 that is attached to a user's body so as to measure the size of the user's body, and outputs sensor measurement information indicating the measured size or the like, a user terminal 20 operated by the user who measures the body and a managing server 30 that manages information or the like of the size and shape of apparel commodities, and based upon the sensor measurement information, supplies user size information corresponding to the information of the body size of the user and commodity retrieval results information corresponding to information about commodities that fit to the size to the user terminal 20.
    Type: Grant
    Filed: February 9, 2018
    Date of Patent: January 4, 2022
    Inventor: Yusaku Maezawa
  • Patent number: 11217016
    Abstract: A method, device, and computer-readable storage medium for generating a proxy mesh are disclosed. The method includes: receiving a reference mesh comprising a polygonal mesh that is a computer representation of a three-dimensional object; receiving a smoothed mesh corresponding to the reference mesh; selecting a given vertex in the smoothed mesh; identifying neighbor vertices of the given vertex in the smoothed mesh; for each neighbor vertex of the given vertex, determining a nearest location on the reference mesh overlaid on the smoothed mesh; determining an average position of the nearest locations on the reference mesh for the neighbor vertices of the given vertex; setting a new location of a vertex in a smoothed output polygonal mesh corresponding to the given vertex to the average position; and outputting the smoothed output polygonal mesh as a proxy mesh for the reference mesh.
    Type: Grant
    Filed: November 24, 2020
    Date of Patent: January 4, 2022
    Assignee: Electronic Arts Inc.
    Inventor: Ashton Mason
  • Patent number: 11200717
    Abstract: Video or graphics, received by a render engine within a graphics processing unit, may be segmented into a region of interest such as foreground and a region of less interest such as background. In other embodiments, an object of interest may be segmented from the rest of the depiction in a case of a video game or graphics processing workload. Each of the segmented portions of a frame may themselves make up a separate surface which is sent separately from the render engine to the display engine of a graphics processing unit. In one embodiment, the display engine combines the two surfaces and sends them over a display link to a display panel. The display controller in the display panel displays the combined frame. The combined frame is stored in a buffer and refreshed periodically.
    Type: Grant
    Filed: November 21, 2019
    Date of Patent: December 14, 2021
    Assignee: Intel Corporation
    Inventor: Joydeep Ray
  • Patent number: 11195319
    Abstract: In one embodiment, a method includes accessing a distortion mesh defined in a 3D space by a plurality of mesh coordinates that are respectively associated with a plurality of predetermined points in a screen representation, where each mesh coordinate specifies a trajectory for a ray cast from the associated predetermined point into the 3D space; determining a sampling point within the screen representation; selecting a set of mesh coordinates from the plurality of mesh coordinates based on proximities between the sampling point and the predetermined points associated with the set of mesh coordinates; computing a sampling trajectory for the sampling point based on the selected set of mesh coordinates; casting a ray into the 3D space using the sampling trajectory; computing an intersection location between the cast ray and an object in the 3D space; and determining a color value for the sampling point based on the intersection location.
    Type: Grant
    Filed: October 30, 2019
    Date of Patent: December 7, 2021
    Assignee: Facebook Technologies, LLC.
    Inventor: Larry Seiler
  • Patent number: 11190831
    Abstract: A display device includes a display; a first external interface configured to be connected to a first external device; a second external interface configured to be connected to a second external device; and a controller configured to display, on the display, an external source list menu including first connection port information for identifying the first external interface and second connection port information for identifying the second external interface and detect a connection signal indicating whether any one of the first external device or the second external device is connected to any one of the first external interface or the second external interface, wherein the connection signal includes at least one of a first connection signal indicating the first external device is connected to the first external interface or a second connection signal indicating the second external device is connected to the second external interface.
    Type: Grant
    Filed: February 5, 2020
    Date of Patent: November 30, 2021
    Assignee: LG ELECTRONICS INC.
    Inventor: Jeong Sim Kim
  • Patent number: 11188189
    Abstract: A computer programming system includes a processor configured to receive computer code in a textual format, and cause a 3-D visual representation of a portion of an immersive 3-D environment to be displayed via a 3-D visual instrumentation, where the 3-D visual representation comprises a visualization of the computer code in the textual format. The system also includes the three-dimensional (3-D) visual instrumentation, communicatively coupled with the processor, and configured to receive the 3-D visual representation, and to present the 3-D visual representation. The system also includes a motion detection instrumentation communicatively coupled with the processor, where the motion detection instrumentation is configured to receive a motion input, and where the 3-D visual representation within the immersive 3-D environment is adjusted based on the motion input.
    Type: Grant
    Filed: December 7, 2020
    Date of Patent: November 30, 2021
    Assignee: United Services Automobile Association (USAA)
    Inventors: Ashley Raine Philbrick, Alexis Maldonado, Micah Ray Pearce, Stephen Seyler Aultman
  • Patent number: 11182954
    Abstract: A plurality of images is obtained, whether as separate images or part of a video. The plurality of images is used to generate a three-dimensional (3D) model of the imagery. The 3D model is registered to a geographic coordinate system as a first registered 3D model. The first registered 3D model is merged with a second registered 3D model to generate a merged 3D model. A request including a value corresponding to a location within the geographic coordinate system that includes at least a portion of the merged 3D model is received from a client device. A message identifying at least a subset of points in the portion of the merged 3D model is sent to the client device, each point in the subset having a three-dimensional coordinate.
    Type: Grant
    Filed: September 7, 2018
    Date of Patent: November 23, 2021
    Inventors: Tom Haramaty, Alon Salhov, Sid Sampangi, Ethan Van Andel
  • Patent number: 11164378
    Abstract: A Virtual reality system which comprises a head mounted display and positional tracking to determine the position and orientation of the head mounted display. A player wearing the head mounted display would view a virtual world. External physical objects such as a cup can be identified and displayed inside the virtual world displayed inside the head mounted display so that a player can drink out of the cup without having to remove the head mounted display.
    Type: Grant
    Filed: December 26, 2018
    Date of Patent: November 2, 2021
    Assignee: Out of Sight Vision Systems LLC
    Inventors: Benjamin Cowen, Jon Muskin
  • Patent number: 11151753
    Abstract: A method includes determining depth values associated with a first set of pixel locations in a first image of a mouth. A first function is generated for a color channel based on intensities of the color channel at the first set of pixel locations and depth values associated with the first set of pixel locations. Image data comprising a new representation of the teeth is received, wherein the image data comprises a second set of pixel locations and new depth values associated with the second set of pixel locations. A new image is generated based on the image data and the first function, wherein a shape of the teeth is based on the image data and a color of the teeth is based on applying the first function to the second set of pixel locations for the teeth and the new depth values.
    Type: Grant
    Filed: September 23, 2019
    Date of Patent: October 19, 2021
    Assignee: Align Technology, Inc.
    Inventors: Yun Gao, Yingjie Li, Chao Shi
  • Patent number: 11151786
    Abstract: A grading method and apparatus for garments including supplemental materials is provided. The grading method and apparatus calculates three-dimensional (3D) strain information between a 3D source avatar and a 3D target avatar, calculates two-dimensional (2D) strain information of a 2D pattern corresponding to source garments draped over the 3D source avatar based on the 3D strain information, determines grading information for grading the 2D pattern to correspond to the 3D target avatar based on the 2D strain information, identifies at least one supplemental material included in the source garments, extracts at least one polygon matching the at least one supplemental material among a plurality of polygons modeling the 2D pattern, and performs grading on the at least one supplemental material based on grading information of the at least one polygon.
    Type: Grant
    Filed: August 18, 2020
    Date of Patent: October 19, 2021
    Assignee: CLO VIRTUAL FASHION INC.
    Inventors: Seungwoo Oh, Jaehwan Ma, Bora Kim, Yeji Kim
  • Patent number: 11127214
    Abstract: An improved wireless split rendering system for displaying Extended Reality (XR) content is discussed. A rendering server and client head-mounted device (HMD) may communicate over a wireless medium, where communication control is given to a server application layer logic. This allows the server to use request pose information from the HMD only when needed for rendering, while preserving bandwidth on the wireless medium for transmitting frames of the rendered content. This reduces contention and improves channel efficiency.
    Type: Grant
    Filed: September 16, 2019
    Date of Patent: September 21, 2021
    Assignee: QUALCOMM Incorporated
    Inventors: Qi Xue, Maksim Krasnyanskiy, Bibhu Mohanty, Ajit Venkat Rao, Serafin Diaz Spindola, Bojan Vrcelj, Sandeep Kanakapura Lakshmikantha
  • Patent number: 11120591
    Abstract: One disclosed embodiment includes a method of graphics processing. The method includes receiving a first function, wherein the first function indicates a desired sampling rate for image content, wherein the desired sampling rate differs in a first location along a first axial direction and a second location along the first axial direction, and wherein the image content is divided into a plurality of tiles, determining a first rasterization rate for each tile of the plurality of tiles based, at least in part, on the desired sampling rate indicated by the first function corresponding to each respective tile, receiving one or more primitives associated with content for display, rasterizing at least a portion of a primitive associated with a respective tile based, at least in part, on the determined first rasterization rate for the respective tile, and displaying an image based on the rasterized portion of the primitive.
    Type: Grant
    Filed: May 31, 2019
    Date of Patent: September 14, 2021
    Assignee: Apple Inc.
    Inventors: Michal Valient, Michael Imbrogno, Rohan Sehgal, Kyle C. Piddington, Matthijs L. van der Meide
  • Patent number: 11107095
    Abstract: A method for display control executed by a display control device includes: acquiring, by the display control device, demand prediction information regarding prediction of demand for allocation of a vehicle in a prediction target area in units of block numbers of the prediction target area; and displaying, by the display control device, the demand prediction information acquired by the display control device on a display unit in a state of being superimposed on a map in the units of block numbers of the prediction target area.
    Type: Grant
    Filed: October 17, 2019
    Date of Patent: August 31, 2021
    Assignees: TOYOTA JIDOSHA KABUSHIKI KAISHA, JapanTaxi Co., Ltd.
    Inventors: Daiki Kaneichi, Yuichi Komatsu, Kiichi Ueta