Texture Patents (Class 345/582)
  • Patent number: 11954832
    Abstract: A method and an apparatus for three-dimensional reconstruction. Images of the reconstruction space captured by N cameras are acquired as N current images in response to an object entering the reconstruction space. Foreground-background differences of all position points in the N current images are obtained according to the N current images and N corresponding initial background images captured by the N cameras when the reconstruction space is empty. Corresponding foreground-background differences of position points in the N current images are fused according to a corresponding relationship between all position points in the N current images and all position points in the reconstruction space, to obtain a foreground-background difference of each position point in the reconstruction space.
    Type: Grant
    Filed: March 26, 2019
    Date of Patent: April 9, 2024
    Assignee: BEIJING AINFINIT TECHNOLOGY CO., LTD
    Inventors: Song Wang, Feng Zhang, Xinran Yu
  • Patent number: 11948320
    Abstract: Systems and methods for estimating depths of features in a scene or environment surrounding a user of a spatial computing system, such as a virtual reality, augmented reality or mixed reality (collectively, cross reality) system, in an end-to-end process. The estimated depths can be utilized by a spatial computing system, for example, to provide an accurate and effective 3D cross reality experience.
    Type: Grant
    Filed: March 5, 2021
    Date of Patent: April 2, 2024
    Assignee: Magic Leap, Inc.
    Inventor: Ayan Tuhinendu Sinha
  • Patent number: 11948244
    Abstract: Methods and systems for providing a dynamic product presentation are disclosed. In one example, a method comprises providing, by a processor, a three-dimensional representation of a product in a virtual environment for display on a customer device; and responsive to the processor identifying a surface in a camera feed of the customer device having a dimensionality suitable for the product, generating, by the processor, an augmented media containing an augmented reality representation of a three-dimensional model for the product on the surface.
    Type: Grant
    Filed: February 11, 2022
    Date of Patent: April 2, 2024
    Assignee: SHOPIFY INC.
    Inventors: Russ Maschmeyer, Adam Debreczeni, Eric Andrew Florenzano, Brennan Letkeman, Sarah Hurtgen, James Harold Hall, Jr.
  • Patent number: 11941746
    Abstract: Embodiments are disclosed for computing accurate smooth occluding contours. In one embodiment, a method of computing accurate smooth occluding contours includes projecting a boundary polygon associated with a first region of a three-dimensional (3D) object to a two-dimensional (2D) image plane, the boundary polygon comprising a plurality of contour vertices and edges connecting the plurality of contour vertices, triangulating the first region in the 2D image plane to generate a 2D triangulation, and generating a 3D mesh for the first region by mapping the 2D triangulation to the 3D object.
    Type: Grant
    Filed: September 3, 2021
    Date of Patent: March 26, 2024
    Assignee: Adobe Inc.
    Inventors: Aaron Hertzmann, Shayan Hoshyari, Chenxi Liu
  • Patent number: 11934829
    Abstract: In various examples, a VPU and associated components may be optimized to improve VPU performance and throughput. For example, the VPU may include a min/max collector, automatic store predication functionality, a SIMD data path organization that allows for inter-lane sharing, a transposed load/store with stride parameter functionality, a load with permute and zero insertion functionality, hardware, logic, and memory layout functionality to allow for two point and two by two point lookups, and per memory bank load caching capabilities. In addition, decoupled accelerators may be used to offload VPU processing tasks to increase throughput and performance, and a hardware sequencer may be included in a DMA system to reduce programming complexity of the VPU and the DMA system. The DMA and VPU may execute a VPU configuration mode that allows the VPU and DMA to operate without a processing controller for performing dynamic region based data movement operations.
    Type: Grant
    Filed: December 9, 2022
    Date of Patent: March 19, 2024
    Assignee: NVIDIA Corporation
    Inventors: Ahmad Itani, Yen-Te Shih, Jagadeesh Sankaran, Ravi P Singh, Ching-Yu Hung
  • Patent number: 11936910
    Abstract: A three-dimensional data encoding method includes encoding information of a current node included in an N-ary tree structure of three-dimensional points included in three-dimensional data, where N is an integer greater than or equal to 2. In the encoding, first information is encoded, the first information indicating a range for one or more referable neighboring nodes among neighboring nodes spatially neighboring the current node, and the current node is encoded with reference to a neighboring node within the range.
    Type: Grant
    Filed: December 30, 2022
    Date of Patent: March 19, 2024
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Chi Wang, Pongsak Lasang, Chung Dean Han, Toshiyasu Sugio
  • Patent number: 11914447
    Abstract: A computing methodology in digital systems for performing computationally expensive operations while lowering the required computing resources, the power consumed to accomplish the computation, and maximizing the system throughput. Intermediate computations within the operation may be analyzed and those that have low gain values are identified and may be either removed from the computation or calculated with lower precision.
    Type: Grant
    Filed: November 20, 2020
    Date of Patent: February 27, 2024
    Assignee: MENTIUM TECHNOLOGIES INC.
    Inventor: Farnood Merrikh Bayat
  • Patent number: 11915337
    Abstract: Systems, apparatuses, and methods for implementing a downsampler in a single compute shader pass are disclosed. A central processing unit (CPU) issues a single-pass compute shader kernel to perform downsampling of a texture on a graphics processing unit (GPU). The GPU includes a plurality of compute units for executing thread groups of the kernel. Each thread group fetches a patch of the texture, and each individual thread downsamples four quads of texels to compute mip levels 1 and 2 independently of the other threads. For mip level 3, texel data is written back over one of the local data share (LDS) entries from which the texel data was loaded. This eliminates the need for a barrier between loads and stores for computing mip level 3. The remaining mip levels are computed in a similar fashion by the thread groups of the single-pass kernel.
    Type: Grant
    Filed: February 23, 2021
    Date of Patent: February 27, 2024
    Assignee: Advanced Micro Devices, Inc.
    Inventors: Lou Isabelle Kramer, Matthäus G. Chajdas
  • Patent number: 11900568
    Abstract: Provided are a writing trajectory processing method, a touch control device, a writing system and a storage medium. The writing trajectory processing method includes: obtaining writing data of an original writing trajectory, wherein the writing data comprise a plurality of first trajectory points and a plurality of first contact areas corresponding to the plurality of first trajectory points one to one; smoothing the writing data to obtain smoothed writing data; wherein the smoothed writing data comprise a plurality of second trajectory points and a plurality of second contact areas corresponding to the plurality of second trajectory points one to one; determining a plurality of trajectory line widths corresponding to the plurality of second trajectory points one to one based on the plurality of second contact areas; and, displaying the writing trajectory based on the plurality of second trajectory points and the plurality of trajectory line widths.
    Type: Grant
    Filed: September 29, 2020
    Date of Patent: February 13, 2024
    Assignee: BOE Technology Group Co., Ltd.
    Inventor: Ruibin Xue
  • Patent number: 11887255
    Abstract: A method and a system for rendering a boundary of a map area within a game map, a computer readable storage medium, and a method for rendering includes: obtaining a boundary of a map area within a game map, and expanding the boundary toward the inside of the boundary along a normal direction of the boundary to form a fuzzy boundary; obtaining each boundary vertex of the fuzzy boundary, and linearly extending a preset distance from the boundary vertex along the normal direction of the fuzzy boundary to form a boundary grid; rendering a boundary color within a first range between the fuzzy boundary and the boundary grid, and rendering a boundary transparency within a second range that expands a preset distance from the fuzzy boundary to the inside of the boundary; rendering the boundary color from the first range with convolutional incremental expansion until the second range is covered.
    Type: Grant
    Filed: November 16, 2021
    Date of Patent: January 30, 2024
    Assignee: Shanghai Lilith Network Technology Company Limited
    Inventor: Zhicheng Zhu
  • Patent number: 11869112
    Abstract: Embodiments of this application provide a watermark embedding method applicable to a three-dimensional (3D) field. By combining vertex data of an original 3D model and vertex data of a 3D watermark, and combining material data of the original 3D model and material data of the 3D watermark, the original 3D model and the 3D watermark can be synthesized into a 3D model. In addition, before and after watermark embedding, an appearance of the original 3D model can remain unchanged. This avoids impact of watermark embedding on the appearance and use value of the 3D model, and ensures a display effect of the 3D model. Further, a function of encrypting the embedded 3D watermark may be implemented, and the 3D watermark cannot be easily removed or modified. This can effectively ensure the copyright of the original 3D model, and better promote a digital asset such as the 3D model.
    Type: Grant
    Filed: December 30, 2020
    Date of Patent: January 9, 2024
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Pei Zhang, Zhongyong Cheng, Wenjin Zou, Guangjie Li
  • Patent number: 11870947
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating images using neural networks. One of the methods includes generating the output image pixel by pixel from a sequence of pixels taken from the output image, comprising, for each pixel in the output image, generating a respective score distribution over a discrete set of possible color values for each of the plurality of color channels.
    Type: Grant
    Filed: October 3, 2022
    Date of Patent: January 9, 2024
    Assignee: DeepMind Technologies Limited
    Inventors: Aaron Gerard Antonius van den Oord, Nal Emmerich Kalchbrenner, Karen Simonyan
  • Patent number: 11860572
    Abstract: Examples are disclosed that relate to computing devices, head-mounted display devices, and methods for displaying holographic objects using slicing planes or volumes. In one example a computing device causes a display system to display a holographic object associated with a holographic volume, the holographic object occluding an occluded holographic object that is not displayed. Location data of at least a portion of a hand is received from a sensor. The location data of the hand is used to locate a slicing plane or a slicing volume within the holographic volume. Based on the location of the slicing plane or the slicing volume, at least a portion of the occluded holographic object is displayed via the display system.
    Type: Grant
    Filed: November 15, 2022
    Date of Patent: January 2, 2024
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Addison Kenan Linville, Jarod Wayne Lenz Erwin, Dong Yoon Park
  • Patent number: 11863813
    Abstract: This present disclosure describes a system and methods for interactive filters in live streaming multimedia.
    Type: Grant
    Filed: February 10, 2021
    Date of Patent: January 2, 2024
    Assignee: Logitech Europe S.A.
    Inventors: Ross Alan Kakuschke, Andrew John Creeth, Eddy Gharbi
  • Patent number: 11852499
    Abstract: Embodiments of this application disclose a map rendering method performed at a terminal. The method includes: transmitting a block request to a native map module of the terminal through a three-dimensional display engine, the block request carrying a block identifier corresponding to a target field of view area; obtaining a block data address based on the block identifier through the native map module, and transmitting the block data address to the three-dimensional display engine; obtaining block data in the target field of view area based on the block data address through the three-dimensional display engine; invoking a target map interface through the native map module, to parse the block data, and generating map mesh data based on data obtained through parsing, the map mesh data including road data and building data; and performing map rendering based on the road data and the building data in the map mesh data.
    Type: Grant
    Filed: September 10, 2020
    Date of Patent: December 26, 2023
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventor: Yuewei Shao
  • Patent number: 11854128
    Abstract: A visual lens system is described that identifies, automatically and without user intervention, digital tool parameters for achieving a visual appearance of an image region in raster image data. To do so, the visual lens system processes raster image data using a tool region detection network trained to output a mask indicating whether the digital tool is useable to achieve a visual appearance of each pixel in the raster image data. The mask is then processed by a tool parameter estimation network trained to generate a probability distribution indicating an estimation of discrete parameter configurations applicable to the digital tool to achieve the visual appearance. The visual lens system generates an image tool description for the parameter configuration and incorporates the image tool description into an interactive image for the raster image data. The image tool description enables transfer of the digital tool parameter configuration to different image data.
    Type: Grant
    Filed: February 8, 2021
    Date of Patent: December 26, 2023
    Assignee: Adobe Inc.
    Inventors: Matthew David Fisher, Vineet Batra, Mrinalini Sardar, Ankit Phogat
  • Patent number: 11833424
    Abstract: The present disclosure describes an image rendering method and apparatus, and a related device. The method includes obtaining, by a terminal device, a base image corresponding to a to-be-rendered picture. The terminal device includes a memory storing instructions and a processor in communication with the memory. The method also includes obtaining, by the terminal device, a picture effect indication array corresponding to the base image, the picture effect indication array comprising a picture effect indication value corresponding to a pixel of the base image; rendering, by the terminal device, the base image matching a screen size of the terminal device to obtain a base texture map; and performing, by the terminal device, rendering on the base texture map according to the picture effect indication array. The present disclosure may effectively reduce the quantity of times of drawing in an image rendering process and improve image rendering efficiency.
    Type: Grant
    Filed: January 29, 2021
    Date of Patent: December 5, 2023
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventor: Zhiliang Wang
  • Patent number: 11816798
    Abstract: Various implementations disclosed herein include devices, systems, and methods that refine a first 3D surface representation (e.g., a 3D point cloud or a 3D mesh) using a second 3D surface representation that includes a 3D geometric primitive. In some implementations, a first 3D surface representation of a physical environment is obtained including points at 3D locations determined based on data generated by a first sensor. In some implementations, a second 3D surface representation corresponding to at least a portion of the physical environment is obtained that includes at least one 3D geometric primitive. In some implementations, a determination whether to adjust the 3D locations of at least one point of the points of the first 3D surface representation is made based on the 3D geometric primitive, and the 3D locations of the at least one point is adjusted to align with the geometric primitive based on the determination.
    Type: Grant
    Filed: March 9, 2021
    Date of Patent: November 14, 2023
    Assignee: Apple Inc.
    Inventors: Baptiste Angles, Yu Ping Lin, Ming Chuang
  • Patent number: 11804008
    Abstract: A method of rendering image frames on a computing system includes rendering an initial frame having a plurality of pixels and determining a low-resolution shading rate for at least one object in the frame or at least a portion of the frame based on at least one metric of the initial frame. The method further includes identifying a shading block having a plurality of pixels based on the low-resolution shading rate and sampling a texture data of the surface associated with the shading block wherein a texture sampling rate is at least two. The average of the texture samples is then applied to the pixels associated with the shading block. The method further includes shading the pixels in the shading block and displaying an output frame on a display device.
    Type: Grant
    Filed: June 11, 2021
    Date of Patent: October 31, 2023
    Assignee: Microsoft Technology Licensing, LLC
    Inventor: Martin Jon Irwin Fuller
  • Patent number: 11783513
    Abstract: The present disclosure provides a vector graphics data processing method, system, medium, and vector graphics processing device. The method includes the following operations: building a vector primitive path intersection data structure (PIDS) based on coordinates of path intersections (PIs); when a new PI is generated, comparing information of the new PI to information of existing PIs corresponding to an X coordinate or Y coordinate of the new PI; and storing the information of the new PI at a corresponding position in the PIDS corresponding to the X coordinate or Y coordinate of the new PI based on a result of the comparing. Only effective PI data are saved, thereby reducing memory footprint and memory bandwidth, and improving vector graphics processing performance.
    Type: Grant
    Filed: July 19, 2021
    Date of Patent: October 10, 2023
    Assignees: VeriSilicon Microelectronics (Shanghai) Co., Ltd., VeriSilicon Holdings Co., Ltd., VeriSilicon Microelectronics (Nanjing) Co., Ltd.
    Inventors: Mike M Cai, Yi Zhang, Yijun Li, Kui Qin
  • Patent number: 11775831
    Abstract: Techniques are described for efficiently reducing the amount of total computation in convolutional neural networks (CNNs) without affecting the output result or classification accuracy. Computation redundancy in CNNs is reduced by exploiting the computing nature of the convolution and subsequent pooling (e.g., sub-sampling) operations. In some implementations, the input features may be divided into a group of precision values and the operation(s) may be cascaded. A maximum may be identified (e.g., by 90% probability) using a small number of bits in the input features, and the full-precision convolution may then be performed on the maximum input. Accordingly, the total number of bits used to perform the convolution is reduced without affecting the output features or the final classification accuracy.
    Type: Grant
    Filed: January 13, 2023
    Date of Patent: October 3, 2023
    Assignee: Arizona Board of Regents on behalf of Arizona State University
    Inventors: Jae-sun Seo, Minkyu Kim
  • Patent number: 11765332
    Abstract: A method for conducting a three dimensional (3D) video conference between multiple participants, the method may include receiving second participant metadata and first viewpoint metadata by a first unit that is associated with a first participant, wherein the second participant metadata is indicative of a pose of a second participant and an expression of the second participant, wherein the first viewpoint metadata is indicative of a virtual position from which the first participant requests to view an avatar of the second participant; generating, by the first unit, and based on the second participant metadata and the first viewpoint metadata, a second participant representation information; wherein the second participant representation information comprises a compact 3D model of the second participant and a second participant texture map; and determining, for the first participant and during the 3D video conference, a representation of virtual 3D video conference environment, wherein the determining is based
    Type: Grant
    Filed: March 2, 2021
    Date of Patent: September 19, 2023
    Assignee: TRUE MEETING INC.
    Inventors: Ran Oz, Yuval Gronau, Michael Rabinovich, Osnat Goren-Peyser, Tal Perl
  • Patent number: 11717755
    Abstract: A content generation system, the system comprising an input obtaining unit operable to obtain one or more samples of input text and/or audio relating to a first content, an input analysis unit operable to generate n-grams representing one or more elements of the obtained inputs, a representation generating unit operable to generate a visual representation of one or more of the generated n-grams, and a display generation unit operable to generate second content comprising one or more elements of the visual representation in association with the first content.
    Type: Grant
    Filed: August 23, 2021
    Date of Patent: August 8, 2023
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Fabio Cappello, Maria Chiara Monti, Matthew Sanders, Timothy Bradley, Oliver Hume, Jason Craig Millson
  • Patent number: 11704839
    Abstract: The present disclosure provides a multi-view image decoding method including: obtaining, from a bitstream, three-dimensional geometry information indicating a three-dimensional space of a multi-view image, view independent component information indicating a view independent component, which is uniformly applied to every view, and view dependent component information indicating a view dependent component, which is differently applied according to views; determining a view dependent component for a texture map of a current view from the view dependent component information; generating the texture map of the current view from a view independent component of the view independent component information and the determined view dependent component for the current view; and reconstructing a current view image according to a three-dimensional space that is constructed according to the texture map of the current view and the three-dimensional geometry information.
    Type: Grant
    Filed: December 16, 2020
    Date of Patent: July 18, 2023
    Assignee: Electronics and Telecommunications Research Institute
    Inventors: Soo Woong Kim, Jung Won Kang, Gun Bang, Jin Ho Lee, Ha Hyun Lee, Sung Chang Lim
  • Patent number: 11699249
    Abstract: A search space for performing nearest neighbor searches for encoding point cloud data may be trimmed. Ranges of a space filling curve may be used to identify search space to exclude or reuse, instead of generating nearest neighbor search results for at least some of the points of a point cloud located within some of the ranges of the space filling curve. Additionally, neighboring voxels may be searched to identify any neighboring points missed during the trimmed search based on the ranges of the space filling curve.
    Type: Grant
    Filed: August 5, 2022
    Date of Patent: July 11, 2023
    Assignee: Apple Inc.
    Inventors: Khaled Mammou, Alexandros Tourapis, David Flynn, Zhenzhen Gao
  • Patent number: 11665358
    Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media to enhance texture image delivery and processing at a client device. For example, the disclosed systems can utilize a server-side compression combination that includes, in sequential order, a first compression pass, a decompression pass, and a second compression pass. By applying this compression combination to a texture image at the server-side, the disclosed systems can leverage both GPU-friendly and network-friendly image formats. For example, at a client device, the disclosed system can instruct the client device to execute a combination of decompression-compression passes on a GPU-network-friendly image delivered over a network connection to the client device.
    Type: Grant
    Filed: April 28, 2020
    Date of Patent: May 30, 2023
    Assignee: Adobe Inc.
    Inventors: Viswanathan Swaminathan, Stefano Petrangeli, Gwendal Simon
  • Patent number: 11650663
    Abstract: A system including a rendering engine to render a field texture for a field display and a foveal texture for a steerable foveal display and a compositor including a field compositor to generate frames for the field display from the field texture and a foveal compositor to generate frames for the foveal display from the foveal texture. The system further including a composition manager designed to sequence and select what is presented including one or more of data in the field display and the foveal display.
    Type: Grant
    Filed: September 20, 2021
    Date of Patent: May 16, 2023
    Assignee: Avegant Corp.
    Inventors: Aaron Matthew Eash, Andrew John Gross, Baker Ngan, Edward Chia Ning Tang, Joseph Roger Battelle, Warren Cornelius Welch, III
  • Patent number: 11652974
    Abstract: A stereoscopic imaging device includes at least a first and a second image recording unit configured to record a first and a second original image of an object from different perspectives, wherein the original images differ at least with regard to one item of image information, an image display unit for imaging displayed images, an image processing unit for further processing the original images, and the image processing unit is configured to supplement at least one of the two original images with at least one item of image information from the other original image to generate a displayed image. In addition, a method for generating at least one displayed image that can be imaged on an image display unit is provided.
    Type: Grant
    Filed: July 9, 2020
    Date of Patent: May 16, 2023
    Assignee: Carl Zeiss Meditec AG
    Inventors: Alois Regensburger, Susanne Kohlhammer, Jonathan Essig
  • Patent number: 11651536
    Abstract: Directional pattern generation techniques are described for digital images as implemented by a directional pattern system. In an implementation, a user input is received to specify a direction with respect to the object. A directional pattern system then fills the object using a directional pattern based on the contours of the object as well as the user-specified direction. To do so, the directional pattern system generates a directional vector field that specifies directions with respect to corresponding locations within the field defined by a mesh. Uniform field embedding is employed to transfer the directional vector field to a grid by superimposing the grid onto the mesh of the directional vector field. The directional pattern system then generates the directional pattern within the object by filling the grid with one or more pattern cells.
    Type: Grant
    Filed: September 16, 2021
    Date of Patent: May 16, 2023
    Assignee: Adobe Inc.
    Inventors: Vineet Batra, Praveen Kumar Dhanuka, Ankit Phogat
  • Patent number: 11636643
    Abstract: During tracing of a primary ray in a 3-D space (e.g., a 3-D scene in graphics rendering), a ray is found to intersect a primitive (e.g., a triangle) located in the 3-D space. Secondary ray(s) may be generated for a variety of purposes. For example, occlusion rays may be generated to test occlusion of a point of intersection between the primary ray and primitive is illuminated by any of the light(s). An origin for each secondary ray can be modified from the intersection point based on characteristics of the primitive intersected. For example, an offset from the intersection point can be calculated using barycentric coordinates of the intersection point and interpolation of one or more parameters associated with vertices defining the primitive. These parameters may include a size of the primitive and differences between a geometric normal for the primitive and a respective additional vector supplied with each vertex.
    Type: Grant
    Filed: January 20, 2021
    Date of Patent: April 25, 2023
    Assignee: Imagination Technologies Limited
    Inventor: Aaron Dwyer
  • Patent number: 11632530
    Abstract: This disclosure describes a system configured to present primary and secondary, tertiary, etc., virtual reality content to a user. Primary virtual reality content may be displayed to a user, and, responsive to the user turning his view away from the primary virtual reality content, a sensory cue is provided to the user that indicates to the user that his view is no longer directed toward the primary virtual reality content, and secondary, tertiary, etc., virtual reality content may be displayed to the user. Primary virtual reality content may resume when the user returns his view to the primary virtual reality content. Primary virtual reality content may be adjusted based on a user's interaction with the secondary, tertiary, etc., virtual reality content. Secondary, tertiary, etc., virtual reality content may be adjusted based on a user's progression through the primary virtual reality content, or interaction with the primary virtual reality content.
    Type: Grant
    Filed: October 19, 2021
    Date of Patent: April 18, 2023
    Assignee: Mindshow Inc.
    Inventor: Jonathan Michael Ross
  • Patent number: 11631158
    Abstract: Disclosed herein is a transmitting method and a receiving method of point cloud data. The transmitting method may include encoding point cloud data, encapsulating a bitstream that includes the encoded point cloud data into a file, and transmitting the file, the point cloud data include at least geometry data, attribute data, or an occupancy map data, the bitstream is stored in multiple tracks of the file, the file further includes signaling data, and the signaling data include spatial region information of the point cloud data.
    Type: Grant
    Filed: February 23, 2021
    Date of Patent: April 18, 2023
    Assignee: LG Electronics Inc.
    Inventors: Jinwon Lee, Sejin Oh
  • Patent number: 11625320
    Abstract: The present disclosure relates to a tensor-based optimization method for GPU memory management of deep learning, at least comprising steps of: executing at least one computing operation, which gets tensors as input and generates tensors as output; when one said computing operation is executed, tracking access information of the tensors, and setting up a memory management optimization decision based on the access information, during a first iteration of training, performing memory swapping operations passively between a CPU memory and a GPU memory so as to obtain the access information about the tensors regarding a complete iteration; according to the obtained access information about the tensors regarding the complete iteration, setting up a memory management optimization decision; and in a successive iteration, dynamically adjusting the set optimization decision of memory management according to operational feedbacks.
    Type: Grant
    Filed: July 1, 2020
    Date of Patent: April 11, 2023
    Assignee: HUAZHONG UNIVERSITY OF SCIENCE AND TECHNOLOGY
    Inventors: Xuanhua Shi, Xuan Peng, Hai Jin, Hulin Dai, Weiliang Ma, Qian Xiong
  • Patent number: 11620788
    Abstract: Accesses to a mipmap by a shader in a graphics pipeline are monitored. The mipmap is stored in a memory or cache associated with the shader and the mipmap represents a texture at a hierarchy of levels of detail. A footprint in the mipmap of the texture is marked based on the monitored accesses. The footprint indicates, on a per-tile, per-level-of-detail (LOD) basis, tiles of the mipmap that are expected to be accessed in subsequent shader operations. In some cases, the footprint is defined by a plurality of footprint indicators that indicate whether the tiles of the mipmap are expected to be accessed in subsequent shader operations. In that case, the plurality of footprint indicators are set to a first value to indicate that the tile was not access during the first frame or a second value to indicate that the tile was accessed during the first frame.
    Type: Grant
    Filed: December 16, 2020
    Date of Patent: April 4, 2023
    Assignee: Advanced Micro Devices, Inc.
    Inventor: Christopher J. Brennan
  • Patent number: 11615218
    Abstract: Described are computer implemented techniques to select a single surface of a computer aided design (CAD) as a surface that shares a boundary with a void space that will be discretized, produce a virtual geometry item that is positioned within or about the void region to define the volume to be discretization and propagate a mesh within the defined volume by discretizing the CAD generated geometry by a discretization factor to find a first valid seed point within the CAD generated geometry that satisfies all virtual geometries taken together.
    Type: Grant
    Filed: May 15, 2020
    Date of Patent: March 28, 2023
    Assignee: Dassault Systemes Simulia Corp.
    Inventor: Kaustubh Rao
  • Patent number: 11610351
    Abstract: Computer-implemented method for transferring style features from at least one source image to a target image, comprising the steps of generating a result image, based on the source and the target image, wherein one or more spatially-variant features of the result image correspond to one or more spatially variant features of the target image; and wherein a texture of the result image corresponds to a texture of the source image; and outputting the result image, and a corresponding device. According to the invention, the texture corresponds to a summary statistic of spatially variant features of the source image.
    Type: Grant
    Filed: January 26, 2018
    Date of Patent: March 21, 2023
    Assignee: EBERHARD KARLS UNIVERSITAET TUEBINGEN
    Inventors: Matthias Bethge, Leon Gatys
  • Patent number: 11573795
    Abstract: In various examples, a VPU and associated components may be optimized to improve VPU performance and throughput. For example, the VPU may include a min/max collector, automatic store predication functionality, a SIMD data path organization that allows for inter-lane sharing, a transposed load/store with stride parameter functionality, a load with permute and zero insertion functionality, hardware, logic, and memory layout functionality to allow for two point and two by two point lookups, and per memory bank load caching capabilities. In addition, decoupled accelerators may be used to offload VPU processing tasks to increase throughput and performance, and a hardware sequencer may be included in a DMA system to reduce programming complexity of the VPU and the DMA system. The DMA and VPU may execute a VPU configuration mode that allows the VPU and DMA to operate without a processing controller for performing dynamic region based data movement operations.
    Type: Grant
    Filed: August 2, 2021
    Date of Patent: February 7, 2023
    Assignee: NVIDIA Corporation
    Inventors: Ahmad Itani, Yen-Te Shih, Jagadeesh Sankaran, Ravi P Singh, Ching-Yu Hung
  • Patent number: 11575936
    Abstract: A three-dimensional data encoding method includes encoding information of a current node included in an N-ary tree structure of three-dimensional points included in three-dimensional data, where N is an integer greater than or equal to 2. In the encoding, first information is encoded, the first information indicating a range for one or more referable neighboring nodes among neighboring nodes spatially neighboring the current node, and the current node is encoded with reference to a neighboring node within the range.
    Type: Grant
    Filed: October 7, 2020
    Date of Patent: February 7, 2023
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Chi Wang, Pongsak Lasang, Chung Dean Han, Toshiyasu Sugio
  • Patent number: 11561552
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing data characterizing a first region in an environment to generate a prediction characterizing a second region in the environment. One of the methods includes obtaining surfel data comprising a plurality of surfels; obtaining sensor data for a plurality of locations in a first region of the environment; determining, from the surfel data, a plurality of first surfels corresponding to respective locations in the first region of the environment; determining, using the first surfels and the sensor data, a difference between i) a first representation of the first region of the environment corresponding to the first surfels and ii) a second representation of the first region of the environment corresponding to the sensor data; and generating a respective object prediction for one or more locations in a second region of the environment.
    Type: Grant
    Filed: September 15, 2020
    Date of Patent: January 24, 2023
    Assignee: Waymo LLC
    Inventors: David Harrison Silver, Carlos Hernandez Esteban, Michael Montemerlo, Peter Pawlowski, David Yonchar Margines
  • Patent number: 11554104
    Abstract: The disclosure relates to compositions containing allyl isothiocyanate and methods of use thereof for stimulating tearing in a subject to treat dry eye.
    Type: Grant
    Filed: August 20, 2018
    Date of Patent: January 17, 2023
    Assignee: The Schepens Eye Research Institute, Inc.
    Inventor: Joseph B. Ciolino
  • Patent number: 11556779
    Abstract: Techniques are described for efficiently reducing the amount of total computation in convolutional neural networks (CNNs) without affecting the output result or classification accuracy. Computation redundancy in CNNs is reduced by exploiting the computing nature of the convolution and subsequent pooling (e.g., sub-sampling) operations. In some implementations, the input features may be divided into a group of precision values and the operation(s) may be cascaded. A maximum may be identified (e.g., by 90% probability) using a small number of bits in the input features, and the full-precision convolution may then be performed on the maximum input. Accordingly, the total number of bits used to perform the convolution is reduced without affecting the output features or the final classification accuracy.
    Type: Grant
    Filed: September 21, 2017
    Date of Patent: January 17, 2023
    Assignee: Arizona Board of Regents on behalf of Arizona State University
    Inventors: Jae-sun Seo, Minkyu Kim
  • Patent number: 11557090
    Abstract: The present disclosure provides a tessellation data processing method, system, medium and vector graphics processing device. The method includes: constructing a data structure including a content table and information tables in memory; when a vector line generated by tessellation intersects an horizontal/vertical line to obtain a new intersection, reading an address and number of Xnodes or Ynodes of an information table in the content table corresponding to a row/column corresponding to the Y/X coordinate of the intersection; according to the address of the information table and the number of X/Ynodes of the information table, reading corresponding X/Ynodes from the memory; comparing information of the intersection with the X/Ynodes, and updating the X/Ynodes in the information table, or adding an X/Ynode to the information table at a position corresponding to the Y/X coordinates.
    Type: Grant
    Filed: July 19, 2021
    Date of Patent: January 17, 2023
    Assignees: VeriSilicon Microelectronics (Shanghai) Co., Ltd., VeriSilicon Holdings Co., Ltd., VeriSilicon Microelectronics (Nanjing) Co., Ltd.
    Inventors: Cheng Chi, Jiangbo Li, Mike M Cai
  • Patent number: 11555745
    Abstract: Example embodiments relate to methods and devices for generating (quasi-) periodic interference patterns. One embodiment includes a method for generating an interference pattern using multi-beam interference of electromagnetic radiation. The method includes computing a set of grid points in a complex plane representing a grid with a desired symmetry. The method also includes selecting a radius of a virtual circle. Additionally, the method includes selecting a set of grid points in the complex plane that lies on the virtual circle centered around a virtual center point. Further, the method includes associating an argument of each grid point of the selected set of grid points in the complex plane with a propagation direction of plane waves or quasi plane waves or parallel wave fronts. In addition, the method includes obtaining the interference pattern that is a superposition of the plane waves or quasi plane waves or parallel wave fronts.
    Type: Grant
    Filed: April 7, 2021
    Date of Patent: January 17, 2023
    Assignees: IMEC VZW, Katholieke Universiteit Leuven, KU Leuven R&D
    Inventors: Niels Verellen, Dmitry Kouznetsov, Pol Van Dorpe
  • Patent number: 11557022
    Abstract: A neural network-based rendering technique increases temporal stability and image fidelity of low sample count path tracing by optimizing a distribution of samples for rendering each image in a sequence. A sample predictor neural network learns spatio-temporal sampling strategies such as placing more samples in dis-occluded regions and tracking specular highlights. Temporal feedback enables a denoiser neural network to boost the effective input sample count and increases temporal stability. The initial uniform sampling step typically present in adaptive sampling algorithms is not needed. The sample predictor and denoiser operate at interactive rates to achieve significantly improved image quality and temporal stability compared with conventional adaptive sampling techniques.
    Type: Grant
    Filed: December 18, 2019
    Date of Patent: January 17, 2023
    Assignee: NVIDIA Corporation
    Inventors: Carl Jacob Munkberg, Jon Niklas Theodor Hasselgren, Anjul Patney, Marco Salvi, Aaron Eliot Lefohn, Donald Lee Brittain
  • Patent number: 11551404
    Abstract: Images of various views of objects can be captured. An object mesh structure can be created based at least in part on the object images. The object mesh structure represents the three-dimensional shape of the object and includes a mesh with mesh elements. The mesh elements are assigned views first from a subset of views to texture large contiguous portions of the object from relatively few views. Portions that are not textured from the subset views are textured using the full set of views, such that all mesh elements are assigned views. The views first assigned from the subset of views and the views then assigned from the full plurality of views can be packaged into a texture atlas. These texture atlas views can be packaged with mapping data to map the texture atlas views to their corresponding mesh elements. The texture atlas and the object mesh structure can be sent to a client device to render a representation of the object.
    Type: Grant
    Filed: June 24, 2021
    Date of Patent: January 10, 2023
    Assignee: A9.com, Inc.
    Inventors: Tomas Francisco Yago Vicente, Radek Grzeszcsuk, Arnab Sanat Kumar Dhua
  • Patent number: 11551398
    Abstract: Systems, apparatuses, and methods for implementing light volume rendering techniques are disclosed. A processor is coupled to a memory. A processor renders the geometry of a scene into a geometry buffer. For a given light source in the scene, the processor initiates two shader pipeline passes to determine which pixels in the geometry buffer to light. On the first pass, the processor renders a front-side of a light volume corresponding to the light source. Any pixels of the geometry buffer which are in front of the front-side of the light volume are marked as pixels to be discarded. Then, during the second pass, only those pixels which were not marked to be discarded are sent to the pixel shader. This approach helps to reduce the overhead involved in applying a lighting effect to the scene by reducing the amount of work performed by the pixel shader.
    Type: Grant
    Filed: August 31, 2020
    Date of Patent: January 10, 2023
    Assignees: Advanced Micro Devices, Inc., ATI Technologies ULC
    Inventors: Mika Tuomi, Miikka Petteri Kangasluoma, Jan Henrik Achrenius, Laurent Lefebvre
  • Patent number: 11544900
    Abstract: According to some embodiments, a system, method and non-transitory computer-readable medium are provided comprising a 3D building modeling module; a memory for storing program instructions; a 3D building modeling processor, coupled to the memory, and in communication with the 3D building modeling module and operative to execute program instructions to: receive a region of interest; receive an image of the region of image from a data source; generate a surface model based on the received image including one or more buildings; generate a digital height model; decompose each building into a set of shapes; apply a correction process to the set of shapes; execute a primitive classification process to each shape; execute a fitting process to each classified shape; select a best fitting model; and generate a 3D model of each building. Numerous other aspects are provided.
    Type: Grant
    Filed: July 22, 2020
    Date of Patent: January 3, 2023
    Assignee: GENERAL ELECTRIC COMPANY
    Inventors: Yen-Liang Lin, Xia Li, James Vradenburg Miller, Walter V Dixon, III
  • Patent number: 11537939
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for transforming patterns of operations on tensors in a computational graph to reduce the memory burden incurred when reshape operations are performed, in particular when deployed to hardware platforms that have vector instructions or vector memory requiring alignment of operands.
    Type: Grant
    Filed: May 3, 2019
    Date of Patent: December 27, 2022
    Assignee: Google LLC
    Inventor: Blake Alan Hechtman
  • Patent number: 11525907
    Abstract: A marine sonar display device comprises a display, a memory element, and a processing element. The display displays sonar images. The memory element stores sonar data. The processing element is configured to transmit a transmit electronic signal to a frequency steered sonar element which transmits an array of sonar beams into a body of water, each sonar beam transmitted in a different angular direction, receive a receive electronic signal from the frequency steered sonar element, the receive electronic signal including a plurality of frequency components, calculate an array of sonar data slices, one sonar data slice for each frequency component, generate an array of sonar image slices, one sonar image slice for each sonar data slice, and control the display to visually present the array of sonar image slices in near real time and a historical sequence of at least one sonar image slice.
    Type: Grant
    Filed: January 17, 2020
    Date of Patent: December 13, 2022
    Inventors: Jeffrey B. Wigh, David M. Hendrix, Matthew E. Havermann, Dallas J. Fletchall
  • Patent number: 11521342
    Abstract: A processor receives a request to access one or more levels of a partially resident texture (PRT) resource. The levels represent a texture at different levels of detail (LOD) and the request includes normalized coordinates indicating a location in the texture. The processor accesses a texture descriptor that includes dimensions of a first level of the levels and one or more offsets between a reference level and one or more second levels that are associated with one or more residency maps that indicate texels that are resident in the PRT resource. The processor translates the normalized coordinates to texel coordinates in the one or more residency maps based on the offset and accesses, in response to the request, the one or more residency maps based on the texel coordinates to determine whether texture data indicated by the normalized coordinates is resident in the PRT resource.
    Type: Grant
    Filed: April 14, 2021
    Date of Patent: December 6, 2022
    Assignee: Advanced Micro Devices, Inc.
    Inventors: Maxim V. Kazakov, Mark Fowler