Texture Patents (Class 345/582)
-
Patent number: 11967094Abstract: To reduce the feel of incongruity in a model, provided is a detection device comprising: a texture detector that detects texture information of a target object from a first position; a position detector that detects depth information to each point in the target object from a second position different from the first position; a region detector that detects a data deficient region in which the depth information has been acquired but the texture information has not been acquired, on the basis of a detection result of the texture detector and a detection result of the position detector; and an adder that adds specific texture information to the data deficient region.Type: GrantFiled: June 17, 2021Date of Patent: April 23, 2024Assignee: NIKON CORPORATIONInventors: Satoshi Hasegawa, Yoshihiro Nakagawa, Masashi Hashimoto
-
Patent number: 11954832Abstract: A method and an apparatus for three-dimensional reconstruction. Images of the reconstruction space captured by N cameras are acquired as N current images in response to an object entering the reconstruction space. Foreground-background differences of all position points in the N current images are obtained according to the N current images and N corresponding initial background images captured by the N cameras when the reconstruction space is empty. Corresponding foreground-background differences of position points in the N current images are fused according to a corresponding relationship between all position points in the N current images and all position points in the reconstruction space, to obtain a foreground-background difference of each position point in the reconstruction space.Type: GrantFiled: March 26, 2019Date of Patent: April 9, 2024Assignee: BEIJING AINFINIT TECHNOLOGY CO., LTDInventors: Song Wang, Feng Zhang, Xinran Yu
-
Patent number: 11948320Abstract: Systems and methods for estimating depths of features in a scene or environment surrounding a user of a spatial computing system, such as a virtual reality, augmented reality or mixed reality (collectively, cross reality) system, in an end-to-end process. The estimated depths can be utilized by a spatial computing system, for example, to provide an accurate and effective 3D cross reality experience.Type: GrantFiled: March 5, 2021Date of Patent: April 2, 2024Assignee: Magic Leap, Inc.Inventor: Ayan Tuhinendu Sinha
-
Patent number: 11948244Abstract: Methods and systems for providing a dynamic product presentation are disclosed. In one example, a method comprises providing, by a processor, a three-dimensional representation of a product in a virtual environment for display on a customer device; and responsive to the processor identifying a surface in a camera feed of the customer device having a dimensionality suitable for the product, generating, by the processor, an augmented media containing an augmented reality representation of a three-dimensional model for the product on the surface.Type: GrantFiled: February 11, 2022Date of Patent: April 2, 2024Assignee: SHOPIFY INC.Inventors: Russ Maschmeyer, Adam Debreczeni, Eric Andrew Florenzano, Brennan Letkeman, Sarah Hurtgen, James Harold Hall, Jr.
-
Patent number: 11941746Abstract: Embodiments are disclosed for computing accurate smooth occluding contours. In one embodiment, a method of computing accurate smooth occluding contours includes projecting a boundary polygon associated with a first region of a three-dimensional (3D) object to a two-dimensional (2D) image plane, the boundary polygon comprising a plurality of contour vertices and edges connecting the plurality of contour vertices, triangulating the first region in the 2D image plane to generate a 2D triangulation, and generating a 3D mesh for the first region by mapping the 2D triangulation to the 3D object.Type: GrantFiled: September 3, 2021Date of Patent: March 26, 2024Assignee: Adobe Inc.Inventors: Aaron Hertzmann, Shayan Hoshyari, Chenxi Liu
-
Patent number: 11934829Abstract: In various examples, a VPU and associated components may be optimized to improve VPU performance and throughput. For example, the VPU may include a min/max collector, automatic store predication functionality, a SIMD data path organization that allows for inter-lane sharing, a transposed load/store with stride parameter functionality, a load with permute and zero insertion functionality, hardware, logic, and memory layout functionality to allow for two point and two by two point lookups, and per memory bank load caching capabilities. In addition, decoupled accelerators may be used to offload VPU processing tasks to increase throughput and performance, and a hardware sequencer may be included in a DMA system to reduce programming complexity of the VPU and the DMA system. The DMA and VPU may execute a VPU configuration mode that allows the VPU and DMA to operate without a processing controller for performing dynamic region based data movement operations.Type: GrantFiled: December 9, 2022Date of Patent: March 19, 2024Assignee: NVIDIA CorporationInventors: Ahmad Itani, Yen-Te Shih, Jagadeesh Sankaran, Ravi P Singh, Ching-Yu Hung
-
Patent number: 11936910Abstract: A three-dimensional data encoding method includes encoding information of a current node included in an N-ary tree structure of three-dimensional points included in three-dimensional data, where N is an integer greater than or equal to 2. In the encoding, first information is encoded, the first information indicating a range for one or more referable neighboring nodes among neighboring nodes spatially neighboring the current node, and the current node is encoded with reference to a neighboring node within the range.Type: GrantFiled: December 30, 2022Date of Patent: March 19, 2024Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICAInventors: Chi Wang, Pongsak Lasang, Chung Dean Han, Toshiyasu Sugio
-
Patent number: 11914447Abstract: A computing methodology in digital systems for performing computationally expensive operations while lowering the required computing resources, the power consumed to accomplish the computation, and maximizing the system throughput. Intermediate computations within the operation may be analyzed and those that have low gain values are identified and may be either removed from the computation or calculated with lower precision.Type: GrantFiled: November 20, 2020Date of Patent: February 27, 2024Assignee: MENTIUM TECHNOLOGIES INC.Inventor: Farnood Merrikh Bayat
-
Patent number: 11915337Abstract: Systems, apparatuses, and methods for implementing a downsampler in a single compute shader pass are disclosed. A central processing unit (CPU) issues a single-pass compute shader kernel to perform downsampling of a texture on a graphics processing unit (GPU). The GPU includes a plurality of compute units for executing thread groups of the kernel. Each thread group fetches a patch of the texture, and each individual thread downsamples four quads of texels to compute mip levels 1 and 2 independently of the other threads. For mip level 3, texel data is written back over one of the local data share (LDS) entries from which the texel data was loaded. This eliminates the need for a barrier between loads and stores for computing mip level 3. The remaining mip levels are computed in a similar fashion by the thread groups of the single-pass kernel.Type: GrantFiled: February 23, 2021Date of Patent: February 27, 2024Assignee: Advanced Micro Devices, Inc.Inventors: Lou Isabelle Kramer, Matthäus G. Chajdas
-
Patent number: 11900568Abstract: Provided are a writing trajectory processing method, a touch control device, a writing system and a storage medium. The writing trajectory processing method includes: obtaining writing data of an original writing trajectory, wherein the writing data comprise a plurality of first trajectory points and a plurality of first contact areas corresponding to the plurality of first trajectory points one to one; smoothing the writing data to obtain smoothed writing data; wherein the smoothed writing data comprise a plurality of second trajectory points and a plurality of second contact areas corresponding to the plurality of second trajectory points one to one; determining a plurality of trajectory line widths corresponding to the plurality of second trajectory points one to one based on the plurality of second contact areas; and, displaying the writing trajectory based on the plurality of second trajectory points and the plurality of trajectory line widths.Type: GrantFiled: September 29, 2020Date of Patent: February 13, 2024Assignee: BOE Technology Group Co., Ltd.Inventor: Ruibin Xue
-
Patent number: 11887255Abstract: A method and a system for rendering a boundary of a map area within a game map, a computer readable storage medium, and a method for rendering includes: obtaining a boundary of a map area within a game map, and expanding the boundary toward the inside of the boundary along a normal direction of the boundary to form a fuzzy boundary; obtaining each boundary vertex of the fuzzy boundary, and linearly extending a preset distance from the boundary vertex along the normal direction of the fuzzy boundary to form a boundary grid; rendering a boundary color within a first range between the fuzzy boundary and the boundary grid, and rendering a boundary transparency within a second range that expands a preset distance from the fuzzy boundary to the inside of the boundary; rendering the boundary color from the first range with convolutional incremental expansion until the second range is covered.Type: GrantFiled: November 16, 2021Date of Patent: January 30, 2024Assignee: Shanghai Lilith Network Technology Company LimitedInventor: Zhicheng Zhu
-
Patent number: 11869112Abstract: Embodiments of this application provide a watermark embedding method applicable to a three-dimensional (3D) field. By combining vertex data of an original 3D model and vertex data of a 3D watermark, and combining material data of the original 3D model and material data of the 3D watermark, the original 3D model and the 3D watermark can be synthesized into a 3D model. In addition, before and after watermark embedding, an appearance of the original 3D model can remain unchanged. This avoids impact of watermark embedding on the appearance and use value of the 3D model, and ensures a display effect of the 3D model. Further, a function of encrypting the embedded 3D watermark may be implemented, and the 3D watermark cannot be easily removed or modified. This can effectively ensure the copyright of the original 3D model, and better promote a digital asset such as the 3D model.Type: GrantFiled: December 30, 2020Date of Patent: January 9, 2024Assignee: HUAWEI TECHNOLOGIES CO., LTD.Inventors: Pei Zhang, Zhongyong Cheng, Wenjin Zou, Guangjie Li
-
Patent number: 11870947Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating images using neural networks. One of the methods includes generating the output image pixel by pixel from a sequence of pixels taken from the output image, comprising, for each pixel in the output image, generating a respective score distribution over a discrete set of possible color values for each of the plurality of color channels.Type: GrantFiled: October 3, 2022Date of Patent: January 9, 2024Assignee: DeepMind Technologies LimitedInventors: Aaron Gerard Antonius van den Oord, Nal Emmerich Kalchbrenner, Karen Simonyan
-
Patent number: 11860572Abstract: Examples are disclosed that relate to computing devices, head-mounted display devices, and methods for displaying holographic objects using slicing planes or volumes. In one example a computing device causes a display system to display a holographic object associated with a holographic volume, the holographic object occluding an occluded holographic object that is not displayed. Location data of at least a portion of a hand is received from a sensor. The location data of the hand is used to locate a slicing plane or a slicing volume within the holographic volume. Based on the location of the slicing plane or the slicing volume, at least a portion of the occluded holographic object is displayed via the display system.Type: GrantFiled: November 15, 2022Date of Patent: January 2, 2024Assignee: Microsoft Technology Licensing, LLCInventors: Addison Kenan Linville, Jarod Wayne Lenz Erwin, Dong Yoon Park
-
Patent number: 11863813Abstract: This present disclosure describes a system and methods for interactive filters in live streaming multimedia.Type: GrantFiled: February 10, 2021Date of Patent: January 2, 2024Assignee: Logitech Europe S.A.Inventors: Ross Alan Kakuschke, Andrew John Creeth, Eddy Gharbi
-
Patent number: 11852499Abstract: Embodiments of this application disclose a map rendering method performed at a terminal. The method includes: transmitting a block request to a native map module of the terminal through a three-dimensional display engine, the block request carrying a block identifier corresponding to a target field of view area; obtaining a block data address based on the block identifier through the native map module, and transmitting the block data address to the three-dimensional display engine; obtaining block data in the target field of view area based on the block data address through the three-dimensional display engine; invoking a target map interface through the native map module, to parse the block data, and generating map mesh data based on data obtained through parsing, the map mesh data including road data and building data; and performing map rendering based on the road data and the building data in the map mesh data.Type: GrantFiled: September 10, 2020Date of Patent: December 26, 2023Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITEDInventor: Yuewei Shao
-
Patent number: 11854128Abstract: A visual lens system is described that identifies, automatically and without user intervention, digital tool parameters for achieving a visual appearance of an image region in raster image data. To do so, the visual lens system processes raster image data using a tool region detection network trained to output a mask indicating whether the digital tool is useable to achieve a visual appearance of each pixel in the raster image data. The mask is then processed by a tool parameter estimation network trained to generate a probability distribution indicating an estimation of discrete parameter configurations applicable to the digital tool to achieve the visual appearance. The visual lens system generates an image tool description for the parameter configuration and incorporates the image tool description into an interactive image for the raster image data. The image tool description enables transfer of the digital tool parameter configuration to different image data.Type: GrantFiled: February 8, 2021Date of Patent: December 26, 2023Assignee: Adobe Inc.Inventors: Matthew David Fisher, Vineet Batra, Mrinalini Sardar, Ankit Phogat
-
Patent number: 11833424Abstract: The present disclosure describes an image rendering method and apparatus, and a related device. The method includes obtaining, by a terminal device, a base image corresponding to a to-be-rendered picture. The terminal device includes a memory storing instructions and a processor in communication with the memory. The method also includes obtaining, by the terminal device, a picture effect indication array corresponding to the base image, the picture effect indication array comprising a picture effect indication value corresponding to a pixel of the base image; rendering, by the terminal device, the base image matching a screen size of the terminal device to obtain a base texture map; and performing, by the terminal device, rendering on the base texture map according to the picture effect indication array. The present disclosure may effectively reduce the quantity of times of drawing in an image rendering process and improve image rendering efficiency.Type: GrantFiled: January 29, 2021Date of Patent: December 5, 2023Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITEDInventor: Zhiliang Wang
-
Patent number: 11816798Abstract: Various implementations disclosed herein include devices, systems, and methods that refine a first 3D surface representation (e.g., a 3D point cloud or a 3D mesh) using a second 3D surface representation that includes a 3D geometric primitive. In some implementations, a first 3D surface representation of a physical environment is obtained including points at 3D locations determined based on data generated by a first sensor. In some implementations, a second 3D surface representation corresponding to at least a portion of the physical environment is obtained that includes at least one 3D geometric primitive. In some implementations, a determination whether to adjust the 3D locations of at least one point of the points of the first 3D surface representation is made based on the 3D geometric primitive, and the 3D locations of the at least one point is adjusted to align with the geometric primitive based on the determination.Type: GrantFiled: March 9, 2021Date of Patent: November 14, 2023Assignee: Apple Inc.Inventors: Baptiste Angles, Yu Ping Lin, Ming Chuang
-
Patent number: 11804008Abstract: A method of rendering image frames on a computing system includes rendering an initial frame having a plurality of pixels and determining a low-resolution shading rate for at least one object in the frame or at least a portion of the frame based on at least one metric of the initial frame. The method further includes identifying a shading block having a plurality of pixels based on the low-resolution shading rate and sampling a texture data of the surface associated with the shading block wherein a texture sampling rate is at least two. The average of the texture samples is then applied to the pixels associated with the shading block. The method further includes shading the pixels in the shading block and displaying an output frame on a display device.Type: GrantFiled: June 11, 2021Date of Patent: October 31, 2023Assignee: Microsoft Technology Licensing, LLCInventor: Martin Jon Irwin Fuller
-
Patent number: 11783513Abstract: The present disclosure provides a vector graphics data processing method, system, medium, and vector graphics processing device. The method includes the following operations: building a vector primitive path intersection data structure (PIDS) based on coordinates of path intersections (PIs); when a new PI is generated, comparing information of the new PI to information of existing PIs corresponding to an X coordinate or Y coordinate of the new PI; and storing the information of the new PI at a corresponding position in the PIDS corresponding to the X coordinate or Y coordinate of the new PI based on a result of the comparing. Only effective PI data are saved, thereby reducing memory footprint and memory bandwidth, and improving vector graphics processing performance.Type: GrantFiled: July 19, 2021Date of Patent: October 10, 2023Assignees: VeriSilicon Microelectronics (Shanghai) Co., Ltd., VeriSilicon Holdings Co., Ltd., VeriSilicon Microelectronics (Nanjing) Co., Ltd.Inventors: Mike M Cai, Yi Zhang, Yijun Li, Kui Qin
-
Patent number: 11775831Abstract: Techniques are described for efficiently reducing the amount of total computation in convolutional neural networks (CNNs) without affecting the output result or classification accuracy. Computation redundancy in CNNs is reduced by exploiting the computing nature of the convolution and subsequent pooling (e.g., sub-sampling) operations. In some implementations, the input features may be divided into a group of precision values and the operation(s) may be cascaded. A maximum may be identified (e.g., by 90% probability) using a small number of bits in the input features, and the full-precision convolution may then be performed on the maximum input. Accordingly, the total number of bits used to perform the convolution is reduced without affecting the output features or the final classification accuracy.Type: GrantFiled: January 13, 2023Date of Patent: October 3, 2023Assignee: Arizona Board of Regents on behalf of Arizona State UniversityInventors: Jae-sun Seo, Minkyu Kim
-
Patent number: 11765332Abstract: A method for conducting a three dimensional (3D) video conference between multiple participants, the method may include receiving second participant metadata and first viewpoint metadata by a first unit that is associated with a first participant, wherein the second participant metadata is indicative of a pose of a second participant and an expression of the second participant, wherein the first viewpoint metadata is indicative of a virtual position from which the first participant requests to view an avatar of the second participant; generating, by the first unit, and based on the second participant metadata and the first viewpoint metadata, a second participant representation information; wherein the second participant representation information comprises a compact 3D model of the second participant and a second participant texture map; and determining, for the first participant and during the 3D video conference, a representation of virtual 3D video conference environment, wherein the determining is basedType: GrantFiled: March 2, 2021Date of Patent: September 19, 2023Assignee: TRUE MEETING INC.Inventors: Ran Oz, Yuval Gronau, Michael Rabinovich, Osnat Goren-Peyser, Tal Perl
-
Patent number: 11717755Abstract: A content generation system, the system comprising an input obtaining unit operable to obtain one or more samples of input text and/or audio relating to a first content, an input analysis unit operable to generate n-grams representing one or more elements of the obtained inputs, a representation generating unit operable to generate a visual representation of one or more of the generated n-grams, and a display generation unit operable to generate second content comprising one or more elements of the visual representation in association with the first content.Type: GrantFiled: August 23, 2021Date of Patent: August 8, 2023Assignee: Sony Interactive Entertainment Inc.Inventors: Fabio Cappello, Maria Chiara Monti, Matthew Sanders, Timothy Bradley, Oliver Hume, Jason Craig Millson
-
Patent number: 11704839Abstract: The present disclosure provides a multi-view image decoding method including: obtaining, from a bitstream, three-dimensional geometry information indicating a three-dimensional space of a multi-view image, view independent component information indicating a view independent component, which is uniformly applied to every view, and view dependent component information indicating a view dependent component, which is differently applied according to views; determining a view dependent component for a texture map of a current view from the view dependent component information; generating the texture map of the current view from a view independent component of the view independent component information and the determined view dependent component for the current view; and reconstructing a current view image according to a three-dimensional space that is constructed according to the texture map of the current view and the three-dimensional geometry information.Type: GrantFiled: December 16, 2020Date of Patent: July 18, 2023Assignee: Electronics and Telecommunications Research InstituteInventors: Soo Woong Kim, Jung Won Kang, Gun Bang, Jin Ho Lee, Ha Hyun Lee, Sung Chang Lim
-
Patent number: 11699249Abstract: A search space for performing nearest neighbor searches for encoding point cloud data may be trimmed. Ranges of a space filling curve may be used to identify search space to exclude or reuse, instead of generating nearest neighbor search results for at least some of the points of a point cloud located within some of the ranges of the space filling curve. Additionally, neighboring voxels may be searched to identify any neighboring points missed during the trimmed search based on the ranges of the space filling curve.Type: GrantFiled: August 5, 2022Date of Patent: July 11, 2023Assignee: Apple Inc.Inventors: Khaled Mammou, Alexandros Tourapis, David Flynn, Zhenzhen Gao
-
Patent number: 11665358Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media to enhance texture image delivery and processing at a client device. For example, the disclosed systems can utilize a server-side compression combination that includes, in sequential order, a first compression pass, a decompression pass, and a second compression pass. By applying this compression combination to a texture image at the server-side, the disclosed systems can leverage both GPU-friendly and network-friendly image formats. For example, at a client device, the disclosed system can instruct the client device to execute a combination of decompression-compression passes on a GPU-network-friendly image delivered over a network connection to the client device.Type: GrantFiled: April 28, 2020Date of Patent: May 30, 2023Assignee: Adobe Inc.Inventors: Viswanathan Swaminathan, Stefano Petrangeli, Gwendal Simon
-
Patent number: 11650663Abstract: A system including a rendering engine to render a field texture for a field display and a foveal texture for a steerable foveal display and a compositor including a field compositor to generate frames for the field display from the field texture and a foveal compositor to generate frames for the foveal display from the foveal texture. The system further including a composition manager designed to sequence and select what is presented including one or more of data in the field display and the foveal display.Type: GrantFiled: September 20, 2021Date of Patent: May 16, 2023Assignee: Avegant Corp.Inventors: Aaron Matthew Eash, Andrew John Gross, Baker Ngan, Edward Chia Ning Tang, Joseph Roger Battelle, Warren Cornelius Welch, III
-
Patent number: 11652974Abstract: A stereoscopic imaging device includes at least a first and a second image recording unit configured to record a first and a second original image of an object from different perspectives, wherein the original images differ at least with regard to one item of image information, an image display unit for imaging displayed images, an image processing unit for further processing the original images, and the image processing unit is configured to supplement at least one of the two original images with at least one item of image information from the other original image to generate a displayed image. In addition, a method for generating at least one displayed image that can be imaged on an image display unit is provided.Type: GrantFiled: July 9, 2020Date of Patent: May 16, 2023Assignee: Carl Zeiss Meditec AGInventors: Alois Regensburger, Susanne Kohlhammer, Jonathan Essig
-
Patent number: 11651536Abstract: Directional pattern generation techniques are described for digital images as implemented by a directional pattern system. In an implementation, a user input is received to specify a direction with respect to the object. A directional pattern system then fills the object using a directional pattern based on the contours of the object as well as the user-specified direction. To do so, the directional pattern system generates a directional vector field that specifies directions with respect to corresponding locations within the field defined by a mesh. Uniform field embedding is employed to transfer the directional vector field to a grid by superimposing the grid onto the mesh of the directional vector field. The directional pattern system then generates the directional pattern within the object by filling the grid with one or more pattern cells.Type: GrantFiled: September 16, 2021Date of Patent: May 16, 2023Assignee: Adobe Inc.Inventors: Vineet Batra, Praveen Kumar Dhanuka, Ankit Phogat
-
Patent number: 11636643Abstract: During tracing of a primary ray in a 3-D space (e.g., a 3-D scene in graphics rendering), a ray is found to intersect a primitive (e.g., a triangle) located in the 3-D space. Secondary ray(s) may be generated for a variety of purposes. For example, occlusion rays may be generated to test occlusion of a point of intersection between the primary ray and primitive is illuminated by any of the light(s). An origin for each secondary ray can be modified from the intersection point based on characteristics of the primitive intersected. For example, an offset from the intersection point can be calculated using barycentric coordinates of the intersection point and interpolation of one or more parameters associated with vertices defining the primitive. These parameters may include a size of the primitive and differences between a geometric normal for the primitive and a respective additional vector supplied with each vertex.Type: GrantFiled: January 20, 2021Date of Patent: April 25, 2023Assignee: Imagination Technologies LimitedInventor: Aaron Dwyer
-
Patent number: 11632530Abstract: This disclosure describes a system configured to present primary and secondary, tertiary, etc., virtual reality content to a user. Primary virtual reality content may be displayed to a user, and, responsive to the user turning his view away from the primary virtual reality content, a sensory cue is provided to the user that indicates to the user that his view is no longer directed toward the primary virtual reality content, and secondary, tertiary, etc., virtual reality content may be displayed to the user. Primary virtual reality content may resume when the user returns his view to the primary virtual reality content. Primary virtual reality content may be adjusted based on a user's interaction with the secondary, tertiary, etc., virtual reality content. Secondary, tertiary, etc., virtual reality content may be adjusted based on a user's progression through the primary virtual reality content, or interaction with the primary virtual reality content.Type: GrantFiled: October 19, 2021Date of Patent: April 18, 2023Assignee: Mindshow Inc.Inventor: Jonathan Michael Ross
-
Patent number: 11631158Abstract: Disclosed herein is a transmitting method and a receiving method of point cloud data. The transmitting method may include encoding point cloud data, encapsulating a bitstream that includes the encoded point cloud data into a file, and transmitting the file, the point cloud data include at least geometry data, attribute data, or an occupancy map data, the bitstream is stored in multiple tracks of the file, the file further includes signaling data, and the signaling data include spatial region information of the point cloud data.Type: GrantFiled: February 23, 2021Date of Patent: April 18, 2023Assignee: LG Electronics Inc.Inventors: Jinwon Lee, Sejin Oh
-
Patent number: 11625320Abstract: The present disclosure relates to a tensor-based optimization method for GPU memory management of deep learning, at least comprising steps of: executing at least one computing operation, which gets tensors as input and generates tensors as output; when one said computing operation is executed, tracking access information of the tensors, and setting up a memory management optimization decision based on the access information, during a first iteration of training, performing memory swapping operations passively between a CPU memory and a GPU memory so as to obtain the access information about the tensors regarding a complete iteration; according to the obtained access information about the tensors regarding the complete iteration, setting up a memory management optimization decision; and in a successive iteration, dynamically adjusting the set optimization decision of memory management according to operational feedbacks.Type: GrantFiled: July 1, 2020Date of Patent: April 11, 2023Assignee: HUAZHONG UNIVERSITY OF SCIENCE AND TECHNOLOGYInventors: Xuanhua Shi, Xuan Peng, Hai Jin, Hulin Dai, Weiliang Ma, Qian Xiong
-
Patent number: 11620788Abstract: Accesses to a mipmap by a shader in a graphics pipeline are monitored. The mipmap is stored in a memory or cache associated with the shader and the mipmap represents a texture at a hierarchy of levels of detail. A footprint in the mipmap of the texture is marked based on the monitored accesses. The footprint indicates, on a per-tile, per-level-of-detail (LOD) basis, tiles of the mipmap that are expected to be accessed in subsequent shader operations. In some cases, the footprint is defined by a plurality of footprint indicators that indicate whether the tiles of the mipmap are expected to be accessed in subsequent shader operations. In that case, the plurality of footprint indicators are set to a first value to indicate that the tile was not access during the first frame or a second value to indicate that the tile was accessed during the first frame.Type: GrantFiled: December 16, 2020Date of Patent: April 4, 2023Assignee: Advanced Micro Devices, Inc.Inventor: Christopher J. Brennan
-
Patent number: 11615218Abstract: Described are computer implemented techniques to select a single surface of a computer aided design (CAD) as a surface that shares a boundary with a void space that will be discretized, produce a virtual geometry item that is positioned within or about the void region to define the volume to be discretization and propagate a mesh within the defined volume by discretizing the CAD generated geometry by a discretization factor to find a first valid seed point within the CAD generated geometry that satisfies all virtual geometries taken together.Type: GrantFiled: May 15, 2020Date of Patent: March 28, 2023Assignee: Dassault Systemes Simulia Corp.Inventor: Kaustubh Rao
-
Patent number: 11610351Abstract: Computer-implemented method for transferring style features from at least one source image to a target image, comprising the steps of generating a result image, based on the source and the target image, wherein one or more spatially-variant features of the result image correspond to one or more spatially variant features of the target image; and wherein a texture of the result image corresponds to a texture of the source image; and outputting the result image, and a corresponding device. According to the invention, the texture corresponds to a summary statistic of spatially variant features of the source image.Type: GrantFiled: January 26, 2018Date of Patent: March 21, 2023Assignee: EBERHARD KARLS UNIVERSITAET TUEBINGENInventors: Matthias Bethge, Leon Gatys
-
Patent number: 11573795Abstract: In various examples, a VPU and associated components may be optimized to improve VPU performance and throughput. For example, the VPU may include a min/max collector, automatic store predication functionality, a SIMD data path organization that allows for inter-lane sharing, a transposed load/store with stride parameter functionality, a load with permute and zero insertion functionality, hardware, logic, and memory layout functionality to allow for two point and two by two point lookups, and per memory bank load caching capabilities. In addition, decoupled accelerators may be used to offload VPU processing tasks to increase throughput and performance, and a hardware sequencer may be included in a DMA system to reduce programming complexity of the VPU and the DMA system. The DMA and VPU may execute a VPU configuration mode that allows the VPU and DMA to operate without a processing controller for performing dynamic region based data movement operations.Type: GrantFiled: August 2, 2021Date of Patent: February 7, 2023Assignee: NVIDIA CorporationInventors: Ahmad Itani, Yen-Te Shih, Jagadeesh Sankaran, Ravi P Singh, Ching-Yu Hung
-
Patent number: 11575936Abstract: A three-dimensional data encoding method includes encoding information of a current node included in an N-ary tree structure of three-dimensional points included in three-dimensional data, where N is an integer greater than or equal to 2. In the encoding, first information is encoded, the first information indicating a range for one or more referable neighboring nodes among neighboring nodes spatially neighboring the current node, and the current node is encoded with reference to a neighboring node within the range.Type: GrantFiled: October 7, 2020Date of Patent: February 7, 2023Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICAInventors: Chi Wang, Pongsak Lasang, Chung Dean Han, Toshiyasu Sugio
-
Patent number: 11561552Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing data characterizing a first region in an environment to generate a prediction characterizing a second region in the environment. One of the methods includes obtaining surfel data comprising a plurality of surfels; obtaining sensor data for a plurality of locations in a first region of the environment; determining, from the surfel data, a plurality of first surfels corresponding to respective locations in the first region of the environment; determining, using the first surfels and the sensor data, a difference between i) a first representation of the first region of the environment corresponding to the first surfels and ii) a second representation of the first region of the environment corresponding to the sensor data; and generating a respective object prediction for one or more locations in a second region of the environment.Type: GrantFiled: September 15, 2020Date of Patent: January 24, 2023Assignee: Waymo LLCInventors: David Harrison Silver, Carlos Hernandez Esteban, Michael Montemerlo, Peter Pawlowski, David Yonchar Margines
-
Patent number: 11554104Abstract: The disclosure relates to compositions containing allyl isothiocyanate and methods of use thereof for stimulating tearing in a subject to treat dry eye.Type: GrantFiled: August 20, 2018Date of Patent: January 17, 2023Assignee: The Schepens Eye Research Institute, Inc.Inventor: Joseph B. Ciolino
-
Patent number: 11556779Abstract: Techniques are described for efficiently reducing the amount of total computation in convolutional neural networks (CNNs) without affecting the output result or classification accuracy. Computation redundancy in CNNs is reduced by exploiting the computing nature of the convolution and subsequent pooling (e.g., sub-sampling) operations. In some implementations, the input features may be divided into a group of precision values and the operation(s) may be cascaded. A maximum may be identified (e.g., by 90% probability) using a small number of bits in the input features, and the full-precision convolution may then be performed on the maximum input. Accordingly, the total number of bits used to perform the convolution is reduced without affecting the output features or the final classification accuracy.Type: GrantFiled: September 21, 2017Date of Patent: January 17, 2023Assignee: Arizona Board of Regents on behalf of Arizona State UniversityInventors: Jae-sun Seo, Minkyu Kim
-
Patent number: 11557090Abstract: The present disclosure provides a tessellation data processing method, system, medium and vector graphics processing device. The method includes: constructing a data structure including a content table and information tables in memory; when a vector line generated by tessellation intersects an horizontal/vertical line to obtain a new intersection, reading an address and number of Xnodes or Ynodes of an information table in the content table corresponding to a row/column corresponding to the Y/X coordinate of the intersection; according to the address of the information table and the number of X/Ynodes of the information table, reading corresponding X/Ynodes from the memory; comparing information of the intersection with the X/Ynodes, and updating the X/Ynodes in the information table, or adding an X/Ynode to the information table at a position corresponding to the Y/X coordinates.Type: GrantFiled: July 19, 2021Date of Patent: January 17, 2023Assignees: VeriSilicon Microelectronics (Shanghai) Co., Ltd., VeriSilicon Holdings Co., Ltd., VeriSilicon Microelectronics (Nanjing) Co., Ltd.Inventors: Cheng Chi, Jiangbo Li, Mike M Cai
-
Patent number: 11555745Abstract: Example embodiments relate to methods and devices for generating (quasi-) periodic interference patterns. One embodiment includes a method for generating an interference pattern using multi-beam interference of electromagnetic radiation. The method includes computing a set of grid points in a complex plane representing a grid with a desired symmetry. The method also includes selecting a radius of a virtual circle. Additionally, the method includes selecting a set of grid points in the complex plane that lies on the virtual circle centered around a virtual center point. Further, the method includes associating an argument of each grid point of the selected set of grid points in the complex plane with a propagation direction of plane waves or quasi plane waves or parallel wave fronts. In addition, the method includes obtaining the interference pattern that is a superposition of the plane waves or quasi plane waves or parallel wave fronts.Type: GrantFiled: April 7, 2021Date of Patent: January 17, 2023Assignees: IMEC VZW, Katholieke Universiteit Leuven, KU Leuven R&DInventors: Niels Verellen, Dmitry Kouznetsov, Pol Van Dorpe
-
Patent number: 11557022Abstract: A neural network-based rendering technique increases temporal stability and image fidelity of low sample count path tracing by optimizing a distribution of samples for rendering each image in a sequence. A sample predictor neural network learns spatio-temporal sampling strategies such as placing more samples in dis-occluded regions and tracking specular highlights. Temporal feedback enables a denoiser neural network to boost the effective input sample count and increases temporal stability. The initial uniform sampling step typically present in adaptive sampling algorithms is not needed. The sample predictor and denoiser operate at interactive rates to achieve significantly improved image quality and temporal stability compared with conventional adaptive sampling techniques.Type: GrantFiled: December 18, 2019Date of Patent: January 17, 2023Assignee: NVIDIA CorporationInventors: Carl Jacob Munkberg, Jon Niklas Theodor Hasselgren, Anjul Patney, Marco Salvi, Aaron Eliot Lefohn, Donald Lee Brittain
-
Patent number: 11551404Abstract: Images of various views of objects can be captured. An object mesh structure can be created based at least in part on the object images. The object mesh structure represents the three-dimensional shape of the object and includes a mesh with mesh elements. The mesh elements are assigned views first from a subset of views to texture large contiguous portions of the object from relatively few views. Portions that are not textured from the subset views are textured using the full set of views, such that all mesh elements are assigned views. The views first assigned from the subset of views and the views then assigned from the full plurality of views can be packaged into a texture atlas. These texture atlas views can be packaged with mapping data to map the texture atlas views to their corresponding mesh elements. The texture atlas and the object mesh structure can be sent to a client device to render a representation of the object.Type: GrantFiled: June 24, 2021Date of Patent: January 10, 2023Assignee: A9.com, Inc.Inventors: Tomas Francisco Yago Vicente, Radek Grzeszcsuk, Arnab Sanat Kumar Dhua
-
Patent number: 11551398Abstract: Systems, apparatuses, and methods for implementing light volume rendering techniques are disclosed. A processor is coupled to a memory. A processor renders the geometry of a scene into a geometry buffer. For a given light source in the scene, the processor initiates two shader pipeline passes to determine which pixels in the geometry buffer to light. On the first pass, the processor renders a front-side of a light volume corresponding to the light source. Any pixels of the geometry buffer which are in front of the front-side of the light volume are marked as pixels to be discarded. Then, during the second pass, only those pixels which were not marked to be discarded are sent to the pixel shader. This approach helps to reduce the overhead involved in applying a lighting effect to the scene by reducing the amount of work performed by the pixel shader.Type: GrantFiled: August 31, 2020Date of Patent: January 10, 2023Assignees: Advanced Micro Devices, Inc., ATI Technologies ULCInventors: Mika Tuomi, Miikka Petteri Kangasluoma, Jan Henrik Achrenius, Laurent Lefebvre
-
Patent number: 11544900Abstract: According to some embodiments, a system, method and non-transitory computer-readable medium are provided comprising a 3D building modeling module; a memory for storing program instructions; a 3D building modeling processor, coupled to the memory, and in communication with the 3D building modeling module and operative to execute program instructions to: receive a region of interest; receive an image of the region of image from a data source; generate a surface model based on the received image including one or more buildings; generate a digital height model; decompose each building into a set of shapes; apply a correction process to the set of shapes; execute a primitive classification process to each shape; execute a fitting process to each classified shape; select a best fitting model; and generate a 3D model of each building. Numerous other aspects are provided.Type: GrantFiled: July 22, 2020Date of Patent: January 3, 2023Assignee: GENERAL ELECTRIC COMPANYInventors: Yen-Liang Lin, Xia Li, James Vradenburg Miller, Walter V Dixon, III
-
Patent number: 11537939Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for transforming patterns of operations on tensors in a computational graph to reduce the memory burden incurred when reshape operations are performed, in particular when deployed to hardware platforms that have vector instructions or vector memory requiring alignment of operands.Type: GrantFiled: May 3, 2019Date of Patent: December 27, 2022Assignee: Google LLCInventor: Blake Alan Hechtman
-
Patent number: 11525907Abstract: A marine sonar display device comprises a display, a memory element, and a processing element. The display displays sonar images. The memory element stores sonar data. The processing element is configured to transmit a transmit electronic signal to a frequency steered sonar element which transmits an array of sonar beams into a body of water, each sonar beam transmitted in a different angular direction, receive a receive electronic signal from the frequency steered sonar element, the receive electronic signal including a plurality of frequency components, calculate an array of sonar data slices, one sonar data slice for each frequency component, generate an array of sonar image slices, one sonar image slice for each sonar data slice, and control the display to visually present the array of sonar image slices in near real time and a historical sequence of at least one sonar image slice.Type: GrantFiled: January 17, 2020Date of Patent: December 13, 2022Inventors: Jeffrey B. Wigh, David M. Hendrix, Matthew E. Havermann, Dallas J. Fletchall