Space Transformation Patents (Class 345/427)
  • Patent number: 11451758
    Abstract: In one embodiment, a computing system may access a first grayscale image and a second grayscale image. The system may generate a first color image and a second color image based on the first grayscale image and the second grayscale image, respectively. The system may generate affinity information based on the first grayscale image and the second grayscale image, the affinity information identifying relationships between pixels of the first grayscale image and pixels of the second grayscale image. The system may modify the color of the first color image and the second color image based on the affinity information. The system may generate a first visual output based on the modified first color image and a second visual output based on the modified second color image.
    Type: Grant
    Filed: February 12, 2020
    Date of Patent: September 20, 2022
    Assignee: Meta Platforms Technologies, LLC
    Inventors: Gaurav Chaurasia, Alexander Sorkine Hornung, David Novotny, Nikola Dodik
  • Patent number: 11450019
    Abstract: A computing system is configured to train an object classifier. Monocular image data and ground-truth data are received for a scene. Geometric context is determined including a three-dimensional camera position relative to a fixed plane. Regions of interest (RoI) and a set of potential occluders are identified within the image data. For each potential occluder, an occlusion zone is projected onto the fixed plane in three-dimensions. A set of occluded RoIs on the fixed plane are generated for each occlusion zone. Each occluded RoI is projected back to the image data in two-dimensions. The classifier is trained by minimizing a loss function generated by inputting information regarding the RoIs and the occluded RoIs into the classifier, and by minimizing location errors of each RoI and each occluded RoI of the set on the fixed plane based on the ground-truth data. The trained classifier is then output for object detection.
    Type: Grant
    Filed: October 22, 2020
    Date of Patent: September 20, 2022
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Ishani Chakraborty, Gang Hua
  • Patent number: 11443408
    Abstract: A method for processing an electronic image including receiving, by a viewer, the electronic image and a FOV (field of view), wherein the FOV includes at least one coordinate, at least one dimension, and a magnification factor, loading, by the viewer, a plurality of tiles within the FOV, determining, by the viewer, a state of the plurality of tiles in a cache, and in response to determining that the state of the plurality of tiles in the cache is a fully loaded state, rendering, by the viewer, the plurality of tiles to a display.
    Type: Grant
    Filed: November 24, 2021
    Date of Patent: September 13, 2022
    Assignee: PAIGE.AI, INC.
    Inventors: Alexandre Kirszenberg, Razik Yousfi, Thomas Fresneau, Peter Schueffler
  • Patent number: 11443079
    Abstract: The present disclosure provides systems and methods for generating an interior design pertaining to a floor plan and creating a three-dimensional (3D) representation of the interior design for achieving high quality interior décor for residential as well as commercial properties. An aspect of the present disclosure pertains to a system for generating and visualizing the interior design in the 3D representation that includes a two-dimensional image receive module to receive a two-dimensional input image of the floor plan, a shape determination module to determine shape of a defined space of the floor plan, an object position determination module to determine position of one or more objects in the defined space, an object placement module to place the one or more objects in the defined space, and a three-dimensional representation generation module to generate a 3D representation of the interior design pertaining to the floor plan.
    Type: Grant
    Filed: December 8, 2018
    Date of Patent: September 13, 2022
    Assignee: SNAPTRUDE INC.
    Inventor: Syed Altaf Hussain Ganihar
  • Patent number: 11438731
    Abstract: A method, apparatus and computer program product creates a viewpoint position structure for media content. The viewpoint position structure specifies a position of a viewpoint defined in a reference coordinate system and an offset of the reference coordinate system with respect to a geographical reference. The method, apparatus and computer program product cause storage of the viewpoint position structure. An indication may be created as to whether the media content is augmented reality media content. The augmented reality media content may comprise a background that is at least partially transparent. The offset may be determined, within the reference coordinate system, relative to a geomagnetic reference direction, based upon one or more of a viewpoint yaw angle, a viewpoint pitch angle, or a viewpoint roll angle.
    Type: Grant
    Filed: March 19, 2020
    Date of Patent: September 6, 2022
    Assignee: NOKIA TECHNOLOGIES OY
    Inventors: Sujeet Shyamsundar Mate, Emre Baris Aksu, Miska Matias Hannuksela, Igor Danilo Diego Curcio, Kashyap Kammachi-Sreedhar, Ville-Veikko Mattila
  • Patent number: 11421994
    Abstract: An embodiment of the invention provides a method and apparatus for partitioning an electronic fence, relating to the technical field of computers. The method in the embodiment of the invention comprises: partitioning a coordinate system of a planimetric map, and taking one vertex of each partition in the same direction as a base point; generalizing, according to a predetermined rule, a station to the base point corresponding to the partition where the station is located; mapping, according to the predetermined rule, a vehicle position to the base point corresponding to the partition where the vehicle position is located, wherein all the stations included in the base point are stations where a vehicle may appear; and acquiring electronic fence information of the stations where the vehicle may appear, and comparing vehicle position information with the electronic fence information of the stations where the vehicle may appear so as to determine whether the vehicle enters or leaves the stations.
    Type: Grant
    Filed: April 10, 2018
    Date of Patent: August 23, 2022
    Assignees: BEIJING JINGDONG SHANGKE INFORMATION TECHNOLOGY CO., LTD., BEIJING JINGDONG CENTURY TRADING CO., LTD.
    Inventor: Qingyu Chen
  • Patent number: 11416963
    Abstract: A method for processing an electronic image including receiving, by a viewer, the electronic image and a FOV (field of view), wherein the FOV includes at least one coordinate, at least one dimension, and a magnification factor, loading, by the viewer, a plurality of tiles within the FOV, determining, by the viewer, a state of the plurality of tiles in a cache, and in response to determining that the state of the plurality of tiles in the cache is a fully loaded state, rendering, by the viewer, the plurality of tiles to a display.
    Type: Grant
    Filed: August 10, 2021
    Date of Patent: August 16, 2022
    Assignee: PAIGE.AI, INC.
    Inventors: Alexandre Kirszenberg, Razik Yousfi, Thomas Fresneau, Peter Schueffler
  • Patent number: 11409404
    Abstract: Communicating information through a user platform by representing, on a user platform visual display, spatial publishing objects as entities at locations within a three-dimensional spatial publishing object space. Each spatial publishing object associated with information, and each presenting a subset of the associated information. Establishing a user presence at a location within the spatial publishing object space. The user presence, in conjunction with a user point-of-view, being navigable by the user in at least a two-dimensional sub-space of the spatial publishing object space.
    Type: Grant
    Filed: May 22, 2020
    Date of Patent: August 9, 2022
    Assignee: AQ MEDIA, INC.
    Inventor: Jan Peter Roos
  • Patent number: 11409424
    Abstract: An information processing apparatus configured to output a parameter related to a virtual viewpoint which is used for generating a virtual viewpoint image based on a plurality of images captured by a plurality of cameras, comprises: a reception unit configured to receive an input according to a user operation; a determination unit configured to determine, based on an input according to a second user operation received by the reception unit, whether to apply a predetermined restriction to determination of a parameter which is based on an input according to a first user operation received by the reception unit; and an output unit configured to output, if the determination unit determines that the predetermined restriction should be applied, the parameter determined based on the predetermined restriction and the input according to the first user operation received by the reception unit.
    Type: Grant
    Filed: February 28, 2019
    Date of Patent: August 9, 2022
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Rei Ishikawa
  • Patent number: 11410377
    Abstract: An example system for lightweight view dependent rendering is described herein. The system includes at least one memory, and at least one processor to execute instructions to track a moving object within a first view of a scene, the first view captured by a first camera of a plurality of cameras. The plurality of cameras to capture video data of the scene from a plurality of angles. The at least one processor to extract a portion of the video data to obtain a cropped video corresponding to the moving object within the first view. The at least one processor to generate a billboard representation based on the cropped video. The at least one processor to cause the billboard representation to be presented on a display in front of a two-dimensional background.
    Type: Grant
    Filed: December 15, 2020
    Date of Patent: August 9, 2022
    Assignee: INTEL CORPORATION
    Inventor: Blake Lucas
  • Patent number: 11403816
    Abstract: A three-dimensional map generation system (500) generates three-dimensional map information (11) by using measured data acquired by a measurement vehicle (200) moving in a measurement area (50). A determination unit (120) determines, from the measurement area (50), a data shortage area where measured data for generating the three-dimensional map falls short, based on first measured data (20) transmitted from the measurement vehicle (200). A generation unit (130) generates interpolated data which interpolates three-dimensional map information of a defective area with a NURBS curve so that a lateral G, which is centrifugal force in a lateral direction applied to a traveling vehicle traveling a road in the defective area at a traveling speed, is equal to or less than a predefined threshold (12).
    Type: Grant
    Filed: November 30, 2018
    Date of Patent: August 2, 2022
    Assignees: Mitsubishi Electric Corporation, Dynamic Map Platform Co., Ltd.
    Inventors: Toshiharu Suzuki, Tsutomu Nakajima, Tadashi Ozawa
  • Patent number: 11398064
    Abstract: A non-transitory computer-readable medium stores instructions readable and executable by a workstation (14) operatively connected to a display device (20) and including at least one electronic processor (16) to perform an image acquisition and reconstruction method (101). The method includes: retrieving a non-voxel-based reconstructed image comprising non-voxel image elements from a picture and archiving communication system (PACS) database (24) to the workstation; at the workstation, generating at least one voxel-based resampled image from the non-voxel-based reconstructed image; and displaying the at least one voxel-based reconstructed image on the display device.
    Type: Grant
    Filed: September 18, 2018
    Date of Patent: July 26, 2022
    Assignee: KONINKLIJKE PHILIPS N.V.
    Inventors: Bin Zhang, Chuanyong Bai, Andriy Andreyev, Zhiqiang Hu
  • Patent number: 11386228
    Abstract: A system for anonymizing motor vehicle position information includes a global positioning system (GPS) module disposed within a host vehicle, a control module disposed within the host vehicle and in electronic communication with the GPS module. The control module executes a control logic for collecting real-time host vehicle telemetry data packets from the GPS module, and a control logic for continuously wirelessly communicating the real-time host vehicle telemetry data packets.
    Type: Grant
    Filed: June 4, 2019
    Date of Patent: July 12, 2022
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventor: Donal B. McErlean
  • Patent number: 11380047
    Abstract: The present disclosure relates to methods and apparatus for graphics processing. The apparatus can determine geometry information for each of a plurality of primitives associated with a viewpoint in a scene. The apparatus can also calculate at least one of surface information and disocclusion information based on the geometry information for each of the plurality of primitives, where the surface information and the disocclusion information may be associated with a volumetric grid based on a viewing area corresponding to the viewpoint. Also, the apparatus can calculate visibility information for each of the plurality of primitives based on at least one of the surface information and the disocclusion information, where the visibility information may be associated with the volumetric grid. The apparatus can also determine whether each of the plurality of primitives is visible based on the visibility information for each of the plurality of primitives.
    Type: Grant
    Filed: June 5, 2020
    Date of Patent: July 5, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Philip Voglreiter, Dieter Schmalstieg, Markus Steinberger
  • Patent number: 11354862
    Abstract: A monitoring system includes a video assembly comprising at least one camera positioned in a predetermined area and configured to transmit a real-time video feed of a physical location in the predetermined area. The monitoring system further includes a control system configured to receive the real-time video feed from the at least one camera. The control system includes a memory device and a processor configured to generate a virtual model of a predetermined area based on instructions stored on the memory device, wherein the processor is configured to incorporate the real-time video feed into the virtual model at a virtual location in the virtual model corresponding to the physical location in the predetermined area. The control system also includes a display unit configured to display the virtual model.
    Type: Grant
    Filed: December 18, 2019
    Date of Patent: June 7, 2022
    Assignee: Universal City Studios LLC
    Inventor: Howard Bruce Mall
  • Patent number: 11354865
    Abstract: A plurality of visualization objects may be provided for representing one or more data sets in a virtual 3D space. The visualization objects may include funnels, containers, name cards, and so forth. The visualization objects can be arranged in a circular carousel that can be rotated around a position of a virtual camera or user in a VR/AR environment. Individual data points in the visualization objects can be rotated, sized, positioned, colored, or otherwise characterized based on attributes of the corresponding data points. Individual data points can also be animated as transitioning between visualization objects in a unified view. Voice commands can be interpreted as part of an interactive environment that can provide views of the visualization objects to multiple devices simultaneously.
    Type: Grant
    Filed: October 21, 2019
    Date of Patent: June 7, 2022
    Assignee: Oracle International Corporation
    Inventors: Benjamin L. Moroze, Brendon Charles Glazer, Kapaya Katongo, Kris L. Hanson, Hendrik van den Broek
  • Patent number: 11341722
    Abstract: A computer vision method for processing an omnidirectional image to extract understanding of a scene, the method comprising: receiving an omnidirectional image of a scene; mapping the omnidirectional image to a mesh on a three-dimensional polyhedron; convert the three dimensional polyhedron into a representation of a neighbourhood structure, wherein the representation of a neighbourhood structure represents vertices of said mesh and their neighbouring vertices; and processing the representation of the neighbourhood structure with a neural network processing stage to produce an output providing understanding of the scene, wherein the neural network processing stage comprising at least one module configured to perform convolution with a filter, aligned with a reference axis of the three-dimensional polyhedron.
    Type: Grant
    Filed: July 7, 2020
    Date of Patent: May 24, 2022
    Assignee: Kabushiki Kaisha Toshiba
    Inventors: Chao Zhang, Stephan Liwicki
  • Patent number: 11328476
    Abstract: Techniques are provided for determining one or more environmental layouts. For example, one or more planes can be detected in an input image of an environment. The one or more planes correspond to one or more objects in the input image. One or more three-dimensional parameters of the one or more planes can be determined. One or more polygons can be determined using the one or more planes and the one or more three-dimensional parameters of the one or more planes. A three-dimensional layout of the environment can be determined based on the one or more polygons.
    Type: Grant
    Filed: March 31, 2020
    Date of Patent: May 10, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Sinisa Stekovic, Friedrich Fraundorfer, Vincent Lepetit
  • Patent number: 11322031
    Abstract: A method includes defining a two-dimensional geographic region by two-dimensional geographic coordinates to define the bounds of the region, converting each of the two-dimensional coordinates to three dimensional coordinates by way of a lookup stored in a computer readable medium, generating a three-dimensional grid of points, each spaced in an arrangement to encompass coverage of a predetermined ground area, and applying heuristics for a shortest path planning, relative to the three-dimensional grid of points.
    Type: Grant
    Filed: December 7, 2015
    Date of Patent: May 3, 2022
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Gregory F. Boland, Yu Ma, Justin G. Manweiler, Kevin E. Siemonsen, Umut Topkara, Katherine Vogt, Justin Weisz
  • Patent number: 11321597
    Abstract: Systems and methods for using facial patterns for information access via optical barcodes are provided. In example embodiments, a computer accesses an image. The computer determines, using facial recognition, that the accessed image includes a face. The computer determines, using the face, an orientation of the image. The computer decodes, based on the determined orientation of the image, data encoded within the geometric shape. The computer may then access a resource based on the decoded data. In some aspects, a graphical output may be presented on a display device indicating the accessed resource.
    Type: Grant
    Filed: May 22, 2020
    Date of Patent: May 3, 2022
    Assignee: Snap Inc.
    Inventors: Evan Spiegel, Kirk Ouimet
  • Patent number: 11315304
    Abstract: Apparatus and method for a hierarchical beam tracer.
    Type: Grant
    Filed: August 26, 2020
    Date of Patent: April 26, 2022
    Assignee: INTEL CORPORATION
    Inventors: Scott Janus, Prasoonkumar Surti, Karthik Vaidyanathan, Alexey Supikov, Gabor Liktor, Carsten Benthin, Philip Laws, Michael Doyle
  • Patent number: 11308683
    Abstract: Ray tracing systems and computer-implemented methods perform intersection testing on a bundle of rays with respect to a box. Silhouette edges of the box are identified from the perspective of the bundle of rays. For each of the identified silhouette edges, components of a vector providing a bound to the bundle of rays are obtained and it is determined whether the vector passes inside or outside of the silhouette edge. Results of determining, for each of the identified silhouette edges, whether the vector passes inside or outside of the silhouette edge, are used to determine an intersection testing result for the bundle of rays with respect to the box.
    Type: Grant
    Filed: June 29, 2020
    Date of Patent: April 19, 2022
    Assignee: Imagination Technologies Limited
    Inventors: Gregory Clark, Steven J. Clohset, Luke T. Peterson
  • Patent number: 11308153
    Abstract: There is disclosed a system, apparatus and methods for optimizing photo selection. When a photographer takes photos as requested in a shot list, the photos are automatically assigned a quality score which correlates to how prominently the photo would be displayed in an online search. The photos and the quality scores are displayed to the photographer so that when the photographer has shot a sufficiently high quality photo then the photographer can stop shooting. Photos with the highest quality scores are optimal. The shot lists include reference photos, and if a new photo has a higher quality score than the corresponding reference photo, the new photo becomes the reference photo.
    Type: Grant
    Filed: November 9, 2021
    Date of Patent: April 19, 2022
    Assignee: Aircam Inc.
    Inventors: Evan Rifkin, Ryan Rifkin, David Hopkins, Jonathan Angelo, Marcus Buffet
  • Patent number: 11309992
    Abstract: Methods, systems, and devices for wireless communications are described. Some wireless communications systems may utilize beamforming techniques to process wireless communications transmitted in millimeter wave (mmW) frequency ranges. In such cases, a user equipment (UE) may perform lattice reduction (LR)-based preprocessing for a received resource element (RE), which allows the UE to utilize demapping techniques (e.g., minimum mean square error (MMSE)-based demapping techniques or successive interference cancellation (SIC) demapping techniques) that are less computationally-complex than conventional demapping techniques (e.g., maximum likelihood (ML)-based demapping techniques) while providing a similar performance as conventional techniques. Further, due to mmW systems' robustness to time-dispersion, the UE may apply the same LR to multiple REs across multiple symbols in the time domain and across multiple sub-carriers in the frequency domain.
    Type: Grant
    Filed: July 15, 2019
    Date of Patent: April 19, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Shay Landis, Igor Gutman, Assaf Touboul
  • Patent number: 11297303
    Abstract: A control apparatus includes a display control unit configured to display a virtual viewpoint image on a display unit, an identification unit configured to identify a selected reproduction mode from among a plurality of reproduction modes including a first reproduction mode in which a position of a virtual viewpoint corresponding to the virtual viewpoint image displayed on the display unit is determined regardless of a position of an object in an image-capturing region, and a second reproduction mode in which the position of the virtual viewpoint changes in accordance with the position of the object in the image-capturing region, and a control unit configured to change at least either one of a position and an orientation of the virtual viewpoint in response to a user operation. The change to be made in response to an identical user operation differs between the first reproduction mode and the second reproduction mode.
    Type: Grant
    Filed: January 16, 2020
    Date of Patent: April 5, 2022
    Assignee: Canon Kabushiki Kaisha
    Inventor: Yuji Kato
  • Patent number: 11275437
    Abstract: A method and a corresponding apparatus for mitigating motion sickness in a virtual reality VR/augmented reality (AR) system using a head mounted display (HMD) are disclosed. The method comprises receiving data from a sensor indicating a current orientation of the HMD in real space, and superimposing a visual indication on a display of the HMD. The visual indication provides visual information to a user of the current orientation of the HMD in real space. Furthermore, methods and corresponding apparatuses are disclosed of calculating gaze convergence distance in an eye tracking system, and of gaze based virtual reality (VR)/augmented reality (AR) menu expansion.
    Type: Grant
    Filed: October 19, 2020
    Date of Patent: March 15, 2022
    Assignee: Tobii AB
    Inventors: Andreas Klingström, Per Fogelström, Andrew Ratcliff
  • Patent number: 11274929
    Abstract: Provided is a method including: capturing, with at least one sensor of a robot, first data indicative of the position of the robot in relation to objects within the workspace and second data indicative of movement of the robot; recognizing, with a processor of the robot, a first area of the workspace based on observing at least one of: a first part of the first data and a first part of the second data; generating, with the processor of the robot, at least part of a map of the workspace based on at least one of: the first part of the first data and the first part of the second data; generating, with the processor of the robot, a first movement path covering at least part of the first recognized area; actuating, with the processor of the robot, the robot to move along the first movement path.
    Type: Grant
    Filed: December 22, 2019
    Date of Patent: March 15, 2022
    Assignee: AI Incorporated
    Inventors: Ali Ebrahimi Afrouzi, Lukas Fath, Chen Zhang
  • Patent number: 11275434
    Abstract: An information processing apparatus supplies, an image display apparatus including an image capturing unit configured to capture an image of a real space, and a display unit configured to display an image generated using the image captured by the image capturing unit, an image generated using the image captured by the image capturing unit. The information processing apparatus includes a generation unit configured to generate an image depicting a specific object at a position at which the specific object is estimated to be present after a predetermined time from a time when the image display apparatus starts to move in the captured image of the real space including the specific object, and a control unit configured to shift a position at which the image generated by the generation unit is displayed on the display unit based on a change in a position and/or an orientation of the image display apparatus.
    Type: Grant
    Filed: October 28, 2019
    Date of Patent: March 15, 2022
    Assignee: Canon Kabushiki Kaisha
    Inventor: Kazuki Takemoto
  • Patent number: 11277596
    Abstract: An image processing apparatus for generating a virtual viewpoint image based on a plurality of images obtained by capturing an object in an image-capturing region from a plurality of directions by using a plurality of image capturing apparatuses includes a viewpoint acquisition unit configured to acquire viewpoint information indicating a position of a virtual viewpoint, and a generation unit configured to generate the virtual viewpoint image corresponding to the position of the virtual viewpoint indicated by the acquired viewpoint information, the virtual viewpoint image including at least one of an image depending on a positional relationship between a boundary and the virtual viewpoint and/or an image representing the boundary, the boundary being between an inside and an outside of a predetermined region included in the image-capturing region.
    Type: Grant
    Filed: October 22, 2019
    Date of Patent: March 15, 2022
    Assignee: Canon Kabushiki Kaisha
    Inventor: Daichi Adachi
  • Patent number: 11270513
    Abstract: A system and method for attaching digital reality applications and interactions to static objects are disclosed. The system comprises a server configured to store and process input data, the server comprising a memory and a processor; and a plurality of client devices connected to the server via a network configured enable interaction with digital reality applications. The memory contains a database with structured data containing a persistent virtual world system storing virtual replicas of static objects. The virtual replicas are configured based on the static objects, comprising location and space, physics, and 3D structure. The system enables application developers to attach digital reality applications on the virtual replicas. When users employing client devices approach a digital reality application, the digital reality application detects the physical position and orientation of the client device, triggering the server to share digital reality application content with the client devices.
    Type: Grant
    Filed: June 16, 2020
    Date of Patent: March 8, 2022
    Assignee: THE CALANY Holding S. À R.L.
    Inventor: Cevat Yerli
  • Patent number: 11256204
    Abstract: An image display apparatus includes a display section that displays an image, a detection section that detects a direction of the face of a user, and a change section that changes an image to be displayed on the display section from an image for a first direction to an image for a second direction, the image for the first direction and the image for the second direction being images having an identical attribute, in a case where the direction of the face of the user, which is detected by the detection section, is changed from the first direction to the second direction.
    Type: Grant
    Filed: November 17, 2020
    Date of Patent: February 22, 2022
    Assignee: FUJIFILM Business Innovation Corp.
    Inventors: Takahiro Kimura, Keigo Okazaki, Shogo Fujita
  • Patent number: 11257199
    Abstract: In accordance with some aspects, systems, methods and media for detecting manipulations of point cloud data are provided. In some aspects, a method for presenting information indicative of whether a manipulation of point cloud data has occurred is provided, the method comprising: receiving point cloud data comprising a plurality of points, wherein each point of the plurality of points is associated with a position; determining, for each of the plurality of points, a value indicative of a density of points in a region surrounding the respective point; associating, for each of the plurality of points, the value indicative of density with the respective point; and causing a representation of at least a portion of the point cloud data to be presented based on the location information associated with each point of the plurality of points, and the value indicative of density associated with each of the plurality of points.
    Type: Grant
    Filed: October 18, 2019
    Date of Patent: February 22, 2022
    Assignee: Wisconsin Alumni Research Foundation
    Inventors: Kevin Ponto, Ross D. Tredinnick, Simon P. B. Smith
  • Patent number: 11256910
    Abstract: An object is tracked in images of the space. A unique identification is assigned to the object and the uniquely identified object may then be located within the space based on the tracking of the object, without having to again uniquely identify the object.
    Type: Grant
    Filed: July 13, 2020
    Date of Patent: February 22, 2022
    Assignee: POINTGRAB LTD.
    Inventors: Itamar Roth, Yonatan Hyatt, David Ungarish
  • Patent number: 11257236
    Abstract: A method is proposed for estimating a depth for pixels in a matrix of M images. Such method comprises, at least for one set of N images among the M images, 2<N?M, a process comprising: —determining depth maps for the images in the set of N images delivering a set of N depth maps; —for at least one current pixel for which a depth has not yet been estimated: —deciding if a candidate depth corresponding to a depth value in the set of N depth maps is consistent or not with the other depth map(s) of the set of N depth maps; —selecting the candidate depth as being the estimated depth for the current pixel if the candidate depth is decided as consistent. The process is enforced iteratively with a new N value which is lower than the previous N value used in the previous iteration of the process.
    Type: Grant
    Filed: July 17, 2019
    Date of Patent: February 22, 2022
    Assignee: INTERDIGITAL CE PATENT HOLDINGS, SAS
    Inventors: Frederic Babon, Neus Sabater, Matthieu Hog, Didier Doyen, Guillaume Boisson
  • Patent number: 11250597
    Abstract: The present principles generally relate to encoding and decoding of a point cloud representing the geometry of a point cloud representing a 3D object. According to the invention, prediction is used in the encoding process of the splitting information of the local octree-based structure and/or in the 10 encoding process of the occupancy information of the leaf cubes of the local octree-based structure. A predictor of the local octree-based structure is used for determining the context of the context-dependent entropy encoding in order to reduce the number of bits needed for the octree encoding.
    Type: Grant
    Filed: October 17, 2018
    Date of Patent: February 15, 2022
    Assignee: InterDigital VC Holdings, Inc.
    Inventors: Sebastien Lasserre, Celine Guede, Jean-Claude Chevet
  • Patent number: 11250640
    Abstract: In a measurement device, a processor is configured to display one first image in a first region of a display. The processor is configured to hide the first image in the first region and display one second image included in a plurality of second images in the first region after a first point is set on the first image. The processor is configured to set the first point on the first image and set a second point on the second image. The processor is configured to generate a three-dimensional shape of a subject on the basis of a position and a posture of a camera when each image is generated. The processor is configured to measure a size of the subject on the basis of at least the first point, the second point, and the three-dimensional shape.
    Type: Grant
    Filed: January 29, 2020
    Date of Patent: February 15, 2022
    Assignee: OLYMPUS CORPORATION
    Inventor: Yohei Sakamoto
  • Patent number: 11245889
    Abstract: A method of generating a composite image includes capturing a video image of a physical scene with a camera, identifying a green-screen region within the video image, identifying a viewpoint and a position and/or orientation of the green-screen region relative to the viewpoint, and generating a modified video image rendered from the viewpoint onto a display surface in which the green-screen region is replaced with an image of a virtual object. The image of the virtual object is generated by projection rendering of a model of the virtual object based on the position and/or orientation of the green-screen region relative to the viewpoint such that the virtual object is constrained within the green-screen region.
    Type: Grant
    Filed: November 8, 2019
    Date of Patent: February 8, 2022
    Assignee: Tanzle, Inc.
    Inventors: Nancy L. Clemens, Michael A. Vesely
  • Patent number: 11231896
    Abstract: In one example, a system for screen configuration includes storage to store instructions and a processor. The processor is to execute the instructions to identify a relative position between a first display screen and a second display screen and to automatically adjust one or more coordinates of the second display screen in response to the relative position.
    Type: Grant
    Filed: August 25, 2017
    Date of Patent: January 25, 2022
    Assignee: Intel Corporation
    Inventor: Sean J. Lawrence
  • Patent number: 11232643
    Abstract: The present embodiments relate to generating 3D objects in an artificial reality environment and collapsing 3D objects into 2D images representing the 3D objects. Users operating extra reality (XR) devices controlling the artificial reality environment can collaboratively create or modify content in the artificial reality environment, using real-world creation objects (such as a hand of the user or a pen held by the user) to create 3D objects. In response to a user triggering a collapse for a 3D object, a 2D image of the 3D object can created, from the user's perspective. The 2D image can replace the 3D object in the artificial reality environment. Presenting the 2D image can reduce the amount of data, processing resources, and power needed to provide the artificial reality environment while also reducing clutter and cognitive load on the user.
    Type: Grant
    Filed: December 22, 2020
    Date of Patent: January 25, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Jasper Stevens, Etienne Pinchon, Jonathan Ravasz, Evgenii Krivoruchko, Wai Leong Chak
  • Patent number: 11227442
    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by a messaging application, a video feed from a camera of a user device that depicts a face; receiving a request to add a 3D caption to the video feed; identifying a graphical element that is associated with context of the 3D caption; and displaying the 3D caption and the identified graphical element in the video feed at a position in 3D space of the video feed proximate to the face depicted in the video feed.
    Type: Grant
    Filed: December 19, 2019
    Date of Patent: January 18, 2022
    Assignee: Snap Inc.
    Inventors: Kyle Goodrich, Samuel Edward Hare, Maxim Maximov Lazarov, Tony Mathew, Andrew James McPhee, Daniel Moreno, Wentao Shang
  • Patent number: 11221481
    Abstract: A three-dimensional projection apparatus includes a display including a display surface having a plurality of subpixels arranged in a grid along a first direction and a second direction substantially orthogonal to the first direction, an optical element configured to define a light beam direction of an image light emitted from the subpixels for each strip-shaped region of a plurality of strip-shaped regions extending in the second direction on the display surface, an optical member configured to project the image light, the light beam direction of which is defined by the optical element, so that a virtual image of the display surface is formed, and a controller configured to acquire information related to a position of an eye of a subject and to correct, in accordance with the position of the eye, the optical element and an image to be displayed by the display surface.
    Type: Grant
    Filed: December 1, 2017
    Date of Patent: January 11, 2022
    Assignee: KYOCERA Corporation
    Inventors: Kaoru Kusafuka, Shin Miura, Yusuke Hayashi, Satoshi Kawaji
  • Patent number: 11218642
    Abstract: The disclosure provides an appearance inspection system that can reduce subject blurring when an object is imaged while changing a relative position of an imaging device with respect to the object. A first control unit causes the imaging device to perform imaging when the imaging device reaches an imaging position corresponding to the inspection target position. A second control unit changes at least one of the position and the orientation of the imaging device in a direction in which a relative movement between a field of view of the imaging device and the inspection target position according to the change in the relative position along a designated path is canceled out during a predetermined period including a time point at which the imaging device reaches the imaging position.
    Type: Grant
    Filed: February 17, 2019
    Date of Patent: January 4, 2022
    Assignee: OMRON Corporation
    Inventor: Yutaka Kato
  • Patent number: 11215461
    Abstract: Provided is a method including: capturing, with at least one sensor of a robot, first data indicative of the position of the robot in relation to objects within the workspace and second data indicative of movement of the robot; recognizing, with a processor of the robot, a first area of the workspace based on observing at least one of: a first part of the first data and a first part of the second data; generating, with the processor of the robot, at least part of a map of the workspace based on at least one of: the first part of the first data and the first part of the second data; generating, with the processor of the robot, a first movement path covering at least part of the first recognized area; actuating, with the processor of the robot, the robot to move along the first movement path.
    Type: Grant
    Filed: October 10, 2019
    Date of Patent: January 4, 2022
    Assignee: AI Incorporated
    Inventors: Ali Ebrahimi Afrouzi, Lukas Fath, Chen Zhang, Sebastian Schweigert
  • Patent number: 11217006
    Abstract: An exemplary three-dimensional (3D) simulation system accesses a two-dimensional (2D) video image captured by a video capture device and that depicts a bounded real-world scene and a real-world object present within the bounded real-world scene. The 3D simulation system accesses respective 3D models of the bounded real-world scene and the real-world object. Based on the 2D video image, the 3D simulation system tracks a spatial characteristic of the real-world object relative to the bounded real-world scene. Based on the tracked spatial characteristic of the real-world object and the 3D models of the bounded real-world scene and the real-world object, the 3D simulation system generates a 3D simulation of the bounded real-world scene within which the real-world object is simulated in accordance with the tracked spatial characteristic of the real-world object. Corresponding methods and systems are also disclosed.
    Type: Grant
    Filed: October 28, 2019
    Date of Patent: January 4, 2022
    Assignee: Verizon Patent and Licensing Inc.
    Inventors: Arthur van Hoff, Daniel Kopeinigg, Philip Lee, Solmaz Hajmohammadi, Sourabh Khire, Simion Venshtain
  • Patent number: 11217016
    Abstract: A method, device, and computer-readable storage medium for generating a proxy mesh are disclosed. The method includes: receiving a reference mesh comprising a polygonal mesh that is a computer representation of a three-dimensional object; receiving a smoothed mesh corresponding to the reference mesh; selecting a given vertex in the smoothed mesh; identifying neighbor vertices of the given vertex in the smoothed mesh; for each neighbor vertex of the given vertex, determining a nearest location on the reference mesh overlaid on the smoothed mesh; determining an average position of the nearest locations on the reference mesh for the neighbor vertices of the given vertex; setting a new location of a vertex in a smoothed output polygonal mesh corresponding to the given vertex to the average position; and outputting the smoothed output polygonal mesh as a proxy mesh for the reference mesh.
    Type: Grant
    Filed: November 24, 2020
    Date of Patent: January 4, 2022
    Assignee: Electronic Arts Inc.
    Inventor: Ashton Mason
  • Patent number: 11210864
    Abstract: The present invention relates to a method for generating virtual reality representation for a plurality of terminal devices. The method comprises: generating location-based data from two sources, a first location-based data representing a terminal device specific local pose coordinates and a second location-based data representing photogrammetric coordinates; constructing a terminal device specific coordinate conversion between coordinates; receiving virtual content; and generating terminal device specific virtual reality representation by applying the constructed terminal device specific coordinate conversion to the received virtual content. The invention also relates to a system and to a computer program product.
    Type: Grant
    Filed: May 29, 2019
    Date of Patent: December 28, 2021
    Assignee: Immersal Oy
    Inventors: Panu Liukkonen, Tatu Blomberg, Teemu Berglund, Tuomas Paavola, Mikko Karvonen
  • Patent number: 11210840
    Abstract: A transform method applied in an image processing system is disclosed, comprising: when the image capture module is rotated, respectively performing inverse rotation operations over post-rotation space coordinates of three first vertices from a integral vertex stream according to rotation angles of the image capture module to obtain their pre-rotation space coordinates; calculating pre-rotation longitudes and latitudes of the three first vertices according to their pre-rotation space coordinates; selecting one from a pre-rotation panoramic image, a south polar image and a north polar image as a texture image to determine a texture ID for the three first vertices according to their pre-rotation latitudes; and, calculating pre-rotation texture coordinates according to the texture ID and the pre-rotation longitudes and latitudes to form a first complete data structure for each of the three first vertices.
    Type: Grant
    Filed: August 27, 2020
    Date of Patent: December 28, 2021
    Assignee: Aspeed Technology Inc.
    Inventor: Chung-Yen Lu
  • Patent number: 11202037
    Abstract: A virtual presence merged reality system comprises a server comprising at least one processor and memory including a data store storing a persistent virtual world system comprising one or more virtual replicas of real world elements. The virtual replicas provide self-computing capabilities and autonomous behavior. The persistent virtual world system comprises a virtual replica of a physical location hosting a live event, wherein the persistent virtual world system is configured to communicate through a network with a plurality of connected devices that include sensing mechanisms configured to capture real-world data of the live event that enables updating the persistent virtual world system. The system enables guests to virtually visit, interact and make transactions within the live event through the persistent virtual world system. Computer-implemented methods thereof are also provided.
    Type: Grant
    Filed: June 16, 2020
    Date of Patent: December 14, 2021
    Assignee: THE CALANY Holding S. À R.L.
    Inventor: Cevat Yerli
  • Patent number: 11195324
    Abstract: Methods and systems for real-time visualization of building structures are disclosed. A computing system may calculate physical illumination characteristics for each of a plurality of predefined virtual external building-surface elements layered in simulation at specified surface locations of a virtual three-dimensional (3D) model of a building structure, wherein the virtual 3D model is constructed based on data descriptive of the building structure. Each of the plurality of predefined virtual external building-surface elements may be associated with its calculated illumination characteristics in a database. A spatially-manipulable rendered image of the building structure may displayed on an interactive display in real-time based on the virtual 3D model. On the interactive display device, one or more of the plurality of the predefined virtual external building-surface elements may be rendered in real-time at respectively specified locations on the rendered image.
    Type: Grant
    Filed: August 14, 2019
    Date of Patent: December 7, 2021
    Assignee: CertainTeed LLC
    Inventors: Brice Dubost, Sizhu You, Rachel Z. Pytel
  • Patent number: 11195325
    Abstract: A method of editing a digital three-dimensional structure associated with one or more two-dimensional texture in real time is disclosed, wherein the structure and one or more texture are processed and output same in a user interface, and user input is read in the user interface and processed into a cut shape of the three-dimensional structure. A simplified structure is generated based on the three-dimensional structure, and points of the cut shape are associated with the simplified structure to generate a curve. Points of the curve corresponding to edges of the curve on the simplified structure are determined, and geometrical characteristics and texture coordinates of the new points calculated. A new three dimensional structure is generated along the curve and layers of the structure are joined, for the cut and layered structure to be rendered in the user interface. An apparatus embodying the method is also disclosed.
    Type: Grant
    Filed: June 27, 2016
    Date of Patent: December 7, 2021
    Assignee: 3D4Medical Limited
    Inventors: Volodymyr Boichentsov, Iuliia Boichentsova