Patents Examined by Sarah Lhymn
  • Patent number: 11508083
    Abstract: An image processing apparatus comprises a calculation unit configured to obtain, for a pixel of interest in a boundary portion of a specific region in a captured image bounding a non-specific region, a direction vector to the non-specific region, a selection unit configured to select one of pixels in the boundary portion that are adjacent to the pixel of interest, as a selected pixel based on the direction vector of the pixel of interest, and a generation unit configured to generate information indicating a direction from the pixel of interest to the selected pixel as information indicating a contour corresponding to the specific region.
    Type: Grant
    Filed: July 24, 2020
    Date of Patent: November 22, 2022
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Masashi Nakagawa
  • Patent number: 11500526
    Abstract: Implementations of various computer methods to couple a computerized ball device which acts as a mobile computing device to record the users environment and project light towards waveguide eyeglasses or contacts which then allows a user to view imbedded light structure holograms in the waveguide while viewing the actual world. The computer ball device additionally has the ability to be docked in a drone cradle which creates a database map of the user's environment while not being utilized by the user for an immediate task. The device may also attach to a wrist band for mobility. The device also has the ability to couple the projected light structures so that a plurality of users may view the same light structure content to build an environment of trust. The device decouples the traditional design of head mounted virtual and mixed reality that place together the camera with the head mounted device.
    Type: Grant
    Filed: October 28, 2019
    Date of Patent: November 15, 2022
    Assignee: CIRCLESX LLC
    Inventors: Erik Mowery Simpson, Kenneth Simpson
  • Patent number: 11494872
    Abstract: A computer system and related computer-implemented methods are disclosed. The system is programmed to simplify one or more digital maps for a geographical region by reducing their sizes while maintaining their physical appearances to the human eyes.
    Type: Grant
    Filed: June 21, 2021
    Date of Patent: November 8, 2022
    Assignee: Risk Management Solutions, Inc.
    Inventors: Julien Brown, Valli Gadiyaram Venkata, Shruthi Bhat
  • Patent number: 11481871
    Abstract: Updating an image during real-time rendering of images by a display device can include determining a depth for each pixel of a color frame received from a source device and corresponding to the image. Each pixel's depth is determined by image-guided propagation of depths of sparse points extracted from a depth map generated at the source device. With respect to pixels corresponding to an extracted sparse depth point, image-guided depth propagation can include retaining the depth of the corresponding sparse depth point unchanged from the source depth map. With respect to each pixel corresponding to a non-sparse depth point, image-guided depth propagation can include propagating to the corresponding non-sparse depth point a depth of a sparse depth point lying within a neighborhood of the non-sparse depth point. Pixel coordinates of the color frame can be transformed for generating a space-warped rendering of the image.
    Type: Grant
    Filed: August 13, 2021
    Date of Patent: October 25, 2022
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Yingen Xiong, Christopher A. Peri
  • Patent number: 11480796
    Abstract: The invention discloses a three-dimensional display module using optical wave-guide for providing directional backlights. This display module includes a wave-guide backlight unit with time-sequential directional light sources, a display device, a wavefront modulation device or a light splitting device, and other components. The wave-guide backlight unit with time-sequential directional light sources includes a sequential-switching light-source array, a relay device, and an optical wave-guide device. Each light source of the sequential-switching light-source array provides backlight of corresponding vector characteristics to the display device, making optical message displayed by the display device being guided to the corresponding viewing zone/viewing zones. Through the technology routes of multiple-view-for-one-pupil or/and Maxwellian view, the three-dimensional display module implements displays free from the vergence-accommodation conflict.
    Type: Grant
    Filed: January 15, 2021
    Date of Patent: October 25, 2022
    Assignee: SUN YAT-SEN UNIVERSITY
    Inventors: Lilin Liu, Dongdong Teng
  • Patent number: 11455776
    Abstract: A network for neural pose transfer includes a pose feature extractor, and a style transfer decoder, wherein the pose feature extractor comprises a plurality of sequential extracting stacks, each extracting stack consists of a first convolution layer and an Instance Norm layer sequential to the first convolution layer. The style transfer decoder comprises a plurality of sequential decoding stacks, a second convolution layer sequential to the plurality of decoding stacks and a tan h layer sequential to the second convolution layer. Each decoding stack consists of a third convolution layer and a SPAdaIn residual block. A source pose mesh is input to the pose feature extractor, and an identity mesh is concatenated with the output of the pose feature extractor and meanwhile fed to each SPAdaIn residual block of the style transfer decoder. A system thereof is also provided.
    Type: Grant
    Filed: September 10, 2020
    Date of Patent: September 27, 2022
    Assignee: FUDAN UNIVERSITY
    Inventors: Yanwei Fu, Xiangyang Xue, Yinda Zhang, Chao Wen, Haitao Lin, Jiashun Wang, Tianyun Zou
  • Patent number: 11450014
    Abstract: A system for continuous image alignment of separate cameras identifies a reference camera transformation matrix between a base reference camera pose and an updated reference camera pose. The system also identifies a match camera transformation matrix between a base match camera pose and an updated match camera pose and an alignment matrix based on visual correspondences between one or more reference frames captured by the reference camera and one or more match frames captured by the match camera. The system also generates a motion model configured to facilitate mapping of a set of pixels of a reference frame captured by the reference camera to a corresponding set of pixels of a match frame captured by the match camera based on the reference camera transformation matrix, the match camera transformation matrix, and the alignment matrix.
    Type: Grant
    Filed: July 22, 2020
    Date of Patent: September 20, 2022
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Michael Bleyer, Christopher Douglas Edmonds, Michael Edward Samples, Sudipta Narayan Sinha, Matthew Beaudoin Karr, Raymond Kirk Price
  • Patent number: 11443484
    Abstract: Techniques performed by a data processing system for reconstructing a three-dimensional (3D) model of the face of a human subject herein include obtaining source data comprising a two-dimensional (2D) image, three-dimensional (3D) image, or depth information representing a face of a human subject. Reconstructing the 3D model of the face also includes generating a 3D model of the face of the human subject based on the source data by analyzing the source data to produce a coarse 3D model of the face of the human subject, and refining the coarse 3D model through free form deformation to produce a fitted 3D model. The coarse 3D model may be a 3D Morphable Model (3DMM), and the coarse 3D model may be refined through free-form deformation in which the deformation of the mesh is limited by applying an as-rigid-as-possible (ARAP) deformation constraint.
    Type: Grant
    Filed: July 15, 2020
    Date of Patent: September 13, 2022
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Noranart Vesdapunt, Wenbin Zhu, Hsiang-Tao Wu, Zeyu Chen, Baoyuan Wang
  • Patent number: 11443455
    Abstract: A scale and pose estimation method for a camera system is disclosed. Camera data for a scene acquired by the camera system is received. A rotation prior parameter characterizing a gravity direction is received. A scale prior parameter characterizing scale of the camera system is received. A cost of a cost function is calculated for a similarity transformation that is configured to encode a scale and pose of the camera system. The cost of the cost function is influenced by the rotation prior parameter and the scale prior parameter. A solved similarity transformation is determined upon calculating a cost for the cost function that is less than a threshold cost. An estimated scale and pose of the camera system is output based on the solved similarity transformation.
    Type: Grant
    Filed: January 15, 2020
    Date of Patent: September 13, 2022
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Victor M. Fragoso Rojas, Mei Chen, Gabriel Takacs
  • Patent number: 11436828
    Abstract: Techniques include receiving image data representing an environment. Based at least in part on the image data, an identity of at least one object disposed within the environment is determined. Based at least in part on the image data, an image is displayed on an electronic device. The image includes a three-dimensional representation of at least a portion of the environment, a three-dimensional representation of the at least one object, and a three-dimensional representation of an assistant providing a request related to the at least one object. A first input is received from a user of the electronic device and based at least in part on the request. An object list is generated based at least in part on the first input and the identity of the at least one object, the list including the at least one object.
    Type: Grant
    Filed: June 2, 2020
    Date of Patent: September 6, 2022
    Assignee: State Farm Mutual Automobile Insurance Company
    Inventors: Rebecca A. Little, Christopher Robert Galante
  • Patent number: 11417044
    Abstract: A computer graphics display system and method which places moving and color changing geometric shapes, which represent tasks of a project, on a circular graph by means of a display such as a computer monitor, (similar to a radar screen) which alerts the user to impending delays to a project by means of visualization of the movement and color change of the geometric shapes or “blips” on the circular graph. The method comprises extracting information from planning calculations, then translating this information into an animated visual radial graphic display.
    Type: Grant
    Filed: May 17, 2019
    Date of Patent: August 16, 2022
    Inventor: Thomas Charley Long
  • Patent number: 11404021
    Abstract: Various embodiments of the present disclosure relate to an electronic device and a method of processing a notification in an electronic device. The electronic device may include a display that displays at least one object on a screen, and a controller that determines a notification display area for displaying a notification on the screen based on a gesture of a user associated with at least one object displayed on the screen, and to display the notification in at least one determined notification display area.
    Type: Grant
    Filed: April 16, 2020
    Date of Patent: August 2, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Ho-Young Lee, Gyu-Chual Kim
  • Patent number: 11403788
    Abstract: Provided are an image processing method and apparatus, an electronic device, and a storage medium. The method includes: identifying a first object to be rendered in a target image and a second object to which the first object belongs in the target image; generating a reference image including a mark based on the target image and the second object, the mark being used for recording a coverage area of the second object; determining an area to be rendered based on the reference image and the first object, the area to be rendered being located within the coverage area corresponding to the mark; and rendering the area by utilizing a target material to generate a rendering result. Through the process, the rendering range can be constrained when the first object is rendered based on the reference image including the mark generated by the second object to which the first object belongs, so that the reliability and authenticity of a rendering result are improved.
    Type: Grant
    Filed: December 10, 2020
    Date of Patent: August 2, 2022
    Assignee: BEIJING SENSETIME TECHNOLOGY DEVELOPMENT CO., LTD.
    Inventor: Liu Su
  • Patent number: 11402655
    Abstract: An example of an image display system includes a goggles apparatus and is capable of setting an angle of view of a virtual camera disposed in a virtual space to a first angle of view or a second angle of view smaller than the first angle of view. If the angle of view of the virtual camera is set to the first angle of view, the image display system sets a parallax between an image for a left eye and an image for a right eye to a first parallax. If the angle of view of the virtual camera is set to the second angle of view, the image display system sets the parallax between the image for a left eye and the image for a right eye to a second parallax smaller than the first parallax.
    Type: Grant
    Filed: March 4, 2020
    Date of Patent: August 2, 2022
    Assignee: NINTENDO CO., LTD.
    Inventors: Kenji Iwata, Ryuhei Matsuura
  • Patent number: 11391949
    Abstract: Provided is a display method for displaying an image based on a color original image. The display method includes guiding an image light corresponding to the color original image to a display position by an optical system, and deflecting a traveling direction of the image light to an observer and performing display by a diffraction optical element. At the time of displaying the color original image, the image light entering the first diffraction optical element includes a light entering at a first angle and a light entering at a second angle that is larger than the first angle, a chromaticity range of the image of the color original image at a position corresponding to the light entering at the first angle is limited to be close to a chromaticity range of the light entering at the second angle.
    Type: Grant
    Filed: April 21, 2020
    Date of Patent: July 19, 2022
    Assignee: SEIKO EPSON CORPORATION
    Inventor: Toshiyuki Noguchi
  • Patent number: 11386572
    Abstract: A calibration platform may obtain measurements for aligning a real-world coordinate system and a display coordinate system. For example, the calibration platform may display, via an optical see-through head-mounted display (OST-HMD), a three-dimensional virtual object and receive, from a positional tracking device, information that relates to a current pose of a three-dimensional real-world object to be aligned with the three-dimensional virtual object. The calibration platform may record a three-dimensional position of a plurality of points on the three-dimensional real-world object based on the current pose of the three-dimensional real-world object, based on an indication that the plurality of points on the three-dimensional real-world object respectively corresponds with a plurality of points on the three-dimensional virtual object.
    Type: Grant
    Filed: January 31, 2019
    Date of Patent: July 12, 2022
    Assignee: The Johns Hopkins University
    Inventors: Ehsan Azimi, Long Qian, Peter Kazanzides, Nassir Navab
  • Patent number: 11380051
    Abstract: Systems and methods for image based location estimation are described. In one example embodiment, a first positioning system is used to generate a first position estimate. Point cloud data describing an environment is then accessed. A two-dimensional surface of an image of an environment is captured, and a portion of the image is matched to a portion of key points in the point cloud data. An augmented reality object is then aligned within one or more images of the environment based on the match of the point cloud with the image. In some embodiments, building façade data may additionally be used to determine a device location and place the augmented reality object within an image.
    Type: Grant
    Filed: February 10, 2021
    Date of Patent: July 5, 2022
    Assignee: Snap Inc.
    Inventors: Nathan Jurgenson, Linjie Luo, Jonathan M Rodriguez, II, Rahul Sheth, Jia Li, Xutao Lv
  • Patent number: 11373348
    Abstract: Provided is a display apparatus that is capable of displaying a relationship between sand properties measured as time series. The display apparatus displays (i) a relationship between pieces of measured first sand property data and pieces of measured second sand property data, obtained in a first predetermined period, together with first and second reference ranges set for the first and second sand properties and (ii) a relationship between pieces of measured third sand property data and pieces of measured fourth sand property data, obtained in a second predetermined period, together with third and fourth reference ranges set for the third and fourth sand properties.
    Type: Grant
    Filed: March 13, 2020
    Date of Patent: June 28, 2022
    Assignee: SINTOKOGIO, LTD.
    Inventors: Kazuhiro Ota, Yuichi Ogura, Takeshi Sonohara
  • Patent number: 11367246
    Abstract: A volumetric data structure models a particular volume representing the particular volume at a plurality of levels of detail. A first entry in the volumetric data structure includes a first set of bits representing voxels at a first level of detail, the first level of detail includes the lowest level of detail in the volumetric data structure, values of the first set of bits indicate whether a corresponding one of the voxels is at least partially occupied by respective geometry, where the volumetric data structure further includes a number of second entries representing voxels at a second level of detail higher than the first level of detail, the voxels at the second level of detail represent subvolumes of volumes represented by voxels at the first level of detail, and the number of second entries corresponds to a number of bits in the first set of bits with values indicating that a corresponding voxel volume is occupied.
    Type: Grant
    Filed: August 19, 2017
    Date of Patent: June 21, 2022
    Assignee: MOVIDIUS LTD.
    Inventors: David Macdara Moloney, Jonathan David Byrne
  • Patent number: 11361518
    Abstract: The construction of virtual reality environments can be made more efficient with enhancements directed to the sizing of objects to be utilized in the construction of virtual reality environments, enhancements directed to the simultaneous display of multiple thumbnails, or other like indicators, of virtual reality environments being constructed, enhancements directed to controlling the positioning of a view of a virtual reality environment, enhancements directed to conceptualizing the virtual reality environment as perceived through different types of three-dimensional presentational hardware, and enhancements directed to the exchange of objects between multiple virtual reality environments being constructed.
    Type: Grant
    Filed: March 1, 2021
    Date of Patent: June 14, 2022
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Dong Back Kim, Ricardo Acosta Moreno, Jia Wang, Joshua Benjamin Eiten, Stefan Landvogt