Patents Examined by Sarah Lhymn
  • Patent number: 11550947
    Abstract: A method of prohibiting personal information identification of a photographic subject including: digitally photographing the photographic subject to form a photo of the photographic subject, the photographic subject having an indicia incorporated in the photo indicating prohibiting personal information identification of the photographic subject, the indicia being invisible to the human eye; reading the indicia; responsive to reading the indicia, processing the indicia to make a determination when the indicia prohibits identification of personal information of the photographic subject; and disclosing on a social network system the photo and the personal information of the photographic subject according to the determination.
    Type: Grant
    Filed: April 21, 2020
    Date of Patent: January 10, 2023
    Assignee: International Business Machines Corporation
    Inventors: Satsuo Kiyono, Eric V. Kline, Wen Ming Lim, Carlo Gonzales Gagui, Chiaki Oishi
  • Patent number: 11551344
    Abstract: A smart, human-centered technique that uses artificial intelligence and mixed reality to accelerate essential tasks of the inspectors such as defect measurement, condition assessment and data processing. For example, a bridge inspector can analyze some remote cracks located on a concrete pier, estimate their dimensional properties and perform condition assessment in real-time. The inspector can intervene in any step of the analysis/assessment and correct the operations of the artificial intelligence. Thereby, the inspector and the artificial intelligence will collaborate/communicate for improved visual inspection. This collective intelligence framework can be integrated in a mixed reality supported see-through headset or a hand-held device with the availability of sufficient hardware and sensors. Consequently, the methods reduce the inspection time and associated labor costs while ensuring reliable and objective infrastructure evaluation.
    Type: Grant
    Filed: December 9, 2020
    Date of Patent: January 10, 2023
    Assignee: University of Central Florida Research Foundation, Inc.
    Inventors: Enes Karaaslan, Fikret Necati Catbas, Ulas Bagci
  • Patent number: 11544009
    Abstract: A system on a chip, including a first domain having a first processor, a first local memory coupled to the first processor, wherein the first local memory having a first memory format and a first sub-network coupled to the first processor, a second domain having a second processor, a second local memory coupled to the second processor and a second sub-network coupled to the second processor, wherein the second local memory having a second memory format which differs from the first memory format, a multi-tier network coupled to the first sub-network and the second sub-network, a global memory coupled to the multi-tier network and a multi-port DDR controller coupled to the global memory to receive, transmit and share the first local memory having the first memory format and the second local memory having the second memory format based on a predetermined criteria.
    Type: Grant
    Filed: May 10, 2021
    Date of Patent: January 3, 2023
    Assignee: Black Sesame Technologies Inc.
    Inventors: Zheng Qi, Qun Gu, Chengyu Xiong
  • Patent number: 11544818
    Abstract: Users often desire to capture certain images from an application. Existing methods of capturing images can result in low-resolution images due to limitations of the display device providing the images. This disclosure provides a method of capturing higher resolution images from source images. Techniques are also disclosed to reduce the storage size associated with the higher resolution images. Through capturing low-resolution versions of the same source images, image effects can be captured and applied to the higher resolution images where those image effects may be altered or missing. Frequency spectrum combination can be used to combine the low-resolution image data and the higher resolution image data. The higher resolution images can be processed using a segmentation scheme, such as tiling, without reducing or limiting the image effects.
    Type: Grant
    Filed: April 13, 2021
    Date of Patent: January 3, 2023
    Assignee: NVIDIA Corporation
    Inventors: Andrey Voroshilov, Halldor Fannar, Dmitry Duka
  • Patent number: 11514560
    Abstract: A method of correcting image latency in implementing augmented reality includes receiving a first image including frames, in which a time point and a pose of an electronic apparatus for each frame are recorded, from an external apparatus; rendering the first image; receiving first data corresponding to a first time point of a first frame; receiving second data corresponding to a second time point of a second frame; calculating a respective pose of the electronic apparatus for each scan line of a second image based on the first data and the second data; calculating a pixel shift for each pixel in each scan line based on the respective pose calculated for each scan line; generating the second image by correcting the first image based on the pixel shift; and transmitting the second image to the external apparatus.
    Type: Grant
    Filed: June 17, 2021
    Date of Patent: November 29, 2022
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Namseop Kwon, Myungjae Jeon, Hongseok Lee
  • Patent number: 11514649
    Abstract: An augmented reality display device includes a near-eye display configured to present imagery to a user eye. A camera is configured to capture light from a real-world environment and produce output useable to contribute to the imagery presented to the user eye via the near-eye display. The camera includes an aperture configured to receive the light from the real-world environment and an image sensor configured to respond to the light received from the real-world environment by generating sensor output signals useable to produce images on the near-eye display depicting the real-world environment. One or more optical elements provide an optical path for light from the aperture to the image sensor, the optical path having a length that is within a threshold of a distance between the user eye and the aperture of the camera.
    Type: Grant
    Filed: May 29, 2020
    Date of Patent: November 29, 2022
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Robert Warren Gruen, Weige Chen, Michael George Boulton, Roberta Rene Moeur, Bernard Charles Kress
  • Patent number: 11514641
    Abstract: A client device of a split rendering graphics processing architecture, receives an encoded shading atlas for a current frame. The encoded shading atlas is characterized by slices. The client decodes the received encoded shading atlas and identifies unsuccessfully decoded slices. The client then determines whether each patch of the decoded shading atlas intersects an identified unsuccessfully decoded slice. The client determines, for each intersecting patch, whether a prior valid version of each intersecting patch is stored at the client device. The client error conceals each intersecting patch having a prior valid version stored at the client device with the corresponding prior valid version to create an error concealed atlas. The client renders the current frame using the error concealed atlas.
    Type: Grant
    Filed: March 3, 2021
    Date of Patent: November 29, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Joseph Daniel Garvey, Bojan Vrcelj
  • Patent number: 11508083
    Abstract: An image processing apparatus comprises a calculation unit configured to obtain, for a pixel of interest in a boundary portion of a specific region in a captured image bounding a non-specific region, a direction vector to the non-specific region, a selection unit configured to select one of pixels in the boundary portion that are adjacent to the pixel of interest, as a selected pixel based on the direction vector of the pixel of interest, and a generation unit configured to generate information indicating a direction from the pixel of interest to the selected pixel as information indicating a contour corresponding to the specific region.
    Type: Grant
    Filed: July 24, 2020
    Date of Patent: November 22, 2022
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Masashi Nakagawa
  • Patent number: 11500526
    Abstract: Implementations of various computer methods to couple a computerized ball device which acts as a mobile computing device to record the users environment and project light towards waveguide eyeglasses or contacts which then allows a user to view imbedded light structure holograms in the waveguide while viewing the actual world. The computer ball device additionally has the ability to be docked in a drone cradle which creates a database map of the user's environment while not being utilized by the user for an immediate task. The device may also attach to a wrist band for mobility. The device also has the ability to couple the projected light structures so that a plurality of users may view the same light structure content to build an environment of trust. The device decouples the traditional design of head mounted virtual and mixed reality that place together the camera with the head mounted device.
    Type: Grant
    Filed: October 28, 2019
    Date of Patent: November 15, 2022
    Assignee: CIRCLESX LLC
    Inventors: Erik Mowery Simpson, Kenneth Simpson
  • Patent number: 11494872
    Abstract: A computer system and related computer-implemented methods are disclosed. The system is programmed to simplify one or more digital maps for a geographical region by reducing their sizes while maintaining their physical appearances to the human eyes.
    Type: Grant
    Filed: June 21, 2021
    Date of Patent: November 8, 2022
    Assignee: Risk Management Solutions, Inc.
    Inventors: Julien Brown, Valli Gadiyaram Venkata, Shruthi Bhat
  • Patent number: 11480796
    Abstract: The invention discloses a three-dimensional display module using optical wave-guide for providing directional backlights. This display module includes a wave-guide backlight unit with time-sequential directional light sources, a display device, a wavefront modulation device or a light splitting device, and other components. The wave-guide backlight unit with time-sequential directional light sources includes a sequential-switching light-source array, a relay device, and an optical wave-guide device. Each light source of the sequential-switching light-source array provides backlight of corresponding vector characteristics to the display device, making optical message displayed by the display device being guided to the corresponding viewing zone/viewing zones. Through the technology routes of multiple-view-for-one-pupil or/and Maxwellian view, the three-dimensional display module implements displays free from the vergence-accommodation conflict.
    Type: Grant
    Filed: January 15, 2021
    Date of Patent: October 25, 2022
    Assignee: SUN YAT-SEN UNIVERSITY
    Inventors: Lilin Liu, Dongdong Teng
  • Patent number: 11481871
    Abstract: Updating an image during real-time rendering of images by a display device can include determining a depth for each pixel of a color frame received from a source device and corresponding to the image. Each pixel's depth is determined by image-guided propagation of depths of sparse points extracted from a depth map generated at the source device. With respect to pixels corresponding to an extracted sparse depth point, image-guided depth propagation can include retaining the depth of the corresponding sparse depth point unchanged from the source depth map. With respect to each pixel corresponding to a non-sparse depth point, image-guided depth propagation can include propagating to the corresponding non-sparse depth point a depth of a sparse depth point lying within a neighborhood of the non-sparse depth point. Pixel coordinates of the color frame can be transformed for generating a space-warped rendering of the image.
    Type: Grant
    Filed: August 13, 2021
    Date of Patent: October 25, 2022
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Yingen Xiong, Christopher A. Peri
  • Patent number: 11455776
    Abstract: A network for neural pose transfer includes a pose feature extractor, and a style transfer decoder, wherein the pose feature extractor comprises a plurality of sequential extracting stacks, each extracting stack consists of a first convolution layer and an Instance Norm layer sequential to the first convolution layer. The style transfer decoder comprises a plurality of sequential decoding stacks, a second convolution layer sequential to the plurality of decoding stacks and a tan h layer sequential to the second convolution layer. Each decoding stack consists of a third convolution layer and a SPAdaIn residual block. A source pose mesh is input to the pose feature extractor, and an identity mesh is concatenated with the output of the pose feature extractor and meanwhile fed to each SPAdaIn residual block of the style transfer decoder. A system thereof is also provided.
    Type: Grant
    Filed: September 10, 2020
    Date of Patent: September 27, 2022
    Assignee: FUDAN UNIVERSITY
    Inventors: Yanwei Fu, Xiangyang Xue, Yinda Zhang, Chao Wen, Haitao Lin, Jiashun Wang, Tianyun Zou
  • Patent number: 11450014
    Abstract: A system for continuous image alignment of separate cameras identifies a reference camera transformation matrix between a base reference camera pose and an updated reference camera pose. The system also identifies a match camera transformation matrix between a base match camera pose and an updated match camera pose and an alignment matrix based on visual correspondences between one or more reference frames captured by the reference camera and one or more match frames captured by the match camera. The system also generates a motion model configured to facilitate mapping of a set of pixels of a reference frame captured by the reference camera to a corresponding set of pixels of a match frame captured by the match camera based on the reference camera transformation matrix, the match camera transformation matrix, and the alignment matrix.
    Type: Grant
    Filed: July 22, 2020
    Date of Patent: September 20, 2022
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Michael Bleyer, Christopher Douglas Edmonds, Michael Edward Samples, Sudipta Narayan Sinha, Matthew Beaudoin Karr, Raymond Kirk Price
  • Patent number: 11443455
    Abstract: A scale and pose estimation method for a camera system is disclosed. Camera data for a scene acquired by the camera system is received. A rotation prior parameter characterizing a gravity direction is received. A scale prior parameter characterizing scale of the camera system is received. A cost of a cost function is calculated for a similarity transformation that is configured to encode a scale and pose of the camera system. The cost of the cost function is influenced by the rotation prior parameter and the scale prior parameter. A solved similarity transformation is determined upon calculating a cost for the cost function that is less than a threshold cost. An estimated scale and pose of the camera system is output based on the solved similarity transformation.
    Type: Grant
    Filed: January 15, 2020
    Date of Patent: September 13, 2022
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Victor M. Fragoso Rojas, Mei Chen, Gabriel Takacs
  • Patent number: 11443484
    Abstract: Techniques performed by a data processing system for reconstructing a three-dimensional (3D) model of the face of a human subject herein include obtaining source data comprising a two-dimensional (2D) image, three-dimensional (3D) image, or depth information representing a face of a human subject. Reconstructing the 3D model of the face also includes generating a 3D model of the face of the human subject based on the source data by analyzing the source data to produce a coarse 3D model of the face of the human subject, and refining the coarse 3D model through free form deformation to produce a fitted 3D model. The coarse 3D model may be a 3D Morphable Model (3DMM), and the coarse 3D model may be refined through free-form deformation in which the deformation of the mesh is limited by applying an as-rigid-as-possible (ARAP) deformation constraint.
    Type: Grant
    Filed: July 15, 2020
    Date of Patent: September 13, 2022
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Noranart Vesdapunt, Wenbin Zhu, Hsiang-Tao Wu, Zeyu Chen, Baoyuan Wang
  • Patent number: 11436828
    Abstract: Techniques include receiving image data representing an environment. Based at least in part on the image data, an identity of at least one object disposed within the environment is determined. Based at least in part on the image data, an image is displayed on an electronic device. The image includes a three-dimensional representation of at least a portion of the environment, a three-dimensional representation of the at least one object, and a three-dimensional representation of an assistant providing a request related to the at least one object. A first input is received from a user of the electronic device and based at least in part on the request. An object list is generated based at least in part on the first input and the identity of the at least one object, the list including the at least one object.
    Type: Grant
    Filed: June 2, 2020
    Date of Patent: September 6, 2022
    Assignee: State Farm Mutual Automobile Insurance Company
    Inventors: Rebecca A. Little, Christopher Robert Galante
  • Patent number: 11417044
    Abstract: A computer graphics display system and method which places moving and color changing geometric shapes, which represent tasks of a project, on a circular graph by means of a display such as a computer monitor, (similar to a radar screen) which alerts the user to impending delays to a project by means of visualization of the movement and color change of the geometric shapes or “blips” on the circular graph. The method comprises extracting information from planning calculations, then translating this information into an animated visual radial graphic display.
    Type: Grant
    Filed: May 17, 2019
    Date of Patent: August 16, 2022
    Inventor: Thomas Charley Long
  • Patent number: 11402655
    Abstract: An example of an image display system includes a goggles apparatus and is capable of setting an angle of view of a virtual camera disposed in a virtual space to a first angle of view or a second angle of view smaller than the first angle of view. If the angle of view of the virtual camera is set to the first angle of view, the image display system sets a parallax between an image for a left eye and an image for a right eye to a first parallax. If the angle of view of the virtual camera is set to the second angle of view, the image display system sets the parallax between the image for a left eye and the image for a right eye to a second parallax smaller than the first parallax.
    Type: Grant
    Filed: March 4, 2020
    Date of Patent: August 2, 2022
    Assignee: NINTENDO CO., LTD.
    Inventors: Kenji Iwata, Ryuhei Matsuura
  • Patent number: 11404021
    Abstract: Various embodiments of the present disclosure relate to an electronic device and a method of processing a notification in an electronic device. The electronic device may include a display that displays at least one object on a screen, and a controller that determines a notification display area for displaying a notification on the screen based on a gesture of a user associated with at least one object displayed on the screen, and to display the notification in at least one determined notification display area.
    Type: Grant
    Filed: April 16, 2020
    Date of Patent: August 2, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Ho-Young Lee, Gyu-Chual Kim