Patents Examined by Andrew Shin
  • Patent number: 11727654
    Abstract: Implementations of the subject matter described herein relate to mixed reality object rendering based on ambient light conditions. According to the embodiments of the subject matter described herein, while rendering an object a wearable computing device acquires light conditions of the real world, thereby increasing the reality of the rendered object. In particular, the wearable computing deice is configured to acquire an image of an environment where the wearable computing deice is located. The image is adjusted based on a cement parameter used when the image is captured. Subsequently, ambient light information is determined based on the adjusted image. In this way, the wearable computing deice can obtain more real and accurate emblem light information, so as to render to the user an object with enhanced reality. Accordingly, the user can have a better interaction experience.
    Type: Grant
    Filed: September 12, 2022
    Date of Patent: August 15, 2023
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Guojun Chen, Yue Dong, Xin Tong, Yingnan Ju, Pingchao Yu
  • Patent number: 11727614
    Abstract: The present disclosure describes systems, methods, and non-transitory computer readable media for detecting user interactions to edit a digital image from a client device and modify the digital image for the client device by using a web-based intermediary that modifies a latent vector of the digital image and an image modification neural network to generate a modified digital image from the modified latent vector. In response to user interaction to modify a digital image, for instance, the disclosed systems modify a latent vector extracted from the digital image to reflect the requested modification. The disclosed systems further use a latent vector stream renderer (as an intermediary device) to generate an image delta that indicates a difference between the digital image and the modified digital image. The disclosed systems then provide the image delta as part of a digital stream to a client device to quickly render the modified digital image.
    Type: Grant
    Filed: February 23, 2021
    Date of Patent: August 15, 2023
    Assignee: Adobe Inc.
    Inventors: Akhilesh Kumar, Baldo Faieta, Piotr Walczyszyn, Ratheesh Kalarot, Archie Bagnall, Shabnam Ghadar, Wei-An Lin, Cameron Smith, Christian Cantrell, Patrick Hebron, Wilson Chan, Jingwan Lu, Holger Winnemoeller, Sven Olsen
  • Patent number: 11703334
    Abstract: An example robot performs a scan to obtain image data of a given region. The robot performs image analysis on the image data to detect a set of undesirable objects, and generates a reference map that excludes the set of undesirable objects, where the reference map is associated with the location of the robot at the time of the scan.
    Type: Grant
    Filed: October 31, 2017
    Date of Patent: July 18, 2023
    Assignee: Hewlett-Packard Development Company. L.P.
    Inventors: Jonathan Salfity, David Murphy
  • Patent number: 11699304
    Abstract: An imaging device includes: an imaging portion that captures an image of a portion of a living body to take in the image; a display portion that displays first and second display images with being superimposed on each other, the first display image being based on the taken-in image, the second display image including guidance regarding a way to place the portion of the living body in a prescribed position; a determination portion that determines whether the portion of the living body is placed in the prescribed position; and a control portion that, until it is determined that the portion of the living body is placed in the prescribed position, causes the imaging portion to newly capture and take in a new image of the portion of the living body and causes the display portion to display an image based on the new taken-in image.
    Type: Grant
    Filed: November 18, 2019
    Date of Patent: July 11, 2023
    Assignee: NEC CORPORATION
    Inventors: Takahiro Sakamoto, Masaki Kuroiwa
  • Patent number: 11694377
    Abstract: An editing device acquires a first image in which an occupant of a vehicle has been imaged in association with a time point in a time series and a second image in which scenery around the vehicle has been imaged in association with a time point in a time series, acquires first index information indicating feelings of the occupant when the first image has been captured on the basis of the first image, and extracts the first image and the second image from first images of the time series and second images of the time series on the basis of the first index information and the time point associated with the first image based on the first index information to generate a library including the extracted images.
    Type: Grant
    Filed: August 3, 2021
    Date of Patent: July 4, 2023
    Assignee: HONDA MOTOR CO., LTD.
    Inventors: Yuki Aoki, Hisashi Murayama, Koichi Kono, Masahide Kobayashi
  • Patent number: 11688124
    Abstract: A background image is also generated, e.g., by filling portions of a captured image where a foreground object was extracted and communicated to the playback device, Foreground objects are identified and point cloud representations of the foreground objects are generated and communicated to a playback device so that they can be used in generating images including the background which is communicated separately. In the case of a point cloud representation a number of points in an environment, e.g., 3D space, are communicated to the playback device along with color information. Thus in some embodiments a foreground object is represented as a set of points with corresponding color information on a per point basis. Foreground object information is communicated and processed in some embodiments at a different rate, e.g., faster rate, then the background textures. The playback device renders images which are sent to the display by first rendering a background layer using the communicated background information, e.g.
    Type: Grant
    Filed: February 14, 2022
    Date of Patent: June 27, 2023
    Assignee: Nevermind Capital LLC
    Inventors: Hector Medina, David Cole, Alan Moss
  • Patent number: 11657553
    Abstract: A digital makeup artist system includes a mobile device, a database system storing cosmetic routine information, common makeup looks, cosmetic products for skin types and ethnicity, and user look preferences of a user. The mobile device includes a user interface for interacting with a digital makeup artist. The digital makeup artist performs an interactive dialog with the user in order to capture needs of the user, including types of makeup look, indoor or outdoor look, skin condition, facial problem areas, favorite facial features. The computation circuitry analyzes the user's face image to identify face parts, analyzes the face image to determine facial characteristics, and generates image frames to be displayed in synchronization with the interaction with the digital makeup artist based on the analyzed face image, needs of the user, the stored cosmetic routine information, common makeup looks, cosmetic products for skin types and ethnicity, and the user look preferences.
    Type: Grant
    Filed: December 30, 2020
    Date of Patent: May 23, 2023
    Assignee: L'OREAL
    Inventors: Mindy Christine Troutman, Sandrine Gadol, Francesca D. Cruz
  • Patent number: 11657564
    Abstract: Methods and apparatus to transition between 2D and 3D renderings of augmented reality content are disclosed. An example apparatus includes instructions to cause programmable circuitry to: cause projection of an AR object onto at least one of a first surface in a real-world environment or a second surface in the real-world environment; cause the AR object to appear to move with variable depth relative to the first surface; cause the AR object to appear to move at a fixed depth relative to the second surface; cause the AR object to appear to transition from the first surface to the second surface when an apparent depth of the AR object relative to the first surface is within a threshold of the fixed depth; and prevent the AR object from appearing to transition to the second surface when the apparent depth is not within the threshold of the fixed depth.
    Type: Grant
    Filed: July 29, 2022
    Date of Patent: May 23, 2023
    Assignee: INTEL CORPORATION
    Inventors: Pete Denman, John Sherry, Glen J. Anderson, Benjamin Bair, Rebecca Chierichetti, Ankur Agrawal, Meng Shi
  • Patent number: 11657528
    Abstract: Systems and methods are provided for three-dimensional scanning and measurement by a device having a processor. The processor is configured to receive images of an object from at least two angles; preprocess the images using morphological refinement; create a source point cloud based on the images; remove outliers from the source point cloud; globally register the source point cloud to generate a transformed source point cloud; compare the transformed source point cloud with a target point cloud to generate a stitched point cloud that thereby creates a stitched 3D model; measure the resulting stitched 3D model; and provide the resulting stitched 3D model for comparison to a digitized item to assess sizing of the 3D model to the item.
    Type: Grant
    Filed: July 21, 2020
    Date of Patent: May 23, 2023
    Assignee: Xesto Inc.
    Inventors: Mehmet Afiny Affan Akdemir, Christian Garcia Salguero, Victoria Sophie Howe
  • Patent number: 11651532
    Abstract: An example method of automated creation of artistic digital images comprises: producing a styled digital image by performing stylization of a source digital image based on a specified visual style; identifying a plurality of visual elements of the styled digital image; generating a sequence of digital paint coat layers for the styled digital image, wherein each digital paint coat layer of the sequence of digital paint coat layers covers at least a subset of the plurality of visual elements of the styled digital image, and wherein each digital paint coat layer of the sequence of digital paint coat layers comprises a set of graphic primitives; and producing an output digital image by generating respective sets of graphic primitives of each digital paint coat layer of the plurality of digital paint coat layers, wherein the output digital image exhibits one or more visual features of the visual style.
    Type: Grant
    Filed: July 15, 2021
    Date of Patent: May 16, 2023
    Assignee: Corel Corporation
    Inventor: Christopher Tremblay
  • Patent number: 11651752
    Abstract: A method, apparatus and computer program product describing groups of overlays, such as semantically correlated overlays, to background media content. In the context of a method, a group of overlays to background media content is defined by metadata (60). The overlays include semantically correlated overlays having alternative overlays representing content with different levels of detail or overlays providing different choices of content. The method also includes receiving client selection of a respective overlay from a group of overlays (62). In response to the client selection, the method causes the respective overlay to be provided. The respective overlay is received (64) for presentation concurrent with background media content (68).
    Type: Grant
    Filed: May 31, 2019
    Date of Patent: May 16, 2023
    Assignee: NOKIA TECHNOLOGIES OY
    Inventors: Kashyap Kammachi-Sreedhar, Igor Curcio, Miska Hannuksela, Sujeet Shyamsundar Mate, Emre Aksu
  • Patent number: 11645781
    Abstract: Techniques are described for computing devices to perform automated operations to determine the acquisition locations of images, such as within a building interior based on automatically determined shapes of rooms of the building, and for using the determined image acquisition location information in further automated manners. The image may be a panorama image or of another type (e.g., a rectilinear perspective image) and acquired at an acquisition location in a multi-room building's interior, and the determined acquisition location for such an image may be at least a location on the building's floor plan and optionally an orientation/direction for at least a part of the imageā€”in addition, the automated image acquisition location determination may be further performed without having or using information from any depth sensors or other distance-measuring devices about distances from an image's acquisition location to walls or other objects in the surrounding building.
    Type: Grant
    Filed: October 7, 2022
    Date of Patent: May 9, 2023
    Assignee: MFTB Holdco, Inc.
    Inventors: Yuguang Li, Will A. Hutchcroft, Naji Khosravan, Ivaylo Boyadzhiev
  • Patent number: 11640683
    Abstract: Stroke special effect program file package generating methods and apparatuses, and stroke special effect generating methods and apparatuses are provided. The stroke special effect program file package generating method includes: obtaining a parameter value of a stroke effect parameter of a target object; and generating a stroke special effect program file package according to the parameter value of the stroke effect parameter of the target object.
    Type: Grant
    Filed: July 1, 2020
    Date of Patent: May 2, 2023
    Assignee: BEIJING SENSETIME TECHNOLOGY DEVELOPMENT CO., LTD.
    Inventors: Qinqin Xu, Zhanpeng Li
  • Patent number: 11625793
    Abstract: A process for estimating a value of a crop of walnuts prior to harvest includes the following steps which are not necessarily in order. First, arranging an unmanned aerial vehicle with a digital single-lens reflex high speed multi spectral camera fitted with a near-infrared filter. Then, taking normalized difference vegetation index images of a field of walnuts every second at a clarity of two centimeters in detail from an altitude of four hundred feet. Next, forming a map of the field from the normalized difference vegetation index images. After that, determining a ratio of the field which possesses a high near-infrared profile. Following that, calculating a meat yield as a product of the ratio and the maximum walnut grade in the field. Finally, calculating the value of the crop from the meat yield.
    Type: Grant
    Filed: March 5, 2021
    Date of Patent: April 11, 2023
    Inventors: Meyer Colpien Hesse, Travis William Hesse
  • Patent number: 11619512
    Abstract: A device may receive data associated with a delivery and display a first portion of a route associated with the delivery and first image data of an environment along the first portion. The device may determine that the first portion has been completed and may then display a second portion of the route. During display of the second portion, second image data representing a delivery location associated with the delivery may be presented. The first portion and the second portion may represent portions of the delivery that are completed using different modes of travel.
    Type: Grant
    Filed: February 25, 2021
    Date of Patent: April 4, 2023
    Assignee: Amazon Technologies, Inc.
    Inventors: Anuj Gupta, Avishek Chandra
  • Patent number: 11593973
    Abstract: A method and a system for Augmented Reality (AR) content creation is disclosed. The method includes creating a feature vector corresponding to each of a sequence of frames extracted from a video, based on a plurality of features captured. The method further includes determining a vector distance between each of two consecutive frames from the sequence of frames, based on the feature vector associated with each of the two consecutive frames. The method further includes dividing the video into a plurality of frames based on the determined vector distance. The method further includes creating a storyline based on an object and an action associated with the object in each of the plurality of frames, and generating a set of instructions for a user based on the storyline created for each of the plurality of frames and real-time video stream capturing a current state of a user environment.
    Type: Grant
    Filed: December 14, 2020
    Date of Patent: February 28, 2023
    Assignee: Wipro Limited
    Inventors: Vivek Kumar Varma Nadimpalli, Gopichand Agnihotram
  • Patent number: 11593914
    Abstract: A method for presenting an image on a display device (100) includes modifying the image by applying a geometric transformation to the image so that an area of the image on the display device is presented to a viewer with higher density of pixels than that in the rest of the image (S18).
    Type: Grant
    Filed: June 16, 2015
    Date of Patent: February 28, 2023
    Assignee: INTERDIGITAL CE PATENT HOLDINGS, SAS
    Inventors: Sylvain Thiebaud, Laurent Blonde, Thierry Tapie, Valter Drazic
  • Patent number: 11587292
    Abstract: Various embodiments of the invention disclosed herein provide techniques for generating a virtual object for a VR/AR environment in response to a trigger. A VR/AR application executing on a client device receives a media content item. The VR/AR application detects an event trigger associated with the media content item. The VR/AR application generates at least a portion of a virtual object based on the event trigger. The VR/AR application displays the media content item and the at least a portion of the virtual object on a display associated with a user device.
    Type: Grant
    Filed: July 30, 2018
    Date of Patent: February 21, 2023
    Assignee: Disney Enterprises, Inc.
    Inventors: John Holbrook Crocker, Wilfredo Rosas
  • Patent number: 11551392
    Abstract: Provided are a graphic drawing method applied to a terminal device. The terminal device includes a canvas deployed on an upper layer of a video stream display window and structured feature data of at least one basic graphic matching the canvas. The method includes: monitoring in real time a target graphic drawing event that is performed by a paintbrush based on a selected basic graphic; upon monitoring the target graphic drawing event, acquiring, for each time point in which each frame of image in a video stream is displayed, a drawing coordinate of the paintbrush at each time point; and rendering and drawing on the canvas a target graphic corresponding to an image displayed at each time point according to structured feature data of the selected basic graphic and the drawing coordinate. Further provided are a graphic drawing apparatus, a device, and a storage medium.
    Type: Grant
    Filed: February 25, 2019
    Date of Patent: January 10, 2023
    Assignee: ZHEJIANG UNIVIEW TECHNOLOGIES CO., LTD.
    Inventor: Guosheng Yu
  • Patent number: 11551328
    Abstract: A method for profiling energy usage in graphics user interfaces (UI) in handheld mobile devices is disclosed, which includes quantifying the central processing unit (CPU) energy drain of each UI update, quantifying the graphics processing unit (GPU) energy drain of each UI update, quantifying the number of pixels changed due to each UI update, identifying an UI update that consumes energy drain but results in no pixel changes to the displayed frame as a graphics energy bug.
    Type: Grant
    Filed: November 23, 2021
    Date of Patent: January 10, 2023
    Assignee: Purdue Research Foundation
    Inventors: Yu Charlie Hu, Ning Ding