Patents Examined by Charles Tseng
  • Patent number: 10783684
    Abstract: A method for displaying an image includes: receiving a setting instruction for performing upper layer display on an image of a target real object; determining image range information of the image of the target real object in a scene image frame upon the scene image frame is captured; acquiring the image of the target real object in the scene image frame based on the image range information; and setting an image of a preset target virtual object on an upper layer of the scene image frame, and setting the image of the target real object on an upper layer of the image of the target virtual object and the scene image frame based on the image range information.
    Type: Grant
    Filed: November 27, 2018
    Date of Patent: September 22, 2020
    Assignee: BEIJING XIAOMI MOBILE SOFTWARE CO., LTD.
    Inventors: Xiaojun Wu, Xingsheng Lin, Binglin Chang
  • Patent number: 10776985
    Abstract: Disclosed approaches may leverage the actual spatial and reflective properties of a virtual environment—such as the size, shape, and orientation of a bidirectional reflectance distribution function (BRDF) lobe of a light path and its position relative to a reflection surface, a virtual screen, and a virtual camera—to produce, for a pixel, an anisotropic kernel filter having dimensions and weights that accurately reflect the spatial characteristics of the virtual environment as well as the reflective properties of the surface. In order to accomplish this, geometry may be computed that corresponds to a projection of a reflection of the BRDF lobe below the surface along a view vector to the pixel. Using this approach, the dimensions of the anisotropic filter kernel may correspond to the BRDF lobe to accurately reflect the spatial characteristics of the virtual environment as well as the reflective properties of the surface.
    Type: Grant
    Filed: March 15, 2019
    Date of Patent: September 15, 2020
    Assignee: NVIDIA Corporation
    Inventors: Shiqiu Liu, Christopher Ryan Wyman, Jon Hasselgren, Jacob Munkberg, Ignacio Llamas
  • Patent number: 10777004
    Abstract: Provided are systems and methods for generating an autonomous 3D inspection plan for an unmanned robot. In an example, the method may include receiving a selection of a plurality of regions of interest with respect to a virtual asset displayed in virtual space, detecting a 3D position of the regions of interest within a coordinate frame of the virtual space, auto-generating a travel path about a physical asset corresponding to the virtual asset by generating a virtual 3D travel path with respect to the virtual asset based on the detected 3D positions of the selected regions of interest within the coordinate frame, aligning the virtual 3D travel path in the virtual space with a physical travel path in a physical space, and outputting a robotic inspection plan comprising the auto-generated physical travel path for the unmanned robot.
    Type: Grant
    Filed: November 14, 2019
    Date of Patent: September 15, 2020
    Assignee: GENERAL ELECTRIC COMPANY
    Inventors: Steven Gray, Shiraj Sen, Ghulam Ali Baloch, Mauricio Castillo-Effen, Charles Theurer
  • Patent number: 10769752
    Abstract: A computer implemented method for warping virtual content includes generating warped virtual content by transforming source virtual content. The method also includes determining whether a memory location corresponding to an X, Y location of the warped virtual content in an output frame of reference is occupied by pre-existing virtual content. The method further includes storing the warped virtual content in the memory location if the memory location is not occupied. Moreover, the method includes comparing respective Z locations of the warped virtual content and the pre-existing virtual content to identify virtual content with a Z location closer to a viewing location if the memory location is occupied. The method also includes storing the warped virtual content in the memory location corresponding to the X, Y location if a Z location of warped virtual content is closer to the viewing location than a pre-existing Z location of pre-existing virtual content.
    Type: Grant
    Filed: March 16, 2018
    Date of Patent: September 8, 2020
    Assignee: Magic Leap, Inc.
    Inventors: Reza Nourai, Robert Blake Taylor
  • Patent number: 10769860
    Abstract: A system for switching a 3D asset between art styles, including a user interface to receive an art style selection, and a 3D character software development kit (SDK) engine. The 3D character SDK engine receives a selected art style from the user interface, determines identifying characteristics of the 3D asset, removes the identifying characteristics from the 3D asset to return the 3D asset to a base figure, receives style deformations based on the selected art style, applies the style deformations to the base figure to form a new 3D asset based on the selected style, and applies the identifying characteristics to the new 3D asset based on the selected style.
    Type: Grant
    Filed: October 30, 2017
    Date of Patent: September 8, 2020
    Assignee: DG Holdings, Inc.
    Inventors: Jesse Janzer, Jon Middleton, Berkley Frei
  • Patent number: 10768790
    Abstract: Systems, methods, and devices are provided for altering an appearance of acquaintances when viewed through smart glasses, which may be altered using augmented reality technology. In particular, an embodiment of the invention is directed to allowing users to specify their appearances to others when viewed by others wearing smart glasses. The others viewing the user through smart glasses include friends, family, contacts, or other acquaintances, which may be specified in one or more social networks or contacts databases. The altered appearance that is displayed may be based on the particular relationship between the user and the viewer. For example, a user may appear as a particular superhero to his friends on a social network website, as having a cartoon feature (such as an enormous head) to his children, as normal to his mother and business contacts, and as wearing a Hawaiian shirt to his closest buddies.
    Type: Grant
    Filed: May 18, 2018
    Date of Patent: September 8, 2020
    Assignee: Hallmark Cards, Incorporated
    Inventor: Scott A. Schimke
  • Patent number: 10762719
    Abstract: A method for generating an active visual product configuration based on interactive digital 2D or 3D objects displayed on an operating device. Processing options and degrees of freedom and/or object characteristics are defined in an object control unit of a data processing system. A variant model is created in the data processing system and corresponding parameters are assigned to the object and to the processing options. A visualization unit assigned to the operating device represents the complex variant model optically in a 3D-scenario for active product configuration. The active product configuration is carried out via a display device and/or a touch screen integrated in the operating device. All processing options and degrees of freedom of the object can be animated. During the production configuration, a communication control unit effects data communication between the visualization unit and the object control unit and the configuration instance of the variant model.
    Type: Grant
    Filed: February 11, 2015
    Date of Patent: September 1, 2020
    Inventor: Erich Schaarschmidt
  • Patent number: 10755479
    Abstract: Neural networks of suitable topology are trained with sets of images, where one image of each set depicts a garment and another pair of images of each set depicts an item of apparel from multiple viewpoints, and a final image of each set depicts a model wearing the garment and the other item of apparel. Once trained, the neural network can synthesize a new image based on input images including an image of a garment and a pair of images of another item of apparel. Quantitative parameters controlling the image synthesis permit adjustment of features of the synthetic image, including skin tone, body shape and pose of the model, as well as characteristics of the garment and other items of apparel.
    Type: Grant
    Filed: May 24, 2019
    Date of Patent: August 25, 2020
    Assignee: Mad Street Den, Inc.
    Inventor: Marcus C. Colbert
  • Patent number: 10748263
    Abstract: A medical image processing apparatus includes an acquisition unit, a processing unit, a memory and a display. The acquisition unit acquires first volume data including data of a subject. A predetermined luminance condition is set in the memory. The predetermined luminance condition is a luminance condition that is to be satisfied by luminance of a first SUM image rendering the acquired first volume data. The processing unit generates first luminance information that gives the luminance of the first SUM image that satisfies the predetermined luminance condition, generates the first SUM image by rendering the acquired first volume data with the generated first luminance information, and displays the generated first SUM image in the display.
    Type: Grant
    Filed: October 10, 2018
    Date of Patent: August 18, 2020
    Assignee: ZIOSOFT, INC.
    Inventor: Takahiro Suzuki
  • Patent number: 10748349
    Abstract: An image conversion unit according to an embodiment includes a gradation unit, a black line extraction unit, and a white line extraction unit. The gradation unit classifies a pixel of a pre-conversion image as one of four levels based on a brightness of the pixel, and expresses, in a color corresponding to the level as which the pixel has been classified, a corresponding pixel of a converted image. The black line extraction unit extracts pixels of an outline of an object in the pre-conversion image, and expresses corresponding pixels of the converted image in black. The white line extraction unit extracts pixels adjacent to an outline of an object in the pre-conversion image, and expresses corresponding pixels of the converted image in white.
    Type: Grant
    Filed: December 21, 2018
    Date of Patent: August 18, 2020
    Assignee: NINTENDO CO., LTD.
    Inventors: Satoshi Miyama, Yosuke Mori, Norihiro Aoyagi, Yuta Yamashita
  • Patent number: 10740954
    Abstract: In various examples, the actual spatial properties of a virtual environment are used to produce, for a pixel, an anisotropic filter kernel for a filter having dimensions and weights that accurately reflect the spatial characteristics of the virtual environment. Geometry of the virtual environment may be computed based at least in part on a projection of a light source onto a surface through an occluder, in order to determine a footprint that reflects a contribution of the light source to lighting conditions of the pixel associated with a point on the surface. The footprint may define a size, orientation, and/or shape of the anisotropic filter kernel and corresponding filter weights. The anisotropic filter kernel may be applied to the pixel to produce a graphically-rendered image of the virtual environment.
    Type: Grant
    Filed: March 15, 2019
    Date of Patent: August 11, 2020
    Assignee: NVIDIA Corporation
    Inventor: Shiqiu Liu
  • Patent number: 10733808
    Abstract: A system of properly displaying chroma key content is presented. The system obtains a digital representation of a 3D environment, for example a digital photo, and gathers data from that digital representation. The system renders the digital representation in an environmental model and displays that digital representation upon an output device. Depending upon the context, content anchors of the environmental model are selected which will be altered by suitable chroma key content. The chroma key content takes into consideration the position and orientation of the chroma key content relative to the content anchor and relative to the point of view that the environmental model is displayed from in order to accurately display chroma key content in a realistic manner.
    Type: Grant
    Filed: February 27, 2019
    Date of Patent: August 4, 2020
    Assignee: NANTMOBILE, LLC
    Inventors: Evgeny Dzhurinskiy, Ludmila Bezyaeva
  • Patent number: 10719569
    Abstract: An information processing apparatus includes a storing device and a processor. The storing device stores associated segment information indicative of two or more display unit segments having common data forming display contents among a plurality of display unit segments included in a screen of the client terminal. The processor instructs, when an update occurs on the data forming the display contents on a first display unit segment among the plurality of display unit segments, the client terminal to update data forming the display contents to be displayed on a second display unit segment associated with the first display unit segment among the plurality of display unit segments by referring to the associated segment information stored in the storing device.
    Type: Grant
    Filed: November 13, 2018
    Date of Patent: July 21, 2020
    Assignee: FUJITSU LIMITED
    Inventors: Kota Iwadate, Kazuyoshi Watanabe, Toshiharu Makida
  • Patent number: 10713847
    Abstract: The present group of inventions relates to methods and systems intended for interacting with virtual objects, involving determining a control unit to be used for interacting with virtual objects, determining characteristic graphics primitives of a virtual object, determining the spatial position of the control unit, correlating the spatial position of the control unit to the graphics primitives of the virtual object, and performing the desired actions with regard to the virtual object. In accordance with the invention, images are used from a user's client device which has a video camera and a display, a control unit image library is created on the basis of the received images, and the obtained image library is used for determining the graphics primitives of the control unit. Then, the spatial position of the control unit is determined by calculating the motion in space of the control unit graphics primitives.
    Type: Grant
    Filed: June 7, 2016
    Date of Patent: July 14, 2020
    Assignee: DEVAR ENTERTAINMENT LIMITED
    Inventors: Vitaly Vitalyevich Averyanov, Andrey Valeryevich Komissarov
  • Patent number: 10699666
    Abstract: Disclosed are an image display device and an image processing method thereof. A signal processing method of the image display device according to the present invention is a signal processing method of an image display device configured to receive an image having a varied vertical synchronization signal, including detecting an input synchronization signal using an input image clock, extracting an input vertical synchronization signal from the input synchronization signal, delaying the input vertical synchronization signal by a reference value of an output clock, continuously tracking a falling region of the delayed input vertical synchronization signal, and finally generating an output synchronization signal in which a vertical front porch is varied.
    Type: Grant
    Filed: August 23, 2018
    Date of Patent: June 30, 2020
    Assignee: LG ELECTRONICS INC.
    Inventors: Kyounghoon Jang, Kwangyeon Rhee, Byungtae Choi
  • Patent number: 10699486
    Abstract: A display system includes a projector that projects a virtual image onto a target space to allow a target person to visibly recognize the virtual image and a controller that controls display of the virtual image. When the projector projects a virtual image corresponding to a caution object, the controller selects at least one reference point from one or more candidate points existing around the caution object and associates the virtual image with the at least one reference point.
    Type: Grant
    Filed: June 25, 2018
    Date of Patent: June 30, 2020
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Akira Tanaka, Tadashi Shibata, Nobuyuki Nakano, Masanaga Tsuji, Shohei Hayashi
  • Patent number: 10684494
    Abstract: The present invention is directed to a see-through near eye optical module that in most cases is fabricated as a standalone unit. The see-through near eye optical module is in certain embodiments then placed in optical communication and alignment with an eyewear lens having appropriate optical power such that when a wearer thereof looks through the see-through near eye optical module he or she can see a real world image and virtual image clearly. In other embodiments the appropriate optical power is provided in the rear section of the see-through near eye optical module. Thus, the combination of both the see-through near eye optical module and the appropriate optical power provides the wearer with a clear augmented reality or mixed reality experience. The placement can be by way of positioning within an open notch, hole, groove, recess, or other section of an eyewear lens.
    Type: Grant
    Filed: October 11, 2019
    Date of Patent: June 16, 2020
    Assignee: NewSight Reality, Inc.
    Inventors: Ronald Blum, Philip Nathan Garfinkle
  • Patent number: 10685483
    Abstract: Viewport transformation modules for use in a three-dimensional rendering system wherein vertices are received from an application in a strip. The viewport transformation modules include a fetch module configured to read from a vertex buffer: untransformed coordinate data for a vertex in a strip; information identifying a viewport associated with the vertex; and information identifying a viewport associated with one or more other vertices in the strip. The one or more other vertices in the strip are selected based on a provoking vertex of a primitive to be formed by the vertices in the strip and a number of vertices in the primitive. The viewport transformation modules also include a processing module that performs a viewport transformation on the untransformed coordinate data based on each of the identified viewports to generate transformed coordinate data for each identified viewport; and a write module that writes the transformed coordinate data for each identified viewport to the vertex buffer.
    Type: Grant
    Filed: July 2, 2018
    Date of Patent: June 16, 2020
    Assignee: Imagination Technologies Limited
    Inventor: Jairaj Dave
  • Patent number: 10685470
    Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media for generating and providing composition effect tutorials for creating and editing digital content based on a metadata composite structure. For example, the disclosed systems can generate and/or access a metadata composite structure that includes nodes corresponding to composition effects applied to a digital content item, where a given node can include location information indicating where a composition effect is applied relative to a digital content item. The disclosed systems can further generate a tutorial to guide a user to implement a selected composition effect by identifying composition effects of nodes that correspond to a location selected within a composition interface and presenting instructions for a particular composition effect.
    Type: Grant
    Filed: September 12, 2018
    Date of Patent: June 16, 2020
    Assignee: ADOBE INC.
    Inventors: Amol Jindal, Vivek Mishra, Neha Sharan, Anmol Dhawan
  • Patent number: 10679424
    Abstract: Described herein are devices, systems, media, and methods using an augmented reality smartphone application to capture measurements of an interior or exterior space in real-time and generate a floorplan of the space and/or a 3D model of the space from the captured measurements in less than 5 minutes.
    Type: Grant
    Filed: April 17, 2019
    Date of Patent: June 9, 2020
    Assignee: SMART PICTURE TECHNOLOGIES, INC.
    Inventors: Dejan Jovanovic, Andrew Kevin Greff