Patents Examined by Frank Chen
  • Patent number: 10229469
    Abstract: Embodiments are provided to enable graphic processing unit (GPU) virtualization for high bandwidth or rate demanding applications, such as 3D gaming, where a client communicates with a host via a virtual desktop infrastructure (VDI). The distributed GPU virtualization allows one or more VMs or comparable hosts or components without GPU access to communicate with a GPU at a different component or physical machine in a data center or a network using remote direct memory access (RDMA). A first physical machine that excludes a GPU starts a remote display driver function to handle a request to render graphics from a client via gateway. A second physical machine that comprises a GPU is instructed to start a render function for the client using the GPU. The render function communicates with the remote display driver function at the first physical machine. The rendered graphics is then sent to the client via the gateway.
    Type: Grant
    Filed: July 26, 2016
    Date of Patent: March 12, 2019
    Assignee: Futurewei Technologies, Inc.
    Inventors: Pu Chen, Guangsong Xia
  • Patent number: 10139901
    Abstract: A method and apparatus for tracking distractions in a virtual reality environment is provided. In an embodiment, data identifying an area of interest is stored with a particular virtual reality application on a client computing device. The client computing device tracks a point of focus during execution of the application on the client computing device. In response to determining that the point of focus differs from the area of interest, the client computing device executes an application event.
    Type: Grant
    Filed: July 5, 2016
    Date of Patent: November 27, 2018
    Assignee: Immersv, Inc.
    Inventors: John Charles Gentilin, Mihir Shah, Andrew Raymond Buck, Jonathan Linsner
  • Patent number: 10140771
    Abstract: Provided is an information processing apparatus, including: an image-taking unit configured to take an image of real scenery to thereby obtain real image; a marker-detecting unit configured to extract a marker image from the real image, the marker image being an image of marker projection light, the marker projection light being projected by a projection device to the real scenery in order to provide spatial first information, the first information being necessary to display virtual information such that the virtual information is superimposed on the real scenery, second information being added to the marker projection light; and an extracting unit configured to extract the second information added to the extracted marker image.
    Type: Grant
    Filed: July 8, 2016
    Date of Patent: November 27, 2018
    Inventors: Tetsuro Goto, Masatoshi Ueno, Kenichi Kabasawa, Toshiyuki Nakagawa, Daisuke Kawakami, Shinobu Kuriya, Tsubasa Tsukahara, Hisako Sugano
  • Patent number: 10133854
    Abstract: In an example, a method includes receiving, at a computing device, information from a scanning electron microscope (SEM) device. The SEM device includes an energy-dispersive X-ray spectroscopy (EDS) detector, and the information including SEM/EDS data for multiple locations of a sample. The method also includes generating a compositional three-dimensional (3D) surface plot based on the SEM/EDS data. The compositional 3D surface plot includes quantitative atomic composition data for each location of the multiple locations of the sample.
    Type: Grant
    Filed: May 12, 2016
    Date of Patent: November 20, 2018
    Assignee: International Business Machines Corporation
    Inventors: Eric J. Campbell, Sarah K. Czaplewski
  • Patent number: 10127726
    Abstract: Disclosed herein is a control method of an electronic apparatus. The control method of an electronic apparatus includes: calculating an average speed of a vehicle when a specific event occurs; generating an object indicating a relationship between the calculated average speed and an event speed corresponding to the specific event; and outputting the generated object through augmented reality.
    Type: Grant
    Filed: December 1, 2015
    Date of Patent: November 13, 2018
    Inventor: Suk Pil Ko
  • Patent number: 10115229
    Abstract: A method for light transport includes steps of initializing a data structure that is configured to provide an importance value for each incident sample in a three-dimensional (3D) scene and tracing, in a direction from an origin, a ray of a plurality of rays through the 3D scene to intersect an object at a hitpoint. Additional steps include selecting a next direction of the ray according to a distribution of the importance values at the hitpoint, tracing the ray in the next direction to find a next hitpoint, updating a first importance value corresponding to the hitpoint using a second importance value corresponding to the next hitpoint, and setting the hitpoint of the ray to the next hitpoint. The additional steps are repeated until the next hitpoint is an endpoint. A contribution, based on each hitpoint and the endpoint, to a pixel that is intersected by the ray is recorded.
    Type: Grant
    Filed: July 12, 2017
    Date of Patent: October 30, 2018
    Inventors: Ken Patrik Dahm, Alexander Keller
  • Patent number: 10107767
    Abstract: A method, system, and apparatus for a vehicle inspection system comprising a mobile inspection device, a display system, a graphical user interface configured to be displayed on the display system, and a controller. The controller is configured to identify a position of the mobile inspection device within a vehicle and receives a user input comprising a group of gestures made by a human operator with respect to an item in a group of items in a field of view of the mobile inspection device based on the position of the mobile inspection device. The controller creates a note at a location with respect to the vehicle in association with the item in the field of view of the mobile inspection device in which the note is assigned to the location with respect to the vehicle and displays the note on the graphical user interface for the mobile inspection device.
    Type: Grant
    Filed: June 14, 2017
    Date of Patent: October 23, 2018
    Assignee: The Boeing Company
    Inventors: Brian D. Laughlin, Richard T. Moore, Steven Curtis Franzman, David R. Aguilar, Elizabeth Juhnke
  • Patent number: 10102821
    Abstract: An image processing device includes a first look-up table in which first gamma correction values corresponding to a white grayscale are recorded; a second look-up table in which second gamma correction values corresponding to red, green, and blue grayscales are recorded; and a data correcting unit that calculates second image data from received first image data based on a first gamma correction value and a second gamma correction value for the first image data, by referring to the first and second look-up tables.
    Type: Grant
    Filed: April 6, 2016
    Date of Patent: October 16, 2018
    Inventors: Hyun Min Cho, Jae Byung Park, Jae Woong Kang, Jong Hyuk Kang, Hyun Deok Im, Sung Jin Hong
  • Patent number: 10102673
    Abstract: Under an embodiment of the invention, an image capturing and processing system creates 3D image-based rendering (IBR) for real estate. The system provides image-based rendering of real property, the computer system including a user interface for visually presenting an image-based rendering of a real property to a user; and a processor to obtain two or more photorealistic viewpoints from ground truth image data capture locations; combine and process two or more instances of ground truth image data to create a plurality of synthesized viewpoints; and visually present a viewpoint in a virtual model of the real property on the user interface, the virtual model including photorealistic viewpoints and synthesized viewpoints.
    Type: Grant
    Filed: December 5, 2017
    Date of Patent: October 16, 2018
    Inventors: David Eraker, Aravind Kalaiah, Robert McGarty
  • Patent number: 10078916
    Abstract: The embodiments provide an augmented reality device for increasing human efficiency in navigating a distribution site and retrieving different customer order items from distinct locations within the distribution site. The augmented reality device uses at least one camera to scan reference points distributed across the distribution site. From the scanning, the device determines its position relative to a destination within the distribution site. The device layers over a real-world view, navigational information directing movement of a device user along a most efficient path to the destination. The camera further scans items falling within its field of view. The device performs feature matching in order to identify a particular item of interest within the field of view. The device layers over the real-world view, visual makers distinguishing the particular item from other items as well instructions or other identifying information relating to the particular item.
    Type: Grant
    Filed: July 1, 2016
    Date of Patent: September 18, 2018
    Assignee: inVia Robotics, Inc.
    Inventors: Lior Elazary, Randolph Charles Voorhies, Daniel Frank Parks, II
  • Patent number: 10074347
    Abstract: A curved display and a method for processing an image thereof are discussed. The curved display according to an embodiment includes a display panel selectively including a flat surface and a curved surface, and a controller including a signal processor for receiving image signal information from an external system, converting the image signal information into an image signal appropriate for the display panel, and distributing the image signal to the display panel, and a curved image generator for receiving the image signal and generating a curved image signal varied to correspond to a viewer's horopter surface corresponding to a curved surface when the display panel is a curved surface.
    Type: Grant
    Filed: September 10, 2015
    Date of Patent: September 11, 2018
    Assignee: LG DISPLAY CO., LTD.
    Inventors: Hyuck-Jun Kim, Sang-Ho Yu
  • Patent number: 10062197
    Abstract: A computer implemented method for use in animating parts of a virtual object in a virtual world, the method comprising obtaining joint data for each joint of a chain of joints associated with parts of a virtual object, joint data including length data defining a vector length for a vector from the joint to a next joint, the length data corresponding to a length of a part in the virtual world, the joint data for at least one joint including vector constraint data defining a rotational constraint for the vector; accessing data for a target curve defining target locations for the joints of the parts of the virtual object; and processing the joint data to rotate the vector for a joint towards a target location on the curve for a next joint in the chain; and if constraint data for the joint prevents the rotated vector from reaching the target location: set the vector angle for the joint at an angle dependent on the rotational constraint; and rotate an immediately preceding joint in the chain to move the vector for
    Type: Grant
    Filed: February 1, 2017
    Date of Patent: August 28, 2018
    Assignee: NaturalMotion Ltd.
    Inventors: Alberto Aguado, James Edward John Brewster
  • Patent number: 10055808
    Abstract: A technique for rendering database data in visualized form using a distributed computer system including a plurality of networked worker nodes each including a graphics processing unit (GPU) is disclosed. The technique includes receiving, at a head node, a user request to render data, forwarding the request to the worker nodes, processing, in parallel, by the worker nodes, chunks of respective shards of data to be rendered. The technique also includes merging, in parallel, by each of the worker nodes, initial images formed by the processing within respective shards, to form a plurality of integrated images, merging, in parallel, respective integrated images to form worker node images, and transmitting respective worker node images to the sink node. The technique also includes merging the worker node images to form a final image, converting the final image to an output image, and providing the output image to the user.
    Type: Grant
    Filed: January 23, 2018
    Date of Patent: August 21, 2018
    Assignee: Kinetica DB, Inc.
    Inventors: Amit Vij, Nima Negahban, Eli Glaser, Byungil Jeong
  • Patent number: 10055870
    Abstract: In a method for automatically supporting an operator in working through an execution sequence protocol with a number of sequence steps, with which a person under examination is being examined in a medical imaging facility, the execution sequence protocol to be carried out for the person under examination is determined, and image data are acquired that show a field of vision of at least a part of the environment of the medical imaging facility and the person under examination, as seen by the operator. A next sequence step of the execution sequence protocol is determined that is to be carried out by the operator. Visual information is created that will inform the operator about the operating step to be carried out, and the visual information is project at a viewing facility for displaying an augmented reality to the operator, in which the field of vision is presented augmented by the visual information.
    Type: Grant
    Filed: September 2, 2016
    Date of Patent: August 21, 2018
    Assignee: Siemens Healthcare GmbH
    Inventors: Thomas Benner, Andreas Potthast
  • Patent number: 10055811
    Abstract: A method for generating an interactive 2D projection of a 3D model includes steps of applying hierarchical defect data to the 3D model of a multi-part object, generating heatmap data based at least in part on the hierarchical defect data, and overlaying the heatmap data on the 3D model. The method also includes steps of extracting data corresponding to the 3D model and including the heatmap data after the overlaying step, and creating the interactive 2D projection based on the extracted data.
    Type: Grant
    Filed: May 12, 2016
    Date of Patent: August 21, 2018
    Assignee: Caterpillar Inc.
    Inventors: Jason Paul Clow, Bjorn Eric Westlund, Steven Daniel Cherewick
  • Patent number: 10043317
    Abstract: A method, computer program product, and a display device for enabling a user to virtually interact with an object includes a processor in the display device utilizing an image capture in the display device, to identify a subject in a three dimensional space proximate to the display device. The processor virtualizes the subject to generate a computer model of the subject and generating mappings between the computer model of the subject and the passive reflection of the subject. The processor obtains a computer model of an article and superimposes the models in three dimensional space by joining the models at selected reference point(s). The processor renders an image that includes the passive reflection of the subject visually superimposed with the computer model of the article, such that a movement by the subject, when obtained by the processors via the image capture device, is reflected in real-time in the image.
    Type: Grant
    Filed: November 18, 2016
    Date of Patent: August 7, 2018
    Assignee: International Business Machines Corporation
    Inventors: Eric V. Kline, Sarbajit K. Rakshit
  • Patent number: 10032306
    Abstract: A method and system for creating a transition between a first scene and a second scene on a computer system display, simulating motion. The method includes determining a transformation that maps the first scene into the second scene. Motion between the scenes is simulated by displaying transitional images that include a transitional scene based on a transitional object in the first scene and in the second scene. The rendering of the transitional object evolves according to specified transitional parameters as the transitional images are displayed. A viewer receives a sense of the connectedness of the scenes from the transitional images. Virtual tours of broad areas, such as cityscapes, can be created using inter-scene transitions among a complex network of pairs of scenes.
    Type: Grant
    Filed: December 15, 2015
    Date of Patent: July 24, 2018
    Assignee: EveryScape, Inc.
    Inventor: Byong Mok Oh
  • Patent number: 10002456
    Abstract: Aspects described herein may provide improved water surface approximation by correcting a polygonal mesh (such as a projected grid mesh) at pixel and/or sub-pixel levels through application of a novel ray-casting method based on a modified version of Newton's method for finding roots. The ray-casting method may refine an initial condition determined based on the polygonal mesh and may iteratively develop a more accurate approximation of the water surface as described further herein. This improved approximation method may be suitable for both low-end and high-end GPUs. Due to lower computational complexity, the method may be utilized by low-end GPUs to improve quality while maintaining performance. The method may also be further enhanced with more advanced features such as low-cost multisampling anti-aliasing on higher-end GPUs to provide superior visualization of water surfaces and take full advantage of the additional processing power of such systems.
    Type: Grant
    Filed: June 23, 2017
    Date of Patent: June 19, 2018
    Assignee: Limited
    Inventor: Yury Kryachko
  • Patent number: 9996980
    Abstract: The disclosure includes embodiments for providing a virtual feature to a vehicle including an augmented reality (“AR”) headset and an AR glove. A method according to some embodiments includes causing the AR headset to display the virtual object which includes a three-dimensional image of a control element operable to control the virtual feature. The method includes monitoring a motion of the AR glove relative to a space in a real-world that appears to the driver to be occupied by the three-dimensional image of the control element when the driver views the space through the AR headset. The method includes providing, using the AR glove, haptic feedback so that the driver feels the control element upon touching the space that appears to include the control element. The method includes providing the virtual feature in accordance with the motion of the AR glove relative to the control element.
    Type: Grant
    Filed: November 18, 2016
    Date of Patent: June 12, 2018
    Inventors: Nikos Arechiga Gonzalez, Siyuan Dai
  • Patent number: 9996969
    Abstract: A method, system, and computer program product provide the ability to dynamically generate a three-dimensional (3D) scene. A red green blue (RGB) image (in RGB color space) of the 3D scene is acquired. The RGB image is converted from RGB color space to a luminance (Y) and chrominance (UV) image in YUV color space (hat includes Y information and UV information). Reflectance information of the 3D scene is acquired from a laser scanner. Based on a blending function, the luminance information is blended with the reflectance information resulting in a blended YUV image. The blended YUV image is converted from YUV color space into RGB color space resulting in a blended RGB image that is output.
    Type: Grant
    Filed: September 27, 2016
    Date of Patent: June 12, 2018
    Assignee: Autodesk, Inc.
    Inventors: Nicolas Gros, Luc Franck Robert