Patents Examined by Jin-Cheng Wang
  • Patent number: 10269159
    Abstract: A head wearable device, a method, and a system. The head wearable device may include a display, a camera, a convolutional neural network (CNN) processor, and a processor. The CNN processor may be configured to: receive real scene image data from the camera; identify and classify objects in a real scene image; and generate object classification and position data. The processor may be configured to receive the real scene image data; receive the object classification and position data from the CNN processor; perform an image segmentation operation on the real scene image to fill in the objects; generate filled-in object data indicative of filled-in objects; generate a pixel mask; receive virtual scene image data; create mixed reality scene image data; and output the mixed reality scene image data to the display for presentation to a user.
    Type: Grant
    Filed: July 27, 2017
    Date of Patent: April 23, 2019
    Inventors: Peter R. Bellows, Danilo P. Groppa
  • Patent number: 10262463
    Abstract: The general field of the invention is that of the methods for graphically representing a first image from an image sensor of the outside landscape superimposed on a second image representing a synthetic image of the same outside landscape, the two images being displayed on a display screen of an onboard display system for aircraft. The first image comprises three rectangular zones of increasing transparency, each zone having a width equal to that of the first image and a determined height, the sum of the three heights being equal to the height of the first image, the first zone situated at the bottom of the image having a first constant level of transparency, the third zone situated at the top of the image having a second constant level of transparency greater than the first level of transparency, the second zone situated between the first zone and the third zone having a level of transparency that is continuously variable between the first level and the second level.
    Type: Grant
    Filed: December 23, 2016
    Date of Patent: April 16, 2019
    Assignee: THALES
    Inventors: Thierry Ganille, Johanna Lux, Baptiste Perrin, Daniel Maulet
  • Patent number: 10248196
    Abstract: The disclosure includes embodiments for providing occlusion adjustment for an in-vehicle augmented reality system. A system may include a three-dimensional heads-up display unit (“3D HUD”) installed in a vehicle. The system may include a memory storing instructions that, when executed, cause the system to: display, on the 3D HUD, a first graphic that is viewable by a driver of the vehicle as overlaying the interested object when the driver is looking at the 3D HUD; determine that at least a portion of the interested object is occluded by an occluding object; turn off the first graphic so that the first graphic is not displayed on the 3D HUD; and display, on the 3D HUD, a second graphic that does not overlay the occluding object and visually indicates to the driver the location of the interested object behind the occluding object when the driver is looking at the 3D HUD.
    Type: Grant
    Filed: August 23, 2016
    Date of Patent: April 2, 2019
    Inventors: Emrah Akin Sisbot, Kentaro Oguchi
  • Patent number: 10237536
    Abstract: A non-limiting example game system includes a game apparatus, and a terminal device and a television are connected to the game apparatus. A game image that is displayed on the television is an image that various kinds of objects arranged in a virtual space are imaged by a virtual camera. The virtual camera follows a player object so as to keep a predetermined distance with the player object, and when the player object enters a grassland object with comparatively long length, for example, each grass object is deformed or moved so as to go away from the virtual camera. For example, a height of the grass object near the virtual camera is made comparatively low, and the height is gradually made high as it separates from the virtual camera.
    Type: Grant
    Filed: April 3, 2017
    Date of Patent: March 19, 2019
    Assignee: NINTENDO CO., LTD.
    Inventor: Atsushi Asakura
  • Patent number: 10236971
    Abstract: To provide a technique capable of reducing the transmission delay of an image, a communication apparatus wirelessly communicable with another communication apparatus, receives a compressed captured image from the other communication apparatus; decompresses the compressed captured image to obtain a decompressed captured image; generates, based on the decompressed captured image, a CG image to be superimposed and displayed on the captured image; and compresses the CG image to generate a compressed CG image; transmits the compressed CG image to the other communication apparatus. Then, the communication apparatus derives a delay time based on a transmission time of the compressed captured image in the other communication apparatus and a generation completion time of the CG image; and changes a compression ratio of the CG image based on whether the delay time is longer than a predetermined threshold.
    Type: Grant
    Filed: June 3, 2016
    Date of Patent: March 19, 2019
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Yutaka Ui, Hiroichi Yamaguchi, Kazuki Takemoto
  • Patent number: 10228242
    Abstract: A waveguide apparatus includes a planar waveguide and at least one optical diffraction element (DOE) that provides a plurality of optical paths between an exterior and interior of the planar waveguide. A phase profile of the DOE may combine a linear diffraction grating with a circular lens, to shape a wave front and produce beams with desired focus. Waveguide apparati may be assembled to create multiple focal planes. The DOE may have a low diffraction efficiency, and planar waveguides may be transparent when viewed normally, allowing passage of light from an ambient environment (e.g., real world) useful in AR systems. Light may be returned for temporally sequentially passes through the planar waveguide. The DOE(s) may be fixed or may have dynamically adjustable characteristics. An optical coupler system may couple images to the waveguide apparatus from a projector, for instance a biaxially scanning cantilevered optical fiber tip.
    Type: Grant
    Filed: May 5, 2015
    Date of Patent: March 12, 2019
    Assignee: Magic Leap, Inc.
    Inventors: Rony Abovitz, Brian T. Schowengerdt, Mathew D. Watson
  • Patent number: 10217255
    Abstract: Embodiments automatically create an axis break in a bar chart or waterfall chart to promote data visualization. For a bar chart with positive bars, a maximum axis break point is determined relative to a lowest datapoint (D1) in the selected bar(s). A minimum axis break point is found from a value (D2) outside selection which is between D1 and zero, and which is closest to D1. The inclusion of padding on either side of a break prevents the break from lying at zero or a bar end. A different procedure creates axis breaks in a waterfall chart. Certain embodiments store only bar selection metadata with a chart. The location of the axis break then is recalculated each time the chart is rendered (e.g., with updated data). Embodiments may retain axis break data for reference in various stages of a user interaction (e.g., filtering/expanding, drilling-down/up, etc.) with a rendered chart.
    Type: Grant
    Filed: June 14, 2016
    Date of Patent: February 26, 2019
    Assignee: SAP SE
    Inventors: Geoffrey Neil Peters, Vincent Teng, Navjot Singh, Brandon Pun, Christina Obry
  • Patent number: 10204453
    Abstract: An aviation mask is disclosed which includes an augmented reality visor, sensors, and a display computational unit. The sensors are communicatively connected to the augmented reality visor. The sensors detect a portion of a cockpit area of an aircraft that is viewed by an aircraft crew member wearing the augmented reality visor during a vision obscured emergency. The display computational unit is communicatively connected to the augmented reality visor and the sensors. The display computational unit projects a prestored image associated with the portion of the cockpit area in front of the augmented reality visor. Further, the display computational unit superimposes the prestored image over the portion of the cockpit area viewed by the aircraft crew member. The superimposed prestored image being viewed by the aircraft crew member through the augmented reality visor to identify objects in the portion of the cockpit area during the vision obscured emergency.
    Type: Grant
    Filed: August 23, 2016
    Date of Patent: February 12, 2019
    Assignee: AIRBUS GROUP INDIA PRIVATE LIMITED
    Inventor: Anurag Sharma
  • Patent number: 10181212
    Abstract: A virtual reality ride system including a headset, a control unit, and a dynamic platform. The headset includes a display unit configured to display a video of an animated virtual environment. The control unit includes one or more processors configured to perform render processing that renders the video of the virtual environment; event motion processing that generates first data representing motions associated with events in the virtual environment; and low-frequency motion processing that generates second data representing low-frequency vibrations unrelated to the events in the virtual environment. The dynamic platform is configured to produce the motions associated with the events in the virtual environment based on the first data, and to produce the low-frequency vibrations based on the second data. The low-frequency vibrations include a frequency between about 5 Hz and 70 Hz.
    Type: Grant
    Filed: May 5, 2015
    Date of Patent: January 15, 2019
    Assignee: DreamWorks Animation L.L.C.
    Inventors: Brad Kenneth Herman, Shiraz Akmal, Bryn Lafollette
  • Patent number: 10175483
    Abstract: A system and method are disclosed for displaying virtual objects in a mixed reality environment in a way that is optimal and most comfortable for a user to interact with the virtual objects. When a user is not focused on the virtual object, which may be a heads-up display, or HUD, the HUD may remain body locked to the user. As such, the user may explore and interact with a mixed reality environment presented by the head mounted display device without interference from the HUD. When a user wishes to view and/or interact with the HUD, the user may look at the HUD. At this point, the HUD may change from a body locked virtual object to a world locked virtual object. The user is then able to view and interact with the HUD from different positions and perspectives of the HUD.
    Type: Grant
    Filed: June 18, 2013
    Date of Patent: January 8, 2019
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Tom G. Salter, Ben J. Sugden, Daniel Deptford, Robert L. Crocco, Jr., Brian E. Keane, Laura K. Massey, Alex Aben-Athar Kipman, Peter Tobias Kinnebrew, Nicholas Ferianc Kamuda
  • Patent number: 10176784
    Abstract: A multi-mode display device may, responsive to a user-selection, divide a display region into different regions corresponding to display data received from different user devices, such as a primary information handling system and a secondary portable information handling system. First display data received from the primary information handling system may be output to a first display region and second display data received from the secondary portable information handling system maybe output to a second display region.
    Type: Grant
    Filed: March 27, 2014
    Date of Patent: January 8, 2019
    Assignee: Dell Products L.P.
    Inventors: Aik Keong Ong, Boon Kiat Law
  • Patent number: 10169924
    Abstract: The AUGMENTED REALITY VIRTUAL CONTENT PLATFORM APPARATUSES, METHODS AND SYSTEMS (“ARV”) provides a photo driven ad-platform that transforms digital media placements into immersive and immediately shareable brand-consumer engagements via GPS-linked virtual photo components instantiated on a user mobile device. Within embodiments, users may create and share photographs augmented with brands or other images and accompanying messages on various social networks using their Smartphones or tablets to earn rewards. In one implementation, merchants and/or advertisers may populate the mobile augmented reality space as fans and consumers may share their photos on social networks and spread the word virally.
    Type: Grant
    Filed: September 7, 2017
    Date of Patent: January 1, 2019
    Assignee: SNAPS MEDIA INC.
    Inventors: Vivian Rosenthal, Steven Austin Bone, Dmitry Rakovitsky
  • Patent number: 10157594
    Abstract: A layered content display system includes a networking device coupled to a network, a source device configured to display first content information on a source device screen, a display device, and a sink device coupled to the networking device, the source device, and the display device. The sink device receives an identification of the first content information from the source device. The sink device then retrieves a first subset of the first content information from the source device, and a second subset of the first content information from the network through the networking device. The sink device then provides the second subset of the first content information layered with the first subset of the first content information for display on the display device such that the first content information displayed on the display device is substantially similar to the first content information displayed on the source device screen.
    Type: Grant
    Filed: August 23, 2016
    Date of Patent: December 18, 2018
    Assignee: Dell Products L.P.
    Inventors: Joseph Paul Marquardt, Sean Patrick O'Neal
  • Patent number: 10137374
    Abstract: A method comprising: detecting a position of a portable device, the portable device including a camera that captures a real-world scene, and identifying an anchor within the real-world scene; generating an augmented reality scene formed by inserting a virtual character into the real-world scene, the virtual character configured to perform an action indicating awareness of the position or activity of the portable device; displaying the augmented reality scene on a display; wherein the action indicating awareness comprises adjusting a view direction, in the augmented reality scene, of the virtual character towards the portable device, and wherein the adjustment of the view direction of the virtual character changes a relationship of the view direction to the anchor, wherein the adjustment of the view direction of the virtual character includes adjustment of a head of the virtual character so as to look in the direction of the portable device.
    Type: Grant
    Filed: February 27, 2018
    Date of Patent: November 27, 2018
    Assignee: Sony Interactive Entertainment America LLC
    Inventors: Thomas Miller, George Weising
  • Patent number: 10134118
    Abstract: An information processing apparatus includes an acquisition unit configured to acquire information about a projection surface on which a projection unit projects a target image, a storage unit configured to store first information indicating a first position, on the projection surface, of the target image projected on the projection surface by the projection unit in a first projection state, and a control unit configured to control a position, on the projection surface, of the target image to move from a second position on the projection surface where the target image is projected by the projection unit in a second projection state to the first position on the projection surface.
    Type: Grant
    Filed: September 19, 2014
    Date of Patent: November 20, 2018
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Asuka Wada
  • Patent number: 10114875
    Abstract: A system (and corresponding methodology) by which a user can interact directly with visual data is provided. The system employs associations and relationships between visual data objects to automatically update objects based upon a change in other objects. The innovation also provides specialized controls (e.g., dashboard tools/controls) that facilitate manipulation of visual data. As there can be numerous manners in which a user can interact with visualization data, the innovation enables a specialized set of controls to be identified and provided to a user thereby reducing overwhelming effects of a large number of controls.
    Type: Grant
    Filed: June 27, 2008
    Date of Patent: October 30, 2018
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Gur Kimchi, Danyel Aharon Fisher, Brian L. Welcker, Jason J. Weber, Ahmed K. Kamal, Benjamin Edward Rampson, William Guthrie Morein, Morten Holm-Peterson, Bongshin Lee, George G. Robertson, Christian Bernd Schormann, Barry James Givens, Joshua W. Lee, B. Scott Ruble, Jakob Peter Nielsen, Michael V. Ehrenberg, Stella Yick Chan, Murali Krishnan, Christian Olaf Abeln, Roland L. Fernandez
  • Patent number: 10074161
    Abstract: Embodiments of the present disclosure relate to a sky editing system and related processes for sky editing. The sky editing system includes a composition detector to determine the composition of a target image. A sky search engine in the sky editing system is configured to find a reference image with similar composition with the target image. Subsequently, a sky editor replaces content of the sky in the target image with content of the sky in the reference image. As such, the sky editing system transforms the target image into a new image with a preferred sky background.
    Type: Grant
    Filed: April 8, 2016
    Date of Patent: September 11, 2018
    Assignee: ADOBE SYSTEMS INCORPORATED
    Inventors: Xiaohui Shen, Yi-Hsuan Tsai, Kalyan K. Sunkavalli, Zhe Lin
  • Patent number: 10062210
    Abstract: Methods, systems, computer-readable media, and apparatuses for radiance transfer sampling for augmented reality are presented. In some embodiments, a method includes receiving at least one video frame of an environment. The method further includes generating a surface reconstruction of the environment. The method additionally includes projecting a plurality of rays within the surface reconstruction of the environment. Upon projecting a plurality of rays within the surface reconstruction of the environment, the method includes generating illumination data of the environment from the at least one video frame. The method also includes determining a subset of rays from the plurality of rays in the environment based on areas within the environment needing refinement. The method further includes rendering the virtual object over the video frames based on the plurality of rays excluding the subset of rays.
    Type: Grant
    Filed: February 25, 2014
    Date of Patent: August 28, 2018
    Assignee: QUALCOMM Incorporated
    Inventors: Lukas Gruber, Jr., Dieter Schmalstieg
  • Patent number: 10055868
    Abstract: A vector based mosaic design system has a graphical processing module, a display module, a plugin application module and memory, and it operates to receive an original input image and mosaic design information from an artist. The plugin module has logical instructions that operate on the information received from the artist to determine the position of curves that are offset from a mosaic design region boundary or feature curve, and the plugin also operates to determine the positions and dimensions of tiles in courses that are defined by the positions of feature curves and curves that are offset from them.
    Type: Grant
    Filed: June 16, 2016
    Date of Patent: August 21, 2018
    Assignee: Artaic, LLC
    Inventors: George Wolberg, Siavash Zokai, Edward Acworth, Michael Trachtman
  • Patent number: 10049645
    Abstract: The present invention relates to a control device (10) and method for controlling a display that reliably and efficiently enhances a person's compliance, e.g., a patient's compliance with his care plan. The control device comprises a presentation style selector (14) for selecting a presentation style to be used for visually presenting the received information on the display in text form, wherein the presentation style is selected based on an importance indicator indicating the importance of the information with respect to a task or plan of the person and obtained boundary conditions for the presentation style to be selected for presenting the information in text form such that more important information is displayed using a presentation style that is more difficult to read than a presentation style used for displaying less important information. A controller (15) controls the display (20) to visually present the received information on the display in text form using the selected presentation style.
    Type: Grant
    Filed: December 12, 2014
    Date of Patent: August 14, 2018
    Assignee: Koninklijke Philips N.V.
    Inventors: Melanie Jane Windridge, Julian Charles Nolan, Joyca Petra Wilma Lacroix, Joris Hendrik Janssen