Augmented Reality (real-time) Patents (Class 345/633)
  • Patent number: 9898872
    Abstract: Techniques for displaying an augmented reality environment. Embodiments capture a visual scene for display. An embedded symbol associated with a garment worn by the first user within the visual scene is identified. Embodiments generate a virtual augmentation corresponding to the first user that is animated based on the captured visual scene. The virtual augmentation alters an appearance of the first user, such that the first user is depicted as wearing a virtual costume, the virtual costume determined to have a predefined relationship with the identified embedded symbol. A sequence of frames is rendered that depicts the first user augmented with the virtual augmentation in the augmented reality environment and depict at least a portion of the first user as wearing the virtual costume.
    Type: Grant
    Filed: March 6, 2017
    Date of Patent: February 20, 2018
    Assignee: Disney Enterprises, Inc.
    Inventor: Kenneth Mitchell
  • Patent number: 9898868
    Abstract: A head mounted display device includes an image display portion that transmits external scenery and displays an image so as to be capable of being visually recognized together with the external scenery. In addition, the head mounted display device includes a control unit that acquires an external scenery image including the external scenery which is visually recognized through the image display portion, recognizes an object which is visually recognized through the image display portion on the basis of the acquired external scenery image, and displays information regarding the object on the image display portion.
    Type: Grant
    Filed: October 15, 2015
    Date of Patent: February 20, 2018
    Assignee: SEIKO EPSON CORPORATION
    Inventors: Masashi Aonuma, Masahide Takano, Kiichi Hirano
  • Patent number: 9897808
    Abstract: A smart glass may include a glass having a transparent display function, a first camera obtaining a front image, a second camera obtaining an image of a user's eyes, and a controller which analyzes the front image and the image of the user's eyes, determines a specific object selected by the user's gaze from a plurality of objects included in the front image based on the result of an analysis, obtains information about the specific object, and displays the information about the specific object on a transparent display area of the glass. The smart glass may provide information about the specific object selected by the user's gaze, and/or may execute a specific function corresponding to user's eye gesture.
    Type: Grant
    Filed: July 1, 2014
    Date of Patent: February 20, 2018
    Assignee: LG ELECTRONICS INC.
    Inventor: Daewon Yoo
  • Patent number: 9891705
    Abstract: A system and method for automatic boresighting of a head-tracking system for a HWD or HUD accesses georeferenced pose (position/orientation) data of an aircraft or other mobile platform from a georeferenced head-tracker and platform-referenced head pose data (based on fiducial markers within the aircraft cockpit) from the inertial measurement units of an optical, magnetic, or optical/magnetic platform-referenced head tracker (PRHT) and determines misalignments of the PRHT relative to the boresighted inertial reference system (IRS) of the aircraft. Based on the determined misalignments and accessed data, the IMUs of the PRHT may be updated and aligned with the aircraft boresight. Misalignments of head-mounted fiducial markers with the boresighted IRS may be determined for updating the alignment of an optical head-tracker fixed relative to the aircraft cockpit.
    Type: Grant
    Filed: August 25, 2016
    Date of Patent: February 13, 2018
    Assignee: Rockwell Collins, Inc.
    Inventors: Weston J. Lahr, William T. Kirchner, David I. Han
  • Patent number: 9881420
    Abstract: An augmented reality display system comprises a passable world model data comprises a set of map points corresponding to one or more objects of the real world. The augmented reality system also comprises a processor to communicate with one or more individual augmented reality display systems to pass a portion of the passable world model data to the one or more individual augmented reality display systems, wherein the piece of the passable world model data is passed based at least in part on respective locations corresponding to the one or more individual augmented reality display systems.
    Type: Grant
    Filed: May 7, 2015
    Date of Patent: January 30, 2018
    Assignee: MAGIC LEAP, INC.
    Inventor: Samuel A. Miller
  • Patent number: 9883110
    Abstract: The present invention relates to a camera enabled mobile device and method of toggling between an augmented reality image viewing mode and a rendered image viewing mode based, in part, on viewability of an augmented reality target (visible or invisible—markerless) proximate the camera enabled mobile device. The method comprising steps of positioning at least one of an augmented reality target in a physical location, aiming the camera at the augmented reality target, initiating, once, an immersive user software experience, determining which of the augmented reality appliance images and the rendered appliance images are associated with the augmented reality target, then toggling between the augmented reality image viewing mode when the augmented reality target is viewable by the camera else entering the rendered image viewing mode.
    Type: Grant
    Filed: May 6, 2016
    Date of Patent: January 30, 2018
    Assignee: CNZ, Inc.
    Inventors: Margaret A. Martin, Alex S. Hill, Harrison D. Leach
  • Patent number: 9875598
    Abstract: Disclosed is a method and system involving augmenting content. The system includes context-sensitive augmenting options that are conveniently presented to a player. Promotion of time sensitive propositions is presented to both simplify the content augmenting experience and provide a better targeted experience.
    Type: Grant
    Filed: May 8, 2017
    Date of Patent: January 23, 2018
    Assignee: Bally Gaming, Inc.
    Inventors: Martin S. Lyons, Bryan M. Kelly
  • Patent number: 9870050
    Abstract: Disclosed are an interactive projection display method and an interactive projection display system. The method comprises: obtaining to-be-displayed location information corresponding to a coordination device; obtaining display information corres-ponding to the coordination device; generating, according to the display information, virtual display content corresponding to the coordination device; and projecting the virtual display content to a location corresponding to the to-be-displayed location information at a fundus of a user. According to the method and the system, virtual display content, used to interact with a user, of a coordination device is projected near the coordination device, to cause interaction between the user and the coordination device to be more convenient.
    Type: Grant
    Filed: October 9, 2014
    Date of Patent: January 16, 2018
    Assignee: BEIJING ZHIGU RUI TUO TECH CO., LTD
    Inventor: Lin Du
  • Patent number: 9865093
    Abstract: A first display device determines a first device configuration of the first display device and a first context of a first AR application operating on the first display device. The first display device connects to a second display device and determines a second device configuration of the second display device and a second context of a second AR application operating on the second display device. The first display device generates a first collaboration configuration for the display device and a second collaboration configuration for the second display device. The first and second collaborations are based on the first device configuration, the first context, the second device configuration, and the second context. The second display device modifies an operation of the second AR application based on the second collaboration configuration. The first display device modifies an operation of the first AR application based on the first collaboration configuration.
    Type: Grant
    Filed: June 30, 2016
    Date of Patent: January 9, 2018
    Assignee: DAQRI, LLC
    Inventor: Brian Mullins
  • Patent number: 9866826
    Abstract: A multi-focal display represents a 3-dimensional scene by a series of 2-dimensional images located at different focal planes. The locations of the focal planes are selected based on an analysis of the three-dimensional scene to be rendered by the multi-focal display.
    Type: Grant
    Filed: March 9, 2015
    Date of Patent: January 9, 2018
    Assignee: Ricoh Company, Ltd.
    Inventors: Wanmin Wu, Patrick Llull, Ivana Tosic, Kathrin Berkner, Noah Bedard
  • Patent number: 9858637
    Abstract: Systems, methods, and computer programs are disclosed for reducing motion-to-photon latency and memory bandwidth in a virtual reality display system. An exemplary method involves receiving sensor data from one or more sensors tracking translational and rotational motion of a user for a virtual reality application. An updated position of the user is computed based on the received sensor data. The speed and acceleration of the user movement may be computed based on the sensor data. The updated position, the speed, and the acceleration may be provided to a warp engine configured to update a rendered image before sending to a virtual reality display based on one or more of the updated position, the speed, and the acceleration.
    Type: Grant
    Filed: August 31, 2016
    Date of Patent: January 2, 2018
    Assignee: QUALCOMM Incorporated
    Inventors: Nhon Quach, Moinul Khan, Maurice Ribble, Martin Renschler, Mehrad Tavakoli, Rashmi Kulkarni, Ricky Wai Kit Yuen, Todd Lemoine
  • Patent number: 9855664
    Abstract: In a robot safety system, a safety controller specifies a robot that a worker is looking at based on position of worker and/or visual field of worker, and acquires distance between robot and worker based on position information. Safety controller generates a fence image of which display mode is changed depending on distance to robot, which is a virtual image showing a boundary position of an operating range of robot, based on acquired distance. Generated fence image is displayed on a glasses type display device that the working is wearing such that fence image overlaps visual field of worker. In another example of the robot safety system, a virtual fence may be displayed on a head mount type display device as a fence image, and display mode of fence image may be optimized such that work efficiency of worker is affected as little as possible.
    Type: Grant
    Filed: November 22, 2016
    Date of Patent: January 2, 2018
    Assignee: DENSO WAVE INCORPORATED
    Inventors: Tomoya Yamamoto, Daisuke Kawase, Toshifumi Enomoto, Masakazu Utsunomiya
  • Patent number: 9858643
    Abstract: An image generating device includes: a storage section that stores images of surrounding spaces centered at plural different fixed points; a detecting section that detects translational movement on the basis of the location of the point of view; an image processor that acquires an image of a displaying target by clipping out part of the image of the surrounding space centered at the fixed point, stored in the storage section, on the basis of the location of the point of view and the direction of the line of sight; and a switching section that makes switching to the image of the surrounding space centered at another fixed point closest to the point of view after translational movement if the plural different fixed points are so disposed that the surrounding spaces centered at the fixed points overlap with each other in a world coordinate system and translational movement is detected.
    Type: Grant
    Filed: July 30, 2015
    Date of Patent: January 2, 2018
    Assignee: SONY INTERACTIVE ENTERTAINMENT INC.
    Inventors: Yoichi Nishimaki, Takeshi Yamagishi, Shinichi Hirata, Kyoko Furumura
  • Patent number: 9860661
    Abstract: A method and an apparatus are provided for providing additional information service in a mobile communication terminal. A microphone receives a sound signal including an audible frequency band and an inaudible frequency band. Additional information related to the service is detected in the inaudible frequency band included in the sound signal. The detected additional information is extracted from the sound signal. Data for providing the service is acquired based on the extracted additional information. A service screen is displayed based on the acquired data.
    Type: Grant
    Filed: February 22, 2016
    Date of Patent: January 2, 2018
    Assignee: Samsung Electronics Co., Ltd
    Inventors: Hee-Won Jung, Jun-Ho Koh, Dong-Wook Kwon
  • Patent number: 9857867
    Abstract: A transparent display apparatus is provided. The transparent display apparatus includes a transparent display which displays information, a sensor which senses background information in a first direction, and a controller configured to modify a display state of the displayed information on the transparent display based on the sensed background information.
    Type: Grant
    Filed: January 22, 2014
    Date of Patent: January 2, 2018
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Nipun Kumar, Joon-kyu Seo, Yeo-jun Yoon, Young-joon Choi
  • Patent number: 9852550
    Abstract: A method is provided for markerless injection of content into an augmented reality scene by use of a mobile device. Through the mobile device, a camera feed of a scene is acquired, which includes a flat surface. A key frame of the flat surface is selected from the feed. After determining that the flat surface in the key frame meets a predetermined level of feature richness, digital content is injected by superimposing text, graphics, video content over at least a part of the key frame. The digital content can be viewed and interacted with by the user of the mobile device. In one embodiment, the digital content is an advertisement.
    Type: Grant
    Filed: August 4, 2016
    Date of Patent: December 26, 2017
    Assignee: Civic Resource Group International Inc.
    Inventors: Yousuf Chowdhary, Kevin Garland, Steven Blumenfeld
  • Patent number: 9852381
    Abstract: An approach is provided for behavioral pattern generation for mixed reality objects. A mixed reality platform determines one or more computation closures for describing one or more user behavioral patterns associated with one or more digital objects of at least one augmented reality information space. The mixed reality platform then processes and/or facilitates a processing of one or more interactions with the one or more digital objects, one or more augmented reality applications associated with the at least one augmented reality information space, or a combination thereof to cause, at least in part, a determination of (a) the one or more user behavioral patterns from the one or more interactions, (b) the data acted on by the one or more computation closures, or (c) a combination thereof.
    Type: Grant
    Filed: December 20, 2012
    Date of Patent: December 26, 2017
    Assignee: Nokia Technologies Oy
    Inventors: Sergey Boldyrev, Jari-Jukka Harald Kaaja, Mikko Aleksi Uusitalo, Ian Justin Oliver, Vesa-Veikko Luukkala
  • Patent number: 9848171
    Abstract: An electronic device displays an image during a communication between two people. The image represents one of the people to the communication. The electronic device determines a location where to place the image and displays the image such that the image appears to exist at the location.
    Type: Grant
    Filed: June 24, 2017
    Date of Patent: December 19, 2017
    Inventor: Philip Scott Lyren
  • Patent number: 9846966
    Abstract: An image processing device includes: an augmented-reality marker detecting unit that detects, from a captured image, an augmented reality marker indicating that a virtual object is to be displayed; an operation-marker detecting unit that detects, from the captured image, an area of an operation marker that is provided so as to correspond to the augmented reality marker; an operation detecting unit that detects, from the area of the operation marker, a user's operation on the operation marker; a virtual-object control unit that deforms a virtual object corresponding to the augmented reality marker in accordance with the user's operation; and a drawing unit that draws the deformed virtual object in the captured image in a superimposed manner.
    Type: Grant
    Filed: February 2, 2015
    Date of Patent: December 19, 2017
    Assignee: RICOH COMPANY, LTD.
    Inventor: Tamon Sadasue
  • Patent number: 9846968
    Abstract: A system and method are disclosed for capturing views of a mixed reality environment from various perspectives which can be displayed on a monitor. The system includes one or more physical cameras at user-defined positions within the mixed reality environment. The system renders virtual objects in the mixed reality environment from the perspective of the one or more cameras. Real and virtual objects from the mixed reality environment may then be displayed from the perspective of the one or more cameras on one or more external, 2D monitor for viewing by others.
    Type: Grant
    Filed: June 2, 2015
    Date of Patent: December 19, 2017
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Arthur Charles Tomlin, Evan Michael Keibler, Nicholas Gervase Fajt, Brian J. Mount, Gregory Lowell Alt, Jorge Tosar, Jonathan Michael Lyons, Anthony J. Ambrus, Cameron Quinn Egbert, Will Guyman, Jeff W. McGlynn, Jeremy Hance, Roger Sebastian-Kevin Sylvan, Alexander Georg Pfaffe, Dan Kroymann, Erik Andrew Saltwell, Chris Word
  • Patent number: 9836888
    Abstract: Augmented reality systems and methods are disclosed which provide for representing imperceptible aspects of telecommunications networks as visual, auditory, tactile, or audiovisual stimuli. In some embodiments, the representation is a type of augmented reality from the perspective of a user on the ground, such as a technician deployed in the field.
    Type: Grant
    Filed: February 17, 2017
    Date of Patent: December 5, 2017
    Assignee: EDX Technologies, Inc.
    Inventor: Roger Ray Skidmore
  • Patent number: 9836263
    Abstract: Aspects of the present invention include a display control device comprising a determining unit configured to determine an orientation of a real object in a real space image. The device may also comprise a control unit configured to select between first and second orientations of a virtual object based on the real object orientation, one of the first or second virtual object orientations aligning the virtual object with the orientation of the real object, and output an image of the virtual object based on the selected orientation, for display on an associated display device.
    Type: Grant
    Filed: March 30, 2012
    Date of Patent: December 5, 2017
    Assignee: Sony Corporation
    Inventor: Shunichi Kasahara
  • Patent number: 9836652
    Abstract: A mechanism is provided for indicating an area of an object that is considered dangerous to a user via a head mounted display (HMD) system. The object being used by the user and one or more areas of the object that are considered dangerous are identified. Responsive to identifying one or more areas of the object that are considered dangerous, an overlay for each of the one or more areas of the object that are considered dangerous is generated. The overlay for each one or more areas of the object that are considered dangerous is displayed via a display layer of the HMD system so that the one or more areas of the object that are considered dangerous are identified as an overlay to the object that is being seen by the user through the HMD system.
    Type: Grant
    Filed: February 2, 2016
    Date of Patent: December 5, 2017
    Assignee: International Business Machines Corporation
    Inventors: David B. Lection, Sarbajit K. Rakshit, Mark B. Stevens, John D. Wilson
  • Patent number: 9837121
    Abstract: There is provided an information processing device including a data processing section configured to perform processing of playing back content according to a feature image, based on detection of the feature image from a captured image acquired by a capturing of an imaging section, and a specifying section configured to specify a resume point, which is a position of playing back the content, according to a timing at which the detection of the feature image is impossible. The data processing section performs the playback of the content from a position corresponding to the resume point, according to re-detection of the feature image after the detection of the feature image becomes impossible.
    Type: Grant
    Filed: April 24, 2013
    Date of Patent: December 5, 2017
    Assignee: SONY CORPORATION
    Inventor: Yuya Hanai
  • Patent number: 9836875
    Abstract: A user device uses sensors to determine the rotation of the user device with respect to a reference orientation. Using the user device rotation, an image manipulation module accesses images that are associated with image rotations. A set of the images are selected based on the device rotation to select images that have image orientations corresponding to the device rotation. A weight may be determined for each selected image, and the images are combined to generate a blended image using the weights. The blended image is displayed to the user, and as the rotation of the user devices changes, the process is repeated to display changing blended images based on the device rotation, thereby animating the rotation effect.
    Type: Grant
    Filed: January 10, 2014
    Date of Patent: December 5, 2017
    Assignee: FLIPBOARD, INC.
    Inventor: Charles Ying
  • Patent number: 9827495
    Abstract: First control means of a simulation device simulates motions of a plurality of virtual players that are placed in a virtual world and other than an operation target of a user. Determining means determines whether a situation of a game being simulated in the virtual world is similar to a situation indicated in data. In a case where it is determined that the situation of the game in the virtual world is similar to the situation indicated in the data, second control means controls, in place of the first control means, the virtual players other than the operation target of the user based on a motion associated with the situation.
    Type: Grant
    Filed: June 23, 2014
    Date of Patent: November 28, 2017
    Assignee: KONAMI DIGITAL ENTERTAINMENT CO., LTD.
    Inventors: Iskander Umarov, Eiji Suzuki
  • Patent number: 9824501
    Abstract: Interference-based augmented reality hosting platforms are presented. Hosting platforms can include networking nodes capable of analyzing a digital representation of scene to derive interference among elements of the scene. The hosting platform utilizes the interference to adjust the presence of augmented reality objects within an augmented reality experience. Elements of a scene can constructively interfere, enhancing presence of augmented reality objects; or destructively interfere, suppressing presence of augmented reality objects.
    Type: Grant
    Filed: July 18, 2016
    Date of Patent: November 21, 2017
    Assignee: Nant Holdings IP, LLC
    Inventor: Patrick Soon-Shiong
  • Patent number: 9824437
    Abstract: A server receives datasets from mobile devices. Each dataset identifies a task selected in an augmented reality application of a corresponding mobile device and an identification of a tool detected at the corresponding mobile device. The server identifies tools present and absent at a dedicated tool board and compares an identification of the tools present and absent at the dedicated tool board with the tools detected at the mobile devices and the tasks identified at the mobile devices to generate a tool inventory and a tool compliance. The server generates an augmented reality content dataset for each mobile device to identify at least one of a missing tool, an incorrect tool, and a valid tool based on the tool compliance.
    Type: Grant
    Filed: December 11, 2015
    Date of Patent: November 21, 2017
    Assignee: DAQRI, LLC
    Inventor: Brian Mullins
  • Patent number: 9821920
    Abstract: A head mounted virtual reality (VR) device including an inertial measurement unit (IMU) is located in a vehicle which may be, and sometimes is, moving. Detected motion attributable to vehicle motion is filtered out based on one or more or all of: vehicle type information, information derived from sensors located in the vehicle external to the head mounted VR device, and/or captured images including a reference point or reference object within the vehicle. An image portion of a simulated VR environment is selected and presented to the user of the head mounted VR device based on the filtered motion information. Thus, the image portion presented to the user of the head mounted VR device is substantially unaffected by vehicle motion and corresponds to user induced head motion.
    Type: Grant
    Filed: August 18, 2015
    Date of Patent: November 21, 2017
    Assignee: NextVR Inc.
    Inventors: David Cole, Alan McKay Moss
  • Patent number: 9824490
    Abstract: In one embodiment, an augmented view is generated that accounts for dynamically changing terrain surface at a site. A sensor captures live georeferenced terrain surface topography for the site. A camera captures an image of the site. Further, a tracking system determines a georeferenced camera pose of the camera. An augmented reality application aligns a georeferenced three-dimensional (3-D) model for the site with the live georeferenced terrain surface topography. Then, using at least the captured image, the georeferenced camera pose, the georeferenced 3-D model and live georeferenced terrain surface topography, the augmented reality application creates an augmented view of the site that shows graphical representations of subsurface features. At least a portion of the graphical representations are dynamically conformed to the contours of the terrain surface in the image based on the live georeferenced terrain surface topography.
    Type: Grant
    Filed: June 8, 2015
    Date of Patent: November 21, 2017
    Assignee: Bentley Systems, Incorporated
    Inventors: Stéphane Côté, Ian Létourneau, Jade Marcoux-Ouellet
  • Patent number: 9825701
    Abstract: An optical communications beacon receiver including a camera for capturing a plurality of beacon images. The plurality of beacon images includes a beacon signal transmitted from a beacon transmitter. The beacon receiver also including processing circuitry configured for determining the state of the beacon signal for each of the plurality of beacon images based on the known pattern, at least one beacon image of the plurality of beacon images includes a beacon on state and at least one beacon image of the plurality of beacon images includes a beacon off state, comparing the at least one beacon image including the beacon on state to the at least one beacon image including the beacon off state, and determining a beacon location based on the comparison of the at least one beacon image including the beacon on state to the at least one beacon image including the beacon off state.
    Type: Grant
    Filed: October 12, 2015
    Date of Patent: November 21, 2017
    Assignee: The Johns Hopkins University
    Inventors: Juan C. Juarez, Radha A. Venkat, Ricardo Luna, David A. Kitchin, Melissa E. Jansen, David W. Young, Katherine T. Souza, Joseph E. Sluz, David M. Brown, Ryan P. DiNello-Fass, Hala J. Tomey
  • Patent number: 9824499
    Abstract: A head-mounted display includes a visible-light camera configured to collect a visible-light image of a physical space, a surface sensor configured to measure one or more surface parameters of the physical space, a see-through display configured to visually present an augmentation image while light from the physical space passes through the see-through display to a user eye, and an augmented-reality engine. The augmented-reality engine may be configured to identify a surface of the physical space from the one or more measured surface parameters, compose a mixed-reality image that includes the augmentation image overlaid on the visible-light image, and visually present, via the see-through display, the mixed-reality image in alignment with the identified surface.
    Type: Grant
    Filed: June 23, 2015
    Date of Patent: November 21, 2017
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Shawn Crispin Wright, Dan Osborn, Alberto E. Cerriteno, Bofan Hsu, Evan Jones, Joe Thompson, Forest Woodcroft Gouin, Megan Saunders
  • Patent number: 9818230
    Abstract: A wearable computing device includes a head-mounted display (HMD) that generates a virtual reality environment. Through the generation and tracking of positional data, a the virtual environment may be interrupted or paused. Upon pausing the environment, a user may access a number of ancillary menus and controls not otherwise available during normal operation of the virtual environment.
    Type: Grant
    Filed: August 17, 2016
    Date of Patent: November 14, 2017
    Assignee: SONY INTERACTIVE ENTERTAINMENT AMERICA LLC
    Inventor: Justin Moravetz
  • Patent number: 9817682
    Abstract: A computer system for processing machine vision data and performing active control of a mobile platform includes a plurality of sensors configured to acquire inertial and positional data. The system further includes a first plurality of co-processors having a hardware logic configured to control the acquisition of the inertial data. A second plurality of sensors is configured to acquire image data related to the mobile platform. The system further includes a second plurality of co-processors having a hardware logic configured to control the acquisition of the image data. The system further includes state management logic to perform state management operations for the acquired inertial and positional data in a computer-readable memory. The state management is performed using a state vector. The state management logic coordinates sharing and updating the acquired machine vision data in a parallel fashion between the first and second co-processors.
    Type: Grant
    Filed: May 18, 2015
    Date of Patent: November 14, 2017
    Assignee: Goodrich Corporation
    Inventor: Erik V. Rencs
  • Patent number: 9817305
    Abstract: The present invention provides an image correction system and method for multi-projection, the image correction system including a plurality of projection surfaces which are installed in a single theater and a projection device which projects images on the plurality of projection surfaces, in which the images projected by the projection device on the plurality of projection surfaces are corrected based on relative differences in properties of the plurality of projection surfaces.
    Type: Grant
    Filed: July 3, 2013
    Date of Patent: November 14, 2017
    Assignee: CJ CGV CO., LTD.
    Inventors: Hwan Chul Kim, Su Ryeon Kang
  • Patent number: 9811947
    Abstract: A method is provided for markerless injection of content into an augmented reality scene by use of a mobile device. Through the mobile device, a camera feed of a scene is acquired, which includes a flat surface. A key frame of the flat surface is selected from the feed. After determining that the flat surface in the key frame meets a predetermined level of feature richness, digital content is injected by superimposing text, graphics, video content over at least a part of the key frame. The digital content can be viewed and interacted with by the user of the mobile device. In one embodiment, the digital content is an advertisement.
    Type: Grant
    Filed: August 4, 2016
    Date of Patent: November 7, 2017
    Assignee: Civic Resource Group International Inc.
    Inventors: Yousuf Chowdhary, Kevin Garland, Steven Blumenfeld
  • Patent number: 9805513
    Abstract: There is provided an image processing device including: a data storage unit storing feature data indicating a feature of appearance of one or more physical objects; an environment map building unit for building an environment map based on an input image obtained by imaging a real space and the feature data, the environment map representing a position of a physical object present in the real space; a control unit for acquiring procedure data for a set of procedures of operation to be performed in the real space, the procedure data defining a correspondence between a direction for each procedure and position information designating a position at which the direction is to be displayed; and a superimposing unit for generating an output image by superimposing the direction for each procedure at a position in the input image determined based on the environment map and the position information, using the procedure data.
    Type: Grant
    Filed: January 8, 2016
    Date of Patent: October 31, 2017
    Assignee: Sony Corporation
    Inventors: Yasuhiro Suto, Masaki Fukuchi, Kenichirou Ooi, Jingjing Guo, Kouichi Matsuda
  • Patent number: 9805514
    Abstract: Dynamic haptic retargeting can be implemented using world warping techniques and body warping techniques. World warping is applied to improve an alignment between a virtual object and a physical object, while body warping is applied to redirect a user's motion to increase a likelihood that a physical hand will reach the physical object at the same time a virtual representation of the hand reaches the virtual object. Threshold values and/or a combination of world warping a body warping can be used to mitigate negative impacts that may be caused by using either technique excessively or independently.
    Type: Grant
    Filed: April 21, 2016
    Date of Patent: October 31, 2017
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Hrvoje Benko, Mark Hancock, Andrew D. Wilson, Eyal Ofek, Mahdi Azmandian
  • Patent number: 9799145
    Abstract: Embodiments are disclosed that relate to augmenting an appearance of a surface via a see-through display device. For example, one disclosed embodiment provides, on a computing device comprising a see-through display device, a method of augmenting an appearance of a surface. The method includes acquiring, via an outward-facing image sensor, image data of a first scene viewable through the display. The method further includes recognizing a surface viewable through the display based on the image data and, in response to recognizing the surface, acquiring a representation of a second scene comprising one or more of a scene located physically behind the surface viewable through the display and a scene located behind a surface contextually related to the surface viewable through the display. The method further includes displaying the representation via the see-through display.
    Type: Grant
    Filed: July 22, 2015
    Date of Patent: October 24, 2017
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Mike Scavezze, Jason Scott, Jonathan Steed, Ian McIntyre, Aaron Krauss, Daniel McCulloch, Stephen Latta
  • Patent number: 9791917
    Abstract: Apparatuses, methods, and storage media for modifying augmented reality in response to user interaction are described. In one instance, the apparatus for modifying augmented reality may include a processor, a scene capture camera coupled with the processor to capture a physical scene, and an augmentation management module to be operated by the processor. The augmentation management module may obtain and analyze the physical scene, generate one or more virtual articles to augment a rendering of the physical scene based on a result of the analysis, track user interaction with the rendered augmented scene, and modify or complement the virtual articles in response to the tracked user interaction. Other embodiments may be described and claimed.
    Type: Grant
    Filed: March 24, 2015
    Date of Patent: October 17, 2017
    Assignee: Intel Corporation
    Inventors: Gila Kamhi, Amit Moran
  • Patent number: 9794860
    Abstract: Geocast-based situation awareness utilizing a scalable, distributed ad hoc geocast protocol as a communication primitive, may provide a field common operating picture (FCOP) for providing location tracking, movement history, telemetry, and messaging in near real time to all operators in a scenario. Information may be transferred using a query/response geocast message protocol. Caching on devices may be utilized to gain scalability. A query message may have a payload containing a type indication and a header containing a description of a geocast region of intended reception, which may comprise the monitored region, the location of the monitorer, or any appropriate combination thereof. Response messages may be sent from devices located in the monitored region to an area containing the location of the sender of a query. A response message may contain monitored information, such as current location, telemetry data, and/or recent movement history, or the like.
    Type: Grant
    Filed: May 20, 2016
    Date of Patent: October 17, 2017
    Assignee: AT&T Intellectual Property I, L.P.
    Inventor: Robert J. Hall
  • Patent number: 9792731
    Abstract: A system includes circuitry configured to acquire image data captured by an electronic device, acquire content and display position information corresponding to the content based on an object detected in the image data, the display position information indicating a display position of the content in relation to the object, determine whether the content is capable of being displayed in a superimposed manner on the image data at the display position indicated by the display position information, and indicate an alert to be output by the electronic device when it is determined that the content is unable to be displayed at the position indicated by the display position information.
    Type: Grant
    Filed: December 18, 2014
    Date of Patent: October 17, 2017
    Assignee: FUJITSU LIMITED
    Inventor: Iori Murakami
  • Patent number: 9791919
    Abstract: An electronic device determines information about a target and provides the information to another electronic device that has an obstructed view of the target. The other electronic device displays an image of the target with an orientation and a location of the target.
    Type: Grant
    Filed: August 11, 2015
    Date of Patent: October 17, 2017
    Inventors: Philip Lyren, Robert Lyren
  • Patent number: 9792521
    Abstract: Systems, apparatuses, and methods are provided for developing a fingerprint database and extracting feature geometries for determining the geographic location of an end-user device. A device collects, or a processor receives, a depth map of a location in a path network. A physical structure is identified within the depth map. The depth map is divided, at the physical structure, into a horizontal plane at an elevation from the road level. A two-dimensional feature geometry is extracted from the horizontal plane of the depth map using a linear regression algorithm, a curvilinear regression algorithm, or a machine learning algorithm.
    Type: Grant
    Filed: December 26, 2014
    Date of Patent: October 17, 2017
    Assignee: HERE Global B.V.
    Inventors: Leo Modica, Leon Stenneth
  • Patent number: 9787846
    Abstract: A user device for generating a scene, the user device comprising: an object determiner configured to determine an object for the scene, the object being associated with at least one audio signal; a relative position/orientation determiner configured to determine a relative position/orientation between the user device's user and the object; an audio position processor configured to spatially audio signal process the at least one audio signal to generate at least two channel audio signal based on the relative position/orientation.
    Type: Grant
    Filed: January 21, 2015
    Date of Patent: October 10, 2017
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Sriram Srinivasan, Ryan S. Menezes, Shawn Crispin Wright, Hongwu Huai
  • Patent number: 9782066
    Abstract: Provided is an imaging apparatus capable of imaging a confocal image and a nonconfocal image, in which an image intended by an examiner is provided easily and rapidly. The imaging apparatus includes: an acquiring unit configured to acquire a confocal image and a nonconfocal image of an eye to be inspected; a display unit configured to display at least one of the acquired confocal image and the acquired nonconfocal image; an analysis unit configured to analyze the acquired confocal image and the acquired nonconfocal image; and a display control unit configured to change a display form displayed on the display unit in accordance with an analysis result obtained by the analysis unit.
    Type: Grant
    Filed: February 10, 2016
    Date of Patent: October 10, 2017
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Tsutomu Utagawa, Hiroshi Imamura
  • Patent number: 9784972
    Abstract: A warning information output outputs warning information for a user, based on a position of the user and a position of a real object with which data is associated in a case where a first attribute indicates outputting of the warning information for the user. An image output outputs an image to be generated, in a case where a second attribute indicates drawing of a virtual object in accordance with the position of the real object and a position at which the virtual object to be viewed by the user is arranged, by not drawing the virtual object in a region in which the position of the real object with which the data is associated is closer to the position of the user than the position at which the virtual object is arranged.
    Type: Grant
    Filed: September 11, 2015
    Date of Patent: October 10, 2017
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Shinichi Aratani, Kazuki Takemoto
  • Patent number: 9779550
    Abstract: An augmented reality system including an unmanned moving object and an augmented reality marker arranged on or within the unmanned moving object. The augmented reality system further includes a visual rendering unit that is configured to augment virtual information corresponding to the augmented reality marker and to map the virtual information on the unmanned moving object.
    Type: Grant
    Filed: September 23, 2013
    Date of Patent: October 3, 2017
    Assignee: SONY CORPORATION
    Inventor: Hiroaki Tobita
  • Patent number: 9773335
    Abstract: A display control device includes circuitry configured to acquire a movement distance of an imaging device configured to acquire a plurality of images including a first image and a second image, calculate, when a specific object is detected from the first image, a first positional relationship between the specific object and the imaging device, control a display to superimpose a specific image corresponding to the specific object on the first image based on the first positional relationship, and control the display to superimpose the specific image on the second image based on the first positional relationship, when the specific object is not detected from the second image and the movement distance is smaller than a specific value, the movement distance being from a first position where the first image is captured by the imaging devise to a second position where the second image is captured by the imaging devise.
    Type: Grant
    Filed: January 16, 2015
    Date of Patent: September 26, 2017
    Assignee: FUJITSU LIMITED
    Inventor: Susumu Koga
  • Patent number: 9773348
    Abstract: A head mounted device suitable for guiding an exhibition is disclosed. The head mounted device includes an image capturing unit, a process module and an information interface. The process module includes a recognition unit, a computing unit and a control unit. The image capturing unit captures an input image in invisible spectrum. The recognition unit recognizes an invisible code from the input image. The computing unit calculates a relative distance and a relative angle between the head mounted device and an exhibition object. By comparing the relative distance with a threshold distance, the control unit determines whether to trigger the information interface and present an exhibit-object introduction based on relative distance and relative angle.
    Type: Grant
    Filed: November 20, 2015
    Date of Patent: September 26, 2017
    Assignee: INSTITUTE FOR INFORMATION INDUSTRY
    Inventors: Ching-Wen Lin, Wei-Yuan Lin