Augmented Reality (real-time) Patents (Class 345/633)
  • Patent number: 9836875
    Abstract: A user device uses sensors to determine the rotation of the user device with respect to a reference orientation. Using the user device rotation, an image manipulation module accesses images that are associated with image rotations. A set of the images are selected based on the device rotation to select images that have image orientations corresponding to the device rotation. A weight may be determined for each selected image, and the images are combined to generate a blended image using the weights. The blended image is displayed to the user, and as the rotation of the user devices changes, the process is repeated to display changing blended images based on the device rotation, thereby animating the rotation effect.
    Type: Grant
    Filed: January 10, 2014
    Date of Patent: December 5, 2017
    Assignee: FLIPBOARD, INC.
    Inventor: Charles Ying
  • Patent number: 9836888
    Abstract: Augmented reality systems and methods are disclosed which provide for representing imperceptible aspects of telecommunications networks as visual, auditory, tactile, or audiovisual stimuli. In some embodiments, the representation is a type of augmented reality from the perspective of a user on the ground, such as a technician deployed in the field.
    Type: Grant
    Filed: February 17, 2017
    Date of Patent: December 5, 2017
    Assignee: EDX Technologies, Inc.
    Inventor: Roger Ray Skidmore
  • Patent number: 9836652
    Abstract: A mechanism is provided for indicating an area of an object that is considered dangerous to a user via a head mounted display (HMD) system. The object being used by the user and one or more areas of the object that are considered dangerous are identified. Responsive to identifying one or more areas of the object that are considered dangerous, an overlay for each of the one or more areas of the object that are considered dangerous is generated. The overlay for each one or more areas of the object that are considered dangerous is displayed via a display layer of the HMD system so that the one or more areas of the object that are considered dangerous are identified as an overlay to the object that is being seen by the user through the HMD system.
    Type: Grant
    Filed: February 2, 2016
    Date of Patent: December 5, 2017
    Assignee: International Business Machines Corporation
    Inventors: David B. Lection, Sarbajit K. Rakshit, Mark B. Stevens, John D. Wilson
  • Patent number: 9836263
    Abstract: Aspects of the present invention include a display control device comprising a determining unit configured to determine an orientation of a real object in a real space image. The device may also comprise a control unit configured to select between first and second orientations of a virtual object based on the real object orientation, one of the first or second virtual object orientations aligning the virtual object with the orientation of the real object, and output an image of the virtual object based on the selected orientation, for display on an associated display device.
    Type: Grant
    Filed: March 30, 2012
    Date of Patent: December 5, 2017
    Assignee: Sony Corporation
    Inventor: Shunichi Kasahara
  • Patent number: 9837121
    Abstract: There is provided an information processing device including a data processing section configured to perform processing of playing back content according to a feature image, based on detection of the feature image from a captured image acquired by a capturing of an imaging section, and a specifying section configured to specify a resume point, which is a position of playing back the content, according to a timing at which the detection of the feature image is impossible. The data processing section performs the playback of the content from a position corresponding to the resume point, according to re-detection of the feature image after the detection of the feature image becomes impossible.
    Type: Grant
    Filed: April 24, 2013
    Date of Patent: December 5, 2017
    Assignee: SONY CORPORATION
    Inventor: Yuya Hanai
  • Patent number: 9827495
    Abstract: First control means of a simulation device simulates motions of a plurality of virtual players that are placed in a virtual world and other than an operation target of a user. Determining means determines whether a situation of a game being simulated in the virtual world is similar to a situation indicated in data. In a case where it is determined that the situation of the game in the virtual world is similar to the situation indicated in the data, second control means controls, in place of the first control means, the virtual players other than the operation target of the user based on a motion associated with the situation.
    Type: Grant
    Filed: June 23, 2014
    Date of Patent: November 28, 2017
    Assignee: KONAMI DIGITAL ENTERTAINMENT CO., LTD.
    Inventors: Iskander Umarov, Eiji Suzuki
  • Patent number: 9824499
    Abstract: A head-mounted display includes a visible-light camera configured to collect a visible-light image of a physical space, a surface sensor configured to measure one or more surface parameters of the physical space, a see-through display configured to visually present an augmentation image while light from the physical space passes through the see-through display to a user eye, and an augmented-reality engine. The augmented-reality engine may be configured to identify a surface of the physical space from the one or more measured surface parameters, compose a mixed-reality image that includes the augmentation image overlaid on the visible-light image, and visually present, via the see-through display, the mixed-reality image in alignment with the identified surface.
    Type: Grant
    Filed: June 23, 2015
    Date of Patent: November 21, 2017
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Shawn Crispin Wright, Dan Osborn, Alberto E. Cerriteno, Bofan Hsu, Evan Jones, Joe Thompson, Forest Woodcroft Gouin, Megan Saunders
  • Patent number: 9825701
    Abstract: An optical communications beacon receiver including a camera for capturing a plurality of beacon images. The plurality of beacon images includes a beacon signal transmitted from a beacon transmitter. The beacon receiver also including processing circuitry configured for determining the state of the beacon signal for each of the plurality of beacon images based on the known pattern, at least one beacon image of the plurality of beacon images includes a beacon on state and at least one beacon image of the plurality of beacon images includes a beacon off state, comparing the at least one beacon image including the beacon on state to the at least one beacon image including the beacon off state, and determining a beacon location based on the comparison of the at least one beacon image including the beacon on state to the at least one beacon image including the beacon off state.
    Type: Grant
    Filed: October 12, 2015
    Date of Patent: November 21, 2017
    Assignee: The Johns Hopkins University
    Inventors: Juan C. Juarez, Radha A. Venkat, Ricardo Luna, David A. Kitchin, Melissa E. Jansen, David W. Young, Katherine T. Souza, Joseph E. Sluz, David M. Brown, Ryan P. DiNello-Fass, Hala J. Tomey
  • Patent number: 9824490
    Abstract: In one embodiment, an augmented view is generated that accounts for dynamically changing terrain surface at a site. A sensor captures live georeferenced terrain surface topography for the site. A camera captures an image of the site. Further, a tracking system determines a georeferenced camera pose of the camera. An augmented reality application aligns a georeferenced three-dimensional (3-D) model for the site with the live georeferenced terrain surface topography. Then, using at least the captured image, the georeferenced camera pose, the georeferenced 3-D model and live georeferenced terrain surface topography, the augmented reality application creates an augmented view of the site that shows graphical representations of subsurface features. At least a portion of the graphical representations are dynamically conformed to the contours of the terrain surface in the image based on the live georeferenced terrain surface topography.
    Type: Grant
    Filed: June 8, 2015
    Date of Patent: November 21, 2017
    Assignee: Bentley Systems, Incorporated
    Inventors: Stéphane Côté, Ian Létourneau, Jade Marcoux-Ouellet
  • Patent number: 9824437
    Abstract: A server receives datasets from mobile devices. Each dataset identifies a task selected in an augmented reality application of a corresponding mobile device and an identification of a tool detected at the corresponding mobile device. The server identifies tools present and absent at a dedicated tool board and compares an identification of the tools present and absent at the dedicated tool board with the tools detected at the mobile devices and the tasks identified at the mobile devices to generate a tool inventory and a tool compliance. The server generates an augmented reality content dataset for each mobile device to identify at least one of a missing tool, an incorrect tool, and a valid tool based on the tool compliance.
    Type: Grant
    Filed: December 11, 2015
    Date of Patent: November 21, 2017
    Assignee: DAQRI, LLC
    Inventor: Brian Mullins
  • Patent number: 9824501
    Abstract: Interference-based augmented reality hosting platforms are presented. Hosting platforms can include networking nodes capable of analyzing a digital representation of scene to derive interference among elements of the scene. The hosting platform utilizes the interference to adjust the presence of augmented reality objects within an augmented reality experience. Elements of a scene can constructively interfere, enhancing presence of augmented reality objects; or destructively interfere, suppressing presence of augmented reality objects.
    Type: Grant
    Filed: July 18, 2016
    Date of Patent: November 21, 2017
    Assignee: Nant Holdings IP, LLC
    Inventor: Patrick Soon-Shiong
  • Patent number: 9821920
    Abstract: A head mounted virtual reality (VR) device including an inertial measurement unit (IMU) is located in a vehicle which may be, and sometimes is, moving. Detected motion attributable to vehicle motion is filtered out based on one or more or all of: vehicle type information, information derived from sensors located in the vehicle external to the head mounted VR device, and/or captured images including a reference point or reference object within the vehicle. An image portion of a simulated VR environment is selected and presented to the user of the head mounted VR device based on the filtered motion information. Thus, the image portion presented to the user of the head mounted VR device is substantially unaffected by vehicle motion and corresponds to user induced head motion.
    Type: Grant
    Filed: August 18, 2015
    Date of Patent: November 21, 2017
    Assignee: NextVR Inc.
    Inventors: David Cole, Alan McKay Moss
  • Patent number: 9817682
    Abstract: A computer system for processing machine vision data and performing active control of a mobile platform includes a plurality of sensors configured to acquire inertial and positional data. The system further includes a first plurality of co-processors having a hardware logic configured to control the acquisition of the inertial data. A second plurality of sensors is configured to acquire image data related to the mobile platform. The system further includes a second plurality of co-processors having a hardware logic configured to control the acquisition of the image data. The system further includes state management logic to perform state management operations for the acquired inertial and positional data in a computer-readable memory. The state management is performed using a state vector. The state management logic coordinates sharing and updating the acquired machine vision data in a parallel fashion between the first and second co-processors.
    Type: Grant
    Filed: May 18, 2015
    Date of Patent: November 14, 2017
    Assignee: Goodrich Corporation
    Inventor: Erik V. Rencs
  • Patent number: 9817305
    Abstract: The present invention provides an image correction system and method for multi-projection, the image correction system including a plurality of projection surfaces which are installed in a single theater and a projection device which projects images on the plurality of projection surfaces, in which the images projected by the projection device on the plurality of projection surfaces are corrected based on relative differences in properties of the plurality of projection surfaces.
    Type: Grant
    Filed: July 3, 2013
    Date of Patent: November 14, 2017
    Assignee: CJ CGV CO., LTD.
    Inventors: Hwan Chul Kim, Su Ryeon Kang
  • Patent number: 9818230
    Abstract: A wearable computing device includes a head-mounted display (HMD) that generates a virtual reality environment. Through the generation and tracking of positional data, a the virtual environment may be interrupted or paused. Upon pausing the environment, a user may access a number of ancillary menus and controls not otherwise available during normal operation of the virtual environment.
    Type: Grant
    Filed: August 17, 2016
    Date of Patent: November 14, 2017
    Assignee: SONY INTERACTIVE ENTERTAINMENT AMERICA LLC
    Inventor: Justin Moravetz
  • Patent number: 9811947
    Abstract: A method is provided for markerless injection of content into an augmented reality scene by use of a mobile device. Through the mobile device, a camera feed of a scene is acquired, which includes a flat surface. A key frame of the flat surface is selected from the feed. After determining that the flat surface in the key frame meets a predetermined level of feature richness, digital content is injected by superimposing text, graphics, video content over at least a part of the key frame. The digital content can be viewed and interacted with by the user of the mobile device. In one embodiment, the digital content is an advertisement.
    Type: Grant
    Filed: August 4, 2016
    Date of Patent: November 7, 2017
    Assignee: Civic Resource Group International Inc.
    Inventors: Yousuf Chowdhary, Kevin Garland, Steven Blumenfeld
  • Patent number: 9805514
    Abstract: Dynamic haptic retargeting can be implemented using world warping techniques and body warping techniques. World warping is applied to improve an alignment between a virtual object and a physical object, while body warping is applied to redirect a user's motion to increase a likelihood that a physical hand will reach the physical object at the same time a virtual representation of the hand reaches the virtual object. Threshold values and/or a combination of world warping a body warping can be used to mitigate negative impacts that may be caused by using either technique excessively or independently.
    Type: Grant
    Filed: April 21, 2016
    Date of Patent: October 31, 2017
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Hrvoje Benko, Mark Hancock, Andrew D. Wilson, Eyal Ofek, Mahdi Azmandian
  • Patent number: 9805513
    Abstract: There is provided an image processing device including: a data storage unit storing feature data indicating a feature of appearance of one or more physical objects; an environment map building unit for building an environment map based on an input image obtained by imaging a real space and the feature data, the environment map representing a position of a physical object present in the real space; a control unit for acquiring procedure data for a set of procedures of operation to be performed in the real space, the procedure data defining a correspondence between a direction for each procedure and position information designating a position at which the direction is to be displayed; and a superimposing unit for generating an output image by superimposing the direction for each procedure at a position in the input image determined based on the environment map and the position information, using the procedure data.
    Type: Grant
    Filed: January 8, 2016
    Date of Patent: October 31, 2017
    Assignee: Sony Corporation
    Inventors: Yasuhiro Suto, Masaki Fukuchi, Kenichirou Ooi, Jingjing Guo, Kouichi Matsuda
  • Patent number: 9799145
    Abstract: Embodiments are disclosed that relate to augmenting an appearance of a surface via a see-through display device. For example, one disclosed embodiment provides, on a computing device comprising a see-through display device, a method of augmenting an appearance of a surface. The method includes acquiring, via an outward-facing image sensor, image data of a first scene viewable through the display. The method further includes recognizing a surface viewable through the display based on the image data and, in response to recognizing the surface, acquiring a representation of a second scene comprising one or more of a scene located physically behind the surface viewable through the display and a scene located behind a surface contextually related to the surface viewable through the display. The method further includes displaying the representation via the see-through display.
    Type: Grant
    Filed: July 22, 2015
    Date of Patent: October 24, 2017
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Mike Scavezze, Jason Scott, Jonathan Steed, Ian McIntyre, Aaron Krauss, Daniel McCulloch, Stephen Latta
  • Patent number: 9791919
    Abstract: An electronic device determines information about a target and provides the information to another electronic device that has an obstructed view of the target. The other electronic device displays an image of the target with an orientation and a location of the target.
    Type: Grant
    Filed: August 11, 2015
    Date of Patent: October 17, 2017
    Inventors: Philip Lyren, Robert Lyren
  • Patent number: 9794860
    Abstract: Geocast-based situation awareness utilizing a scalable, distributed ad hoc geocast protocol as a communication primitive, may provide a field common operating picture (FCOP) for providing location tracking, movement history, telemetry, and messaging in near real time to all operators in a scenario. Information may be transferred using a query/response geocast message protocol. Caching on devices may be utilized to gain scalability. A query message may have a payload containing a type indication and a header containing a description of a geocast region of intended reception, which may comprise the monitored region, the location of the monitorer, or any appropriate combination thereof. Response messages may be sent from devices located in the monitored region to an area containing the location of the sender of a query. A response message may contain monitored information, such as current location, telemetry data, and/or recent movement history, or the like.
    Type: Grant
    Filed: May 20, 2016
    Date of Patent: October 17, 2017
    Assignee: AT&T Intellectual Property I, L.P.
    Inventor: Robert J. Hall
  • Patent number: 9792731
    Abstract: A system includes circuitry configured to acquire image data captured by an electronic device, acquire content and display position information corresponding to the content based on an object detected in the image data, the display position information indicating a display position of the content in relation to the object, determine whether the content is capable of being displayed in a superimposed manner on the image data at the display position indicated by the display position information, and indicate an alert to be output by the electronic device when it is determined that the content is unable to be displayed at the position indicated by the display position information.
    Type: Grant
    Filed: December 18, 2014
    Date of Patent: October 17, 2017
    Assignee: FUJITSU LIMITED
    Inventor: Iori Murakami
  • Patent number: 9792521
    Abstract: Systems, apparatuses, and methods are provided for developing a fingerprint database and extracting feature geometries for determining the geographic location of an end-user device. A device collects, or a processor receives, a depth map of a location in a path network. A physical structure is identified within the depth map. The depth map is divided, at the physical structure, into a horizontal plane at an elevation from the road level. A two-dimensional feature geometry is extracted from the horizontal plane of the depth map using a linear regression algorithm, a curvilinear regression algorithm, or a machine learning algorithm.
    Type: Grant
    Filed: December 26, 2014
    Date of Patent: October 17, 2017
    Assignee: HERE Global B.V.
    Inventors: Leo Modica, Leon Stenneth
  • Patent number: 9791917
    Abstract: Apparatuses, methods, and storage media for modifying augmented reality in response to user interaction are described. In one instance, the apparatus for modifying augmented reality may include a processor, a scene capture camera coupled with the processor to capture a physical scene, and an augmentation management module to be operated by the processor. The augmentation management module may obtain and analyze the physical scene, generate one or more virtual articles to augment a rendering of the physical scene based on a result of the analysis, track user interaction with the rendered augmented scene, and modify or complement the virtual articles in response to the tracked user interaction. Other embodiments may be described and claimed.
    Type: Grant
    Filed: March 24, 2015
    Date of Patent: October 17, 2017
    Assignee: Intel Corporation
    Inventors: Gila Kamhi, Amit Moran
  • Patent number: 9784972
    Abstract: A warning information output outputs warning information for a user, based on a position of the user and a position of a real object with which data is associated in a case where a first attribute indicates outputting of the warning information for the user. An image output outputs an image to be generated, in a case where a second attribute indicates drawing of a virtual object in accordance with the position of the real object and a position at which the virtual object to be viewed by the user is arranged, by not drawing the virtual object in a region in which the position of the real object with which the data is associated is closer to the position of the user than the position at which the virtual object is arranged.
    Type: Grant
    Filed: September 11, 2015
    Date of Patent: October 10, 2017
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Shinichi Aratani, Kazuki Takemoto
  • Patent number: 9787846
    Abstract: A user device for generating a scene, the user device comprising: an object determiner configured to determine an object for the scene, the object being associated with at least one audio signal; a relative position/orientation determiner configured to determine a relative position/orientation between the user device's user and the object; an audio position processor configured to spatially audio signal process the at least one audio signal to generate at least two channel audio signal based on the relative position/orientation.
    Type: Grant
    Filed: January 21, 2015
    Date of Patent: October 10, 2017
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Sriram Srinivasan, Ryan S. Menezes, Shawn Crispin Wright, Hongwu Huai
  • Patent number: 9782066
    Abstract: Provided is an imaging apparatus capable of imaging a confocal image and a nonconfocal image, in which an image intended by an examiner is provided easily and rapidly. The imaging apparatus includes: an acquiring unit configured to acquire a confocal image and a nonconfocal image of an eye to be inspected; a display unit configured to display at least one of the acquired confocal image and the acquired nonconfocal image; an analysis unit configured to analyze the acquired confocal image and the acquired nonconfocal image; and a display control unit configured to change a display form displayed on the display unit in accordance with an analysis result obtained by the analysis unit.
    Type: Grant
    Filed: February 10, 2016
    Date of Patent: October 10, 2017
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Tsutomu Utagawa, Hiroshi Imamura
  • Patent number: 9779550
    Abstract: An augmented reality system including an unmanned moving object and an augmented reality marker arranged on or within the unmanned moving object. The augmented reality system further includes a visual rendering unit that is configured to augment virtual information corresponding to the augmented reality marker and to map the virtual information on the unmanned moving object.
    Type: Grant
    Filed: September 23, 2013
    Date of Patent: October 3, 2017
    Assignee: SONY CORPORATION
    Inventor: Hiroaki Tobita
  • Patent number: 9773335
    Abstract: A display control device includes circuitry configured to acquire a movement distance of an imaging device configured to acquire a plurality of images including a first image and a second image, calculate, when a specific object is detected from the first image, a first positional relationship between the specific object and the imaging device, control a display to superimpose a specific image corresponding to the specific object on the first image based on the first positional relationship, and control the display to superimpose the specific image on the second image based on the first positional relationship, when the specific object is not detected from the second image and the movement distance is smaller than a specific value, the movement distance being from a first position where the first image is captured by the imaging devise to a second position where the second image is captured by the imaging devise.
    Type: Grant
    Filed: January 16, 2015
    Date of Patent: September 26, 2017
    Assignee: FUJITSU LIMITED
    Inventor: Susumu Koga
  • Patent number: 9773348
    Abstract: A head mounted device suitable for guiding an exhibition is disclosed. The head mounted device includes an image capturing unit, a process module and an information interface. The process module includes a recognition unit, a computing unit and a control unit. The image capturing unit captures an input image in invisible spectrum. The recognition unit recognizes an invisible code from the input image. The computing unit calculates a relative distance and a relative angle between the head mounted device and an exhibition object. By comparing the relative distance with a threshold distance, the control unit determines whether to trigger the information interface and present an exhibit-object introduction based on relative distance and relative angle.
    Type: Grant
    Filed: November 20, 2015
    Date of Patent: September 26, 2017
    Assignee: INSTITUTE FOR INFORMATION INDUSTRY
    Inventors: Ching-Wen Lin, Wei-Yuan Lin
  • Patent number: 9761053
    Abstract: A system of properly displaying chroma key content is presented. The system obtains a digital representation of a 3D environment, for example a digital photo, and gathers data from that digital representation. The system renders the digital representation in an environmental model and displays that digital representation upon an output device. Depending upon the context, content anchors of the environmental model are selected which will be altered by suitable chroma key content. The chroma key content takes into consideration the position and orientation of the chroma key content relative to the content anchor and relative to the point of view that the environmental model is displayed from in order to accurately display chroma key content in a realistic manner.
    Type: Grant
    Filed: August 21, 2014
    Date of Patent: September 12, 2017
    Assignee: NANTMOBILE, LLC
    Inventors: Evgeny Dzhurinskiy, Ludmila Bezyaeva
  • Patent number: 9761054
    Abstract: Example embodiments of the present disclosure provide techniques for receiving measurements from one or more inertial sensors (i.e. accelerometer and angular rate gyros) attached to a device with a camera or other environment capture capability. In one embodiment, the inertial measurements may be combined with pose estimates obtained from computer vision algorithms executing with real time camera images. Using such inertial measurements, a system may more quickly and efficiently obtain higher accuracy orientation estimates of the device with respect to an object known to be stationary in the environment.
    Type: Grant
    Filed: May 4, 2015
    Date of Patent: September 12, 2017
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Matthew L. Bronder, Michael A. Dougherty, Adam Green, Joseph Bertolami, Robert M. Craig
  • Patent number: 9753553
    Abstract: Systems, methods, and computer-readable media are provided for generating computer-mediated reality display data based on user instantaneous motion data.
    Type: Grant
    Filed: July 3, 2014
    Date of Patent: September 5, 2017
    Assignee: Sony Interactive Entertainment America LLC
    Inventor: Gary Lauder
  • Patent number: 9754178
    Abstract: Software for static object detection that performs the following operations: (i) detecting an object that is present in at least one image of a set of images, wherein the set of images correspond to a time period; (ii) identifying a set of corner points for the detected object; (iii) tracking the object's presence in the set of images over the time period, wherein the object's presence is determined by matching the set of images to a template generated based on the identified corner points; and (iv) identifying the object as a static object when an amount of time corresponding to the object's presence in the set of images is greater than a predefined threshold.
    Type: Grant
    Filed: August 19, 2015
    Date of Patent: September 5, 2017
    Assignee: International Business Machines Corporation
    Inventors: Quanfu Fan, Zuoxuan Lu, Sharathchandra U. Pankanti
  • Patent number: 9754397
    Abstract: Methods, hardware, and software perform augmented reality created from a separate source in context with, such as synchronized and positioned in, captured media, so as to replicate a similar augmented reality at a different instance. A computer processor in a network of communications devices handles a combination of augmented reality information, anchor information that provides the context-matching, limitation information that controls if such information is transmitted or acted upon, and captured media information. The computer processor compares the anchor information with the media to identify triggering media and how augmented reality elements should appear in context with such media. If successful, the augmented reality is performed on a communications device based on the media.
    Type: Grant
    Filed: April 7, 2017
    Date of Patent: September 5, 2017
    Assignee: MIRAGE WORLDS, INC.
    Inventors: Patrick S. Piemonte, Ryan P. Staake
  • Patent number: 9746672
    Abstract: There is provided an image processing apparatus including: an input image acquisition unit for obtaining an input image generated by taking an image of a real space; an image recognition unit for recognizing, when a first user-input representing a start of manipulation is detected, a manipulator used for manipulating a virtual object, wherein the manipulator appears in the input image; a calculation unit for calculating, according to a result of the recognition of the manipulator provided by the image recognition unit, a position on a screen of a display device at which the virtual object is to be displayed; a display control unit for displaying the virtual object at the position of the screen of the display device calculated by the calculation unit; and a communication unit for transmitting, when the first user-input is detected, a first notification signal for notifying the start of manipulation to another apparatus displaying the same virtual object.
    Type: Grant
    Filed: June 2, 2014
    Date of Patent: August 29, 2017
    Assignee: Sony Corporation
    Inventor: Kouichi Matsuda
  • Patent number: 9747503
    Abstract: Systems and methods for optical narrowcasting are provided for transmitting various types of content. Optical narrowcasting content indicative of the presence of additional information along with identifying information may be transmitted. The additional information (which may include meaningful amounts of advertising information, media, or any other content) may also be transmitted as optical narrowcasting content. Elements of an optical narrowcasting system may include optical transmitters and optical receivers which can be configured to be operative at distances ranging from, e.g., 400 meters to 1200 meters. Moreover, the elements can be implemented on a miniaturized scale in conjunction with small, user devices such as smartphones, thereby also realizing optical ad-hoc networking, as well as interoperability with other types of data networks. Optically narrowcast content can be used to augment a real-world experience, enhance and/or spawn new forms of social-media and media content.
    Type: Grant
    Filed: December 30, 2016
    Date of Patent: August 29, 2017
    Assignee: SureFire LLC
    Inventors: Narkis E. Shatz, John C. Bortz
  • Patent number: 9747724
    Abstract: A system includes circuitry configured to acquire image data captured by an electronic device, acquire content and display position information corresponding to the content based on an object detected in the image data, the display position information indicating a display position of the content in relation to the object, determine whether the content is capable of being displayed in a superimposed manner on the image data at the display position indicated by the display position information, and indicate an alert to be output by the electronic device when it is determined that the content is unable to be displayed at the position indicated by the display position information.
    Type: Grant
    Filed: December 18, 2014
    Date of Patent: August 29, 2017
    Assignee: FUJITSU LIMITED
    Inventor: Iori Murakami
  • Patent number: 9746855
    Abstract: An apparatus is provided with a first sensor unit that obtains two-dimensional information or three-dimensional information about a target object with a first position and orientation, a second sensor unit that obtains the two-dimensional information about the target object, a three-dimensional position and orientation measurement unit that measures three-dimensional position and orientation of the target object based on the information obtained by the first sensor unit, a second sensor position and orientation determination unit that calculates second position and orientation based on a measurement result with the three-dimensional position and orientation measurement unit and model information about the target object, and a three-dimensional position and orientation measurement unit that measures the three-dimensional position and orientation of the target object based on the information obtained by the second sensor unit with the second position and orientation and the model information about the target ob
    Type: Grant
    Filed: August 29, 2013
    Date of Patent: August 29, 2017
    Assignee: Canon Kabushiki Kaisha
    Inventors: Kazuhiko Kobayashi, Masahiro Suzuki, Shinji Uchiyama
  • Patent number: 9740012
    Abstract: Aspects of the present invention relate to methods and systems for the see-through computer display systems with a wide field of view.
    Type: Grant
    Filed: August 25, 2015
    Date of Patent: August 22, 2017
    Assignee: Osterhout Group, Inc.
    Inventors: John N. Border, Joseph Bietry
  • Patent number: 9743244
    Abstract: A method for visually finding and interacting with people, operable on a computing system including a server and a mobile device comprising a processor, a display and a camera, the method comprising: detecting the current location of members of a group, which a user of the mobile device has created or is a member of, if the group members have similar mobile devices and if they have set to permit their visibility when the user or other group members wish to locate them by scanning their surroundings with the camera of their mobile device; and, for each group member detected while the user is scanning user's surroundings, and having a position falling in the direction the mobile device's camera points to at a particular moment, displaying on the mobile device's display a group member representation associated with the group member's position.
    Type: Grant
    Filed: April 20, 2016
    Date of Patent: August 22, 2017
    Inventor: Keith Crutchfield
  • Patent number: 9734636
    Abstract: Embodiments that relate to presenting a plurality of visual information density levels for a plurality of geo-located data items in a mixed reality environment are disclosed. For example, in one disclosed embodiment a graduated information delivery program receives information for a first geo-located data item and provides a first visual information density level for the item to a head-mounted display device. When a spatial information density of geo-located data item information is below a threshold, the program provides a second visual information density level greater than the first level for a second geo-located data item displayed.
    Type: Grant
    Filed: March 7, 2017
    Date of Patent: August 15, 2017
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Thomas George Salter, Ben Sugden, Daniel Deptford, Robert Crocco, Jr., Brian Keane, Laura Massey, Alex Kipman, Peter Tobias Kinnebrew, Nicholas Kamuda
  • Patent number: 9727996
    Abstract: A display device may be provided and may be configured to present a virtual field of view comprising a virtual object superimposed on a real-world scene. A controller may be provided and configured to modify display of the virtual object by the display device based on a first color of a real-world object in the real-world scene. The virtual object in the virtual field of view may be superimposed over the real-world object. A lumen output of the display device for displaying the virtual object may be decreased.
    Type: Grant
    Filed: September 9, 2016
    Date of Patent: August 8, 2017
    Assignee: QUALCOMM Incorporated
    Inventors: Umesh Pandey, Chandrasekar Srinivasan, Babak Forutanpour
  • Patent number: 9727977
    Abstract: A system and method for sampling-based color extraction for augmented reality are described. A viewing device includes an optical sensor to capture an image of a real-world object. A color extraction software divides the captured image into multiple regions or recognizes pre-defined regions and identifies a color value for each region. A color-based augmented reality effect module retrieves a virtual content based on the color values for the regions, and delivers the virtual content in the viewing device.
    Type: Grant
    Filed: December 29, 2014
    Date of Patent: August 8, 2017
    Assignee: DAQRI, LLC
    Inventors: Brian Mullins, Matthew Kammerait, Mark Sararu, Andrew Krage
  • Patent number: 9723300
    Abstract: A direct interaction stereoscopic display system that produces an augmented or virtual reality environment. The system comprises one or more displays and one or more beam combiners to virtually project high-resolution flicker-free stereoscopic 3D imagery into a graphics volume in an open region. Viewpoint tracking is provided enabling motion parallax cues. A user interaction volume co-inhabits the graphics volume and a precise low-latency sensor allows users to directly interact with 3D virtual objects or interfaces without occluding the graphics. An adjustable support frame permits the 3D imagery to be readily positioned in situ with real environments for augmented reality applications. Individual display components may be adjusted to precisely align the 3D imagery with components of real environments for high-precision applications and also to match accommodation-vergence distances to prevent eye strain.
    Type: Grant
    Filed: March 17, 2015
    Date of Patent: August 1, 2017
    Assignee: Spatial Intelligence LLC
    Inventor: Nicholas V. Riedel
  • Patent number: 9717981
    Abstract: Augmented reality and physical game techniques are described. In one or more implementations, an indication is received by a computing device of a location of a physical gaming piece of a game. An augmentation is computed based on the indication by the computing device to be displayed as part of the game. The augmentation is displayed by the computing device on a display device that is at least partially transparent such that a physical portion of the game is viewable through the display device concurrently with the augmentation.
    Type: Grant
    Filed: April 5, 2012
    Date of Patent: August 1, 2017
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Steven John Robbins, William J. Westerinen, Lisa M. Hanson, Sung Ho Son, Richard J. Wattles
  • Patent number: 9710969
    Abstract: Technologies are described for indicating a geographic origin of a digitally-mediated communication relative to a location of a recipient by presenting the indication in an augmented reality scene. For example, an augmented reality scene can be presented to the recipient. The geographic origin of an incoming digital communication may be determined and a relative location of the origin with respect to the recipient's location may be computed. A format for presenting the relative location may be derived from the digital communication and the geographic origin. The augmented reality scene may be updated with the relative location based on the derived format.
    Type: Grant
    Filed: August 27, 2012
    Date of Patent: July 18, 2017
    Assignee: EMPIRE TECHNOLOGY DEVELOPMENT LLC
    Inventors: Mark Malamud, Royce Levien
  • Patent number: 9710967
    Abstract: An exemplary embodiment provides an information processing program. The information processing program includes image obtaining instructions, search target detection instructions, shape recognition instructions, event occurrence instructions, virtual image generation instructions, and display control instructions. The search target detection instructions cause a computer to detect a search target from an image of a subject obtained in accordance with the image obtaining instructions. The shape recognition instructions cause the computer to recognize a shape of the search target. The event occurrence instructions cause the computer to cause an event to occur in a virtual space in accordance with the shape of the search target. The virtual image generation instructions cause the computer to generate a virtual image by shooting the event that occurs in accordance with the event occurrence instructions with a virtual camera arranged in the virtual space.
    Type: Grant
    Filed: February 6, 2012
    Date of Patent: July 18, 2017
    Assignee: NINTENDO CO., LTD.
    Inventors: Kozo Makino, Keisuke Kikuchi, Yutaka Fukaya, Yota Aizawa
  • Patent number: 9706360
    Abstract: A method for processing media content is described. The method includes steps of receiving via a wireless network and at a content processing server media content of an activity captured by a mobile device; identifying a location of the mobile device and a location of the activity; and identifying a point of view characteristic of the received media content based on the location of the mobile device and the location of the activity. It is then determined whether the point of view characteristic of the received media content corresponds to a desired point of view of the activity. Upon determining the point of view characteristic of the received media content corresponds to the desired point of view, the content processing server selects to perform at least one of uploading and/or distributing of the media content via the content processing server to a user display device.
    Type: Grant
    Filed: January 5, 2016
    Date of Patent: July 11, 2017
    Assignee: VERIZON PATENT AND LICENSING INC.
    Inventors: Steven T. Archer, Matthew J. Threefoot
  • Patent number: 9704230
    Abstract: Methods and systems for determining augmentability information associated with an image frame captured by a digital imaging part of a user device. The determined augmentability score may then be used in the generation of feedback to the user. For example, a graphical user interface may be generated and rendered having a substantially continuous visual output corresponding to the augmentability information.
    Type: Grant
    Filed: September 30, 2011
    Date of Patent: July 11, 2017
    Assignee: LAYAR B.V.
    Inventors: Klaus Michael Hofmann, Vladimir Nedovic