Abstract: A projection metadata system and method are provided for providing projection metadata to a rendering system for use in rendering a panoramic scene. A rendering system and method are provided for rendering the panoramic scene using the projection metadata. The projection metadata may comprise machine readable data which may directly provide the coordinate mapping to be used in by the rendering system to render the panoramic scene. For example, an executable script may be provided which, when executed, carries out the coordinate mapping. Compared to known ways of signalling a rendering system which projection to use, which may conventionally involve selecting a projection from a number of predefined projections and signalling the selection, the use of projection metadata may provide a high degree of flexibility, as different projections may be defined for, e.g., different spatial and/or temporal parts of the panoramic scene, different rendering techniques, etc.
Type:
Grant
Filed:
May 23, 2018
Date of Patent:
November 23, 2021
Assignees:
KONINKLIJKE KPN N.V., NEDERLANDSE ORGANISATIE VOOR TOEGEPAST-NATUURWETENSCHAPPELIJK ONDERZOEK TNO
Inventors:
Mattijs Oskar Van Deventer, Hendrikus Nathaniel Hindriks
Abstract: In a video capture system, a virtual lens is simulated when applying a crop or zoom effect to an input video. An input video frame is received from the input video that has a first field of view and an input lens distortion caused by a lens used to capture the input video frame. A selection of a sub-frame representing a portion of the input video frame is obtained that has a second field of view smaller than the first field of view. The sub-frame is processed to remap the input lens distortion to a desired lens distortion in the sub-frame. The processed sub-frame is the outputted.
Type:
Grant
Filed:
October 21, 2020
Date of Patent:
November 2, 2021
Assignee:
GOPRO, INC.
Inventors:
David A. Newman, Joshua Edward Bodinet, Otto Kenneth Sievert, Timothy MacMillan
Abstract: A wearable glasses is provided. The wearable glasses includes a sensing circuit, a communication interface, a display, a memory and one or more processors. The sensing circuit senses movement information of a user wearing the wearable glasses. The communication interface receives notification message information. The display displays the notification message information within an angle of view of the user wearing the wearable glasses. The memory and one or more processors execute one or more programs including instructions to obtain environment information, determine a movement state of the user based on the sensed movement information of the user and the environment information, and control the display to display the received notification message information according to the movement state of the user.
Abstract: The present invention relates to physical athletic ball games played using augmented reality smart glasses, and more specifically, to physical real-time athletic ball games where at least two players at different game locations anywhere in the world play athletic ball games against one another using smart glasses. The present invention also relates to the reading of statistical sports data and implementing that data through augmented reality smart glasses in the form of visual graphics so the player wearing the glasses can interact with real sports players in an augmented reality setting.
Abstract: A rendering section renders a virtual space object to generate a computer graphics image. A superimposing section superimposes the computer graphics image on a captured real space image to generate a provisional superimposed image. A post-processing section performs post-processing on the provisional superimposed image. A chroma key generation section performs chroma key processing on the computer graphics image on the basis of depth information regarding the captured real space image, to thereby generate a chroma key image. A composing section masks the provisional superimposed image subjected to the post-processing with the chroma key image, to thereby generate a composed chroma key image. The composed chroma key image is superimposed on the captured real space image to generate an augmented reality image.
Abstract: A gaze initiated interaction technique for facilitating interaction between wearers of head-mountable devices. Methods are shown which allow users to interact with each other following an event of interlocking gaze. Methods are also shown which allows the operator of a personal point-of-interest beacon to control and limit interaction from the public thus ensuring a greater degree of privacy. Methods are also introduced which allow a mode of interaction to be determined by a remote service after mutual authorization of each interacting user. This disclosure also introduces a system of a head-mountable device which comprises a directional beacon transceiver system using beams in the infrared light spectrum enabling the detection of a gaze interlock event.
Type:
Grant
Filed:
November 13, 2020
Date of Patent:
September 21, 2021
Inventor:
Maximilian Ralph Peter von und zu Liechtenstein
Abstract: An image generating apparatus includes a rendering unit carrying out rendering of an object of a virtual space and an object of a real space and carrying out rendering of expression relating to light of the virtual space with respect to the real space to generate a computer graphics image, a superimposing unit superimposing the computer graphics image on a photographed image of the real space to generate a provisional superposition image, a chroma key generating unit generating a chroma key image through executing chroma key processing for the computer graphics image based on depth information of the photographed image of the real space, and a synthesizing unit generating a synthesized chroma key image used for being superimposed on the photographed image of the real space to generate an augmented reality image by applying a mask to the provisional superposition image by the chroma key image.
Abstract: An electronic device is provided. The electronic device includes a first sensor, a memory, a display, and a processor. The processor is configured to identify an ambient illuminance of the electronic device using the first sensor, when the identified illuminance is within a first illuminance range, designate a position where content stored in the memory is to be displayed in at least part of a first display region corresponding to a first field of view (FOV), and when the identified illuminance is within a second illuminance range, designate the position where the content is to be displayed in at least part of a second display region corresponding to a second FOV broader than the first FOV.
Type:
Grant
Filed:
April 18, 2019
Date of Patent:
September 14, 2021
Inventors:
Junwhon Uhm, Yunguk Lee, Seungnyun Kim, Yongsang Yun
Abstract: According to at least some example embodiments, a computer-readable medium stores computer-executable program instructions that, when executed by a processor, cause the processor to perform operations including, obtaining plane information of a plane by using first distances from a terminal to a plurality of points on the plane; obtaining a normal vector of the plane by using direction information of the terminal measured by a direction sensor and the plane information; determining, based on the normal vector, a parameter of an object to be displayed on the plane; and displaying, on a display of the terminal, the object according to the determined parameter.
Abstract: Example embodiments described herein relate to an augmented-reality system to generate and cause display of interactive augmented reality content at a client device.
Type:
Grant
Filed:
September 10, 2019
Date of Patent:
August 31, 2021
Assignee:
Snap Inc.
Inventors:
David Li, Piers Cowburn, Isac Andreas Müller Sandvik, Qi Pan
Abstract: The present invention relates to a basketball shooting game played using smart glasses, and more specifically, to a real-time basketball shooting game that enables at least two players at basketball courts at remote locations anywhere in the world to play a real basketball shooting game with one another using smart glasses.
Abstract: According to a specific embodiment of the present invention, an object at each viewpoint is recognized through image recognition, each recognized object is labeled, directional values and label values of objects that are determined as being the same are then input into an MPD, the MPD is transported, a direction of an object at a viewpoint to be moved, within an image, is corrected with a derived offset directional value, reproduction is performed, and thus, only with the labeling and the directional value of the object, the same content can be displayed on a screen without the user switching between directions. Accordingly, a reduction in an amount of data to be processed can improve a processing speed, and in turn, a sense of reality can be improved. Additionally, compatibility with an existing DASH structure is ensured, and applicability to existing image transport systems is widely expandable.
Type:
Grant
Filed:
December 6, 2019
Date of Patent:
July 6, 2021
Assignee:
Fdn. For Res.&Bus., Seoul Nat. Univ. Of Sci.&Tech.
Abstract: A content providing device, a content providing method, and a storage medium which allows a user to ascertain a state of a tourist spot on the day of travel are provided. A content providing device includes a first acquirer configured to acquire a travel plan that includes at least a scheduled visit date and a scheduled location to be visited of a user, a second acquirer configured to acquire content that indicates a state of a scheduled location to be visited scheduled or estimated on the scheduled visit date of the user according to an image on the basis of the travel plan, and a reproduction controller configured to cause a reproduction device to reproduce the content.
Abstract: There is provided an information processing apparatus to enable more proper control of a projection of an object notifying a user of a message on the basis of an attribute of the message. The information processing apparatus includes: an acquisition unit that acquires a message; and a control unit that controls projection of an object notifying a user of the message on the basis of an attribute of the message.
Abstract: Methods and systems may be directed to retrieving personal information relating to a user of a wearable head device, detecting a physical structure at a geo-spatial location, associating a digital content with the geo-spatial location based on at least the detected physical structure, determining whether the user is near the geo-spatial location, and presenting the digital content on a see-through display of the wearable head device. Presenting the digital content on the see-through display may comprise indicating a spatial relationship between the digital content and the physical structure.
Type:
Grant
Filed:
April 6, 2020
Date of Patent:
June 1, 2021
Assignee:
Mentor Acquisition One, LLC
Inventors:
Ralph F. Osterhout, John D. Haddick, Robert Michael Lohse, John N. Border, Nima L. Shams
Abstract: This disclosure is generally directed to systems and methods for generating a customized display in a vehicle. The customized display may be generated on the basis of various factors such as a reason for executing a trip, a preferred travel model, and/or operating parameters of the vehicle. A few exemplary reasons for executing a trip can include taking a vacation, delivering a package, dropping off a passenger, dining out, going to work, a fuel fill up, and/or for charging a battery. A computer may utilize such reasons to identify objects of interest in a geographical area surrounding the vehicle when the vehicle is executing the trip and generate a customized display that includes these objects. For example, when the reason for executing the trip is a vacation, the objects in the customized display may include a tourist attraction, a landmark, a fueling station, an electric charging station, and/or a restaurant.
Type:
Grant
Filed:
August 7, 2019
Date of Patent:
May 25, 2021
Assignee:
Ford Global Technologies, LLC
Inventors:
Venkata Maruthe Ravikumara Sharma Chengalvala, James Wilhelm Heaton
Abstract: A method for creating image products includes the following steps. Image data and positional data corresponding to the image data are captured and processed to create geo-referenced images. Edge detection procedures are performed on the geo-referenced images to identify edges and produce geo-referenced, edge-detected images. The geo-referenced, edge-detected images are saved in a database. A user interface to view and interact with the geo-referenced image is also provided such that the user can consistently select the same Points of Interest between multiple interactions and multiple users.
Type:
Grant
Filed:
April 13, 2020
Date of Patent:
May 11, 2021
Assignee:
Pictometry International Corp.
Inventors:
Steven Douglas Adams, Yandong Wang, Frank D. Giuffrida
Abstract: Provided is a an inspection assistance device. This inspection assistance device is provided with: an image data acquisition unit that acquires image data in which a to-be-inspected object is captured; a display control unit that causes a display unit to display information about inspection results of the to-be-inspected object, recognized on the basis of the acquired image data, in such a manner as to be superimposed on an image that includes the to-be-inspected object; and a recording control unit that records the information being displayed on the display unit and the information about the to-be-inspected object in association with each other.
Type:
Grant
Filed:
February 28, 2017
Date of Patent:
May 11, 2021
Assignee:
NEC CORPORATION
Inventors:
Takami Sato, Kota Iwamoto, Yoshinori Saida, Shin Norieda
Abstract: A physician performing a physical examination can miss subtle abnormalities, such as alterations of respiratory rate or dangerous skin lesion. A surgeon performing surgery can miss small areas of bleeding or tumor implants. This invention comprises head display unit comprising sensors that gathers data and in real time analyzes the data for potential hazards and alerts the user of a potential hazardous scenario.