Panoramic Patents (Class 348/36)
  • Patent number: 9836408
    Abstract: A data processing method, a computer readable medium, and a data processing device capable of improving processing efficiency are provided. A storage destination of sub-read blocks is changed to a high-speed small-capacity memory on a high layer by adding a shape attribute in an attribute group for data blocks, adding a memory access monitoring unit for obtaining the shape attribute of a data block to the configuration of a data processing device, obtaining the shape attribute of the non-rectangular read block by executing a program on a trial basis, and propagating this shape attribute in a direction opposite to a data flow or a process flow within the program.
    Type: Grant
    Filed: October 16, 2015
    Date of Patent: December 5, 2017
    Assignee: Renesas Electronics Corporation
    Inventor: Katsunori Tanaka
  • Patent number: 9832448
    Abstract: Using the techniques discussed herein, a set of images is captured by one or more array imagers (106). Each array imager includes multiple imagers configured in various manners. Each array imager captures multiple images of substantially a same scene at substantially a same time. The images captured by each array image are encoded by multiple processors (112, 114). Each processor can encode sets of images captured by a different array imager, or each processor can encode different sets of images captured by the same array imager. The encoding of the images is performed using various image-compression techniques so that the information that results from the encoding is smaller, in terms of storage size, than the uncompressed images.
    Type: Grant
    Filed: April 6, 2016
    Date of Patent: November 28, 2017
    Assignee: Google Technology Holdings LLC
    Inventors: John T. Bretscher, Randall S. Vaas
  • Patent number: 9823441
    Abstract: A three-piece optical lens for capturing image and a three-piece optical module for capturing image, along the optical axis in order from an object side to an image side, include a first lens with positive refractive power, wherein an object-side surface thereof can be convex; a second lens with refractive power; and a third lens with refractive power, wherein both surfaces of each of the aforementioned lenses can be aspheric; the third lens can have positive refractive power, wherein an image-side surface thereof can be concave, and both surfaces thereof are aspheric; at least one surface of the third lens has an inflection point whereby the optical lens can increase aperture value and improve the imaging quality for use in compact cameras.
    Type: Grant
    Filed: October 8, 2015
    Date of Patent: November 21, 2017
    Assignee: Ability Opto-Electronics Technology Co., Ltd.
    Inventors: Yao-Wei Liu, Yeong-Ming Chang
  • Patent number: 9819854
    Abstract: A mobile terminal and a method for controlling the same are disclosed. The mobile terminal and method for controlling same can recognize a first input, which is applied to a first area of the display unit on which a preview image obtained by driving a camera is displayed, as a triggering signal for entering a specific photographing mode and enter the specific photographing mode, upon reception of the first input. According to the present invention, grip of the mobile terminal can be improved by processing an operation of gripping the mobile terminal as a valid input.
    Type: Grant
    Filed: January 20, 2015
    Date of Patent: November 14, 2017
    Assignee: LG ELECTRONICS INC.
    Inventor: Daeduek Cho
  • Patent number: 9819863
    Abstract: Aspects relate to methods and systems for producing ultra-wide field of view images. In some embodiments, an image capture system for capturing wide field-of-view images comprises an aperture, a central camera positioned to receive light through the aperture, the center camera having an optical axis, a plurality of periphery cameras disposed beside the central camera and pointed towards a portion of the optical axis of the center camera, the plurality of cameras arranged around the center camera, and a plurality of extendible reflectors. The reflectors are configured to move from a first position to a second position and have a mirrored first surface that faces away from the optical axis of the center camera and a second black surface that faces towards the optical axis of the center camera, the plurality of periphery cameras arranged around the center camera.
    Type: Grant
    Filed: June 15, 2015
    Date of Patent: November 14, 2017
    Assignee: QUALCOMM Incorporated
    Inventors: Thomas Wesley Osborne, Todor Georgiev Georgiev, Sergiu Radu Goma
  • Patent number: 9811934
    Abstract: The present disclosure relates to a mobile terminal capable of image capture and a control method thereof. A mobile terminal according to an embodiment of the present disclosure may include a display unit, a camera arranged with a plurality of lenses along a plurality of lines, and a controller configured to capture images entered through the plurality of lenses, and display a first image on the display unit among a plurality of captured images, wherein the controller changes at least one region of the first image to at least part of an image different from the first image among the plurality of images based on the user's selection.
    Type: Grant
    Filed: February 5, 2014
    Date of Patent: November 7, 2017
    Assignee: LG ELECTRONICS INC.
    Inventors: Minchul Kim, Jeonghyun Lee, Kyungmin Cho, Jaemoo Lee, Jongkyeong Park
  • Patent number: 9811733
    Abstract: A method of selecting a frame from a plurality of video frames captured by a camera (120). The method determines features to which map points in a three dimensional space are projected. A histogram of the determined features for a plurality of regions in the frame is created. One of the regions may be determined as being an unmapped region based on the created histogram. The frame is selected based on the size of the unmapped region.
    Type: Grant
    Filed: October 2, 2014
    Date of Patent: November 7, 2017
    Assignee: Canon Kabushiki Kaisha
    Inventor: Ka Ming Leung
  • Patent number: 9804023
    Abstract: A glare measuring system is configured to have an imaging camera which is supported to be rotatable within a horizontal plane, and a processing device which calculates equivalent veiling luminance on the basis of a pickup image of the imaging camera and calculates the value of a glare rating GR on the basis of the equivalent veiling luminance. The imaging camera has a super-wide-angle lens mounted thereon, and picks up an image in a position which is rotated within the horizontal plane by every angle corresponding to the angle of view ? of the super-wide-angle. The processing device combines pickup images to generate a composite image in which a glare measurement direction is set to the center of the composite image, calculates equivalent veiling luminance on the basis of the composite image, and calculates the value of the glare rating in the glare measurement direction.
    Type: Grant
    Filed: February 25, 2013
    Date of Patent: October 31, 2017
    Assignee: IWASAKI ELECTRIC CO., LTD.
    Inventors: Tetsuji Yamada, Kosuke Oshima
  • Patent number: 9802538
    Abstract: A method provides driver information in a motor vehicle, in which method a recording device of the motor vehicle captures an image flow containing images of at least one part of the environment of the motor vehicle. A display unit in the interior of the motor vehicle reproduces at least one image section of the image flow. A display control unit of the motor vehicle automatically modifies the environmental section shown to the driver by reproducing the image section using the display unit. During the reproduction of the image section, in addition to the representation of the environmental section, at least first optical information relating to the position of the environmental section relative to the motor vehicle is output to the driver.
    Type: Grant
    Filed: March 16, 2010
    Date of Patent: October 31, 2017
    Assignee: Bayerische Motoren Werke Aktiengesellschaft
    Inventor: Alexander Augst
  • Patent number: 9800786
    Abstract: A stable and controllable shooting apparatus, comprising a shooting module, a stabilizer module and a main control module, wherein the shooting module and the stabilizer module are respectively connected with the main control module, the stabilizer module comprises a handheld part and an X-axis motor, a Y-axis motor, and a Z-axis motor which are arranged at top of the handheld part and are orthogonal in a space, wherein a stator of the Z-axis motor is connected with the handheld part, a rotor of the Z-axis motor is connected with a stator of the Y-axis motor, a rotor of the Y-axis motor is connected with a stator of the X-axis motor, and a rotor of the X-axis motor is connected with the shooting module. The stable and controllable shooting apparatus may be quickly stabilized during moving shooting and its shooting direction may be controlled.
    Type: Grant
    Filed: June 8, 2016
    Date of Patent: October 24, 2017
    Assignee: Guilin Feiyu Technology Corporation Ltd.
    Inventor: Chengyun Wei
  • Patent number: 9794479
    Abstract: The present invention relates to the field of panoramic still and motion photography. In a first embodiment, a camera apparatus for panoramic photography includes a first image sensor positioned to capture a first image. The first image sensor has a rolling-shutter readout arranged in portrait orientation. The camera apparatus also includes second image sensor positioned to capture a second image. The second image sensor has a rolling-shutter readout arranged in portrait orientation. Finally, the camera apparatus includes a controller configured to signal the second image sensor to start capturing the second image before the first image sensor finishes capturing the first image. At least a portion of the first image is in front of the second image relative to a forward direction of the camera apparatus.
    Type: Grant
    Filed: January 26, 2016
    Date of Patent: October 17, 2017
    Assignee: Google Inc.
    Inventors: Richard Francis Lyon, Gary Embler, Iain Richard Tyrone McClatchie, Jason Holt
  • Patent number: 9794498
    Abstract: Multiple cameras are arranged in an array at a pitch, roll, and yaw that allow the cameras to have adjacent fields of view such that each camera is pointed inward relative to the array. The read window of an image sensor of each camera in a multi-camera array can be adjusted to minimize the overlap between adjacent fields of view, to maximize the correlation within the overlapping portions of the fields of view, and to correct for manufacturing and assembly tolerances. Images from cameras in a multi-camera array with adjacent fields of view can be manipulated using low-power warping and cropping techniques, and can be taped together to form a final image.
    Type: Grant
    Filed: October 23, 2015
    Date of Patent: October 17, 2017
    Assignee: GoPro, Inc.
    Inventors: Timothy MacMillan, Scott Patrick Campbell
  • Patent number: 9792690
    Abstract: A shape measurement system includes one or more lighting units located in a case that illuminate a target object located in the case, one or more image capture units located in the case that capture an image of the target object, a holding unit that holds the image capture units and the lighting units so as to form a polyhedron shape approximating a sphere, a selector that selects at least one of the image capture units and at least one of the lighting units to be operated, and a shape calculator that calculates a 3-D shape of the target object based on image data captured by the selected image capture unit under light emitted by the selected lighting unit.
    Type: Grant
    Filed: June 10, 2015
    Date of Patent: October 17, 2017
    Assignee: Ricoh Company, Ltd.
    Inventors: Akira Kinoshita, Atsuo Kawaguchi, Shogo Ishida, Kazuki Tokoyoda
  • Patent number: 9787939
    Abstract: Video conferencing is performed using near-end and far-end devices at near-end and far-end sites, respectively. Each device has a display surface and a video camera. The view of the far-end scene displayed by the near-end device is selected as a function of the position of the near-end user relative to the near-end device. As the near-end user moves toward the left, the view pans toward the right of the far-end scene. As the near-end user moves toward the right, the view pans toward the left of the far-end scene.
    Type: Grant
    Filed: November 19, 2014
    Date of Patent: October 10, 2017
    Assignee: Amazon Technologies, Inc.
    Inventors: Julien George Beguin, Eric Alan Breitbard, Robert Steven Murdock, Meng Li, Michael Douglas McQueen
  • Patent number: 9779093
    Abstract: A method, apparatus, and computer program product are provided in order to playback video and/or audio files wherein a desired segment is selected and played back based on its spatial audio content. In the context of a method, playback of media data is provided. The method may include generating one or more spatial seek points for the media data and causing display of information corresponding to the one or more spatial seek points. The method may further include performing the generation of the one or more seek points based on receiving a request for spatial seek points, automatically upon receiving the media data or upon starting playback of the media data, or based on the format of the media data. The method may further include receiving a selection of one of the one or more spatial seek points and providing for playback of the media data from a time point corresponding to the selected spatial seek point. A corresponding apparatus and a computer program product are also provided.
    Type: Grant
    Filed: December 19, 2012
    Date of Patent: October 3, 2017
    Assignee: Nokia Technologies Oy
    Inventors: Roope Olavi Jarvinen, Miikka Vilermo
  • Patent number: 9781334
    Abstract: A control method, a camera device and an electronic equipment are provided in the disclosure. After acquiring a first control instruction, the lens of the camera device is controlled to perform a preset operation according to the first control instruction, until a preview image captured by the camera device meets a first preset requirement. The preset operation at least includes controlling the lens to form a first inclination angle with respect to an initial position of the lens. Thus the angle between a lens plane and an image plane is adjusted, i.e., the clarity at various parts of the image acquired by the camera device is adjusted, thus a target image desired by a user can be acquired by the camera device, thereby improving user experiences.
    Type: Grant
    Filed: September 29, 2015
    Date of Patent: October 3, 2017
    Assignees: Beijing Lenovo Software Ltd., Lenovo (Beijing) Co., Ltd.
    Inventor: Jiefeng Chen
  • Patent number: 9781342
    Abstract: Systems and methods for identifying comment clusters for panoramic content segments. A panoramic content segment of digital content may be hosted to client computing platforms. User comment information may be received. The user comment information may convey user comments, include time indications for a duration of a content segment, and/or include location indications for a panorama of the panoramic content segment. A comment distribution may be determined from the user comment information. A comment cluster may be identified based on the comment distribution. View information may be received from a client computing platform. Whether a view range associated with the comment cluster identified is located within or outside one or more visible ranges of viewing angles selected by the user may be determined. Alert information may be generated and/or transmitted for effectuating presentation of a notification on the client computing platform associated with the user.
    Type: Grant
    Filed: October 22, 2015
    Date of Patent: October 3, 2017
    Assignee: GoPro, Inc.
    Inventors: Logan Turley, David Chalmers, Todd Garnet Wagner, Karan Nischol
  • Patent number: 9770203
    Abstract: A force measurement system is disclosed herein. The force measurement system includes a force measurement assembly configured to receive a subject thereon, at least one visual display device having an output screen, and one or more data processing devices configured to generate a screen image comprising a plurality of substantially concentric bands on the output screen of the at least one visual display device that is configured to create a visual stimuli for the subject disposed on the force measurement assembly. A method for testing a subject is also disclosed herein. The method for testing a subject utilizes reality-altering glasses that are used to perturb a visual input of a subject. Also, in one or more embodiments, the reality-altering glasses are used in conjunction with a force measurement assembly configured to receive the subject thereon.
    Type: Grant
    Filed: November 30, 2016
    Date of Patent: September 26, 2017
    Assignee: Bertec Corporation
    Inventors: Necip Berme, Scott Zerkle Barnes, Lewis Michael Nashner
  • Patent number: 9761050
    Abstract: Provided is an information provision device for a glasses-type terminal, including: a camera; and a controller that is configured to detect a first object from an image that is captured through the camera, to recognize information that is indicated on the detected first object, to recognize a second object associated with the recognized information from the image that is captured through the camera for a predetermined first time starting from a point in time at which the first object is detected, and to store the recognized second object in a storage unit along with the recognized information.
    Type: Grant
    Filed: July 21, 2014
    Date of Patent: September 12, 2017
    Assignee: LG ELECTRONICS INC.
    Inventors: Sunryang Kim, Jinsung Im, Jongpil Won
  • Patent number: 9762796
    Abstract: There is provided an image processing apparatus including a display image generation section configured to generate display image data by performing a display projection process in a case where panorama image data to be a display target is judged to be a full circumference panorama image.
    Type: Grant
    Filed: April 3, 2013
    Date of Patent: September 12, 2017
    Assignee: Sony Corporation
    Inventor: Atsushi Kimura
  • Patent number: 9757985
    Abstract: A system and method for providing a gear selection indication for a vehicle that includes receiving an image of a gear shifting region of the vehicle from a vehicle camera system. The system and method also include processing the image of the gear shifting region into processed image data. Additionally, the system and method include determining a currently selected gear of a plurality of gears of a transmission unit of the vehicle based on the processed image data. The system and method further include outputting the currently selected gear of the plurality of gears. Outputting the determined currently selected gear includes at least one of: communicating the currently selected gear to a gear selection indicator that presents the determined currently selected gear, and communicating the currently selected gear to vehicle systems.
    Type: Grant
    Filed: September 25, 2015
    Date of Patent: September 12, 2017
    Assignee: Honda Motor Co., Ltd.
    Inventor: Jun Iwamoto
  • Patent number: 9747677
    Abstract: An example disclosed method includes generating a composite image by merging unblocked portions of first and second images, each of the first and second images being representative of an environment; identifying a blocked portion of the first and second images; determining, by the processor, whether the blocked portion has been blocked for greater than a threshold amount of time; and in response to determining that the blocked portion has been blocked for greater than the threshold amount of time, including the blocked portion in the composite image.
    Type: Grant
    Filed: May 23, 2016
    Date of Patent: August 29, 2017
    Assignee: Symbol Technologies, LLC
    Inventors: Richard M. Clayton, Karthik Lakshminarayanan, Miklos Stern
  • Patent number: 9749539
    Abstract: An image processing apparatus that records a moving image used for generating a still image by a generation unit, comprises: a correction amount calculation unit configured to calculate, for each frame of the moving image, a correction amount for correction of a rolling shutter distortion of an image signal based on a shake amount detected by a camera shake amount detection unit; and a recording unit configured to record the correction amount in association with an image for each frame of the moving image, wherein the generation unit corrects an image of a selected frame from among the images of the frames based on the associated correction amount, and generates a still image.
    Type: Grant
    Filed: September 4, 2015
    Date of Patent: August 29, 2017
    Assignee: Canon Kabushiki Kaisha
    Inventor: Kenichi Miyasako
  • Patent number: 9742994
    Abstract: This specification describes technologies relating to digital images. In general, one aspect of the subject matter described in this specification can be embodied in methods that include the actions of receiving a source wide-angle image; identifying one or more locally salient features of the source wide-angle image; calculating a mapping from the source wide-angle image to a two-dimensional mapped wide-angle image according to constraints using the identified one or more spatially variable salient features; and rendering the mapped wide-angle image using the calculated mapping such that the mapped wide-angle image reduces distortion of the locally salient features relative to the distortion of the source wide angle image.
    Type: Grant
    Filed: August 7, 2013
    Date of Patent: August 22, 2017
    Assignee: Adobe Systems Incorporated
    Inventors: Aseem O. Agarwala, Robert E. Carroll
  • Patent number: 9733458
    Abstract: Aspects relate to an array camera exhibiting little or no parallax artifacts in captured images. For example, the planes of the central mirror surfaces of the array camera can be located at a midpoint along, and orthogonally to, a line between the corresponding camera location and the virtual camera location. Accordingly, the cones of all of the cameras in the array appear as if coming from the virtual camera location after folding by the mirrors. Each sensor in the array “sees” a portion of the image scene using a corresponding facet of the central mirror prism, and accordingly each individual sensor/mirror pair represents only a sub-aperture of the total array camera. The complete array camera has a synthetic aperture generated based on the sum of all individual aperture rays.
    Type: Grant
    Filed: May 24, 2016
    Date of Patent: August 15, 2017
    Assignee: QUALCOMM Incorporated
    Inventors: Todor Georgiev Georgiev, Thomas Wesley Osborne, Sergiu Radu Goma
  • Patent number: 9736370
    Abstract: A hand-held digital camera has a touch-sensitive display screen (“touch screen”) for image preview and user control of the camera, and a user-selectable panorama mode. Upon entering panorama mode the camera superimposes upon the touch screen a horizontal rectangular bar whose width and/or height are user-adjustable by interaction with the touch screen to select a desired horizontal sweep angle. After the sweep angle is set the camera automatically captures successive horizontally overlapping images during a sweep of the device through the selected sweep angle. Subsequently the camera synthesizes a panoramic image from the successively captured images, the panoramic image having a width corresponding to the selected sweep angle.
    Type: Grant
    Filed: November 21, 2013
    Date of Patent: August 15, 2017
    Assignee: FotoNation Limited
    Inventors: Igor Barcovschi, George Susanu, Serghei Carateev
  • Patent number: 9734413
    Abstract: An image generation apparatus includes a processor that generates an output image based on input images captured by multiple imaging units mounted on a paver including a hopper, a tractor, and a screed. The output image includes a hopper image representing a downward view of the hopper, a left-side surrounding image representing a downward view of a surrounding area on the left side in a movement direction of the paver, a right-side surrounding image representing a downward view of a surrounding area on the right side in the moving direction of the paver, and an illustration image of the tractor. The processor arranges the hopper image, the left-side surrounding image, the right-side surrounding image, and the illustration image such that the output image represents a downward view of the paver.
    Type: Grant
    Filed: March 25, 2015
    Date of Patent: August 15, 2017
    Assignee: SUMITOMO HEAVY INDUSTRIES, LTD.
    Inventor: Tomoko Ichikawa
  • Patent number: 9729771
    Abstract: A three-piece optical lens for capturing image and a three-piece optical module for capturing image, along the optical axis in order from an object side to an image side, include a first lens with positive refractive power; a second lens with refractive power; and a third lens with refractive power; and at least one of the image-side surface and object-side surface of each of the three lens elements are aspheric. The optical lens can increase aperture value and improve the imaging quality for use in compact cameras.
    Type: Grant
    Filed: April 1, 2015
    Date of Patent: August 8, 2017
    Assignee: ABILITY OPTO-ELECTRONICS TECHNOLOGY CO., LTD.
    Inventors: Kuo-Yu Liao, Yao-Wei Liu, Yeong-Ming Chang
  • Patent number: 9723223
    Abstract: A server includes an input node to receive video streams forming a panoramic video. The server also receives audio tracks corresponding to the video streams. A module forms an audio track based upon a combination of at least two of the audio tracks and directional viewing data. The audio track may be a stereo, mixed or surround sound audio track with volume modulation based upon the directional viewing data. An output node sends the audio track to a client device.
    Type: Grant
    Filed: September 27, 2013
    Date of Patent: August 1, 2017
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventors: Bill Banta, Paul Alioshin
  • Patent number: 9723034
    Abstract: An online system and method are disclosed. An exemplary method includes providing meeting information to a server and/or a participant device prior to the online meeting and streaming audio content to participants during the meeting. The system and method allow online meeting participants to connect to and view meeting information using less network bandwidth during the meeting, compared to traditional online meeting systems and methods.
    Type: Grant
    Filed: December 13, 2012
    Date of Patent: August 1, 2017
    Assignee: Mitel Networks Corporation
    Inventors: Michael Yeung, Jim Davies
  • Patent number: 9720413
    Abstract: This disclosure relates to providing flight control for an unmanned aerial vehicle based on opposing fields of view with overlap. The UAV may include a housing, a motor, a first image sensor, a second image sensor, a first optical element having a first field of view greater than 180 degrees, a second optical element having a second field of view greater than 180 degrees, and one or more processors. The first optical element and the second optical element may be carried by the housing such that a centerline of the second field of view is substantially opposite from a centerline of the first field of view, and a peripheral portion of the first field of view and a peripheral portion of the second field of view overlap. Flight control for the UAV may be provided based on parallax disparity of an object within the overlapping fields of view.
    Type: Grant
    Filed: December 21, 2015
    Date of Patent: August 1, 2017
    Assignee: GoPro, Inc.
    Inventors: Pablo Lema, Gary Fong, Shu Ching Ip
  • Patent number: 9712746
    Abstract: One or more techniques and/or systems are provided for ordering images for panorama stitching and/or for providing a focal point indicator for image capture. For example, one or more images, which may be stitched together to create a panorama of a scene, may be stored within an image stack according to one or more ordering preferences, such as where manually captured images are stored within a first/higher priority region of the image stack as compared to automatically captured images. One or more images within the image stack may be stitched according to a stitching order to create the panorama, such as using images in the first region for a foreground of the panorama. Also, a current position of a camera may be tracked and compared with a focal point of a scene to generate a focal point indicator to assist with capturing a new/current image of the scene.
    Type: Grant
    Filed: March 14, 2013
    Date of Patent: July 18, 2017
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Blaise Aguera y Arcas, Markus Unger, Donald A. Barnett, David Maxwell Gedye, Sudipta Narayan Sinha, Eric Joel Stollnitz, Johannes Kopf
  • Patent number: 9709772
    Abstract: A three-piece optical lens for capturing image and a three-piece optical module for capturing image, along the optical axis in order from an object side to an image side, include a first lens with positive refractive power; a second lens with refractive power; and a third lens with refractive power; and at least one of the image-side surface and object-side surface of each of the three lens elements are aspheric. The optical lens can increase aperture value and improve the imaging quality for use in compact cameras.
    Type: Grant
    Filed: August 4, 2015
    Date of Patent: July 18, 2017
    Assignee: ABILITY OPTO-ELECTRONICS TECHNOLOGY CO., LTD.
    Inventors: Yao-Wei Liu, Yeong-Ming Chang
  • Patent number: 9704361
    Abstract: A user may input one or more messages (e.g., visual or audio content) with respect to a projection device that is to project the messages to users within an environment. The user may additionally input related information that dictates a context and manner in which the messages are to be projected. The projection device may monitor the environment to identify users, events or actions within the environment. Upon detecting and identifying a particular user, the projection device may visually project the messages onto a surface within the environment, or may audibly output the messages within the environment, which may convey a particular meaning to that user. Optionally, the projection device may authenticate the user in order to determine that the user is the intended recipient of the messages.
    Type: Grant
    Filed: August 14, 2012
    Date of Patent: July 11, 2017
    Assignee: Amazon Technologies, Inc.
    Inventors: William R. Hazlewood, Shweta D. Grampurohit, Daniel C. Bay, Sunny A. Consolvo, Beverly L. Harrison
  • Patent number: 9704298
    Abstract: Systems and methods for generating a 360 degree mixed virtual reality environment that provides a 360 degree view of an environment in accordance with embodiments of the invention are described. In a number of embodiments, the 360 degree mixed virtual reality environment is obtained by (1) combining one or more real world videos that capture images of an environment with (2) a virtual world environment that includes various synthetic objects that may be placed within the real world clips. Furthermore, the virtual objects embedded within the 360 degree mixed reality environment interact with the real world objects depicted in the real world environment to provide a realistic mixed reality experience.
    Type: Grant
    Filed: June 21, 2016
    Date of Patent: July 11, 2017
    Assignee: Paofit Holdings Pte Ltd.
    Inventors: Tonny Espeset, Andrei Richard Frank, Marc Scott Hardy
  • Patent number: 9696404
    Abstract: A new apparatus and method for tracking a moving object with a moving camera provides a real-time, narrow field-of-view, high resolution and on target image by combining commanded motion with an optical flow algorithm for deriving motion and classifying background. Commanded motion means that movement of the pan, tilt and zoom (PTZ) unit is “commanded” by a computer, instead of being observed by the camera, so that the pan, tilt and zoom parameters are known, as opposed to having to be determined, significantly reducing the computational requirements for tracking a moving object.
    Type: Grant
    Filed: May 6, 2015
    Date of Patent: July 4, 2017
    Assignee: The United States of America as represented by the Secretary of the Air Force
    Inventors: Daniel D. Doyle, Alan L. Jennings, Jonathan T. Black
  • Patent number: 9699366
    Abstract: An image providing apparatus includes: a plurality of auxiliary imaging units that have shooting ranges partially overlapping one another, and each of which images a subject to generate auxiliary image data; a provider communication unit; a provider communication control unit that receives, from the portable device, via the provider communication unit, transmission request information requesting the image providing apparatus to transmit composite image data; and an image synthesizing unit that generates, based on the transmission request information, composite image data by combining the auxiliary image data respectively generated by two or more of the plurality of auxiliary imaging units. The provider communication control unit transmits, via the provider communication unit, the composite image data to the portable device.
    Type: Grant
    Filed: April 29, 2015
    Date of Patent: July 4, 2017
    Assignee: Olympus Corporation
    Inventors: Akinobu Sato, Saori Matsumoto, Keito Fukushima, Hiroki Amino, Takashi Hamada, Osamu Nonaka
  • Patent number: 9690079
    Abstract: Methods and apparatus for capturing or generating images using multiple optical chains operating in parallel are described. Pixel values captured by individual optical chains corresponding to the same scene area are combined to provide an image with at least some of the benefits which would have been provided by capturing an image of the scene using a larger lens than that of the individual lenses of the optical chain modules. By using multiple optical chains in parallel at least some benefits normally obtained from using a large lens can be obtained without the need for a large lens. Furthermore in at least some embodiments, a wide dynamic range can be supported through the use of multiple sensors with the overall supported dynamic range being potentially larger than that of the individual sensors. Some lens and/or optical chain configurations are designed for use in small handheld devices, e.g., cell phones.
    Type: Grant
    Filed: January 27, 2016
    Date of Patent: June 27, 2017
    Assignee: Light Labs Inc.
    Inventor: Rajiv Laroia
  • Patent number: 9692980
    Abstract: A digital camera includes a zoom function for supporting a user when performing a frame assist, and includes an operation switch for instructing startup and completion of the zoom function on an operation unit. A system control unit stores a zoom position in a memory and varies the zoom position in a wide angle position according to a preset zoom-out drive amount when an instruction to startup the zoom function is given by the operation switch. Then, when the instruction to end the zoom function is given by the operation switch, the system control unit executes a zoom-in operation by returning to the zoom position that is stored in the memory.
    Type: Grant
    Filed: January 24, 2017
    Date of Patent: June 27, 2017
    Assignee: Canon Kabushiki Kaisha
    Inventors: Akihiro Tsubusaki, Koki Kitaya, Eiji Yoshino
  • Patent number: 9691181
    Abstract: Systems and method for processing video frames generated for display on a head mounted display (HMD) to a second screen are provided. One example method includes receiving the video frames formatted for display on the HMD, and while passing the video frames to the HMD, selecting a portion of content from the video frames and processing the portion of the content for output to a second screen. The video frames viewed in the HMD are a result of interactive play executed for viewing on the HMD. The second screen configured to render an undistorted view of the interactive play on the HMD. In one example, the method and system enable additional content to be rendered on the second screen (e.g., second screen content, such as social interactive play with others, other non-game content, player-player communication, etc.).
    Type: Grant
    Filed: May 5, 2014
    Date of Patent: June 27, 2017
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Brian Watson, Anton Mikhailov, Jeffrey Stafford, Glenn Black
  • Patent number: 9686467
    Abstract: A direction of a sound source located in the surrounding of a detector of a panoramic video is established. A preset view of the panoramic video is determined based on the established direction. Playback of the panoramic video is based on the determined preset view.
    Type: Grant
    Filed: August 15, 2014
    Date of Patent: June 20, 2017
    Assignees: Sony Corporation, Sony Mobile Communications Inc.
    Inventors: Mikael Hansson, Staffan Björklund, Markus Agevik, Magnus Lindhe
  • Patent number: 9686468
    Abstract: An apparatus is described. An embodiment of an apparatus comprises a stationary first camera; a second camera; and a mechanical coupling enabling a first and a second camera position, wherein the mechanical coupling enables the rotation of the second camera with respect to the stationary first camera; wherein in the first camera position the first camera and the second camera are orientated in substantially opposite directions, and in the second camera position the second camera is orientated in substantially the same direction as the stationary first camera.
    Type: Grant
    Filed: October 15, 2015
    Date of Patent: June 20, 2017
    Assignee: Microsoft Technology Licensing, LLC
    Inventor: Marko Eromäki
  • Patent number: 9679382
    Abstract: A method of georeferencing a first image of a scene acquired from a first imaging device based on at least one second image of the scene acquired from a second imaging device. The method includes obtaining data indicative of an eligibility parameter for one or more areas of the scene; selecting one or more pivot areas among the one or more areas of the scene, wherein the eligibility parameter of the pivot areas satisfy a predefined criterion; for at least some of the selected pivot areas, identifying tie points for the first and second images; and solving the external orientation of the first image using the identified tie points and a first imaging device model.
    Type: Grant
    Filed: June 25, 2014
    Date of Patent: June 13, 2017
    Assignee: ISRAEL AEROSPACE INDUSTRIES LTD.
    Inventors: Garry Haim Zalmanson, Gil Bar Hillel
  • Patent number: 9681047
    Abstract: Disclosed is an image feature extraction method including a step of defining a combination of at least two kinds of solid angles along at least two directions, of an input spherical image; a step of determining respective values of the combination of the at least two kinds of solid angles, so that surface areas of spherical crowns of spherical segments, which are obtained by dividing the spherical image by the respective values of the combination of the at least two kinds solid angles, have a same value; and a step of generating, by utilizing the respective values of the combination of the at least two kinds of solid angles, an image feature template so as to conduct image feature extraction.
    Type: Grant
    Filed: July 30, 2015
    Date of Patent: June 13, 2017
    Assignee: Ricoh Company, Ltd.
    Inventors: Na He, Gang Wang, Zhongchao Shi, Dianchao Liu, Yaojie Lu
  • Patent number: 9669761
    Abstract: The present invention provides an around view monitoring (AVM) apparatus, including: a plurality of cameras which is mounted on a vehicle; a video composing unit which receives a plurality of videos from the plurality of cameras and composes the plurality of videos to generate an around view video; a brightness correcting unit which receives the around view video and corrects and outputs the brightness of the around view video based on an average brightness value and a variance of the brightness values for every region which is included in the around view video; and a video display unit which displays the around view video whose brightness is corrected.
    Type: Grant
    Filed: October 16, 2014
    Date of Patent: June 6, 2017
    Assignee: HYUNDAI MOBIS CO., LTD.
    Inventor: Sung Joo Lee
  • Patent number: 9671595
    Abstract: Methods and apparatus for capturing or generating images using multiple optical chains operating in parallel are described. Pixel values captured by individual optical chains corresponding to the same scene area are combined to provide an image with at least some of the benefits which would have been provided by capturing an image of the scene using a larger lens than that of the individual lenses of the optical chain modules. By using multiple optical chains in parallel at least some benefits normally obtained from using a large lens can be obtained without the need for a large lens. Furthermore in at least some embodiments, a wide dynamic range can be supported through the use of multiple sensors with the overall supported dynamic range being potentially larger than that of the individual sensors. Some lens and/or optical chain configurations are designed for use in small handheld devices, e.g., cell phones.
    Type: Grant
    Filed: January 5, 2014
    Date of Patent: June 6, 2017
    Assignee: Light Labs Inc.
    Inventor: Rajiv Laroia
  • Patent number: 9674507
    Abstract: Disclosed are a system, apparatus, and method for monocular visual simultaneous localization and mapping that handles general 6DOF and panorama camera movements. A 3D map of an environment containing features with finite or infinite depth observed in regular or panorama keyframes is received. The camera is tracked in 6DOF from finite, infinite, or mixed feature sets. Upon detection of a panorama camera movement towards unmapped scene regions, a reference panorama keyframe with infinite features is created and inserted into the 3D map. When panoramic camera movement extends toward unmapped scene regions, the reference keyframe is extended with further dependent panorama keyframes. Panorama keyframes are robustly localized in 6DOF with respect to finite 3D map features. Localized panorama keyframes contain 2D observations of infinite map features that are matched with 2D observations in other localized keyframes. 2D-2D correspondences are triangulated, resulting in new finite 3D map features.
    Type: Grant
    Filed: January 9, 2014
    Date of Patent: June 6, 2017
    Assignee: QUALCOMM Incorporated
    Inventors: Christian Pirchheim, Dieter Schmalstieg, Gerhard Reitmayr
  • Patent number: 9665260
    Abstract: A method and an apparatus for controlling a screen of a mobile device are provided. The method includes detecting an object from an image captured through an image sensor, detecting movement of a location of the object to move a location of the screen, and moving and displaying the screen according to the detected movement of the location of the object. According to the present disclosure, a screen can be moved and displayed according to movement of an object detected from an image captured by an image sensor. Accordingly, users can easily operate mobile devices of various sizes only with one hand.
    Type: Grant
    Filed: September 3, 2014
    Date of Patent: May 30, 2017
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Yohan Lee, Jaebong Chun
  • Patent number: 9652856
    Abstract: An image processing system includes an image receiver to receive a first image sequence composed of first partial images and a second image sequence composed of second partial images captured at a plurality of time points, each one of the first partial images and corresponding each one of the second partial images captured at substantially the same time point, a detection unit to detect a stitching position of each one of the first partial images and corresponding each one of the second partial images captured at substantially the same time point, a correction unit to correct the stitching position at the plurality of time points, and an image synthesis processing unit to synthesize each one of the first partial images and corresponding each one of the second partial images captured at substantially the same time point based on the corrected stitching position information to generate a plurality of synthesis images.
    Type: Grant
    Filed: July 29, 2015
    Date of Patent: May 16, 2017
    Assignee: Ricoh Company, Ltd.
    Inventor: Hirokazu Takenaka
  • Patent number: 9638829
    Abstract: An autonomous and controllable system of sensors and methods for using such a system of sensors are described.
    Type: Grant
    Filed: November 11, 2014
    Date of Patent: May 2, 2017
    Assignee: CALIFORNIA INSTITUTE OF TECHNOLOGY
    Inventors: Faranak Davoodi, Farhooman Davoudi