More Than Two Cameras Patents (Class 348/48)
  • Patent number: 10818038
    Abstract: Embodiments of the present disclosure techniques for modeling and capturing the dynamic appearance of skin. These techniques can couple dynamic reflectance parameters for skin (albedo and specular reflectance) with dynamic geometry. The disclosed techniques allow for capture and modeling of the dynamic appearance of skin for an actor. The techniques can re-render the actor's face accurately to accurately model the appearance of skin including the albedo of skin that can change primarily due to blood flow. The techniques can also re-render the actor's face accurately under multiple different lighting conditions.
    Type: Grant
    Filed: December 5, 2018
    Date of Patent: October 27, 2020
    Assignee: DISNEY ENTERPRISES, INC.
    Inventors: Thabo Beeler, Abhijeet Ghosh, Derek Bradley, Jeremy Riviere, Paulo F. Urnau Gotardo
  • Patent number: 10798368
    Abstract: In one embodiment, a computing system may determine a first target region within a first field of view of a first camera and a second target region within a second field of view of a second camera. The first field of view and the second field of view may be partially overlapping. The system may determine first lighting conditions of the first target region. The system may determine a first exposure time for at least the first camera and the second camera based at least in part on the determined first lighting conditions. The system may instruct the first camera and the second camera to take pictures using the determined first exposure time.
    Type: Grant
    Filed: March 11, 2019
    Date of Patent: October 6, 2020
    Assignee: Lyft, Inc.
    Inventors: Forrest Samuel Briggs, James Allen-White Hoffacker, Dhruv Lamba, Phillip Sawbridge
  • Patent number: 10789767
    Abstract: A method for three-dimensional (3D) modeling using two-dimensional (2D) image data includes obtaining a first image of an object oriented in a first direction and a second image of the object oriented in a second direction, determining a plurality of feature points of the object in the first image, and determining a plurality of matching feature points of the object in the second image that correspond to the plurality of feature points of the object in the first image. The method further includes calculating similarity values between the plurality of feature points and the corresponding plurality of matching feature points, calculating depth values of the plurality of feature points, calculating weighted depth values based on the similarity values and depth values, and performing 3D modeling of the object based on the weighted depth values.
    Type: Grant
    Filed: September 9, 2019
    Date of Patent: September 29, 2020
    Assignee: Alibaba Group Holding Limited
    Inventor: Jie Zhang
  • Patent number: 10764482
    Abstract: The invention concerns a portable device that, even for a device of small dimensions, increases the amount of the recorded imagery data of a measured object in a fixed position in order to obtain spatially varying surface reflectance data, i.e. Bidirectional Texture Function data, and the multidirectional imaging of real objects with the use of a basic three-dimensional object (2) equipped with first illumination units (4) and/or exit apertures of a light guiding system (21) in combination with multiplication of optical elements (11) contributing to the imaging on the acquisition system and/or second illumination units (9) and/or acquisition elements of the camera/detector type and/or third illumination units (12), by their placement on moveable arms (7, 8, 13) attached to the basic three-dimensional object (2). This principle is usable for small portable devices and allows for recording the visual appearance of surfaces on site without having to extract a sample from its environment.
    Type: Grant
    Filed: November 29, 2017
    Date of Patent: September 1, 2020
    Assignee: CESKE VYSOKE UCENI TECHNICKE V PRAZE JUGOSLAVSKYCH PARTYZANU
    Inventors: Vlastimil Havran, Jan Hosek, Jiri Bittner, Sarka Nemcova, Jiri Cap
  • Patent number: 10735712
    Abstract: A method and system are described. The method includes capturing a set of images from an array of cameras, each camera of the array of cameras having an overlapping field of view (FOV) with an adjacent camera of the array of cameras. The method further includes synchronously capturing a supplemental image from an additional camera, the additional camera having an at least partially overlapping FOV with every camera of the array of cameras. Supplemental information is extracted by comparing the supplemental image with the set of images. Portions of the set of images are stitched based in part on the supplemental information to produce a combined stitched image, the combined stitched image having a higher resolution than each image of the set of images.
    Type: Grant
    Filed: July 11, 2019
    Date of Patent: August 4, 2020
    Assignee: GoPro, Inc.
    Inventors: Adeel Abbas, David A. Newman, Timothy Macmillan
  • Patent number: 10728525
    Abstract: An image capturing apparatus: calculates, for each of pairs of images, based on the pairs of images and camera parameters, position information including information specifying a three-dimensional position of a measurement point with respect to a pair of pixels respectively included in the pair of images, and information specifying a position of each of the pair of pixels; performs, based on the position information and the camera parameters, weighted addition on the information specifying the three-dimensional position of the measurement point in each of the pair of images, with information using an effective baseline length or a viewing angle, with respect to the three-dimensional position, of a pair of the cameras corresponding to the pair of images; and outputs position information of the measurement point to which a weighted addition value is applied.
    Type: Grant
    Filed: April 24, 2018
    Date of Patent: July 28, 2020
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Takeo Azuma, Nobuhiko Wakai, Kunio Nobori, Satoshi Sato
  • Patent number: 10728537
    Abstract: A photographing device for photographing a monitored area has a state diagnosis of a camera using a stereo camera configured by two or more cameras. A diagnostic pattern database is provided in which information on a plurality of images having different photographing conditions obtained by the stereo camera are stored in advance as diagnostic patterns. Disparity information is acquired based on image data from the stereo camera and a state diagnosis of the camera is performed by determining whether the camera is abnormal or normal based on the disparity information with reference to the information on the plurality of images having different photographing conditions stored in the diagnostic pattern database. Upon receiving a result of the state diagnosis, at least one of illumination control, shutter control, and posture control of the camera or the stereo camera is performed.
    Type: Grant
    Filed: August 29, 2016
    Date of Patent: July 28, 2020
    Assignee: Hitachi, Ltd.
    Inventors: Masaya Itoh, Ryosuke Miki, So Sasatani, Kenichirou Kurata
  • Patent number: 10708568
    Abstract: The disclosure includes a system and method for generating virtual reality content. For example, the disclosure includes a method for generating virtual reality content that includes a stream of three-dimensional video data and a stream of three-dimensional audio data with a processor-based computing device programmed to perform the generating, providing the virtual reality content to a user, detecting a location of the user's gaze at the virtual reality content, and suggesting an advertisement based on the location of the user's gaze. Another example includes receiving virtual reality content that includes a stream of three-dimensional video data and a stream of three-dimensional audio data to a first user with a processor-based computing device programmed to perform the receiving, generating a social network for the first user, and generating a social graph that includes user interactions with the virtual reality content.
    Type: Grant
    Filed: August 21, 2014
    Date of Patent: July 7, 2020
    Assignee: Verizon Patent and Licensing Inc.
    Inventors: Jens Christensen, Thomas M. Annau, Arthur Van Hoff
  • Patent number: 10706569
    Abstract: This disclosure describes a configuration of an aerial vehicle, such as an unmanned aerial vehicle (“UAV”), that includes a plurality of cameras that may be selectively combined to form a stereo pair for use in obtaining stereo images that provide depth information corresponding to objects represented in those images. Depending on the distance between an object and the aerial vehicle, different cameras may be selected for the stereo pair based on the baseline between those cameras and a distance between the object and the aerial vehicle. For example, cameras with a small baseline (close together) may be selected to generate stereo images and depth information for an object that is close to the aerial vehicle. In comparison, cameras with a large baseline may be selected to generate stereo images and depth information for an object that is farther away from the aerial vehicle.
    Type: Grant
    Filed: June 8, 2016
    Date of Patent: July 7, 2020
    Assignee: Amazon Technologies, Inc.
    Inventors: Scott Raymond Harris, Barry James O'Brien, Joshua John Watson
  • Patent number: 10699436
    Abstract: The present invention discloses a spatial positioning device, and a positioning processing method and device. The spatial positioning device comprises a set of cameras arranged horizontally and a set of cameras arranged vertically, wherein each set comprises at least two cameras with the same parameters including an image resolution, a camera lens angle in the horizontal direction and a camera lens angle in the vertical direction; and the at least two cameras in the set of cameras arranged horizontally are aligned in the horizontal direction, and the at least two cameras in the set of cameras arranged vertically are aligned in the vertical direction. In the spatial positioning device provided by the present invention, as the sets of cameras are arranged in the different directions, it is possible to effectively reduce or even eliminate the number of blind spots in the process of image shooting in the single direction.
    Type: Grant
    Filed: August 11, 2017
    Date of Patent: June 30, 2020
    Assignee: Goertek Inc.
    Inventors: Jian Zhu, Xiangdong Zhang, Zhuo Chen, Zhiping Luo, Dong Yan
  • Patent number: 10691202
    Abstract: The disclosure includes a system and method for receiving viewing data that describes a location of a first user's gaze while viewing virtual reality content. The method also determining an object of interest in the virtual reality content based on the location of the first user's gaze. The method also includes generating a social network that includes the first user as a member of the social network. The method also includes performing an action in the social network related to the object of interest.
    Type: Grant
    Filed: November 3, 2017
    Date of Patent: June 23, 2020
    Assignee: Verizon Patent and Licensing Inc.
    Inventors: Arthur van Hoff, Thomas M. Annau, Jens Christensen
  • Patent number: 10681261
    Abstract: A front-end image acquisition component acquires photographs and/or videos of various goods, vehicles, vessels, and/or real estate fixtures. In one aspect, an image acquisition system comprises a hub with outwardly extending arms and supports for coupling to an upper support structure. Cameras are affixed to the hub and the arms for acquiring image data of a subject substantially simultaneously.
    Type: Grant
    Filed: February 1, 2016
    Date of Patent: June 9, 2020
    Assignee: 3I AVI, LLC
    Inventor: Jason Hauk
  • Patent number: 10666921
    Abstract: The disclosure includes a system and method for generating virtual reality content. For example, the disclosure includes a method for generating virtual reality content that includes a stream of three-dimensional video data and a stream of three-dimensional audio data with a processor-based computing device programmed to perform the generating, providing the virtual reality content to a user, detecting a location of the user's gaze at the virtual reality content, and suggesting an advertisement based on the location of the user's gaze. Another example includes receiving virtual reality content that includes a stream of three-dimensional video data and a stream of three-dimensional audio data to a first user with a processor-based computing device programmed to perform the receiving, generating a social network for the first user, and generating a social graph that includes user interactions with the virtual reality content.
    Type: Grant
    Filed: May 2, 2017
    Date of Patent: May 26, 2020
    Assignee: Verizon Patent and Licensing Inc.
    Inventors: Jens Christensen, Thomas M. Annau, Arthur Van Hoff
  • Patent number: 10665261
    Abstract: The disclosure includes a camera array comprising camera modules, the camera modules comprising a master camera that includes a processor, a memory, a sensor, a lens, a status indicator, and a switch, the switch configured to instruct each of the camera modules to initiate a start operation to start recording video data using the lens and the sensor in the other camera modules and the switch configured to instruct each of the camera modules to initiate a stop operation to stop recording, the status indicator configured to indicate a status of at least one of the camera modules. The camera modules of the camera array are configured to provide a 3× field of view overlap.
    Type: Grant
    Filed: January 3, 2019
    Date of Patent: May 26, 2020
    Assignee: Verizon Patent and Licensing Inc.
    Inventors: Arthur Van Hoff, Thomas M. Annau, Jens Christensen, Koji Gardiner
  • Patent number: 10652460
    Abstract: The image-capturing apparatus includes an image-capturing device configured to perform image capturing through multiple magnification-variable optical systems, which face in mutually different directions, to acquire multiple images to be continuously joined together, a controller configured to control magnification-varying operations of the respective magnification-variable optical systems to set field angles thereof, a main body holding the multiple magnification-variable optical systems, and a protrusion detector configured to detect a protruding member. The controller is configured to perform, depending on a detection result of the protrusion detector, a field angle setting process for setting the field angles of the respective magnification-variable optical systems such that the detected protruding member is not included in all the field angles of the magnification-variable optical systems.
    Type: Grant
    Filed: March 26, 2018
    Date of Patent: May 12, 2020
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Akihiko Masuki
  • Patent number: 10630898
    Abstract: An image capturing apparatus includes a first lens module, a second lens module and an operation module which divides a first left block, a second right block of the first image and a second right block, a second left block of the second image into a plurality of first right sub-blocks, first left sub-blocks, second right sub-blocks and second left sub-blocks respectively, compares a first parameter, a second parameter and/or a third parameter of the first left sub-blocks, the first right sub-blocks, the second left sub-blocks and the second right sub-blocks, obtains a plurality of first difference values, a plurality of second difference values and/or a plurality of third difference values, obtains a total weighting value according to the first difference values, the second difference values and/or the third difference values, and adjusts brightness of the first image and the second image with the total weighting value.
    Type: Grant
    Filed: June 29, 2018
    Date of Patent: April 21, 2020
    Assignee: ABILITY ENTERPRISE CO., LTD.
    Inventors: Shiu-Yung Lin, Cheng-Chang Wu
  • Patent number: 10630925
    Abstract: A depth camera assembly (DCA) for depth sensing of a local area. The DCA includes a light source assembly, a camera assembly, and a controller. The light source assembly projects pulses of light into the local area, each pulse having a respective polarization type. The camera assembly images a portion of the local area illuminated with the pulses of light. The camera assembly includes a plurality of augmented pixels, each augmented pixel having a plurality of gates and local storage locations. An exposure interval of the camera assembly is divided into intervals and some of the intervals are synchronized to the projected pulses of light such that each respective local storage location stores image data associated with a different polarization type. The controller determines depth information for the local area based in part on the polarization types associated with the image data stored in respective local storage locations.
    Type: Grant
    Filed: December 3, 2018
    Date of Patent: April 21, 2020
    Assignee: Facebook Technologies, LLC
    Inventors: Fengqiang Li, Michael Hall
  • Patent number: 10623660
    Abstract: A camera array for a mediated-reality system includes a plurality of hexagonal cells arranged in a honeycomb pattern in which a pair of inner cells include respective edges adjacent to each other and a pair of outer cells are separated from each other by the inner cells. A plurality of cameras are mounted within each of the plurality of hexagonal cells. The plurality of cameras include at least one camera of a first type and at least one camera of a second type. The camera of the first type may have a longer focal length than the camera of the second type.
    Type: Grant
    Filed: September 25, 2019
    Date of Patent: April 14, 2020
    Assignee: eLoupes, Inc.
    Inventors: James Andrew Youngquist, David Julio Colmenares, Adam Gabriel Jones
  • Patent number: 10599324
    Abstract: System for associating a computerized hand gestures model with application functions, comprising: (a) A storage storing a plurality of hand pose features records and hand motion features records. Each of the hand pose features records and hand motion features records is defined by a set of discrete pose values and discrete motion values respectively. (b) An interface receiving programmer instructions. (c) A memory storing code. (d) One or more processors coupled to the interface, storage and memory for executing the code which comprises: 1) Code instructions to define hand gestures by constructing a unique logical sequence of the hand pose features records and hand motion features records. 2) Code instructions to associate the unique logical sequence with application functions per the instructions for initiating execution of the functions during the application runtime in response to detection of the unique logical sequence from analysis of images depicting movement of user's hand(s).
    Type: Grant
    Filed: December 31, 2015
    Date of Patent: March 24, 2020
    Assignee: Microsoft Technology Licensing, LLC
    Inventor: Kfir Karmon
  • Patent number: 10562394
    Abstract: A method and system for executing gesture based control of a vehicle system that include receiving at least one signal that pertains to at least one muscle movement from sensors disposed within a gear shift knob. The method and system also include determining at least one gesture based on the at least one signal. Additionally, the method and system include determining an interaction command with the vehicle system based on the at least one gesture. The method and system further include outputting the interaction command to the vehicle system.
    Type: Grant
    Filed: August 3, 2017
    Date of Patent: February 18, 2020
    Assignee: Honda Motor Co., Ltd.
    Inventors: Calvin Ling, Michael Nehmad
  • Patent number: 10565449
    Abstract: There is provided an image capturing apparatus that captures a plurality of images, calculates a three-dimensional position from the plurality of images, and outputs the plurality of images and information about the three-dimensional position. The image capturing apparatus includes an image capturing unit, a camera parameter storage unit, a position calculation unit, a position selection unit, and an image complementing unit. The image capturing unit outputs the plurality of images using at least three cameras. The camera parameter storage unit stores in advance camera parameters including occlusion information. The position calculation unit calculates three dimensional positions of a plurality of points. The position selection unit selects a piece of position information relating to a subject area that does not have an occlusion, and outputs selected position information. The image complementing unit generates a complementary image, and outputs the complementary image and the selected position information.
    Type: Grant
    Filed: October 30, 2018
    Date of Patent: February 18, 2020
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Kunio Nobori, Satoshi Sato, Takeo Azuma
  • Patent number: 10542247
    Abstract: A 3D image capture method includes selecting a plurality of different pairs of image capture devices, of which distance errors relevant to an object are determined, the distance error being a distance between a measured position and a real position of the object; selecting a pair of image capture devices with a minimum distance error; and obtaining 3D information according to spacing and angles of view of the selected pair of image capture devices.
    Type: Grant
    Filed: January 4, 2018
    Date of Patent: January 21, 2020
    Assignee: Wistron Corporation
    Inventors: Yao-Tsung Chang, Chuan-Yen Kao
  • Patent number: 10536633
    Abstract: An image processing device includes a reference camera determiner that determines one among the multiple cameras, as a reference camera; an imaging condition acquisition unit that acquires imaging conditions relating to exposure and white balance which are set in the reference camera; an imaging condition setter that sends a command to set the imaging conditions relating to the exposure and the white balance, based on the imaging conditions in the reference camera, to cameras other than the reference camera; and an image composition unit that performs image composition processing on the multiple captured images that are acquired from the multiple cameras and that outputs the panoramic composite image. Thus, a boundary of an area of each composed image in the panoramic composite image that results from the composition is suppressed from being unnaturally conspicuous, and the captured image that is a reference is suitably displayed.
    Type: Grant
    Filed: January 21, 2016
    Date of Patent: January 14, 2020
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Junya Kuwada, Ryoji Ogino, Ryo Hirota, Akio Nishiyama
  • Patent number: 10511845
    Abstract: There are provided methods and apparatus for video usability information (VUI) for scalable video coding (SVC). An apparatus includes an encoder (100) for encoding video signal data into a bitstream. The encoder specifies video user information, excluding hypothetical reference decoder parameters, in the bitstream using a high level syntax element. The video user information corresponds to a set of interoperability points in the bitstream relating to scalable video coding (340, 355).
    Type: Grant
    Filed: November 5, 2018
    Date of Patent: December 17, 2019
    Assignee: InterDigital VC Holdings, Inc.
    Inventors: Jiancong Luo, Peng Yin, Lihua Zhu
  • Patent number: 10496182
    Abstract: This document describes techniques and devices for type-agnostic radio frequency (RF) signal representations. These techniques and devices enable use of multiple different types of radar systems and fields through type-agnostic RF signal representations. By so doing, recognition and application-layer analysis can be independent of various radar parameters that differ between different radar systems and fields.
    Type: Grant
    Filed: April 19, 2019
    Date of Patent: December 3, 2019
    Assignees: Google LLC, The Board of Trustees of the Leland Stanford Junior University
    Inventors: Jaime Lien, Patrick M. Amihood, Ivan Poupyrev
  • Patent number: 10498958
    Abstract: Multiple images may be combined to obtain a composite image. Individual images may be obtained with different camera sensors and/or at different time instances. In order to obtain the composite image source images may be aligned in order to produce a seamless stitch. Source images may be characterized by a region of overlap. A disparity measure may be determined for pixels along a border region between the source images. A warp transformation may be determined using a refinement process configured to determine displacement of pixels of the border region based on the disparity. Pixel displacement at a given location may be constrained to direction configured tangential to an epipolar line corresponding to the location. The warp transformation may be propagated to pixels of the image. Spatial and/or temporal smoothing may be applied. In order to obtain refined solution, the warp transformation may be determined at multiple spatial scales.
    Type: Grant
    Filed: May 14, 2018
    Date of Patent: December 3, 2019
    Assignee: GoPro, Inc.
    Inventors: Antoine Meler, Thomas Derbanne
  • Patent number: 10499038
    Abstract: Methods and systems for recalibrating sensing devices without using familiar targets are provided herein. The method may include: capturing a scene using a sensing device; determining whether or not the device is calibrated; in a case that said sensing device is calibrated, adding at least one new landmark to the known landmarks; in a case that said sensing device is not calibrated, determining at least some of the captured objects as objects stored on a database as known landmarks at the scene whose position is known; and calibrating the sensing device based on the known landmarks. The system may have various architectures that include a sensing device which captures images of the scene and further derive 3D data on the scene of some form.
    Type: Grant
    Filed: June 9, 2017
    Date of Patent: December 3, 2019
    Assignee: Alibaba Technology (Israel) Ltd.
    Inventors: Matan Protter, Motti Kushnir
  • Patent number: 10460473
    Abstract: Techniques for calibrating a camera utilizing a calibration station. The camera calibration station may be configured to emit collimated light toward a camera housed in a cradle. The camera may capture images of the collimated light at pre-determined positions throughout a calibration sequence. A computing system associated with the camera calibration station may utilize reference locations determined based on the collimated light at the pre-determined positions compared to measured locations of the collimated light at the pre-determined positions to determine intrinsics of the camera (e.g., focal length of lens, optical center of lens, etc.) and an error associated therewith. Based at least in part on the error being less than a threshold error, the computing system may store the intrinsic parameters of the camera.
    Type: Grant
    Filed: December 14, 2018
    Date of Patent: October 29, 2019
    Assignee: Zoox, Inc.
    Inventors: Ryan McMichael, Till Kroeger, Robert Nicholas Moor, Maxwell Yaron
  • Patent number: 10436575
    Abstract: The present invention provides a system for accurate three-dimensional (3D) capture of apparel by 3D scanning and stereo photogrammetry. One or more flexible deflated bladders are inserted into an apparel and inflated by a filling media source. The bladder is inflated to measure at least one of size of the apparel, tensile strength of the fabric of the apparel, or cross section perimeter of the apparel. A rotating structure is anchored onto the stable structure to uniformly rotate all the fixed points of the apparel. One or more 3D scanners are configured to scan the inflated apparel on the stable structure and export the scanned data to one or more software applications. The processor retrieves the 3D scanned dimensional data from a searchable database and compares the given apparel's dimensions with one or more apparels' dimensions in the database to provide the customer with size recommendation via a display.
    Type: Grant
    Filed: August 6, 2018
    Date of Patent: October 8, 2019
    Assignee: Clothscan LLC
    Inventors: John Thomas Belknap, Kenji Shimada
  • Patent number: 10397549
    Abstract: A method and system are described. The method includes capturing a set of images from a 2×2 array of cameras, each camera of the array of cameras having an overlapping field of view (FOV) with an adjacent camera of the array of cameras. The method further includes synchronously capturing a supplemental image from a fifth camera, the fifth camera having an at least partially overlapping FOV with every camera of the array of cameras. Supplemental information is extracted by comparing the supplemental image with the set of four images. Portions of the set of images are stitched based in part on the supplemental information to produce a combined stitched image, the combined stitched image having a higher resolution than each image of the set of images.
    Type: Grant
    Filed: December 20, 2016
    Date of Patent: August 27, 2019
    Assignee: GoPro, Inc.
    Inventors: Adeel Abbas, David A. Newman, Timothy Macmillan
  • Patent number: 10397453
    Abstract: An electronic device is provided which includes an upper cover unit including at least one first camera that faces a first direction, a plurality of second camera pairs disposed to face a second direction, second cameras included in each of the second camera pairs being arranged to face directions that intersect each other, a housing including a plurality of first openings, to which the plurality of second camera pairs are at least partially coupled to be exposed to an outside, and a first support member disposed in an accommodation space inside the housing, and providing a seating space for a printed circuit unit electrically connected with a connector of the upper cover unit.
    Type: Grant
    Filed: August 1, 2017
    Date of Patent: August 27, 2019
    Assignee: Samsung Electronics Co., Ltd
    Inventors: Bong-Suk Choi, Doo-Ryong Kim, Oh-Hee Lee, An-Jin Nam
  • Patent number: 10334220
    Abstract: The disclosure includes a system and method for aggregating image frames and audio data to generate virtual reality content. The system includes a processor and a memory storing instructions that, when executed, cause the system to: receive video data describing image frames from a camera array; receive audio data from a microphone array; aggregate the image frames to generate a stream of three-dimensional (3D) video data, the stream of 3D video data including a stream of left panoramic images and a stream of right panoramic images; generate a stream of 3D audio data from the audio data; and generate virtual reality content that includes the stream of 3D video data and the stream of 3D audio data.
    Type: Grant
    Filed: August 21, 2014
    Date of Patent: June 25, 2019
    Inventors: Arthur Van Hoff, Thomas M. Annau, Jens Christensen
  • Patent number: 10313702
    Abstract: At least one disclosed method and apparatus relate to inter-view prediction with different resolution reference picture. A particular method includes accessing at least a portion of an encoded picture (614), the encoded picture being from a particular view of multiple views, and the portion being encoded at a particular resolution. The method further includes determining a particular view level based on the particular view (614), determining the particular resolution based on the particular view level (606), and decoding the portion based on the particular resolution (630).
    Type: Grant
    Filed: April 23, 2008
    Date of Patent: June 4, 2019
    Assignee: INTERDIGITAL MADISON PATENT HOLDINGS
    Inventors: Purvin Bibhas Pandit, Peng Yin, Cristina Gomila
  • Patent number: 10308374
    Abstract: A stereo distance measuring apparatus includes a first optical camera and a second optical camera, a position-posture calculator, an image corrector, and a stereo distance measuring unit. The first and second optical cameras are provided in an elastic structure part of an aircraft and separated from each other. The first and second optical cameras constitute a stereo camera. The position-posture calculator calculates, on the basis of a displacement amount of the elastic structure part, first and second position-posture information regarding positions and postures of the first and second optical cameras, respectively. The image corrector generates first and second corrected images by correcting, on the basis of the first and second position-posture information, positions and orientations of images taken by the first and second optical cameras, respectively. The stereo distance measuring unit calculates a distance to a photographing target, on the basis of the first and second corrected images.
    Type: Grant
    Filed: October 3, 2017
    Date of Patent: June 4, 2019
    Assignee: SUBARU CORPORATION
    Inventors: Yoichi Onomura, Akihiro Yamane, Akitoshi Sakaguchi
  • Patent number: 10313659
    Abstract: Provided are a stereoscopic distance measuring apparatus and method, and a computer readable program. The apparatus includes first and second optical cameras, first and second position-posture meters, an image corrector, and a stereoscopic distance measuring unit. The first and second position-posture meters acquire first and second position-posture information regarding the first and second optical cameras. The image corrector corrects, on the basis of the first and second position-posture information, positions and orientations of a plurality of first and second images taken by the first and second optical cameras, to generate a plurality of first and second corrected images. The stereoscopic distance measuring unit calculates a distance to a photographing target, on the basis of a pair of the corrected images including one of the plurality of the first corrected images and one of the plurality of the second corrected images.
    Type: Grant
    Filed: June 30, 2017
    Date of Patent: June 4, 2019
    Assignee: SUBARU CORPORATION
    Inventor: Yoichi Onomura
  • Patent number: 10260866
    Abstract: A 3D imaging system uses a depth sensor to produce a coarse depth map, and then uses the coarse depth map as a constraint in order to correct ambiguous surface normals computed from polarization cues. The imaging system outputs an enhanced depth map that has a greater depth resolution than the coarse depth map. The enhanced depth map is also much more accurate than could be obtained from the depth sensor alone. In many cases, the imaging system extracts the polarization cues from three polarized images. Thus, in many implementations, the system takes only three extra images—in addition to data used to generate the coarse depth map—in order to dramatically enhance the coarse depth map.
    Type: Grant
    Filed: December 27, 2015
    Date of Patent: April 16, 2019
    Assignee: Massachusetts Institute of Technology
    Inventors: Achuta Kadambi, Vage Taamazyan, Boxin Shi, Ramesh Raskar
  • Patent number: 10212341
    Abstract: Exemplary embodiments of a mobile electronic device with multiple cameras are provided. In one embodiment, an apparatus is provided comprising a mobile electronic device having a first side and a second opposing side, a first camera on the first side of the mobile electronic device, and a second camera on the first side of the mobile electronic device, wherein the first camera is configured to obtain a first image and the second camera is configured to obtain a second image simultaneously, wherein the second image partially overlaps the first image, and wherein the mobile electronic device merges the first image and the second image to create an image which comprises at least a portion of the first image and the second image.
    Type: Grant
    Filed: November 21, 2016
    Date of Patent: February 19, 2019
    Inventor: Amit Sondhi
  • Patent number: 10210898
    Abstract: The disclosure includes a camera array comprising camera modules, the camera modules comprising a master camera that includes a processor, a memory, a sensor, a lens, a status indicator, and a switch, the switch configured to instruct each of the camera modules to initiate a start operation to start recording video data using the lens and the sensor in the other camera modules and the switch configured to instruct each of the camera modules to initiate a stop operation to stop recording, the status indicator configured to indicate a status of at least one of the camera modules. The camera modules of the camera array are configured to provide a 3X field of view overlap.
    Type: Grant
    Filed: March 2, 2018
    Date of Patent: February 19, 2019
    Inventors: Arthur van Hoff, Thomas M. Annau, Jens Christensen, Koji Gardiner
  • Patent number: 10175100
    Abstract: There is provided an image display apparatus including: a light source unit; at least one light modulation device configured to modulate light from the light source unit, and to emit a modulated light beam; and a sensor configured to receive diffracted light of the modulated light beam emitted from the at least one light modulation device, and to measure intensity of the modulated light.
    Type: Grant
    Filed: January 15, 2016
    Date of Patent: January 8, 2019
    Assignee: SONY CORPORATION
    Inventors: Keisuke Homma, Yoshihisa Aikoh, Yuji Kato, Kazumasa Ikeura, Tomomi Yuno, Shiun Sakai
  • Patent number: 10165182
    Abstract: Panoramic imaging systems and devices are disclosed. In one aspect, a disclosed panoramic camera assembly of a panoramic imaging system includes a first camera module including a first wide-angle-lens camera positioned to cover one half of a full spherical space and a second camera module including a second wide-angle-lens camera positioned to cover the other half of the full spherical space. Moreover, the optical axis of the first camera and the optical axis of the second camera are separated by a predetermined distance in a lateral direction perpendicular to the optical axes. Furthermore, the first camera module and the second camera module are positioned to have a predetermined amount of overlap in the vertical direction so that a height of the panoramic camera assembly is significantly smaller than a dimension of the first camera module plus a dimension of the second camera module in the vertical direction.
    Type: Grant
    Filed: December 29, 2016
    Date of Patent: December 25, 2018
    Inventor: Scott Zhihao Chen
  • Patent number: 10157315
    Abstract: There is provided an image capturing apparatus that captures a plurality of images, calculates a three-dimensional position from the plurality of images, and outputs the plurality of images and information about the three-dimensional position. The image capturing apparatus includes an image capturing unit, a camera parameter storage unit, a position calculation unit, a position selection unit, and an image complementing unit. The image capturing unit outputs the plurality of images using at least three cameras. The camera parameter storage unit stores in advance camera parameters including occlusion information. The position calculation unit calculates three dimensional positions of a plurality of points. The position selection unit selects a piece of position information relating to a subject area that does not have an occlusion, and outputs selected position information. The image complementing unit generates a complementary image, and outputs the complementary image and the selected position information.
    Type: Grant
    Filed: November 27, 2014
    Date of Patent: December 18, 2018
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Kunio Nobori, Satoshi Sato, Takeo Azuma
  • Patent number: 10154272
    Abstract: There are provided methods and apparatus for video usability information (VUI) for scalable video coding (SVC). An apparatus includes an encoder (100) for encoding video signal data into a bitstream. The encoder specifies video user information, excluding hypothetical reference decoder parameters, in the bitstream using a high level syntax element. The video user information corresponds to a set of interoperability points in the bitstream relating to scalable video coding (340, 355).
    Type: Grant
    Filed: October 9, 2017
    Date of Patent: December 11, 2018
    Assignee: InterDigital VC Holdings Inc.
    Inventors: Jiancong Luo, Peng Yin, Lihua Zhu
  • Patent number: 10146999
    Abstract: A video management apparatus includes a video database for holding a plurality of pieces of video information each associated with an image position, a geographic information database for holding a plurality of pieces of geographic information each indicating a position of a different one of spots on a map, and a controller. The controller extracts spots located within a first range from a current position as a first spot group, based on the current position and the plurality of pieces of geographic information. Further, the controller extracts spots located within a second range from the image position as a second spot group, based on the image position and the plurality of pieces of geographic information. Then, the controller selects video information from the plurality of pieces of video information, based on a similarity degree of the second spot group with respect to the first spot group.
    Type: Grant
    Filed: October 17, 2016
    Date of Patent: December 4, 2018
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Keijiroh Nagano, Hiroki Sunagawa, Yoshifumi Asao, Masaharu Matsumoto
  • Patent number: 10088296
    Abstract: A method for scanning and obtaining three-dimensional (3D) coordinates is provided. The method includes providing a 3D measuring device having a projector, a first camera and a second camera. The method records images of a light pattern emitted by the projector onto an object. A deviation in a measured parameter from an expected parameter is determined. The calibration of the 3D measuring device may be changed when the deviation is outside of a predetermined threshold.
    Type: Grant
    Filed: January 11, 2018
    Date of Patent: October 2, 2018
    Assignee: FARO TECHNOLOGIES, INC.
    Inventors: Gerrit Hillebrand, Rolf Heidemann, Martin Ossig
  • Patent number: 10067570
    Abstract: To improve the user's convenience related to non-contact operation. An on-vehicle device 1 includes a control section that is configured to detect non-contact operation, and is configured, in a first mode, to analyze the detected non-contact operation and determine, on the basis of a first rule, whether or not the non-contact operation is an effective operation, and in a second mode, to analyze the detected non-contact operation and determine, on the basis of a second rule, whether or not the non-contact operation is an effective operation.
    Type: Grant
    Filed: March 24, 2015
    Date of Patent: September 4, 2018
    Assignee: CLARION CO., LTD.
    Inventor: Shizue Kato
  • Patent number: 10052955
    Abstract: A method for providing an operating device in a vehicle, wherein a control device generates graphics data which control a display surface so that a graphics object relating to an executed application is displayed, and the geometric structure of an actuating object is detected in a detection space in front of the display surface and, depending upon the detected structure, a control signal for controlling the executed application is generated. A control signal for stopping the executed application is generated by the control system if a geometric structure of the actuating object has been detected in the detection space, wherein a substantially planar surface of the actuating object which is oriented substantially parallel to the display surface is spaced apart from the display surface. Also disclosed is a corresponding operating device for carrying out the method and a vehicle having such an operating device.
    Type: Grant
    Filed: July 8, 2016
    Date of Patent: August 21, 2018
    Assignee: Volkswagen AG
    Inventors: Rainer Dehmann, Frank Hauschild, Sönke Petersen, Mathias Kuhn
  • Patent number: 10045000
    Abstract: An omni-directional audio signal acquisition and playback system is disclosed. In some embodiments, the described system includes a set of microphones positioned substantially evenly with respect to a center of the audio signal acquisition environment, the set of microphones are configured to acquire multiple channels of omni-directional audio signals. The system further includes one or more processors configured to: determine current positions of both the left and the right ears of a viewer's head; identify a subset of microphones within the set of microphones which is closest to the current positions of the left and right ears of the viewer's head; and compute a left channel and a right channel of audio output signals using the omni-directional audio signals recorded by the identified subset of microphones.
    Type: Grant
    Filed: December 29, 2016
    Date of Patent: August 7, 2018
    Inventor: Scott Zhihao Chen
  • Patent number: 10009597
    Abstract: Systems, devices, and methods disclosed herein may generate captured views and a plurality of intermediate views within a pixel disparity range, Td, the plurality of intermediate views being extrapolated from the captured views.
    Type: Grant
    Filed: January 27, 2017
    Date of Patent: June 26, 2018
    Assignee: LIGHT FIELD LAB, INC.
    Inventors: Jon Karafin, Miller H. Schuck, Douglas J. McKnight, Mrityunjay Kumar, Wilhelm Taylor
  • Patent number: 9900505
    Abstract: Systems and methods for generating a panoramic video from unstructured camera arrays. The systems and methods are configured to statically align corresponding image-frames of respective input video streams, warp the aligned image-frames according to a warping-order, and relax the warped image-frames thereby generating a temporally coherent panoramic video. Methods according to embodiments this invention utilize a new parallax-warping-error metric that is devised to capture structural differences created by parallax artifacts. The parallax-warping-error metric is effective in finding an optimal warping-order and in driving the warping process, resulting in a panoramic video with minimal parallax artifacts.
    Type: Grant
    Filed: July 23, 2014
    Date of Patent: February 20, 2018
    Assignee: DISNEY ENTERPRISES, INC.
    Inventors: Federico Perazzi, Alexander Sorkine Hornung, Henning Zimmer, Oliver Wang, Peter Kaufmann, Scott Watson
  • Patent number: 9879975
    Abstract: A method for scanning and obtaining three-dimensional (3D) coordinates is provided. The method includes providing a 3D measuring device having a projector, a first camera and a second camera. The method records images of a light pattern emitted by the projector onto an object. A deviation in a measured parameter from an expected parameter is determined. The calibration of the 3D measuring device may be changed when the deviation is outside of a predetermined threshold.
    Type: Grant
    Filed: June 26, 2017
    Date of Patent: January 30, 2018
    Assignee: FARO TECHNOLOGIES, INC.
    Inventors: Gerrit Hillebrand, Rolf Heidemann, Martin Ossig