Panoramic Patents (Class 348/36)
  • Patent number: 10148875
    Abstract: Panoramic imaging systems and process for multiplexing a set of video signal inputs captured by a set of cameras in a panoramic imaging system into a single video signal output is disclosed. In some embodiments, the disclosed process receives a set of input image frames associated with the set of video signal inputs and temporarily stores the set of input image frames in a memory. Next, for each pair of image frames in the set of input image frames, the process iteratively processes each line in the pair of image frames to construct a portion of a video signal output frame. The process then combines portions of the video signal output frame to form a single composite output frame containing the image data of the set of input image frames.
    Type: Grant
    Filed: May 17, 2016
    Date of Patent: December 4, 2018
    Inventor: Scott Zhihao Chen
  • Patent number: 10148874
    Abstract: A system and machine-implemented method of generating panoramic photographs and videos. Panoramic image data in a YUV data format is received in a YUV data format by an integrated circuit. A format of the panoramic image data is detected by the integrated circuit. The format includes resolution, pixel clock, line frequency information, and field frequency information. The panoramic image data is output, by the integrated circuit, to a memory unit. The panoramic image data is processed by the integrated circuit. The integrated circuit retrieves the panoramic image data from the memory unit. The processed panoramic image data is output, by the integrated circuit, to a processing unit. The processing includes at least one of projecting, stitching or distortion correcting.
    Type: Grant
    Filed: March 4, 2016
    Date of Patent: December 4, 2018
    Inventors: Scott Zhihao Chen, Weidong Cai, Qinghua Xu, Bozhong Wu, Peng Chen, Hu Luo
  • Patent number: 10148939
    Abstract: A system captures a first hemispherical image and a second hemispherical image, each hemispherical image including an overlap portion, the overlap portions capturing a same field of view, the two hemispherical images collectively comprising a spherical FOV and separated along a longitudinal plane. The system maps a modified first hemispherical image to a first portion of the 2D projection of a cubic image, the modified first hemispherical image including a non-overlap portion of the first hemispherical image, and maps a modified second hemispherical image to a second portion of the 2D projection of the cubic image, the modified second hemispherical image also including a non-overlap portion. The system maps the overlap portions of the first hemispherical image and the second hemispherical image to the 2D projection of the cubic image, and encodes the 2D projection of the cubic image to generate an encoded image representative of the spherical FOV.
    Type: Grant
    Filed: November 21, 2016
    Date of Patent: December 4, 2018
    Assignee: GOPRO, INC.
    Inventors: Timothy Macmillan, Adeel Abbas
  • Patent number: 10142545
    Abstract: An image stabilizing apparatus includes one or more processors, and a memory storing instructions which, when executed by the one or more processors, cause the image stabilizing apparatus to function as a detecting unit configured to detect a motion vector in a plurality of areas made by dividing motion vector detecting frames set in a plurality of images sequentially output from an imaging unit, and a control unit configured to determine a motion vector of an object in the detected motion vector and to perform an image stabilization control based on the motion vector of the object. The control unit determines a size of the object based on the motion vector of the object, and changes the motion vector detecting frame based on the size of the object and a position of the object.
    Type: Grant
    Filed: March 6, 2017
    Date of Patent: November 27, 2018
    Assignee: Canon Kabushiki Kaisha
    Inventor: Tomonari Abe
  • Patent number: 10139225
    Abstract: The method employs a computer interconnected with a GPS transceiver and a distance measurement means and operatively interconnected with a digital camera, all provided on a moving vehicle, to acquire a plurality of geographic location related images. A first geographic position is obtained from the GPS transceiver and a plurality of distance measurements are received before a second geographic position is taken. A photo request is generated after a pre-determined distance is traveled, as determined by the distance measurement means, and transmitted to the digital camera. The camera takes a photo based on the request; and the photos, photo requests, first and second positions and distance measurements are stored for post-processing. Post-processing determines a path traveled by the vehicle using the positions and distance measurements to determine an accurate geographic location and orientation for each photo. The method is suitable for building a database of geographically related images.
    Type: Grant
    Filed: December 18, 2017
    Date of Patent: November 27, 2018
    Assignee: iLOOKAbout Inc.
    Inventor: Jeffrey Hack
  • Patent number: 10142544
    Abstract: A wide angle video camera system which eliminates barrel distortion and increases the field of view by combining multiple images. Image distortion may be corrected through use of a jig to determine the field of view and distortion parameters of a camera lens. From these measurements, one may calculate the amount of adjustment needed at various points in the image. Once the image correction parameters are determined for a particular camera lens, the real time image obtained from the camera may be corrected immediately, without the need for post image processing to correct for distortion. As multiple overlapping images may be immediately corrected, they may also be instantaneously aligned and combined into a single image.
    Type: Grant
    Filed: July 20, 2016
    Date of Patent: November 27, 2018
    Assignee: RAPC Systems, Inc.
    Inventor: Geoffrey Stephen Engel
  • Patent number: 10140687
    Abstract: A wide angle video camera system which eliminates barrel distortion and increase the field of view by combining multiple images. Image distortion may be corrected through use of a jig to determine the field of view and distortion parameters of a camera lens. From these measurements, one may calculate the amount of adjustment needed at various points in the image. Once the image correction parameters are determined for a particular camera lens, the real time image obtained from the camera may be corrected immediately, without the need for post image processing to correct for distortion. As multiple overlapping images may be immediately corrected, they may also be instantaneously aligned and combined into a single image.
    Type: Grant
    Filed: January 27, 2016
    Date of Patent: November 27, 2018
    Assignee: RAPC Systems, Inc.
    Inventor: Geoffrey Stephen Engel
  • Patent number: 10142598
    Abstract: A wearable terminal device includes circuitry configured to receive sensor data from one or more sensors, wherein the sensor data corresponds to a behavior of a user in possession of the wearable terminal device. The circuitry is configured to determine, based on the sensor data, the behavior of the user. The circuitry is configured to control, based on the determined behavior of the user, a photographing interval of a camera.
    Type: Grant
    Filed: May 30, 2014
    Date of Patent: November 27, 2018
    Assignees: SONY CORPORATION, SONY MOBILE COMMUNICATIONS INC.
    Inventor: Chikashi Yajima
  • Patent number: 10127714
    Abstract: Systems and methods are disclosed for spherical three dimensional video rendering for virtual reality. A method includes receiving a spherical two-dimensional (2D) input image and a corresponding spherical depth map to be used in a creation of a spherical three-dimensional (3D) video, determining, by a processing device, a pixel shift value for each pixel of the spherical 2D input image based on the spherical depth map, and generating, based on the spherical 2D input image and the pixel shift values, a modified spherical image, wherein the modified spherical image in combination with the spherical 2d input image comprises at least one frame in the spherical 3D video.
    Type: Grant
    Filed: January 27, 2015
    Date of Patent: November 13, 2018
    Assignee: Google LLC
    Inventors: Sam Kvaalen, Anjali Wheeler, Richard Leider
  • Patent number: 10129478
    Abstract: A method for supporting target tracking includes acquiring a target from one or more images captured by an imaging device carried by a movable object, obtaining a relative distance between the movable object and the target, and generating one or more control signals based on the relative distance to direct the movable object to track the target.
    Type: Grant
    Filed: December 30, 2016
    Date of Patent: November 13, 2018
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: Cong Zhao, Minjian Pang, Rui Li, You Zhou, Zhe Liu, Guyue Zhou
  • Patent number: 10129569
    Abstract: Venue-based data including video from cameras located at a sports venue can be provided to hand held devices authorized by at least one casino. A casino patron's hand held device can enable to view sporting events provided to a hand held device from a server and placement of wagers with the server. Venue-based data including video and statistics are received from server including camera views captured as video by at least one camera located within at least one sports venue. Venue-based data is processed at server for display on a display associated with at least one hand held device operating within a casino. Venue-based data is displayed on hand held devices, enabling casino patrons to view event video. Portable devices can be authorized only when moving about a casino. Casino patrons can also gamble using said hand held device while viewing selected sporting events within the casino.
    Type: Grant
    Filed: August 27, 2014
    Date of Patent: November 13, 2018
    Assignee: Front Row Technologies, LLC
    Inventors: Luis M. Ortiz, Kermit D. Lopez
  • Patent number: 10129483
    Abstract: Methods and apparatus for implementing a camera device including multiple camera modules and which supports zoom operations are described. A plurality of moveable camera modules are included with the position of the moveable camera modules being controlled as a function of a zoom setting. One or more fixed camera modules are also included to facilitate image combining. A fixed camera module having a smaller focal length than the movable camera modules is used in some embodiments to capture a scene area including scene area portions which will be captured by movable camera modules. The image captured by the fixed camera module, with the small focal length, is used in aligning images captured by the movable camera modules during generation of a composite image. The camera may also include another fixed camera module, e.g., having the same focal length as the movable camera modules, for capturing the center of a scene.
    Type: Grant
    Filed: June 23, 2016
    Date of Patent: November 13, 2018
    Assignee: Light Labs Inc.
    Inventor: Sapna A Shroff
  • Patent number: 10127686
    Abstract: A seamless lens cover, and methods of forming such a seamless lens cover. The cap structure that covers a camera of a rotating panoramic camera system includes a seamless lens cover through which images are obtained by the camera. The cap structure may be injection molded at an initial lens cover thickness, and then a portion of the as molded initial lens cover thickness may be removed (e.g., by machining away) to achieve the final desired thickness. By such a method, the lens cover may be injection molded at thicknesses suitable for injection molding (e.g., about 0.06 to about 0.1 inch), after which most of the thickness may be machined away, to provide a seamless lens cover having a thickness of less than about 0.015 inch, exhibiting at least 60% transmittance to the thermal spectrum, no lensing characteristics, and no curvature effect.
    Type: Grant
    Filed: May 19, 2016
    Date of Patent: November 13, 2018
    Assignee: THERMAL IMAGING RADAR, INC.
    Inventor: Michael D. Dortch
  • Patent number: 10122906
    Abstract: An adaptive video end-to-end network is described that uses local abstraction. One example includes an image sensor to generate a sequence of images, a processor coupled to the image sensor to analyze the sequence of images to detect an event, to select images related to the event and to generate metadata regarding the event, and a communications interface coupled to the processor to send the metadata information through a network connection to a central node.
    Type: Grant
    Filed: August 9, 2017
    Date of Patent: November 6, 2018
    Assignee: Intel Corporation
    Inventors: Shao-Wen Yang, Yen-Kuang Chen
  • Patent number: 10116880
    Abstract: An image stitching method for use in an image processing apparatus is provided. The method includes the steps of: receiving a first video file and a second video file from an image capturing unit, wherein the first video file includes at least one first image and a first audio track, and the second video file includes at least one second image and a second audio track; calculating delay time between a first acoustic feature of the first audio track and a second acoustic feature of the second audio track to synchronize the first image and the second image; converting the first image and the second image into a first adjusted image and a second adjusted image; and performing an image stitching process on the first adjusted image and the second adjusted image to generate a stitched image.
    Type: Grant
    Filed: January 30, 2017
    Date of Patent: October 30, 2018
    Assignees: SINTAI OPTICAL (SHENZHEN) CO., LTD., ASIA OPTICAL CO., INC.
    Inventors: Kunihiko Kanai, Takayuki Sasaki, Hiroaki Furuya, Takenori Akimoto, Gakuji Horigome
  • Patent number: 10110856
    Abstract: Systems, methods and computer-readable media for creating and using video analysis rules that are based on map data are disclosed. A sensor(s), such as a video camera, can track and monitor a geographic location, such as a road, pipeline, or other location or installation. A video analytics engine can receive video streams from the sensor, and identify a location of the imaged view in a geo-registered map space, such as a latitude-longitude defined map space. A user can operate a graphical user interface to draw, enter, select, and/or otherwise input on a map a set of rules for detection of events in the monitored scene, such as tripwires and areas of interest. When tripwires, areas of interest, and/or other features are approached or crossed, the engine can perform responsive actions, such as generating an alert and sending it to a user.
    Type: Grant
    Filed: December 4, 2015
    Date of Patent: October 23, 2018
    Assignee: AVIGILON FORTRESS CORPORATION
    Inventors: Zeeshan Rasheed, Dana Eubanks, Weihong Yin, Zhong Zhang, Kyle Glowacki, Allison Beach
  • Patent number: 10104283
    Abstract: Provided is a method for reproducing a situation using a mobile device having an image shooting function. The method may include extracting first keypoints from a live view output to a display of the mobile device, extracting second keypoints from a previously shot image, calculating a tilt of the mobile device at which the first keypoints are mapped to the second keypoints within a critical range, and synthesizing the previously shot image with the live view in a state where the mobile device has been adjusted according to guide information based on a result of the calculating.
    Type: Grant
    Filed: February 13, 2017
    Date of Patent: October 16, 2018
    Assignee: ELECTRONICS & TELECOMMUNICATIONS RESEARCH INSTITUTE
    Inventors: Seong Ho Lee, YoungHo Suh, Yoon-Seop Chang, Joonmyun Cho
  • Patent number: 10101566
    Abstract: Methods and apparatus for capturing or generating images using multiple optical chains operating in parallel are described. Pixel values captured by individual optical chains corresponding to the same scene area are combined to provide an image with at least some of the benefits which would have been provided by capturing an image of the scene using a larger lens than that of the individual lenses of the optical chain modules. By using multiple optical chains in parallel at least some benefits normally obtained from using a large lens can be obtained without the need for a large lens. Furthermore in at least some embodiments, a wide dynamic range can be supported through the use of multiple sensors with the overall supported dynamic range being potentially larger than that of the individual sensors. Some lens and/or optical chain configurations are designed for use in small handheld devices, e.g., cell phones.
    Type: Grant
    Filed: June 27, 2017
    Date of Patent: October 16, 2018
    Assignee: Light Labs Inc.
    Inventor: Rajiv Laroia
  • Patent number: 10104287
    Abstract: An image processing system, an image generation apparatus, and an image generation method are provided. The image processing system includes a switching unit configured to switch an operating mode of the image processing system between at least a first mode and a second mode, a detection unit configured to detect a joining position among a plurality of input images to generate a detection result, and a joining unit configured to join the plurality of input images to generate an output image. When the mode is switched to the first mode, the joining unit joins the plurality of input images based on the detection result of the detection unit to generate the output image. When the mode is switched to the second mode, the joining unit joins the plurality of input images to generate the output image, without causing the detection unit to generate the detection result.
    Type: Grant
    Filed: February 5, 2016
    Date of Patent: October 16, 2018
    Assignee: Ricoh Company, Ltd.
    Inventor: Tetsuya Satoh
  • Patent number: 10104288
    Abstract: A vertex processing device applied in an image processing system having an image capture module is disclosed. The image capture module generates camera images. The vertex processing device comprises a coefficient interpolation unit and a coordinate modifying unit. The coefficient interpolation unit generates an interpolated warping coefficient for each camera image with respect to each vertex from a vertex list based on n number of warping coefficients and its original texture coordinates in each camera image. The coordinate modifying unit calculates modified texture coordinates in each camera image for each vertex according to the interpolated warping coefficient and its original texture coordinates in each camera image. The vertex list comprises vertices with data structures that define vertex mapping between the camera images and a panoramic image. The n number of warping coefficients correspond to n number of overlap regions in the panoramic image.
    Type: Grant
    Filed: February 8, 2017
    Date of Patent: October 16, 2018
    Assignee: ASPEED TECHNOLOGY INC.
    Inventors: Pei-Hen Hung, Chung-Yen Lu, Kuo-Wei Yeh, Jing-Chuan Chen
  • Patent number: 10104282
    Abstract: A system and method that calculates a yaw error in an image and provides a user interface to a user for correcting the yaw error. The method includes receiving an image, performing line detection in the image, computing a line parameterization for lines in the image, computing a yaw angle for the image and providing the yaw data calculated in the image.
    Type: Grant
    Filed: January 29, 2016
    Date of Patent: October 16, 2018
    Assignee: Ricoh Co., Ltd.
    Inventors: Jamey Graham, Daniel G Van Olst
  • Patent number: 10095100
    Abstract: The present invention provides a panoramic viewing system, which includes a panoramic reflection mirror, formed in an elliptical conical status, and the conical surface thereof is defined as a curved surface used for reflecting an ambient light source; and an image sensor, disposed at one side of the panoramic reflection mirror and used for receiving a light source from the panoramic reflection mirror so as to generate an image data; wherein the panoramic reflection mirror allows a panoramic image to be formed in a rectangular area when the panoramic image is projected by the panoramic reflection mirror to the image sensor. In addition, the present invention also discloses a method of panoramic viewing, a panoramic projecting system, a method of panoramic projecting and a panoramic image sensor.
    Type: Grant
    Filed: July 30, 2014
    Date of Patent: October 9, 2018
    Assignee: NATIONAL TAIWAN NORMAL UNIVERSITY
    Inventors: Hong-Fa Ho, Pei-Yung Hsiao, Wen-Jui Chou, Chun-Yu Tsai
  • Patent number: 10088692
    Abstract: A method of designing lenses includes defining a material having an inside reflective surface spanning an area, and providing an optical design algorithm which defines a plurality of oxels across the area. Each oxel has a plurality of sub-elements including a center sub-element and a plurality of neighboring sub-elements. Based on a defined optical prescription for the inside reflective surface, an optically corrected reference 3D surface is calculated for each oxel having spherical and cylindrical corrections relative to a spherical contour which spans a predetermined field of view (FOV) with respect to a single (common) predetermined reference point. A position of at least a first of the sub-elements for each of the oxels is moved to approach respective final 3D positions on the optically corrected reference 3D surface, where the moving is constrained to be along an individual line connecting each of the first sub-elements to the single predetermined reference point.
    Type: Grant
    Filed: July 13, 2015
    Date of Patent: October 2, 2018
    Assignee: Lockheed Martin Corporation
    Inventors: David A. Smith, Gregory A. Harrison
  • Patent number: 10085010
    Abstract: An imaging system for capturing images of the same object using a plurality of image capturing apparatuses that can communicate with each other is provided. At least one image capturing apparatus of the image capturing apparatuses transmits information of a distance to an in-focus position, or a captured image including the in-focus position, to another image capturing apparatus among the image capturing apparatuses, and each of the image capturing apparatuses determines each depth of field using the information of the distance to the in-focus position, or the captured image including the in-focus position.
    Type: Grant
    Filed: June 29, 2016
    Date of Patent: September 25, 2018
    Assignee: Canon Kabushiki Kaisha
    Inventor: Tomoyuki Shiozaki
  • Patent number: 10063775
    Abstract: Disclosed herein is a content transmission apparatus, including: a retaining section adapted to retain a multi viewpoint video content formed from a plurality of viewpoint videos imaged simultaneously by a plurality of different video cameras; a production section adapted to produce a VRT including acquisition destination information of the viewpoint videos which configure the multi viewpoint video content, VRT standing for View Relation Table; a supplying section adapted to supply the produced VRT to a content reproduction apparatus; a broadcasting section adapted to broadcast one or plural ones of the viewpoint videos which configure the retained multi viewpoint video content; and a delivery section adapted to deliver one or plural ones of the viewpoint videos which configure the retained multi viewpoint video content through a network.
    Type: Grant
    Filed: September 15, 2016
    Date of Patent: August 28, 2018
    Assignee: Saturn Licensing LLC
    Inventor: Naohisa Kitazato
  • Patent number: 10055644
    Abstract: Aspects of the subject disclosure may include, for example, observing a plurality of objects viewed through a smart lens, wherein the plurality of objects are in a frame of an image viewed by the smart lens, determining an identification for an object of the plurality of objects, assigning tag information for the object based on the identification, storing the tag information for the object and the frame in which the object was observed, receiving a recall request for the object, retrieving the tag information for the object and the frame responsive to the receiving the recall request, and displaying the tag information and the frame. Other embodiments are disclosed.
    Type: Grant
    Filed: February 20, 2017
    Date of Patent: August 21, 2018
    Assignee: AT&T Intellectual Property I, L.P.
    Inventor: Roque Rios, III
  • Patent number: 10048042
    Abstract: An adaptive masking method for an element in a field of operations. According to this method, at least one cover allowing to cover the element is implemented, the cover carrying at least one image generator network connected to an image synthesizer coupled to a camera. According to this method, the camera is positioned so as to cover both a portion of a background of the element and the entire cover, the image synthesizer controlling the at least one image generator network so as to minimize the contrast and optionally the frequency deviation between the background and the cover. The device implementing such a method is described.
    Type: Grant
    Filed: May 2, 2014
    Date of Patent: August 14, 2018
    Assignee: NEXTER SYSTEMS
    Inventors: Sylvain Muller, Eric Petitpas
  • Patent number: 10044963
    Abstract: An imaging apparatus includes a rolling shutter type first image sensor and second image sensor, a timing generator that controls operation timings of these two image sensors, and a controller that subjects generated image data to image processing and controls the timing generator. The first image sensor captures an image of a subject to generate first image data, and the second image sensor captures an image of the subject to generate second image data. Each of the first image data and the second image data has a duplicate region in which the subject is partly duplicated. The controller controls the timing generator in such a way that a period over which the first image sensor exposes lines within the duplicate region in the first image data coincides with a period over which the second image sensor exposes lines within the duplicate region in the second image data.
    Type: Grant
    Filed: February 10, 2017
    Date of Patent: August 7, 2018
    Assignee: Panasonic Intellectual Property Management Co., Ltd.
    Inventors: Genki Sato, Katsuji Kunisue, Hisako Chiaki
  • Patent number: 10043076
    Abstract: The described positional awareness techniques employing visual-inertial sensory data gathering and analysis hardware with reference to specific example implementations implement improvements in the use of sensors, techniques and hardware design that can enable specific embodiments to provide positional awareness to machines with improved speed and accuracy.
    Type: Grant
    Filed: August 29, 2016
    Date of Patent: August 7, 2018
    Assignee: PerceptIn, Inc.
    Inventors: Zhe Zhang, Grace Tsai, Shaoshan Liu
  • Patent number: 10039198
    Abstract: A charger plug for a smartphone is disconnected from its electrical cord and positioned on its back face with its electrical connector prongs extending upward, then the smartphone is oriented with a side edge facing generally downward and placed on the charger plug on its front face between its electrical connector prongs for use as a stand to stably support the smartphone for use. When standing on the charger in this way, the smartphone can be used for general purposes such a watching videos or it can be used particularly with a software application that automatically controls the smartphone's vibrator to induce hands-free controlled rotation of the smartphone. In typical embodiments, the smartphone and the charger-stand rotate together to compose a panoramic photograph, or for video-conferencing, gaming, or other uses.
    Type: Grant
    Filed: September 21, 2015
    Date of Patent: July 31, 2018
    Assignee: EGOS VENTURES INC.
    Inventor: Bruno Jean-Marie Francois
  • Patent number: 10038860
    Abstract: Methods and apparatus relating to capturing images of a scene area in a synchronized manner using a plurality of optical chains are described. In various embodiments image sensors corresponding to the plurality of optical chains of a camera are operated in rolling shutter mode to read out rows of pixel values corresponding to a current scan position when the image sensors have a row of pixel values corresponding to the current scan position. In some embodiments a scene area of interest is captured by initiating a scan and thus image capture of the scene area by one or more optical chains which are operated in a coordinated manner. In some embodiments a controller controls the plurality of image sensors to perform a read out of pixel values in a synchronized manner, e.g., with rows of pixel values being read out sequentially in accordance with operation of a rolling shutter implementation.
    Type: Grant
    Filed: January 23, 2017
    Date of Patent: July 31, 2018
    Assignee: Light Labs Inc.
    Inventor: Rajiv Laroia
  • Patent number: 10033935
    Abstract: In order to improve imaging performance, an imaging apparatus is provided to include an image capturing unit configured to detect incident light and generate a raw image data, a compression unit configured to compress the raw image data to generate a coded data having a data amount smaller than that of the raw image data, and an output unit configured to output the coded data to a processing unit for processing the coded data. Furthermore, the image capturing unit, the compression unit, and the output unit are configured to be within a same semiconductor package.
    Type: Grant
    Filed: July 19, 2017
    Date of Patent: July 24, 2018
    Assignee: SONY CORPORATION
    Inventors: Nobuo Ueki, Masuyoshi Kurokawa, Yoichi Yagasaki, Makoto Aoki
  • Patent number: 10027949
    Abstract: Based on a disparity amount of an object image in a left-eye viewpoint and a right-eye viewpoint and a seam position decided for one of the left-eye viewpoint and the right-eye viewpoint, a seam position of the other viewpoint is decided, and a panoramic image for left eye and a panoramic image for right eye are generated by using the decided seam position.
    Type: Grant
    Filed: March 9, 2016
    Date of Patent: July 17, 2018
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Yuji Kato
  • Patent number: 10026219
    Abstract: Various embodiments of the present invention relate generally to systems and methods for analyzing and manipulating images and video. According to particular embodiments, the spatial relationship between multiple images and video is analyzed together with location information data, for purposes of creating a representation referred to herein as a surround view. In particular embodiments, a surround view can be generated by combining a panoramic view of an object with a panoramic view of a distant scene, such that the object panorama is placed in a foreground position relative to the distant scene panorama. Such combined panoramas can enhance the interactive and immersive viewing experience of the surround view.
    Type: Grant
    Filed: November 2, 2017
    Date of Patent: July 17, 2018
    Assignee: FYUSION, INC.
    Inventors: Stefan Johannes Josef Holzer, Stephen David Miller, Radu Bogdan Rusu
  • Patent number: 10028088
    Abstract: A request is received from a mobile device located in a first geographic location for an image displaying a second geographic location. Mobile devices are geolocated and those located within a predetermined distance from the second geographic location are identified. A description of the desired image is delivered to each such identified such mobile device, whereupon the desired image is received from at least one such identified mobile device and forwarded to the requesting mobile device.
    Type: Grant
    Filed: September 27, 2016
    Date of Patent: July 17, 2018
    Inventor: Ouri Shifman
  • Patent number: 10005263
    Abstract: A display device may include a first substrate, a lower barrier layer disposed on a rear surface of the first substrate, an upper barrier layer disposed on a front surface of the first substrate, a display structure disposed on the upper barrier layer, and a second substrate disposed on the display structure.
    Type: Grant
    Filed: July 30, 2015
    Date of Patent: June 26, 2018
    Assignee: Samsung Display Co., Ltd.
    Inventors: Seung-Ho Jung, Chaun-Gi Choi, Hye-Young Park, Young-Sik Yoon, Joo-Hee Jeon
  • Patent number: 10002305
    Abstract: A fisheye image display method is adapted to a display device, wherein a display screen of the display device is divided into a plurality of view cells. The fisheye image display method includes steps of receiving a fisheye image; generating an original image and a plurality of regional images according to the fisheye image, wherein the regional images are corresponding to a plurality of regions of interest in the original image; and arranging the regional images in at least two of the view cells, wherein the at least two view cells are adjacent to each other horizontally or vertically, and one of the at least two view cells includes at least two of the regional images.
    Type: Grant
    Filed: March 5, 2017
    Date of Patent: June 19, 2018
    Assignee: VIVOTEK INC.
    Inventors: Yi-Hsuen Shih, Chien-Wen Liu
  • Patent number: 10003743
    Abstract: In an example embodiment, a method, apparatus and computer program product are provided. The method includes facilitating receipt of a plurality of light-field images of a scene captured in a burst capture by a light-field camera. The method includes determining shifts between images of the plurality of light-field images, where the shifts between the images of the plurality of light-field images are associated with shake of the light-field camera while capturing the plurality of light-field images. The method includes generating a plurality of depth maps for the plurality of light-field images, and generating a set of view images of the scene based on the plurality of light-field images and the plurality of depth maps. The method includes generating a refocus image by combining the set of view images based at least on the shifts between the images of the plurality of light-field images.
    Type: Grant
    Filed: December 16, 2014
    Date of Patent: June 19, 2018
    Assignee: Nokia Technologies Oy
    Inventors: Basavaraja S V, Mithun Uliyar, Gururaj Gopal Putraya
  • Patent number: 10002406
    Abstract: An electronic device, method, and computer readable medium for a consistent spherical photo and video orientation correction. The electronic device includes a memory and at least one processor. The at least one processor is operably connected to the memory. The at least one processor is configured to capture orientation information corresponding to a spherical frame. The at least one processor is also configured to reorient the spherical frame using the orientation information. The at least one processor is further configured to store the reoriented spherical frame.
    Type: Grant
    Filed: October 3, 2016
    Date of Patent: June 19, 2018
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventor: Thomas Flynn
  • Patent number: 9998660
    Abstract: A method of mosaicing of a scene as a 3D mosaic, characterized in that at least one 3D reconstruction having been obtained, comprises the following steps: A) acquiring successive images by means of a panoramic sensor moving in displacement along a predefined mosaicing trajectory, the last image acquired being referred to as the current panoramic image; B) choosing one or more scene-related projection surfaces on which the mosaic will be constructed, C) from the textures of the panoramic images overlapping each 3D reconstruction, retrieving the textures originating from the current panoramic image, D) from among these textures, selecting the visible parts in each projection surface with the aid of the 3D reconstruction, E) projecting these textures onto each projection surface and fusing the textures in each projection surface to thus obtain a conformal mosaic on each projection surface.
    Type: Grant
    Filed: November 20, 2013
    Date of Patent: June 12, 2018
    Assignee: THALES
    Inventor: Raphael Horak
  • Patent number: 9996895
    Abstract: An image display system is provided that includes an information processing apparatus and a terminal apparatus that receives a wide-angle image from the information processing apparatus. The information processing apparatus includes a region determining unit that determines a region of the wide-angle image that is viewed less frequently than other regions of the wide-angle image, a reduction unit that deletes the region determined as less frequently viewed by the region determining unit from the wide-angle image to generate a reduced wide-angle image, and a first transmitting unit that transmits the reduced wide-angle image generated by the reduction unit to the terminal apparatus. The terminal apparatus includes a receiving unit that receives the reduced wide-angle image from the information processing apparatus, and an image display unit that displays the reduced wide-angle image on a display device.
    Type: Grant
    Filed: April 22, 2016
    Date of Patent: June 12, 2018
    Assignee: Ricoh Company, Ltd.
    Inventor: Yohei Fujita
  • Patent number: 9998659
    Abstract: Methods for correcting an image acquired through an Ultra Wide-Angle (UWA) lens is disclosed, where the entire image is mapped via a transformation that substantially improves the perspective, yet maintains all image information. Additional locally adaptive transformations can be applied to regions of interest in the image to fully restore the perspective. This de-warping scheme allows for flexible manipulation of the image while no content would be lost.
    Type: Grant
    Filed: March 1, 2012
    Date of Patent: June 12, 2018
    Assignee: GEO SEMICONDUCTOR INC.
    Inventor: Zorawar Singh Bassi
  • Patent number: 9995910
    Abstract: An optical assembly for a point action camera or other compact digital camera having a wide field of view, includes multiple lens elements, including at least one lens element that has an aspheric lens surface. The optical assembly is configured to provide a field of view in excess of 120 degrees. The optical assembly has a modulation transfer function (hereinafter “MTF”) at the Nyquist frequency that is above 0.3 and a MTF at half Nyquist frequency that is above 0.5 across the wide field of view.
    Type: Grant
    Filed: November 4, 2015
    Date of Patent: June 12, 2018
    Assignee: Navitar Industries, LLC
    Inventors: Russell Hudyma, Michael Thomas, Ian Wallhead, Arash Ghorbani
  • Patent number: 9986219
    Abstract: This disclosure describes a system configured to present primary and secondary, tertiary, etc., virtual reality content to a user. Primary virtual reality content may be displayed to a user, and, responsive to the user turning his view away from the primary virtual reality content, a sensory cue is provided to the user that indicates to the user that his view is no longer directed toward the primary virtual reality content, and secondary, tertiary, etc., virtual reality content may be displayed to the user. Primary virtual reality content may resume when the user returns his view to the primary virtual reality content. Primary virtual reality content may be adjusted based on a user's interaction with the secondary, tertiary, etc., virtual reality content. Secondary, tertiary, etc., virtual reality content may be adjusted based on a user's progression through the primary virtual reality content, or interaction with the primary virtual reality content.
    Type: Grant
    Filed: May 22, 2017
    Date of Patent: May 29, 2018
    Assignee: Visionary VR, Inc.
    Inventor: Jonathan Michael Ross
  • Patent number: 9973697
    Abstract: One or more techniques and/or systems are provided for ordering images for panorama stitching and/or for providing a focal point indicator for image capture. For example, one or more images, which may be stitched together to create a panorama of a scene, may be stored within an image stack according to one or more ordering preferences, such as where manually captured images are stored within a first/higher priority region of the image stack as compared to automatically captured images. One or more images within the image stack may be stitched according to a stitching order to create the panorama, such as using images in the first region for a foreground of the panorama. Also, a current position of a camera may be tracked and compared with a focal point of a scene to generate a focal point indicator to assist with capturing a new/current image of the scene.
    Type: Grant
    Filed: May 24, 2017
    Date of Patent: May 15, 2018
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Blaise Aguera y Arcas, Markus Unger, Donald A. Barnett, David Maxwell Gedye, Sudipta Narayan Sinha, Eric Joel Stollnitz, Johannes Kopf
  • Patent number: 9973692
    Abstract: In one embodiment, a method for displaying a panoramic view image includes transmitting video data from a plurality of sensors to a data processor and using the processor to stitch the video data from respective ones of the sensors into a single panoramic image. A focus view of the image is defined and the panoramic image is scrolled such that the focus view is centered in the display. A high resolution camera is aimed along a line corresponding to a center of the focus view of the image and an image produced by the camera is stitched into the panoramic image. A mapping function is applied to the image data to compress the data and thereby reduce at least the horizontal resolution of the image in regions adjacent to the side edges thereof.
    Type: Grant
    Filed: January 16, 2015
    Date of Patent: May 15, 2018
    Assignee: FLIR SYSTEMS, INC.
    Inventors: Matthew Joseph Szabo, Phillip Vickery, Brian D. O'Dell, Andrew C. Teich, Jeffrey D. Frank
  • Patent number: 9967527
    Abstract: An imaging unit includes a color filter in which filter elements of R, G and B are arranged in a plane thereof. The imaging unit captures an object in a state where infrared light with three frequencies assigned to R, G and B are projected so as to generate first to third frames. A synthesizing unit in a pre-signal processing unit arranges pixel data for the three primary colors including pixel data for R in the first frame, pixel data for G in the second frame and pixel data for B in the third frame in such a manner as to have the same array as the filter elements in the color filter, so as to generate synthesized image signals synthesized in one frame. A demosaicing unit subjects the frame of the synthesized image signals to demosaicing so as to generate frames of the three primary colors.
    Type: Grant
    Filed: December 23, 2014
    Date of Patent: May 8, 2018
    Assignee: JVC KENWOOD CORPORATION
    Inventors: Satoru Sekiguchi, Takayoshi Sasao
  • Patent number: 9967478
    Abstract: A low-level region detection unit is configured to detect a low-level region from a far-infrared camera image. A transparent region detection unit is configured to detect a low-level region based on at least the near-infrared camera image, the low-level region having a predetermined level or less resulting from being a transparent region that is a region covered with a visually transparent material, within the low-level region detected by the low-level region detection unit. The image segmentation unit is configured to segment a portion of the transparent region from the near-infrared camera image. The superimposition unit is configured to superimpose the portion of the transparent region onto a position of the far-infrared camera image, which corresponds to a position of the transparent region, and generate a synthetic image.
    Type: Grant
    Filed: April 1, 2015
    Date of Patent: May 8, 2018
    Assignee: JVC KENWOOD CORPORATION
    Inventor: Tomohiro Matsuoka
  • Patent number: 9961722
    Abstract: The present disclosure relates to a camera module, and a dew condensation prevention system of the camera module, and there is disclosed a camera module including a lens assembly; a lens barrel in a cylindrical shape with a predetermined height configured to accommodate the lens assembly; and a heat radiation member formed along an outer surface of the lens barrel to transfer heat to an outermost lens of the lens assembly, wherein the lens assembly has a field-of-view region formed in a first direction and a second direction crossed with the first direction, and at least one of the first and the second field of view is above 180 degrees, and a dew condensation prevention system using the same.
    Type: Grant
    Filed: June 28, 2016
    Date of Patent: May 1, 2018
    Assignee: LG ELECTRONICS INC.
    Inventors: Dongwook Chae, Salkmann Ji, Hyungjoo Kang, Hyunjoon Kim, Samnyol Hong
  • Patent number: 9958651
    Abstract: A panoramic lens assembly includes a first lens assembly which includes a first lens group, a first prism and a second lens group, all of which are arranged in order from a first object side to a first image side along a first optical axis. The first lens group is with negative refractive power and includes a first and a second lens. The first prism includes a first incident surface, a first reflective surface and a first exit surface. The second lens group is with positive refractive power and includes a third, a fourth, a fifth, a sixth and a seventh lens. The first lens assembly satisfies: 0.2?TTL1/?1m?0.4, wherein TTL1 is an interval in mm from an object surface of the first lens to a first image plane along the first optical axis and ?1m is a half maximum field of view in degree for the first lens assembly.
    Type: Grant
    Filed: March 27, 2017
    Date of Patent: May 1, 2018
    Assignees: SINTAI OPTICAL (SHENZHEN) CO., LTD., ASIA OPTICAL CO., INC.
    Inventor: Ching-Chung Yeh