Panoramic Patents (Class 348/36)
  • Patent number: 10356316
    Abstract: A panoramic camera is provided with an orientation sensor to record orientation along with a panoramic image. The display or print image is selected from the captured panoramic image, a warped, non-scale-correct image. The selection of the display image is done using the orientation sensor. The orientation sensor data can be recorded with the panoramic image as metadata. The orientation sensor can also be used to control an external display and/or panoramic image selection during browsing.
    Type: Grant
    Filed: January 4, 2013
    Date of Patent: July 16, 2019
    Assignee: 6115187 Canada
    Inventor: Jean-Claude Artonne
  • Patent number: 10351075
    Abstract: A useful, novel and non-obvious method and apparatus for creative photography of three-dimensional automotive vehicle interior images providing a 360 degree view of an entire interior of an automotive vehicle or car (vehicle and car will be used interchangeable) for simulation of a virtual reality of the entire automotive interior through a virtual reality display used in conjunction with a virtual reality image gathering medium and related software applications to provide a virtual reality head mounted display of the automotive interior in both three dimensions and with a 360 degree review of the entire automotive interior.
    Type: Grant
    Filed: February 27, 2018
    Date of Patent: July 16, 2019
    Assignee: EVOX Productions, LLC
    Inventors: David Falstrup, Ryan Murray, Alex McClain, Pat Hadnagy, Thom Denick, Claudia Nefately Ambriz
  • Patent number: 10356386
    Abstract: A video processing method includes obtaining projection face(s) from an omnidirectional content of a sphere, and obtaining a re-sampled projection face by re-sampling at least a portion of a projection face of the projection face(s) through non-uniform mapping. The omnidirectional content of the sphere is mapped onto the projection face(s) via a 360-degree Virtual Reality (360 VR) projection. The projection face has a first source region and a second source region. The re-sampled projection face has a first re-sampled region and a second re-sampled region. The first re-sampled region is derived from re-sampling the first source region with a first sampling density. The second re-sampled region is derived from re-sampling the second source region with a second sampling density that is different from the first sampling density.
    Type: Grant
    Filed: April 3, 2018
    Date of Patent: July 16, 2019
    Assignee: MEDIATEK INC.
    Inventors: Ya-Hsuan Lee, Peng Wang, Jian-Liang Lin, Shen-Kai Chang
  • Patent number: 10353426
    Abstract: A mobile electronic device, for example a smartphone, may feature thin or curved borders at the left, right, top, and/or bottom edge of the display screen. To accommodate front-facing optical sensor(s) and/or emitter(s) despite a border that is too thin (e.g., too thin for a front camera module and lens), two or more corners of the display panel have a cutout, and the optical sensor(s) and/or emitter(s) are disposed, at least in part, in the areas of these cutouts at the corners. The cutouts may have a convex shape for the most part, thereby maximizing the remaining screen area. At least one embodiment may display scrollable screen content that extends over the entire height of the screen, such that the uppermost part is displayed between two cutouts. To adjust the layout, the elements displayed on the screen may be categorized by relevance.
    Type: Grant
    Filed: June 28, 2018
    Date of Patent: July 16, 2019
    Assignee: inodyn NewMedia GmbH
    Inventor: Lothar Pantel
  • Patent number: 10348874
    Abstract: A system and method is provided for affixing a first mobile device (e.g., a smartphone, etc.) having a camera feature to a stand (e.g., a tripod) having a motor, where a second mobile device (e.g., a tablet, etc.) is used to control at least the motor, thereby adjusting the first mobile device in relation to the stand. In another embodiment, the second mobile device is further used to control other features, such as shutter, flash, focus, etc. In a first embodiment, this is accomplished via a single wireless communication channel between the second mobile device and either the first mobile device or the stand and a second (e.g., wired or wireless) communication channel between the first mobile device and the stand. In a second embodiment, this is accomplished via a plurality of wireless communication channels between the second wireless device and the first mobile device and/or the stand.
    Type: Grant
    Filed: April 9, 2018
    Date of Patent: July 9, 2019
    Inventor: Conor Penfold
  • Patent number: 10345822
    Abstract: A system, comprising a processor, and a memory, the memory including instructions to be executed by the processor to acquire the images of the vehicle environment, determine a cognitive map, which includes a top-down view of the vehicle environment, based on the image, and operate the vehicle based on the cognitive map.
    Type: Grant
    Filed: January 26, 2018
    Date of Patent: July 9, 2019
    Assignee: FORD GLOBAL TECHNOLOGIES, LLC
    Inventors: Mostafa Parchami, Vahid Taimouri, Gintaras Vincent Puskorius
  • Patent number: 10348970
    Abstract: A mobile terminal includes a display unit; and a controller configured to obtain use intention information indicating an intention to use omnidirectional content, extract a partial image included in the omnidirectional content, and display the extracted partial image through the display unit, wherein the extracted partial image is changed according to the use intention information.
    Type: Grant
    Filed: February 1, 2017
    Date of Patent: July 9, 2019
    Assignee: LG ELECTRONICS INC.
    Inventors: Shinnyue Kang, Jeongyun Heo
  • Patent number: 10339688
    Abstract: A computing device for inserting an effect into a 360 video receives the effect from a user. A target region is also received from the user, where the target region corresponds to a location within the 360 video for inserting the effect. Next, the following steps are performed for each frame in the 360 video. The effect is inserted on a surface of a spherical model based on the target region, and two half-sphere frames containing the effect from the spherical model are generated. The two half-sphere frames are stitched to generate a panoramic representation of the effect, and the panoramic representation of the effect is blended with an original source panorama to generate a modified 360 video frame with the effect.
    Type: Grant
    Filed: July 27, 2017
    Date of Patent: July 2, 2019
    Assignee: CYBERLINK CORP.
    Inventors: Chun-Chia Su, Shan-Jan Weng
  • Patent number: 10341559
    Abstract: A multicamera panoramic imaging system having no parallax. In an example, the multicamera panoramic imaging system includes multiple discrete, imaging systems disposed in a side-by-side array, wherein a field of view of each discrete, imaging systems is conjoined with a field of view of each adjacent discrete imaging system, further wherein a stencil of chief rays at the edge of the field of view of any one of the discrete imaging systems will be substantially parallel to a stencil of chief rays at the edge of the field of view of any adjacent ones of the discrete imaging systems such that all of the substantially parallel stencils of chief rays appear to converge to a common point when viewed from object space. A method for forming an image of an object having no parallax.
    Type: Grant
    Filed: May 5, 2015
    Date of Patent: July 2, 2019
    Inventor: Zakariya Niazi
  • Patent number: 10334149
    Abstract: Example techniques are described for low power mode operation for multi-camera devices. A camera device includes processing circuitry configured to determine what information from the first camera is needed to process image content captured by the second camera or to operate the second camera, and adjust an operation mode of one of the first camera or camera circuitry coupled to the first camera from a first operation mode to a second operation mode based on the determination. An amount of power consumed by the first camera or the camera circuitry coupled to the first camera in the second operation mode is different than an amount of power consumed by the first camera or the camera circuitry in the first operation mode.
    Type: Grant
    Filed: August 24, 2017
    Date of Patent: June 25, 2019
    Assignee: QUALCOMM Incorporated
    Inventors: Cullum Baldwin, Pasi Parkkila, Jeyaprakash Soundrapandian, Meghana Barkalle, Harsh Narendra Shah
  • Patent number: 10331978
    Abstract: The present disclosure is related in general to image processing and a method and system for generating a multi-level classifier for image processing. An image processing system may analyze an input image of a predetermined image type to extract unique key feature descriptors associated with the input image. Further, the unique key feature descriptors are resized into a predefined standard template format which is utilized to develop an image type classifier. Furthermore, the unique key feature descriptors are resized into each of one or more template classifiers of the predetermined image type. Further, signal quality value of each of the template classifiers is determined by validating each of the unique key feature descriptors resized based on each of the template classifiers and an image prediction classifier is developed based on the signal quality value.
    Type: Grant
    Filed: March 15, 2017
    Date of Patent: June 25, 2019
    Assignee: Wipro Limited
    Inventors: Sendil Kumar Jaya Kumar, Sujatha Jagannath
  • Patent number: 10332273
    Abstract: A computer-implemented method for building a 3D map, includes: obtaining plural videos and plural video-related data units, each of the plural video-related data units indicating a feature of radio wave signals received at a place where a corresponding video has been taken; reconstructing plural 3D models, respectively, based on the plural videos; selecting a pair of 3D models from the plural 3D models based on similarity between a corresponding pair of video-related data units; and merging the pair of 3D models to obtain the 3D map.
    Type: Grant
    Filed: December 14, 2016
    Date of Patent: June 25, 2019
    Assignee: International Business Machines Corporation
    Inventors: Tatsuya Ishihara, Jayakorn Vongkulbhisal
  • Patent number: 10334226
    Abstract: A vision system may include a first camera and a second camera mounted for stereoscopic monitoring of a work environment, a support platform for support of a workpiece in the work environment, a first reference plate operably coupled to the support platform to provide a first frame of reference for three dimensional location of objects in the work environment, a power tool operable in the work environment under control of a tool controller, and a motion monitor operably coupled to the first and second cameras to determine location of the tool in the work environment based on a comparison of a reference point on the tool to a position of reference points on the reference plate. A perspective view of the support platform by the first and second cameras may be changeable, and the system may further include a second reference plate to define a second frame of reference for three dimensional location of objects responsive to the perspective view of the support platform being changed.
    Type: Grant
    Filed: July 15, 2016
    Date of Patent: June 25, 2019
    Assignee: APEX BRANDS, INC.
    Inventor: Aliaksandr Burakou
  • Patent number: 10324367
    Abstract: An aerial panoramic oblique photography apparatus includes a pod body provided with at least two nadir cameras and a plurality of oblique cameras. The at least two nadir cameras are arranged in a transverse direction, and the shooting regions of adjacent nadir cameras of the at least two nadir cameras are partially overlapping. Since the aerial panoramic oblique photography apparatus is provided with at least two transversely arranged nadir cameras, a plurality of stripes of aerial images is obtained for each aerial oblique photo-shooting operation. This can increase photo-shooting efficiency, reduce the number of flight, and lower photo-shooting cost. The combination of at least two nadir cameras and a plurality of oblique cameras can capture texture of the sides of urban buildings from multiple angles. Three-dimensional real scenery model of a city can be established more efficiently and completely.
    Type: Grant
    Filed: October 31, 2018
    Date of Patent: June 18, 2019
    Assignee: AS VISION LIMITED
    Inventor: Man Kit Liu
  • Patent number: 10326932
    Abstract: A panoramic image acquisition device includes: fish-eye lens modules, an image sensor and a signal cable, wherein: there are two sets of the fish-eye lens modules, and optic axes thereof coincide with each other; the fish-eye lens modules are arranged at two ends of the optic axes; a prism is provided at a center of a line connecting two optic center of the fish-eye lens modules; and the image sensor is provided below the prism for acquiring images of the fish-eye lens modules. The panoramic image acquisition device of the present invention achieves complete image quality unification and full image synchronization of different view fields in a panoramic image. Meanwhile, the panoramic image acquisition device has only one channel of video output, which greatly simplifies data acquisition tasks and panorama stitching tasks of panoramic image post-treatment, so as to reduce difficulty and costs.
    Type: Grant
    Filed: November 29, 2016
    Date of Patent: June 18, 2019
    Assignee: Chengdu Eapil Technology. Ltd
    Inventors: Enze Zhang, Wenjie Lai, Zhifa Hu, Yin Cheng, Li Yu
  • Patent number: 10324360
    Abstract: Implementations of a camera rig configured for use in the production of virtual reality (VR) content are provided. In some implementations, the camera rig may be configured so that multiple cameras can be mounted thereon, each mounted camera faces away from the camera rig and provides a different field of view. In some implementations, the camera rig may be configured so that cameras mounted thereon are able to capture a scene (e.g., a surgical site) from the perspective of a subject (e.g., a surgeon), without obstructing the subject's view of the scene. In some implementations, the camera rig may comprise a first planar member and a second planar member connected together by a first angled bracket and a second angled bracket, each angled bracket includes a connector that is configured for use in orienting and/or positioning the camera rig over the scene (e.g., a surgical site) to-be recorded.
    Type: Grant
    Filed: May 8, 2018
    Date of Patent: June 18, 2019
    Inventors: Jared Stanton, Michael Krikorian
  • Patent number: 10321052
    Abstract: A method and apparatus of seam finding includes determining an overlap area between a first image and a second image. The first image is captured by a first image capturing device and the second image is captured by a second image capturing device. A plurality of seam paths for stitching the first image with the second image is computed and a cost is computed for each seam path. A seam is selected to stitch the first image to the second image based upon the cost for the seam path for that seam being less than a cost for all other computed seam paths, that seam is maintained as the selected seam for stitching based upon a predefined criteria.
    Type: Grant
    Filed: April 28, 2017
    Date of Patent: June 11, 2019
    Assignee: Advanced Micro Devices, Inc.
    Inventors: Michael L. Schmit, Radhakrishna Giduthuri, Kiriti Nagesh Gowda
  • Patent number: 10318230
    Abstract: Systems and method for processing video frames generated for display on a head mounted display (HMD) to a second screen are provided. In one example, a client system having a processor for generating video frames in response to interactive game play of a video game using the HMD is provided. The generated video frames include in-band regions that include the video game content (VGC) to be displayed on the HMD. A processing device having an input interface for receiving the generated video frames. The processing device including extract logic for extracting a portion of the generated video frames, and a codec unit configured to process the portion of the generated video frames. Further included is a graphics processor unit (GPU) for processing the portion of the generated video frames and formatting for display on the second screen. The portion of the generated video frames processed by the GPU being provided to a first output interface of the processing device.
    Type: Grant
    Filed: June 27, 2017
    Date of Patent: June 11, 2019
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Brian Watson, Anton Mikhailov, Jeffrey Stafford, Glenn Black
  • Patent number: 10311565
    Abstract: Systems and method for verifying a cell site utilizing an Unmanned Aerial Vehicle (UAV) include providing an initial point cloud related to the cell site to the UAV; developing a second point cloud based on current conditions at the cell site, wherein the second point cloud is based on data acquisition using the UAV at the cell site; detecting variations between the initial point cloud and the second point cloud; and, responsive to detecting the variations, determining whether the variations are any of compliance related, load issues, and defects associated with any equipment or structures at the cell site.
    Type: Grant
    Filed: March 22, 2017
    Date of Patent: June 4, 2019
    Assignee: ETAK Systems, LLC
    Inventor: Charlie Terry
  • Patent number: 10313728
    Abstract: There is provided an information processing apparatus and an information processing method which are capable of reliably recognizing the position on a screen of an image made up of a plurality of divided images or the positions on the screen of divided images compatible with encoded streams. A position protruding out of a screen is set as the position on the screen of an end image that is made up of a left end image and a right end image compatible with encoded streams. The present disclosure is applicable to a file generating apparatus, etc. of an information processing system that distributes encoded streams of an entire celestial sphere image as an image of a moving-image content to a moving-image playback terminal according to a process equivalent to MPEG-DASH, for example.
    Type: Grant
    Filed: May 30, 2016
    Date of Patent: June 4, 2019
    Assignee: SONY CORPORATION
    Inventors: Mitsuhiro Hirabayashi, Yoichi Yagasaki, Nobuaki Izumi, Mitsuru Katsumata
  • Patent number: 10304173
    Abstract: The present disclosure relates to methods and apparatus for globally adjusting luminance and/or chrominance consistency among multiple images. The methods may include sorting a plurality of images in an order, such that: adjacent images at least partially overlap with each other; and the first image and the last image at least partially overlap with each other. The methods may also include determining mean pixel values for overlapping region of the images. The methods may also include determining consistency factors for the images. The methods may also include generating modified mean pixel values by multiplying the mean pixel values by the respective consistency factors. The methods may also include adjusting the consistency factors to reduce differences of the modified mean pixel values in the overlapping regions. The methods may further include adjusting pixel values of the images based on the respective consistency factors.
    Type: Grant
    Filed: June 30, 2016
    Date of Patent: May 28, 2019
    Assignee: Shanghai Xiaoyi Technology Co., Ltd.
    Inventor: Kongqiao Wang
  • Patent number: 10298864
    Abstract: Foreign lighting effects, such as lens flare, are very common in natural images. In a two-camera-system, the two images may be fused together to generate one image of a better quality. However, there are frequently different foreign light patterns in the two images that form the image pair, e.g., due to the difference in lens design, sensor and position, etc. Directly fusing such pairs of images will result in non-photorealistic images, with composed foreign light patterns from both images from the image pair. This disclosure describes a general foreign light mitigation scheme to detect all kinds of foreign light region mismatches. The detected foreign light mismatch regions may be deemphasized or excluded in the fusion step, in order to create a fused image that keeps a natural-looking foreign light pattern that is close to what was seen by the user of an image capture device during an image capture preview mode.
    Type: Grant
    Filed: June 8, 2017
    Date of Patent: May 21, 2019
    Assignee: Apple Inc.
    Inventors: Xiaoxing Li, Paul M. Hubel, Marius Tico, Lech J. Szumilas
  • Patent number: 10297034
    Abstract: A method performed by an electronic device is described. The method includes obtaining a first image from a first camera, the first camera having a first focal length and a first field of view. The method also includes obtaining a second image from a second camera, the second camera having a second focal length and a second field of view disposed within the first field of view. The method further includes aligning at least a portion of the first image and at least a portion of the second image to produce aligned images. The method additionally includes fusing the aligned images based on a diffusion kernel to produce a fused image. The diffusion kernel indicates a threshold level over a gray level range. The method also includes outputting the fused image. The method may be performed for each of a plurality of frames of a video feed.
    Type: Grant
    Filed: April 27, 2017
    Date of Patent: May 21, 2019
    Assignee: QUALCOMM Incorporated
    Inventors: James Wilson Nash, Kalin Mitkov Atanassov, Sergiu Radu Goma
  • Patent number: 10288843
    Abstract: An optical image capturing system includes, along the optical axis in order from an object side to an image side, a first lens, a second lens, a third lens, a fourth lens, and a fifth lens. At least one lens among the first to the fifth lenses has positive refractive force. The fifth lens can have negative refractive force, wherein both surfaces thereof are aspheric, and at least one surface thereof has an inflection point. The lenses in the optical image capturing system which have refractive power include the first to the fifth lenses. The optical image capturing system can increase aperture value and improve the imaging quality for use in compact cameras.
    Type: Grant
    Filed: November 15, 2016
    Date of Patent: May 14, 2019
    Assignee: ABILITY OPTO-ELECTRONICS TECHNOLOGY CO. LTD.
    Inventors: Chien-Hsun Lai, Nai-Yuan Tang, Yeong-Ming Chang
  • Patent number: 10282859
    Abstract: An example system for determining relative position information includes a plurality of positioning devices for determining relative position data within a three-dimensional space, each positioning device having a line of sight. The relative position data determined via each positioning device includes relative position data with respect to the positioning device for each other positioning device within its line of sight. The system further includes a plurality of imaging devices for obtaining image data of an object within the three-dimensional space. The system also includes a computing device configured to correlate the relative position data determined via the plurality of positioning devices and the image data obtained via the plurality of imaging devices, to thereby determine relative position information corresponding to the object within the three-dimensional space.
    Type: Grant
    Filed: December 12, 2016
    Date of Patent: May 7, 2019
    Assignee: The Boeing Company
    Inventors: Jeffrey H. Hunt, Michael M. Vander Wel
  • Patent number: 10275943
    Abstract: A device may receive, from a user device, information that identifies a geolocation of the user device. The device may determine a set of sensor devices that are associated with the geolocation. The device may request, from the set of sensor devices, real-time information associated with the geolocation based on determining the set of sensor devices. The device may receive, from the set of sensor devices, the real-time information associated with the geolocation based on requesting the real-time information. The device may provide, to the user device, the real-time information associated with the geolocation to permit the user device to provide, for display, the real-time information as an augmented reality overlay.
    Type: Grant
    Filed: December 13, 2016
    Date of Patent: April 30, 2019
    Assignee: Verizon Patent and Licensing Inc.
    Inventors: Christopher Samuel Choi, Myles Coolen, Mitchell Edward Dull, Harsha Viswanathan, Christian Guirnalda, Jaskeerat Bedi, Mrinalini Ingram
  • Patent number: 10269132
    Abstract: [Object] To process an image captured by a camera mounted on a moving object device or a user to be suitable for display on an image display device fixed to the head or face of the user. [Solution] The image rendering processor 1042, in the beginning, corrects the user's head posture angle qh using the camera posture angle qc (F1421), and clips a display angle of view depending on the corrected user's head posture angle qh* from the captured image to render a free viewpoint image (F1422). Then, the image processing device 1040 transmits the free viewpoint image rendered by the image rendering processor 1042 to the display device 1020 via the communication unit 1041, and the image is displayed on the display device 1020 (F1430).
    Type: Grant
    Filed: May 18, 2015
    Date of Patent: April 23, 2019
    Assignee: Sony Corporation
    Inventors: Kenta Kawamoto, Hirokazu Tatsuta, Yuichiro Koyama
  • Patent number: 10264188
    Abstract: In some embodiments, a first camera unit includes a first actuator for moving a first optical package configured for a first focal length. A second camera unit of the multifunction device for simultaneously capturing a second image of a second visual field includes a second actuator for moving a second optical package configured for a second focal length, and the camera system includes a shared magnet positioned between the first camera unit and the second camera unit to generate magnetic fields usable in creating motion in both the first camera actuator and the second camera actuator.
    Type: Grant
    Filed: September 30, 2015
    Date of Patent: April 16, 2019
    Assignee: Apple Inc.
    Inventors: Scott W. Miller, Shashank Sharma, Simon S. Lee
  • Patent number: 10257652
    Abstract: Disclosed inter alia is a method, comprising: wireless transmitting of transmission information from an apparatus, wherein the transmission information comprises an identifier of the apparatus, and wherein the identifier is associated with a resource.
    Type: Grant
    Filed: October 19, 2016
    Date of Patent: April 9, 2019
    Assignee: ICE Gateway GmbH
    Inventors: Ramin Lavae Mokhtari, Gerd Ascheid
  • Patent number: 10257485
    Abstract: A computer-implemented method includes capturing, with a camera, a first image of a physical item at a first camera position, detecting borders associated with the physical item, based on the first image, generating an overlay that includes a plurality of objects that are positioned within one or more of the borders associated with the physical item, capturing, with the camera, subsequent images of the physical item, where each subsequent image is captured with a respective subsequent camera position, and during capture of the subsequent images, displaying an image preview that includes the overlay. The method further includes establishing correspondence between pixels of the first image and pixels of each of the subsequent images and generating a composite image of the physical item, where each pixel value of the composite image is based on corresponding pixel values of the first image and the subsequent images.
    Type: Grant
    Filed: November 14, 2016
    Date of Patent: April 9, 2019
    Assignee: Google LLC
    Inventors: Julia Winn, David Lieb, Eric Henry
  • Patent number: 10249340
    Abstract: It is an object of the invention to realize automatic video generation displaying in an easily understandable manner the state of brush stroke as effectively maintaining immersion feeling happened by looking-around operation during reproduction of the image production of an omnidirectional image. A stroke information group is associated with valid line-of-sight information from a reproduction sequence recording the line-of-sight information and the stroke information group. The number of frames between a pair of line-of-sight information is made constant. When the line-of-sight moves from a line-of-sight A via a line-of-sight B to a line-of-sight C, the stroke information group corresponding to the line-of-sight B is reproduced in a range from “a frame of a center between the line-of-sight information A and B” to “a frame of a center between the line-of-sight information B and C”.
    Type: Grant
    Filed: November 17, 2017
    Date of Patent: April 2, 2019
    Inventor: Mitsuo Hayashi
  • Patent number: 10244215
    Abstract: Innovations in reconstruction and rendering of panoramic video are described. For example, a view-dependent operation controller of a panoramic video playback system receives an indication of a view direction for an application and, based at least in part on the view direction, identifies a section of a picture of panoramic video in an input projection. The view-dependent operation controller limits operations of a color converter, video decoder, and/or streaming controller to the identified section. In this way, the panoramic video playback system can avoid performing operations to reconstruct sections of the picture of panoramic video that will not be viewed. As another example, a mapper of a panoramic video playback system re-projects at least some sample values in an input flat projection towards a center location for a view direction, producing an output flat projection, which an application can use to generate one or more screen projections.
    Type: Grant
    Filed: December 19, 2016
    Date of Patent: March 26, 2019
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Matthew Wozniak, Bakkama Srinath Reddy, Vladislav Alexandrov, David H. Mebane, Dibyajyoti Roy, Shyam Sadhwani
  • Patent number: 10244168
    Abstract: A system for video capture and delivery is disclosed. The system comprises a camera with multiple sensors to capture video at a first location, and to stitch images corresponding to the multiple sensors to produce a panoramic video having at least a 100 degrees field of view; and a cloud-based server to process the panoramic video for delivery to a plurality of client devices, and to stream the processed video to the plurality of client devices.
    Type: Grant
    Filed: July 12, 2017
    Date of Patent: March 26, 2019
    Assignee: Altia Systems, Inc.
    Inventors: Naveed Alam, Yashket Gupta, Ram Natarajan, Oliver Gunasekara, Aurangzeb Khan, Lars Herlitz, Atif Sarwari
  • Patent number: 10244164
    Abstract: A method performed by an electronic device is described. The method includes receiving a plurality of images from a first camera with a first field of view and a second plurality of images from a second camera with a second field of view. An overlapping region exists between the first field of view and the second field of view. The method also includes predicting a disparity of a moving object present in a first image of the first plurality of images. The moving object is not present in a corresponding second image of the second plurality of images. The method further includes determining warp vectors based on the predicted disparity. The method additionally includes combining an image from the first plurality of images with an image from the second plurality of images based on the determined warp vectors.
    Type: Grant
    Filed: September 11, 2017
    Date of Patent: March 26, 2019
    Assignee: QUALCOMM Incorporated
    Inventors: Sudipto Banerjee, Pushkar Gorur Sheshagiri, Pawan Kumar Baheti, Ajit Deepak Gupte, Ajit Venkat Rao
  • Patent number: 10235767
    Abstract: [Object] To process an image captured by a camera mounted on a moving object device or a user to be suitable for display on an image display device fixed to the head or face of the user. [Solution] The image rendering processor 1042, in the beginning, corrects the user's head posture angle qh using the camera posture angle qc (F1421), and clips a display angle of view depending on the corrected user's head posture angle qh* from the captured image to render a free viewpoint image (F1422). Then, the image processing device 1040 transmits the free viewpoint image rendered by the image rendering processor 1042 to the display device 1020 via the communication unit 1041, and the image is displayed on the display device 1020 (F1430).
    Type: Grant
    Filed: May 18, 2015
    Date of Patent: March 19, 2019
    Assignee: Sony Corporation
    Inventors: Kenta Kawamoto, Hirokazu Tatsuta, Yuichiro Koyama
  • Patent number: 10237614
    Abstract: In one embodiment, a method comprising receiving data of a plurality of viewports generated from a content item during rendering of the content item, receiving data about at least one feature included in the content item, comparing the data of the plurality of viewports with the data about the at least one feature included in the content item, and computing a score representing to what extent the at least one feature is included in the plurality of viewports. Related apparatus and methods are also described.
    Type: Grant
    Filed: April 19, 2017
    Date of Patent: March 19, 2019
    Assignee: Cisco Technology, Inc.
    Inventors: Yoav Glazner, Amitay Stern
  • Patent number: 10235010
    Abstract: An information processing apparatus acquires information about designation of a position of a virtual viewpoint related to a virtual viewpoint image generated based on image capturing by a plurality of cameras, and decides, based on the information, a virtual listening point for generating an audio signal based on sound pickup at a plurality of sound pickup points.
    Type: Grant
    Filed: July 7, 2017
    Date of Patent: March 19, 2019
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Masanobu Funakoshi
  • Patent number: 10229714
    Abstract: A time slice video providing apparatus includes a video receiving unit configured to receive multiple videos recorded by multiple cameras, a selection unit configured to select a region of interest from at least one of the multiple videos, a coordinate restoring unit configured to restore multi-dimensional center coordinates based on the selected region of interest and positional relationship information between the multiple cameras, and a generation unit configured to extract each image from the multiple videos based on the restored multi-dimensional center coordinates and generate a time slice video using each of the extracted images.
    Type: Grant
    Filed: January 29, 2018
    Date of Patent: March 12, 2019
    Assignee: KT CORPORATION
    Inventor: Hyoung-Chul Shin
  • Patent number: 10218916
    Abstract: This application discloses a camera including a camera lens, a plurality of light sources and bypass circuit. The camera lens is configured to capture visual data of a field of view, and the light sources are configured to illuminate the field of view. The bypass circuit is coupled to the light sources, and configured to group the light sources into a plurality of light source subsets. At least two of the light source subsets include distinct light source members to illuminate different regions of the field of view of the camera. The camera includes a first mode in which the light sources are electrically coupled in series to form a string and driven by a boosted drive voltage, and a second mode in which one of the light source subsets is selected and driven by a regular drive voltage that is lower than the boosted drive voltage.
    Type: Grant
    Filed: January 5, 2018
    Date of Patent: February 26, 2019
    Assignee: GOOGLE LLC
    Inventors: Arvind Dorai, Anders Nelson, Brian Jonathan Conner
  • Patent number: 10217031
    Abstract: An approach is provided that captures a digital image of an object that has a number of facets. The approach further determines the actual sizes of various facets found on the object. The actual sizes of the facets are used to identify compatible objects based, with the compatible objects being objects that can work with the object.
    Type: Grant
    Filed: October 13, 2016
    Date of Patent: February 26, 2019
    Assignee: International Business Machines Corporation
    Inventors: Charles E. Beller, Benjamin L. Johnson
  • Patent number: 10218903
    Abstract: The digital 3D/360° camera system is an omnidirectional stereoscopic device for capturing image data that may be used to create a 3-dimensional model for presenting a 3D image, a 3D movie, or 3D animation. The device uses multiple digital cameras, arranged with overlapping fields of view, to capture image data covering an entire 360° scene. The data collected by one, or several, digital 3D/360° camera systems can be used to create a 3D model of a 360° scene by using triangulation of the image data within the overlapping fields of view.
    Type: Grant
    Filed: June 19, 2017
    Date of Patent: February 26, 2019
    Inventor: Leonard P. Steuart, III
  • Patent number: 10204418
    Abstract: A method, apparatus and computer program products are provided for facilitating stereo vision through the use of multi-layer shifting. One example method includes receiving a first RGB image and a second RGB image, each captured from a different position, generating corresponding depth images, performing a first segmentation on the depth images, performing a second segmentation on the RGB images resulting in a first object mask and a second object mask, stitching of the background layers to form a background layer, generating a series of images comprising a first image representative of a view from the first position and a second image representative of a view from the second position, the series of images demonstrating a shifting of an object layer occurring at a higher speed than a shifting of the background layer.
    Type: Grant
    Filed: September 7, 2016
    Date of Patent: February 12, 2019
    Assignee: NOKIA TECHNOLOGIES OY
    Inventors: Bodi Yuan, Muninder Veldandi
  • Patent number: 10205930
    Abstract: A camera system is configured to capture video content with 360 degree views of an environment. The camera array comprises a housing including a first quadrant, a second quadrant, a third quadrant, and a fourth quadrant, wherein each of the first quadrant, the second quadrant, the third quadrant, and the fourth quadrant form a plurality of apertures, a chassis bottom that is removably coupled to the housing, and a plurality of camera modules, each camera module comprising a processor, a memory, a sensor, and a lens, wherein each of the camera modules is removably coupled to one of the plurality of apertures in the housing, wherein the first quadrant, the second quadrant, the third quadrant, and the fourth quadrant each include a subset of the plurality of camera modules. Each of the plurality of camera modules includes a heat sink.
    Type: Grant
    Filed: September 15, 2016
    Date of Patent: February 12, 2019
    Inventors: Arthur Van Hoff, Thomas M. Annau, Jens Christensen, Koji Gardiner, Punit Govenji, James Dunn
  • Patent number: 10204280
    Abstract: A computer includes a processor that is programmed to activate a vehicle exterior light, and measure a luminance in a predetermined region outside the vehicle based on vehicle camera data. The processor is programmed to determine whether the vehicle exterior light is operational based the measured luminance.
    Type: Grant
    Filed: June 1, 2017
    Date of Patent: February 12, 2019
    Assignee: FORD GLOBAL TECHNOLOGIES, LLC
    Inventors: Ryan J. Skaff, Tsung-Han Tsai
  • Patent number: 10204291
    Abstract: A discrepancy detection system for detecting a discrepancy between a plurality of video images of a same scene captured by an imaging device at different times, the system including a correspondence point detection device configured to detect corresponding points matching each other between a first video image sequence of the plurality of video images and a second video image sequence of the plurality of video images and a comparison device configured to compare image content of the first video image sequence and the second video image sequence for the discrepancy in the image content between the first video image sequence and the second video image sequence.
    Type: Grant
    Filed: August 31, 2015
    Date of Patent: February 12, 2019
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Chung-Ching Lin, Sharathchandra U. Pankanti, John R. Smith
  • Patent number: 10200606
    Abstract: An image processing apparatus comprises an image obtaining unit configured to obtain an omnidirectional image, a traveling direction obtaining unit configured to obtain information on a traveling direction of an image capturing apparatus when the omnidirectional image was shot, and a processing unit configured to perform processing of panoramic expansion on the omnidirectional image obtained by the image obtaining unit, based on the information on the traveling direction obtained with the traveling direction obtaining unit, such that an image portion corresponding to the traveling direction is positioned at a horizontal center in a panoramically expanded image, wherein the processing unit performs processing of panoramic expansion in accordance with change in the traveling direction in a case where the traveling direction changes while shooting the omnidirectional image that is a moving image.
    Type: Grant
    Filed: October 29, 2015
    Date of Patent: February 5, 2019
    Assignee: Canon Kabushiki Kaisha
    Inventor: Ryuichi Ishikuri
  • Patent number: 10198862
    Abstract: Apparatus and methods for providing a rotated spherical viewpoint (RSV). In one or more embodiments, the RSV is implemented using equirectangular projections (ERPs). The RSV methodologies described herein are particularly suitable for panning within virtual reality (VR) or 360° panoramic content as there is minimal, if any, geometric distortions at the edge of a given viewport. Moreover, the RSV methodologies described herein may reduce the bandwidth requirements of, for example, devices operating in a client-server architecture. Additionally, the computation requirements for providing RSV are minimal and can be provided using relatively simple rotation transforms.
    Type: Grant
    Filed: June 1, 2017
    Date of Patent: February 5, 2019
    Assignee: GOPRO, INC.
    Inventor: Adeel Abbas
  • Patent number: 10200609
    Abstract: An image processing apparatus including an interface that receives an input identifying a subject, and a processor that generates a panoramic image based on captured image data so that the subject is positioned in a reference position in the panoramic image.
    Type: Grant
    Filed: December 5, 2017
    Date of Patent: February 5, 2019
    Assignee: SONY CORPORATION
    Inventors: Takuya Arai, Junichiro Goto
  • Patent number: 10192284
    Abstract: A method for managing a surveillance system includes at least one camera equipped with capability of capturing direction adjustment, such as a Pan-Tilt-Zoom (PTZ) camera. The method includes the steps of: outputting a panoramic map to a display module of the surveillance system for being displayed on the display module; according to at least one user input of a user of the surveillance system, labeling a target patrol route of the surveillance system on the panoramic map correspondingly for the user to confirm the target patrol route; and applying at least one configuration corresponding to the target patrol route to the camera to cause capturing direction adjustment operations of the camera to correspond to the target patrol route. The panoramic map may include at least one multi-directional combination picture corresponding to the camera.
    Type: Grant
    Filed: October 6, 2015
    Date of Patent: January 29, 2019
    Assignee: Synology Incorporated
    Inventors: Szu-Hsien Lee, Bo-Shao Lin, His-Wei Chang
  • Patent number: 10187572
    Abstract: A method for generating panoramic aerial images includes controlling a carrier to rotate an image capturing device by a predetermined angle of rotation around a first axis of the carrier. The image capturing device is coupled to an unmanned aerial vehicle (UAV) via the carrier and the carrier is configured to permit the image capturing device to rotate around at least the first axis and a second axis. The method further includes controlling the carrier to stabilize the image capturing device with respect to at least the second axis while the image capturing device is rotating around the first axis, by controlling one or more actuator members of the carrier. The method also includes controlling the image capturing device to capture a plurality of successive images while the image capturing device is rotating around the first axis and generating a panoramic image based on the captured plurality of images.
    Type: Grant
    Filed: December 7, 2017
    Date of Patent: January 22, 2019
    Assignee: SZ DJI OSMO TECHNOLOGY CO., LTD.
    Inventors: Mingyu Wang, Zisheng Cao, Taiwen Liang, Lifu Yu