Panoramic Patents (Class 348/36)
  • Patent number: 10846831
    Abstract: Various technologies described herein pertain to rectification of a fisheye image. A computing system receives the fisheye image. Responsive to receiving the fisheye image, the computing system applies a first lookup function to a first portion of the fisheye image to mitigate spatial distortions of the fisheye image. The computing system also applies a second lookup function to a second portion of the fisheye image to mitigate the spatial distortions. The first lookup function maps first pixels in the first portion to a first rectilinear image corresponding to the first portion when viewed from a first perspective of a first virtual camera. The second lookup function maps second pixels in the second portion to a second rectilinear image corresponding to the second portion when viewed from a second perspective of a second virtual camera. The computing system then outputs the first rectilinear image and the second rectilinear image.
    Type: Grant
    Filed: December 19, 2018
    Date of Patent: November 24, 2020
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventor: Radu Raduta
  • Patent number: 10845943
    Abstract: A system for generating a 360-degree viewing experience may receive a plurality of images of an object from an image capture device, wherein each of the plurality of images corresponds to a different rotational orientation of the object relative to the image capture device. The system may detect, using a first machine learning model, the object in each of the plurality of images. The system may detect, using a second machine learning model, regions associated with identifiable object features in one or more images of the plurality of images. The system may assign feature metadata to the one or more images, the features metadata associated with one or more detected regions of the detected regions of the object in the one or more images. The system may publish, with an application programming interface, the plurality of images and the feature metadata for the 360-degree viewing experience.
    Type: Grant
    Filed: February 14, 2020
    Date of Patent: November 24, 2020
    Assignee: CARMAX BUSINESS SERVICES, LLC
    Inventors: Omar Ahmed Ansari, Clark Barrett Jennings
  • Patent number: 10846529
    Abstract: An image monitoring system includes: recording means for recording an image captured by a camera via a network; control means for controlling the system so as to display the present image captured by the camera or a past image recorded on the recording means on display means; and moving-object detecting means for detecting a moving object from the image captured by the camera; wherein the moving-object detecting means includes resolution conversion means for generating an image with a resolution lower than the resolution of the image captured by the camera, positional-information output means for detecting a moving object from the image generated by the resolution conversion means and outputting positional information on the detected moving object, and information merging means for merging the positional information of the moving object with the image captured by the camera on the basis of the positional information of the moving object output by the positional-information output means.
    Type: Grant
    Filed: April 29, 2019
    Date of Patent: November 24, 2020
    Assignee: SONY CORPORATION
    Inventors: Masaki Demizu, Miki Murakami
  • Patent number: 10839236
    Abstract: A vehicle exterior environment recognition apparatus includes first and luminance-image acquiring units, first and second distance-image generating units, and a composite-image generating unit. The first luminance-image acquiring unit acquires first luminance images captured by image-capturing units that are disposed at positions different from each other at a first exposure time. The second luminance-image acquiring unit acquires second luminance images captured by the image-capturing units at a second exposure time shorter than the first exposure time. The first distance-image generating unit generates a first distance image through pattern matching of the first luminance images. The second distance-image generating unit generates a second distance image through pattern matching of the second luminance images.
    Type: Grant
    Filed: January 7, 2019
    Date of Patent: November 17, 2020
    Assignee: SUBARU CORPORATION
    Inventor: Toshimi Okubo
  • Patent number: 10839480
    Abstract: Provided are systems and methods for processing 360-degree video data. In various implementations, a spherical representation of a 360-degree video frame can be segmented into a top region, a bottom region, and a middle region. Using a cylindrical equal area projection, such as the Lambert cylindrical equal area projection, the middle region can be mapped into one or more rectangular areas of an output video frame.
    Type: Grant
    Filed: March 20, 2018
    Date of Patent: November 17, 2020
    Assignee: QUALCOMM Incorporated
    Inventors: Geert Van Der Auwera, Muhammed Coban, Marta Karczewicz
  • Patent number: 10841561
    Abstract: An apparatus for three-dimensional inspection includes a carrier, an image sensing component, and a processor. The carrier is configured to hold an object. The image sensing component is configured to capture a first image, a second image and a third image of the object along a first axis, a second axis, and a third axis respectively, and the first axis, the second axis, and the third axis are not parallel with each other. The processor is configured to analyze the first image and the second image to obtain a first directional stereo information, and analyze the third image and a determined image of the object to obtain a second directional stereo information.
    Type: Grant
    Filed: March 24, 2017
    Date of Patent: November 17, 2020
    Assignee: Test Research, Inc.
    Inventors: Wen-Tzong Lee, Kuang-Pu Wen, Don Lin
  • Patent number: 10841513
    Abstract: A controller and method therein for controlling encoding of a set of images to enable blending of an overlapping area, where a first image and a second image overlap each other are disclosed. The controller encodes macroblocks of the non-overlapping area in the first image using a set of base quantization parameter values, QP-values, and adds the same set of base QP-values to a header of each macroblock. The controller encodes macroblocks of the overlapping area in the first image using a set of first QP values, and adds a modified set of the first QP-values to a header of each macroblock. The controller encodes macroblocks of the overlapping area in the second image using a set of second QP values, and adds a modified set of the second OP-values to a header of each macroblock.
    Type: Grant
    Filed: November 26, 2018
    Date of Patent: November 17, 2020
    Assignee: AXIS AB
    Inventors: Song Yuan, Viktor Edpalm
  • Patent number: 10834316
    Abstract: An image processing apparatus detecting a plurality of joint positions between a plurality of input images includes a target image generation unit configured to generate a plurality of target images to be searched in a second input image among the input images from a first input image among the input images; a characteristic amount calculation unit configured to calculate a characteristic amount for each of the target images generated by the target image generation unit; and a joint position determination unit configured to determine the joint position for a target image of interest among the target images having the characteristic amounts calculated by the characteristic amount calculation unit depending on the characteristic amount.
    Type: Grant
    Filed: July 19, 2019
    Date of Patent: November 10, 2020
    Assignee: RICOH COMPANY, LTD.
    Inventors: Hirokazu Takenaka, Kazuhiro Yoshida, Keiichi Kawaguchi
  • Patent number: 10832425
    Abstract: A method and an apparatus for a terminal, where the method includes obtaining a first video sequence photographed by a first camera and a second video sequence photographed by a second camera, determining, according to a first image in the first video sequence and photographed at a first moment and a second image in the second video sequence and photographed at the first moment, an available first motion vector (V), and a third image and a fourth image corresponding to the V, obtaining a second motion vector (U) of the first image relative to the third image, obtaining a third motion vector (W) of the fourth image relative to the second image, and obtaining a correspondence between a pixel in the first image and a pixel in the second image according to the V, the U, and the W.
    Type: Grant
    Filed: March 30, 2016
    Date of Patent: November 10, 2020
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventor: Gang Chen
  • Patent number: 10827118
    Abstract: A tiltable system for panoramic imaging of a scene.
    Type: Grant
    Filed: November 11, 2019
    Date of Patent: November 3, 2020
    Assignee: AXIS AB
    Inventors: Johan Stening, Henrik Persson, Agnes Rusz, Andree Bengtsson
  • Patent number: 10825147
    Abstract: A surround view system for a vehicle includes a processor (10) and cameras (2 to 5) that can be arranged on the vehicle so that the cameras (2 to 5) can record images of an outside environment of the vehicle. The processor is configured to analyze a position (?) and/or a movement of a movable part (14) of the vehicle (1) and to generate a composite image of the outside environment from individual images recorded by the cameras. Furthermore, the processor is configured to calculate an image processing region within the composite image for an adaptive image processing, to determine, based on the analyzed position and/or movement of the movable part (14), that a back-projection of the movable part (14) goes beyond the image processing region, and to modify the image processing region so that the back-projection of the movable part (14) is within the modified image processing region.
    Type: Grant
    Filed: March 5, 2018
    Date of Patent: November 3, 2020
    Assignee: Conti Temic microelectronic GmbH
    Inventors: Markus Friebe, Martin Buerker
  • Patent number: 10819971
    Abstract: A system captures a first hemispherical image and a second hemispherical image, each hemispherical image including an overlap portion, the overlap portions capturing a same field of view, the two hemispherical images collectively comprising a spherical FOV and separated along a longitudinal plane. The system maps a modified first hemispherical image to a first portion of the 2D projection of a cubic image, the modified first hemispherical image including a non-overlap portion of the first hemispherical image, and maps a modified second hemispherical image to a second portion of the 2D projection of the cubic image, the modified second hemispherical image also including a non-overlap portion. The system maps the overlap portions of the first hemispherical image and the second hemispherical image to the 2D projection of the cubic image, and encodes the 2D projection of the cubic image to generate an encoded image representative of the spherical FOV.
    Type: Grant
    Filed: November 18, 2019
    Date of Patent: October 27, 2020
    Assignee: GoPro, Inc.
    Inventors: Timothy MacMillan, Adeel Abbas
  • Patent number: 10817980
    Abstract: An information processing apparatus, an information processing system, a data generation method, and a recording medium storing program code. The information processing apparatus and data generation method include displaying a spherical image obtained by an imaging apparatus, reproducing three-dimensional audio data obtained by the imaging apparatus in association with the spherical image, accepting designation of a displaying direction on the spherical image, generating two-dimensional image data that corresponds to the displaying direction, based on data of the spherical image, and generating two-dimensional audio data that corresponds to the displaying direction, from the three-dimensional audio data. The information processing system includes the information processing, and an image processing server connected to the information processing apparatus through a communication network.
    Type: Grant
    Filed: January 2, 2019
    Date of Patent: October 27, 2020
    Assignee: RICOH COMPANY, LTD.
    Inventor: Keitaro Shimizu
  • Patent number: 10819954
    Abstract: A panoramic imaging system includes a plurality of separated video cameras that may be distributed around an object. A series of images captured by at least one of the separated video cameras is stored in a predetermined file format. The panoramic system further includes a viewer module that may render the series of images using the first file format. Moreover, the panoramic system includes a calibration module capable of modifying information associated with at least one of the series of images, where the modification results in calibration data stored in a configuration file and/or in the predetermined file format. The viewer module may also be capable of rendering the series of images in accordance with the predetermined file format.
    Type: Grant
    Filed: July 1, 2019
    Date of Patent: October 27, 2020
    Assignee: Immersive Licensing, Inc.
    Inventors: Michael C. Park, Patrick W. White, Steven C. Sandven
  • Patent number: 10819907
    Abstract: A video processing method includes receiving a virtual reality (VR) content, encoding visual data obtained from the VR content to generate a part of a coded bitstream, and encapsulating the part of the coded bitstream into ISO Base Media File Format (ISOBMFF) file (s). In one exemplary implementation, the ISOBMFF file (s) may include a timed metadata track associated with a sphere visual track, where the timed metadata track is set to signal that the associated sphere visual track contains at least one spherical region contributed from at least one region visual track. In another exemplary implementation, the ISOBMFF file (s) may include a timed metadata track associated with a region visual track, where the timed metadata track is set to signal that the associated region visual track contributes to at least one spherical region carried in at least one sphere visual track. Further, an associated video processing apparatus is provided.
    Type: Grant
    Filed: March 29, 2018
    Date of Patent: October 27, 2020
    Assignee: MEDIATEK INC.
    Inventors: Xin Wang, Lulin Chen, Wang Lin Lai
  • Patent number: 10812569
    Abstract: A method, computer program product and system for eye contact-based information transfer. Communication is established by a computer device between a first head mounted device worn by a first user and a second head mounted device worn by a second user. Gaze tracking establishes through gaze tracking of the first head mounted device and the second head mounted device that the first head mounted device and the second head mounted device have made mutual eye contact. Responsive to an input to the first head mounted device made while the established mutual eye contact exists, transferring, by the computer device, a file from the first head mounted device to the second head mounted device.
    Type: Grant
    Filed: November 16, 2018
    Date of Patent: October 20, 2020
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventor: Sarbajit K. Rakshit
  • Patent number: 10802578
    Abstract: An electronic device is provided. The electronic device includes a display, and a processor functionally connected to the display and configured to, when a first input is received while a first partial image, which corresponds to a first direction, in an image taken by at least one camera is displayed on the display, control the display to display a second partial image, which corresponds to a second direction different from the first direction, in the image in response to the first input.
    Type: Grant
    Filed: December 18, 2017
    Date of Patent: October 13, 2020
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Sun-Kee Lee, Gong-Bo Moon, Kyung-Tae Kim, Yo-Han Lee, A-Ran Cha, Eun-Jung Hyun
  • Patent number: 10803590
    Abstract: A multiple-wavelength image analysis electro-optical system for detecting a disabled ship and persons overboard of the present invention is a multiple-wavelength image analysis electro-optical system for detecting a disabled ship and persons overboard configured to have an input part 10 provided with an ultra-low light camera 3, a short-wavelength infrared image sensor 5, a medium-wavelength infrared image sensor 7, and a long-wavelength infrared image sensor 9; a signal processing part 20 for receiving and processing data of the input part 10; a display part 30 for receiving and displaying data of the signal processing part 20; a storage part 40 for storing data of the signal processing part 20 and the display part 30; and a control part 90 provided with a camera control board 50 and a drive control board 60 for controlling the input part 10, signal processing part 20, the display part 30 and the storage part 40.
    Type: Grant
    Filed: May 16, 2018
    Date of Patent: October 13, 2020
    Assignee: KOREA INSTITUTE OF OCEAN SCIENCE & TECHNOLOGY
    Inventors: Sangwoo Oh, Tae-Sung Kim, Won-Soo Kang, Moonjin Lee, Tae-Byung Chun
  • Patent number: 10798280
    Abstract: According to a control device of the present invention, there is provided a center server including a display processing unit that performs control so as to display a panorama image display area in which a panorama image captured with a camera terminal device is displayed and an enlarged image display area in which an enlarged image is displayed, the enlarged image being obtained by enlarging an area corresponding to a position specified on the panorama image, and a control unit that performs control so as to capture with the camera terminal device an image of the area corresponding to the position specified on the panorama image. The display processing unit displays on the enlarged image display area the image captured with the camera terminal device in accordance with control by the control unit, and the panorama image is a circular panorama image.
    Type: Grant
    Filed: June 1, 2010
    Date of Patent: October 6, 2020
    Assignee: Sony Corporation
    Inventor: Kazunori Sakaki
  • Patent number: 10796568
    Abstract: Illuminated signal devices and speed detectors for audio/video (A/V) recording and communication devices in accordance with various embodiments of the present disclosure are provided. In one embodiment, an illuminated signal device configured for capturing image data is provided, the device comprising a camera having a field of view, a communication module, and a processing module operatively connected to the camera and the communication module, the processing module comprising a processor, and a signal device application, wherein the signal device application configures the processor to detect motion within the field of view of the camera, capture image data in response to the detected motion using the camera, and transmit the image data to a backend server using the communication module.
    Type: Grant
    Filed: November 23, 2019
    Date of Patent: October 6, 2020
    Assignee: Amazon Technologies, Inc.
    Inventor: James Siminoff
  • Patent number: 10798301
    Abstract: Disclosed is a panoramic image mapping method and a corresponding reversely mapping method. Particularly, the mapping process includes mapping a panoramic image or a spherical surface corresponding to Video A: first, dividing the spherical surface into three areas based on the latitudes of the spherical surface, denoted as Area I, Area II, and Area III, respectively; mapping the three areas to a square plane I?, a rectangular plane II?, and a square plane III?, respectively; then, splicing the planes I?, II? and III? into a plane, wherein the resulting plane is the two-dimensional image or video B. Compared with the equirectangular mapping method, the method according to the present disclosure may effectively ameliorate oversampling in high-latitude areas and effectively lower the bit rate needed by coding and the complexity of decoding. The present disclosure relates to the field of virtual reality, which may be applied to panoramic images and videos.
    Type: Grant
    Filed: August 22, 2017
    Date of Patent: October 6, 2020
    Assignee: PEKING UNIVERSITY SHENZHEN GRADUATE SCHOOL
    Inventors: Ronggang Wang, Yueming Wang, Zhenyu Wang, Wen Gao
  • Patent number: 10791356
    Abstract: There is described a system for providing streaming services, comprising: a plurality of capture devices each for generating a stream of an event, each stream being associated with a timing reference; and a server for analysing the plurality of captured streams in order to align the received plurality of received captured streams according.
    Type: Grant
    Filed: June 15, 2016
    Date of Patent: September 29, 2020
    Assignee: PIKSEL, INC.
    Inventors: Philip Shaw, Peter Heiland, Sean Everett, Mark Christie, Kristan Bullett, Ralf Tilmann, Hans-Jurgen Maas
  • Patent number: 10791258
    Abstract: A monitoring device includes: a communication interface configured to receive image data acquired by a camera and a signal generated by at least one sensor; a screen configured to display thereon the received image data as a main image; and a controller configured to control operations of the communication interface and the screen, wherein the controller controls the screen to include a control area around an area for displaying the main image so that the control area displays the main image and a surrounding image of the main image, and wherein, in response to the sensor sensing at least one event, the controller controls generation of an alarm with indication of at least one pointer associated with the sensor in the control area as a source of the sensing the event, and controls the main image to be changed to cover an area where the sensor is disposed.
    Type: Grant
    Filed: December 10, 2018
    Date of Patent: September 29, 2020
    Assignee: HANWHA TECHWIN CO., LTD.
    Inventors: Ho Jung Lee, Yeon Woo Kim
  • Patent number: 10783853
    Abstract: An image provision device (100) displays on a field-of-vision covering display (192) an image obtained by trimming all-surroundings image data (21). A detector (11) detects an orientation or a change in the orientation of a user's head or sight line by means of a sensor (191). A direction setter (12) sets an eye direction to the all-surroundings image data (21) in accordance with the detected orientation or change in the orientation. An extractor (13) obtains a zoomed image by trimming and zooming part of the all-surroundings image with a zoom factor that depends on an angle formed between the set eye direction and a predetermined direction in the all-surroundings image data (21). A displayer (14) displays the obtained zoomed image on a display (192).
    Type: Grant
    Filed: November 2, 2016
    Date of Patent: September 22, 2020
    Assignee: Rakuten, Inc.
    Inventor: Naoki Chiba
  • Patent number: 10776902
    Abstract: Image processing device for producing in real-time a digital composite image from a sequence of digital images recorded by a camera device, in particular an endoscopic camera device, the image processing device including a selecting unit, a key point detection unit, a transforming unit and a joining unit, wherein the key point detection unit includes a maximum detection unit configured for executing following steps separately for the filter response for the reference image and for the filter response for the further image, wherein a variable threshold is used: i) creating blocks by dividing the respective filter response, ii) calculating the variable threshold for each of the blocks, iii) discarding those blocks of the blocks from further consideration, in which the respective filter response at a reference point of the respective block is less than the respective variable threshold.
    Type: Grant
    Filed: May 30, 2019
    Date of Patent: September 15, 2020
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Tobias Bergen, Michaela Benz, Andreas Ernst, Thomas Wittenberg, Christian Muenzenmayer, Frederik Zilly, Malte Avenhaus
  • Patent number: 10771711
    Abstract: Provided is an imaging apparatus that includes a first imaging section that sequentially shoots a plurality of images including a first image, a second imaging section that shoots at least one image including a second image, a signal processor that synthesizes the plurality of images shot by the first imaging section, a characteristic amount calculator that calculates a characteristic amount of a subject based on the first image and the second image, and an exposure amount controller that controls exposure amounts of the first imaging section and the second imaging section to reduce a difference between the exposure amount of the first image and the exposure amount of the second image.
    Type: Grant
    Filed: March 14, 2017
    Date of Patent: September 8, 2020
    Assignee: SONY CORPORATION
    Inventor: Kazuyuki Okuike
  • Patent number: 10771693
    Abstract: An image captured by a camera having a fixed imaging range and an image captured by a camera capable of changing an imaging range are appropriately distributed. An imaging apparatus includes a plurality of first imaging units, a second imaging unit configured to be capable of changing an imaging range, and a distribution unit configured to distribute a plurality of first captured images in a sequence based on a region.
    Type: Grant
    Filed: September 4, 2018
    Date of Patent: September 8, 2020
    Assignee: Canon Kabushiki Kaisha
    Inventor: Naohiro Yamamoto
  • Patent number: 10762597
    Abstract: There is provided a generation apparatus, a generation method, a reproduction apparatus, and a reproduction method by which a display image generated by use of an omnidirectional image is made approximately uniform in image quality in all visual line directions. A down-conversion part down-converts an omnidirectional image. A perspective projection part generates multiple images by projecting on multiple two-dimensional planes the omnidirectional image mapped onto a 3D model. This disclosure may be applied, for example, to generation apparatuses that generate an omnidirectional image from captured images in six directions so as to generate low- and high-resolution streams of the omnidirectional image.
    Type: Grant
    Filed: April 28, 2017
    Date of Patent: September 1, 2020
    Assignee: SONY CORPORATION
    Inventor: Nobuaki Izumi
  • Patent number: 10764504
    Abstract: An electronic device is provided that includes a display, and a first camera module including a first lens and a first lens driving unit. The electronic device also includes a second camera module including a second lens and a second lens driving unit. The electronic device further includes a processor configured to display a first image, which is obtained through the first camera module. The processor is also configured to receive an input associated with switching from the first camera module to the second camera module. Additionally, the processor is configured to move the second lens in a direction that reduces parallax with the first camera module by using the second lens driving unit. The processor is further configured to display a second image, which is obtained through the second camera module in the state in which the second lens is moved.
    Type: Grant
    Filed: August 23, 2018
    Date of Patent: September 1, 2020
    Assignee: Samsung Electronics Co., Ltd
    Inventors: Jae Myung Baek, Sang Kee Jung
  • Patent number: 10764513
    Abstract: An image data communication system includes: a first communication terminal including first circuitry; and a second communication terminal including second circuitry. The first circuitry of the first communication terminal is configured to transmit a plurality of pieces of image data and layer display order information indicating a layer display order in which a plurality of images represented by the plurality of pieces of image data are to be displayed. The second circuitry of the second communication terminal is configured to display the plurality of images represented by the plurality of pieces of image data transmitted from the first communication terminal in the layer display order based on the layer display order information transmitted from the first communication terminal.
    Type: Grant
    Filed: July 23, 2019
    Date of Patent: September 1, 2020
    Assignee: Ricoh Company, Ltd.
    Inventors: Yohhei Ohmura, Kenichiro Morita, Takafumi Takeda, Hidekuni Annaka, Takeshi Homma, Mayu Hakata
  • Patent number: 10761595
    Abstract: A method, apparatus and computer program is provided. The method comprises: causing display of a panoramic menu in which a first panoramic menu item and a second panoramic menu item are simultaneously displayed, wherein the first panoramic menu item extends beyond a user's field of view and is associated with first mediated reality content, and the second panoramic menu item extends beyond a user's field of view and is associated with second mediated reality content, different from the first mediated reality content.
    Type: Grant
    Filed: June 22, 2016
    Date of Patent: September 1, 2020
    Assignee: Nokia Technologies Oy
    Inventors: Jussi Leppänen, Antti Eronen, Arto Lehtiniemi
  • Patent number: 10757345
    Abstract: An image capture apparatus suitable for capturing images for use in generating a virtual reality environment, the apparatus comprising a three-dimensional frame that defines an internal volume and a plurality of cameras arranged on the frame so as to form a three-dimensional array, wherein the cameras are arranged to face inwards towards a part of the internal volume and are arranged to capture images of a scene located outside the internal volume, the images also comprising at least a portion of the internal volume.
    Type: Grant
    Filed: October 17, 2016
    Date of Patent: August 25, 2020
    Assignee: Sony Interactive Entertainment Inc.
    Inventor: Jason Doig
  • Patent number: 10757463
    Abstract: There is provided an information processing apparatus and an information processing method which are capable of reliably recognizing the position on a screen of an image made up of a plurality of divided images or the positions on the screen of divided images compatible with encoded streams. A position protruding out of a screen is set as the position on the screen of an end image that is made up of a left end image and a right end image compatible with encoded streams. The present disclosure is applicable to a file generating apparatus, etc. of an information processing system that distributes encoded streams of an entire celestial sphere image as an image of a moving-image content to a moving-image playback terminal according to a process equivalent to MPEG-DASH, for example.
    Type: Grant
    Filed: March 28, 2019
    Date of Patent: August 25, 2020
    Assignee: SONY CORPORATION
    Inventors: Mitsuhiro Hirabayashi, Yoichi Yagasaki, Nobuaki Izumi, Mitsuru Katsumata
  • Patent number: 10748333
    Abstract: In various embodiments, a finite aperture omni-directional camera is modeled by aligning a finite aperture lens and focal point with the omni-directional part of the projection. For example, each point on an image plane maps to a direction in camera space. For a spherical projection, the lens can be orientated along this direction and the focal point is picked along this direction at focal distance from the lens. For a cylindrical projection, the lens can be oriented along the projected direction on the two dimensional (2D) xz-plane, as the projection is not omni-directional in the y direction. The focal point is picked along the (unprojected) direction so its projection on the xz-plane is at focal distance from the lens. The final outgoing ray can be constructed by sampling of point on this oriented lens and shooting a ray from there through the focal point.
    Type: Grant
    Filed: January 26, 2018
    Date of Patent: August 18, 2020
    Assignee: NVIDIA Corporation
    Inventor: Dietger van Antwerpen
  • Patent number: 10748257
    Abstract: Systems and methods are described for colorizing a point cloud comprising a set of point cloud data points associated with a particular object using a plurality of candidate images. For each respective data point in the set of point cloud data points, an image is selected, from a subset of the plurality of candidate images that include an un-occluded point of the particular object corresponding to the respective data point, that has a shortest subject distance to the un-occluded point of the particular object. The respective data point is colorized based on a color in the selected image of the un-occluded point of the particular object corresponding to the respective data point.
    Type: Grant
    Filed: June 29, 2018
    Date of Patent: August 18, 2020
    Assignee: TOPCON CORPORATION
    Inventor: Naoki Morikawa
  • Patent number: 10750086
    Abstract: Disclosed herein are a mobile terminal and an operating method thereof. The mobile terminal includes a short-range communication module configured to perform short-range communication with an omnidirectional capture device for capturing an omnidirectional image, a display unit configured to display the omnidirectional image received through the short-range communication module and to receive user input, and a controller configured to set an area, in which a moving image is generated, in the omnidirectional image and to generate the moving image in the set area. Therefore, it is possible to acquire the moving image of the moving object in the omnidirectional image.
    Type: Grant
    Filed: October 13, 2017
    Date of Patent: August 18, 2020
    Assignee: LG ELECTRONICS INC.
    Inventors: Yujune Jang, Seongeun Kim, Bongjeong Jeon, Jie Seol
  • Patent number: 10748348
    Abstract: Embodiments of the present application provide a method, apparatus, electronic device for displaying an image and a storage medium. The method and apparatus are applied to an electronic device. The method comprises: determining a display angle of a 3D wallpaper containing elements, wherein the 3D wallpaper is obtained by pasting an overall spherical panoramic image containing all the elements onto one 3D model; determining a graphic to be displayed corresponding to the display angle in the overall spherical panoramic image; and rendering the graphic to be displayed and displaying the rendered graphic. In the embodiments, when the graphic to be displayed corresponding to the display angle of the 3D wallpaper is rendered, the operation on unnecessary occluded parts is avoided, thereby reducing the amount of computation in displaying the 3D wallpaper and saving the computing resources.
    Type: Grant
    Filed: August 22, 2018
    Date of Patent: August 18, 2020
    Assignee: Beijing Kingsoft Internet Security Software Co., Ltd.
    Inventor: Ming Yan Jonathan Chu
  • Patent number: 10740957
    Abstract: A set of images is mapped to a three-dimensional shape. A two-dimensional image that includes at least two portions is generated based on the three-dimensional shape, and within at least one of the at least two portions is rendered a transformation of at least a subset of the set of images. The two-dimensional image is provided to a display device to cause the display device to simultaneously display at least the two portions on a display surface.
    Type: Grant
    Filed: June 14, 2018
    Date of Patent: August 11, 2020
    Assignee: KILBURN LIVE, LLC
    Inventors: Jon McElroy, Patrick John Ascolese
  • Patent number: 10733697
    Abstract: An apparatus for applying a convolutional neural network (CNN) to a wide-angle camera image is described herein. The apparatus includes a camera, controller, convolution mechanism and a fully connected layer. The camera is to capture a wide-angle image, and the controller is to map the image on a 3D surface. The convolution mechanism is to perform convolution on the 3D surface and the fully connected layer is to classify a plurality of features generated by the convolution mechanism.
    Type: Grant
    Filed: December 27, 2016
    Date of Patent: August 4, 2020
    Assignee: Intel IP Corporation
    Inventors: Koba Natroshvili, Kay-Ulrich Scholl
  • Patent number: 10733786
    Abstract: As user device can receive and display 360 panoramic content in a 360 depth format. 360 depth content can comprise 360 panoramic image data and corresponding depth information. To display 360 depth content, the user device can generate a 3D environment based on the 360 depth content and the current user viewpoint. A content display module on the user device can render 360 depth content using a standard 3D rendering pipeline modified to render 360 depth content. The content display module can use a vertex shader or fragment shader of the 3D rendering pipeline to interpret the depth information of the 360 depth content into the 3D environment as it is rendered.
    Type: Grant
    Filed: July 20, 2018
    Date of Patent: August 4, 2020
    Assignee: Facebook, Inc.
    Inventor: Forrest Samuel Briggs
  • Patent number: 10728496
    Abstract: Now it is time to extend the capability of Internet to “Virtual Existence”; make a rapid change to “the 3D World”, both in real and animation environment; start the new Era of “the instant travels”; “stop the wasted time” with many hours of travelling with cars and replace (reduce) the cars with the best alternative: “Task-Ins Cubicle”. Task-Ins-Cubicle is “a round room”, equipped with Monitors, Cameras, Speakers, and Microphones inside and outside, equipped inside with a Control Console, Internet Connection, and with possibly seating or laying arrangement. The Local Cubicle communicates with a Remote Cubicle placed anywhere in the world. A person in the Local Cubicle is able to feel everything of the Remote Cubicle. Persons at the Remote Task-Ins Cubicle are able to feel the complete holographic existence of the person from the Local Task-Ins Cubicle. Remote Task-Ins Cubicle can be replaced with a virtual Emulation World, to enable 3D Experience with Games and Imaginary Worlds.
    Type: Grant
    Filed: September 14, 2013
    Date of Patent: July 28, 2020
    Inventor: Taskin Sakarya
  • Patent number: 10728551
    Abstract: Apparatus and methods for providing block-based layouts for non-rectangular regions between non-contiguous imaging regions in projections such as, for example, Rotated Sphere Projections (RSP). In one embodiment, methods and apparatus for selecting coding unit block sizes for non-rectangular regions disposed between non-contiguous imaging portions is disclosed.
    Type: Grant
    Filed: September 26, 2018
    Date of Patent: July 28, 2020
    Assignee: GoPro, Inc.
    Inventors: Adeel Abbas, David Newman
  • Patent number: 10715724
    Abstract: A system that facilitates collecting data is described herein. The system includes a digital camera that is configured to capture images in a visible light spectrum and a near-infrared camera that is configured to capture near infrared images, wherein a field of view of the digital camera and the field of view of the near-infrared camera are substantially similar. The system further includes a trigger component that is configured to cause the digital camera and the near-infrared camera to capture images at a substantially similar point in time, and also includes a mounting mechanism that facilitates mounting the digital camera and the near-infrared camera to an automobile.
    Type: Grant
    Filed: July 3, 2015
    Date of Patent: July 14, 2020
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Michael Kroepfl, Michael Gruber, Martin Josef Ponticelli, Stephen Lawler, Joachim Bauer, Franz W. Leberl, Konrad Karner, Zanin Cosic, Hannes Hegenbarth, Gur Kimchi, John Charles Curlander
  • Patent number: 10708505
    Abstract: An image processing apparatus according to an embodiment of the present invention specifies a partial area of a three-dimensional shape model that is generated based on a plurality of captured images obtained by a plurality of cameras. The image processing apparatus includes: a display control unit configured to display a display image based on a captured image of at least one camera of the plurality of cameras on a display unit; a designation unit configured to designate an area on the display image displayed by the display control unit; and a specification unit configured to specify an area on a three-dimensional shape model, which corresponds to an area designated by the designation unit on the display image, based on captured images of two or more cameras of the plurality of cameras.
    Type: Grant
    Filed: March 23, 2018
    Date of Patent: July 7, 2020
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Kaori Taya
  • Patent number: 10706890
    Abstract: A mechanism is described for facilitating cinematic space-time view synthesis in computing environments according to one embodiment. A method of embodiments, as described herein, includes capturing, by one or more cameras, multiple images at multiple positions or multiple points in times, where the multiple images represent multiple views of an object or a scene, where the one or more cameras are coupled to one or more processors of a computing device. The method further includes synthesizing, by a neural network, the multiple images into a single image including a middle image of the multiple images and representing an intermediary view of the multiple views.
    Type: Grant
    Filed: August 24, 2017
    Date of Patent: July 7, 2020
    Assignee: Intel Corporation
    Inventors: Gowri Somanath, Oscar Nestares
  • Patent number: 10708548
    Abstract: Systems, methods and computer-readable media for creating and using video analysis rules that are based on map data are disclosed. A sensor(s), such as a video camera, can track and monitor a geographic location, such as a road, pipeline, or other location or installation. A video analytics engine can receive video streams from the sensor, and identify a location of the imaged view in a geo-registered map space, such as a latitude-longitude defined map space. A user can operate a graphical user interface to draw, enter, select, and/or otherwise input on a map a set of rules for detection of events in the monitored scene, such as tripwires and areas of interest. When tripwires, areas of interest, and/or other features are approached or crossed, the engine can perform responsive actions, such as generating an alert and sending it to a user.
    Type: Grant
    Filed: September 24, 2018
    Date of Patent: July 7, 2020
    Assignee: AVIGILON FORTRESS CORPORATION
    Inventors: Zeeshan Rasheed, Dana Eubanks, Weihong Yin, Zhong Zhang, Kyle Glowacki, Allison Beach
  • Patent number: 10706624
    Abstract: Systems and methods related to augmented reality guidance for an image capture process using panorama paths may include presenting various text, cues, and indications to guide the image capture process. A user device including an imaging sensor and position and orientation sensors may present, via a display, the various text, cues, and indications during portions of the image capture process, including a plurality of image capture locations, imaging sensor sweep guides, textual instructions, arrows, and position guides.
    Type: Grant
    Filed: March 11, 2019
    Date of Patent: July 7, 2020
    Assignee: Amazon Technologies, Inc.
    Inventors: Joonhao Chuah, Dillon Baker, Kristian Kane, Hai Quang Kim, Brian Mount, Michael Thomas
  • Patent number: 10708471
    Abstract: The alignment of a camera system is less expensive when using a holder with a plurality of connecting pieces, each implemented for connecting, fitting or clamping with a counterpart of a camera housing or an objective, a holder that is implemented such that the connecting pieces or holder modules of the holder, where the connecting pieces are held rigidly or merely at rotation axes, are held rigidly with respect to one another along at least one common spatial direction.
    Type: Grant
    Filed: October 16, 2015
    Date of Patent: July 7, 2020
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Christian Weissig, Arne Finn
  • Patent number: 10708506
    Abstract: An image processing device may include a control unit. The control unit may be operable, in a first mode, to control display on a display screen of a representative image of a group of images and, in a second mode, to control display on the display screen of an image of the group of images corresponding to a posture of the device. In addition, the control unit may be operable to switch between operation in the first mode and the second mode.
    Type: Grant
    Filed: February 11, 2019
    Date of Patent: July 7, 2020
    Assignee: Sony Corporation
    Inventor: Kimu Higashimoto
  • Patent number: 10701321
    Abstract: A system and method for distributed analysis of image data in a video surveillance system can be deployed in households, businesses, and within corporate entities, in examples. The image data are processed on local video analytics systems located within the networks of the businesses or on remote video analytics systems hosted by a cloud service. To limit the data traffic imposed by the image data on the network, the system divides the image data processing into separate object detection and analysis functions. The system can also integrate the object detection function within the surveillance cameras or on a local gateway. This can significantly reduce the data traffic sent over networks as compared to current video surveillance systems and methods since only image data containing object of interest needs to be sent.
    Type: Grant
    Filed: February 27, 2015
    Date of Patent: June 30, 2020
    Assignee: Sensormatic Electronics, LLC
    Inventors: Ian Christopher Westmacott, Steve Carney