With Observer Selected Field Of View Patents (Class 348/39)
  • Patent number: 10222619
    Abstract: A head-worn image display apparatus that comprises a non-immersive image display assembly that receives images from a stereoscopic video camera module. The image display assembly comprises a miniature display component for generating the images for display. The image display assembly may work by an optical relay system. The head-worn image display apparatus could be used in a variety of different settings. One particular application is for performing medical procedures such as microsurgery. The stereoscopic video camera module may have optical magnification capability (e.g. such as in a surgical microscope) to provide a magnified view of the surgical field.
    Type: Grant
    Filed: July 12, 2016
    Date of Patent: March 5, 2019
    Inventor: Steven Sounyoung Yu
  • Patent number: 10205881
    Abstract: A mobile terminal including a main body; an image sensor provided in the main body; a driving unit coupled to the image sensor and configured to change the posture of the image sensor in at least one of roll, pitch, and yaw directions; a sensing unit configured to sense movement information of a subject as an imaging target in an image input through the image sensor; a touch screen; and a controller configured to change the posture of the image sensor using the driving unit such that the image sensor tracks a movement of the subject based on the sensed movement information, and display guide information on the touch screen related to the movement information of the subject to guide a movement of the main body of the mobile terminal.
    Type: Grant
    Filed: May 1, 2017
    Date of Patent: February 12, 2019
    Assignee: LG ELECTRONICS INC.
    Inventors: Byungwook Jung, Jeeho Hyun, Kyunghee Kang, Sungbum Joo
  • Patent number: 10158845
    Abstract: A depth camera assembly (DCA) includes a projector, a detector and a controller. The projector emits a tiled structured light (SL) pattern onto a local area. Each illumination source of the projector includes one or more light emitters and an augmented diffractive optical element (ADOE) designed with a pattern mask. The ADOE diffracts at least a portion of light beams emitted from the light emitters to form a first SL pattern projection having a field-of-view corresponding to a first tileable boundary. The pattern mask prevents projection of light that would otherwise be diffracted outside the first tileable boundary. The first SL pattern projection is combined with at least a second SL pattern projection into the tiled SL pattern illuminating objects in the local area. The detector captures images of the objects illuminated by the SL pattern. The controller determines depth information for the objects using the captured images.
    Type: Grant
    Filed: January 18, 2017
    Date of Patent: December 18, 2018
    Assignee: Facebook Technologies, LLC
    Inventors: Zhaoming Zhu, Nicholas Daniel Trail, Renzo De Nardi, Richard Andrew Newcombe
  • Patent number: 10154228
    Abstract: Devices, systems and methods are disclosed for smoothing rendering data (e.g., panning data and/or magnification data) prior to rendering a video clip. The rendering data may be recorded using a first sampling rate and the system may determine Bézier points using a second sampling rate. The Bézier points may be aligned with the rendering data and may be used to generate smoothed rendering data. The smoothed rendering data may be used to render a video clip that may be displayed to a user. If the user inputs additional rendering data during playback of the video clip, the system may generate second smoothed rendering data. For example, the system may record additional rendering data for a second half of the video clip and generate second smoothed rendering data, including a first half of the first smoothed rendering data, based on the additional rendering data.
    Type: Grant
    Filed: December 23, 2015
    Date of Patent: December 11, 2018
    Assignee: Amazon Technologies, Inc.
    Inventors: Peter Van Tuyl Bentley, Mark Eugene Pearson, Robert James Hanson
  • Patent number: 10148916
    Abstract: In one aspect, the invention provides an imaging system adapted to simultaneously receive light from wide and narrow fields of view, with the wide filed image data collected by an array of fixed position cameras, and the narrow field data collected by a panable, tiltable room camera at higher resolution than the fixed array in a selected orientation, and a compound viewing cover that includes two separated pieces interlocked with one another.
    Type: Grant
    Filed: October 31, 2016
    Date of Patent: December 4, 2018
    Assignee: Epilog Imaging Systems
    Inventor: Michael Mojaver
  • Patent number: 10136058
    Abstract: An example virtual presence system includes at least a first and second mobile device in electronic communication with one another, a panoramic camera coupled to the second mobile device. A user of the first mobile device can specify a position (e.g., location or orientation), such as via a joystick or head-mounted display. The specified position is transmitted to the second mobile device, which selectively obtains image data from the panoramic camera corresponding to the specified position. The selected image data is transmitted as a video stream or other format to the first mobile device, thereby allowing the user of the first mobile device to view surrounding environment available at the second mobile device.
    Type: Grant
    Filed: July 27, 2017
    Date of Patent: November 20, 2018
    Inventor: Shakil Hussain
  • Patent number: 10126813
    Abstract: A 360-degree camera captures images from every direction. The user specifies the region of interest for the camera with a gesture, for example by pointing with one end of the device to a specific direction. The region of interest is saved as metadata with the image or video recording. The device may assign the user among multiple persons near the device by detecting from the omnidirectional view who has been the last person in physical contact with the device. The region of interest may be assigned with voice commands.
    Type: Grant
    Filed: September 21, 2015
    Date of Patent: November 13, 2018
    Assignee: Microsoft Technology Licensing, LLC
    Inventor: Roope Rainisto
  • Patent number: 10129516
    Abstract: Systems and methods for marking an event of interest within a spherical video segment are provided. The spherical video segment may define visual content viewable from a point of view. User input designating an event of interest within the visual content may be received. The user input may indicate a point in time in the spherical video segment and a viewing angle of the event of interest. Tag information associated with the event of interest may be generated. The tag information may identify the point in time and the viewing angle such that notification of alert information is effectuated based on a determination that the viewing angle, proximate to the point in time during a subsequent presentation of the spherical video segment, is outside a display field of view. The alert information may indicate that the event of interest is located outside the display field of view.
    Type: Grant
    Filed: March 14, 2017
    Date of Patent: November 13, 2018
    Assignee: GoPro, Inc.
    Inventors: Joven Matias, David Newman, Ha Phan, Timothy Bucklin, Daryl Stimm
  • Patent number: 10110787
    Abstract: A wearable video device is provided. The video device wearable includes a first hanger and a second hanger by which the wearable video device is connected to a user, a first camera module that is installed in the first hanger, the first camera module having a first optical axis that is rotated outward at a predetermined first angle from a central axis of the wearable video device, and the first camera module being configured to generate a first image, a second camera module that is installed in the second hanger, the second camera module having a second optical axis that is rotated outward at a predetermined second angle from the central axis of the wearable video device, and the second camera module being configured to generate a second image, and a main circuit that controls the first camera module and the second camera module, and that processes at least a portion of the first and second images, wherein a first view of the first camera module and a second view of the second camera module partially overlap.
    Type: Grant
    Filed: December 27, 2013
    Date of Patent: October 23, 2018
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Yong-jin Choi, Sun Min Park, Hee-Seok Jeong
  • Patent number: 10091269
    Abstract: A buffer model in an HTTP streaming client may include receiving a first content fragment of a first content stream in response to a first HTTP request. It may also include receiving a second content fragment of a second content stream in response to a second HTTP request. The buffer model may further include storing the first and second content fragments in first and second buffers of a plurality of configurable buffers. The first and second content fragments may be multiplexed into a third buffer of the plurality of buffers. The multiplexed first and second content fragments may be stored in a fourth buffer of the plurality of buffers for playback. The buffer model may be implemented by an application. The buffers may be designed based on one or more constraints.
    Type: Grant
    Filed: June 16, 2015
    Date of Patent: October 2, 2018
    Assignee: Adobe Systems Incorporated
    Inventors: Viswanathan Swaminathan, Saayan Mitra
  • Patent number: 10063792
    Abstract: Various examples are directed to systems and methods for formatting stitched panoramic frames for transmission to a remote image processing system, the method comprising. A control circuit of a panoramic camera may receive first and second frames captured by first and second image sensors having partially overlapping fields-of-view. The control circuit may identify a first overlap region of the first frame and a second overlap region of the second frame. The first and second overlap region may comprise pixel values from portions of the fields-of-view of the image sensors that overlap. The control circuit may generate a panoramic frame from based at least in part on the first and second frames. The control circuit may generate a transmission frame comprising the panoramic frame, the first overlap region and the second overlap region.
    Type: Grant
    Filed: September 30, 2015
    Date of Patent: August 28, 2018
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventors: Ilya Vladimirovich Brailovskiy, Ilia Vitsnudel, Philip James Taylor, Nathaniel Bubis, Matthew Alan Townsend, Dmitry Svetlov, Noam Sorek, Benjamin Robert Hirsch, Paul Andersen Alioshin
  • Patent number: 10049431
    Abstract: In an embodiment, a user equipment (UE) groups a plurality of images. The UE displays a first image among the plurality of images, determines an object of interest within the first image and a desired level of zoom, and determines to lock onto the object of interest in association with one or more transitions between the plurality of images. The UE determines to transition to a second image among the plurality of images, and detects, based on the lock determination, the object of interest within the second image. The UE displays the second image by zooming-in upon the object of interest at a level of zoom that corresponds to the desired level of zoom.
    Type: Grant
    Filed: January 4, 2017
    Date of Patent: August 14, 2018
    Assignee: QUALCOMM Incorporated
    Inventors: Bing Leng, Suzana Arellano, Daniel Rivas, Bing-Hsun Wu, Virginia Walker Keating
  • Patent number: 10019632
    Abstract: In a surveillance system including a remote sensor apparatus and a portable receiver, a method is provided for collecting and processing data related to a surrounding environment of the remote sensor apparatus including image data for a scene external to the housing of the apparatus. The method includes receiving, at the processing unit, raw image data simultaneously from a plurality of image sensors as the raw image data is being captured by the plurality of image sensors. One or more light sources are placed around a wide-angle lens fitted to each of the image sensor. Infrared or near-infrared light emanating from the plurality of light sources is used in a dark environment. The method also includes processing, at the processing unit, the simultaneously received raw image data to generate pre-processed image data. The method further includes transmitting the pre-processed image data to the portable receiver using the wireless transceiver.
    Type: Grant
    Filed: September 24, 2014
    Date of Patent: July 10, 2018
    Assignee: BOUNCE IMAGING, INC.
    Inventors: Francisco Aguilar, Pablo Alvarado-Moya, Mikhail Fridberg
  • Patent number: 10003740
    Abstract: The present disclosure involves systems, software, and computer implemented methods for increasing spatial resolution of panoramic video captured by a camera array. In one example, a method may include identifying a captured image from each camera in a camera array associated with a capture of a panoramic video. The captured images are stitched together to generate at least one combined image and image mode homographies are calculated between the plurality of cameras in the camera array based on the stitching results. A plurality of captured video frames from each camera in the camera array are identified and video mode homographies of the plurality of cameras are determined based on the calculated image mode homographies. The determined video mode homographies are applied to stitch the plurality of captured video frames.
    Type: Grant
    Filed: July 13, 2015
    Date of Patent: June 19, 2018
    Assignee: Futurewei Technologies, Inc.
    Inventors: Zhenyu Wu, Muhammad Twaha Naqash Ibrahim
  • Patent number: 9877012
    Abstract: An image processing apparatus includes a holding unit configured to hold a positional relationship of a plurality of image capturing units, an acquisition unit configured to detect objects from respective images captured by the plurality of image capturing units and acquire positions of the objects on the captured images and geometric attributes of the objects, an associating unit configured to associate the detected objects, based on the positional relationship, the positions and the geometric attributes, and an estimation unit configured to estimate a three-dimensional position of the objects based on the positional relationship and the positions of the detected objects.
    Type: Grant
    Filed: March 29, 2016
    Date of Patent: January 23, 2018
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Hiroyuki Uchiyama, Muling Guo, Kotaro Yano, Ichiro Umeda
  • Patent number: 9742903
    Abstract: A user device, such as a smart phone, may capture sensor data or interface with a wearable device, such as a smart watch, or another user device to capture sensor data related to the capture of multimedia content. The sensor data may relate to a user, other people, and/or an associated environment. The sensor data may be processed to detect notable events based on a sensor value having a value or being within a range of values associated with the notable event. When a notable event is detected, the multimedia content may be annotated or modified based on the notable event. For example, the multimedia content may be modified to identify the notable event and/or present sensor data captured in connection with the notable event. A user interface may be presented to enable a user to identify instances of notable events and exchange sensor data.
    Type: Grant
    Filed: March 28, 2016
    Date of Patent: August 22, 2017
    Assignee: Verizon Patent and Licensing Inc.
    Inventors: Julian Ferdman, Kuo-Wei Tseng, Shawn Bramson, Margaret Barnes, Jean-Charles Gasche
  • Patent number: 9710924
    Abstract: Field of view overlap among multiple cameras are automatically determined as a function of the temporal overlap of object tracks determined within their fields-of-view. Object tracks with the highest similarity value are assigned into pairs, and portions of the assigned object track pairs having a temporally overlapping period of time are determined. Scene entry points are determined from object locations on the tracks at a beginning of the temporally overlapping period of time, and scene exit points from object locations at an ending of the temporally overlapping period of time. Boundary lines for the overlapping fields-of-view portions within the corresponding camera fields-of-view are defined as a function of the determined entry and exit points in their respective fields-of-view.
    Type: Grant
    Filed: September 14, 2015
    Date of Patent: July 18, 2017
    Assignee: International Business Machines Corporation
    Inventors: Ankur Datta, Rogerio S. Feris, Sharathchandra U. Pankanti, Yun Zhai
  • Patent number: 9661275
    Abstract: An event visualization system. The system uses a digital video capture array. The array is synchronized into a composited video feed file. The composited video feed file has a number of unit perspective video files. Each unit perspective video file has a coordinate location, a unit frame height, and a unit frame width. The unit perspective video files can be played simultaneously for individual display in a digital event player. The digital event player is operated on a client.
    Type: Grant
    Filed: June 15, 2009
    Date of Patent: May 23, 2017
    Inventors: Scott Gordon, Daniel Gordon, Sean Simmons
  • Patent number: 9658744
    Abstract: Aspects of the disclosure relate generally to allowing users to create their own image navigation experiences. As an example, a set of panoramic images may be identified using manual and/or automated methods. One or more suggested potential paths connecting ones of the panoramic images may be determined. This information may be displayed to a user with an interface that allows the user to create and change relationships between the panoramic images. For example, users may activate the suggested paths and create connections between the panoramic images of the set. Users may also draw their own connecting paths between panoramic images. The panoramic images and the connections between them may be used to provide a navigation experience.
    Type: Grant
    Filed: November 25, 2013
    Date of Patent: May 23, 2017
    Assignee: Google Inc.
    Inventors: Aaron Michael Donsbach, John Isidoro, Jeffrey Scott Beis, Evan Rapoport, Ping Hsin Chen
  • Patent number: 9648234
    Abstract: A 360 degree camera system includes a support structure, a plurality of image capture devices, a plurality of lens systems, and an image processing system. The image capture devices are positioned such that their height is greater than their width. The image processing system includes a rotation module for remapping the pixel addresses of the image data to join the captured images along their long edges.
    Type: Grant
    Filed: June 2, 2016
    Date of Patent: May 9, 2017
    Assignee: OmniVision Technologies, Inc.
    Inventors: Jeff Hsieh, Yuguo Ye, Hui Wang, Wei-Feng Huang
  • Patent number: 9648301
    Abstract: The present invention relates to an image processing system for pointing or making an augmented reality image by selectively capturing a left or right image of a stereo image of a 3D display, and detecting a mark from the captured image.
    Type: Grant
    Filed: September 29, 2012
    Date of Patent: May 9, 2017
    Inventor: Moon Key Lee
  • Patent number: 9618621
    Abstract: An optical tracker is provided herein. The tracker may include at least two optical tracker sensors, facing at least partially each other. Each optical tracker sensor may include: a pixel array sensor configured to generate a pixel-by-pixel stream of values representing a scene; at least one visual indicator physically coupled to said pixel array sensor; and an integrated circuit (IC) physically coupled to said at least one pixel array sensor, and configured to: receive said pixel-by-pixel stream of values; and apply a binary large object (BLOB) analysis to said stream, to yield BLOB parameters indicative of the at least one visual indicator present in the scene in a single pass of the pixels representing the scene; and a computer processor configured to receive said BLOB parameters and calculate a relative position and/or orientation, or a partial data thereof, of the at least two optical tracker sensors.
    Type: Grant
    Filed: November 19, 2014
    Date of Patent: April 11, 2017
    Assignee: Elbit Systems Ltd.
    Inventors: Lior Barak, Ron Kornblit, Rani Ben-Yishai
  • Patent number: 9620050
    Abstract: The invention provides a display method and a display device. The display method comprises: generating a primary image based on image information, wherein the primary image is formed of virtual pixels arranged in a matrix, each virtual pixel is formed by multiple virtual sub-pixels of different colors arranged in one row, in the column direction, the size of the virtual pixel and that of the sub-pixel are the same; calculating a comparison component of each sub-pixel by using primary components of comparison virtual sub-pixels of the sub-pixel; acquiring differences between comparison components of each sub-pixel and other sub-pixels adjacent thereto, if each of the differences between comparison components of the sub-pixel and the other sub-pixels exceeds a predetermined threshold value, determining the sub-pixel as a highlighted sub-pixel; calculating a display component of each sub-pixel by using primary components of sampling virtual sub-pixels of the sub-pixel.
    Type: Grant
    Filed: March 20, 2014
    Date of Patent: April 11, 2017
    Assignees: BOE TECHNOLOGY GROUP CO., LTD., BEIJING BOE OPTOELECTRONICS TECHNOLOGY CO., LTD.
    Inventors: Renwei Guo, Xue Dong
  • Patent number: 9621768
    Abstract: Displaying media information includes receiving a first media stream that is encoded based at least in part on a plurality of recordings; displaying the first media stream, including simultaneously displaying a first main view and a first set of auxiliary views, the first main view corresponding to at least one of the plurality of recordings and at least some of the first set of auxiliary views corresponding to at least some of the plurality of recordings; receiving a user selection that corresponds to a selected one of the first set of auxiliary views; in response to the user selection, receiving a second media stream that is encoded based at least in part on at least some of the plurality of recordings; and displaying the second media stream, including simultaneously displaying a second main view and a second set of auxiliary views, the second main view corresponding to the selected one of the first set of auxiliary views and the second set of auxiliary views corresponding to at least some of the plurality
    Type: Grant
    Filed: December 8, 2008
    Date of Patent: April 11, 2017
    Assignee: TATA COMMUNICATIONS (AMERICA) INC.
    Inventors: Barrett Gibson Lyon, Brian Shalar
  • Patent number: 9589317
    Abstract: There is provided an image processing apparatus including a movement amount deciding unit configured to decide a movement amount for moving a target object that is a movement target among objects included in a plurality of captured images imaged by an imaging device including optical units that have imaging ranges overlapping with each other in part on the basis of a distance from the imaging device to the target object and an angle from a reference line at a reference position of the imaging device to the target object in a manner that the plurality of captured images look like images imaged from the reference position, the imaging device using all directions as an imaging range, the plurality of captured images corresponding to the respective optical units.
    Type: Grant
    Filed: January 28, 2015
    Date of Patent: March 7, 2017
    Assignee: SONY CORPORATION
    Inventor: Koji Ozaki
  • Patent number: 9486699
    Abstract: An information processing system includes an information processing unit configured to move a virtual camera in a virtual space within a predetermined movable range in response to a movement and/or a posture of a controller. The information processing unit changes a correspondence relation between the movement and/or the posture of the controller and a capturing direction and/or a viewing point position of the virtual camera after the movement of the virtual camera reaches a limit of the movable range due to the movement of the controller in a predetermined direction.
    Type: Grant
    Filed: September 3, 2014
    Date of Patent: November 8, 2016
    Assignee: NINTENDO CO., LTD.
    Inventors: Ichiro Suzuki, Tsubasa Sakaguchi
  • Patent number: 9420176
    Abstract: A 360 degree camera system includes a support structure, a plurality of image capture devices, a plurality of lens systems, and an image processing system. The image capture devices are positioned such that their height is greater than their width. The image processing system includes a rotation module for remapping the pixel addresses of the image data to join the captured images along their long edges.
    Type: Grant
    Filed: June 19, 2014
    Date of Patent: August 16, 2016
    Assignee: OmniVision Technologies, Inc.
    Inventors: Jeff Hsieh, Yuguo Ye, Hui Wang, Wei-Feng Huang
  • Patent number: 9392167
    Abstract: An image-processing system includes a receiver which receives an input value defining an output range, a generator which generates a three-dimensional model having a target image attached to a three-dimensional conformation, a decision part which decides a position of a viewing point and a viewing angle in accordance with the input value, and a projector which projects the three-dimensional model from the viewing point, wherein the decision part changes a range of a target image inside a viewing field by changing the viewing angle preferentially when the input value is in a first range, and changes the range of the target image inside the viewing field by changing the viewing point preferentially when the input value is in a second range which is a wider-angle side than that of the first range.
    Type: Grant
    Filed: December 12, 2013
    Date of Patent: July 12, 2016
    Assignee: RICOH COMPANY, LTD.
    Inventors: Makoto Shohara, Nozomi Imae, Toru Harada, Hideaki Yamamoto, Yasuo Ueda, Yoichi Ito, Satoshi Sawaguchi, Hirokazu Takenaka, Kensuke Masuda, Hiroyuki Satoh
  • Patent number: 9357198
    Abstract: A digital broadcast receiving apparatus for providing an integrated service of a 2D image and a 3D image. The apparatus comprising a demultiplexing unit configured to demultiplex a received digital broadcast signal; a PSIP or PSI/SI processor configured to extract at least any one of 3D service information related to a 2D image channel or service and 2D service information related to a 3D image channel or service from the demultiplexed digital broadcast signal; a decoder configured to decode an extension view video stream and a base view video stream from the demultiplexed digital broadcast signal; and an output formatting unit configured to format the extension view video stream and the base view video stream based on at least any one of the 3D service information and the 2D service information.
    Type: Grant
    Filed: July 26, 2013
    Date of Patent: May 31, 2016
    Assignee: LG ELECTRONICS INC.
    Inventors: Jong Yeul Suh, Jinpil Kim, Jae-Hyung Song, Hotaek Hong, Joonhui Lee
  • Patent number: 9336596
    Abstract: Embodiments of the invention include a system and methods for measuring disparity and mismatch of stereoscopic images of three-dimensional video, which may indicate a level of discomfort on the part of the viewer. Measuring these parameters may also be used to give an indication that certain processes have or have not adversely effected perceived depth (i.e. through conversion from disparity to depth given a display size and viewing distance), verify camera setup or 2-dimension to 3-dimension synthesizing processes. Generating the indications and other data about the stereoscopic images uses techniques that allow processing with much less computing resources than was possible in previous systems.
    Type: Grant
    Filed: January 11, 2011
    Date of Patent: May 10, 2016
    Assignee: TEKTRONIX, INC.
    Inventor: Kevin M. Ferguson
  • Patent number: 9325934
    Abstract: An image processing system comprises a first video camera arranged to have a first width of field of view, and operable to capture a first image, a second video camera arranged to have a second width of field of view narrower than that of the first video camera, and operable to capture a second image substantially at the same time that the first camera captures the first image, and an image processing unit operable to access scene geometry for a known scene, with the first video camera and the second video camera being arranged in a pre-set positional relation to each other; the image processing unit is arranged in operation to map scene geometry onto the first image captured by the first video camera, and the image processing unit is arranged in operation to map onto the second image captured by the second video camera at least part of the scene geometry mapped onto the first image, in dependence upon the pre-set positional relation of the first and second video cameras and their respective widths of field o
    Type: Grant
    Filed: November 23, 2012
    Date of Patent: April 26, 2016
    Assignee: Sony Corporation
    Inventor: Michael John Williams
  • Patent number: 9294674
    Abstract: Signal processing techniques are applied to digital image data to remove the distortion caused by motion of the camera, or the movement of the subject being photographed, or defective optics, or optical distortion from other sources. When the image is captured, the effect of relative motion between the camera and the subject is that it transforms the true image into a blurred image according to a 2-dimensional transfer function. The 2-dimensional transfer function representing the motion is derived using blind estimation techniques or by using information from sensors that detect the motion. The transfer function is inverted and used to define a corrective filter. The filter is applied to the image and the blur due to the motion is removed, restoring the correct image. Another embodiment uses the transfer function to avoid blur by combining multiple consecutive images taken at a fast shutter speed.
    Type: Grant
    Filed: November 19, 2008
    Date of Patent: March 22, 2016
    Inventor: Fatih M. Ozluturk
  • Patent number: 9275460
    Abstract: Aspects of the present disclosure relates generally to deciding which part of a panoramic image is most important and using that as a reference point for displaying the panoramic image to user. For example, a 360 degree panoramic image associated with orientation and location information may be identified. Related images, for example, in content and location may also be identified. The related images may be projected as points on a unit circle representing the orientations of the panoramic image. The point farthest from an average location of the points may be removed until the average location of the points is at least a minimum distance from the center of the circle. When this occurs, an angular location of the average location relative to the circle may be identified as a reference orientation. The reference orientation may be associated with the panoramic image, and the association may be stored in memory.
    Type: Grant
    Filed: October 17, 2012
    Date of Patent: March 1, 2016
    Assignee: Google Inc.
    Inventor: Jeremy Bryant Pack
  • Patent number: 9185284
    Abstract: Certain embodiments relate to systems and methods for generating a single group image from multiple captured images. A first image and a second image may be captured, the first image including a first part of a group and the second image including a second part of the group. A user interface may be provided, in some embodiments, for capture of the second image that enables a photographer to provide input regarding the relative positioning of the first and second image as well as providing input on the relative positioning of the first and second parts of the group and the image scene background. In some embodiments, a lowest energy seam line may be determined for an overlapping portion of the first and second images, and the lowest energy seam line may be used for generating a final stitched image including both the first and second parts of the group.
    Type: Grant
    Filed: November 14, 2013
    Date of Patent: November 10, 2015
    Assignee: QUALCOMM Incorporated
    Inventor: Hui Chao
  • Patent number: 9094615
    Abstract: An automatics system 100 that uses one to three grids 20cm of overhead cameras 20c to first video an event area 2. Overall bandwidth is greatly reduced by intelligent hubs 26 that extract foreground blocks 10m based upon initial and continuously updated background images 2r. The hubs also analyze current images 10c to constantly locate, classify and track in 3D the limited number of expected foreground objects 10. As objects 10 of interest are tracked, the system automatically directs ptz perspective view cameras 40c to follow the activities. These asynchronous cameras 40c limit their images to defined repeatable pt angles and zoom depths. Pre-captured venue backgrounds 2r at each repeatable ptz setting facilitate perspective foreground extraction. The moving background, such as spectators 13, is removed with various techniques including stereoscopic side cameras 40c-b and 40c-c flanking each perspective camera 40c.
    Type: Grant
    Filed: April 18, 2005
    Date of Patent: July 28, 2015
    Assignee: INTHEPLAY, INC.
    Inventors: James A. Aman, Paul Michael Bennett
  • Patent number: 9041769
    Abstract: A method of controlling media projectors includes providing at least one electromagnetic detector having a field of view directed toward a three dimensional space, and photogrammetrically characterizing at least a portion of the field of view. There is provided at least one media projector that projects at least an electromagnetic signal and a projection controller that moves one or more media projectors in at least two dimensions. At least three measurement locations are obtained within the at least a portion of the field of view by moving the media projector in at least two dimensions. The at least one electromagnetic detector is used to detect the measurement locations within the three dimensional space using the electromagnetic detector to obtain photogrammetric data. The projection controller is calibrated based on the photogrammetric data.
    Type: Grant
    Filed: October 18, 2011
    Date of Patent: May 26, 2015
    Inventor: Will Bauer
  • Publication number: 20150124049
    Abstract: There is provided an image processing apparatus including an association section configured to, in a case where panorama image data generated by using a plurality of frame image data obtained by an imaging operation while displacing an imaging direction is determined to be a full circumference panorama image, associate the panorama image data with information showing that the panorama image data is the full circumference panorama image.
    Type: Application
    Filed: April 3, 2013
    Publication date: May 7, 2015
    Applicant: Sony Corporation
    Inventor: Atsushi Kimura
  • Publication number: 20150109408
    Abstract: The present disclosure provides a system and method for capturing and rendering a landscape image such that the field of view of the captured image remains consistent across any orientation maintained by the camera device at the time the image is captured. The retained field of view corresponds to the maximum landscape field of view achievable from the aspect ratio of the image when captured by the device, when the device is positioned in portrait orientation. Thus, the field of view of a landscape image captured when the camera device is positioned in landscape orientation is identical to the field of view of a landscape image captured when the device is positioned in portrait orientation. Furthermore, the system and method provide for a consistent field of view at the time of playback regardless of whether the captured image is displayed on a device having a portrait or landscape display orientation.
    Type: Application
    Filed: October 21, 2013
    Publication date: April 23, 2015
    Applicant: STMicroelectronics International N.V.
    Inventors: Amit Sharma, Gaurav Jairath, Paramanand Singh
  • Patent number: 9013542
    Abstract: This invention discloses an image capture device and an image synthesis method thereof. The image capture device comprises an image pickup module and a processing module. The image pickup module scans a plurality of visual angles of a scene in advance to obtain a plurality of temporary images. Each of the temporary images has a scanning focal length value. The processing module analyzes the plurality of temporary image of each of the visual angles to obtain a temporary focal length value. The processing module obtains a weighting focal length value by each temporary focal length value by using a function to control the image pickup module in order to perform a panorama image capturing process according to the weighting focal length value.
    Type: Grant
    Filed: May 17, 2012
    Date of Patent: April 21, 2015
    Assignee: Altek Corporation
    Inventors: Hong-Long Chou, Chia-Chun Tseng, Chia-Yu Wu
  • Publication number: 20150103139
    Abstract: A method for taking a photograph and corresponding device are provided. The method includes: determining a shooting focal distance and a shooting visual angle (101); shooting at least two photographs, comprising all objects required to be shot in an area of the shooting visual angle, according to the shooting focal distance and the shooting visual angle which are determined (102); and processing the at least two photographs to obtain one panoramic photograph (103). Another method for taking a photograph and corresponding device are provided, wherein the method includes: determining a shooting focal distance and an initial position of a lens assembly; determining two shooting positions of two photographs used for obtaining a three dimensions photograph according to the initial position of the lens assembly; shooting one photograph at each of the two shooting positions respectively; and processing two shot photographs to obtain a three dimensions photograph.
    Type: Application
    Filed: July 17, 2012
    Publication date: April 16, 2015
    Applicant: ZTE CORPORATION
    Inventor: Jinqiang Xie
  • Patent number: 9007429
    Abstract: The CPU of a digital camera according to the present invention acquires a plurality of panoramic images, and generates a wide-range image by combining the acquired panoramic images.
    Type: Grant
    Filed: April 2, 2012
    Date of Patent: April 14, 2015
    Assignee: Casio Computer Co., Ltd.
    Inventors: Kosuke Matsumoto, Naotomo Miyamoto, Masaru Onozawa
  • Patent number: 9007432
    Abstract: Security guards at large facilities, such as airports, monitor multiple screens that display images from individual surveillance cameras dispersed throughout the facility. If a guard zooms with a particular camera, he may lose image resolution, along with perspective on the surrounding area. Embodiments of the inventive Imaging System for Immersive Surveillance (ISIS) solve these problems by combining multiple cameras in one device. When properly mounted, example ISIS systems offer up to 360-degree, 240-megapixel views on a single screen. (Other fields of view and resolutions are also possible.) Image-stitching software merges multiple video feeds into one scene. The system also allows operators to tag and follow targets, and can monitor restricted areas and sound an alert when intruders breach them.
    Type: Grant
    Filed: December 15, 2011
    Date of Patent: April 14, 2015
    Assignee: The Massachusetts Institute of Technology
    Inventors: Daniel B. Chuang, Lawrence M. Candell, William D. Ross, Mark E. Beattie, Cindy Y. Fang, Bobby Ren, Jonathan P. Blanchard, Gary M. Long, Jr., Lauren L. White, Svetlana V. Panasyuk, Mark Bury
  • Publication number: 20150085068
    Abstract: A method interactively displays panoramic images of a scene. The method includes measuring 3D coordinates of the scene with a 3D measuring instrument at a first position and a second position. The 3D coordinates are registering into a common frame of reference. Within the scene, a trajectory includes a plurality of trajectory points. Along the trajectory, 2D images are generated from the commonly registered 3D coordinates. A user interface provides a trajectory display mode that sequentially displays a collection of 2D images at the trajectory points. The user interface also provides a rotational display mode that allows a user to select a desired view direction at a given trajectory point. The user selects the trajectory display mode or the rotational display mode and sees the result shown on the display device.
    Type: Application
    Filed: September 23, 2014
    Publication date: March 26, 2015
    Inventors: Reinhard Becker, Martin Ossig
  • Publication number: 20150062293
    Abstract: The present specification relates to a digital device and a method of controlling therefor, and more particularly, to a method of displaying a sensed image according to a photographing angle of a camera unit and a photographing angular speed of the camera unit.
    Type: Application
    Filed: November 27, 2013
    Publication date: March 5, 2015
    Applicant: LG ELECTRONICS INC.
    Inventors: Eunhyung CHO, Sinae CHUN, Jongho KIM, Jihwan KIM
  • Patent number: 8970666
    Abstract: Systems and methods for low-scale and low-cost production of events. The system having a plurality of video cameras, each of the video cameras capturing a video stream, a video processing server receiving the video streams from the video cameras and generating a panoramic video stream from the video streams and a video production server selecting a region of interest based on a selection received from a user and generating a video broadcast including the region of interest, the region of interest being a portion of the panoramic video stream.
    Type: Grant
    Filed: September 16, 2011
    Date of Patent: March 3, 2015
    Assignee: Disney Enterprises, Inc.
    Inventors: Jay J. DiGiovanni, Smadar Gefen
  • Patent number: 8964036
    Abstract: A system and method for the capture and storage of data relating to the movements of objects, in a specified area and enables this data to be displayed in a graphically meaningful and useful manner. Video data is collected and video metadata is generated relating to objects (persons) appearing in the video data and their movements over time. The movements of the objects are then analyzed to detect the movements within a region of interest. This detection of movement allows a user, such as a manager of a store, to make informed decisions as to the infrastructure and operation of the store. One detection method relates to the number of people that are present in a region of interest for a specified time period. A second detection method relates to the number of people that remain or dwell in a particular area for a particular time period. A third detection method determines the flow of people and the direction they take within a region of interest.
    Type: Grant
    Filed: April 3, 2013
    Date of Patent: February 24, 2015
    Assignee: Verint Americas Inc.
    Inventors: Oren Golan, Boaz Dudovich, Shahar Daliyot, Itzik Horovitz, Shmuel Kiro
  • Patent number: 8941716
    Abstract: A digital camera 100 includes an image capturing unit 16, an angular velocity sensor 22, an image determination unit 53, and an image composition unit 52. The angular velocity sensor 22 acquires a displacement amount in a field of view of image data when the image data is captured at predetermined time intervals. The image determination unit 53 sets a determination criterion for determining whether the image data thus captured is to be combined or not based on the displacement amount in the field of view acquired by the angular velocity sensor 22. Also, the image determination unit 53 determines whether or not the image data thus captured is valid as a composition target based on the determination criterion thus set. The image composition unit 52 combines image data determined by the image determination unit 53 as being valid as a composition target.
    Type: Grant
    Filed: September 22, 2011
    Date of Patent: January 27, 2015
    Assignee: Casio Computer Co., Ltd.
    Inventors: Kosuke Matsumoto, Naotomo Miyamoto
  • Patent number: 8937651
    Abstract: A method and system are presented for monitoring a field of regard. At least a part of a field of regard is imaged by concurrently collecting a plurality of light components propagating from a plurality of zones, respectively, located within the field of regard, a combined collected light beam is produced, and corresponding data is generated being indicative of a combined image of the at least part of the field of regard formed by the collected light components. This image data indicative of the combined image data is processed and analyzed, and if existence of a certain condition or event is identified in the image data, a corresponding control signal is generated.
    Type: Grant
    Filed: April 27, 2008
    Date of Patent: January 20, 2015
    Assignee: DVP Technologies Ltd.
    Inventors: Rami Guissin, Eitan Lavi
  • Patent number: 8928731
    Abstract: A panorama photography method and apparatus is provided to inform a use of an optimum photographing position for the next photograph when capturing in succession several adjacent photographs to obtain a combined panorama photograph. In the method, after a first image is captured, a guide image is generated from a predefined section of the first image, and a first edge is detected in the guide image. A preview image is acquired for a second image to be captured, and a second edge is detected in the preview image. The second edge is obtained from a predefined part of the preview image that coincides with the guide image. Based on comparison between the first and second edges, notification data are generated and outputted together with a synthetic image of the guide image and the preview image.
    Type: Grant
    Filed: July 16, 2007
    Date of Patent: January 6, 2015
    Assignee: Samsung Electronics Co., Ltd
    Inventor: Gun Chul Song
  • Patent number: 8922619
    Abstract: Disclosed are an unmanned monitoring system and a monitoring method for performing 360° unmanned monitoring work in equipment having a low storage capacity, such as a robot, by using one omni-directional camera. When an image is input through the omni-directional camera, a movement of an object is detected from the image. Then, the movement region is sampled by tracing the object and the image for the movement region is rotated into a frontal image while compensating for inclination of the image in order to allow a user to easily view the image. Thus, the frontal image is transmitted to a mobile communication terminal of a user, such as a mobile phone or a PDA.
    Type: Grant
    Filed: July 19, 2006
    Date of Patent: December 30, 2014
    Assignee: Samsung Electronics Co., Ltd
    Inventors: Byoung-Chul Ko, Kwang-Choon Kim