Object Tracking Patents (Class 348/169)
  • Patent number: 9842392
    Abstract: An input unit (20) obtains a sequence of image frames over time. A segmentation unit (22) segments image frames of the sequence of image frames. A tracking unit (24) tracks segments of the segmented image frame over time in the sequence of image frames. A clustering unit (26) clusters the tracked segments to obtain clusters representing skin of a subject by use of one or more image features of the tracked segments.
    Type: Grant
    Filed: December 2, 2015
    Date of Patent: December 12, 2017
    Assignee: KONINKLIJKE PHILIPS N.V.
    Inventor: Gerard De Haan
  • Patent number: 9842276
    Abstract: A system and method for analyzing a personalized characteristic are provided. The system includes an analysis range calculator configured to calculate a plurality of analysis ranges having different analysis times from positioning data according to a lapse of time of an analysis target; an image analyzer configured to identify one or more objects from the image data corresponding to each of the analysis ranges, and analyze one or more visual characteristics from each of the identified objects; and a characteristic analyzer configured to generate personalized characteristic information of the analysis target using a characteristic analysis result of each of the analysis ranges.
    Type: Grant
    Filed: December 28, 2015
    Date of Patent: December 12, 2017
    Assignee: SAMSUNG SDS CO., LTD.
    Inventors: Min-Woo Jung, Hyun-Jung Soh, Hye-Ran Lee, Tae-Hwan Jeong, Hyun-Chul Kim
  • Patent number: 9838604
    Abstract: A method, system, and computer program product for stabilizing frames, the method comprising: receiving a frame sequence comprising three or more frames, including a current frame; determining salient feature points within the frames; matching the salient feature points between the frames; dropping salient feature points associated with advancing objects; dropping salient feature points associated with objects moving in shaking movements; computing a transformation between pairs of consecutive frames from amongst the at least three frames, based upon non-dropped salient feature points, thereby obtaining a multiplicity of transformations; determining a center position for the frames based upon the multiplicity of transformations; determining a stabilizing transformation from a current frame to the center position; and applying the stabilizing transformation to the current frame to obtain a stabilized frame.
    Type: Grant
    Filed: October 15, 2015
    Date of Patent: December 5, 2017
    Assignee: AG INTERNATIONAL GMBH
    Inventors: Markus Schlattmann, Rohit Mande
  • Patent number: 9836846
    Abstract: The present invention relates to image analysis. In particular, but not limited to, the invention relates to estimating 3D facial geometry. First, images are acquired 205 of an object, typically a face. Then a first three-dimensional (3D) geometry of the object is estimated 215 based upon at least the first image. A calibration image of the object and a calibration rig 120 is acquired 405. A scaling factor is determined 420 of the first 3D geometry based upon the calibration image, a known size of the calibration rig 120 and a predetermined spatial configuration. Finally, scaling the first 3D geometry using the scaling factor. The invention also concerns a system and software.
    Type: Grant
    Filed: June 19, 2014
    Date of Patent: December 5, 2017
    Assignee: COMMONWEALTH SCIENTIFIC AND INDUSTRIAL RESEARCH ORGANISATION
    Inventor: Simon Lucey
  • Patent number: 9836852
    Abstract: A method includes receiving first data defining a first bounding box for a first image of a sequence of images. The first bounding box corresponds to a region of interest including a tracked object. The method also includes receiving object tracking data for a second image of the sequence of images, the object tracking data defining a second bounding box. The second bounding box corresponds to the region of interest including the tracked object in the second image. The method further includes determining a similarity metric for first pixels within the first bounding box and search pixels within each of multiple search bounding boxes. Search coordinates of each of the search bounding boxes correspond to second coordinates of the second bounding box shifted in one or more directions. The method also includes determining a modified second bounding box based on the similarity metric.
    Type: Grant
    Filed: December 11, 2014
    Date of Patent: December 5, 2017
    Assignee: QUALCOMM Incorporated
    Inventors: Christopher Li, Xin Zhong, Dashan Gao, Yingyong Qi, Kai Guo
  • Patent number: 9830395
    Abstract: A system and method for spatial data processing are described. Path bundle data packages from a viewing device are accessed and processed. The path bundle data packages identify a user interaction of the viewing device with an augmented reality content relative to and based on a physical object captured by the viewing device. The path bundle data packages are generated based on the sensor data using a data model comprising a data header and a data payload. The data header comprises a contextual header having data identifying the viewing device and a user of the viewing device. A path header having data identifies the path of the interaction with the augmented reality content. A sensor header having data identifies the plurality of sensors. The data payload comprises dynamically sized sampling data from the sensor data. The path bundle data packages are normalized and aggregated. Analytics computation is performed on the normalized and aggregated path bundle data packages.
    Type: Grant
    Filed: August 15, 2014
    Date of Patent: November 28, 2017
    Assignee: DAQRI, LLC
    Inventors: Brian Mullins, Matthew Kammerait, Frank Chester Irving, Jr.
  • Patent number: 9826202
    Abstract: The apparatus comprises a camera (10) with a digital sensor read by a mechanism of the rolling shutter type delivering video data (Scam) line by line. An exposure control circuit (22) adjusts dynamically the exposure time (texp) as a function of the level of illumination of the scene that is captured. A gyrometer unit (12) delivers a gyrometer signal (Sgyro) representative of the instantaneous variations of attitude (?, ?, ?) of the camera, and a processing circuit (18) that receives the video data (Scam) and the gyrometer signal (Sgyro) delivers as an output video data processed and corrected for artefacts introduced by vibrations specific to the apparatus. An anti-wobble filter (24) dynamically modifies the gain of the gyrometer signal as a function of the exposure time (texp), so as to reduce the gain of the filter when the exposure time increases, and vice versa.
    Type: Grant
    Filed: September 15, 2015
    Date of Patent: November 21, 2017
    Assignee: Parrot Drones
    Inventors: Pierre Eline, Eng Hong Sron
  • Patent number: 9818023
    Abstract: A method for face detection includes capturing a depth map and an image of a scene and selecting one or more locations in the image to test for presence of human faces. At each selected location, a respective face detection window is defined, having a size that is scaled according to a depth coordinate of the location that is indicated by the depth map. Apart of the image that is contained within each face detection window is processed to determine whether the face detection window contains a human face. Similar methods may also be applied in identifying other object types.
    Type: Grant
    Filed: January 26, 2017
    Date of Patent: November 14, 2017
    Assignee: APPLE INC.
    Inventors: Yael Shor, Tomer Yanir, Yaniv Shaked
  • Patent number: 9813693
    Abstract: Images captured at short distances, such as “selfies,” can be improved by addressing magnification and perspective effects present in the images. Distance information, such as a three-dimensional depth map, can be determined for an object using stereoscopic imaging or another distance measuring approach. Based on a magnification function determined for a camera lens, magnification levels for different regions of the captured images can be determined. At least some of these regions then can be adjusted or transformed in order to provide for a more consistent magnification levels across those regions, thereby reducing anamorphic effects. Where appropriate, gaps in the image can also be filled to enhance the image. At least some control over the amount of adjustment may be provided to users for aesthetic control.
    Type: Grant
    Filed: June 27, 2014
    Date of Patent: November 7, 2017
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventor: Leo Benedict Baldwin
  • Patent number: 9811736
    Abstract: An information processing method includes: acquiring setting pseudo multipole information on a pseudo multipole (S10), the setting pseudo multipole information being set such that color information on poles p1 and p2 is related to color information on an object 2, the poles corresponding to a plurality of points in an image of a single predetermined frame 20; specifying a position of the pseudo multipole in an initial frame and seeking an image of a single frame in the video for the pseudo multipole (S14), the pseudo multipole having poles whose colors conform to colors in the color information on the poles in the acquired setting pseudo multipole information, a distance between the poles of the pseudo multipole being equal to or less than a predetermined distance; specifying a position of the found pseudo multipole in the image of the single frame of the video (S17); and tracking the object on the basis of the position of the pseudo multipole found from the image of the single frame and the position of the p
    Type: Grant
    Filed: June 28, 2013
    Date of Patent: November 7, 2017
    Assignee: Rakuten, Inc.
    Inventor: Hiromi Hirano
  • Patent number: 9800834
    Abstract: A method is disclosed for detecting interaction between two or more participants in a meeting, which includes capturing at least one three-dimensional stream of data on the two or more participants; extracting a time-series of skeletal data from the at least one three-dimensional stream of data on the two or more participants; classifying the time-series of skeletal data for each of the two or more participants based on a plurality of body position classifiers; and calculating an engagement score for each of the two or more participants. In addition, a method is disclosed for improving a group interaction in a meeting, which includes calculating, for each of the two or more participants, an individual engagement state based on attitudes of the participant, wherein the individual engagement state is an engagement state of the participant to the meeting including an engaged state and a disengaged state.
    Type: Grant
    Filed: October 31, 2016
    Date of Patent: October 24, 2017
    Assignee: KONICA MINOLTA LABORATORY U.S.A., INC.
    Inventors: Maria Frank, Ghassem Tofighi, Nandita Nayak, Haisong Gu
  • Patent number: 9791264
    Abstract: A method to estimate a set of camera locations, in clockwise or counter-clockwise order, according to the videos captured by these cameras is described herein. In some embodiments, the cameras are assumed to be fixed, with no or very mild tilting angles and no rolling angles (the horizon is horizontal in each camera image). The difference of orientation (rolling angle) between each neighboring (closest) camera pair is able to be up to 45 degrees. Each camera is assumed to have overlapped views with at least one other camera. Each camera has one right neighboring camera and one left neighboring camera, except the first and the last cameras which have only one neighboring camera at one side. The locations of the cameras then are able to be expressed as a unique list counter-clockwise. The input videos are assumed to be synchronized in time.
    Type: Grant
    Filed: February 4, 2015
    Date of Patent: October 17, 2017
    Assignee: SONY CORPORATION
    Inventors: Cheng-Yi Liu, Alexander Berestov
  • Patent number: 9789820
    Abstract: An object detection apparatus that detects an object in a vicinity of a vehicle includes: (a) an image processing circuit configured to: (i) derive vectors representing movement of feature points in captured images acquired periodically by a camera that captures images of the vicinity of the vehicle; and (ii) detect the object based on the vectors; and (b) a controller configured to (i) acquire a velocity of the vehicle; and (ii) set a parameter that affects a number of the feature points based on the velocity of the vehicle.
    Type: Grant
    Filed: October 19, 2015
    Date of Patent: October 17, 2017
    Assignee: FUJITSU TEN LIMITED
    Inventor: Tetsuo Yamamoto
  • Patent number: 9785744
    Abstract: The system and method disclosed herein provides an integrated and automated workflow, sensor, and reasoning system that automatically detects breaches in protocols, appropriately alarms and records these breaches, facilitates staff adoption of protocol adherence, and ultimately enables the study of protocols for care comparative effectiveness. The system provides real-time alerts to medical personnel in the actual processes of care, thereby reducing the number of negative patient events and ultimately improving staff behavior with respect to protocol adherence.
    Type: Grant
    Filed: September 13, 2011
    Date of Patent: October 10, 2017
    Assignee: GENERAL ELECTRIC COMPANY
    Inventors: Christopher Donald Johnson, Peter Henry Tu, Piero Patrone Bonissone, John Michael Lizzi, Jr., Kunter Seref Akbay, Ting Yu, Corey Nicholas Bufi, Viswanath Avasarala, Naresh Sundaram Iyer, Yi Yao, Kedar Anil Patwardhan, Dashan Gao
  • Patent number: 9785836
    Abstract: A mobile platform visually detects and/or tracks a target that includes a dynamically changing portion, or otherwise undesirable portion, using a feature dataset for the target that excludes the undesirable portion. The feature dataset is created by providing an image of the target and identifying the undesirable portion of the target. The identification of the undesirable portion may be automatic or by user selection. An image mask is generated for the undesirable portion. The image mask is used to exclude the undesirable portion in the creation of the feature dataset for the target. For example, the image mask may be overlaid on the image and features are extracted only from unmasked areas of the image of the target. Alternatively, features may be extracted from all areas of the image and the image mask used to remove features extracted from the undesirable portion.
    Type: Grant
    Filed: December 11, 2015
    Date of Patent: October 10, 2017
    Assignee: QUALCOMM Incorporated
    Inventors: Daniel Wagner, Zsolt Szabolcs Szalavari
  • Patent number: 9785857
    Abstract: A positioning server is connected to a collection of access points, base stations, NFC stations, and image or video cameras and the collected data is used for positioning objects. A plurality of electronic devices are paired with an object by tracking the position of the object based on imaging and the position of electronic devices based on RF signals in vicinity of the object. Once a device is paired with an object, the propagation channel profile measured through the electronic device is used to develop and tune a database of channel profiles versus location. This database is used based on signature/profile matching and correlation for positioning devices and objects that do not have pairing or have poor image-based positioning accuracy or reliability. When a device is detected that cannot be paired with any object, or a device that is unpaired from a previously associated object, a theft or loss alert is generated.
    Type: Grant
    Filed: August 30, 2016
    Date of Patent: October 10, 2017
    Assignee: GOLBA LLC
    Inventor: Mehran Moshfeghi
  • Patent number: 9783320
    Abstract: A collision avoidance system for an airplane under tow may include a sensing device configured to capture image data of at least a portion of the airplane and an object while the airplane is being towed. The sensing device may be located remotely to both the airplane and the object. Positions of two or more features of the airplane may be determined based on the image data. A bounding box encompassing the airplane may be generated based, at least in part, on the positions of the two or more features. Additionally, based on a comparison of the position of an object relative to the bounding box, it may be determined whether the object is within a predetermined distance from the airplane.
    Type: Grant
    Filed: September 7, 2016
    Date of Patent: October 10, 2017
    Assignee: DM3 AVIATION LLC
    Inventors: Megan D. Barnes, Michael W. Delk, Richard L. Tutwiler, John R. Durkin, David E. Barnes, Jr.
  • Patent number: 9781363
    Abstract: A multifunctional sky camera system and techniques for the use thereof for total sky imaging and spectral irradiance/radiance measurement are provided. In one aspect, a sky camera system is provided. The sky camera system includes an objective lens having a field of view of greater than about 170 degrees; a spatial light modulator at an image plane of the objective lens, wherein the spatial light modulator is configured to attenuate light from objects in images captured by the objective lens; a semiconductor image sensor; and one or more relay lens configured to project the images from the spatial light modulator to the semiconductor image sensor. Techniques for use of the one or more of the sky camera systems for optical flow based cloud tracking and three-dimensional cloud analysis are also provided.
    Type: Grant
    Filed: September 19, 2013
    Date of Patent: October 3, 2017
    Assignee: International Business Machines Corporation
    Inventors: Hendrik F. Hamann, Siyuan Lu
  • Patent number: 9778472
    Abstract: A stereoscopic display device is provided. The stereoscopic display device comprises: a display panel (100), comprising a plurality of first display units (101) and a plurality of second display units (102) which are alternately arranged; and a grating (200) positioned on a light exiting side of the display panel (100) and including a plurality of light-transmitting regions (a) and a plurality of light-shielding regions (b), wherein the stereoscopic display device comprises a lens (300) with a light divergence action at a position corresponding to each of the light-transmitting regions (a) of the grating (200). Therefore, when the stereoscopic display device is viewed at a short distance, a mechanical performance of the stereoscopic display device is improved.
    Type: Grant
    Filed: December 17, 2014
    Date of Patent: October 3, 2017
    Assignee: BOE Technology Group Co., Ltd.
    Inventor: Wei Wei
  • Patent number: 9773317
    Abstract: Provided are a pedestrian tracking and counting method and device for a near-front top-view monitoring video, wherein the method includes that a video image under a current monitoring scene is acquired, the acquired video image is compared with a background image, and when it is determined that the video image is a foreground image, each blob in the foreground image is segmented and combined to acquire a target blob representing an individual pedestrian, and tracking and counting are performed according to the center-of-mass coordinate of each target blob in a detection area to acquire the number of pedestrians under the current monitoring scene. Thus the accuracy of a counting result can be improved.
    Type: Grant
    Filed: September 3, 2013
    Date of Patent: September 26, 2017
    Assignee: XI'AN ZHONGXING NEW SOFTWARE CO. LTD.
    Inventors: Ping Lu, Jian Lu, Gang Zeng
  • Patent number: 9767336
    Abstract: Methods, computer program products and systems for providing video tracking. The method includes receiving a first signal from a radio frequency identification (RFID) tag. A location of the RFID tag is determined in response to the first signal. An image that includes the location of the RFID tag is recorded. The location of the RFID tag is marked on the image, resulting in a marked image.
    Type: Grant
    Filed: October 3, 2016
    Date of Patent: September 19, 2017
    Assignee: AT&T Intellectual Property I, L.P.
    Inventors: Barrett Kreiner, Jonathan L. Reeves
  • Patent number: 9767378
    Abstract: Various aspects of a method and system to track one or more objects in a video stream are disclosed herein. In accordance with an embodiment, the method includes computation of a first confidence score of a first geometrical shape that encompasses at least a portion of an object in a first image frame of the video stream. The first geometrical shape is utilized to track the object in the video stream. The first geometrical shape is split into a plurality of second geometrical shapes. The split of the first geometrical shape is based on a comparison of the computed first confidence score with a pre-defined threshold score.
    Type: Grant
    Filed: August 31, 2015
    Date of Patent: September 19, 2017
    Assignee: SONY CORPORATION
    Inventors: Houman Rastgar, Alexander Berestov
  • Patent number: 9763615
    Abstract: The present invention provides a device and a method for monitoring the bladder volume of a subject. A device for monitoring the bladder volume of a subject comprises a sensor to be attached to a region on the exterior surface of the abdomen of the subject, the region corresponding to the bladder of the subject, the sensor being configured to obtain a sensor signal indicating the bladder volume of the subject; a controlling unit configured to generate a control action signal if it determines, based on the sensor signal, that the change of the bladder volume of the subject exceeds a predetermined amount; an ultrasound probe to be attached to the subject and configured to emit, in response to the control signal, an ultrasonic signal toward the bladder of the subject and receive echo signals from the bladder of the subject; a deriving unit configured to derive the bladder volume of the subject from the received echo signals.
    Type: Grant
    Filed: January 28, 2015
    Date of Patent: September 19, 2017
    Assignee: KONINKLIJKE PHILIPS N.V.
    Inventor: Jingping Xu
  • Patent number: 9762956
    Abstract: In one embodiment, a mobile device analyzes frames before and after a particular frame of a real-time video to identify one or more social network objects, and selects one or more frames before and after the particular frame based on social network information for further storage in the mobile device.
    Type: Grant
    Filed: April 4, 2013
    Date of Patent: September 12, 2017
    Assignee: Facebook, Inc.
    Inventors: Andrew Garrod Bosworth, David Harry Garcia, Oswald Soleio Cuervo
  • Patent number: 9752880
    Abstract: An object linking method including: detecting each first object based on a video image, detecting each second object based on each data measured by each inertial sensor, each first object or each second object having each first state or each second state that is one of states including a moving state and a stopping state, and linking, by a computer, each first object and each second object in one-to-one, based on each first change of each first state and each second change of each second state, wherein when a specified first object of at least one first object is not linked to any of the at least one second object, the specified first object is linked to a virtual second object that is added to the at least one second object.
    Type: Grant
    Filed: January 6, 2016
    Date of Patent: September 5, 2017
    Assignee: FUJITSU LIMITED
    Inventor: Bin Chen
  • Patent number: 9747516
    Abstract: Disclosed embodiments facilitate keypoint selection in part by assigning a similarity score to each candidate keypoint being considered for selection. The similarity score may be based on the maximum measured similarity of an image patch associated with a keypoint in relation to an image patch in a local image section in a region around the image patch. A subset of the candidate keypoints with the lowest similarity scores may be selected and used to detect and/or track objects in subsequent images and/or to determine camera pose.
    Type: Grant
    Filed: September 4, 2015
    Date of Patent: August 29, 2017
    Assignee: QUALCOMM Incorporated
    Inventors: Daniel Wagner, Kiyoung Kim
  • Patent number: 9750103
    Abstract: A method for a light bulb or fixture to emit light and measure ambient light. The method includes driving solid state light sources, such as LEDs, in the bulb with a cyclical signal to repeatedly turn the solid state light sources off and on, where the light sources are turned off and on at a rate sufficient for the bulb to appear on. The method also includes measuring ambient light via a light sensor in or on the bulb during at least some times when the light sources are off, and outputting a signal related to the measured ambient light. The ambient light level signal can be used to control when the light bulb is on and an intensity of light output by the bulb.
    Type: Grant
    Filed: May 1, 2015
    Date of Patent: August 29, 2017
    Assignee: 3M INNOVATIVE PROPERTIES COMPANY
    Inventors: Mark G. Mathews, James F. Poch, Kayla A. McGrath, Jake D. Swensen, Blake R. Shamla, James C. Medek
  • Patent number: 9747697
    Abstract: Systems and methods are provided for generating calibration information for a media projector. The method includes tracking at least position of a tracking apparatus that can be positioned on a surface. The media projector shines a test spot on the surface, and the test spot corresponds to a known pixel coordinate of the media projector. The system includes a computing device in communication with at least two cameras, wherein each of the cameras are able to capture images of one or more light sources attached to an object. The computing device determines the object's position by comparing images of the light sources and generates an output comprising the real-world position of the object. This real-world position is mapped to the known pixel coordinate of the media projector.
    Type: Grant
    Filed: March 16, 2016
    Date of Patent: August 29, 2017
    Assignee: CAST Group of Companies Inc.
    Inventors: Gilray Densham, Justin Eichel
  • Patent number: 9742974
    Abstract: A method and a system for controlling camera orientation in training and exhibition systems. The method and system use a control algorithm to drive the orientation of a camera system at a determined reference velocity in order to place the aim-point of the camera system following a target aim-point in a local coordinate system. In some embodiments, the position and velocity of the target aim-point in the local coordinate system are determined based on dynamically filtered position and motion of a target object, where the position and motion of the target object are measured from a local positioning system.
    Type: Grant
    Filed: February 11, 2014
    Date of Patent: August 22, 2017
    Inventors: Xueming Tang, Hai Yu
  • Patent number: 9740933
    Abstract: An image monitoring system includes a recorder that records an image captured by a camera via a network. The system is controlled to display the present image captured by the camera or a past image recorded on the recorder. A moving object is detected from the image captured by the camera, the detector including a resolution converter for generating an image with a resolution lower than the resolution of the image captured by the camera. A moving object is detected from the image generated by the resolution converter and positional information on the detected moving object is output. The positional information of the detected moving object is merged with the image captured by the camera on the basis of the positional information.
    Type: Grant
    Filed: April 30, 2015
    Date of Patent: August 22, 2017
    Assignee: SONY CORPORATION
    Inventors: Masaki Demizu, Miki Murakami
  • Patent number: 9737757
    Abstract: A golf ball launch monitor is disclosed that may be used with an alignment stick. The monitor has a default alignment and an image sensor adapted to capture an image of the alignment stick and communicate that image to a processor. The processor is configured to perform the following steps: (a) detect a horizontal edge within the image representative of the alignment stick by detecting large contrast changes; (b) convert each edge to a vector that starts at the sensor's focal point and projects into space based on the sensor's calibration; (c) locate the plane formed by the vectors by applying standard outlier removal and best fit analysis (d) determine the intersection of the plane and an earth tangential plane; and (e) calculate an azimuth alignment angle offset based on the line and the monitor's default alignment. The calculated azimuth alignment angle can then be used to adjust ball flight trajectory calculations.
    Type: Grant
    Filed: April 29, 2017
    Date of Patent: August 22, 2017
    Assignee: WAWGD, INC
    Inventor: Chris Kiraly
  • Patent number: 9734395
    Abstract: A non-transitory computer-readable medium storing a program for tracking a feature point in an image that causes a computer to execute a process, the process includes: calculating first values indicating degree of corner for respective pixels in another image, based on change of brightness values in horizontal direction and vertical direction; calculating second values indicating degree of similarity between respective areas in the another image and a reference area around the feature point in the image, based on comparison between the respective areas and the reference area; calculating third values indicating overall degree of corner and similarity, based on the first values and the second values; and tracking the feature point by identifying a point in the another image corresponding to the feature point in the image, based on the third values.
    Type: Grant
    Filed: November 10, 2014
    Date of Patent: August 15, 2017
    Assignee: FUJITSU LIMITED
    Inventor: Osafumi Nakayama
  • Patent number: 9734612
    Abstract: The image processing apparatus includes a region detection unit that detects a face region of the attention person, an attention person movement region of the moving image, the entire region of the attention person, and an attention person transfer region of the moving image, a region image extraction unit that extracts an image of the face region of the attention person, an image of the attention person movement region of the moving image, an image of the entire region of the attention person, and an image of the attention person transfer region of the moving image, which respectively correspond to the face region of the attention person, the attention person movement region of the moving image, the entire region of the attention person, and the attention person transfer region of the moving image, from the still image, and a composite image generation unit that generates a composite image.
    Type: Grant
    Filed: September 8, 2015
    Date of Patent: August 15, 2017
    Assignee: FUJIFILM Corporation
    Inventor: Kei Yamaji
  • Patent number: 9736385
    Abstract: The invention is directed to determining compensation distance for capturing an image in a zoom mode using a camera. An exemplary method comprises determining the camera is in a non-zoom mode; receiving first depth information associated with an object in the image when the camera is in the non-zoom mode; receiving first angle information associated with the object in the image when the camera is in the non-zoom mode; switching from the non-zoom mode to a zoom mode; receiving second angle information associated with the object in the image when the camera is in the zoom mode; determining a compensation distance for capturing the image of the object in the zoom mode based on the first depth information, the first angle information, and the second angle information; and generate an image based on the compensated distance.
    Type: Grant
    Filed: January 8, 2014
    Date of Patent: August 15, 2017
    Assignees: Sony Corporation, Sony Mobile Communications Inc.
    Inventors: Jonas Gustavsson, Daniel Linåker, Johannes Elg, Fredrik Mattisson
  • Patent number: 9723192
    Abstract: The video recording systems disclosed herein comprise recording devices built in a variety of system architectures depending on the type of intended use. The guiding principle of the system architectures is that an optimal recording device will have optics, sensor, control electronics, and communication capability designed for the purpose of use. User controls, as well as power sources may be separated from the optimal recording device. Different applications may demand a variety of accessories including camera mounts, automatic camera orientation capabilities, remote control devices, and remote power sources, all of which may be designed as use-specific devices and optimized for the purpose of use.
    Type: Grant
    Filed: June 12, 2015
    Date of Patent: August 1, 2017
    Assignee: H4 Engineering, Inc.
    Inventors: Alexander G. Sammons, Christopher T. Boyle, Scott K. Taylor, Gordon Jason Glover
  • Patent number: 9720934
    Abstract: An object recognition system can be adapted to recognize subject matter having very few features or limited or no texture. A feature-sparse or texture-limited object can be recognized by complementing local features and/or texture features with color, region-based, shape-based, three-dimensional (3D), global, and/or composite features. Machine learning algorithms can be used to classify such objects, and image matching and verification can be adapted to the classification. Further, multiple modes of input can be integrated at various stages of the object recognition processing pipeline. These multi-modal inputs can include user feedback, additional images representing different perspectives of the object or specific regions of the object including a logo or text corresponding to the object, user behavior data, location, among others.
    Type: Grant
    Filed: March 13, 2014
    Date of Patent: August 1, 2017
    Assignee: A9.COM, INC.
    Inventors: Simant Dube, Edward Hsiao
  • Patent number: 9723209
    Abstract: Provided is an image shake correction device to correct image shake during panning photographing to let the movement of an image pick-up apparatus follow the movement of a main subject which uses a shift lens group. The image shake correction device executes a determination process on a motion vector for calculating an angular velocity of the main object for use in calculation of a drive signal of the shift lens group. The image shake correction device changes the determination process on the motion vector according to a state of the image pick-up apparatus.
    Type: Grant
    Filed: December 1, 2015
    Date of Patent: August 1, 2017
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Wataru Takayanagi
  • Patent number: 9710712
    Abstract: The present disclosure provides for a method, device, and computer-readable storage medium for performing a method for discerning a vehicle at an access control point. The method including obtaining a video sequence of the access control point; detecting an object of interest from the video sequence; tracking the object from the video sequence to obtain tracked-object data; classifying the object to obtain classified-object data; determining that the object is a vehicle based on the classified-object data; and determining that the vehicle is present in a predetermined detection zone based on the tracked-object data.
    Type: Grant
    Filed: June 11, 2015
    Date of Patent: July 18, 2017
    Assignee: AVIGILON FORTRESS CORPORATION
    Inventors: Don Madden, Ethan Shayne
  • Patent number: 9704265
    Abstract: An optical-flow imaging system having an ultrasonic array for generating images that include depth data, and methods for manufacturing and using same. The optical-flow imaging system includes an ultrasonic sensor array positioned on a housing that includes an ultrasonic emitter and a plurality of ultrasonic sensors. The optical-flow imaging system also includes a Red, Green Blue (RGB) camera assembly positioned on the housing in a parallel plane with, and operably connected to, the ultrasonic sensor. Thereby, the optical-flow imaging system advantageously enables improved imaging in a wide variety of lighting conditions compared to conventional systems.
    Type: Grant
    Filed: June 13, 2016
    Date of Patent: July 11, 2017
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: Jiebin Xie, Bo Zang, Wei Ren, Guyue Zhou
  • Patent number: 9705953
    Abstract: Techniques are disclosed for facilitating digital signal processing in a client-server computing environment. In one embodiment, a local computing device is used to playback a digital media asset that is processed by a digital signal processing server. The local computing device can be configured to provide a user interface that receives a user selection of the segment of the media asset that is to be modified, and responsive to such selection, that instructs the digital signal processing server to segment the media asset accordingly. The “segmented mix”, which includes the user-selected portion of the media asset that is to be modified, is provided to the local computing device for local processing according to the user's instructions. The “main mix”, which comprises the other non-selected portions of the media asset, continues to be processed by the digital signal processing server and provided to the local computing device for playback.
    Type: Grant
    Filed: June 17, 2013
    Date of Patent: July 11, 2017
    Assignee: ADOBE SYSTEMS INCORPORATED
    Inventor: James Anderson Moorer
  • Patent number: 9697425
    Abstract: A camera system comprises an image capturing device and an object classification module connected to the image capturing device. The object classification module is operable to determine whether or not an object in an image is a member of an object class. The object classification module includes multiple decision steps configured in a cascade configuration, wherein at least one of the multiple decision steps is operable to (a) accept an object as a member of the object class, (b) reject an object as a member of the object class, and (c) call on a next step to determine whether or not an object is a member of the object class.
    Type: Grant
    Filed: December 5, 2014
    Date of Patent: July 4, 2017
    Assignee: AVIGILON ANALYTICS CORPORATION
    Inventors: Mahesh Saptharishi, Dimitri A. Lisin, Aleksey Lipchin, Igor Reyzin
  • Patent number: 9697420
    Abstract: To provide an information processing system, an information processing method, and a program, whereby it is possible, using a plurality of video camera videos, to desirably carry out person tracking. An information processing system includes: an appearance time score computation unit which computes a time from when a first mobile body exits a frame from a video of a first video camera to when a second mobile body enters a frame of a video of a second video camera; and a person association unit which, on the basis of an attribute of the first mobile body, a degree of similarity between the first mobile body and the second mobile body, and the time, determines whether the first mobile body and the second mobile body are the same mobile body.
    Type: Grant
    Filed: January 22, 2014
    Date of Patent: July 4, 2017
    Assignee: NEC CORPORATION
    Inventor: Yusuke Takahashi
  • Patent number: 9697595
    Abstract: A user identifies an unwanted object in a source image. Related images are identified on the basis of timestamp and/or geolocation metadata. Matching masks are identified in the source image, wherein each of the matching masks is adjacent to the selection mask. Features in the selection and matching masks which also appear in one of the related images are identified. The related image having a maximum of features which are tracked to a source image matching mask, but also a minimum of features which are tracked to the source image selection mask, is identified as a best-match related image. By mapping the source image matching masks onto the best-match related image, a seed region can be located in the best-match related image. This seed region is used for filling in the source image. This allows the unwanted object to be replaced with a visually plausible background having a reasonable appearance.
    Type: Grant
    Filed: November 26, 2014
    Date of Patent: July 4, 2017
    Assignee: ADOBE SYSTEMS INCORPORATED
    Inventors: Ajay Bedi, Sourabh Gupta, Saurabh Gupta
  • Patent number: 9684849
    Abstract: An image processing device includes: an image sequence acquisition section that acquires an image sequence that includes a plurality of constituent images; and a processing section that performs an image summarization process that deletes some of the plurality of constituent images included in the image sequence to generate a summary image sequence, the processing section detecting an observation target area from each of the plurality of constituent images, selecting a reference image and a determination target image from the plurality of constituent images, calculating deformation information about a deformation estimation target area included in the reference image and the deformation estimation target area included in the determination target image, and determining whether or not the determination target image can be deleted based on the observation target area included in the reference image, the observation target area included in the determination target image, and the deformation information.
    Type: Grant
    Filed: March 26, 2015
    Date of Patent: June 20, 2017
    Assignee: OLYMPUS CORPORATION
    Inventor: Yoichi Yaguchi
  • Patent number: 9679200
    Abstract: In queues, persons—or objects (120) in general—move inside an area (110) to a target (112), such as to a counter. The queue has movement characteristics in terms of speed, waiting times and queue form. A computer-implemented approach obtains the characteristics by receiving a sequence (140) of image frames (141, 142, 143, 49) that represent the surveillance area (110); calculating flow vectors that indicate an optical displacement for the sequence (140) of image frames (141/142, 142/143); extending one of the flow vectors as lead vector in extension directions; determining intermediate vectors by using flow vectors along the extension directions; and selecting one the intermediate vectors as the new lead vector. The steps are repeated to concatenate the lead vectors to the movement characteristics (190).
    Type: Grant
    Filed: July 18, 2013
    Date of Patent: June 13, 2017
    Assignee: AGT INTERNATIONAL GMBH
    Inventors: Markus Schlattmann, Henning Hamer, Ulf Blanke
  • Patent number: 9681150
    Abstract: An image processing system includes a processor and optical flow determination logic. The optical flow determination logic is to quantify relative motion of a feature present in a first frame of video and a second frame of video with respect to the two frames of video. The optical flow determination logic configures the processor to convert each of the frames of video into a hierarchical image pyramid. The image pyramid comprises a plurality of image levels. Image resolution is reduced at each higher one of the image levels. For each image level and for each pixel in the first frame, the processor is configured to establish an initial estimate of a location of the pixel in the second frame and to apply a plurality of sequential searches, starting from the initial estimate, that establish refined estimates of the location of the pixel in the second frame.
    Type: Grant
    Filed: June 12, 2015
    Date of Patent: June 13, 2017
    Assignee: TEXAS INSTRUMENTS INCORPORATED
    Inventors: Hrushikesh Tukaram Garud, Soyeb Noormohammed Nagori, Dipan Kumar Mandal
  • Patent number: 9672660
    Abstract: A system and method for offloading augmented reality processing is described. A first sensor of a server generates a first set of sensor data corresponding to a location and an orientation of a display device. The server receives a request from the display device to offload a combination of at least one of a tracking process and a rendering process from the display device. The server generates offloaded processed data based on a combination of at least one of the first set of sensor data and a second set of sensor data. The second set of sensor data is generated by a second sensor at the display device. The server streams the offloaded processed data to the display device.
    Type: Grant
    Filed: February 11, 2016
    Date of Patent: June 6, 2017
    Assignee: DAQRI, LLC
    Inventor: Brian Mullins
  • Patent number: 9659371
    Abstract: A system and method for online projector-camera calibration from one or more images is provided. The system comprises: a projector, a camera, and a calibration device configured to: determine a map between pixels of each of a projector image and a camera image in fewer than one hundred percent of pixels of the projector image using feature extraction; determine an initial estimate of a fundamental matrix from the map; determine an initial guess of intrinsic properties of the projector and camera using one or more closed-form solutions; iteratively determine an error-function based on the map using the fundamental matrix while adding constraints on the intrinsic properties using the one or more closed-form solutions, and the initial estimate and guess as initial input; and, when the error-function reaches an acceptance value, determine intrinsic and extrinsic properties of the projector and the camera from current values of iterative estimates.
    Type: Grant
    Filed: October 8, 2015
    Date of Patent: May 23, 2017
    Assignee: CHRISTIE DIGITAL SYSTEMS USA, INC.
    Inventors: Christian Scharfenberger, Hicham Sekkati, Jason Deglint, Matthew Post
  • Patent number: 9652677
    Abstract: An object detection device detects an object being recognized (such as a pedestrian) in a frame image, and identifies an area where a detected object which is detected in the frame image is present. A frame image is input after the frame image. The object detection device detects the object being recognized in the frame image, and identifies an area where a detected object which is detected in the frame image is present. When a distance from center coordinates of the area to center coordinates of the area is smaller than a reference distance, the object detection device determines that the detected object which is detected in the frame image is identical to the detected object which is detected in the frame image.
    Type: Grant
    Filed: February 20, 2013
    Date of Patent: May 16, 2017
    Assignee: MegaChips Corporation
    Inventors: Taizo Umezaki, Yuki Haraguchi, Hiromu Hasegawa
  • Patent number: 9648229
    Abstract: Provided is an image processing device including a global motion detection unit configured to detect a global motion indicating a motion of an entire image, a local motion detection unit configured to detect a local motion indicating a motion of each of areas of an image, and a main subject determination unit configured to determine a main subject based on the global motion and the local motion.
    Type: Grant
    Filed: March 18, 2013
    Date of Patent: May 9, 2017
    Assignee: SONY CORPORATION
    Inventor: Masaya Kinoshita