Object Tracking Patents (Class 348/169)
  • Patent number: 11113787
    Abstract: By performing a simple operation on an information processing terminal, a direction of a subject desired to be viewed by a user 40 can be smoothly displayed from various directions.
    Type: Grant
    Filed: September 20, 2018
    Date of Patent: September 7, 2021
    Assignee: AMATELUS INC.
    Inventors: Shinya Shimojo, Mitsuhide Matsuda, Izuru Senokuchi
  • Patent number: 11106274
    Abstract: An embodiment of a graphics apparatus may include a facial expression detector to detect a facial expression of a user, and a parameter adjuster communicatively coupled to the facial expression detector to adjust a graphics parameter based on the detected facial expression of the user. The detected facial expression may include one or more of a squinting, blinking, winking, and facial muscle tension of the user. The graphics parameter may include one or more of a frame resolution, a screen contrast, a screen brightness, and a shading rate. Other embodiments are disclosed and claimed.
    Type: Grant
    Filed: April 10, 2017
    Date of Patent: August 31, 2021
    Assignee: Intel Corporation
    Inventors: Travis T. Schluessler, Joydeep Ray, John H. Feit, Nikos Kaburlasos, Jacek Kwiatkowski, Jefferson Amstutz, Carson Brownlee, Vivek Tiwari, Sayan Lahiri, Kai Xiao, Abhishek R. Appu, ElMoustapha Ould-Ahmed-Vall, Deepak S. Vembar, Ankur N. Shah, Balaji Vembu, Josh B. Mastronarde
  • Patent number: 11107237
    Abstract: An image foreground detection apparatus and method and an electronic device. In the apparatus and method, in updating the background model, a pixel value of a sample value of which the pixel value difference is maximum is replaced with a predetermined probability, which may efficiently improve accuracy of the background model, and relatively large number of integral foreground image blocks which are accurate may be quickly obtained.
    Type: Grant
    Filed: June 21, 2019
    Date of Patent: August 31, 2021
    Assignee: FUJITSU LIMITED
    Inventors: Nan Zhang, Qi Wang
  • Patent number: 11108993
    Abstract: A system and methods for controlling video streaming over a shared communications channel from a set of two or more video cameras to a base station, including acquiring video capture rate data values from each video camera; acquiring transmissions rate data values from each video camera indicative of a rate of transmission from each video camera to the base station over the shared communications channel; acquiring channel bandwidth data values from said shared communications channel indicative of a supported rate of transmission by the shared communications channel; predicting, from the acquired video capture, communications rate and channel bandwidth data values, future values of at least one of (1) future captured video rate data; (2) future transmission rate data; or (3) future channel bandwidth; and responsively providing that video rates of transmission from all the cameras are supported by the shared communications channel.
    Type: Grant
    Filed: December 19, 2017
    Date of Patent: August 31, 2021
    Assignee: TELICOMM CITY CONNECT, LTD.
    Inventors: Lior Ophir, Shlomo Arbel
  • Patent number: 11108996
    Abstract: A system comprising a coordinate tracking engine and a video classification engine communicably coupled to a notification engine. The coordinate tracking engine detects that geographical coordinates of a mobile device indicate that an account holder is within a threshold distance of a physical branch of an institution. The notification engine retrieves account information for the account holder. The coordinate tracking engine further detects that the account holder has arrived at the physical branch. The video classification engine captures video frames of an entrance to the physical branch and identifies the account holder. The notification engine further determines an institutional representative associated with the account holder is available at the physical branch, notifies the representative of the arrival of the account holder, and presents account information for the account holder.
    Type: Grant
    Filed: July 28, 2020
    Date of Patent: August 31, 2021
    Assignee: Bank of America Corporation
    Inventors: Kalyan Chakravarthy Pallapolu, Bharathi Tadepalli
  • Patent number: 11107249
    Abstract: A method of mapping 3D point cloud data into 2D surfaces for further efficient temporal coding is described herein. Point cloud global tetris packing utilizes 3D surface patches to represent point clouds and performs temporally consistent global mapping of 3D patch surface data into 2D canvas images. Point cloud global tetris packing includes calculating an accumulated occupancy map and a weight of each patch according to the matched patches.
    Type: Grant
    Filed: October 17, 2019
    Date of Patent: August 31, 2021
    Assignee: Sony Group Corporation
    Inventor: Danillo Graziosi
  • Patent number: 11102411
    Abstract: A gimbal photographing method includes obtaining an external signal, processing the external signal to generate one or more gimbal action control instructions and one or more photographing control instructions, controlling a gimbal to perform a corresponding action according to at least one of the one or more gimbal action control instructions, and controlling a camera device to perform photographing according to at least one of the one or more photographing control instructions. The at least one of the one or more photographing control instructions cause the camera device to photograph along with the action performed by the gimbal during at least part of a whole photographing process.
    Type: Grant
    Filed: October 27, 2020
    Date of Patent: August 24, 2021
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventor: Ye Tao
  • Patent number: 11092827
    Abstract: A booth includes at least one display unit that is transmissive and displays an image. The at least one display unit is disposed in such a manner that the inside of a space which allows a person's entrance is viewed from the outside of the space.
    Type: Grant
    Filed: March 27, 2020
    Date of Patent: August 17, 2021
    Assignee: FUJIFILM Business Innovation Corp.
    Inventors: Kana Miyazaki, Kengo Tokuchi
  • Patent number: 11079202
    Abstract: A digital sight for a weapon includes a sight body, a mount for a peripheral fixed to the sight body, and a controller. The controller is disposed in communication with a non-volatile memory and is responsive to instructions recorded to boresight a peripheral relative to the digital weapon sight. Weapon assemblies and methods of boresighting peripherals to digital weapon sights are also described.
    Type: Grant
    Filed: July 7, 2018
    Date of Patent: August 3, 2021
    Inventors: Samuel Moseman, Mathew Canahuati
  • Patent number: 11080891
    Abstract: A method of detecting a dangerous situation includes obtaining a first image including a first object capable of generating a movement, by using a dynamic vision sensor (DVS); detecting, from the first image, a second image including the first object in a predefined pose; and determining whether a situation of the first object is the dangerous situation by analyzing the second image.
    Type: Grant
    Filed: February 21, 2018
    Date of Patent: August 3, 2021
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Joo-young Kim, Joon-ho Kim, Do-jun Yang, Hyun-woo Lee, Jong-hee Han
  • Patent number: 11080868
    Abstract: The present disclosure relates to a method and system for tracking an object of interest in real-time in a multi-camera environment capable of performing data communication without the occurrence of overlapping, and according to the present invention, an object of interest can be tracked in real-time on the basis of mutually captured image data even though capturing zones of a plurality of cameras capable of performing data communication according to the connection therebetween are not overlapped with each other.
    Type: Grant
    Filed: January 23, 2018
    Date of Patent: August 3, 2021
    Assignee: GIST(Gwangju Institute of Science and Technology)
    Inventors: Moon Gu Jeon, Hyung Uk Choi
  • Patent number: 11080513
    Abstract: A computer alters at least one recognizable metric or text in a digitally encoded photographic image by operating an alteration algorithm in response to user input data while preserving an overall aesthetic quality of the image and obscuring an identity of at least one individual or geographic location appearing in the image. An altered digitally-encoded photographic image prepared by the altering of the at least one recognizable metric or text in the image is stored in a computer memory. User feedback and/or automatic analysis may be performed to define parameter values of the alteration algorithm such that the alteration process achieves preservation of aesthetic qualities while obscuring an identity of interest.
    Type: Grant
    Filed: March 4, 2019
    Date of Patent: August 3, 2021
    Inventor: Gary S. Shuster
  • Patent number: 11080946
    Abstract: A method for collecting activity-data of a user executing a task including at least one activity includes tracking a user-device to determine a location-data of the user-device associated with the user; retrieving, at a server-arrangement from a database-server, a client-data; determining a change in the location-data of the user-device; and generating the activity-data, based on the change in the location-data, by one of correlating the location-data with the client-data by employing machine learning techniques, or processing a prompt-response generated by a manual-input at the user-device, wherein the prompt-response is generated based on a prompt provided by the server-arrangement to the user-device when the machine learning techniques fail to correlate the location data with the client-data.
    Type: Grant
    Filed: June 6, 2018
    Date of Patent: August 3, 2021
    Assignee: XSELIS, Inc.
    Inventors: Tyler Logan Fox, Kevin Tyler Gardenhire
  • Patent number: 11074736
    Abstract: According to one implementation, a system for performing cosmetic transformation through image synthesis includes a computing platform having a hardware processor and a system memory storing an image synthesis software code. The hardware processor executes the image synthesis software code to receive a user image depicting a user of the system, to receive a reference image for transforming to resemble the user image, the reference image projecting an identifiable persona, and to generate a user image metadata describing the user image, based on the user image. The hardware processor further executes the image synthesis software code to identify a reference image metadata describing the reference image, and to transform the reference image to resemble the user image, based on the user image metadata and the reference image metadata, while preserving the identifiable persona projected by the reference image.
    Type: Grant
    Filed: October 22, 2019
    Date of Patent: July 27, 2021
    Assignee: Disney Enterprises, Inc.
    Inventor: Douglas A. Fidaleo
  • Patent number: 11068530
    Abstract: Various aspects of the subject technology relate to systems, methods, and machine-readable media for context-based selection of images for digital media. An image server storing many images provides, in real time as digital media are rendered, images for inclusion in that digital media that will drive client engagement goals for that media. The digital media may include a web page of a business and the engagement goal may be increasing time-on-site for a user of that web page. The digital media may include a customer email and the engagement goal may be a user opening the email or following a link in the email. The image server includes a machine-learning engine to identify recommended images for each instance of the web page, email, or other digital media for a particular user at a particular time.
    Type: Grant
    Filed: November 2, 2018
    Date of Patent: July 20, 2021
    Assignee: Shutterstock, Inc.
    Inventor: Jonathan Oringer
  • Patent number: 11070708
    Abstract: A recording arrangement is provided including an outer enclosure including a plurality of video recording devices and a matching plurality of audio recording devices, at least one extender configured to deploy the plurality of video recording devices to a desired location, extender deployment hardware configured to drive the at least one extender, and electronics configured to drive the at least one extender, the electronics comprising a power supply, a timecode generator, a plurality of recorders, and an internet protocol (IP) assembly configured to facilitate interface with a remote computing device.
    Type: Grant
    Filed: September 27, 2019
    Date of Patent: July 20, 2021
    Assignee: Brainbaby, Inc.
    Inventor: Michael Montgomery
  • Patent number: 11068721
    Abstract: An apparatus is provided for automated object tracking in a video feed. The apparatus receives and sequentially processes a plurality of frames of the video feed to track objects. In particular, a plurality of objects in a frame are detected and assigned to a respective track fragment. A kinematic, visual, temporal or machine learning-based feature of an object is then identified and stored in metadata associated with the track fragment. A track fragment for the object is identified in earlier frames based on a comparison of the feature and a corresponding feature in metadata associated with the earlier frames. The track fragments for the object in the frame and the object in the earlier frames are linked to form a track of the object. The apparatus then outputs the video feed with the track of the object as an overlay thereon.
    Type: Grant
    Filed: March 30, 2017
    Date of Patent: July 20, 2021
    Assignee: THE BOEING COMPANY
    Inventors: Jan Wei Pan, Hieu Tat Nguyen, Zachary Jorgensen, Yuri Levchuk
  • Patent number: 11070719
    Abstract: An image capture assist device includes a moving speed determining unit that determines whether or not a moving speed of a camera is greater than or equal to a threshold, a target outline determining unit that, if the moving speed determining unit has determined that the moving speed of the camera is greater than or equal to the threshold, determines, on a basis of a capture image obtained from the camera, whether a candidate inspection target, being an object that may be a target to be inspected, appears in the capture image, a moving speed instruction unit that, if the target outline determining unit has determined that the candidate inspection target appears in the capture image, outputs an instruction to reduce the moving speed of the camera, a target type determining unit that, if the moving speed determining unit has determined that the moving speed of the camera is less than the threshold, determines a type of a target appearing in the capture image on a basis of the capture image, and a shooting locat
    Type: Grant
    Filed: May 10, 2017
    Date of Patent: July 20, 2021
    Assignee: MITSUBISHI ELECTRIC CORPORATION
    Inventors: Shunya Osawa, Hirohiko Higuchi
  • Patent number: 11062165
    Abstract: The present application provides a method of corner detection and an image processing system for detecting corners in an image. The preferred implementation is in software using enabling and reusable hardware features in the underlying vector processor architecture. The advantage of this combined software and programmable processor datapath hardware is that the same hardware used for the FAST algorithm can also be readily applied to a variety of other computational tasks, not limited to image processing.
    Type: Grant
    Filed: December 8, 2017
    Date of Patent: July 13, 2021
    Assignee: Movidius Limited
    Inventors: Cormac Brick, Brendan Barry, Fergal Connor, David Moloney
  • Patent number: 11054245
    Abstract: An image processing apparatus includes processing circuitry configured to generate a first map formed of pixels that are associated with x coordinate information, distance information, and frequency values; search for a target pixel satisfying a predetermined condition among the pixels in the first map, the searching being performed from the pixels that are near towards the pixels that are far away as indicated by the distance information; and validate pixels surrounding the target pixel in the first map, together with the target pixel.
    Type: Grant
    Filed: September 5, 2018
    Date of Patent: July 6, 2021
    Assignee: RICOH COMPANY, LTD.
    Inventors: Sadao Takahashi, Seiya Amano, Hiroyoshi Sekiguchi, Soichiro Yokota, Yuu Yamada, Shinichi Sumiyoshi
  • Patent number: 11057561
    Abstract: Techniques are described for automated operations involving capturing and analyzing information from an interior of a house, building or other structure, for use in generating and providing a representation of that interior. Such techniques may include using a user's mobile device to capture visual data from multiple viewing locations (e.g., video captured while the mobile device is rotated for some or all of a full 360 degree rotation at each viewing location) within multiple rooms, capturing data linking the multiple viewing locations, analyzing each viewing location's visual data to create a panorama image from that viewing location, analyzing the linking data to determine relative positions/directions between at least some viewing locations, creating inter-panorama links in the panoramas to each of one or more other panoramas based on such determined positions/directions, and providing information to display multiple linked panorama images to represent the interior.
    Type: Grant
    Filed: June 18, 2019
    Date of Patent: July 6, 2021
    Assignee: Zillow, Inc.
    Inventors: Ivaylo Boyadzhiev, Alex Colburn, Li Guan, Qi Shan
  • Patent number: 11048961
    Abstract: A method and system for locating a target object in a target scene. The method may include obtaining a depth image of the target scene. The depth image may include a plurality of pixels. The method may also include, for each of the plurality of pixels of the depth image, determining a first target coordinate under a target coordinate system. The method may further include generating a marking image according to the depth image and the first target coordinates of the plurality of pixels in the depth image. The marking image may represent potential target objects in the depth image. The method may also include determining a locating coordinate of the target object under the target coordinate system according to the marking image.
    Type: Grant
    Filed: July 17, 2019
    Date of Patent: June 29, 2021
    Assignee: ZHEJIANG DAHUA TECHNOLOGY CO., LTD.
    Inventors: Qiankun Li, Wei Lu, Shizhu Pan
  • Patent number: 11047958
    Abstract: The system and method for target identification using a comparatively low resolution imager combined with a 3D LIDAR on-board a round. This system and method are applicable to any round looking for a 3D target ID. A round, as used herein, may be a weapon, a projectile, a ballistic, a bullet, a munition, a guided weapon, or the like. By coupling a fiber laser of a LIDAR with a piezoelectric oscillator, or actuator, to scan a target and an avalanche photodiode (APD) detector array, or other high resolution sensor, target dimensional information can be used to increase the probability of an accurate target ID.
    Type: Grant
    Filed: March 13, 2020
    Date of Patent: June 29, 2021
    Assignee: BAE Systems Information and Electronic Systems Integration Inc.
    Inventor: Michael J. Choiniere
  • Patent number: 11042215
    Abstract: Provided are an image processing method and apparatus, a storage medium and an electronic device. In the embodiments of the present application, a human body image is acquired; the human body image is analyzed to identify human body feature point information corresponding to the human body image; the human body feature point information is combined to generate human body model information; and a virtual object is correspondingly controlled according to the human body model information.
    Type: Grant
    Filed: September 24, 2019
    Date of Patent: June 22, 2021
    Assignee: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
    Inventor: Yan Chen
  • Patent number: 11040450
    Abstract: Embodiments of the present invention determine the configuration of a workpiece and whether it is actually being handled by a monitored piece of machinery, such as a robot. The problem solved by the invention is especially challenging in real-world factory environments because many objects, most of which are not workpieces, may be in proximity to the machinery. Accordingly, embodiments of the invention utilize semantic understanding to distinguish between workpieces that may become associated with the robot and other objects (and humans) in the workspace that will not, and detect when the robot is carrying a workpiece.
    Type: Grant
    Filed: February 6, 2018
    Date of Patent: June 22, 2021
    Assignee: VEO ROBOTICS, INC.
    Inventors: Clara Vu, Scott Denenberg, Patrick Sobalvarro, Patrick Barragan, Alberto Moel
  • Patent number: 11042975
    Abstract: A computer-implemented method, a computer system, and a computer program product are provided for estimating output data that includes or is based on a number of containers, which may or may not be in receptacles. The method involves using an object detection algorithm operating on an input digital image to detect container images and receptacle images (if any), and using an estimation algorithm operating on the detected images to estimate the number of containers. Estimating the number of containers may involve counting the number of containers within different container classes, as determined by the object detection algorithm. Estimating the number of containers may involve estimating a size of a receptacle in a detected receptacle image based on analysis of a detected reference container image. A detected reference object image may be used to assist with classifying detected container images in different container classes.
    Type: Grant
    Filed: February 7, 2019
    Date of Patent: June 22, 2021
    Assignee: FLASCHEBOTTLE TECHNOLOGIES INC.
    Inventors: Philippe Perron, Yilong Zhang, Douglas Long
  • Patent number: 11037316
    Abstract: An apparatus comprises: an acquisition unit that captures an image of a measurement target and acquires an original image pair having a parallax; a reduction unit that reduces a size of the original image pair; and a calculator that calculates, from an image pair obtained by the reduction unit, a parallax map using predetermined search ranges and search windows in the respective regions. In order to obtain a parallax map that has a predetermined number of pieces of data, the calculator calculates parallax maps in a plurality of hierarchies in which a hierarchy where a parallax map is calculated using an image pair with a lowest magnification is set as a lowest hierarchy, and the predetermined search ranges for calculating the parallax maps in the respective hierarchies are determined based on a parallax map in an immediately lower hierarchy.
    Type: Grant
    Filed: March 26, 2019
    Date of Patent: June 15, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Makoto Oigawa
  • Patent number: 11029683
    Abstract: The present invention provides methods and systems of tracking a target with an imaging device onboard an unmanned aerial vehicle. The method may comprise identifying one or more targets in a first image captured by the imaging device, receiving a user selection of a target to be tracked from the one or more targets in the one or more images, generating target information for the target to be tracked based on the user selection of the target, detecting a deviation of a detected position and/or a detected size of the target in a second image captured by the imaging device from the selected position and/or the selected size of the target in the first image and adjusting at least one of the UAV and the carrier, to reduce the determined deviation to maintain the target substantially within the field of view of the image device, based on the deviation.
    Type: Grant
    Filed: December 28, 2016
    Date of Patent: June 8, 2021
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventor: Bo Zang
  • Patent number: 11023727
    Abstract: A target monitoring method, a camera, a controller, and a target monitoring system, where the system includes a first camera and a second camera. An overlapping area exists between fields of view of the first camera and the second camera. The method includes obtaining, location information of a to-be-tracked target in a first monitoring picture when the first camera is used as a current primary monitoring camera, determining, based on the location information of the target in the first monitoring picture, whether a location of the target in the first monitoring picture is in the overlapping area, where the overlapping area is an overlapping range between the fields of view of the first camera and the second camera, and switching, the current primary monitoring camera to the second camera when the location of the target in the first monitoring picture is in the overlapping area.
    Type: Grant
    Filed: July 13, 2017
    Date of Patent: June 1, 2021
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Qiang Ding, Liyao Zhang, Hongrui Jiang
  • Patent number: 11024073
    Abstract: A method and apparatus for generating a virtual object are provided, the method includes acquiring a point cloud of an object to generate a virtual object, determining shape attribute information of the object based on an image of the object, changing a position of at least one point in the point cloud based on the shape attribute information, and generating a virtual object for the object based on a changed point cloud.
    Type: Grant
    Filed: March 12, 2018
    Date of Patent: June 1, 2021
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Donghoon Sagong, Jiyeon Kim, Minjung Son, Hyun Sung Chang
  • Patent number: 11023093
    Abstract: An improved human-computer interface for placing and sizing virtual objects in a three-dimensional (“3D”) representation of a real-world environment is disclosed herein. The disclosed HCI can determine a location, size, and orientation of virtual objects in a 3D representation of a real-world environment based on simplified user gestures. In some embodiments, based on the timing and direction of an input gesture, a computing device can utilize (1) an automated mode that determines a position and orientation of a virtual object or utilize (2) a manual mode that determines position, orientation, and size of the virtual object. A computing device capable of 3D spatial mapping generates mesh data defining a 3D representation of a real-world environment and images of the real-world environment. The size of the virtual object can be based on a computed depth of real-world objects related to the virtual object.
    Type: Grant
    Filed: May 30, 2018
    Date of Patent: June 1, 2021
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Jason Thomas Faulkner, Sandhya Rajendra Rao, Kathleen Patricia Mulcahy, Timothy David Kviz, Bogdan Berg
  • Patent number: 11024035
    Abstract: The present disclosure concerns a method for processing a light field image comprising a set of image views.
    Type: Grant
    Filed: November 30, 2017
    Date of Patent: June 1, 2021
    Assignee: INTERDIGITAL CE PATENT HOLDINGS, SAS
    Inventors: Matthieu Hog, Neus Sabater, Christine Guillemot
  • Patent number: 11025981
    Abstract: Aspects of the subject disclosure may include, for example, obtaining one or more signals, the one or more signals being based upon brain activity of a viewer while the viewer is viewing media content; predicting, based upon the one or more signals, a first predicted desired viewport of the viewer; obtaining head movement data associated with the media content; predicting, based upon the head movement data, a second predicted desired viewport of the viewer; comparing the first predicted desired viewport to the second predicted desired viewport, resulting in a comparison; and determining, based upon the comparison, to use the first predicted desired viewport to facilitate obtaining a first subsequent portion of the media content or to use the second predicted desired viewport to facilitate obtaining a second subsequent portion of the media content. Other embodiments are disclosed.
    Type: Grant
    Filed: July 17, 2019
    Date of Patent: June 1, 2021
    Assignee: AT&T Intellectual Property I, L.P.
    Inventors: Bo Han, Zhengye Liu, Chenfei Gao
  • Patent number: 11026037
    Abstract: Methods and systems for generating a multichannel audio object. One or more features in a given video frame are identified using one or more image analysis neural networks. A multichannel audio object is generated based on the one or more identified features and one or more baseline audio tracks using an audio neural network.
    Type: Grant
    Filed: July 18, 2019
    Date of Patent: June 1, 2021
    Assignee: International Business Machines Corporation
    Inventors: Srihari Sridharan, Isaac Markus Serfaty
  • Patent number: 11017544
    Abstract: A communication terminal communicably connected with a server, including circuitry to: obtain first image data of at least a part of a first object detected at a first point of time; transmit the first image data to the server to request verification of the first image data; obtain second image data of at least a part of a second object detected at a second point of time, the second point of time being a time later than the first point of time; calculate a distance between a first position indicating a position of the first object at the first point of time, and a second position indicating a position of the second object at the second point of time; and control not to transmit the second image data based on a determination indicating that the calculated distance is equal to or less than a threshold
    Type: Grant
    Filed: July 30, 2019
    Date of Patent: May 25, 2021
    Assignee: Ricoh Company, Ltd.
    Inventor: Yoshinaga Kato
  • Patent number: 11017695
    Abstract: Methods for developing a machine learning model of a neural network for classifying medical images using a medical imaging system such as an ultrasound system. The methods involve capturing images during a first medical procedure, analyzing the images for the presence of one or more features, labeling the images as belonging to one or more classes, splitting the labeled images into a training set and a validation set. Training and validation processes are then performed, and the machine learning model may be used when training process metrics and validation process metrics for the training and validation processes are within acceptable thresholds.
    Type: Grant
    Filed: December 26, 2019
    Date of Patent: May 25, 2021
    Assignee: Tienovix, LLC
    Inventors: William R. Buras, Craig S. Russell, Kyle Q. Nguyen
  • Patent number: 11012614
    Abstract: There is provided an image processing device including a subject distance change determination unit configured to detect a temporal change of a distance from an imaging position to each subject present in an image and determine a tendency toward approach or recession of the each subject with respect to the imaging position on the basis of the detection, and a main subject determination unit configured to determine a main subject on the basis of the tendency toward approach or recession of the each subject determined by the subject distance change determination unit.
    Type: Grant
    Filed: December 13, 2019
    Date of Patent: May 18, 2021
    Assignee: Sony Corporation
    Inventor: Masaya Kinoshita
  • Patent number: 11010905
    Abstract: Techniques described herein provide efficient object detection and tracking in video images, such as may be used for real-time camera control in power-limited mobile image capture devices. The techniques include performing object detection on a first subset of frames of an input video, detecting an object and object location in a first detection frame of the first subset of frames, and tracking the detected object on a second subset of frames of the input video after the first detection frame.
    Type: Grant
    Filed: May 31, 2019
    Date of Patent: May 18, 2021
    Assignee: Apple Inc.
    Inventors: Afshin Dehghan, Yang Yang, Feng Tang, Kelsey Y. Ho
  • Patent number: 11010975
    Abstract: There is disclosed a system for remote tracking of augmented reality media through a real-world environment. The system may use an augmented reality platform incorporating a camera and motion sensors to move about a physical space while an augmented reality object or characters are superimposed within that physical space. The augmented reality platform may move intelligently to keep the augmented reality media within frame as it moves or is adjusted. The augmented reality platform may present a basis upon which to build upon for superimposing augmented reality elements onto augmented reality media and the augmented reality platform as they move about within a space together. The platform may be used, for example, in a racing or platforming style game or experience.
    Type: Grant
    Filed: March 6, 2019
    Date of Patent: May 18, 2021
    Assignee: Velan Studios, Inc.
    Inventors: Daniel Doptis, Jan-Erik Steel, Edward Tumbusch, Karthik Bala
  • Patent number: 11006072
    Abstract: A window system includes a plurality of local terminals, a remote camera array, and an information processor; wherein each of the plurality of local terminals includes a local display and a local identification device, the local display is configured to display remote video information; the local identification device is configured to identify a position of a local user's face; the remote camera array is configured to capture the remote video information according to the position of the local user's face of each of the plurality of local terminals; the information processor is configured to calculate a range of the local user's visual field according to the position of the local user's face, select the corresponding remote video information according to the range of the local user's visual field, and transmit the corresponding remote video information to the local display.
    Type: Grant
    Filed: September 14, 2020
    Date of Patent: May 11, 2021
    Assignee: Beijing FUNATE Innovation Technology Co., LTD.
    Inventor: Liang Liu
  • Patent number: 10992910
    Abstract: Direction control of audio/video (A/V) recording and communication devices in network communication with additional cameras is provided. In one embodiment, an A/V recording and communication device comprises: a first camera configured to capture first image data, wherein the first camera is pointed in a first direction; a communication module; and a processing module comprising: a processor; and a camera application that configures the processor to: maintain the first camera in a low-power state; receive a power-up command signal from the backend server based on an output signal from a second camera; receive an orientation signal from the backend server based on the output signal from the second camera; point the first camera in a second direction in response to the orientation signal; power up the first camera in response to the power-up command signal; and capture the first image data in response to the power-up command signal.
    Type: Grant
    Filed: August 16, 2019
    Date of Patent: April 27, 2021
    Assignee: Amazon Technologies, Inc.
    Inventors: James Siminoff, Mark Siminoff, Elliott Lemberger
  • Patent number: 10984816
    Abstract: A voice enhancement method and apparatus of a smart device and a smart device are disclosed. The method comprises: monitoring and collecting a voice signal sent by a user in real time; determining a direction of the user according to the voice signal; collecting a depth image in the direction of the user; determining a sound source direction of the user according to the depth image; and adjusting a beamforming direction of a microphone array on the smart device according to the sound source direction of the user, and performing enhancement processing on the voice signal.
    Type: Grant
    Filed: July 5, 2018
    Date of Patent: April 20, 2021
    Assignee: GOERTEK INC.
    Inventors: Jian Zhu, Xiangdong Zhang, Zhenyu Yu, Zhiping Luo, Dong Yan
  • Patent number: 10977807
    Abstract: A method of extracting facial movement information capable of effectively canceling noise includes: obtaining an image of a subject's face with a camera; extracting raw data on facial movement from the image; detecting macro movement data from the raw data; and removing the macro movement component from the raw data to obtain refined micro movement data.
    Type: Grant
    Filed: July 29, 2019
    Date of Patent: April 13, 2021
    Inventors: Min Cheol Whang, Sung Teac Hwang, Myoung Ju Won, Dong Won Lee
  • Patent number: 10970888
    Abstract: According to an embodiment of the present technology, there is provided an information processing device including an acquisition unit configured to acquire multiple images to which position information showing an imaging position is attached, and a display control unit configured to display a first map on which a pointer indicating the imaging position shown by the position information is displayed while switching a reduced scale and a display area according to an operation of a user, and configured to display a second map of a fixed reduced scale together with the first map while causing a display area to cooperate with a display area of the first map.
    Type: Grant
    Filed: December 18, 2012
    Date of Patent: April 6, 2021
    Inventors: Satoshi Suzuki, Shinichirou Tobinaga, Noriyuki Hoshihara
  • Patent number: 10970553
    Abstract: Systems and methods for performing semantic segmentation of three-dimensional data are provided. In one example embodiment, a computing system can be configured to obtain sensor data including three-dimensional data associated with an environment. The three-dimensional data can include a plurality of points and can be associated with one or more times. The computing system can be configured to determine data indicative of a two-dimensional voxel representation associated with the environment based at least in part on the three-dimensional data. The computing system can be configured to determine a classification for each point of the plurality of points within the three-dimensional data based at least in part on the two-dimensional voxel representation associated with the environment and a machine-learned semantic segmentation model. The computing system can be configured to initiate one or more actions based at least in part on the per-point classifications.
    Type: Grant
    Filed: September 6, 2018
    Date of Patent: April 6, 2021
    Assignee: UATC, LLC
    Inventors: Chris Jia-Han Zhang, Wenjie Luo, Raquel Urtasun
  • Patent number: 10964046
    Abstract: An information processing apparatus includes a receiving unit that receives a first image which has been extracted from an image obtained by imaging of an omnidirectional camera, the first image having been obtained by imaging a head of a person and position information indicating a position of the person in the image, a calculation unit that calculates a degree of distortion of the first image from the position information, and a learning unit that performs learning for estimating an orientation of a face of the person by using the calculated degree of distortion and the first image.
    Type: Grant
    Filed: October 16, 2018
    Date of Patent: March 30, 2021
    Assignee: FUJI XEROX CO., LTD.
    Inventors: Yusuke Yamaura, Yukihiro Tsuboshita, Takeshi Onishi
  • Patent number: 10965886
    Abstract: A system and method of generating a composite frame from a video capturing a plurality of persons. The method comprises determining a plurality of frames corresponding to occurrence of a predetermined event in the video; determining an importance score for each of the plurality of persons in the determined plurality of frames, the importance score determined based on a type of interaction detected between each of the plurality of persons with an activity object; and selecting one or more of the plurality of persons based on the determined importance score to generate a composite frame of the event including the selected one or more persons.
    Type: Grant
    Filed: November 12, 2018
    Date of Patent: March 30, 2021
    Assignee: Canon Kabushiki Kaisha
    Inventors: Amit Kumar Gupta, Quang Tuan Pham
  • Patent number: 10963835
    Abstract: Described is a multiple-camera system for use in capturing images of users within a materials handling facility and processing those images to monitor the movement of users. For large materials handling facilities, a large number of cameras may be required to monitor the facility. Processing of the data generated from a large number of cameras becomes difficult. The implementations described herein include a hierarchy that allows image data from any number of cameras within a materials handling facility to be processed without substantially increasing the processing time needed or sacrificing processing capabilities.
    Type: Grant
    Filed: October 26, 2018
    Date of Patent: March 30, 2021
    Assignee: Amazon Technologies, Inc.
    Inventors: Frank Florian Liberato, Daniel Bibireata, Muralidhar Koka, Yasser Baseer Asmi, Nishitkumar Ashokkumar Desai
  • Patent number: 10957055
    Abstract: The claimed invention relates to the data processing industry, in particular, to the methods and systems of searching and analyzing data for finding an object in a video stream. The technical result is enhancing the precision of determining the sought object in a video stream, as well as increasing the speed of locating the object by means of performing a classification of objects and determining their features present on the video stream frames.
    Type: Grant
    Filed: December 27, 2016
    Date of Patent: March 23, 2021
    Assignee: OBSCHESTVO S OGRANICHENNOI OTVETSTVENNOSTYU “SATELLIT INNOVATSIA”
    Inventors: Artem Vladimirovich Razumkov, Alexandr Vladimirovich Korobkov, Petr Vladimirovich Kharebov, Alexey Georgievich Yastrebov, Alexandr Anatolievich Nevelsky, Konstantin Alekseevich Gavrilov, Andrey Viktorovich Durakov, Aleksey Yurievich Gorodilov, Alexei Georgievich Kraev, Andrey Valerievich Zayakin
  • Patent number: 10957358
    Abstract: Devices and methods for determining image quality using full-reference and non-reference techniques. Full reference image quality may be determined prior to output of an image or video frame from an image sensor processor by temporarily retaining image data from the image sensor and comparing processed image data of the image to the retained, non-processed image data of the same image. Full reference image quality determination may be assisted by a heuristic-based fault indicator. Image quality may also be determined by a non-reference technique of matching the image to one of various scenarios that are associated with sets of heuristics and applying the heuristics of the particular scenario to the image. Instead of relying on a nominal frame rate, video timing quality may be determined by comparing the capture time interval between successive video frames to the presentation time interval of the same video frames.
    Type: Grant
    Filed: January 18, 2019
    Date of Patent: March 23, 2021
    Assignee: Apple Inc.
    Inventors: Krasimir D. Kolarov, Steven E. Saunders