Local Or Regional Features Patents (Class 382/195)
  • Patent number: 10817704
    Abstract: At least one example embodiment discloses a method of extracting a feature from an input image. The method may include detecting landmarks from the input image, detecting physical characteristics between the landmarks based on the landmarks, determining a target area of the input image from which at least one feature is to be extracted and an order of extracting the feature from the target area based on the physical characteristics and extracting the feature based on the determining.
    Type: Grant
    Filed: December 28, 2018
    Date of Patent: October 27, 2020
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Sungjoo Suh, Seungju Han, Jaejoon Han
  • Patent number: 10803597
    Abstract: A circuitry of an image processing device divides a first image into a plurality of regions, extracts a feature point from each of the regions, tracks the feature point among a plurality of images to detect a motion vector, estimates a notable target of the first image, calculates the priority level of setting of a tracking feature point for each of the regions for tracking motion of the notable target, and sets the tracking feature point to any of the regions based on the priority level.
    Type: Grant
    Filed: March 1, 2018
    Date of Patent: October 13, 2020
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Yu Narita
  • Patent number: 10803664
    Abstract: A redundant tracking system comprising multiple redundant tracking sub-systems, enabling seamless transitions between such tracking sub-systems, provides a solution to this problem by merging multiple tracking approaches into a single tracking system. This system is able to combine tracking objects with six degrees of freedom (6DoF) and 3DoF through combining and transitioning between multiple tracking systems based on the availability of tracking indicia tracked by the tracking systems. Thus, as the indicia tracked by any one tracking system becomes unavailable, the redundant tracking system seamlessly switches between tracking in 6DoF and 3DoF thereby providing the user with an uninterrupted experience.
    Type: Grant
    Filed: April 20, 2020
    Date of Patent: October 13, 2020
    Assignee: Snap Inc.
    Inventors: Andrew James McPhee, Samuel Edward Hare, Peicheng Yu, Robert Cornelius Murphy, Dhritiman Sagar
  • Patent number: 10788430
    Abstract: A surface inspection apparatus includes: an inspection pattern forming unit that forms inspection patterns; a projection unit that projects the inspection patterns onto an inspection target object; a captured image acquiring unit that acquires captured images of the inspection target object; an edge extraction image creating unit that extracts edges from captured images, and creates edge extraction images; a correction coefficient setting unit that sets a correction coefficient for correcting intensities of edges in the edge extraction image; an intensity correcting unit that corrects the intensities of the edges; a corrected edge extraction image creating unit that creates corrected edge extraction images; an integrated image creating unit that creates a single integrated image by integrating the brightness values at the same position of the inspection target object; and a determination unit that determines the presence or absence of unevenness on a surface of the inspection target object.
    Type: Grant
    Filed: January 8, 2019
    Date of Patent: September 29, 2020
    Assignee: AISIN SEIKI KABUSHIKI KAISHA
    Inventors: Jin Nozawa, Yasuyuki Kuno, Yukio Ichikawa, Masataka Toda, Munehiro Takayama
  • Patent number: 10776939
    Abstract: Embodiments described herein provide various examples of an automatic obstacle avoidance system for unmanned vehicles using embedded stereo vision techniques. In one aspect, an unmanned aerial vehicle (UAV) capable of performing autonomous obstacle detection and avoidance is disclosed. This UAV includes: a stereo vision camera set coupled to the one or more processors and the memory to capture a sequence of stereo images; and a stereo vision module configured to: receive a pair of stereo images captured by a pair of stereo vision cameras; perform a border cropping operation on the pair of stereo images to obtain a pair of cropped stereo images; perform a sub sampling operation on the pair of cropped stereo images to obtain a pair of sub sampled stereo images; and perform a dense stereo matching operation on the pair of sub sampled stereo images to generate a dense three-dimensional (3D) point map of a space corresponding to the pair of stereo images.
    Type: Grant
    Filed: April 3, 2018
    Date of Patent: September 15, 2020
    Assignee: AltumView Systems Inc.
    Inventors: Rui Ma, Chao Shen, Yu Gao, Ye Lu, Minghua Chen, Jie Liang, Jianbing Wu
  • Patent number: 10769411
    Abstract: Techniques are provided for selecting a three-dimensional model. An input image including an object can be obtained, and a pose of the object in the input image can be determined. One or more candidate three-dimensional models representing one or more objects in the determined pose can be obtained. From the one or more candidate three-dimensional models, a candidate three-dimensional model can be determined to represent the object in the input image.
    Type: Grant
    Filed: April 5, 2018
    Date of Patent: September 8, 2020
    Assignee: QUALCOMM TECHNOLOGIES, INC.
    Inventors: Alexander Grabner, Peter Michael Roth, Vincent Lepetit
  • Patent number: 10768303
    Abstract: The invention relates to a method for identifying individual trees in airborne lidar data and a corresponding computer program product. The method comprises: a. obtaining lidar data points of a group of one or more trees; b. define voxels in a regular 3D grid on the basis of the data points; c. applying an image segmentation algorithm to obtain at least one segment; and, if at least two segments are obtained: d. find the root voxel and branch voxels of a first segment and a second neighbouring segment; and e. merging the first and second segment if the distance between the first and second root voxel is less than a first threshold, the distance between the first root voxel and the closest second branch voxel is less than a second threshold; and the distance between the first branch voxels and the second branch voxels is less than a third threshold.
    Type: Grant
    Filed: August 24, 2016
    Date of Patent: September 8, 2020
    Assignees: YaDo Holding B.V.
    Inventors: Biao Xiong, Dong Yang
  • Patent number: 10769474
    Abstract: Embodiments relate a keypoint detection circuit for identifying keypoints in captured image frames. The keypoint detection circuit generates an image pyramid based upon a received image frame, and determine multiple sets of keypoints for each octave of the pyramid using different levels of blur. In some embodiments, the keypoint detection circuit includes multiple branches, each branch made up of one or more circuits for determining a different set of keypoints from the image, or for determining a subsampled image for a subsequent octave of the pyramid. By determining multiple sets of keypoints for each of a plurality of pyramid octaves, a larger, more varied set of keypoints can be obtained and used for object detection and matching between images.
    Type: Grant
    Filed: August 10, 2018
    Date of Patent: September 8, 2020
    Assignee: Apple Inc.
    Inventors: David R. Pope, Cecile Foret, Jung Kim
  • Patent number: 10769485
    Abstract: A framebuffer-less system of convolutional neural network (CNN) includes a region of interest (ROI) unit that extracts features, according to which a region of interest in an input image frame is generated; a convolutional neural network (CNN) unit that processes the region of interest of the input image frame to detect an object; and a tracking unit that compares the features extracted at different times, according to which the CNN unit selectively processes the input image frame.
    Type: Grant
    Filed: June 19, 2018
    Date of Patent: September 8, 2020
    Assignee: Himax Technologies Limited
    Inventor: Der-Wei Yang
  • Patent number: 10762608
    Abstract: Embodiments of the present disclosure relate to a sky editing system and related processes for sky editing. The sky editing system includes a composition detector to determine the composition of a target image. A sky search engine in the sky editing system is configured to find a reference image with similar composition with the target image. Subsequently, a sky editor replaces content of the sky in the target image with content of the sky in the reference image. As such, the sky editing system transforms the target image into a new image with a preferred sky background.
    Type: Grant
    Filed: August 31, 2018
    Date of Patent: September 1, 2020
    Assignee: ADOBE INC.
    Inventors: Xiaohui Shen, Yi-Hsuan Tsai, Kalyan K. Sunkavalli, Zhe Lin
  • Patent number: 10762680
    Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media for generating deterministic enhanced digital images based on parallel determinations of pixel group offsets arranged in pixel waves. For example, the disclosed systems can utilize a parallel wave analysis to propagate through pixel groups in a pixel wave of a target region within a digital image to determine matching patch offsets for the pixel groups. The disclosed systems can further utilize the matching patch offsets to generate a deterministic enhanced digital image by filling or replacing pixels of the target region with matching pixels indicated by the matching patch offsets.
    Type: Grant
    Filed: March 25, 2019
    Date of Patent: September 1, 2020
    Assignee: ADOBE INC.
    Inventors: Sohrab Amirghodsi, Connelly Barnes, Eric L. Palmer
  • Patent number: 10752172
    Abstract: A computer-implemented method for controlling a vehicle interface system in vehicle includes receiving images of a driver from an image capture device and determining a population group based on the images. The method includes identifying a human perception condition of the driver that is characteristic of the population group. The human perception condition limits an ability of the driver to perceive a driving situation of a vehicle operation and a stimulus output that conveys information to the driver in the vehicle about the driving situation of the vehicle operation. The stimulus output is controlled by the vehicle interface system. The method includes modifying the stimulus output into an optimal stimulus output that can be perceived by the driver with the human perception condition, and controlling the vehicle interface system to provide the optimal stimulus output to the driver during the vehicle operation.
    Type: Grant
    Filed: March 18, 2019
    Date of Patent: August 25, 2020
    Assignee: Honda Motor Co., Ltd.
    Inventor: Laith Daman
  • Patent number: 10751129
    Abstract: Described are various embodiments of a computerized method and system for automatically developing a facial remediation protocol for a user based on an input facial image of the user, wherein facial remediation design or plan comprises a combination of one or more of a surgical plan to shift or change the size of various facial anatomical features, a makeup plan to change the apparent size or apparent position of various facial anatomical features and other techniques, such as hair design, to reduce the actual and perceived difference between the subject's face and a standard face, for example.
    Type: Grant
    Filed: May 16, 2017
    Date of Patent: August 25, 2020
    Inventor: John Gordon Robertson
  • Patent number: 10748579
    Abstract: Facial expressions depicted in image data are edited based on variations of facial expressions depicted across a plurality of frames in other image data. The facial expression of a target subject, depicted in a first image data set, is edited based on the facial expression of a preview subject depicted in a second image data set. The target subject's facial expression is automatically edited based on variations in the of the preview subject's facial expression. A camera device captures video image data of the preview subject. The camera provides a live data image feed to a face-editing engine. The engine edits the face of the target subject's based on the varying face of the preview subject. In real time, for each frame of the data image feed, a user interface simultaneously displays both the varying face of the preview subject and the edited face of the target subject.
    Type: Grant
    Filed: October 26, 2016
    Date of Patent: August 18, 2020
    Assignee: Adobe Inc.
    Inventors: Gagan Singhal, Manik Singhal
  • Patent number: 10750115
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for capturing video on a mobile device. In an example mobile device, an activation action puts the device in a state in which it captures a loop of video of predefined length and uses that as a prefix to a video recorded in response to a record video action.
    Type: Grant
    Filed: June 11, 2019
    Date of Patent: August 18, 2020
    Assignee: Twitter, Inc.
    Inventors: Richard Plom, Reed Martin
  • Patent number: 10739774
    Abstract: According to one aspect, keyframe based autonomous vehicle operation may include collecting vehicle state information and collecting environment state information. A size of an object within the environment, a distance between the object and the autonomous vehicle, and a lane structure of the environment through which the autonomous vehicle is travelling may be determined. A matching keyframe model may be selected based on the size of the object, the distance from the object to the autonomous vehicle, the lane structure of the environment, and the vehicle state information. Suggested limits for a driving parameter associated with autonomous vehicle operation may be generated based on the selected keyframe model. The autonomous vehicle may be commanded to operate autonomously according to the suggested limits for the driving parameter.
    Type: Grant
    Filed: April 6, 2018
    Date of Patent: August 11, 2020
    Assignee: Honda Motor Co., Ltd.
    Inventors: Priyam Parashar, Kikuo Fujimura, Alireza Nakhaei Sarvedani, Akansel Cosgun
  • Patent number: 10733720
    Abstract: Disclosed embodiments relate to a method and an apparatus for testing accuracy of a high-precision map. In some embodiments, the method includes: reverting the high-precision map to a road network map; acquiring a 3D point cloud road image labeled with an actual coordinate of a map element; fitting the 3D point cloud road image into the road network map to obtain a road network map with the fitted 3D point cloud road image; calculating a differential between the actual coordinate of the 3D point cloud road image in the road network map with the fitted 3D point cloud road image and a map coordinate in the road network map; and determining the high-precision map as being accurate in response to the differential being less than or equal to a preset threshold.
    Type: Grant
    Filed: May 12, 2017
    Date of Patent: August 4, 2020
    Assignee: Baidu Online Network Technology (Beijing) Co., Ltd.
    Inventor: Fenghui Han
  • Patent number: 10726272
    Abstract: Systems and method of generating video summaries are presented herein. Information defining a video may be obtained. The video may include a set of frame images. Parameter values for parameters of individual frame images of the video may be determined. Interest weights for the frame images may be determined. An interest curve for the video that characterizes the video by interest weights as a function of progress through the set of frame images may be generated. One or more curve attributes of the interest curve may be identified and one or more interest curve values of the interest curve that correspond to individual curve attributes may be determined. Interest curve values of the interest curve may be compared to threshold curve values. A subset of frame images of the video to include within a video summary of the video may be identified based on the comparison.
    Type: Grant
    Filed: April 23, 2018
    Date of Patent: July 28, 2020
    Assignee: Go Pro, Inc.
    Inventors: Jonathan Wills, Daniel Tse, Desmond Chik, Brian Schunck
  • Patent number: 10713477
    Abstract: A determination result is easily obtained even in expression determination on a face image that is not a front view. A Robot includes a camera, a face detector, a face angle estimator, and an expression determiner. The camera acquires image data. The face detector detects a face of a person from the image data acquired by the camera. The face angle estimator estimates an angle of the face detected by the face detector. The expression determiner determines an expression of the face based on the angle estimated by the face angle estimator.
    Type: Grant
    Filed: May 25, 2018
    Date of Patent: July 14, 2020
    Assignee: CASIO COMPUTER CO., LTD.
    Inventors: Kouichi Nakagome, Keisuke Shimada
  • Patent number: 10713495
    Abstract: Techniques are disclosed for identifying a video using a video signature generated using image features derived from a portion of the video. In some examples, a method may include determining image features derived from a portion of a video, determining a video frame sequence of the video, and generating the video signature of the video based on the image features and the video frame sequence. The method may further include deriving a curve for the video based on the image features and the video frame sequence, and comparing the derived curve with one or more curves corresponding to respective one or more reference videos.
    Type: Grant
    Filed: March 13, 2018
    Date of Patent: July 14, 2020
    Assignee: Adobe Inc.
    Inventors: Kevin Gary Smith, William Brandon George
  • Patent number: 10702991
    Abstract: An apparatus, robot, method and recording medium is provided, wherein when it is determined that a speech of an adult includes a warning word, whether the adult is angry or scolding is determined based on a physical feature value of the speech of the adult. When it is determined that the adult is angry, at least any of the following processes is performed: (a) a process of causing a loudspeaker to output a first sound, (b) a process of causing an apparatus to perform a first operation, and (c) a process of causing a display to perform a first display.
    Type: Grant
    Filed: February 20, 2018
    Date of Patent: July 7, 2020
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Michiko Sasagawa, Ryouta Miyazaki
  • Patent number: 10699208
    Abstract: Nearest neighbor distances are obtained by coherent majority voting based on a plurality of available distance estimates produced using amplitude estimation without measurement in a quantum computer. In some examples, distances are Euclidean distances or are based on inner products of a target vector with vectors from a training set of vectors. Distances such as mean square distances and distances from a data centroid can also be obtained.
    Type: Grant
    Filed: December 5, 2014
    Date of Patent: June 30, 2020
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Nathan Wiebe, Krysta Svore, Ashish Kapoor
  • Patent number: 10692000
    Abstract: In one respect, there is provided a system that may include a processor and a memory. The memory may be configured to store instructions that results in operations when executed by the processor. The operations may include: training a machine learning model by at least processing a training set with the machine learning model, the training set including at least one synthetic image that is generated by applying one or more modifications to a non-synthetic image; determining, based at least on a result of the processing of the mixed training set, that the machine learning model is unable to classify images having a specific modification; and training the machine learning model with additional training data that includes one or more additional synthetic images having the specific modification. Related methods and articles of manufacture are also disclosed.
    Type: Grant
    Filed: March 20, 2017
    Date of Patent: June 23, 2020
    Assignee: SAP SE
    Inventors: Tatiana Surazhsky, Leonid Bobovich, Michael Kemelmakher, Ran Moshe Bittmann
  • Patent number: 10692285
    Abstract: A redundant tracking system comprising multiple redundant tracking sub-systems, enabling seamless transitions between such tracking sub-systems, provides a solution to this problem by merging multiple tracking approaches into a single tracking system. This system is able to combine tracking objects with six degrees of freedom (6DoF) and 3DoF through combining and transitioning between multiple tracking systems based on the availability of tracking indicia tracked by the tracking systems. Thus, as the indicia tracked by any one tracking system becomes unavailable, the redundant tracking system seamlessly switches between tracking in 6DoF and 3DoF thereby providing the user with an uninterrupted experience.
    Type: Grant
    Filed: September 23, 2019
    Date of Patent: June 23, 2020
    Assignee: Snap Inc.
    Inventors: Andrew James McPhee, Samuel Edward Hare, Peicheng Yu, Robert Cornelius Murphy, Dhritiman Sagar
  • Patent number: 10685434
    Abstract: The present application discloses a method for assessing aesthetic quality of a natural image based on multi-task deep learning. Said method includes: step 1: automatically learning aesthetic and semantic characteristics of the natural image based on multi-task deep learning; step 2: performing aesthetic categorization and semantic recognition to the results of automatic learning based on multi-task deep learning, thereby realizing assessment of aesthetic quality of the natural image. The present application uses semantic information to assist learning of expressions of aesthetic characteristics so as to assess aesthetic quality more effectively, besides, the present application designs various multi-task deep learning network structures so as to effectively use the aesthetic and semantic information for obtaining highly accurate image aesthetic categorization.
    Type: Grant
    Filed: March 30, 2016
    Date of Patent: June 16, 2020
    Assignee: Institute of Automation, Chinese Academy of Sciences
    Inventors: Kaiqi Huang, Tieniu Tan, Ran He, Yueying Kao
  • Patent number: 10671713
    Abstract: A method for controlling unlocking and related products are provided. An electronic device includes at least one processor and a computer readable storage coupled to the at least one processor. The computer readable storage stores at least one computer executable instruction thereon, which when executed by the at least one processor, cause the at least one processor to carry out actions, including: obtaining a face image; carrying out a group of rough features and a group of fine features from the face image; carrying out a verification operation for the group of rough features and the group of the fine features; carrying out a next unlocking process when verification of the group of rough features and the group of fine features is passed.
    Type: Grant
    Filed: July 11, 2018
    Date of Patent: June 2, 2020
    Assignee: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
    Inventors: Haiping Zhang, Yibao Zhou
  • Patent number: 10671875
    Abstract: A degree-of-saliency map generated from an input image is divided into a plurality of partial areas, and the degree of nonuniformity is calculated from the distribution characteristics of the degrees of saliency of the partial areas. Whether a main subject is present in the input image is judged based on the calculated degree of nonuniformity.
    Type: Grant
    Filed: March 20, 2019
    Date of Patent: June 2, 2020
    Assignee: Canon Kabushiki Kaisha
    Inventors: Takahisa Yamamoto, Masao Yamanaka
  • Patent number: 10671663
    Abstract: A generation device according to the subject application includes an acquiring unit and a generating unit. The acquiring unit acquires multiple pieces of vector information that correspond to each search target during the proximity search. The generating unit generates multiple pieces of centroid information, in which each piece of vector information is related in accordance with a distance for vector quantization, based on multiple pieces of vector information acquired by the acquiring unit such that a difference in the number of pieces of vector information related to each piece of centroid information falls within a predetermined value.
    Type: Grant
    Filed: November 13, 2017
    Date of Patent: June 2, 2020
    Assignee: YAHOO JAPAN CORPORATION
    Inventor: Masajiro Iwasaki
  • Patent number: 10657369
    Abstract: Techniques are disclosed for removing text from an image of a form document. The text is removed by determining a spectral domain representation of the image and applying a filter to remove the high-frequency components which correspond to the text in the form. An image is reconstructed from the filtered spectral domain representation which maintains the low-frequency components, while deemphasizing or removing the high-frequency components. A shape of the filter applied to the spectral domain representation is determined based on a similarity measure between the image of the form and the reconstructed image.
    Type: Grant
    Filed: October 27, 2017
    Date of Patent: May 19, 2020
    Assignee: INTUIT, INC.
    Inventors: Diane Chang, Rohan Kekatpure
  • Patent number: 10652778
    Abstract: Method for a communication device switching among a plurality of sub-bands in a wireless network. The method comprises measuring a signal quality for an operation sub-band, comparing the signal quality with a signal quality threshold, determining a switch action according to the comparison of the signal quality with the signal quality threshold, and switching from the operation sub-band according to the determined switch action. The communication device and access node thereof are also disclosed.
    Type: Grant
    Filed: November 17, 2017
    Date of Patent: May 12, 2020
    Assignee: Telefonaktiebolaget LM Ericsson (publ)
    Inventors: Jinhua Liu, Rui Fan
  • Patent number: 10642893
    Abstract: Implementations relate to generating theme-based videos. In some implementations, a computer-implemented method to automatically generate a theme-based video includes obtaining image criteria for a theme from a theme definition, querying an image database to obtain a plurality of images that meet the image criteria, determining that a count of the plurality of images satisfies a threshold based on the theme definition, and generating the theme-based video that includes one or more of the plurality of images.
    Type: Grant
    Filed: September 1, 2017
    Date of Patent: May 5, 2020
    Assignee: Google LLC
    Inventors: Timothy Novikoff, Jingyu Cui
  • Patent number: 10635889
    Abstract: For displaying a subject composition, a method determines a subject number, a subject age category, and a subject size for one or more subjects of an image. The method further calculates a subject distribution that indicates a position for a face of each subject. In addition, the method determines a subject pose for each subject that indicates a body position for the subject. The method further displays the subject composition comprising the subject distribution and the subject poses overlaying a display image.
    Type: Grant
    Filed: December 28, 2017
    Date of Patent: April 28, 2020
    Inventors: Rolf Herd, Joshua Quinton
  • Patent number: 10636166
    Abstract: Systems and methods for correlating visual content in 2D and 3D scenes of a geographical region can include at least one data source for providing geographical data, a display device of an aircraft, and a processor. The display device can display a 2D view and a 3D view representing top-down views of the geographical region using data received from the data source(s). The processor(s) can identify a first image point within the 2D view referenced by a first cursor of the 2D view. The processor(s) can determine, using information received from the at least one data source, a geographical location corresponding to the first image point. The processor(s) can determine a second image point within the 3D view corresponding to the determined geographical location. The processor(s) can position a second visual indicator of the 3D view to reference the determined second image point within the 3D view.
    Type: Grant
    Filed: April 19, 2017
    Date of Patent: April 28, 2020
    Assignee: Rockwell Collins, Inc.
    Inventors: Michael J. Armstrong, Scott E. Schultz, Matthew J. Cunnien
  • Patent number: 10627232
    Abstract: A method for aerial image processing preferably includes receiving ground control point (GCP) information, receiving a set of images, determining spatial information associated with the images, and determining GCP image locations; and can additionally or alternatively include determining aerial map information, training an automated GCP detector, and/or any other suitable elements. A system for aerial image processing preferably includes one or more computing devices, and can additionally or alternatively include one or more GCPs, aerial vehicles, and/or any other suitable elements.
    Type: Grant
    Filed: June 27, 2018
    Date of Patent: April 21, 2020
    Assignee: Infatics, Inc.
    Inventors: Nicholas Pilkington, Jonathan James Millin
  • Patent number: 10623610
    Abstract: A display processing device includes a moving image generation unit, a display control unit, and an input detection unit. The moving image generation unit generates a combined moving image that is a moving image combined from a plurality of moving images. The input detection unit detects an input operation performed on the input device that receives the input operation for inputting at least one of a position on the combined moving image displayed on a display device and a direction based on the combined moving image. The display control unit allows the display device to display a moving image that is based on, among the plurality of moving images constituting the combined moving image, one or more moving images according to the input detected by the input detection unit, and that has a display mode different from at least the combined moving image.
    Type: Grant
    Filed: February 6, 2017
    Date of Patent: April 14, 2020
    Assignee: DENSO CORPORATION
    Inventor: Hiroki Kitani
  • Patent number: 10618172
    Abstract: A method for operating a robotic system includes determining a discretized object model based on source sensor data; comparing the discretized object model to a packing plan or to master data; determining a discretized platform model based on destination sensor data; determining height measures based on the destination sensor data; comparing the discretized platform model and/or the height measures to an expected platform model and/or expected height measures; and determining one or more errors by (i) determining at least one source matching error by identifying one or more disparities between (a) the discretized object model and (b) the packing plan or the master data or (ii) determining at least one destination matching error by identifying one or more disparities between (a) the discretized platform model or the height measures and (b) the expected platform model or the expected height measures, respectively.
    Type: Grant
    Filed: May 31, 2019
    Date of Patent: April 14, 2020
    Assignee: MUJIN, Inc.
    Inventors: Rosen Nikolaev Diankov, Denys Kanunikov
  • Patent number: 10616570
    Abstract: An image processing apparatus includes an acquiring unit and a determining unit. For example, the acquiring unit acquires an imaging image captured by a camera mounted on a vehicle and registers the acquired imaging image in drive recorder information. When a vanishing point is detected from the imaging image, the determining unit determines that the imaging direction of the imaging device is normal such that the front of the vehicle is normally imaged. When the vanishing point is not detected from the acquired the imaging image, the determining unit determines that the imaging direction of the imaging device is abnormal such that the front of the vehicle is not normally imaged.
    Type: Grant
    Filed: April 27, 2017
    Date of Patent: April 7, 2020
    Assignee: FUJITSU LIMITED
    Inventors: Kozo Baba, Norio Hashiguchi
  • Patent number: 10611995
    Abstract: The present disclosure provides systems and methods for sorting a cell. The system may comprise a flow channel configured to transport a cell through the channel. The system may comprise an imaging device configured to capture an image of the cell from a plurality of different angles as the cell is transported through the flow channel. The system may comprise a processor configured to analyze the image using a deep learning algorithm to enable sorting of the cell.
    Type: Grant
    Filed: November 16, 2018
    Date of Patent: April 7, 2020
    Assignee: Deepcell, Inc.
    Inventors: Mahdokht Masaeli, Mahyar Salek, Hou-Pu Chou, Soroush Kahkeshani
  • Patent number: 10606398
    Abstract: An electronic device comprising: a display configured to output image data; and at least one processor configured to: detect an input; select a portion of the image data based on the input; and generate a preview of the image data based on the selected portion.
    Type: Grant
    Filed: September 14, 2015
    Date of Patent: March 31, 2020
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Sung-Wang Kim, Joon-Won Park, Yun-Hong Choi
  • Patent number: 10600182
    Abstract: An image processing apparatus includes an image obtaining unit configured to obtain a time-sequential image obtained in order of a start image, a plurality of intermediate images, and an end image, an image selecting unit configured to select a plurality of combinations of images including the start image, at least one of the plurality of intermediate images, and the end image, and a conformable image determining unit configured to determine a conformable combination from among the plurality of combinations based on image quality of the images included in each of the plurality of combinations and a similarity between the images included in each of the plurality of combinations.
    Type: Grant
    Filed: January 23, 2018
    Date of Patent: March 24, 2020
    Assignee: Canon Kabushiki Kaisha
    Inventor: Keita Nakagomi
  • Patent number: 10593052
    Abstract: Methods and image-guided surgical navigation systems for updating an existing landmark registration of one or more landmark features in a common coordinate space are provided. The image-guided surgical navigation system includes a processor, an imaging device coupled to the processor, and a memory coupled to the processor. The image-guided surgical navigation system may be configured to capture a planar image of a region of interest, where the planar view image includes illustration of the one or more landmark features; generate a depth map from the planar view image; based on the depth map, identify a current location of the one or more landmark features in the common coordinate space; and transform the existing landmark registration to the current location of the one or more landmark features in the common coordinate space.
    Type: Grant
    Filed: August 23, 2017
    Date of Patent: March 17, 2020
    Assignee: Synaptive Medical (Barbados) Inc.
    Inventors: Kamyar Abhari, Neil Jeffrey Witcomb, Stewart David McLachlin, Kai Michael Hynna, Gal Sela
  • Patent number: 10593013
    Abstract: An image processing apparatus obtains a first image, cuts out at least a portion of the first image to generate a second image that is distortion-corrected, receives designation of a first area in which image quality is to be different in the first image, calculates a second area in the second image, the second area corresponding to the first area designated in the first image, and sets, as an area associated with a function that influences encoding processing for encoding the second image, an area that includes the second area and is based on a processing unit of the encoding processing for encoding the second image, the processing unit being an area in the second image.
    Type: Grant
    Filed: June 15, 2018
    Date of Patent: March 17, 2020
    Assignee: Canon Kabushiki Kaisha
    Inventor: Tsuyoshi Yokomizo
  • Patent number: 10585948
    Abstract: Embodiments of the present invention disclose a method and device for constructing a spatial index of massive point cloud data. The method includes: partitioning acquired original point cloud data to obtain a plurality of point cloud data blocks; constructing an octree index of a current point cloud data block for each point cloud data block; and merging the octree indexes of the plurality of point cloud data blocks to obtain a spatial index structure of the original point cloud data.
    Type: Grant
    Filed: December 13, 2016
    Date of Patent: March 10, 2020
    Assignee: Beijing Greenvalley Technology Co., Ltd.
    Inventor: Yanming Guo
  • Patent number: 10571582
    Abstract: In a calibration routine, a first set of X-ray recordings of at least one closed first reference package without content is produced, and a mass calibration signature is derived therefrom. A second set of X-ray recordings of at least one closed second reference package having a reference content is produced, and a reference signature is derived therefrom. From the reference signature and the mass calibration signature, a reference measurement value is derived via subtraction. The reference mass of the reference content is ascertained by weighing and assigned to the reference measurement value. In ongoing measurement operation, at least one set of measuring X-ray recordings of closed foil packages each having a content is produced and a measurement signature is derived therefrom. Herefrom, and from the mass calibration signature, measurement values for the individual closed foil packages are derived via subtraction, from which the masses of the contents are quantitatively determined.
    Type: Grant
    Filed: May 3, 2018
    Date of Patent: February 25, 2020
    Assignee: Harro Hoefliger Verpackungsmaschinen GmbH
    Inventors: Karlheinz Seyfang, Martin Lober, Joachim Fahrian, Jan Rimbach
  • Patent number: 10565442
    Abstract: The present disclosure provides a picture recognition method and apparatus, a computer device and a computer-readable medium. The method comprises: obtaining a to-be-recognized picture; according to the to-be-recognized picture and a pre-trained picture recognition model, acquiring a predicted class tag of the to-be-recognized picture; the pre-trained picture recognition model employs a convolutional neural network model, and the convolutional neural network model comprises at least one layer of kernel pooling layer upgrading a dimensionality of a channel from one dimension to multiple dimensions; recognizing a class of the to-be-recognized picture according to the predicted class tag of the to-be-recognized picture. By recognizing the to-be-recognized picture by using the picture recognition model having the kernel pooling layer, the present disclosure can achieve recognition of picture classes with finer granularities and effectively improve the picture recognition accuracy and efficiency.
    Type: Grant
    Filed: March 5, 2018
    Date of Patent: February 18, 2020
    Assignee: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) CO., LTD.
    Inventors: Feng Zhou, Xiao Liu
  • Patent number: 10565463
    Abstract: A device for determining information for video data includes one or more processors implemented in circuitry that are configured to determine one or more most-interested regions of a plurality of regions of an image of video data from data representative of the one or more most-interested regions. The one or more processors are further configured to generate a request specifying the one or more most-interested regions using the data representative of the one or more most-interested regions and output the request to a server device.
    Type: Grant
    Filed: May 10, 2017
    Date of Patent: February 18, 2020
    Assignee: Qualcomm Incorporated
    Inventors: Ye-Kui Wang, Fnu Hendry
  • Patent number: 10528852
    Abstract: According to one embodiment, an information processing device includes a memory and a processor. The processor is configured to acquire an image, determine a likelihood of presence of an objected within the image, display information on a position of the object within the image based on the likelihood, identify the object within the image, and generate a recognition result based on the identified object.
    Type: Grant
    Filed: September 1, 2017
    Date of Patent: January 7, 2020
    Assignee: KABUSHIKI KAISHA TOSHIBA
    Inventors: Yojiro Tonouchi, Kazushige Ouchi, Hideo Umeki
  • Patent number: 10527846
    Abstract: Various devices, arrangements and methods for managing communications using a head mounted display device are described. In one aspect, tracking data is generated at least in part by one or more sensors in a head mounted display (HMD) device. The tracking data indicates one or more facial movements of a user wearing the HMD device. A patch image is obtained based on the tracking data. The patch image is merged with a facial image. Various embodiments relate to the HMD device and other methods for generating and using the patch and facial images.
    Type: Grant
    Filed: January 18, 2018
    Date of Patent: January 7, 2020
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Simon J. Gibbs, Anthony S. Liot, Yu Song, Yoshiya Hirase
  • Patent number: 10504008
    Abstract: A system configured to improve the operations associated with generating virtual representations of physical environments to recognize the physical environments and/or relocalize within the virtual representations in a substantially real time system. In some cases, the system may use a first pre-training phase of descriptors and/or split nodes of regression forests using features common across various scenes to learn general image appearance, and a second training phase of descriptors and/or leaf nodes of regression forests to learn scene specific features. The system may align the features using an orientation vector, correct for camera perspective and lens distortion of the features as well as learn robust illumination invariant features from real and synthetic data.
    Type: Grant
    Filed: July 18, 2017
    Date of Patent: December 10, 2019
    Assignee: Occipital, Inc.
    Inventors: Jeffrey Powers, Miguel Algaba, Nicolas Burrus
  • Patent number: 10504287
    Abstract: A redundant tracking system comprising multiple redundant tracking sub-systems, enabling seamless transitions between such tracking sub-systems, provides a solution to this problem by merging multiple tracking approaches into a single tracking system. This system is able to combine tracking objects with six degrees of freedom (6DoF) and 3DoF through combining and transitioning between multiple tracking systems based on the availability of tracking indicia tracked by the tracking systems. Thus, as the indicia tracked by any one tracking system becomes unavailable, the redundant tracking system seamlessly switches between tracking in 6DoF and 3DoF thereby providing the user with an uninterrupted experience.
    Type: Grant
    Filed: October 24, 2017
    Date of Patent: December 10, 2019
    Assignee: Snap Inc.
    Inventors: Andrew James McPhee, Samuel Edward Hare, Peicheng Yu, Robert Cornelius Murphy, Dhritiman Sagar