Patents Examined by Daniel C Chang
-
Patent number: 11663710Abstract: The image processing device includes an imaging unit that images a subject and a distance map acquisition unit that acquires information regarding a distance distribution of the subject as map data. The distance map acquisition unit acquires map data with an image deviation amount or a defocused amount related to a captured image or distance map data in conformity with a TOF scheme or an imaging plane phase difference detection scheme of using a pupil division type image sensor. An image processing unit generates data of a texture image in which a low-frequency component of a captured image is inhibited and combines the data of the texture image and the map data acquired by the distance map acquisition unit to generate image data in which a distance distribution of a subject is expressed.Type: GrantFiled: September 10, 2020Date of Patent: May 30, 2023Assignee: CANON KABUSHIKI KAISHAInventor: Masaaki Matsuoka
-
Patent number: 11657477Abstract: An image processing device, an image processing system, an imaging device, an image processing method, and a recording medium storing program code. The image processing device includes a receiver configured to receive a first image and a second image, a memory configured to store a joining position at each one of a plurality of portions between the first image and the second image received by the receiver, and circuitry configured to evaluate, for each of the plurality of portions, validity of the joining position in a past stored in the memory, and generate a composite image based on the first image and the second image received by the receiver and the joining position in the past stored in the memory on a site where the validity meets a criterion. The method includes reading a past joining position at each one of a plurality of portions between a pair of images.Type: GrantFiled: January 26, 2021Date of Patent: May 23, 2023Assignee: RICOH COMPANY, LTD.Inventors: Kazuhiro Yoshida, Takamichi Katoh, Takashi Tada, Hiroyuki Kawamoto, Makoto Usami, Kenichi Ono
-
Patent number: 11645769Abstract: A method of determining macrotexture of an object is presented which includes obtaining a plurality of stereo images from an object, generating a local coordinate system for each image, detecting one or more local keypoints each having a local coordinate, generating a global coordinate system based on a plurality of ground control points (GCPs) with apriori position knowledge of each of the plurality of GCPs, transforming the one or more local keypoints in each image to one or more global keypoints each having a global coordinate, generating a sparse point cloud based on the one or more global keypoints, reconstructing a 3D dense point cloud of the object based on neighboring pixels of each of the one or more local keypoints and calculating the global coordinates of each pixel of the 3D dense point cloud, and obtaining the macrotexture based on the reconstructed 3D dense point cloud of the object.Type: GrantFiled: March 15, 2021Date of Patent: May 9, 2023Assignee: Purdue Research FoundationInventors: Jie Shan, Xiangxi Tian
-
Patent number: 11611755Abstract: A system and methods for a CODEC driving a real-time light field display for multi-dimensional video streaming, interactive gaming and other light field display applications is provided applying a layered scene decomposition strategy. Multi-dimensional scene data is divided into a plurality of data layers of increasing depths as the distance between a given layer and the plane of the display increases. Data layers are sampled using a plenoptic sampling scheme and rendered using hybrid rendering, such as perspective and oblique rendering, to encode light fields corresponding to each data layer. The resulting compressed, (layered) core representation of the multi-dimensional scene data is produced at predictable rates, reconstructed and merged at the light field display in real-time by applying view synthesis protocols, including edge adaptive interpolation, to reconstruct pixel arrays in stages (e.g. columns then rows) from reference elemental images.Type: GrantFiled: February 25, 2021Date of Patent: March 21, 2023Assignee: Avalon Holographies Inc.Inventors: Matthew Hamilton, Chuck Rumbolt, Donovan Benoit, Matthew Troke, Robert Lockyer
-
Patent number: 11593917Abstract: A method for creating a high-resolution image of an object from low-resolution images of the object is provided. Both the low-resolution images and the high-resolution image are composed of a pixel grid. An image recording device successively records low-resolution images, in which pitches of the grid points of the pixel grid are increased in one image dimension in comparison with the pitches of the grid points of the pixel grid in the high-resolution image to be created. A data processing system registers the low-resolution images with respect to one another to obtain registered images which are superimposed to obtain the high-resolution image. The grid points of the low-resolution images and the grid points of the high-resolution image have same dimensions and the data processing system uses image information obtained from different positions of the object relative to the grid points in the individual low-resolution images to create the high-resolution images.Type: GrantFiled: November 28, 2020Date of Patent: February 28, 2023Assignee: Carl Zeiss Meditec AGInventors: Patrick Hoyer, Stefan Saur, Gerald Panitz
-
Patent number: 11587237Abstract: A system for controlling a physical system via segmentation of an image includes a controller. The controller may be configured to receive an image of n pixels from a first sensor, and an annotation of the image from a second sensor, form a coupling matrix, k class vectors each of length n, and a bias coefficient based on the image and the annotation, generate n pixel vectors each of length n based on the coupling matrix, class vectors, and bias coefficient create a single segmentation vector of length n from the pixel vectors wherein each entry in the segmentation vector identifies one of the k class vectors, output the single segmentation vector; and operate the physical system based on the single segmentation vector.Type: GrantFiled: November 30, 2020Date of Patent: February 21, 2023Inventors: Devin T. Willmott, Chirag Pabbaraju, Po-Wei Wang, Jeremy Kolter
-
Patent number: 11568659Abstract: A character recognizing apparatus includes an acquiring unit, an identifying unit, and a character recognizing unit. The acquiring unit acquires a string image that is an image of a string generated in accordance with one of multiple string generation schemes. The identifying unit identifies a range specified for a result of character recognition in each of the multiple string generation schemes. The character recognizing unit performs first character recognition on the string image, and if a result of the first character recognition has a feature of a particular string generation scheme of the multiple string generation schemes, the character recognizing unit performs second character recognition on the string image within the range specified for a result of character recognition in the particular string generation scheme.Type: GrantFiled: August 30, 2019Date of Patent: January 31, 2023Assignee: FUJIFILM Business Innovation Corp.Inventor: Yusuke Suzuki
-
Patent number: 11566750Abstract: An apparatus and method for executing a safety function is particularly applicable to monitoring a safety area of a technical installation. An imaging unit acquires an event that triggers the safety function within a defined working area. A controller carries out a safety-related reaction depending on the triggering event. A test unit is configured to verify the operability of the imaging unit and includes a processing unit and a projection unit. The projection unit projects a pattern with defined properties into the working area. The processing unit evaluates the image data acquired by the imaging unit to detect the projected pattern within the acquired image data. Further, the processing unit extracts the specific properties of the detected projected pattern, and compares the specific properties of the detected projected pattern with the defined properties.Type: GrantFiled: September 3, 2020Date of Patent: January 31, 2023Assignee: Pilz GmbH & Co. KGInventors: Daniel Bakovic, Juergen Pullmann, Bernd Neuschwander
-
Patent number: 11550395Abstract: Described is a method for instilling the haptic dimension of texture to virtual and holographic objects using mid-air ultrasonic technology. A set of features is extracted from imported images using their associated displacement maps. Textural qualities such as the micro and macro roughness are then computed and fed to a haptic mapping function together with information about the dynamic motion of the user's hands during holographic touch. Mid-air haptic textures are then synthesized and projected onto the user's bare hands. Further, mid-air haptic technology enables tactile exploration of virtual objects in digital environments. When a user's prior and current expectations and rendered tactile texture differ, user immersion can break. A study aims at mitigating this by integrating user expectations into the rendering algorithm of mid-air haptic textures and establishes a relationship between visual and mid-air haptic roughness.Type: GrantFiled: January 6, 2020Date of Patent: January 10, 2023Assignee: ULTRAHAPTICS IP LTDInventors: David Beattie, Rory Clark, Adam Harwood, Orestis Georgiou, Benjamin John Oliver Long, Thomas Andrew Carter
-
Patent number: 11538175Abstract: The present disclosure relates to a method and an apparatus for detecting a subject, an electronic device, and a computer readable storage medium. The method includes the following. A current image and a previous image are obtained. A transformation matrix between the current image and the previous image is obtained in response to determining that the current image indicates the shaking state. The previous image is corrected based on the transformation matrix. The subject detection model is updated based on the corrected previous image. The subject detection is performed on the current image based on the updated subject detection model, to obtain a target subject.Type: GrantFiled: June 29, 2020Date of Patent: December 27, 2022Assignee: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.Inventor: Yuhu Jia
-
Patent number: 11538190Abstract: An image analyzing method of increasing analysis accuracy is applied to an image monitoring apparatus with a processor. The image analyzing method is executed by the first processor and includes receiving statistic data of an external electronic unit, transforming the statistic data into feedback data via specific algorithm, and generating a control parameter according to the feedback data. The control parameter is used to optimize image data output by the image monitoring apparatus.Type: GrantFiled: November 16, 2020Date of Patent: December 27, 2022Assignee: VIVOTEK INC.Inventor: Jen-Chih Wu
-
Patent number: 11532070Abstract: A set of input images from satellites (or other remote sensors) can be orthorectified and stitched together to create a mosaic. If the resulting mosaic is not of suitable quality, the input images can be adjusted and the processes of orthorectifying and creating the mosaic can be repeated. However, orthorectifying and creating the mosaic uses a large amount of computational resources and takes a lot of time. Therefore, performing numerous iterations is expensive and sometimes not practical. To overcome these issues, it is proposed to generate an indication of accuracy of the resulting mosaic prior to orthorectifying and creating the mosaic by accessing a set of points in the plurality of input images, projecting the points to a model, determining residuals for the projected points, and generating the indication of accuracy of the orthorectified mosaic based on the determined residuals.Type: GrantFiled: February 2, 2021Date of Patent: December 20, 2022Assignee: Maxar Intelligence Inc.Inventors: Steven F. Hartung, Wolfgang Schickler, Nathan Swanson, Laurence C. Bleiler
-
Patent number: 11514377Abstract: The present invention discloses a space allocation system and a method for allocating space to objects with multi-variate characteristics. In the present invention, intra-container allocation and/or inter-container allocation is performed to generate a combination in which the objects can be placed in one or more pre-defined storage spaces in a plurality of storage containers. The generated combination is further optimized for efficient space allocation to objects with multi-variate characteristics.Type: GrantFiled: September 9, 2019Date of Patent: November 29, 2022Assignee: Amadeus S.A.S.Inventors: Eldho Abraham, Suresh Yerva
-
Patent number: 11508044Abstract: A method for translating an image, a method for training an image translation model, and related electronic devices are proposed. In the method for translating an image, an image translation request carrying an original image is obtained. A down-sampled image is generated by down sampling the original image. A pre-translated image, a mask image, and deformation parameters are generated based on the down-sampled image. A size of the pre-translated image and a size of the mask image are the same as a size of the original image. A deformed image is obtained by deforming original image based on the deformation parameters. The deformed image, the pre-translated image and the mask image are fused to generate a target translation image.Type: GrantFiled: December 9, 2020Date of Patent: November 22, 2022Assignee: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.Inventors: Shaoxiong Yang, Chen Zhao
-
Patent number: 11508077Abstract: A processor-implemented method of detecting a moving object includes: estimating a depth image of a current frame; determining an occlusion image of the current frame by calculating a depth difference value between the estimated depth image of the current frame and an estimated depth image of a previous frame; determining an occlusion accumulation image of the current frame by adding a depth difference value of the occlusion image of the current frame to a depth difference accumulation value of an occlusion accumulation image of the previous frame; and outputting an area of a moving object based on the occlusion accumulation image.Type: GrantFiled: February 4, 2021Date of Patent: November 22, 2022Assignees: Samsung Electronics Co., Ltd., SNU R&DB FOUNDATIONInventors: Hyoun Jin Kim, Haram Kim
-
Patent number: 11501465Abstract: Systems and methods for macro stereo time-lapse photography, producing a stereographic time-lapse digital video, and macro stereographic time-lapse digital videos. A method of producing a sequence of time-lapse stereographic images of a subject, by positioning a camera with a macro lens at a first position relative to the subject; using the camera to obtain a first stack of images of the subject from the first position; positioning the camera at a second position relative to the subject; using the camera to obtain a second stack of images of the subject from the second position; and storing the first stack of images and the second stack of images as a stack pair; and then selectively repeating.Type: GrantFiled: May 3, 2019Date of Patent: November 15, 2022Assignee: WITHIN UNLIMITED, INC.Inventor: Aaron Koblin
-
Patent number: 11481877Abstract: In one embodiment, a method includes accessing first-resolution images corresponding to frames of a video, computing a motion vector based on a first-resolution image of a first frame in the video and a first-resolution image of a second frame in the video, generating a second-resolution warped image associated with the second frame by using the motion vector to warp a second-resolution reconstructed image associated with the first frame, generating a second-resolution intermediate image associated with the second frame based on the first-resolution image associated with the second frame, computing adjustment parameters by processing the first-resolution image associated with the second frame and the second-resolution warped image associated with the second frame using a machine-learning model, and adjusting pixels of the second-resolution intermediate image associated with the second frame based on the adjustment parameters to reconstruct a second-resolution reconstructed image associated with the second fraType: GrantFiled: June 16, 2020Date of Patent: October 25, 2022Assignee: Meta Platforms Technologies, LLCInventors: Mikhail Okunev, Anton S. Kaplanyan
-
Patent number: 11450013Abstract: A method for acquiring a sample image set, includes: acquiring a plurality of frame images continuously shot for a shooting scene; determining, as a reference image, one frame of a plurality of frame images, and determining, as non-reference images, remaining ones of the plurality of frame images other than the one determined as the reference image; performing a format conversion on the reference image and the non-reference images to obtain a format-converted reference image and format-converted non-reference images, and performing a noise addition processing on the format-converted reference image and each non-reference image respectively; aligning each noise-added non-reference image with a noise-added reference image to obtain an aligned non-reference image; annotating the format-converted reference image with pixel information to obtain a non-noise-added reference image; and acquiring the sample image set, the sample image set including the aligned non-reference image, the noise-added reference image, andType: GrantFiled: July 16, 2020Date of Patent: September 20, 2022Assignee: Beijing Xiaomi Pinecone Electronics Co., Ltd.Inventors: Weihang Yuan, Jin Wang, Taolue Feng
-
Patent number: 11443410Abstract: An image processing method includes a matching cost calculating process of calculating matching costs in a unit of sub-pixels having higher resolution than first and second images by using an image of a reference area contained in the first image in which a target object is imaged and images of a plurality of comparison areas contained in the second image in which the target object is imaged, and a synthesized cost calculating process of calculating synthesized costs related to the reference area based on comparison results of values related to the plurality of matching costs calculated in the matching cost calculating process.Type: GrantFiled: October 2, 2020Date of Patent: September 13, 2022Assignee: CANON KABUSHIKI KAISHAInventors: Hiroto Mizohana, Keita Dan
-
Patent number: 11436709Abstract: The disclosure provides a 3-dimensional reconstruction method, an electronic device and a storage medium. The method includes: obtaining an image sequence pre-collected by a camera; obtaining nominal intrinsic parameters of the camera, and preset initial values of distortion coefficients of the camera, the camera being a camera for collecting the image sequence; calculating fluctuation ranges of the distortion coefficients; performing the 3D reconstruction on the image sequence based on the nominal intrinsic parameters, the initial values of the distortion coefficients, and the fluctuation ranges of the distortion coefficients; and during the 3D reconstruction, optimizing an obtained visual point cloud and a camera pose.Type: GrantFiled: October 28, 2020Date of Patent: September 6, 2022Assignee: APOLLO INTELLIGENT DRIVING TECHNOLOGY (BEIJING) CO., LTD.Inventors: Yuzhan Cai, Chao Zheng, Chao Yan, Hantian Zhang