Picture Signal Generator Patents (Class 348/46)
  • Patent number: 11144119
    Abstract: A system and methods for the enhancement of a user's vision using a head-mounted and user-controllable device including a magnification bubble having variable attributes wherein a portion of the scene is magnified within the complete scene, wherein the user is able to modify, in real-time, how the images are processed including the attributes of the magnification bubble.
    Type: Grant
    Filed: June 20, 2019
    Date of Patent: October 12, 2021
    Assignee: Irisvision, Inc.
    Inventors: Frank S. Werblin, Robert Massof, Yuval S. Boger
  • Patent number: 11146747
    Abstract: An apparatus including a rolling shutter image sensor, a structured light projector and a processor. The rolling shutter image sensor may be configured to capture images. The structured light projector may be configured to generate a structured light pattern. The processor may be configured to receive the images from said rolling shutter image sensor, perform computer vision operations on the images to detect an object in the images, determine a start line location and an end line location corresponding to the object detected and present a control signal to the structured light projector. The control signal may be configured to activate the structured light pattern when the rolling shutter image sensor is at the start line location and deactivate the structured light pattern when the rolling shutter image sensor is at the end line location.
    Type: Grant
    Filed: October 12, 2020
    Date of Patent: October 12, 2021
    Assignee: Ambarella International LP
    Inventor: Zhe Zhang
  • Patent number: 11145085
    Abstract: A system and method for automating installation of prefabricated parts at a construction site includes retrieving an installation plan for a room in which a plurality of parts are installed. The method also includes determining an orientation of the room based on one or more images captured for the room and scanning a first visual indicator on a first part from the plurality of parts, the visual indicator indicating a first order position in the installation order. The method includes determining a first installation location in the room based on the first order position and the installation plan. The method also includes displaying an installation graphic at the first installation location in the room, the installation graphic illustrating a spatial position and an alignment for the first part.
    Type: Grant
    Filed: December 13, 2019
    Date of Patent: October 12, 2021
    Assignee: Social Construct Company
    Inventor: Dae Young Huh
  • Patent number: 11140325
    Abstract: Various embodiments of the present invention comprise: a first image sensor for acquiring a first image of an external object; a second image sensor for acquiring a second image of the external object; and a processor, wherein the processor is set so as to: acquire, through the first image sensor, the first image by using a first setting related to an exposure for the external object; acquire, through the second image sensor, the second image by using a second setting related to the exposure, during the operation of acquiring the first image; select one corresponding setting from among the first setting and the second setting on the basis of at least the first image or the second image; and acquire, through the first image sensor or the second image sensor, a third image of the external object on the basis of at least the one corresponding setting, thereby enabling an entry time of a dual camera mounted on a rear surface of an electronic device to be reduced.
    Type: Grant
    Filed: November 28, 2017
    Date of Patent: October 5, 2021
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Jonghyub Lee, Haesun Lee, Sugon Baek, Jongkeun Shin, Jonghun Won, Kihuk Lee
  • Patent number: 11138756
    Abstract: A 3D object detection method includes: obtaining two-dimensional (2D) coordinates of at least one predetermined key point of a target object in an image to be processed; constructing a pseudo 3D detection body of the target object in a 2D space according to the 2D coordinates of the at least one predetermined key point; obtaining depth information of a plurality of vertices of the pseudo 3D detection body; and determining a 3D detection body of the target object in a 3D space according to the depth information of the plurality of vertices of the pseudo 3D detection body.
    Type: Grant
    Filed: April 1, 2020
    Date of Patent: October 5, 2021
    Assignees: SENSETIME GROUP LIMITED, HONDA MOTOR CO. LTD.
    Inventors: Yingjie Cai, Shinan Liu, Xingyu Zeng, Junjie Yan, Xiaogang Wang, Atsushi Kawamura, Yuji Yasui, Tokitomo Ariyoshi, Yuji Kaneda, Yuhi Goto
  • Patent number: 11132805
    Abstract: A depth measurement assembly (DMA) includes an illumination source that projects pulses of light (e.g., structured light) at a temporal pulsing frequency into a local area. The DMA includes a sensor that capture images of the pulses of light reflected from the local area and determines, using one or more of the captured images, one or more TOF phase shifts for the pulses of light. The DMA includes a controller coupled to the sensor and configured to determine a first set of estimated radial distances to an object in the local area based on the one or more TOF phase shifts. The controller determines a second estimated radial distance to the object based on an encoding of structured light and at least one of the captured images. The controller selects an estimated radial distance from the first set of radial distances.
    Type: Grant
    Filed: December 1, 2020
    Date of Patent: September 28, 2021
    Assignee: Facebook Technologies, LLC
    Inventor: Michael Hall
  • Patent number: 11127159
    Abstract: Various embodiments for system and method of adaptive lighting for data-driven non-line-of-sight imaging are disclosed.
    Type: Grant
    Filed: January 8, 2020
    Date of Patent: September 21, 2021
    Assignee: Arizona Board of Regents on Behalf of Arizona State University
    Inventors: Sreenithy Chandran, Suren Jayasuriya
  • Patent number: 11123876
    Abstract: A method for remote operation of a robot, preferably including: recording a set of sensor streams; transmitting a transmission stream; selecting a received stream for display; and/or displaying the selected stream. A system, preferably including a robot and a remote operation system connected to the robot by one or more communication networks.
    Type: Grant
    Filed: June 15, 2020
    Date of Patent: September 21, 2021
    Assignee: Caterpillar Inc.
    Inventors: Kevin Peterson, Matt Delaney, Zachary Witte, Jason Calaiaro
  • Patent number: 11120558
    Abstract: A human detection system 18 includes: a camera 19 that acquires detection image data Dd of a detection region D, the detection region D being a prescribed region including a portion of a crane 1; a deviation determination unit 21c in which image data of the crane 1 included in the detection image data Dd acquired by the camera 19 in a state of being disposed at a reference position is set as reference image data Sd of the detection region D, and in which the detection image data Dd of the detection region D acquired at an arbitrary time by the camera 19 is compared to the reference image data Sd to determine whether the position of the camera 19 has deviated from the reference position; and a reporting unit 21d that reports that the position of the camera 19 has deviated.
    Type: Grant
    Filed: March 9, 2018
    Date of Patent: September 14, 2021
    Assignee: TADANO LTD.
    Inventors: Iwao Ishikawa, Tomohiro Toyosaki, Masafumi Takahashi
  • Patent number: 11115636
    Abstract: Disclosed are an image processing apparatus including a deserializer receiving respective Bayer image information pieces acquired from a plurality of cameras; and an image processor processing Bayer data processed and output by the deserializer to produce one stitched image from a plurality of Bayer images acquired from the plurality of cameras, wherein the one stitched image is output.
    Type: Grant
    Filed: July 14, 2017
    Date of Patent: September 7, 2021
    Assignee: LG INNOTEK CO., LTD.
    Inventors: Sung Hyun Lim, Je Yong Shin
  • Patent number: 11108957
    Abstract: An imaging system includes a sensor array of differential pixels. A controller operates a first differential pixel of the sensor array in a first, lower power mode. The controller supplies a first clock signal to selectively activate a first collection terminal of the first differential pixel for a first duration, and a second clock signal to selectively activate a second collection terminal of the first differential pixel for a second duration. In an analog domain, a first amount of charge accumulated at the first collection terminal over the first duration is readout and compared to a readout of a second amount of charge accumulated at the second collection terminal over the second duration. Responsive to the first amount of charge being different from the second amount of charge by more than a threshold, the first differential pixel of the sensor array is operated in a second, higher power mode.
    Type: Grant
    Filed: June 17, 2020
    Date of Patent: August 31, 2021
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Minseok Oh, Cyrus Soli Bamji, Swati Mehta, Barry Thompson, Andrew Dean Payne
  • Patent number: 11100671
    Abstract: An image generation apparatus includes an image acquisition part that acquires a wide angle image group and a telephoto image group in which a subject is imaged while changing a position of an imaging apparatus, the wide angle image group being captured by the imaging apparatus including an imaging optical system including a wide angle optical system and a telephoto optical system having a common optical axis, and the telephoto image group being captured at the same time as the wide angle image group; a composition information acquisition part that analyzes the acquired wide angle image group and acquires composition information to be used for compositing the telephoto image group; and a composite image generation part that generates an image in which the telephoto image group is composited, information related to focal lengths of the wide angle optical system and the telephoto optical system, and the telephoto image group.
    Type: Grant
    Filed: October 16, 2019
    Date of Patent: August 24, 2021
    Assignee: FUJIFILM Corporation
    Inventor: Shuji Ono
  • Patent number: 11100830
    Abstract: A patch scanning display apparatus and a technique for reconstructing a target image frame on a projection surface is disclosed. The patch scanning display apparatus includes a backlight and a spatial light modulator (SLM). An optical scanning device scans the image projected by the SLM across the projection surface in accordance with a scan trajectory. A decomposition model is used to generate a set of image patches based on the target image frame and the scan trajectory. In an embodiment, the decomposition model is a projective non-negative matrix factorization model. The set of image patches are utilized to generate a modulation signal for the SLM and a binary backlight signal is then generated for each time step of the scan trajectory within a frame period to activate or deactivate the light-emitting elements of the backlight during the frame period at a high refresh rate while the projected image is scanned.
    Type: Grant
    Filed: January 13, 2020
    Date of Patent: August 24, 2021
    Assignee: NVIDIA Corporation
    Inventor: Kaan Aksit
  • Patent number: 11092489
    Abstract: A system for computational imaging spectroscopy to provide compact and lightweight design, as well as large field of view of an object to be captured. The system includes imaging components, and computational device. The imaging components includes lens assembly, a fixed or variable-diameter aperture, spectral filter array and imaging sensor. The lens assembly provides wide angle of view, image-side telecentricity, and further may correct for longitudinal chromatic aberrations. The lens assembly may not provide correction of lateral chromatic aberrations. Furthermore, the lens assembly provides image-space telecentricity so as to chief rays are incident perpendicular to image sensor. The lens assembly may produce different chromatic aberrations pattern for each wavelength within the spectral range of interest.
    Type: Grant
    Filed: January 31, 2018
    Date of Patent: August 17, 2021
    Assignee: GAMAYA SA
    Inventors: Yosef Akhtman, Christophe Galland
  • Patent number: 11095866
    Abstract: A 3D image sensing system includes: a 3D image sensor (100), including: a light-emitting module (102), configured to emit a structured light to a target (300), the structured light has a known pattern; and a light-sensing module (104) receives a reflected structured light of the structured light that is reflected by the target; and a processor (110), configured to perform a time-of-flight distance measurement to obtain a first distance corresponding to the target based on time-of-flights of the structured light and the reflected structured light, the first distance has a global offset, the processor (110) establishes an unknown distance image based on the reflected structured light, estimates a disparity between the unknown distance image and a known distance image according to the known pattern, calculates a global compensation coefficient based on the disparity, and compensates the first distance to eliminate the global offset according to the global compensation coefficient.
    Type: Grant
    Filed: November 18, 2020
    Date of Patent: August 17, 2021
    Assignee: SHENZHEN GOODIX TECHNOLOGY CO., LTD.
    Inventors: Hao-Jen Wang, Chung-Te Li
  • Patent number: 11093103
    Abstract: Disclosed herein are system, method, and computer program product embodiments for generating collaborating AR workspaces. An embodiment operates by identifying a first user that is participating in an augment reality (AR) meeting space from a first location. A second user participating in the AR meeting space from a second location is identified. A selection of a room configuration for the AR meeting space based on at least one of the first location or the second location is received. The digital canvas is configured in the AR meeting space for at least one of the first user or the second user based on the selected room configuration, wherein a size or shape of the digital canvas is adjusted based on either the first wall or the second wall corresponding to the selected room configuration.
    Type: Grant
    Filed: April 3, 2019
    Date of Patent: August 17, 2021
    Assignee: SPATIAL SYSTEMS INC.
    Inventors: Anand Agarawala, Jinha Lee, Peter Ng, Roman Revzin, Waldo Bronchart, Donghyeon Kim
  • Patent number: 11079842
    Abstract: The system for image stream switching may include a processor, a display, and a storage. The system storage includes instructions that when executed on the processor, cause the processor to provide, to the display, a first image stream from a data comprising multiple simultaneous image streams comprising the first image stream and a second image stream, the first image stream comprising a first setting, the second image stream comprising a second setting distinct from the first setting. The example system includes a storage with instructions that when executed detect a signal to switch from the first setting to a third setting that is numerically between the first setting and the second setting. The example system includes a storage with instructions that when executed provide, to the display, a third stream generated from alternating frames from the first stream and the second stream.
    Type: Grant
    Filed: May 22, 2020
    Date of Patent: August 3, 2021
    Assignee: INTEL CORPORATION
    Inventors: Ramon C. Cancel Olmo, Dong Yeung Kwak
  • Patent number: 11079598
    Abstract: In some embodiments, a system comprises a head-mounted frame removably coupleable to the user's head; one or more light sources coupled to the head-mounted frame and configured to emit light with at least two different wavelengths toward a target object in an irradiation field of view of the light sources; one or more electromagnetic radiation detectors coupled to the head-mounted member and configured to receive light reflected after encountering the target object; and a controller operatively coupled to the one or more light sources and detectors and configured to determine and display an output indicating the identity or property of the target object as determined by the light properties measured by the detectors in relation to the light properties emitted by the light sources.
    Type: Grant
    Filed: January 28, 2020
    Date of Patent: August 3, 2021
    Assignee: Magic Leap, Inc.
    Inventors: Nicole Elizabeth Samec, Nastasja U. Robaina, Adrian Kaehler, Mark Baerenrodt, Eric Baerenrodt, Christopher M. Harrises, Tammy Sherri Powers
  • Patent number: 11074445
    Abstract: A remote sensing image recognition method, apparatus and device, a storage medium and a computer program. The remote sensing image recognition method comprises: performing resolution reduction processing on a remote sensing image to be recognized to obtain a resolution reduction processed remote sensing image (S100); segmenting at least one remote sensing image block from the resolution reduction processed remote sensing image (S110); determining, from the at least one remote sensing image block, a remote sensing image block to be processed (S120); inputting, into a neural network, the remote sensing image block to be processed, and obtaining, through the neural network, classification probability information of pixels in the input remote sensing image block to be processed (S130); and determining a recognition result of the remote sensing image to be recognized, according to the classification probability information of the pixels in the remote sensing image block to be processed (S140).
    Type: Grant
    Filed: June 23, 2020
    Date of Patent: July 27, 2021
    Assignee: BEIJING SENSETIME TECHNOLOGY DEVELOPMENT CO., LTD.
    Inventor: Cong Li
  • Patent number: 11067669
    Abstract: Embodiments of the present disclosure can include a method and apparatus for adjusting a point cloud data acquisition trajectory, and a computer readable medium. According to the embodiments of the present disclosure, a trajectory may be adjusted based on a characteristic extracted from point cloud data. A parameter that needs to be adjusted may be selected according to the property of the characteristic, instead of adjusting all parameters at the same time. In addition, according to the embodiments of the present disclosure, when trajectories are fused, the sequence relationships between the trajectory points in the trajectories can be considered, which avoids that a loop cannot be closed.
    Type: Grant
    Filed: December 26, 2018
    Date of Patent: July 20, 2021
    Assignee: Baidu Online Network Technology (Beijing) Co., Ltd.
    Inventors: Miao Yan, Yifei Zhan, Xianpeng Lang, Wang Zhou, Xiong Duan, Changjie Ma
  • Patent number: 11062485
    Abstract: Disclosed are a method and an apparatus for providing a representative image of content in a content view displayed by an electronic device. The electronic device includes: a display device configured to display a content view; and a processor, wherein the processor is configured to acquire item information related to items in a content view in response to detection of a request for executing the content view, divide the items into a reference item and a target item in the content view based on the acquired item information, acquire representative information based on the reference item, and configure a color-based representative image of the target item based at least partially on the acquired representative information. Various embodiments are possible.
    Type: Grant
    Filed: August 28, 2018
    Date of Patent: July 13, 2021
    Assignee: Samsung Electronics Co., Ltd.
    Inventor: Jaein Kim
  • Patent number: 11057595
    Abstract: Described examples include an optical device having a first light source configured to provide a first light having a first characteristic. The optical device also has a second light source configured to provide a second light having a second characteristic. The optical device also has a combiner configured to combine the first light and the second light to provide a combined light. The optical device also has a spatial light modulator configured to modulate the combined light to provide modulated combined light. The optical device also has a divider configured to receive the modulated combined light and to direct a first portion of the modulated combined light having the first characteristic to a first target and to direct a second portion of the modulated combined light having the second characteristic to a second target.
    Type: Grant
    Filed: October 11, 2019
    Date of Patent: July 6, 2021
    Assignee: TEXAS INSTRUMENTS INCORPORATED
    Inventors: Ganapathy Sivakumar, Zhongyan Sheng, Terry Alan Bartlett, John Marshall Ferri
  • Patent number: 11047673
    Abstract: A method, device, apparatus and a computer-readable storage medium for detecting a height of an obstacle are provided. The method can include: acquiring observation data of a plurality of reference obstacles from a frame; for each reference obstacle, determining a first evaluation value of the height of the obstacle to be detected, according to the observation data of the reference obstacle, an observed height of the obstacle to be detected in a frame, an actual height of the reference obstacle, and a distance between a bottom of the obstacle to be detected in the frame and an optical axis of a camera capturing the frame; and determining a second evaluation value of the height of the obstacle to be detected by using a plurality of first evaluation values for the plurality of reference obstacles.
    Type: Grant
    Filed: July 16, 2019
    Date of Patent: June 29, 2021
    Assignee: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) CO., LTD
    Inventors: Han Gao, Xun Sun, Tian Xia
  • Patent number: 11049270
    Abstract: A method of calculating a depth map includes dividing an input image into segments, calculating reliabilities of the segments, selecting at least one of the segments based on the reliabilities, estimating pose information of a camera with respect to the input image using the selected segment, and calculating a depth map of the input image based on the pose information of the camera.
    Type: Grant
    Filed: January 23, 2018
    Date of Patent: June 29, 2021
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Hwiryong Jung, Sunghoon Hong, Chul Woo Kang
  • Patent number: 11044460
    Abstract: A three-dimensional object imager uses infrared light at different wavelengths to triangulate depth information of the object from wavelength-dependent detection of the infrared image of the object. The depth information is obtained by determining wavelength of infrared light impinging on different pixels of the array. The wavelength may be determined by breaking each pixel into a plurality of sub-pixels, each sub-pixel having its own spectral selectivity to light at different infrared wavelength. For eye imaging or eye tracking applications, this enables the preservation of an unobstructed field of view of the eye while obtaining real-time, dynamic information about eye position and orientation in an non-intrusive, inconspicuous manner.
    Type: Grant
    Filed: May 1, 2019
    Date of Patent: June 22, 2021
    Assignee: FACEBOOK TECHNOLOGIES, LLC
    Inventors: Babak Amirsolaimani, Mohamed Tarek El-Haddad
  • Patent number: 11039062
    Abstract: The present invention relates to an electronic device, and a method for processing an image according to a camera photographing environment and scene by using the same, and the electronic device according to various embodiments of the present invention comprises a camera module, a memory, and a processor electrically connected to the camera module and the memory, wherein the processor can be configured to: extract a first parameter for first image data obtained using the camera module; detect situation information on the electronic device by using a sensor or a microphone functionally connected to the electronic device; detect a scene, corresponding to the first image data, among a plurality of predefined scenes; obtain a second parameter on the basis of the first parameter, the situation information, and the scene; generate, on the basis of the second parameter, second image data obtained using the camera module; and display the second image data by using a display functionally connected to the electronic de
    Type: Grant
    Filed: March 23, 2018
    Date of Patent: June 15, 2021
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Wooyong Lee, Inpyo Lee, Byunghyun Min, Jeongyong Park, Hyoungjin Yoo, Gyubong Lee, Jonghoon Won
  • Patent number: 11037362
    Abstract: A method and an apparatus for generating a three-dimension (3D) virtual viewpoint image including: segmenting a first image into a plurality of images indicating different layers based on depth information of the first image at a gaze point of a user; and inpainting an area occluded by foreground in the plurality of images based on depth information of a reference viewpoint image are provided.
    Type: Grant
    Filed: June 26, 2020
    Date of Patent: June 15, 2021
    Assignee: Electronics and Telecommunications Research Institute
    Inventors: Hong-Chang Shin, Gwang Soon Lee, Jun Young Jeong
  • Patent number: 11030455
    Abstract: The present disclosure belongs to the field of 3D gaze point recognition and computer vision, and more particularly discloses a pose recognition method, device and system for an object of interest to human eyes, which respectively identifies centers of left and right pupils of a user by using a left eye camera and a right eye camera on an eye tracker to extract information of the user's eyes; maps the obtained centers of the left and right pupils to a left scene camera to obtain a 2D gaze point; extracts bounding boxes of objects in the left scene camera by using target recognition and tracking algorithms, and then determines an object of interest to the user according to a positional relationship between the 2D gaze point and the bounding boxes of the objects; performs 3D reconstruction and pose estimation of the object of interest to the user to obtain a pose of the object of interest in the left scene camera; and converts the pose of the object of interest in the left scene camera to a pose in the world co
    Type: Grant
    Filed: May 14, 2019
    Date of Patent: June 8, 2021
    Assignee: HUAZHONG UNIVERSITY OF SCIENCE AND TECHNOLOGY
    Inventors: Caihua Xiong, Shikai Qiu, Quanlin Li
  • Patent number: 11024265
    Abstract: An image processing apparatus is described comprising a first acquisition unit configured to acquire image data from an image capturing apparatus and a second acquisition unit configured to acquire display installation information indicating a configuration of one or more display screens in a display installation to be simulated. A generation unit is provided to generate, based on the display installation information and the acquired image data, a simulation image that simulates display of the image on the display installation. A display control unit is provided to display the simulation image on a display device.
    Type: Grant
    Filed: July 1, 2019
    Date of Patent: June 1, 2021
    Assignee: Canon Kabushiki Kaisha
    Inventor: Masatoshi Ishii
  • Patent number: 11024264
    Abstract: The disclosure relates to a method and an apparatus for controlling a field of view of an augmented reality (AR) device. The method includes receiving, by an AR device, an instruction for starting a target application; determining, by the AR device, a preset field of view corresponding to the target application in response to receiving the instruction for starting the target application; and adjusting, by the AR device, a current field of view based on the preset field of view.
    Type: Grant
    Filed: October 22, 2018
    Date of Patent: June 1, 2021
    Assignee: Beijing Xiaomi Mobile Software Co., Ltd.
    Inventor: Xingsheng Lin
  • Patent number: 11019249
    Abstract: A 3D distance sensor projects a plurality of points of light onto a target. A 2D camera having a fixed position relative to the 3D distance sensor acquires a first image of the points on the target. A light receiving system of the 3D distance sensor acquires a second image of the points on the target. A set of 2D coordinates of a first point is associated with a distance coordinate of the first point to form a single set of coordinates for the first point. The set of 2D coordinates is obtained from the first image, and the distance coordinate is obtained from the second image. A relational expression is derived from the single set of coordinates and describes a relationship between a distance of the light receiving system to the target and a position of the first point on an image sensor of the 2D camera.
    Type: Grant
    Filed: May 7, 2020
    Date of Patent: May 25, 2021
    Assignee: Magik Eye Inc.
    Inventor: Akiteru Kimura
  • Patent number: 11010908
    Abstract: An apparatus comprises a component aligner having a base, a top opposite the base, and a body. The body includes one or more exterior wall surfaces extending from the base to the top. The body includes a first bore configured for fixed placement of a first component. The first bore extends between and through both the top and the base, and is defined at least in part by a first interior wall surface of the body. The body includes a second bore configured for fixed placement of a second component. The second bore extends between and through both the top and the base, and is defined at least in part by a second interior wall surface of the body. The component aligner also includes a first slot within the body. The first slot is open at the first interior wall surface and at the top.
    Type: Grant
    Filed: July 1, 2019
    Date of Patent: May 18, 2021
    Assignee: Snap-on Incorporated
    Inventors: Timothy G. Ruther, Gary F. Stefanik, Robert Hoevenaar
  • Patent number: 11010901
    Abstract: A captured image acquisition section 50 acquires, from an imaging apparatus 12, data of a polarized image obtained by capturing a target object and stores the data into an image data storage section 52. A normal line distribution acquisition section 362 of a region segmentation section 310 acquires a distribution of normal line vectors of a subject surface using the polarized image. A region decision section 312 evaluates the distribution of normal line vectors with a predetermined criterion indicating stability such as a dispersion and determines a region in which the stability is high as a region of a figure of a subject to segment the image. An output data generation section 56 carries out various processes using a result of the segmentation to generate output data.
    Type: Grant
    Filed: August 31, 2017
    Date of Patent: May 18, 2021
    Assignee: SONY INTERACTIVE ENTERTAINMENT INC.
    Inventors: Akio Ohba, Hidehiko Ogasawara, Hiroyuki Segawa
  • Patent number: 11004223
    Abstract: A device for obtaining an image includes a projector configured to project light having a preset pattern to an object, a first camera configured to sense light reflected and fed back by the object to obtain a depth image, a second camera configured to obtain a color image of the object, a motion sensor configured to sense a motion of the device. The device also includes and a processor configured to obtain a color image and a plurality of depth images of the object, by changing a parameter about the projected light and the light sensed by the first camera. When the motion of the device is less than a threshold, the processor is configured to merge pieces of depth information respectively obtained from the plurality of depth images with each other, and obtain a 3D image of the object, based on the merged depth information and the color image.
    Type: Grant
    Filed: July 14, 2017
    Date of Patent: May 11, 2021
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Antoni Jakubiak, Marcin Bogucki, Michal Szolucha, Michal Wengierow, Pawel Kies
  • Patent number: 11006051
    Abstract: A display device is capable of switching between image sources and includes a first transmission interface, a second transmission interface, a first peripheral interface, a system on chip (SOC) and a display panel. The first transmission interface is configured to be coupled to a first electronic device and receive a first image signal from the first electronic device. The second transmission interface is configured to be coupled to a second electronic device and receive a second image signal from the second electronic device. The first peripheral interface is configured to be coupled to a first peripheral device providing input information. The SOC selects at least one of the first and second image signals according to the input information to generate a display signal. The display panel displays an image according to the display signal.
    Type: Grant
    Filed: August 21, 2020
    Date of Patent: May 11, 2021
    Assignee: GIGA-BYTE TECHNOLOGY CO., LTD.
    Inventors: Kuei-Shan Chang, Chin-Hui Chen, Erh-Chia Joung, Chun-Keung Chau, Shih-Pin Chang
  • Patent number: 11004264
    Abstract: Systems and methods relate to receiving a plurality of video streams captured of a subject by a plurality of video cameras, each video stream including video frames time-synchronized according to a shared frame rate, each video camera having a known vantage point in a predetermined coordinate system; obtaining at least one three-dimensional (3D) mesh of the subject at the shared frame rate, the 3D mesh time-synchronized with the video frames of the video streams, the at least one mesh including a plurality of vertices with known locations in the predetermined coordinate system; calculating one or more lists of visible-vertices at the shared frame rate, each list including a subset of the plurality of vertices of the at least one 3D mesh of the subject, the subset being a function of the location of the known vantage point associated with at least one of the plurality of video cameras; generating one or more time-synchronized data streams at the shared frame rate, the one or more time-synchronized data streams
    Type: Grant
    Filed: January 8, 2018
    Date of Patent: May 11, 2021
    Assignee: Verizon Patent and Licensing Inc.
    Inventor: Simion Venshtain
  • Patent number: 10996814
    Abstract: A method for providing tactile feedback in a display system including using a display to show an image of a virtual object in a viewing space, using a touch detector to detect a user touching a real object within the viewing space, and providing a location of the touching to the display. Related apparatus and methods are also described.
    Type: Grant
    Filed: November 29, 2017
    Date of Patent: May 4, 2021
    Assignee: Real View Imaging Ltd.
    Inventors: Shaul Alexander Gelman, Aviad Kaufman, Carmel Rotschild
  • Patent number: 10996743
    Abstract: A computer-implement operating method includes periodically generating sensing data by determining a triggered area of each of the sensors of a surface on which each of the sensors disposed; grouping effective sensors among the sensors into a plurality of sensor groups respectively corresponding to the fingers; obtaining a bending angle of one finger among the fingers according to the sensing values of the sensing data of all effective sensors in one sensor group corresponding to the said one finger among the sensor groups; and bending one virtual finger corresponding to the said one finger among virtual fingers of a virtual hand rendered in a virtual space corresponding to the electronic system according to the obtained bending angle of the said one finger, so as to render the virtual hand having a gesture matching to a gesture of the hand sensed by the controller.
    Type: Grant
    Filed: December 31, 2019
    Date of Patent: May 4, 2021
    Assignee: HTC Corporation
    Inventors: Li-Hsun Chang, Tian-Jia Hsieh, Kuan-Ying Ou, Hsi-Yu Tseng, Chen-Fu Chang, Huan-Hsin Li, Chien-Min Wu, Tzu-Hao Lin
  • Patent number: 10997327
    Abstract: A method for analyzing a rock sample includes segmenting a digital image volume corresponding to the rock sample, to associate voxels in the digital image volume with pore space or solid material. A distance transform is applied to each pore space voxel. The distance transform assigns a distance value to the pore space voxel specifying distance from the pore space voxel to a solid material voxel. Drainage is numerically simulated by, for a pore space, selecting each distance value assigned to a pore space voxel that is greater than a predetermined threshold value to represent a radius of a sphere of a non-wetting fluid introduced into the pore space. The sphere is centered at the pore space voxel corresponding to the distance value. The digital image volume is numerically analyzed to characterize a material property of the rock sample at a non-wetting fluid saturation produced by the drainage.
    Type: Grant
    Filed: October 30, 2017
    Date of Patent: May 4, 2021
    Assignee: BP CORPORATION NORTH AMERICA INC.
    Inventors: Joanne Fredrich, Nathan Lane
  • Patent number: 10992920
    Abstract: The purpose of the present invention is to provide a stereo image processing device that is capable of expanding the effective field of view by using a lens having distortion for realizing a wide field of view. This stereo image processing device has two sensors arranged so as to be shifted from the optical axes of respective lenses in directions separating each other, wherein each of the lenses has a property such that the distortion, in a region of a large viewing angle, is greater than that of an f? lens.
    Type: Grant
    Filed: May 1, 2018
    Date of Patent: April 27, 2021
    Assignee: Hitachi Automotive Systems, Ltd.
    Inventors: Kazuyoshi Yamazaki, Keiichi Betsui
  • Patent number: 10991127
    Abstract: Methods and devices for index buffer block compression in a computer system include a compressor in communication with a graphical processing unit (GPU). The methods and devices include selecting one or more primitives of at least a portion of a mesh formed by a total number of primitives for inclusion within a compressed index buffer block, the one or more primitives each associated with a number of indices each corresponding to a vertex within the mesh. The methods and devices may identify at least one redundant index in the number of indices associated with the one or more primitives of the compressed index buffer block. The methods and devices removing the at least one redundant index from the number of indices associated with the one or more primitives of the compressed index buffer block to form the compressed index buffer block as a set of one or more unique indices.
    Type: Grant
    Filed: September 16, 2019
    Date of Patent: April 27, 2021
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Ivan Nevraev, Jason M. Gould
  • Patent number: 10984556
    Abstract: The present disclosure provides a method for calibrating relative parameters of a collector, an apparatus for calibrating relative parameters of a collector, a device and a storage medium. The technical solution of the present disclosure may determine target position and attitude information of a target image collector in a calibration coordinate system when each target image is collected, determine the first position information of a spatial point in a three-dimensional scene point cloud in the calibration coordinate system and the second position information a projection point of the spatial point in each target image, and determine a relative position and attitude value between the target image collector and the reference collector based on the target position and attitude information corresponding to each target image, the first position information and the second position information.
    Type: Grant
    Filed: September 5, 2019
    Date of Patent: April 20, 2021
    Assignee: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) CO., LTD.
    Inventors: Yuanfan Xie, Xun Zhou, Shirui Li, Liang Wang
  • Patent number: 10979633
    Abstract: A camera system produces omnidirectional RGBD (reg-green-blue-depth) data, similar to a LiDAR but with additional registered RGB data. The system uses multiple cameras, fisheye lenses and computer vision procedures to compute a depth map. The system produces 360° RGB and depth, from a single viewpoint for both RGB and depth, without requiring stitching. RGB and depth registration may be obtained without extra computation and result presents zero parallax misalignment.
    Type: Grant
    Filed: December 17, 2019
    Date of Patent: April 13, 2021
    Assignee: Suometry, Inc.
    Inventor: Jean-Nicola Blanchet
  • Patent number: 10977829
    Abstract: A depth camera calibration device and a method thereof are provided. The method comprises: disabling a projection function of a camera and photographing surface planes to obtain a first image; enabling the projection function of the camera and photographing the surface planes to obtain a second image, and a positional relationship between the camera and a calibration plate assembly remaining unchanged when obtaining the first image and the second image; and obtaining parameters of the camera by cropping an image boundary, calculating positions of characteristic points, reading a projection pattern, calculating positions of corresponding points and excluding abnormal points according to the first image and the second image.
    Type: Grant
    Filed: December 27, 2018
    Date of Patent: April 13, 2021
    Assignee: INDUSTRIAL TECHNOLOGY RESEARCH INSTITUTE
    Inventors: Tien-Yan Ma, Te-Mei Wang, Ping-Chang Shih
  • Patent number: 10970874
    Abstract: The present invention relates to a method and an apparatus for performing image feature matching in a SLAM-based camera and, more particularly, to a method and an apparatus for improving the performance and speed of feature matching by generating labeled keyframes including GPS information, receiving limited promising keyframes on the basis of the labeled keyframes, and applying weighted grid to perform image feature matching.
    Type: Grant
    Filed: March 29, 2019
    Date of Patent: April 6, 2021
    Assignee: Electronics and Telecommunications Research Institute
    Inventor: Jun Seong Bang
  • Patent number: 10971174
    Abstract: An information-processing apparatus includes a display displaying an image; a memory recording voice data having a voice pronounced at each of plural observation points of the image; a gaze detector generating gaze data by detecting a gaze of a user; a voice input device generating voice data associated with a time axis identical to that of the gaze data by receiving a voice of the user; and a processor to analyze a attention period where a attention degree of the gaze to each of the plural observation points is a predetermined value or greater, based on the gaze data, set a period where the voice is pronounced with respect to the voice data as an important voice period, based on the voice data, and generate calibration data based on a time lag between the attention period and the important voice period.
    Type: Grant
    Filed: May 14, 2019
    Date of Patent: April 6, 2021
    Assignee: OLYMPUS CORPORATION
    Inventors: Kazuhito Horiuchi, Nobuyuki Watanabe, Yoshioki Kaneko, Hidetoshi Nishimura
  • Patent number: 10969762
    Abstract: A method of configuring at least one hazard zone to be monitored by at least one three-dimensional (3D) sensor includes fixing outer surfaces, where the at least one hazard zone is a volume defined by the outer surfaces, and is a zone in which a machine to be secured is located. Additionally, a check is made during the configuration or after the configuration whether the outer surfaces are visible to the at least one 3D sensor.
    Type: Grant
    Filed: June 5, 2019
    Date of Patent: April 6, 2021
    Assignee: SICK AG
    Inventors: Armin Hornung, Matthias Neubauer, Ingolf Braune, Shane MacNamara, Thomas Neumann
  • Patent number: 10969489
    Abstract: A method for detecting and autonomously tracking a target object using a LIDAR sensor that continuously emits laser pulses onto the target object and generates a 3-D point cloud from measurement points reflected by the target objects at predetermined time intervals. A current relative position of the target object is calculated for six degrees of freedom of movement of the target object at the predetermined time intervals based on algorithms estimating the position. The method includes acquiring a high-resolution initializing point cloud over a plurality of predetermined time intervals, generating a reference model with a small number of measurement points from the initializing point cloud, and, in subsequent iterative steps, determining temporal position clouds and comparing the position clouds with the reference model using the algorithms. Position information of the target object is calculated, wherein the reference model is continuously adapted to the changes in the point clouds.
    Type: Grant
    Filed: May 23, 2018
    Date of Patent: April 6, 2021
    Assignee: Jena-Optronik GmbH
    Inventors: Christoph Schmitt, Florian Kolb
  • Patent number: 10971900
    Abstract: The present disclosure provides a vertical-cavity surface-emitting laser, structured light module, terminal comprising the structured light module, and method for projecting the structured light thereof. The structured light module includes a plurality of light sources and a single diffractive optical element (DOE); wherein the plurality of light sources simultaneously emit a plurality beams of invisible light to the single DOE, wherein the single DOE has a pseudo-random optical pattern groove, wherein the invisible light of each light source passes through the DOE and emits a beam of spectral encoded structured light, and the beam of structured light comprises a pattern corresponding to the pseudo-random optical pattern groove. The DOE projects an overall structured light that is formed by superimposing a plurality of beams of structured light, and there is an offset between patterns of different beams of structured light.
    Type: Grant
    Filed: May 9, 2019
    Date of Patent: April 6, 2021
    Assignee: SHENZHEN GOODIX TECHNOLOGY CO., LTD.
    Inventors: Hao-Jen Wang, Chung-Te Li, Yung-Lin Huang
  • Patent number: 10970934
    Abstract: Systems and methods of rendering a three-dimensional (3D) virtual environment rendering are disclosed. The system comprises a central processing device, a plurality of user devices in data communication with the central processing device, a plurality of application servers in data communication with the central processing device, and software executing on the central processor. The software creates and renders a 3D virtual environment, receives user data from each of the plurality of user devices, renders the user data received from each of the user devices in the 3D virtual environment, receives application data from each of the application servers, renders the application data received from each of the application servers in the 3D virtual environment, and outputs the rendered 3D virtual environment to each of the user devices. The 3D virtual environment serves as a direct user interface with the Internet by allowing users to visually navigate the world wide web.
    Type: Grant
    Filed: November 16, 2018
    Date of Patent: April 6, 2021
    Assignee: Roam Holdings, LLC
    Inventors: Joseph D. Rogers, Marc E. Rogers