Patents Assigned to NAVER LABS CORPORATION
  • Patent number: 11964392
    Abstract: A method and a system generate global path planning of a robot according to a node specification principle that is defined based on social norms for an indoor space using an indoor map to assist human-friendly navigation of the robot.
    Type: Grant
    Filed: July 8, 2021
    Date of Patent: April 23, 2024
    Assignee: NAVER LABS CORPORATION
    Inventors: Seoktae Kim, Kahyeon Kim
  • Patent number: 11941755
    Abstract: A method of generating a map for visual localization includes specifying a virtual camera pose by using 3-dimensional (3D) model data which is based on an image of an outdoor space captured from the air; rendering the image of the outdoor space from a perspective of the virtual camera, by using the virtual camera pose and the 3D model data; and generating a feature point map by using the rendered image and the virtual camera pose.
    Type: Grant
    Filed: November 3, 2021
    Date of Patent: March 26, 2024
    Assignee: NAVER LABS CORPORATION
    Inventors: Deok Hwa Kim, Dong Hwan Lee, Woo Young Kim
  • Publication number: 20240051125
    Abstract: A system includes: a hand module to, based on a demonstration of a human hand grasping an object, determine first and second vectors that are normal to and parallel to a palm of the human hand, respectively, and a position of the human hand; a gripper module to determine third and fourth vectors that are normal to and parallel to a palm of a gripper of a robot, respectively, and a present position of the gripper; and an actuation module to: move the gripper when open such that the present position of the gripper is at the position of the human hand, the third and first vectors are aligned, and the fourth and second vectors are aligned; close fingers of the gripper based on minimizing a first loss; and actuate the fingers of the gripper to minimize a second loss determined based on the first loss and a third loss.
    Type: Application
    Filed: February 22, 2023
    Publication date: February 15, 2024
    Applicants: Naver Corporation, Naver Labs Corporation, Ecole Nationale des Ponts et Chaussées
    Inventors: Yuming DU, Romain BREGIER, Philippe WEINZAEPFEL, Vincent LEPETIT
  • Patent number: 11897394
    Abstract: A head up display for a vehicle including a display device configured to output light forming an image, an optical system configured to control a path of the light such that the image is output towards a light transmission region, and a controller configured to generate the image based on a first view and a second view such that a virtual image is produced on a ground surface in the light transmission region, the first view being towards the ground surface, the second view being towards a 3D space above the ground surface, the first view and the second view being based on an eye-box, the ground surface being in front of the vehicle, and the virtual image including a graphic object having a stereoscopic effect, and control the display device to output the image.
    Type: Grant
    Filed: July 20, 2021
    Date of Patent: February 13, 2024
    Assignee: NAVER LABS CORPORATION
    Inventors: Jae Won Cha, Jeseon Lee, Kisung Kim, Jongjin Park, Eunyoung Jeong, Yongho Shin
  • Patent number: 11897122
    Abstract: Disclosed is a robot hand comprising a base, a first bracket provided on an upper portion of the base, a second bracket provided on an upper portion of the base and configured such that the other side of the second bracket is rotatable in a horizontal direction about one side of the second bracket, a plurality of finger modules coupled to upper portions of the first and second brackets, respectively, and configured to tilt in order to grip an object, finger drive units installed on the first and second brackets and configured to transmit driving power to the finger modules and a rotation drive unit installed at one side of the second bracket and configured to transmit driving power so that the other side of the second bracket is rotatable in the horizontal direction about one side of the second bracket.
    Type: Grant
    Filed: October 11, 2018
    Date of Patent: February 13, 2024
    Assignees: NAVER LABS CORPORATION, KOREA UNIVERSITY OF TECHNOLOGY AND EDUCATION INDUSTRY-UNIVERSITY COOPERATION FOUNDATION
    Inventors: Yong Jae Kim, Jong In Kim, Jun Suk Yoon
  • Publication number: 20240046569
    Abstract: A system includes: a feature module configured to generate a feature map based on a single image taken from a point of view (POV) including a human based on features of the human visible in the image and non-visible features of the human; a pixel features module configured to generate pixel features based on the feature map and a target POV; a feature mesh module configured to generate a feature mesh for the human based on the feature map; a geometry module configured to: generate voxel features based on the feature mesh; and generate a density value based on the voxel and pixel features; a texture module configured to generate RGB colors for pixels based on the density value and the pixel features; and a rendering module configured to generate a three dimensional rendering of the human from the target POV based on the RGB colors and the density value.
    Type: Application
    Filed: December 16, 2022
    Publication date: February 8, 2024
    Applicants: NAVER CORPORATION, NAVER LABS CORPORATION, SEOUL NATIONAL UNIVERSITY R&DB FOUNDATION
    Inventors: Hongsuk CHOI, Gyeongsik MOON, Vincent LEROY, KyoungMu LEE, Grégory ROGEZ
  • Patent number: 11865915
    Abstract: A three-dimensional augmented reality head-up display includes a display device functioning as a light source; and a freeform surface mirror for reflecting light from the light source onto a windshield of a vehicle. An image created by the light from the light source is focused on the ground in front of the vehicle as a virtual image of a three-dimensional perspective, through a reflection method in which the light from the light source is reflected onto the windshield by means of the freeform surface mirror.
    Type: Grant
    Filed: March 19, 2021
    Date of Patent: January 9, 2024
    Assignee: NAVER LABS CORPORATION
    Inventors: Eunyoung Jeong, Jae Won Cha
  • Patent number: 11850759
    Abstract: A control method and system for a robot. The robot control method includes allocating a task to a robot, the task associated with a place and a target user, determining a location of the target user based on an image received from a camera, the camera being arranged in a space including the place, and controlling a performance time of the task based on the location of the target user and the place.
    Type: Grant
    Filed: July 21, 2021
    Date of Patent: December 26, 2023
    Assignee: NAVER LABS CORPORATION
    Inventors: Seijin Cha, Kahyeon Kim
  • Publication number: 20230359212
    Abstract: A navigating device includes: a camera configured to capture images within a field of view, the field of view depicting a scene including humans; a feature module configured to generate feature vectors based on the scene of humans in the images and to specify latent vectors that summarize movement of the humans in the scene based only on the camera images, the feature vectors summarizing the movement of the humans in the scene, and the latent vectors capturing a latent representation of trajectories in the scene of humans; a policy module configured to generate actions to be taken by the navigating device to navigate the scene of humans based on the feature vectors; and a propulsion control module configured to control one or more propulsion devices of the navigating device based on the actions to be taken generated by the policy module to navigate the scene of humans
    Type: Application
    Filed: February 9, 2023
    Publication date: November 9, 2023
    Applicants: NAVER CORPORATION, NAVER LABS CORPORATION
    Inventors: Gianluca MONACI, Michel Aractingi, Tomi Silander
  • Patent number: 11798274
    Abstract: A method for spatial messaging includes the steps of setting, as a space for messaging, a location designated by a user as a virtual space assigned a unique coordinate value corresponding to a location in the real world; and collecting, as a message for the space, at least one content authored by another user who shares the corresponding space through a coordinate value of the space.
    Type: Grant
    Filed: June 17, 2020
    Date of Patent: October 24, 2023
    Assignee: NAVER LABS CORPORATION
    Inventors: Jeanie Jung, Byungsoo Kim
  • Patent number: 11747477
    Abstract: The data collecting method includes: collecting first and second sensor data respectively through a first and a second sensors while a data collecting apparatus moves within a target area, and tagging a first and a second timestamp values respectively to the first and the second sensor data; generating map data of the target area and location data at a point of time corresponding to the first timestamp value, based on the first sensor data; generating map information of the target area based on the map data, and generating moving path information on the map based on the location data; and estimating a sensing location at a point of time corresponding to the second timestamp value based on the moving path information, and tagging the sensing location to the second sensor data.
    Type: Grant
    Filed: September 25, 2019
    Date of Patent: September 5, 2023
    Assignee: NAVER LABS CORPORATION
    Inventors: Su Yong Yeon, Soo Hyun Ryu, Dong Hwan Lee, Jeong Hee Kim, Kay Park, Sang Ok Seok
  • Publication number: 20230245436
    Abstract: An autonomous system includes: a first semantic segmentation model trained based on a training dataset including images and labels for the images, the first semantic segmentation model configured to generate a first segmentation map based on an image from a camera; a second semantic segmentation model of the same type of semantic segmentation model as the first semantic segmentation model, the second semantic segmentation model configured to generate a second segmentation map based on the image from the camera; an adaptation module configured to selectively adjust one or more first parameters of the second semantic segmentation model; and a reset module configured to: determine a first total number of unique classifications included in the first segmentation map; determine a second total number of unique classifications included in the first segmentation map; and selectively reset the first parameters to previous parameters, respectively, based on the first and second total numbers.
    Type: Application
    Filed: January 31, 2022
    Publication date: August 3, 2023
    Applicants: NAVER CORPORATION, NAVER LABS CORPORATION
    Inventors: Riccardo VOLPI, Diane LARLUS, Gabriela CSURKA KHEDARI
  • Patent number: 11703109
    Abstract: A planetary gear actuator including a sun gear, a rotary internal gear being concentric with the sun gear, a fixed internal gear being concentric with the sun gear, compound planetary gears, and a carrier connected to each of the compound planetary gears so as to be rotatable relative to each of compound planetary gears may be provided, Each of the compound planetary gears may include a first planet gear engaged with the sun gear, a second planet gear at one side of the first planet gear, engaged with the rotary internal gear, and having a smaller number of teeth than the first planet gear, and a third planet gear at another side of the first planet gear, engaged with the fixed internal gear, and having a smaller number of teeth than the first planet gear. One compound planetary gear may overlap another compound planetary gear in a thickness direction.
    Type: Grant
    Filed: September 9, 2021
    Date of Patent: July 18, 2023
    Assignees: NAVER LABS CORPORATION, Korea University of Technology and Education Inductry-University Cooperation Foundation
    Inventors: Yong Jae Kim, Seong Ho Yun, Ji Won Seo
  • Patent number: 11684843
    Abstract: A personal mobility device includes a frame connected to at least one wheel, a connection part on the frame, a boarding part connected to the connection part to be tiltable, a first sensor disposed on the frame to measure an inclination of the frame, and a second sensor disposed on the boarding part to measure an inclination of the boarding part.
    Type: Grant
    Filed: April 10, 2020
    Date of Patent: June 27, 2023
    Assignee: NAVER LABS CORPORATION
    Inventors: Dong Il Choi, Min Su Kim
  • Patent number: 11651608
    Abstract: A system for generating whole body poses includes: a body regression module configured to generate a first pose of a body of an animal in an input image by regressing from a stored body anchor pose; a face regression module configured to generate a second pose of a face of the animal in the input image by regressing from a stored face anchor pose; an extremity regression module configured to generate a third pose of an extremity of the animal in the input image by regressing from a stored extremity anchor pose; and a pose module configured to generate a whole body pose of the animal in the input image based on the first pose, the second pose, and the third pose.
    Type: Grant
    Filed: September 13, 2022
    Date of Patent: May 16, 2023
    Assignees: NAVER CORPORATION, NAVER LABS CORPORATION
    Inventors: Philippe Weinzaepfel, Romain Bregier, Hadrien Combaluzier, Vincent Leroy, Gregory Rogez
  • Publication number: 20230119559
    Abstract: A training system includes: a neural network model configured to determine three-dimensional coordinates of joints, respectively, representing poses of animals in images, where the neural network model is trained using a first training dataset including: images including animals; and coordinates of joints of the animals in the images, respectively; and a training module configured to, after the training of the neural network model using the first training dataset, train the neural network model using a second training dataset including motion capture data, where the motion capture data does not include images of animals and includes measured coordinates at points, respectively, on animals.
    Type: Application
    Filed: October 4, 2021
    Publication date: April 20, 2023
    Applicants: NAVER CORPORATION, NAVER LABS CORPORATION
    Inventors: Fabien BARADEL, Romain BREGIER, Thibault GROUEIX, Ioannis KALANTIDIS, Philippe WEINZAEPFEL, Gregory ROGEZ
  • Patent number: 11625855
    Abstract: A map updating method may include calculating a relative pose relationship between consecutive images; calculating an absolute pose of each image based on the relative pose relationship between the consecutive images; and updating a map used for visual localization (VL) based on the absolute pose.
    Type: Grant
    Filed: April 7, 2020
    Date of Patent: April 11, 2023
    Assignee: NAVER LABS CORPORATION
    Inventors: Deokhwa Kim, Donghwan Lee, Sangok Seok
  • Publication number: 20230107921
    Abstract: Am image retrieval system includes: a neural network (NN) module configured to generate local features based on an input image; an iterative attention module configured to, via T iterations, generate an ordered set of super features in the input image based on the local features, where T is an integer greater than 1; and a selection module configured to select a second image from a plurality of images in an image database based on the second image having a second ordered set of super features that most closely match the ordered set of super features in the input image, where the super features in the set of super features do not include redundant local features of the input image.
    Type: Application
    Filed: January 21, 2022
    Publication date: April 6, 2023
    Applicants: NAVER CORPORATION, NAVER LABS CORPORATION
    Inventors: Philippe Weinzaepfel, Thomas Lucas, Diane Larlus, loannis Kalantidis
  • Patent number: 11620755
    Abstract: The trajectory tracking method for a mobile electronic device may include tracking a trajectory of the electronic device by using results of pose estimation using odometry and results of pose estimation using visual localization (VL) as camera pose information.
    Type: Grant
    Filed: November 12, 2020
    Date of Patent: April 4, 2023
    Assignee: NAVER LABS CORPORATION
    Inventors: Donghwan Lee, Deokhwa Kim
  • Patent number: D1018618
    Type: Grant
    Filed: June 9, 2021
    Date of Patent: March 19, 2024
    Assignee: NAVER LABS CORPORATION
    Inventors: Min-Kyo Im, Kyumin Ha