Including Orientation Sensors (e.g., Infrared, Ultrasonic, Remotely Controlled) Patents (Class 345/158)
  • Patent number: 11125566
    Abstract: A system includes a processor configured to receive image data gathered by a vehicle camera, relating to a fixed environmental feature. The processor is also configured to determine a vehicle position relative to the fixed environmental feature and determine a vehicle lane-level location on a digital map, based on the vehicle position relative to the fixed environmental feature.
    Type: Grant
    Filed: July 16, 2015
    Date of Patent: September 21, 2021
    Assignee: Ford Global Technologies, LLC
    Inventors: Dehua Cui, David A. Herman, Oleg Yurievitch Gusikhin, Perry Robinson MacNeille, David Allen Kowalski, Omar Makke
  • Patent number: 11126000
    Abstract: Systems, devices, and methods for increasing resolution in wearable heads-up displays (WHUD) are described. A WHUD includes a support structure, a scanning laser projector (SLP), a fold mirror, a split mirror, an optical splitter, and an optical combiner. When the WHUD is worn on the head of a user, the optical combiner is positioned in a field of view of the user. The SLP scans light signals onto the fold mirror which reflects light onto one of at least two reflective surfaces of the split mirror, based on a state of the fold mirror. The split mirror redirects the light signals onto the optical splitter, which, in turn, redirects the light signals towards the optical combiner. The optical combiner redirects the light signals to the eye at exit pupils containing the full usable resolution of the SLP.
    Type: Grant
    Filed: January 22, 2020
    Date of Patent: September 21, 2021
    Assignee: Google LLC
    Inventor: Stuart James Myron Nicholson
  • Patent number: 11119570
    Abstract: A method and a system for modifying the position of a cursor are provided. In the method, the depth information of a human body portion of a user is determined. The user uses the human body portion to move the cursor. The cursor is located at the end of a ray cast emitted from a user side, and the user's head wears a head mounted display. The first position of the cursor is determined. The second position of the cursor different from the first position is determined based on the depth information of the human body portion and the first position. The second position is used as the current position of the cursor, and the current position is located at the end of a ray cast emitted from the user currently. Accordingly, it is easy to control the cursor for different heights or arm lengths.
    Type: Grant
    Filed: October 29, 2020
    Date of Patent: September 14, 2021
    Assignee: XRSPACE CO., LTD.
    Inventors: Yu-Feng Tai, Sheng-Hsiu Kuo
  • Patent number: 11119572
    Abstract: Selective display of available objects based on eye-gaze characteristics with respect to currently displayed objects and certain attributes of the currently displayed objects. Similarity-driven selective display compares attributes of a displayed object receiving a fixed gaze to attributes of available objects and displays similar objects in addition to the displayed object receiving the fixed gaze.
    Type: Grant
    Filed: November 6, 2019
    Date of Patent: September 14, 2021
    Assignee: International Business Machines Corporation
    Inventors: Karan Ahuja, Kuntal Dey, Sougata Mukherjea, Seema Nagar
  • Patent number: 11113533
    Abstract: A computer-implemented method executed by a processor for reducing exposure of a plurality of objects to environmental conditions by employing a smart room tracking system is presented. The computer-implemented method includes counting a number of individuals within a space including the plurality of objects via one or more image capture devices and determining whether each individual makes direct eye contact with any of the plurality of objects by evaluating orientation, posture, and eye movement of each individual. The computer-implemented method further includes shielding, via an object viewing controller, an object of the plurality of objects from view when no direct eye contact is determined and making an object of the plurality of objects viewable, via the object viewing controller, when direct eye contact is determined.
    Type: Grant
    Filed: September 17, 2019
    Date of Patent: September 7, 2021
    Assignee: International Business Machines Corporation
    Inventors: Marc A. Bergendahl, Christopher J. Penny, James J. Demarest, Christopher Waskiewicz, Jean Wynne, Jonathan Fry
  • Patent number: 11108586
    Abstract: An infotainment apparatus of a vehicle includes: a communication device configured to receive relative location information of an Internet of Things (IoT) device included in a predetermined space from an external device; a controller configured to generate a virtual space based on the relative location information of the IoT device, generate an icon of the IoT device, dispose the icon of the IoT device in the virtual space, generate a Graphic User Interface (GUI) of the virtual space in which the icon of the IoT device is located; and a display configured to display the GUI of the virtual space.
    Type: Grant
    Filed: September 30, 2019
    Date of Patent: August 31, 2021
    Assignees: Hyundai Motor Company, Kia Motors Corporation
    Inventor: Unhwan Seol
  • Patent number: 11102461
    Abstract: A projection system includes a projection device including a projector unit and a camera unit, a signal transmitter unit mounted to a projection screen, and a processing unit. The camera unit captures an image of a projection image projected by the projector unit onto the projection screen, and the processing unit obtains a position of the projection image accordingly. The processing unit obtains a position of the projection screen based on signals wirelessly transmitted by the signal transmitter unit and adjusts setting parameter(s) related to the projector unit based on a comparison between the positions of the projection image and the projection screen to reduce dimensional and/or positional differences between the two.
    Type: Grant
    Filed: September 24, 2020
    Date of Patent: August 24, 2021
    Assignee: TPKTouch Systems (Xiamen) Inc.
    Inventors: Ning Zhang, Xiao Xin Bai, Qi Jun Zheng, Yan Jun Xie, Kwan Sin Ho
  • Patent number: 11099655
    Abstract: The present invention relates to an electronic wrist wearable device that uses image and inertia sensors to track motion of hand and wrist of a user, and is able to determine locations and orientation (relative to a stationary object in physical environment) of hand and wrist, and discrete and motion hand gestures. The wearable device can also emulate various data input devices by matching the determined gestures with preregistered gestures and sending the data associated with the matched gesture to a relevant computer device. The wearable device sends the said tracking information of the hand and the wrist to at least one external computer, which can process the received information to simulate hand motion, and to determine discrete and motion hand gestures. The said computer can also emulate various data input devices by matching the determined gestures with preregistered gestures and using the data associated with the matched gesture.
    Type: Grant
    Filed: May 25, 2020
    Date of Patent: August 24, 2021
    Inventor: Abhishek Johri
  • Patent number: 11099653
    Abstract: Methods and systems for processing an input are disclosed that detect a portion of a hand and/or other detectable object in a region of space monitored by a 3D sensor. The method further includes determining a zone corresponding to the region of space in which the portion of the hand or other detectable object was detected. Also, the method can include determining from the zone a correct way to interpret inputs made by a position, shape or a motion of the portion of the hand or other detectable object.
    Type: Grant
    Filed: October 21, 2019
    Date of Patent: August 24, 2021
    Assignee: Ultrahaptics IP Two Limited
    Inventors: Michael Zagorsek, Avinash Dabir, Paul Durdik, Keith Mertens
  • Patent number: 11093208
    Abstract: The disclosure relates generally to techniques for determining pupil location of a display device's user via imaging sensors on the display device, and using that information to verify and/or correct positioning of the display device or its internal components. The display device may be a head-mounted display (“HMD”) device with display panels separated from a wearer's eyes via intervening lenses, with the sensors including optical flow sensor integrated circuits mounted on or near at least one of the display panels to capture images of the wearer's eye locations through the lenses, and with the correction to the positioning including modifications to the alignment or other positioning of the HMD device on the wearer user's head and/or its internal components within the HMD device (e.g., based on automated control of motors on the HMD device) to reflect a target alignment of the wearer's eyes relative to displayed information.
    Type: Grant
    Filed: February 1, 2019
    Date of Patent: August 17, 2021
    Assignee: Valve Corporation
    Inventors: Joshua Mark Hudman, Jeremy Adam Selan
  • Patent number: 11093053
    Abstract: In some embodiments, an input device includes a housing having a top surface, a touch sensor disposed on the top surface of the housing, and a processor disposed in the housing. The touch sensor can be configured to detect a contact by a hand on the top surface of the housing and generate touch data corresponding to the detected contact by the hand. The processor can be configured to control operation of the touch sensor and receive the touch data, determine an orientation of the hand with respect to the housing based on the touch data, and calibrate a detected movement of the input device based on the determined orientation of the hand with respect to the housing. An image sensor and/or one or more IMUs can be used to detect 2D and/or 3D movement of the input device.
    Type: Grant
    Filed: November 12, 2019
    Date of Patent: August 17, 2021
    Assignee: Logitech Europe S.A.
    Inventors: Chun-Wei Su, Kuan-Lin Wu, Laurent Mealares, Thibaut Mauron, Chia Feng Lee, Christina Chen, Alice Liu, Chih-Wei Chen, Kuo Hsiang Chen, Joe Chiu, Charles Gigandet
  • Patent number: 11080935
    Abstract: Some embodiments include a method comprising using a first computing device to perform: obtaining an image of a scene captured using a camera coupled to the first computing device; obtaining camera setting values used to capture the image; determining, using the image, surface attribute values characterizing at least one surface shown in the image of the scene; generating an augmented reality (AR) interface at least in part by using the camera setting values and the surface attribute values to create a first composite image by overlaying a selected virtual furniture object onto the image so that the virtual furniture object is displayed in the AR interface as being on a first surface of the at least one surface shown in the image; and transmitting, to a second computing device and via at least one communication network, the first composite image, the camera setting values and the surface attribute values.
    Type: Grant
    Filed: November 22, 2019
    Date of Patent: August 3, 2021
    Assignee: Wayfair LLC
    Inventors: Shrenik Sadalgi, Kunal Rajesh Khona
  • Patent number: 11073923
    Abstract: The disclosed apparatus reduces necessary electric power for moving a touch pad of an input device to a predetermined height and maintaining the touch pad at the height, the touch panel creating a sense of touch when operated. The input device includes: a contact member to be in contact with a contact body; a housing for supporting the contact member in a movable manner; and a drive device for moving the contact member with respect to the housing, wherein the drive device is equipped with a rotatable rotary body, first magnets disposed on the rotary body, and second magnets disposed on the contact member, and wherein the first magnets and the second magnets are arranged so as to be able to face each other.
    Type: Grant
    Filed: August 12, 2016
    Date of Patent: July 27, 2021
    Assignees: PIONEER CORPORATION, TOHOKU PIONEER CORPORATION
    Inventors: Makoto Abe, Takeru Miki, Atsushi Kudo, Masakazu Takahashi
  • Patent number: 11067797
    Abstract: An augmented reality system includes a light source configured to generate a virtual light beam. The system also includes a light guiding optical element having an entry portion, an exit portion, and a surface having a diverter disposed adjacent thereto. The light source and the light guiding optical element are configured such that the virtual light beam enters the light guiding optical element through the entry portion, propagates through the light guiding optical element by at least partially reflecting off of the surface, and exits the light guiding optical element through the exit portion. The light guiding optical element is transparent to a first real-world light beam. The diverter is configured to modify a light path of a second real-world light beam at the surface.
    Type: Grant
    Filed: April 5, 2017
    Date of Patent: July 20, 2021
    Assignee: Magic Leap, Inc.
    Inventors: Brian T. Schowengerdt, Mathew D. Watson
  • Patent number: 11070852
    Abstract: A media system replaces content in a first sequence of media content. The media system presents the first sequence of media content to an end-user and generates a fingerprint of the sequence of media content. The fingerprint is for comparison with a plurality of reference fingerprints so as to identify the first sequence of media content and determine a reference position within the first sequence of media content. The media system sends a request for a replacement sequence of content to a content replacement system, and receives replacement media content selected based on the identified first sequence of media content. The media system presents the replacement media content to the end-user instead of the first sequence of media content. Presenting the replacement media content begins at a position in the first sequence of media content that is determined based on the reference position.
    Type: Grant
    Filed: May 3, 2019
    Date of Patent: July 20, 2021
    Assignee: Roku, Inc.
    Inventor: Donald F. Gordon
  • Patent number: 11060858
    Abstract: A waveguide apparatus includes a planar waveguide and at least one optical diffraction element (DOE) that provides a plurality of optical paths between an exterior and interior of the planar waveguide. A phase profile of the DOE may combine a linear diffraction grating with a circular lens, to shape a wave front and produce beams with desired focus. Waveguide apparati may be assembled to create multiple focal planes. The DOE may have a low diffraction efficiency, and planar waveguides may be transparent when viewed normally, allowing passage of light from an ambient environment (e.g., real world) useful in AR systems. Light may be returned for temporally sequentially passes through the planar waveguide. The DOE(s) may be fixed or may have dynamically adjustable characteristics. An optical coupler system may couple images to the waveguide apparatus from a projector, for instance a biaxially scanning cantilevered optical fiber tip.
    Type: Grant
    Filed: May 13, 2019
    Date of Patent: July 13, 2021
    Assignee: Magic Leap, Inc.
    Inventors: Rony Abovitz, Brian T. Schowengerdt, Mathew D. Watson
  • Patent number: 11048343
    Abstract: In one aspect, a computer mouse is provided. The computer mouse may include an accelerometer sensor configured to measure vibrations of the computer mouse during a mouse gliding action and a motion sensor configured to measure the speed of the computer mouse during the mouse gliding action. The gliding performance of the computer mouse may be analyzed based on the measured vibrations and the measured speed of the computer mouse. In another aspect, a method and an apparatus for mouse gliding performance analysis are provided. The apparatus may measure vibrations of a computer mouse using an accelerometer sensor during a mouse gliding action. The apparatus may measure the speed of the computer mouse using a motion sensor during the mouse gliding action. The apparatus may analyze the gliding performance of the computer mouse based on the measured vibrations and the measured speed of the computer mouse.
    Type: Grant
    Filed: October 10, 2017
    Date of Patent: June 29, 2021
    Assignee: RAZER (ASIA-PACIFIC) PTE. LTD.
    Inventors: Kah Yong Lee, Jian Yao Lien
  • Patent number: 11048944
    Abstract: A method of determining a spatio-temporal feature value for frames of a sequence of video. A first frame and second frame from the sequence of video are received. Spatial feature values in each of the first and second frames are determined according to a plurality of spatial feature functions. For each of the spatial feature functions, a change in the spatial feature values between the first and second frames is determined. The spatio-temporal feature value is determined by combining the determined change in spatial feature values for each of the spatial feature functions.
    Type: Grant
    Filed: December 5, 2018
    Date of Patent: June 29, 2021
    Assignee: Canon Kabushiki Kaisha
    Inventor: Anthony Knittel
  • Patent number: 11042286
    Abstract: A mobile computing device with a touch-sensitive display wherein: a pointer is displayed; a control icon is displayed; a contact on the touch-sensitive display is detected; and in response to detecting a change in a horizontal position of the contact beginning anywhere on the control icon, a horizontal position of the pointer is changed wherein the horizontal position of the pointer with respect to the control icon is changed; and in response to detecting a change in a vertical position of a contact beginning anywhere on the control icon: a vertical position of the pointer is changed; and a vertical position of the control icon is changed.
    Type: Grant
    Filed: May 3, 2020
    Date of Patent: June 22, 2021
    Inventor: David Graham Boyers
  • Patent number: 11042028
    Abstract: This invention relates to tracking of user-worn and hand-held devices with respect to each other, in circumstances where there are two or more users interacting in the same share space. It extends conventional global and body-relative approaches to “cooperatively” estimate the relative poses between all useful combinations of user-worn tracked devices such as HMDs and hand-held controllers worn (or held) by multiple users. For example, a first user's HMD estimates its absolute global pose in the coordinate frame associated with the externally-mounted devices, as well as its relative pose with respect to all other HMDs, hand-held controllers, and other user held/worn tracked devices in the environment. In this way, all HMDs (or as many as appropriate) are tracked with respect to each other, all HMDs are tracked with respect to all hand-held controllers, and all hand-held controllers are tracked with respect to all other hand-held controllers.
    Type: Grant
    Filed: January 12, 2021
    Date of Patent: June 22, 2021
    Assignee: University of Central Florida Research Foundation, Inc.
    Inventors: Gregory Welch, Gerd Bruder
  • Patent number: 11030720
    Abstract: A direct retinal projection apparatus including means for detecting a gaze direction of a user, a projector, a first optical element, an actuator and a processor. The first optical element includes different optical portions having different optical properties with respect to magnification. The processor is configured to render a warped image having a spatially-uniform angular resolution via the projector, whilst adjusting an orientation of the first optical element via the actuator, based on the detected gaze direction, to direct a projection of the warped image from the first optical element towards a retina of a user's eye. Projections of different portions of the warped image are differently magnified by the different optical portions of the first optical element to produce on the retina of the user's eye a de-warped image having a spatially-variable angular resolution.
    Type: Grant
    Filed: June 4, 2019
    Date of Patent: June 8, 2021
    Assignee: Varjo Technologies Oy
    Inventors: Klaus Melakari, Mikko Ollila
  • Patent number: 11029765
    Abstract: An optical mouse includes a pixel array and a light source. A method for determining when the optical mouse is in a lifted condition above a surface includes: accumulating pixel values of a first column of the pixel array, the first column being closest to the light source; accumulating pixel values of a second column of the pixel array, the second column being different from the first column; comparing the accumulated pixel values of the first column with the accumulated pixel values of the second column; and when a difference between the accumulated pixel values of the first column and the accumulated pixel values of the second column is greater than a threshold value, determining the optical mouse to be in a lifted condition.
    Type: Grant
    Filed: June 3, 2020
    Date of Patent: June 8, 2021
    Assignee: PixArt Imaging Inc.
    Inventor: Chun Heap Leow
  • Patent number: 11030947
    Abstract: A display device includes a display including a plurality of pixels having a plurality of light-emitting elements, a pixel selector configured to select a pixel from among a plurality of pixels, a positional information generator configured to generate the positional information representing the position of the selected pixel, and a light emission processor configured to superpose the positional information on the light emitted by the selected pixel. A position detecting device is used to detect and output the positional information superposed on the light of the selected pixel on the display device, thus making it easy to accurately detect the position of the pixel subjected to calibration in luminance.
    Type: Grant
    Filed: February 19, 2019
    Date of Patent: June 8, 2021
    Assignee: SHARP NEC DISPLAY SOLUTIONS, LTD.
    Inventor: Ryoji Takahashi
  • Patent number: 11027425
    Abstract: Methods, apparatus, systems, and computer-readable media are provided for enabling users to approximately identify a space within an environment inhabited by a plurality of objects that user wishes for a robot to manipulate. In various implementations, an approximation of a space within an environment may be identified based on user input. The actual space within the environment may then be extrapolated based at least in part on the approximation and one or more attributes of the environment. A plurality of objects that are co-present within the space and that are to be manipulated by a robot may be identified. The robot may then be operated to manipulate the identified plurality of objects.
    Type: Grant
    Filed: July 20, 2018
    Date of Patent: June 8, 2021
    Assignee: X DEVELOPMENT LLC
    Inventor: Crystal Chao
  • Patent number: 11027191
    Abstract: Provided is an auxiliary electronic controller of a mobile terminal includes a main body having a seating portion configured to seat the mobile terminal at a top surface of the main body, and having a radiating structure disposed therein, a first holding portion formed at one side of the main body, and a second holding portion hinge-coupled to another side facing the one side of the main body to rotate to a bottom surface of the main body.
    Type: Grant
    Filed: September 6, 2019
    Date of Patent: June 8, 2021
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Junhwa Oh, Woochul Lee, Byunghun Cho, Jaewoong Choi
  • Patent number: 11029766
    Abstract: There is provided an information processing apparatus including: a recognition unit which recognizes an irradiation position of laser light by a laser pointer to a projection image; an acquisition unit which acquires movement information of the laser pointer; and an output unit which outputs a control signal for causing display of an object within a projection image corresponding to the irradiation position to be changed in accordance with the movement information.
    Type: Grant
    Filed: March 31, 2014
    Date of Patent: June 8, 2021
    Assignee: SONY CORPORATION
    Inventors: Tomoya Narita, Taku Inoue, Takehiro Hagiwara
  • Patent number: 11026571
    Abstract: A method for processing pupil tracking images, comprising the steps of: 1) acquiring eye images multiple times; 2) processing each acquired eye image, and determining whether a pupil can be positioned in the acquired image; and 3) determining that pupil tracking is completed when the pupil can be positioned in consecutive n pieces of eye images. Image processing efficiency is improved by searching a potential bright spot area and carrying out Blob analysis smearing images caused by pupil movement can be eliminated, the pupil edge is accurately positioned by adopting a line drawing method in collaboration with a support vector machine when determining the pupil edge, and finally a weighted least square method is adopted to fit a circle/ellipse (pupil). Therefore, real-time tracking and analysis of the pupil under a complex background are realized, and reliable data are provided for subsequent steps to obtain the refractive parameters of the eye.
    Type: Grant
    Filed: December 13, 2018
    Date of Patent: June 8, 2021
    Assignee: WENZHOU MEDICAL UNIVERSITY
    Inventors: Jinhai Huang, Hang Yu, Meixiao Shen, Hao Chen
  • Patent number: 11009951
    Abstract: Systems, devices and methods that enable a user to access and interact with content displayed on a portable electronic display in an inconspicuous, hands-free manner are described. There is disclosed a completely wearable system comprising a wearable muscle interface device and a wearable head-mounted display, as well as methods for using the wearable system to effect interactions between the user and content displayed on the wearable head-mounted display. The wearable muscle interface device includes muscle activity sensors worn on an arm of the user to detect muscle activity generated when the user performs a physical gesture. The wearable system is adapted to recognize a plurality of gestures made by the user and, in response to each recognized gesture, to effect one or more interaction(s) with content displayed on the wearable head-mounted display.
    Type: Grant
    Filed: November 26, 2019
    Date of Patent: May 18, 2021
    Assignee: Facebook Technologies, LLC
    Inventors: Matthew Bailey, Aaron Grant, Stephen Lake
  • Patent number: 11006861
    Abstract: Described herein is a sensorized glove, in particular designed for ergonomic analysis, including an inner glove, which comprises a plurality of extensometer sensors configured for detecting relative movements between parts of a worker's hand; and an outer glove, which comprises a plurality of pressure sensors distributed over a palmar surface and configured for detecting the pressure exerted in corresponding areas of said palmar surface. Moreover described is a corresponding method for determining the type of grasp exerted by a worker.
    Type: Grant
    Filed: January 23, 2019
    Date of Patent: May 18, 2021
    Assignee: C.R.F. Societa Consortile per Azioni
    Inventors: Massimo Di Pardo, Giorgio Pasquettaz, Rossella Monferino, Francesca Gallo
  • Patent number: 11009916
    Abstract: A touch input device includes a frame unit, a circuit unit and a touch pad. The circuit unit includes a circuit board, a dome-shaped actuating member including an actuating portion and a resilient metal sheet connected between the actuating portion and the circuit board, and a noise reduction member having a main body connected to the resilient metal sheet, made of an elastic material and formed with a recess surrounding the actuating portion. A touch surface of the touch pad is touchable to push the circuit unit toward the block member, such that the actuating portion contacts the block member to deform the resilient metal sheet to electrically connect the actuating portion with the circuit board.
    Type: Grant
    Filed: June 26, 2020
    Date of Patent: May 18, 2021
    Assignee: SUNREXTECHNOLOGY CORP.
    Inventors: Chun-Chieh Chen, Yi-Wen Tsai, Ching-Yao Huang, Ling-Cheng Tseng
  • Patent number: 11010679
    Abstract: Disclosed are systems and methods for autonomous computing replacing or augmenting a human user of computer programs, where access to internal operations of the computer program is not used. An application controller can use the display output of a computer program to determine a current state of the computer program, using the disclosed embodiments. For example, identity of menu options of the computer program can be determined from image frames obtained from the display output of the computer program and used to determine the current state of the computer program. The application controller can provide input commands to the computer program to execute the computer program from the current state to a destination state.
    Type: Grant
    Filed: June 25, 2020
    Date of Patent: May 18, 2021
    Inventor: Curtis Ray Robinson, Jr.
  • Patent number: 11002965
    Abstract: Systems and methods for computer-generated reality user hailing are described. Some implementations may include accessing sensor data captured using one or more sensors; detecting a person within a distance of a head-mounted display based on the sensor data; detecting a hail event based on the sensor data; and responsive to the hail event, invoking an alert using the head-mounted display.
    Type: Grant
    Filed: June 10, 2019
    Date of Patent: May 11, 2021
    Assignee: Apple Inc.
    Inventor: Golnaz Abdollahian
  • Patent number: 11000760
    Abstract: Proposed is a controller which can suppress an amount of protrusion of an operation member from an external surface of a chassis while operability of the operation member is maintained. A controller including a chassis, and an operation member which is slidable along an extension direction of the chassis with a predetermined position as a reference, and is rotatable in a circumferential direction of the chassis with the predetermined position as the reference, and at least a part of which is fitted into a recess section provided in an external surface of the chassis.
    Type: Grant
    Filed: October 17, 2017
    Date of Patent: May 11, 2021
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Tetsunori Nakayama, Akichika Tanaka, Masaki Hanzawa, Yujin Morisawa, Alexis Andre
  • Patent number: 10990260
    Abstract: An electronic device includes a fingerprint sensor and one or more processors operable with the fingerprint sensor. One or more motion detectors are also operable with the one or more processors. The one or more processors determine with the fingerprint sensor, a direction of rotation of an object rotating, and in contact with, the fingerprint sensor. The one or more motion detectors detect whether the electronic device is rotating in three-dimensional space. The one or more processors then select and perform a first control operation when the object is rotating in a first axial direction and the electronic device is substantially stationary. Alternatively, the one or more processors select and perform a second control operation when the electronic device is rotating and the object is rotating in the first axial direction.
    Type: Grant
    Filed: August 23, 2018
    Date of Patent: April 27, 2021
    Assignee: Motorola Mobility LLC
    Inventors: John Gorsica, Thomas Merrell
  • Patent number: 10983605
    Abstract: A hand-held controller and a positional reference device for determining the position and orientation of the hand-held controller within a three-dimensional volume relative to the location of the positional reference device. An input/output subsystem in conjunction with processing and memory subsystems can receive a reference image data captured by a beacon sensing device combined with inertial measurement information from inertial measurement units within the hand-held controller. The position and orientation of the hand-held controller can be computed based on the linear distance between a pair of beacons on the positional reference device and the reference image data and the inertial measurement information.
    Type: Grant
    Filed: August 4, 2017
    Date of Patent: April 20, 2021
    Assignee: Marbl Limited
    Inventor: Matthew G. Fonken
  • Patent number: 10984604
    Abstract: A method of implementing a plurality of contextual applications within a mixed reality (MR) environment on an MR-capable device of a user is disclosed. At least one real-world object is identified in the MR environment by applying an object recognition algorithm to one or more attributes of the at least one real-world object that are captured by sensors of the MR-capable device. A first contextual application of the plurality of contextual applications is used to determine an association between a first set of contextual triggers and a second contextual application of the plurality of contextual applications. A second contextual application is initiated based on a satisfying of the at least one contextual trigger. A function is invoked within the second contextual application based on an interaction of the user with at least one virtual object satisfying a second set of contextual triggers associated with the second contextual application.
    Type: Grant
    Filed: July 28, 2020
    Date of Patent: April 20, 2021
    Assignee: Unity IPR ApS
    Inventors: Sylvio Herve Drouin, Gregory Lionel Xavier Jean Palmaro, Dioselin Alejandra Gonzalez Rosillo
  • Patent number: 10978090
    Abstract: A method for operating a voice trigger is provided. In some implementations, the method is performed at an electronic device including one or more processors and memory storing instructions for execution by the one or more processors. The method includes receiving a sound input. The sound input may correspond to a spoken word or phrase, or a portion thereof. The method includes determining whether at least a portion of the sound input corresponds to a predetermined type of sound, such as a human voice. The method includes, upon a determination that at least a portion of the sound input corresponds to the predetermined type, determining whether the sound input includes predetermined content, such as a predetermined trigger word or phrase. The method also includes, upon a determination that the sound input includes the predetermined content, initiating a speech-based service, such as a voice-based digital assistant.
    Type: Grant
    Filed: May 20, 2020
    Date of Patent: April 13, 2021
    Assignee: Apple Inc.
    Inventors: Justin Binder, Samuel D. Post, Onur Tackin, Thomas R. Gruber
  • Patent number: 10967253
    Abstract: An operating device includes a movable part capable of moving between a first position and a second position, with the movable part being capable of operation by the finger of the user gripping the operating device. The operating device includes a regulating part that regulates a range in which the movable part can move, and a control part that determines the amount of regulation in which the movable part can move and provides the regulating part with an instruction to regulate the range in which the movable part can move according to the amount of regulation which has been determined.
    Type: Grant
    Filed: May 19, 2017
    Date of Patent: April 6, 2021
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Yusuke Nakagawa, Ikuo Yamano, Shinichi Hirata, Yuichi Machida, Yoichi Nishimaki
  • Patent number: 10959863
    Abstract: The present invention discloses a multi-dimensional surface electromyogram signal prosthetic hand control method based on principal component analysis. The method comprises the following steps. Wear an armlet provided with a 24-channel array electromyography sensor to a front arm of a subject, and respectively wear five finger joint attitude sensors at a distal phalanx of a thumb and at middle phalanxes of remaining fingers of the subject. Perform independent bending and stretching training on the five fingers of the subject, and meanwhile, collect data of an array electromyography sensor and data of the finger joint attitude sensors. Decouple the data of the array electromyography sensor by principal component analysis to form a finger motion training set. Perform data fitting on the finger motion training set by a neural network method, and construct a finger continuous motion prediction model. Predict a current bending angle of the finger through the finger continuous motion model.
    Type: Grant
    Filed: May 23, 2018
    Date of Patent: March 30, 2021
    Assignee: SOUTHEAST UNIVERSITY
    Inventors: Aiguo Song, Xuhui Hu, Hong Zeng, Baoguo Xu, Huijun Li
  • Patent number: 10964188
    Abstract: A missing child prevention support system is provided and includes: a grouping part configured to recognize a group of users who are facility users entering a facility and generate user group information indicating a user group; an image acquisition part configured to acquire facility images including images of the users from imaging devices of the facility; a guide control part configured to control an operation of a movable guiding device performing guiding for the users in the facility; a guide grouping specifying part configured to specify the user group of the users for which the guiding device performs the guiding; and a missing child estimation part configured to estimate an unguided user who is a user not belonging to the user group as a potential missing child when the unguided user is shown in the facility images.
    Type: Grant
    Filed: March 3, 2020
    Date of Patent: March 30, 2021
    Assignee: Honda Motor Co., Ltd.
    Inventor: Haruomi Higashi
  • Patent number: 10963073
    Abstract: A display control device includes a reception unit configured to receive sensor information from an operating device, a pointer display control unit configured to determine a motion of the operating device on the basis of the sensor information, and to display and control a pointer in conjunction with the determined motion of the operating device, and an identification display control unit configured to calculate a rotation angle of the operating device on the basis of the sensor information, and to execute control to present identification display at a position where the pointer is displayed, when the calculated rotation angle comes to a switching angle.
    Type: Grant
    Filed: August 29, 2018
    Date of Patent: March 30, 2021
    Assignee: SHARP KABUSHIKI KAISHA
    Inventor: Hiroya Saito
  • Patent number: 10958834
    Abstract: The present invention is a system for assembling panoramic images of a scene captured by a panoramic image capture device having a decoding unit configured to read image content data from the image capture device, an information reading unit configured to extract device parameters about the capture device, and an image processing unit configured to assemble an output image using the image content data and the device parameters.
    Type: Grant
    Filed: July 21, 2017
    Date of Patent: March 23, 2021
    Assignee: IMMERVISION, INC.
    Inventors: Patrice Roulet, Xiaojun Du, Pierre Konen, Simon Thibault, Jocelyn Parent, Pascale Nini, Alessandro Gasparini, Valentin Bataille, Jhinseok Lee
  • Patent number: 10949639
    Abstract: An exemplary embodiment of the present inventive concept provides a display device including: a display unit including a plurality of pixels disposed on a display area; a display controller configured to control the display unit; a sensor including a plurality of first sensing electrodes and a plurality of second sensing electrodes disposed in the display area; and a sensor controller configured to recognize a touch of a user inputted into the sensor in a touch sensing mode and to recognize a fingerprint of the user inputted into the sensor in a fingerprint sensing mode, wherein the sensor controller changes a mode to the fingerprint sensing mode when no touch is inputted for a predetermined time period in the touch sensing mode and changes the mode to the touch sensing mode when authorization on a fingerprint inputted into the sensor is succeeded in the fingerprint sensing mode.
    Type: Grant
    Filed: September 9, 2019
    Date of Patent: March 16, 2021
    Inventors: Won Ki Hong, Jong Seo Lee
  • Patent number: 10949027
    Abstract: An interactive mid-air display including a display that presents a graphical user interface (GUI), optics projecting and rotating the GUI above the display such that the GUI is visible in-air in a plane rotated away from the display, a sensor including light emitters projecting beams towards the projected GUI, light detectors detecting reflections of the beams by objects interacting with the projected GUI, and a lens structure maximizing detection at each detector for light entering the lens structure at a respective location at a specific angle ?, whereby for each emitter-detector pair, maximum detection of light corresponds to the object being at a specific location in the projected GUI, in accordance with the locations of the emitter and detector and the angle ?, and a processor mapping detections of light for emitter-detector pairs to corresponding locations in the projected GUI, and translating the mapped locations to coordinates on the display.
    Type: Grant
    Filed: March 26, 2019
    Date of Patent: March 16, 2021
    Assignee: NEONODE INC.
    Inventors: Thomas Eriksson, Alexander Jubner, Rozita Teymourzadeh, Stefan Holmgren, Lars Sparf, Bengt Henry Hjalmar Edlund, Richard Berglind
  • Patent number: 10949160
    Abstract: A display apparatus and a controlling method thereof are provided. The display apparatus includes: a display; a communicator including circuitry configured to communicate with an electronic apparatus; a processor configured to execute instructions to: identify whether blank regions are included in an image for mirroring based on the image for mirroring being received from the electronic apparatus through the communicator, and control to display, on the display, an image of a remaining region excluding the blank regions in the received image based on the blank regions being identified in the received image in a state in which the display is oriented in a predetermined direction.
    Type: Grant
    Filed: September 30, 2019
    Date of Patent: March 16, 2021
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventor: Taehoon Lee
  • Patent number: 10942607
    Abstract: A manipulation detection device includes a first manipulation detection process based on detection of light emission of an electronic pen (a first manipulation object) and a second manipulation detection process based on detection of a shadow of a finger (a second manipulation object) by radiation of illumination light. An image sensor captures an image of the electronic pen and an image of the finger, and image signal processing units perform a contrast adjustment of the captured image. Here, a state of the contrast adjustment performed by the image signal processing unit differs between the captured image of the electronic pen and the captured image of the finger. Manipulation detecting units execute a manipulation detection process for the electronic pen and the finger using the captured image which has undergone the contrast adjustment.
    Type: Grant
    Filed: November 13, 2015
    Date of Patent: March 9, 2021
    Assignee: MAXELL, LTD.
    Inventors: Takehiro Niikura, Takashi Matsubara, Naoki Mori
  • Patent number: 10942566
    Abstract: Provided are a navigation service assistance system based on a driver line of sight and a vehicle navigation system using the same. The navigation service assistance system recognizes in real time a direction at which a driver looks and a line of sight of the driver, using a sensor. The navigation service assistance system matches external image data and coordinates information based on the line of sight of the driver, using a map controller and extracts detailed information about a text, a place, a road, or the like at a matched position. Here, the map controller assists in enabling automatically extracted text information or a building, a place, a road, or the like to be set or changed as an intermediate point or a destination with only a simple operation of the driver.
    Type: Grant
    Filed: September 10, 2019
    Date of Patent: March 9, 2021
    Assignee: LG ELECTRONICS INC.
    Inventors: Soojung Jeon, Junyoung Yu, Dae Geun Ha
  • Patent number: 10936084
    Abstract: Techniques are described for notebook hinge sensors. For example, a computing device may comprise a housing having a processor circuit and an input device, the input device arranged on a side of the housing, a lid having a digital display arranged on a side of the lid, a hinge arranged to couple the housing and the lid, and a sensor module coupled to the processor circuit, the sensor module arranged inside the hinge and operative to capture motion input outside of the computing device.
    Type: Grant
    Filed: October 24, 2019
    Date of Patent: March 2, 2021
    Assignee: INTEL CORPORATION
    Inventor: James M. Okuley
  • Patent number: 10928921
    Abstract: A gesture based user interface includes a movement monitor configured to monitor a user's hand and to provide a signal based on movements of the hand. A processor is configured to provide at least one interface state in which a cursor is confined to movement within a single dimension region responsive to the signal from the movement monitor, and to actuate different commands responsive to the signal from the movement monitor and the location of the cursor in the single dimension region.
    Type: Grant
    Filed: August 26, 2019
    Date of Patent: February 23, 2021
    Assignee: APPLE INC.
    Inventors: Amir Hoffnung, Micha Galor, Jonathan Pokrass, Roee Shenberg, Shlomo Zippel
  • Patent number: 10920357
    Abstract: The present invention relates to a washing apparatus and to a washing apparatus having a convenient user interface. More specifically, the present invention relates to a washing apparatus that provides a user interface that is concentrated, simple and intuitive.
    Type: Grant
    Filed: October 27, 2015
    Date of Patent: February 16, 2021
    Assignee: LG ELECTRONICS INC.
    Inventors: Jayoen Kim, Youngwoo Kim, Joohyeon Oh, Darae Kim