Gesture-based Patents (Class 715/863)
  • Patent number: 11289089
    Abstract: This disclosure proposes systems and methods to perform audio based projector control by a projector device to detect that a user is close to a projector and disable the projector when certain conditions are detected. The projector device may detect the user by performing voice activity detection (VAD) and/or breathing activity detection (BAD) on reference audio data generated by a reference microphone by the projector. In some examples, the projector device may determine that the user is located near the projector by performing beamforming on input audio data and/or comparing a first signal strength of the reference audio data to a second signal strength of the input audio data. The projector device may also implement two level device peripheral control architecture to provide additional safeguards to ensure that control mechanisms are in place even if a central processing unit (CPU) stops operating normally.
    Type: Grant
    Filed: June 23, 2020
    Date of Patent: March 29, 2022
    Assignee: Amazon Technologies, Inc.
    Inventors: Bijendra Singh, Dawit Teshome Habtegiorgis, Satya Ranganathan, Saadiah Gul Ahmed
  • Patent number: 11287905
    Abstract: Systems and methods for enhancing trackability of a passive stylus. A six degree of freedom (6DoF) location and orientation of a passive stylus may be tracked by a tracking system via a retroreflector system disposed on the passive stylus. Additionally, characteristic movements of one of a user's finger, hand, and/or wrist may be recognized by the tracking system. The passive stylus may useable to interact with a virtual 3D scene being displayed via a 3D display. A user input via the passive stylus may be determined based on the tracked 6DoF location and orientation of the passive stylus and/or the recognized characteristic movements. The retroreflector system may include multiple patterns of retroreflectors and one of the patterns may be a spiral pattern of retroreflectors disposed along a longitudinal axis of the passive stylus.
    Type: Grant
    Filed: March 2, 2021
    Date of Patent: March 29, 2022
    Assignee: ZSPACE, INC.
    Inventors: Kevin S. Yamada, Jonathan J. Hosenpud, Christian R. Larsen, David A. Chavez, Arthur L. Berman, Clifford S. Champion
  • Patent number: 11281742
    Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for selectively modifying live digital vector glyphs. For example, the disclosed system can use a vector description of a live vector glyph having a plurality of regions defined by a plurality of paths to determine a vector document object model including style information for the paths. The disclosed system can extract a color for a selected region from the style information for the paths (e.g., from a stylesheet) and then change the extracted color to a selected color. After modifying the color, the disclosed system can then generate an updated vector description with the modified region color and render the updated live vector glyph at a client device. The disclosed system thus updates the live vector glyph while maintaining the glyph as a live glyph.
    Type: Grant
    Filed: August 8, 2019
    Date of Patent: March 22, 2022
    Assignee: Adobe Inc.
    Inventors: Nirmal Kumawat, Praveen Kumar Dhanuka, Arushi Jain
  • Patent number: 11276144
    Abstract: An information processing apparatus realizing an enlargement function without system-level customization is provided. The information processing apparatus includes an application unit, an enlargement control unit, and a screen control unit. The application unit generates and draws an image in a normal display area. The enlargement control unit enlarges the image drawn in the normal display area, and generates and draws an enlarged image including part of the enlarged image in an expansion display area. The screen control unit displays the image drawn in the normal display area on a display when the enlargement function is invalid, and displays the enlarged image drawn in the expansion display area on the display when the enlargement function is valid.
    Type: Grant
    Filed: November 25, 2019
    Date of Patent: March 15, 2022
    Assignee: Canon Kabushiki Kaisha
    Inventors: Hideshi Ichimi, Masayuki Yamada
  • Patent number: 11275446
    Abstract: A computer-implemented method for enabling gesture-based interactions between a computer program and a user is disclosed. According to certain embodiments, the method may include initiating the computer program. The method may also include detecting that a condition has occurred. The method may also include activating a gesture-based operation mode of the computer program. The method may also include receiving gesture data generated by a sensor, the gesture data representing a gesture performed by the user. The method may further include performing a task based on the gesture data.
    Type: Grant
    Filed: July 7, 2017
    Date of Patent: March 15, 2022
    Assignee: Capital One Services, LLC
    Inventors: David Franklin, Van Shea Sedita, Stephen Simpson
  • Patent number: 11275499
    Abstract: In accordance with some embodiments, a method is performed at a device with one or more processors, non-transitory memory, a display, and an input device. The method includes displaying, on the display, a first column and a second column in an application region. The method includes detecting, via the input device, a first user input that starts at a location at a top of the application region and moves toward an edge of the application region. The method includes, in response to detecting the first user input, changing the number of columns displayed in the application region, wherein changing the number of columns displayed in the application region includes, in accordance with a determination that the first user input was in a first direction, displaying a third column in the application region while maintaining display of the first column and the second column in the application region.
    Type: Grant
    Filed: May 31, 2017
    Date of Patent: March 15, 2022
    Assignee: APPLE INC.
    Inventors: Bruce D. Nilo, Jason Clay Beaver
  • Patent number: 11269401
    Abstract: Holographic image-guidance can be used to track an interventional device during a non-vascular percutaneous procedure. The holographic image guidance can be provided by a head-mounted device by transforming tracking data and body image data to a common coordinate system and creating a holographic display relative to a patient's body to track the interventional device during the non-vascular percutaneous procedure. The holographic display can also include graphics to provide guidance for the physical interventional device as it travels through the patient's anatomy.
    Type: Grant
    Filed: November 9, 2020
    Date of Patent: March 8, 2022
    Assignee: THE CLEVELAND CLINIC FOUNDATION
    Inventors: Karl West, Jeffrey H. Yanof
  • Patent number: 11269981
    Abstract: An information displaying method for a terminal device, and a terminal device, where the method includes displaying, by the terminal device, prompt information on a screen of the terminal device when the terminal device is in a screen-locked state, collecting, by the terminal device, a user face image using a camera of the terminal device, and displaying, by the terminal device on the screen of the terminal device, content information corresponding to the prompt information when the user face image matches an image template stored in the terminal device. According to the information displaying method, related information is displayed through facial recognition without releasing the screen-locked state of a mobile phone such that convenience of information displaying is improved while information security is ensured.
    Type: Grant
    Filed: February 14, 2019
    Date of Patent: March 8, 2022
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Changqi Hu, Dawei Li, Xingguang Song, Jiping Liao
  • Patent number: 11262889
    Abstract: A mobile computing device runs multiple activities concurrently and provides at least two modes for interacting with the activities. The user may toggle between the modes as desired. In a full-screen mode, one activity occupies substantially an entire display screen. In a windowed mode, the activity is visible within a window, and a portion of at least one other window is also visible. In the windowed mode, the user can cause windows to move, thereby changing focus from one activity to another. For example, the window having focus can be moved off the screen, to be replaced by a new window that is then given focus. The windows are ordered in a sequence and move in concert with one another; pushing one window off one edge of the screen causes a new window to appear at the opposite edge. A persistent positional relationship can be established among windows.
    Type: Grant
    Filed: October 22, 2020
    Date of Patent: March 1, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Matias Gonzalo Duarte, Daniel Marc Gatan Shiplacoff, Jeremy Godfrey Lyon, Paul Mercer, Ralph Thomas
  • Patent number: 11256406
    Abstract: A processing apparatus includes a chuck table for holding a workpiece thereon, a processing unit for processing the workpiece held on the chuck table, a touch panel for entering processing conditions, and a control unit for controlling the touch panel. The control unit controls the touch panel to display a plurality of input fields corresponding to a plurality of items included in the processing conditions, and controls the touch panel to display a copy processing key and a paste processing key when one of the input fields is selected. The control unit copies information entered in the selected one of the input fields when the copy processing key is selected, and enters information that has been copied in advance into the selected one of the input fields when the paste processing key is selected.
    Type: Grant
    Filed: July 30, 2020
    Date of Patent: February 22, 2022
    Assignee: DISCO CORPORATION
    Inventor: Takafumi Omori
  • Patent number: 11256411
    Abstract: An interface performs a flick operation with a button selected from buttons of representative characters for each of the syllabic lines of the Japanese syllabary that are array-displayed on a touch panel so as to specify any one of Japanese characters assigned to the representative character in advance. The interface includes a storage unit that stores association information in which up, down, left, and right directions are set to each of the characters assigned to the representative characters in association with each button and a guide image display processing unit that displays a guide image guiding arrangement directions set to the characters assigned to the representative characters prior to selection of a button of the representative character in an outside of an array display region of the representative character.
    Type: Grant
    Filed: May 18, 2017
    Date of Patent: February 22, 2022
    Assignee: SHARP KABUSHIKI KAISHA
    Inventors: Shota Kaneko, Tohru Nishikawa
  • Patent number: 11249557
    Abstract: Methods and apparatus for gesture-based control of a device in a multi-user environment are described. The methods prioritize users or gestures based on a predetermined priority ruleset. A first-user-in-time ruleset prioritizes gestures based on when in time they were begun by a user in the camera FOV. An action-hierarchy ruleset prioritizes gestures based on the actions they correspond to, and the relative positions of those actions within an action hierarchy. A designated-master-user ruleset prioritizes gestures performed by an explicitly designated master user. Methods for designating a new master user and for providing gesture-control-related user feedback in a multi-user environment are also described.
    Type: Grant
    Filed: May 5, 2021
    Date of Patent: February 15, 2022
    Assignee: Huawei Technologies Co. Ltd.
    Inventors: Wei Zhou, Mona Hosseinkhani Loorak, Gaganpreet Singh, Xiu Yi, Juwei Lu, Wei Li
  • Patent number: 11250253
    Abstract: A handwriting input display apparatus causes display means to display a stroke generated by an input made by using input means to a screen as a handwritten object. The apparatus includes display control means for causing the display means to display character string candidates including a handwriting recognition candidate when the handwritten object does not change for a predetermined time. When the handwriting recognition candidate is selected, the display control means causes the display means to erase a display of the character string candidates and a display of the handwritten object, and causes the display means to display a character string object at a position where the erased handwritten object was displayed. When selection of the handwriting recognition candidate is not performed for a predetermined time and the display of the character string candidates is erased, the display control means causes the handwritten object to be kept displayed.
    Type: Grant
    Filed: June 12, 2019
    Date of Patent: February 15, 2022
    Assignee: RICOH COMPANY, LTD.
    Inventor: Kiyoshi Kasatani
  • Patent number: 11247130
    Abstract: A system and method for providing interactive media streaming is provided. Media and a set of activity data associated with the media may be stored in memory. The set of activity data may include information about the activity and one or more objects shown in the activity. A user selection of the media may be detected. Object information for one or more object images displayed may be retrieved from the associated set of activity data. A list of retrieved object information may be displayed.
    Type: Grant
    Filed: April 9, 2019
    Date of Patent: February 15, 2022
    Assignee: SONY INTERACTIVE ENTERTAINMENT LLC
    Inventors: Mischa Stephens, Dustin Shawn Clingman, Adil Sherwani
  • Patent number: 11249773
    Abstract: In one embodiment, a method includes detecting a user input comprising an incomplete gesture performed by one or more hands of a first user by a client system associated with the first user; selecting one or more candidate gestures from a plurality of pre-defined gestures by the client system based on a personalized gesture-recognition model, wherein each of the candidate gestures is associated with a confidence score representing a likelihood the first user intended to input the respective candidate gesture, and presenting one or more suggested inputs corresponding to one or more of the candidate gestures at the client system.
    Type: Grant
    Filed: September 2, 2020
    Date of Patent: February 15, 2022
    Assignee: Facebook Technologies, LLC.
    Inventors: William Crosby Presant, Francislav P. Penov, Anuj Kumar
  • Patent number: 11243637
    Abstract: Methods, systems, devices, and apparatus, including computer program products, for adjusting a graphical user interface. A motion of a device is detected. A graphical user interface of the device is adjusted in response to the detected motion.
    Type: Grant
    Filed: April 25, 2017
    Date of Patent: February 8, 2022
    Assignee: Apple Inc.
    Inventor: John O. Louch
  • Patent number: 11237641
    Abstract: One embodiment provides a method, including: receiving, at an information handling device, selection input on a virtual object from a user; identifying, using at least one sensor, a direction that a palm of the user is oriented towards; determining, using a processor, whether movement of the palm is detected toward the direction; and adjusting, responsive to determining that the movement of the palm is detected toward the direction, a position of the virtual object toward the direction. Other aspects are described and claimed.
    Type: Grant
    Filed: March 27, 2020
    Date of Patent: February 1, 2022
    Assignee: Lenovo (Singapore) Pte. Ltd.
    Inventors: Russell Speight VanBlon, Arnold S. Weksler, Nathan J. Peterson, John Carl Mese, Mark Patrick Delaney
  • Patent number: 11240481
    Abstract: A wallpaper system presents a first wallpaper image of a wallpaper video to a user and receives, via a user input device, one or both of: (i) a spatial user input selection, and (ii) a time user input selection from the user to apply to the wallpaper video. In response to detecting one or both of: (i) the spatial user input selection, and (ii) the time user input selection, the wallpaper system determines one or both of: (i) a respective spatial movement parameter within a wallpaper video associated with the spatial user input selection, and (ii) a respective time coordinate within the wallpaper video associated with the time user input selection. Wallpaper system presents, via the image display, a second wallpaper image associated with one or both of: (i) the respective spatial movement parameter, and (ii) the respective time coordinate.
    Type: Grant
    Filed: December 5, 2019
    Date of Patent: February 1, 2022
    Assignee: Snap Inc.
    Inventors: Sagi Katz, Guy Melamed
  • Patent number: 11231774
    Abstract: The present disclosure discloses a method for executing an operation action on a display screen and a device for executing an operation action. Firstly, a gazing position of an operator's eyes on the display screen and a corresponding operation position of the operator's operating portion on the display screen are determined, then a corresponding operation is executed for content displayed on the display screen according to the operation action of the operating portion, when it is determined that the gazing position of the operator's eyes on the display screen is consistent with the corresponding operation position of the operator's operating portion on the display screen.
    Type: Grant
    Filed: November 9, 2017
    Date of Patent: January 25, 2022
    Assignee: BOE TECHNOLOGY GROUP CO., LTD.
    Inventors: Yanling Han, Xue Dong, Haisheng Wang, Chun-wei Wu, Xiaoliang Ding, Yingming Liu
  • Patent number: 11231829
    Abstract: Methods and apparatus for controlling a computing device using gesture inputs. The gesture inputs may be operative to move screens corresponding to applications executing on the handheld computing device from one display to another. Additionally, a multi portion gesture may be used to target different screens. For example, a first portion of the gesture may maintain or “pin” a screen in a display such that a second portion of the gesture is operative to move a different screen behind the pinned application.
    Type: Grant
    Filed: June 11, 2019
    Date of Patent: January 25, 2022
    Assignee: Z124
    Inventor: Sanjiv Sirpal
  • Patent number: 11232419
    Abstract: Systems and methods for initiating and/or facilitating a financial transaction in response to detecting and translating a spatial gesture may be provided. A payor transaction device may be capable of detecting, via a motion-detecting device, a payor spatial gesture corresponding to a payment gesture of one or more predetermined spatial gestures and, responsive to detecting the payor spatial gesture, receiving payee account information from a payee transaction device. The payor transaction device may also be capable of transmitting, to a payor computing device, transaction data comprising the payee account information and data indicative of the payor spatial gesture. The payor computing device may be capable of transmitting at least a portion of the transaction data to a financial service provider terminal to enable the financial service provider terminal to facilitate the requested transaction.
    Type: Grant
    Filed: April 8, 2020
    Date of Patent: January 25, 2022
    Assignee: CAPITAL ONE SERVICES, LLC
    Inventors: David Wurmfeld, Tyler Locke, Adam Koeppel
  • Patent number: 11226675
    Abstract: Various embodiments of the present invention provide an apparatus and a method for adaptively configuring a user interface in an electronic device. According to various embodiments, an electronic device may comprise: a memory for storing instructions; a communication interface; and at least one processor connected to the communication interface and the memory, wherein the at least one processor is configured to: receive at least one signal which is transmitted by an external electronic device and is used to determine a user's characteristic related to the electronic device and the external electronic device, in response to detection of the user's input in the external electronic device; determine a field of view (FOV) for the user on the basis of the at least one signal; and execute the stored instructions in order to display a content for virtual reality (VR) on the basis of the determined FOV.
    Type: Grant
    Filed: November 5, 2018
    Date of Patent: January 18, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Yeon Hee Roh, Dong Ho Koo, Hyeon Ju Lee, Stephanie Ahn, Young Hak Oh
  • Patent number: 11221689
    Abstract: One embodiment provides an information handling device, including: a processor; a memory device that stores instructions executable by the processor to: receive, at an electronic device, a drawing input; receive, at the electronic device, secondary user input; and modify, the drawing input based on the secondary user input; wherein the secondary input is voice input. Other aspects are described and claimed.
    Type: Grant
    Filed: February 27, 2015
    Date of Patent: January 11, 2022
    Assignee: Lenovo (Singapore) Pte. Ltd.
    Inventors: Antoine Roland Raux, Grigori Zaitsev
  • Patent number: 11221748
    Abstract: Systems, interfaces, and methods for implementing the systems and interfaces include a dynamic environment generation subsystem that changes objects and subobjects based on locations of the motion sensors and/or the nature, time and/or location of sensed motion and include selection attractive movement as the selection protocol, where a selection object is used to discriminate between selectable objects and attract a target object toward the selection objects, where the direction and speed of the motion controls, discriminates, attracts, and activates the selected objects.
    Type: Grant
    Filed: May 2, 2018
    Date of Patent: January 11, 2022
    Assignee: QUANTUM INTERFACE, LLC
    Inventors: Damon Chandler, Jonathan Josephson
  • Patent number: 11218586
    Abstract: A method includes obtaining, by a mobile terminal, a motion parameter of the mobile terminal, determining whether the motion parameter meets a pick-up parameter threshold or a put-down parameter threshold, determining that the mobile terminal is picked up when the motion parameter meets the pick-up parameter threshold, obtaining a sight line parameter of a user, and switching the screen to an on state when a visual center of the user is on a screen of the mobile terminal and the screen is in an off state.
    Type: Grant
    Filed: September 9, 2016
    Date of Patent: January 4, 2022
    Assignee: HONOR DEVICE CO., LTD.
    Inventors: Changxue Lu, Jinhua Bai, Liudong Xiong, Jinsong Zhou, Yide Wei
  • Patent number: 11194401
    Abstract: A set of gesture commands are learned. Each gesture in the set of gesture commands controls a function of one or more computing devices. A first gesture received from a user is identified. A determination is made whether at least one computing device associated with the identified gesture is active. In response to determining that at least one computing device associated with the identified gesture is active, a determination is made whether the user associated with the identified gesture is recognized. In response to determining that the user associated with the identified gesture is recognized, an action to perform on at least one computing device associated with the identified gesture is determined. The determined action is implemented.
    Type: Grant
    Filed: January 13, 2020
    Date of Patent: December 7, 2021
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Roxana Monge Nunez, Cesar Augusto Rodriguez Bravo
  • Patent number: 11188168
    Abstract: In accordance with some embodiments, a computing device is described. In response to receiving an input corresponding to a first gesture, the device determines an updated location for an object selection indicator within a user interface in accordance with the first gesture. In accordance with a determination that the updated location is within a portion of the user interface that corresponds to a predefined region of the display, the device sends instructions to the display for moving the object selection indicator to the updated location without scrolling the user interface. In accordance with a determination that the updated location is outside of the portion of the user interface, the device sends instructions to the display for moving the object selection indicator to the updated location and scrolling the user interface so as to display the updated location within the predefined region.
    Type: Grant
    Filed: September 12, 2019
    Date of Patent: November 30, 2021
    Assignee: Apple Inc.
    Inventor: Julian Missig
  • Patent number: 11188225
    Abstract: This application provides a touch control method and an apparatus, and relates to the field of communications technologies. The method includes: (S601) obtaining, by a terminal, a first touch operation entered by a user on a touchscreen; (S602, S603, and S604) and mapping, by the terminal when the first touch operation is performed on a first preset area in a target interface, the first touch operation to a second touch operation, so that a target application responds to the second touch operation, where the target interface is any interface that is presented by the target application and that covers the first preset area, and the target application is running in the foreground.
    Type: Grant
    Filed: November 7, 2017
    Date of Patent: November 30, 2021
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Jiang Rui, Zhubiao Xue, Bo Xu
  • Patent number: 11188296
    Abstract: According to one or more aspects, systems and methods for human-vehicle interaction are described herein. A touchpad may include a first touchpad zone and a second touchpad zone. A display may include a first display zone and a second display zone, which correspond to the first touchpad zone and the second touchpad zone, respectively. A processor may execute instructions stored on a memory to perform rendering a first application in a first mode within the first display zone of the display and rendering a second application in a second mode within the second display zone of the display. The processor, in response to an input from the touchpad, may render the already running second application in a first mode within the first display zone of the display and render the first application in a second mode within the second display zone of the display.
    Type: Grant
    Filed: July 3, 2019
    Date of Patent: November 30, 2021
    Assignee: HONDA MOTOR CO., LTD.
    Inventors: Steven Feit, Ross C. Miller, Jessica Champi
  • Patent number: 11188624
    Abstract: A first electronic device is configured to operate in a restricted mode of operation, which restricted mode may be terminated or continued by one or more remotely located authorization devices, according to predetermined criteria. In a restricted mode, a first set of permitted applications stored on the first electronic device are executable, and a first set of data is accessible. While operating in the restricted mode, the first device detects a termination condition of the restricted mode and transmits an indication of the termination condition to one or more authorization devices. After transmitting the request, the first electronic devices receives an indication that the restricted mode of the operation has been continued according to predetermined criteria. Responsive to receiving the indication, the first electronic device continues to operate in the restricted mode according to the predetermined criteria.
    Type: Grant
    Filed: January 19, 2018
    Date of Patent: November 30, 2021
    Assignee: Apple Inc.
    Inventors: Donald Walter Pitschel, Maria Dimitrova Ioveva, Christopher Brian Fleizach, Elizabeth Caroline Furches Cranfill
  • Patent number: 11182936
    Abstract: The present disclosure provides drawing content processing method and device for a terminal apparatus. The method includes positioning a drawing focus of a user based on a drawing operation of the user and processing drawing content displayed on a screen of the terminal apparatus based on the positioned drawing focus.
    Type: Grant
    Filed: August 14, 2019
    Date of Patent: November 23, 2021
    Inventors: Weihua Zhang, Shilei Liu
  • Patent number: 11175811
    Abstract: Embodiments of the present invention relate to the field of terminal application technologies, and provide a method, an apparatus, and a terminal for processing notification information. Therefore, an efficient operation manner for processing notification information is provided, which can simplify operation steps and improve usability and controllability of a device. The method is: after a user display operation is detected, and a display instruction corresponding to the user display operation is triggered, determining a target application program corresponding to notification information; and when it is determined that a screen display status meets a condition, adjusting, according to a preset adjustment policy corresponding to the display instruction, a window corresponding to the target application program. The embodiments of the present invention are used to process notification information of an intelligent terminal device.
    Type: Grant
    Filed: September 5, 2019
    Date of Patent: November 16, 2021
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Hao Jing, Dian Fu, Yahui Wang, Xiaojuan Li
  • Patent number: 11176237
    Abstract: In some embodiments, a first device performs ranging operations to allow a user to access the first device under one of several user accounts without providing device-access credentials. For example, when a second device is within a first distance of the first device, the first device determines that the second device is associated with a first user account under which a user can access (e.g., can log into) the first device. In response to the determination, the first device enables at least one substitute interaction (e.g., a password-less UI interaction) to allow the first device to be accessed without receiving access credentials through a user interface. In response to detecting an occurrence of the substitute interaction, the user is allowed to access the first device under the first user account. In some embodiments, the substitute interaction occurs while the first device is logged into under a second user account.
    Type: Grant
    Filed: June 1, 2018
    Date of Patent: November 16, 2021
    Assignee: Apple Inc.
    Inventors: Wade Benson, Alexander R. Ledwith, Marc J. Krochmal, John J. Iarocci, Jerrold V. Hauck, Michael Brouwer, Mitchell D. Adler, Yannick L. Sierra, Libor Sykora
  • Patent number: 11176751
    Abstract: System, method, and non-transitory computer readable medium for presenting images on a mobile device. Images are presented by monitoring the location and the orientation of the mobile device, requesting previously captured images corresponding to where the previously captured images were captured in relation to the location from a server, receiving the requested previously captured images from the server, selecting images from the requested previously captured images responsive to the location and the orientation of the mobile device, generating overlay images from the selected images including image icons associated with the selected images, presenting the overlay images on an optical assembly, receiving an image selection identifying one of the image icons in the presented overlay images, and display the selected image associated with the identified image icon on the viewing area of the optical assembly.
    Type: Grant
    Filed: March 17, 2020
    Date of Patent: November 16, 2021
    Assignee: Snap Inc.
    Inventors: David Meisenholder, Celia Mourkogiannis, Donald Giovannini
  • Patent number: 11170539
    Abstract: A display control unit that controls presence or absence of a display item on a display unit based on a display order of display items determined according to environment information or user information, by using a change in behavior of a user as a trigger is provided, such that an influence of the display item on a view of the user is reduced and the user can comfortably experience an AR superimposition technology.
    Type: Grant
    Filed: October 29, 2018
    Date of Patent: November 9, 2021
    Assignee: SONY CORPORATION
    Inventor: Soichiro Inatani
  • Patent number: 11169618
    Abstract: A gesture control system includes a processor, the processor in communication with a plurality of sensors. The processor is configured to perform the steps of detecting, using the plurality of sensors, a gesture in a volume occupied by a plurality of occupants, analyzing a prior knowledge to associate the gesture with one of the plurality of occupants, and generating an output, the output being determined by the gesture and the one of the plurality of occupants.
    Type: Grant
    Filed: December 7, 2020
    Date of Patent: November 9, 2021
    Assignees: HONDA MOTOR CO., LTD., EDGE 3 TECHNOLOGIES, INC.
    Inventors: Stuart Yamamoto, Matt Conway, Graeme Asher, Matt McElvogue, Churu Yun, Tarek El Dokor, Josh King, James E. Holmes, Jordan Cluster
  • Patent number: 11169598
    Abstract: An apparatus configured to: present a virtual reality space having at least one defined and non-defined region; control a point-of-view location and a direction-of-view orientation based on sensors configured to sense the user in a real-world play space; receive input to move by means other than said sensors; determine if the requested point-of-view location is allowed or not allowed wherein a location is not allowed if any physical locations in the play space correspond to point-of-view locations in the virtual reality space that lie within a non-defined region and if the requested point-of-view location is not allowed, determine at least one of: (i) a compromise point-of-view location; (ii) a compromise direction-of-view orientation; (iii) a compromise point-of-view location and direction-of-view orientation; (iv) a compromise physical position of the user in the real-world play space; and present the virtual reality space from/with the at least one of (i), (ii), (iii) and (iv).
    Type: Grant
    Filed: January 3, 2020
    Date of Patent: November 9, 2021
    Assignee: NOKIA TECHNOLOGIES OY
    Inventors: Jussi Artturi Leppänen, Sujeet Shyamsundar Mate
  • Patent number: 11169659
    Abstract: A folder management method and device. The method includes: displaying a folder icon comprising a set of icons of at least two applications, and the set of icons is displayed as a thumbnail icon, and, in the thumbnail icon, each of the icons of the at least two applications is displayed in a shrunk size, and the folder icon further comprising an enlarged first icon associated with a first application, wherein the enlarged first icon is displayed adjacent to the thumbnail icon without the first icon, and wherein a size of the enlarged first icon is a same size as the thumbnail icon. The first application is determined according to a use time sequence or other factors. In this way, icons, of some applications, in the folder icon can be enlarged for display, which facilitates management of applications in the folder.
    Type: Grant
    Filed: September 15, 2020
    Date of Patent: November 9, 2021
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Jian Chen, Jingyu Zhang, Qiang Zhang
  • Patent number: 11163372
    Abstract: An example operation includes one or more of receiving, by a computer associated with a transport, a gait of an individual from at least one camera associated with the transport, validating, by the computer, the gait, receiving, by the computer, a gesture of the individual from the at least one camera, validating, by the computer, the gesture, and performing, by the computer, one or more functions based on the validated gait and the validated gesture.
    Type: Grant
    Filed: April 1, 2020
    Date of Patent: November 2, 2021
    Assignee: TOYOTA MOTOR NORTH AMERICA, INC
    Inventor: Stephen Paul McFarland, Jr.
  • Patent number: 11163387
    Abstract: An electronic device including a base member having a touch area defined inside a first closed-shape, the first closed-shape being a first imaginary line, and a peripheral area disposed adjacent to the touch area and defined outside the first closed-shape, and a touch sensor including a plurality of patterns disposed in the touch area to sense a touch from outside and a driving line disposed in the peripheral area and connected to a pattern disposed adjacent to the first closed-shape. The touch area includes a first area defined inside a second closed-shape being a second imaginary line defined in the touch area, and a second area defined outside the second closed-shape and surrounded by the first closed-shape, and an edge pattern disposed in the second area having an area substantially equal to or greater than approximately one-half of an area of a center pattern disposed in the first area.
    Type: Grant
    Filed: February 13, 2020
    Date of Patent: November 2, 2021
    Assignee: Samsung Display Co., Ltd.
    Inventors: Byeongkyu Jeon, Hyungchul Kim, Jungmok Park, Heewoong Park
  • Patent number: 11163422
    Abstract: A device and method and graphical user interface for positioning a selection and selecting text on a mobile computing device with a touch-sensitive display is described. This includes: displaying a selection having a selection start point and a selection end point within a text content having a text content type; determining the text content type; in response to determining that the text content type is editable text content, displaying the selection within the text content wherein the selection is a zero-length selection; in response to determining that the text content type is read-only text content, displaying the selection within the text content wherein the selection is a one-character-length selection; displaying a control icon; detecting a contact on the touch-sensitive display; and in response to detecting a change in a position of the contact beginning anywhere on the control icon, changing a position of the selection.
    Type: Grant
    Filed: November 27, 2019
    Date of Patent: November 2, 2021
    Inventor: David Graham Boyers
  • Patent number: 11163438
    Abstract: Disclosed are a method and an apparatus for adjusting outputs of an electronic device by using a touch technology. The apparatus for adjusting outputs of the electronic device, according to an embodiment of the present invention, comprises: a touch input unit for sensing a touch input of a first figure and at least one second figure; and an output adjustment unit for generating at least one piece of adjustment information for adjusting at least one output of the electronic device according to a relative phase relationship (topology) of the first figure and the at least one second figure, and adjusting the at least one output of the electronic device. The output adjustment unit can generate the at least one piece of adjustment information when the relative phase relationship between the at least one first figure and the at least one second figure is the same even if the touch position and direction on the touch input unit are different.
    Type: Grant
    Filed: October 13, 2017
    Date of Patent: November 2, 2021
    Inventor: Tae Ho Kang
  • Patent number: 11163370
    Abstract: A computer-implemented method and system for, using a camera, detecting a gesture during a video stream; using a computing device, generating a digital drawing that corresponds to the gesture and storing the digital drawing in a database as a gesture layer; using the computing device, combining the gesture layer with the video stream to generate a gesture visualization; and using the computing device, causing the gesture visualization to be displayed in one or more displays of one or more other computing devices.
    Type: Grant
    Filed: October 17, 2019
    Date of Patent: November 2, 2021
    Assignee: RingCentral, Inc.
    Inventor: Erik Dmitrievich Parland
  • Patent number: 11152030
    Abstract: A graphical user interface for setting speed and direction of video playback may include a timeline representation of video duration. Playback speed and playback direction from a selected point of the video may be determined based on user interaction with the graphical user interface. A portion of the video to which the selected playback speed and selected playback direction is applied may be determined based on user movement of the timeline representation.
    Type: Grant
    Filed: August 27, 2020
    Date of Patent: October 19, 2021
    Assignee: GoPro, Inc.
    Inventors: Steven Fortunato, Evan Kosowski, Rachael Irene Hines Thompson, Renaud Cousin, Nicolas Duponchel, Thomas Achddou, Joshua Hamill
  • Patent number: 11150803
    Abstract: This application provides a touch control method and an apparatus, and relates to the field of communications technologies. The method includes: (S601) obtaining, by a terminal, a first touch operation entered by a user on a touchscreen; (S602, S603, and S604) and mapping, by the terminal when the first touch operation is performed on a first preset area in a target interface, the first touch operation to a second touch operation, so that a target application responds to the second touch operation, where the target interface is any interface that is presented by the target application and that covers the first preset area, and the target application is running in the foreground.
    Type: Grant
    Filed: November 7, 2017
    Date of Patent: October 19, 2021
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Jiang Rui, Zhubiao Xue, Bo Xu
  • Patent number: 11137902
    Abstract: A character input device includes an operation unit that receives a character input performed with a flick input, a slide detector that detects a starting position of the flick input, and a determination unit that adjusts an input determination area for the character input in response to the starting position in accordance with an input error count for the flick input.
    Type: Grant
    Filed: February 19, 2020
    Date of Patent: October 5, 2021
    Assignee: OMRON Corporation
    Inventor: Yosuke Higuchi
  • Patent number: 11132121
    Abstract: The embodiment of the present application discloses a method, an apparatus, a storage medium, and an electronic device of processing split screen display. In the embodiment of the present application, gesture information on a display screen is acquired; when it is determined that the gesture information matches preset gesture information, position change information corresponding to the gesture information is acquired; when it is determined that the position change information matches preset position change information, a display region of the display screen is divided into at least two sub-regions; and a currently displayed first display interface is displayed in a first sub-region of the at least two sub-regions.
    Type: Grant
    Filed: December 8, 2018
    Date of Patent: September 28, 2021
    Assignee: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
    Inventors: Liangjing Fu, Tongxi Li, Dan Cao, Zhiyong Lin
  • Patent number: 11132078
    Abstract: An electronic device including a base member having a touch area defined inside a first closed-shape, the first closed-shape being a first imaginary line, and a peripheral area disposed adjacent to the touch area and defined outside the first closed-shape, and a touch sensor including a plurality of patterns disposed in the touch area to sense a touch from outside and a driving line disposed in the peripheral area and connected to a pattern disposed adjacent to the first closed-shape. The touch area includes a first area defined inside a second closed-shape being a second imaginary line defined in the touch area, and a second area defined outside the second closed-shape and surrounded by the first closed-shape, and an edge pattern disposed in the second area having an area substantially equal to or greater than approximately one-half of an area of a center pattern disposed in the first area.
    Type: Grant
    Filed: February 13, 2020
    Date of Patent: September 28, 2021
    Assignee: Samsung Display Co., Ltd.
    Inventors: Byeongkyu Jeon, Hyungchul Kim, Jungmok Park, Heewoong Park
  • Patent number: 11126276
    Abstract: The disclosure provides a method, device and equipment for launching an application. The method includes: a mobile terminal presetting one or more initial positions for one or more applications, wherein the one or more initial positions of the one or more applications are located outside the mobile terminal; then determining a target application from the one or more applications according to a current position of the mobile terminal; and then when a moving operation of a user on the mobile terminal is detected, shortening a distance between the mobile terminal and the target application according to the moving operation, then determining a first distance between the mobile terminal and the target application, and furthermore, launching the target application when the first distance is less than a preset threshold.
    Type: Grant
    Filed: September 11, 2020
    Date of Patent: September 21, 2021
    Assignee: Beijing Bytedance Network Technology Co., Ltd.
    Inventors: Chi Fang, Wei Lu, Huayun Miao
  • Patent number: 11119726
    Abstract: Implementations described herein relate to transitioning a computing device between operating modes according to whether the computing device is suitably oriented for received non-audio related gestures. For instance, the user can attach a portable computing device to a docking station of a vehicle and, while in transit, wave their hand near the portable computing device in order to invoke the automated assistant. Such action by the user can be detected by a proximity sensor and/or any other device capable of determining a context of the portable computing device and/or an interest of the user in invoking the automated assistant. In some implementations location, orientation, and/or motion of the portable computing device can be detected and used in combination with an output of the proximity sensor to determine whether to invoke the automated assistant in response to an input gesture from the user.
    Type: Grant
    Filed: October 8, 2018
    Date of Patent: September 14, 2021
    Assignee: GOOGLE LLC
    Inventor: Haywai Chan