Gesture-based Patents (Class 715/863)
  • Patent number: 11500103
    Abstract: A mobile terminal including a display configured to display a rotatable graphic interface; a Time of Flight (TOF) camera configured to obtain a depth image of an object; and a controller configured to control the TOF camera to enter a rotation detection mode based on the object included the depth image, obtain a relative rotation amount of a plurality of specific points of the object included in the depth image, and rotate the graphic interface on the display based on the obtained relative rotation amount.
    Type: Grant
    Filed: October 23, 2019
    Date of Patent: November 15, 2022
    Assignee: LG ELECTRONICS INC.
    Inventors: Yehan Ahn, Minho Kim, Hoyoung Kim, Minwoo Song, Jihye Yu, Dongju Lee, Jieun Lee, Sangkuk Jeon, Dongchul Jin
  • Patent number: 11494754
    Abstract: A method of determining a proximity of an antenna located in a payment instrument to an antenna located within an electronic device may include receiving, at the antenna located within the electronic device, a first signal from the antenna located in the payment instrument, the first signal received at a first time, receiving, at the antenna located within an electronic device, a second signal from the antenna located in the payment instrument, the second signal received at a second time, the second time being later than the first time, determining a difference in a signal strength between the first and second signals, and displaying, on a display of the electronic device, an indication based on the determination.
    Type: Grant
    Filed: April 9, 2020
    Date of Patent: November 8, 2022
    Assignee: Worldpay Limited
    Inventors: Jonathan Stewart Vokes, Nicholas Telford-Reed
  • Patent number: 11488592
    Abstract: A communication robot for operating a massage providing apparatus by executing an artificial intelligence algorithm (AI) and/or machine learning algorithm in a 5G environment connected for the Internet of things and a method for operating the communication robot are provided. The method for operating the communication robot may include acquiring a spoken utterance of a user positioned within a prescribed range from the massage providing apparatus, tracking a spoken utterance direction of the user from the spoken utterance of the user, orienting the communication robot towards the spoken utterance direction of the user, acquiring a voice command included in the spoken utterance in relation to operation of the massage providing apparatus, and operating the massage providing apparatus according to the voice command.
    Type: Grant
    Filed: September 24, 2019
    Date of Patent: November 1, 2022
    Assignee: LG ELECTRONICS INC.
    Inventors: Sang Won Kim, Sun Chan Park
  • Patent number: 11487503
    Abstract: The present invention discloses an interactive control method executed during instant video communication between a user and one or more other users. The method comprises: monitoring video information collected by a camera during the instant video communication between the user and the one or more other users; performing recognition on the video information after acquiring the video information, to acquire user behavior data inputted by the user in a preset manner; determining whether the user behavior data comprises preset trigger information; when it is determined that the user behavior data comprises the preset trigger information, further determining whether the user behavior data comprises a preset gesture action; and when it is determined that the user behavior data comprises the preset gesture action, determining an operation instruction corresponding to the preset gesture action in a preset operation instruction set, and performing an event corresponding to the operation instruction.
    Type: Grant
    Filed: June 11, 2020
    Date of Patent: November 1, 2022
    Assignee: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) CO., LTD.
    Inventor: Feng Li
  • Patent number: 11478696
    Abstract: An interaction method and apparatus for locking a target in a game is provided. The method includes that: when detecting a preset touch operation of a touch medium within an effective operation range of a first operation icon, a first position is determined in a game interface, a sliding touch operation of the touch medium is detected, and the first position is updated according to a sliding trace of the touch medium; an optional virtual character is determined from the at least one optional virtual character as a preselected virtual character; visual marking is performed on the preselected virtual character so as to distinct from other optional virtual characters; and when detecting the touch medium leaves a touch screen, the present preselected virtual character is locked as a target virtual character of the first operation.
    Type: Grant
    Filed: June 25, 2018
    Date of Patent: October 25, 2022
    Assignee: NETEASE (HANGZHOU) NETWORK CO., LTD.
    Inventor: Junxiang Wang
  • Patent number: 11474624
    Abstract: According to one or more aspects, a system for vehicle user interface (UI) management includes an interface component, an operation component, a presentation logic, and a rendering component. The interface component may include a display portion located at a first position and an input portion located at a second position different than the first position. The input portion may receive one or more user inputs and include a touch sensitive portion, a first button, and a second button. The operation component may select one or more modes for a UI based on one or more of the user inputs. The presentation logic may generate one or more objects based on a selected mode and presence information associated with one or more of the user inputs. The rendering component may render one or more of the objects to form a composite image at the display portion.
    Type: Grant
    Filed: May 29, 2020
    Date of Patent: October 18, 2022
    Assignee: HONDA MOTOR CO., LTD.
    Inventors: Ross Cameron Miller, Matthew Conway, Richard Alan Ewing, Jr.
  • Patent number: 11474688
    Abstract: A method for creating handwriting content is provided. The method includes displaying handwriting letters being input, extracting at least one candidate handwriting word stored in advance in response to the input handwriting letters, displaying the extracted at least one candidate handwriting word, and replacing the input handwriting letters with a candidate handwriting word selected from among the displayed at least one candidate handwriting word.
    Type: Grant
    Filed: May 15, 2020
    Date of Patent: October 18, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Do-Hyeon Kim, Dong-Chang Lee, Dong-Hyuk Lee, Jae-Woong Lee, Won-Suk Chang, Seong-Taek Hwang, Kang-Jin Yoon
  • Patent number: 11474652
    Abstract: According to one embodiment, a display device includes a display panel, a cover member includes an opening which opposes the display panel and a sensor device provided around the opening in the cover member, and the sensor device includes a button portion includes a plurality of first sensors arranged at a first interval along a first direction, a bar portion includes plurality of second sensors arranged at a second interval along the first direction, the second sensors being smaller than the first sensors and a volume portion formed into a ring shape and including a plurality of third sensors arranged along a circumferential direction thereof.
    Type: Grant
    Filed: August 10, 2020
    Date of Patent: October 18, 2022
    Assignee: Japan Display Inc.
    Inventor: Naoki Takada
  • Patent number: 11461955
    Abstract: A head-mounted display comprises a display device and an outward-facing depth camera. A storage machine comprises instructions executable by a logic machine to present one or more virtual objects on the display device, to receive information from the depth camera about an environment, and to determine a position of the head-mounted display within the environment. Based on the position of the head-mounted display, a position of a joint of a user's arm is inferred. Based on the information received from the depth camera, a position of a user's hand is determined. A ray is cast from a portion of the user's hand based on the position of the joint of the user's arm and the position of the user's hand. Responsive to the ray intersecting with one or more control points of a virtual object, the user is provided with an indication that the virtual object is being targeted.
    Type: Grant
    Filed: August 23, 2021
    Date of Patent: October 4, 2022
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Sheng Kai Tang, Julia Schwarz, Jason Michael Ray, Sophie Stellmach, Thomas Matthew Gable, Casey Leon Meekhof, Nahil Tawfik Sharkasi, Nicholas Ferianc Kamuda, Ramiro S. Torres, Kevin John Appel, Jamie Bryant Kirschenbaum
  • Patent number: 11457150
    Abstract: An electronic device includes: a first detector configured to detect a moving operation of moving an operating object while touching an operation surface with the operating object; a second detector configured to detect a pressing force of the operating object on the operation surface; and a control unit configured to control so that in a case where the moving operation is in a first length and the pressing force is in a first magnitude, an item displayed on a display is moved in a first distance; and in a case where the moving operation is in the first length and the pressing force is in a second magnitude that is different from the first magnitude, the item displayed on the display is moved in a second distance that is longer than the first distance.
    Type: Grant
    Filed: June 10, 2020
    Date of Patent: September 27, 2022
    Assignee: Canon Kabushiki Kaisha
    Inventor: Kazuki Sugaya
  • Patent number: 11448747
    Abstract: An electronic device that selectively performs a predefined action is described. The predefined action can be any action performed by the electronic device, such as changing the power state of the electronic device or a component, change the state of a display, initiating a process, ending a process, etc. During operation, the electronic device may transmit a wireless signal. Then, the electronic device may receive a wireless-return signal associated with an object, which can indicate a time-of-flight of the wireless signal between the electronic device and the object. Moreover, the electronic device may determine a range between the electronic device and the object based at least in part on the wireless-return signal. When the range between the electronic device and the object is less than a threshold value, the electronic device may determine: whether the range between the electronic device and the object is varying and/or whether to perform the predefined action.
    Type: Grant
    Filed: September 26, 2019
    Date of Patent: September 20, 2022
    Assignee: Apple Inc.
    Inventors: Sujeet Milind Patole, Jouya Jadidian, Mikheil Tsiklauri
  • Patent number: 11442620
    Abstract: Conventional input mechanisms available are built considering majority users but face usability and security challenge when used by special users or when used in challenging environments. Embodiments herein provide a method and device for multimodal input mechanism. The device is preconfigured for a plurality of modalities and provides an option to a user to select an input modality pair for entering a sequence of characters into the device. A first modality among the pair enables selection of a character set among a plurality of character sets and the second modality enables selecting a character from the selected character set. The plurality of modalities comprise a touch mode defined by a set of touch based gestures, a motion keyboard mode defined by a set of device tilt based gestures, an air gesture mode defined by a set of virtual gestures and a voice mode defined by a set of voice commands.
    Type: Grant
    Filed: July 14, 2021
    Date of Patent: September 13, 2022
    Assignee: TATA CONSULTANCY SERVICES LIMITED
    Inventors: Charudatta Jadhav, Shubham Agarwal
  • Patent number: 11435899
    Abstract: A mobile computing device has a touch screen which has a display and a user interface UI that has a control system for manipulating the displayed data. The UI can be used for scrolling, zooming, and selecting specific data on the visual display. The basic operation of the UI includes a touch circle being formed around a control point where the user touches the touch screen. The user can swipe on the touch screen with radial and arcuate gestures which can be interpreted by the UI for zooming, selecting, and inputting data.
    Type: Grant
    Filed: April 5, 2021
    Date of Patent: September 6, 2022
    Inventors: Zachary Michaels, Charlotte Maumus
  • Patent number: 11432162
    Abstract: The disclosure relates to an access point (AP) device for controlling spectrum usage of a hierarchical communication system, in which a spectrum reserved for an Incumbent is usable by at least one user equipment (UE) for transmission when the spectrum is not required by the Incumbent, the AP device comprising a processor configured to: enforce the at least one UE into a mode protecting use of the spectrum by the Incumbent based on a spectrum request indication from the Incumbent; and enable transmission of the at least one UE using the spectrum reserved for the Incumbent based on a spectrum availability indication from the Incumbent.
    Type: Grant
    Filed: January 28, 2019
    Date of Patent: August 30, 2022
    Assignee: Intel Corporation
    Inventors: Markus Dominik Mueck, Christian Drewes, Kostas Tsagkaris, Panagiotis Demestichas, Michalis Michaloliakos, Stavroula Vassaki
  • Patent number: 11422765
    Abstract: The present disclosure generally relates to engaging in cross device interactions. The method includes at a first device with a first display, while a second device having a second display is placed over a first region of the first display, detecting, via input devices of the first device, a first input. In response to detecting the first input and in accordance with a determination that the first input occurred while focus was directed to the second device, the method includes causing a response to the first input to be displayed on the second display. In response to detecting the first input and in accordance with a determination that the first input occurred while focus was directed to the first device, the method includes displaying, on the first display, a response to the first input without causing a response to the first input to be displayed on the second display.
    Type: Grant
    Filed: July 9, 2019
    Date of Patent: August 23, 2022
    Assignee: Apple Inc.
    Inventors: Tianjia Sun, Chang Zhang, Paul X Wang, Aaron Wang
  • Patent number: 11422691
    Abstract: In response to detecting a movement input directed to an application switcher user interface including application representations: the device, in accordance with the movement input meeting deletion criteria corresponding to a respective application representation, moves the respective application representation while maintaining the respective size of the respective application representation during its movement, and removes the respective application representation from the application switcher user interface; and the electronic device, in accordance with the movement input meeting home display criteria, changes the respective sizes of application representations, ceases to display the application switching user interface, and displays an application launching user interface.
    Type: Grant
    Filed: March 3, 2021
    Date of Patent: August 23, 2022
    Assignee: APPLE INC.
    Inventors: Marcos Alonso Ruiz, Chanaka G. Karunamuni, Brandon M. Walkin, Shubham Kedia
  • Patent number: 11423184
    Abstract: An information processing method, an information processing device, and an electronic device are provided. The method includes: obtaining an input operation; in response to the input operation being performed on a first object displayed in a first region of a display region, collecting first operation information and making the first object respond to the input operation according to the first operation information; and in response to the input operation being performed on a second object displayed in a second region of the display region, collecting second operation information, and making the second object respond to the input operation according to the second operation information and authentication information corresponding to the second operation information.
    Type: Grant
    Filed: September 26, 2019
    Date of Patent: August 23, 2022
    Assignee: LENOVO (BEIJING) CO., LTD.
    Inventor: Guojing Cheng
  • Patent number: 11416132
    Abstract: A system is described for scaling display content on a computing device based on user-to-device distance. A measurement is taken of the distance between the user and the device and a scaling setting is determined using a predefined rule based on the measured distance. The scaling setting is applied to scale content on the display based on the user-to-device distance by changing settings in the operating system or changing scaling in an application. Embodiments include virtual desktop/application and localized implementations.
    Type: Grant
    Filed: July 31, 2020
    Date of Patent: August 16, 2022
    Assignee: VMware, Inc.
    Inventors: Yue Sun, Bo Liu, Ming Zhao, Jingxiao Xu, Yanni Wu, Xiang Hu
  • Patent number: 11416599
    Abstract: A method enables website providers to prohibit non-human users, such as programmed agents, from viewing their websites. According to a method for user authentication according to an embodiment, an authentication challenge is generated by a computing device, the authentication challenge including a number of challenge elements. The authentication challenge is presented to a user of a computing device and the user responds to the authentication challenge by selecting one or more challenge elements in accordance with an instruction provided to the user on how to complete the authentication challenge. The user is then notified whether they have successfully chosen the correct challenge element/s.
    Type: Grant
    Filed: March 16, 2018
    Date of Patent: August 16, 2022
    Assignee: Arkose Labs Holdings, Inc.
    Inventor: Matthew Michael Ford
  • Patent number: 11417179
    Abstract: A method of tracking a user in a store and tracking takes and puts in regard to items in said store. One method includes tracking a shopper in a physical store using two or more cameras that are overlapping to infer and account for shopping activity performed by the shopper. The method includes providing output of at least one of the two or more cameras to a processing entity to extract skeletal limb features of the shopper. Then, processing the skeletal limb features of the shopper to detect a take of an item from the store into possession of the shopper. The method further includes detecting, based on the tracking, that the shopper has exited the store and processing a charge to an account of shopper for the item based on the detected take.
    Type: Grant
    Filed: December 29, 2018
    Date of Patent: August 16, 2022
    Inventors: Gary M. Zalewski, Albert S. Penilla
  • Patent number: 11402921
    Abstract: A spatial sensing region is set in accordance with a spatial sensing function of a first operation detection unit included in a first operation device, and another spatial sensing region is set in accordance with a spatial sensing function of a second operation detection unit included in a second operation device. The first operation device and the second operation device are arranged in a vehicle interior. For example, when the second operation detection unit of the second operation device detects a forward movement of a hand, it is determined that an operator intends to operate the first operation device and control is performed such that a display screen of the first operation device is turned on, for example.
    Type: Grant
    Filed: February 26, 2021
    Date of Patent: August 2, 2022
    Assignee: ALPINE ELECTRONICS, INC.
    Inventor: Keisuke Abe
  • Patent number: 11402646
    Abstract: A control unit controls a movement of a viewpoint-following display area that moves in accordance with the movement of a user's point of regard, and determines whether to cause the viewpoint-following display area to follow the user's point of regard or to stop the viewpoint-following display area from following the user's point of regard, according to the staying time of the user's point of regard. The display apparatus is configured as a three-dimensional display apparatus or a HUD that allows the viewpoint-following display area to be observed in front of a fixed display area. In a case where the staying time of the user's point of regard reaches or exceeds a specified time t set in advance, the control unit does not cause the viewpoint-following display area to follow the user's point of regard, but fixes the viewpoint-following display area for display.
    Type: Grant
    Filed: September 19, 2019
    Date of Patent: August 2, 2022
    Assignee: SONY GROUP CORPORATION
    Inventors: Ryouhei Yasuda, Shinichi Kawano
  • Patent number: 11394806
    Abstract: An exemplary method and computing device for receiving a user input and determining whether the user input is a casting action for outputting content from the client device to one or more target devices. The computing device at least one target device of the one or more target devices that is eligible to output the content and identifies content source information associated with the content to be output by the at least one identified target device. One or more content output instructions are generated for outputting the content to the at least one identified target device. The computing device sends the one or more content output instructions to the at least one identified target device over a wireless connection.
    Type: Grant
    Filed: July 20, 2020
    Date of Patent: July 19, 2022
    Assignee: ARRIS Enterprises LLC
    Inventors: Albert F. Elcock, Anurag Sharma, Richard Moore, Jr.
  • Patent number: 11386193
    Abstract: Various systems and methods are provided for defining a CAPTCHA generator that is configured to generate CAPTCHA challenges by using at least a first parameter and a first plurality of values associated with the first parameter; defining an adversary program, where the adversary program is configured to automatically attempt to solve the CAPTCHA challenges; performing a first feedback loop that includes generating a first plurality of CAPTCHA challenges, receiving feedback from a group of human users and feedback from the adversary program; and using the feedback received from the human user and the feedback received from the adversary program to modify a weight associated with a first value among the plurality of values in order to generate future CAPTCHA challenges that create less inconvenience for human users but which are more difficult for adversary programs.
    Type: Grant
    Filed: March 24, 2020
    Date of Patent: July 12, 2022
    Assignee: Dell Products L.P.
    Inventors: Falaah Arif Khan, Hari Surender Sharma
  • Patent number: 11386717
    Abstract: A fingerprint inputting method used in an electronic device that includes a display screen and an under-screen fingerprint module. The method includes: displaying a setting interface of fingerprint input having a button of adding fingerprint function; in response to detecting an instruction on the fingerprint adding function, obtaining at least one screen image by the under-screen fingerprint module while a user finger is not pressing a fingerprint identification region; displaying a guiding interface of fingerprint input on the display screen and obtaining a plurality of fingerprint images while the user finger is pressing the fingerprint identification region by the under-screen fingerprint module; and generating a fingerprint model according to the at least one screen image and the plurality of fingerprint images.
    Type: Grant
    Filed: July 16, 2021
    Date of Patent: July 12, 2022
    Assignee: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD
    Inventor: Zeqi Shen
  • Patent number: 11385770
    Abstract: This disclosure provides systems, methods and apparatus, including computer programs encoded on computer storage media, for presenting, while an apparatus is in a first apparatus orientation, a plurality of icons in a first configuration on a display of the apparatus. In some aspects, the first configuration may correspond to a first icon arrangement. Some disclosed methods involve presenting, associated with a custom event, the plurality of icons in a second configuration on the display while the apparatus remains substantially in the first apparatus orientation. The second configuration may correspond to a second icon arrangement wherein a first position of at least one icon in the first configuration is different from a second position of the at least one icon in the second configuration.
    Type: Grant
    Filed: April 21, 2021
    Date of Patent: July 12, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Venu Madhav Raidu, Raja Shekhar Reddy Annam, Sriram Emarose
  • Patent number: 11380021
    Abstract: Disclosed herein is an image processing apparatus including a hand recognizing section configured to recognize a state of a hand of a user, an item image superimposing section configured to superimpose images of items as selection targets attached to the fingers of the hand that are assigned to the items on either an image of the hand being displayed or an image representing the hand being displayed, and a selecting operation detecting section configured to detect that one of the items is selected on the basis of a hand motion performed on the images of the items before performing processing corresponding to the detected selection.
    Type: Grant
    Filed: June 12, 2020
    Date of Patent: July 5, 2022
    Assignee: SONY INTERACTIVE ENTERTAINMENT INC.
    Inventor: Masashi Nakata
  • Patent number: 11379099
    Abstract: The present disclosure provides a method and a device for selecting a text in an electronic terminal, and the method includes: receiving an operation for entering a text selection mode and entering the text selection mode; displaying a start marker for indicating a start position of the selected text, an end marker for indicating an end position of the selected text, a start guideline which refers to a straight line passing through the start position and extending along a character direction in the text within a predetermined range, and an end guideline which refers to a straight line passing through the end position and extending along a character direction in the text within a predetermined range.
    Type: Grant
    Filed: November 15, 2018
    Date of Patent: July 5, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventor: Zhibiao Cheng
  • Patent number: 11365014
    Abstract: A method for acquiring a target for a movable object includes providing a solicitation signal in response to receiving an initialization signal, detecting an action by one or more potential candidates in response to the solicitation signal, and identifying a target from the one or more potential candidates based on the detected action.
    Type: Grant
    Filed: January 3, 2019
    Date of Patent: June 21, 2022
    Assignee: SZ DJI TECHNOLOGY CO., LTD.
    Inventors: You Zhou, Jie Qian, Xuyang Feng, Cong Zhao, Jiaqi Yan
  • Patent number: 11367130
    Abstract: Systems and methods according to present principles involved highlighting objects such as on a store shelf. Highlighting is displayed by projecting a light directly on the object by means of a light source or may alternatively be indicated by displaying an indicator or image of the object on a display screen. Information about the targeted object may appear in a headmounted display, on a user's mobile device, or may be projected on a surface via the projector. Information provided to a user may include comparison product data, data about potential allergens, and the like. Highlighting can also be employed to suggest items of interest to the user. For example, products may be recommended to a user through analysis of user data and such products illuminated by a projector as a user walks through a store. Other highlighted objects may be those on a user grocery list or the like.
    Type: Grant
    Filed: May 26, 2020
    Date of Patent: June 21, 2022
    Assignee: SONY INTERACTIVE ENTERTAINMENT LLC
    Inventors: Charles McCoy, Leo Pedlow, True Xiong
  • Patent number: 11360651
    Abstract: A system and method for a mobile communication device having a circular display allowing more information to be displayed on the mobile communication device's display, a corresponding charging station, and a specially formatted user interface fully utilizing the circular display area of the mobile communication device.
    Type: Grant
    Filed: February 15, 2021
    Date of Patent: June 14, 2022
    Assignee: dTOOR Inc. SPC
    Inventors: Christina Cyr, Kristen Faiferlick, Marjan Zamani, Julia Cheng
  • Patent number: 11361153
    Abstract: Systems and methods for linking digital ink instances. One system includes a memory storing instructions and an electronic processor. The electronic processor, through execution of the instructions stored in the memory, is configured to receive detected interactions between a touchscreen and a digital pen representing one or more digital strokes within a canvas and determine whether the one or more digital strokes match a predetermined signifier including a predetermined mark and a line extending from the predetermined mark. The electronic processor is also configured to, in response to determining that the one or more digital strokes match the predetermined signifier, determine a first digital ink instance and a second digital ink instance included in the canvas based on a position of the one or more digital strokes within the canvas, and update metadata of the first digital ink instance to include an identifier of the second digital ink instance.
    Type: Grant
    Filed: March 16, 2021
    Date of Patent: June 14, 2022
    Assignee: Microsoft Technology Licensing, LLC
    Inventor: Arcadio García Salvadores
  • Patent number: 11361861
    Abstract: A method and system are a for gesture support system for controlling a cloud-based image processing application. In an embodiment, the system includes an extended touch screen device; a DICOM Appliance including a receiver and an uploader client, adapted for segregating PHI-data and non-confidential image data, and for encrypting PHI-data and sending a data package, including the encrypted PHI-data and non-confidential image data to a cloud server. The cloud server is adapted for processing the medical image data. It receives the data package form the uploader client and decrypts the received data package. A gesture reception unit receives user-specific gesture signals and a mapping unit maps the received user-specific gesture signals to standard gestures and provides the standard gestures to the cloud server for generating control instructions for the image processing.
    Type: Grant
    Filed: September 16, 2016
    Date of Patent: June 14, 2022
    Assignee: SIEMENS HEALTHCARE GMBH
    Inventors: Fabian Gruemer, Chandrashekara Rangapura Shettappa
  • Patent number: 11354991
    Abstract: A security system (10) includes an image information acquisition unit (11) that acquires input image information on an image taken of a person in a store, a tracking unit (12) that tracks an action of a hand of the person based on the input image information, and a suspicious action detection unit (13) that detects a suspicious action of the person based on the tracked action of the hand. A security system, a security method, and a security program capable of accurately detecting a suspicious action are thereby provided.
    Type: Grant
    Filed: September 10, 2018
    Date of Patent: June 7, 2022
    Assignee: NEC CORPORATION
    Inventors: Kaoru Uchida, Nobuyuki Yamashita
  • Patent number: 11354032
    Abstract: An electronic device with a display and a touch-sensitive surface displays, on the display, a first visual indicator that corresponds to a virtual touch. The device receives a first input from an adaptive input device. In response to receiving the first input from the adaptive input device, the device displays a first menu on the display. The first menu includes a virtual touches selection icon. In response to detecting selection of the virtual touches selection icon, a menu of virtual multitouch contacts is displayed.
    Type: Grant
    Filed: July 27, 2020
    Date of Patent: June 7, 2022
    Assignee: Apple Inc.
    Inventors: Christopher B. Fleizach, Eric T. Seymour, James P. Craig
  • Patent number: 11353962
    Abstract: During control of a user interface via free-space motions of a hand or other suitable control object, switching between control modes can be facilitated by tracking the control object's movements relative to, and its penetration of, a virtual control construct (such as a virtual surface construct). The position of the virtual control construct can be updated, continuously or from time to time, based on the control object's location.
    Type: Grant
    Filed: August 6, 2020
    Date of Patent: June 7, 2022
    Assignee: Ultrahaptics IP Two Limited
    Inventors: Raffi Bedikian, Jonathan Marsden, Keith Mertens, David Holz
  • Patent number: 11348373
    Abstract: Generally discussed herein are examples of gesture-based extended reality (XR) with object recognition and tracking. A method, implemented by an extended reality (XR) device can include recognizing and tracking one or more objects in the image data, recognizing a gesture in the image data, analyzing the image data to determine whether a condition is satisfied, the condition indicating a recognized and tracked object of the one or more objects proximate which the recognized gesture is to be made, and in response to determining that the condition is satisfied, performing an augmentation of the image data based on satisfaction of the condition.
    Type: Grant
    Filed: February 21, 2020
    Date of Patent: May 31, 2022
    Assignee: Microsoft Technology Licensing, LLC
    Inventor: Erik Alexander Hill
  • Patent number: 11347317
    Abstract: The technology disclosed relates to filtering gestures, according to one implementation. In particular, it relates to distinguishing between interesting gestures from non-interesting gestures in a three-dimensional (3D) sensory space by comparing characteristics of user-defined reference gestures against characteristics of actual gestures performed in the 3D sensory space. Based on the comparison, a set of gestures of interest are filtered from all the gestures performed in the 3D sensory space. The technology disclosed also relates to customizing gesture interpretation for a particular user, according to another implementation. In particular, it relates to setting parameters for recognizing gestures by prompting the user to select values for characteristics of the gestures. In one implementation, the technology disclosed includes performing characteristic focused demonstrations of boundaries of the gesture.
    Type: Grant
    Filed: April 14, 2020
    Date of Patent: May 31, 2022
    Assignee: Ultrahaptics IP Two Limited
    Inventor: David S. Holz
  • Patent number: 11338733
    Abstract: A method for determining usage of a mobile device in a vehicle by a user includes receiving a first value indicating an “off” state of a screen at a first time, operating at least one sensor of the mobile device to obtain first movement measurements, and classifying the first movements as usage movements. The method also includes generating an indication of mobile device usage, receiving a second value indicating an “on” state of the screen at a second time, operating the at least one sensor to obtain second movement measurements, and classifying the second movements as usage movements or non-usage movements. The method further includes maintaining the indication of mobile device usage in response to the second movements being classified as usage movements or changing the indication of mobile device usage to an indication of mobile device non-usage in response to the second movements being classified as non-usage movements.
    Type: Grant
    Filed: January 16, 2019
    Date of Patent: May 24, 2022
    Assignee: CAMBRIDGE MOBILE TELEMATICS INC.
    Inventors: Brad Cordova, Rafi Finegold, Dan Shiebler
  • Patent number: 11340778
    Abstract: An electronic device changes the current user interface of a respective type of user interface from a first user interface to a second user interface. An individual uses their personal device to set up and configure a device for another user.
    Type: Grant
    Filed: May 5, 2020
    Date of Patent: May 24, 2022
    Assignee: Apple Inc.
    Inventors: Heena Ko, Giovanni Agnoli, Kevin Will Chen, Catherine Lee, Reed E. Olsen, Paul W. Salzman, David Schimon, Matthew J. Sundstrom, Christopher Wilson, Kevin Lynch
  • Patent number: 11341705
    Abstract: A method is performed at a computing device coupled with a display. The method includes displaying a graphical user interface that includes a data visualization in a first state, including a plurality of visual marks. Each of the plurality of visual marks is displayed in a corresponding first position. The method includes receiving user input in the graphical user interface to specify an action that triggers an animated transition of the data visualization from the first state to a second state. The data visualization in the second state includes one or more of the plurality of visual marks in corresponding second positions. The method includes, in response to the user input, triggering the animated transition of the data visualization from the first to the second state. The animated transition is configured by three or more visual parameters, including: an animation mode, an animation speed, and an animation emphasis.
    Type: Grant
    Filed: October 18, 2018
    Date of Patent: May 24, 2022
    Assignee: TABLEAU SOFTWARE, INC.
    Inventors: Paul Matthew Isaacs, Kyle Johns, Jock Douglas Mackinlay
  • Patent number: 11340705
    Abstract: Implementations provided herein relate to correlating available input gestures to recently created application functions, and adapting available input gestures, and/or user-created input gestures, to be correlated with existing application functions. Available input gestures (e.g., a hand wave) can be those that can be readily performed upon setup of a computing device. When a user installs an application that is not initially configured to handle the available input gestures, the available input gestures can be correlated to certain functions of the application. Furthermore, a user can create new gestures for application actions and/or modify existing gestures according to their own preferences and/or physical capabilities. When multiple users elect to modify an existing gesture in the same way, the modification can be made universal, with permission from the users, in order to eliminate latency when subsequently adapting to preferences of other users.
    Type: Grant
    Filed: March 27, 2019
    Date of Patent: May 24, 2022
    Assignee: GOOGLE LLC
    Inventors: Ruxandra Davies, Lisa Takehana
  • Patent number: 11340756
    Abstract: While displaying a three-dimensional environment, a computer system detects a hand at a first position that corresponds to a portion of the three-dimensional environment. In response to detecting the hand at the first position: in accordance with a determination that the hand is being held in a first predefined configuration, the computer system displays a visual indication of a first operation context for gesture input using hand gestures in the three-dimensional environment; and in accordance with a determination that the hand is not being held in the first predefined configuration, the computer system forgoes display of the visual indication.
    Type: Grant
    Filed: September 23, 2020
    Date of Patent: May 24, 2022
    Assignee: APPLE INC.
    Inventors: Jeffrey M. Faulkner, Israel Pastrana Vicente, Pol Pla I. Conesa, Stephen O. Lemay, Robert T. Tilton, William A. Sorrentino, III, Kristi E. S. Bauerly
  • Patent number: 11334189
    Abstract: One variation of a system includes: a frame; a sensor module; and a controller. The frame includes: a base structure that locates a display defining a front face of a device; and a lateral frame structure extending along and adjacent an edge of the display and supported on a side of the base structure. The base structure and the lateral frame structure cooperate to define a channel arranged behind the display and extending longitudinally between the lateral frame structure and the side of the base structure. The sensor module is arranged in the channel and includes: a substrate; and a linear array of sensors arranged on the substrate and outputting sense signals representing local deflections of the lateral frame structure. The controller detects locations and force magnitudes of side inputs on the device, proximal the edge of the display, based on sense signals output by the linear array of sensors.
    Type: Grant
    Filed: June 4, 2021
    Date of Patent: May 17, 2022
    Assignee: Sensel, Inc.
    Inventors: Ilya Daniel Rosenberg, John Aaron Zarraga, James Junus, Darren Lochun, Tomer Moscovich, Shuangming Li, Alexander Grau
  • Patent number: 11328120
    Abstract: Examples described herein include systems and methods for importing text into a draft email on a user device. In response to a user selecting the first selectable element, the user device can launch a camera interface on the display. The user can capture an image, such as a page of a book or newspaper, and then scale the captured image to the relevant desired portion. The example method can further include recognizing text within the scaled portion of the image and automatically importing the recognized text into the draft email. The user device can utilize a machine learning model to perform text recognition at the device and then insert the recognized text into the draft email automatically. The user device can also display an indication of the accuracy of the imported recognized text within the draft email.
    Type: Grant
    Filed: September 8, 2020
    Date of Patent: May 10, 2022
    Assignee: VMware, Inc.
    Inventors: Ratna Paul Saka, Bilal Ilyas Dar
  • Patent number: 11329941
    Abstract: An efficient email display is provided. Elements in the email that are determined to be useful or relevant to a particular recipient are displayed and elements that are determined not to be useful or relevant to the recipient are removed from view. A received email is parsed for identifying elements that can be collapsed or expanded when displayed to the recipient. A predetermined value is applied to each element based on the content type. The weight of one or more of the elements is adjusted by applying a weight based on one or more weight factors. A collapsed or expanded display state is assigned to each content element based on the adjusted value. Further, the email message is rendered in the email client application interface to the recipient, where elements having the expanded display state are displayed and elements having the collapsed display state are hidden.
    Type: Grant
    Filed: November 24, 2020
    Date of Patent: May 10, 2022
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: James V. Woodward, Jonathan Gabriel Picariello, Jonathan Norman Scott
  • Patent number: 11328118
    Abstract: Systems and methods for linking digital ink instances. One system includes a memory storing instructions and an electronic processor. The electronic processor, through execution of the instructions stored in the memory, is configured to receive detected interactions between a touchscreen and a digital pen representing one or more digital strokes within a canvas and determine whether the one or more digital strokes match a predetermined signifier including a predetermined mark and a line extending from the predetermined mark. The electronic processor is also configured to, in response to determining that the one or more digital strokes match the predetermined signifier, determine a first digital ink instance and a second digital ink instance included in the canvas based on a position of the one or more digital strokes within the canvas, and update metadata of the first digital ink instance to include an identifier of the second digital ink instance.
    Type: Grant
    Filed: March 16, 2021
    Date of Patent: May 10, 2022
    Assignee: Microsoft Technology Licensing, LLC
    Inventor: Arcadio García Salvadores
  • Patent number: 11320962
    Abstract: A method for handling on a mobile terminal a list of contents each associated to a sub-content, the list of contents and each sub-content being displayable on a touch-sensitive screen of the terminal. The method includes performing by a processing unit of the terminal: displaying on the screen a window containing the sub-content associated to a first content selected by a user from said list of contents; detecting a predetermined touch gesture by the user on the screen; and when a predetermined touch gesture has been detected, displaying on the screen, over the displayed window, a pop-up window containing a sub-list of contents from said list of contents.
    Type: Grant
    Filed: July 13, 2018
    Date of Patent: May 3, 2022
    Assignee: ORANGE
    Inventor: Michael Tourneur
  • Patent number: 11314898
    Abstract: An operating method of an electronic device for function execution includes receiving an execution signal associated with executing a voice command function performed based on a voice input, confirming a locked state of an electronic device, and providing an entire function execution state in which access to the entire information stored in a memory is allowed or a partial function execution state in which access to a part of the information stored in the memory is allowed, based on the locked state in relation to executing a function corresponding to the voice input or outputting a result corresponding to the voice input.
    Type: Grant
    Filed: February 27, 2018
    Date of Patent: April 26, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: In Jong Rhee, Sang Ki Kang, Sung Pa Park, Jang Seok Seo, Ji Soo Yi, Kook Tae Choi, Han Jun Ku, Da Som Lee, Dong Ho Jang, Yong Joon Jeon
  • Patent number: 11307759
    Abstract: The present disclosure provides a fusion method and terminal for touch messages and a computer readable storage medium. The method includes: pushing touch messages of all touch fingers from at least two different touch screens into different buffer queues for buffering; intercepting head data of each buffer queue to generate a reported data array; and acquiring states of the touch fingers according to the reported data array and packaging the states into multi-finger touch protocol data.
    Type: Grant
    Filed: September 5, 2018
    Date of Patent: April 19, 2022
    Assignee: XI'AN ZHONGXING NEW SOFTWARE CO., LTD.
    Inventor: Xiaochuan Cui