Abstract: In an embodiment, generative AI-based image generation using attribute-based slider control is provided. A prompt indicative of a description of a first image is received. The first image is generated based on the prompt, by a text-to-image model. A set of attributes associated with the description is determined, based on a first language model. The set of attributes corresponds to semantics associated with the first image. Based on a second language model, a set of questions associated with prompt is generated. Slider boundary values and initial slider value are generated, based on the set of questions and the first image. A set of sliders is generated based on the slider boundary values and the initial slider value. Each slider corresponds to an attribute. A user input associated with the set of sliders is received and a second image is generated. The second image is rendered.

Abstract: Various aspects of the subject technology relate to systems, methods, and machine-readable media for navigating through a shared artificial reality environment. Various aspects may include receiving an indication of a virtual object in the shared artificial reality environment. Aspects may also include receiving an input gesture indicative of a navigation command associated with the virtual object. Aspects may also include determining at least one type of the input gesture comprising flexion and extension, pronation and supination, or radial and ulnar. Aspects may also include determining a control method. Aspects may include determining a scrolling parameter. Aspects may include identifying the navigation command based on the type of the input gesture, the control method, and the scrolling parameter. Aspects may include applying the navigation command to the virtual object.

Abstract: The disclosed computer-implemented method may include systems and methods for optimizing the timing of when intelligent selection suggestions are provided within a VR/AR environment. In one example, the systems and methods described herein determine a probability that a potential action within a user interface is an intended action; quantify, over a period of time, a value of suggesting the potential action within the user interface; select a time at which to suggest the potential action based on the quantified value over the period of time; and suggest the potential action within the user interface at the selected time. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: The disclosed computer-implemented method may include systems and methods for optimizing the timing of when intelligent selection suggestions are provided within a VR/AR environment. In one example, the systems and methods described herein determine a probability that a potential action within a user interface is an intended action; quantify, over a period of time, a value of suggesting the potential action within the user interface; select a time at which to suggest the potential action based on the quantified value over the period of time; and suggest the potential action within the user interface at the selected time. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: The disclosed computer-implemented method may include capturing, by a computing device, a current position of a wearable device and a current position of user eye gaze at a current time. The method may also include determining that a user eye gaze is at a fixation position based on a speed of gaze movement. Additionally, the method may include calculating a direction of cursor movement by comparing a current cursor position with a previous cursor position at a previous time. Furthermore, the method may include calculating a likelihood of the fixation position being a target cursor position based on a difference between the direction of cursor movement and a direction from the current cursor position to the fixation position. Finally, the method may include increasing a speed of cursor movement toward the fixation position based on the likelihood. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: The disclosed system may include (1) a processor that generates an artificial environment that includes a virtual object, (2) a display that presents the artificial environment, (3) an input subsystem that detects tracks positioning of a body, and (4) a plurality of haptic actuators that are arranged to apply haptic feedback to a first plurality of locations on the body, where the processor (a) determines, based on the positioning of the body, a virtual contact of one of a second plurality of locations on the body with the virtual object, where the second plurality of locations is different from the first plurality of locations, and (b) activates, in response to the virtual contact, at least one of the plurality of haptic actuators based on a mapping of the second plurality of locations to the plurality of haptic actuators. Various other systems and methods are also disclosed.

Abstract: The disclosed system may include (1) a processor that generates an artificial environment that includes a virtual object, (2) a display that presents the artificial environment, (3) an input subsystem that detects tracks positioning of a body, and (4) a plurality of haptic actuators that are arranged to apply haptic feedback to a first plurality of locations on the body, where the processor (a) determines, based on the positioning of the body, a virtual contact of one of a second plurality of locations on the body with the virtual object, where the second plurality of locations is different from the first plurality of locations, and (b) activates, in response to the virtual contact, at least one of the plurality of haptic actuators based on a mapping of the second plurality of locations to the plurality of haptic actuators. Various other systems and methods are also disclosed.

Abstract: The disclosed computer-implemented method may include capturing, by a computing device, a current position of a wearable device and a current position of user eye gaze at a current time. The method may also include determining that a user eye gaze is at a fixation position based on a speed of gaze movement. Additionally, the method may include calculating a direction of cursor movement by comparing a current cursor position with a previous cursor position at a previous time. Furthermore, the method may include calculating a likelihood of the fixation position being a target cursor position based on a difference between the direction of cursor movement and a direction from the current cursor position to the fixation position. Finally, the method may include increasing a speed of cursor movement toward the fixation position based on the likelihood. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: Various aspects of the subject technology relate to systems, methods, and machine-readable media for navigating through a shared artificial reality environment. Various aspects may include receiving an indication of a virtual object in the shared artificial reality environment. Aspects may also include receiving an input gesture indicative of a navigation command associated with the virtual object. Aspects may also include determining at least one type of the input gesture comprising flexion and extension, pronation and supination, or radial and ulnar. Aspects may also include determining a control method. Aspects may include determining a scrolling parameter. Aspects may include identifying the navigation command based on the type of the input gesture, the control method, and the scrolling parameter. Aspects may include applying the navigation command to the virtual object.

Abstract: The disclosed computer-implemented method may include (1) receiving information associated with a real-time output of a recognition model adapted to recognize at least one behavior of a user, (2) determining, based on the information, a level of uncertainty associated with the real-time output, (3) modulating at least one attribute of feedback based on the level of uncertainty, and (4) presenting the feedback to the user substantially contemporaneous with the real-time output of the recognition model. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: Various aspects of the subject technology relate to systems, methods, and machine-readable media for navigating through a shared artificial reality environment. Various aspects may include receiving an indication of a virtual object in the shared artificial reality environment. Aspects may also include receiving an input gesture indicative of a navigation command associated with the virtual object. Aspects may also include determining at least one type of the input gesture comprising flexion and extension, pronation and supination, or radial and ulnar. Aspects may also include determining a control method. Aspects may include determining a scrolling parameter. Aspects may include identifying the navigation command based on the type of the input gesture, the control method, and the scrolling parameter. Aspects may include applying the navigation command to the virtual object.

Abstract: Various aspects of the subject technology relate to systems, methods, and machine-readable media for navigating through a shared artificial reality environment. Various aspects may include receiving an indication of a virtual object in the shared artificial reality environment. Aspects may also include receiving an input gesture indicative of a navigation command associated with the virtual object. Aspects may also include determining at least one type of the input gesture comprising flexion and extension, pronation and supination, or radial and ulnar. Aspects may also include determining a control method. Aspects may include determining a scrolling parameter. Aspects may include identifying the navigation command based on the type of the input gesture, the control method, and the scrolling parameter. Aspects may include applying the navigation command to the virtual object.

Abstract: The disclosed system may include (1) a processor that generates an artificial environment that includes a virtual object, (2) a display that presents the artificial environment, (3) an input subsystem that detects tracks positioning of a body, and (4) a plurality of haptic actuators that are arranged to apply haptic feedback to a first plurality of locations on the body, where the processor (a) determines, based on the positioning of the body, a virtual contact of one of a second plurality of locations on the body with the virtual object, where the second plurality of locations is different from the first plurality of locations, and (b) activates, in response to the virtual contact, at least one of the plurality of haptic actuators based on a mapping of the second plurality of locations to the plurality of haptic actuators. Various other systems and methods are also disclosed.

Abstract: An electronic device tracks, for a user performing a target acquisition movement within a 3D space, movement parameters of a plurality of input devices of the user. The electronic device predicts, for the user, a region of interest within the 3D space, based on the movement parameters. The region of interest includes a plurality of targets in close proximity. The electronic device predicts an endpoint of the target acquisition movement, within the region of interest. In some embodiments, the plurality of input devices includes an eye tracking input device, each input device corresponds to a predefined input device type, and the movement parameters include gaze data from the eye tracking input device. In some embodiments, input devices includes an eye tracking input device, a head-mounted display, and a hand-held controller, and the user's eye, hand, and head movements are coordinated.

Abstract: The disclosed computer-implemented method may include (1) receiving information associated with a real-time output of a recognition model adapted to recognize at least one behavior of a user, (2) determining, based on the information, a level of uncertainty associated with the real-time output, (3) modulating at least one attribute of feedback based on the level of uncertainty, and (4) presenting the feedback to the user substantially contemporaneous with the real-time output of the recognition model. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: A wearable device equipped with sensors or transducers capable of detecting a vibration propagating through two different mediums. In some embodiments, the two mediums are air and a surface contacted by a user. In such an embodiment, the sensors or transducers include a microphone and an accelerometer. In some embodiments, the device may perform some or all of the signal processing and/or logic used to determine that a contact occurred and the location of the contact using a processor programmed with a set of computer-executable instructions. In some embodiments, the device may transmit data or signals to a processor located in a different device, such as a mobile phone or artificial reality headset, for signal processing and/or the execution of logic.

Abstract: A wearable device and system for detecting data generated by a user's contact with a surface and using that data to determine that a user contacted the surface and, in some examples, the location of the contact. The location of the contact may then be used by another device, such as an artificial reality headset, to select a user interface element, activate a function or perform a task in an artificial reality environment, or execute another type of function typically performed in response to an input to a user interface. In one example, the wearable device includes an ultrasound transmitter (Tx) and an ultrasound receiver (Rx). In some embodiments, the wearable device may also include a processing element capable of processing the signals detected or received by the receiver to determine that a contact occurred.

Abstract: An electronic device tracks, for a user performing a target acquisition movement within a 3D space, movement parameters of a plurality of input devices of the user. The electronic device predicts, for the user, a region of interest within the 3D space, based on the movement parameters. The region of interest includes a plurality of targets in close proximity. The electronic device predicts an endpoint of the target acquisition movement, within the region of interest. In some embodiments, the plurality of input devices includes an eye tracking input device, each input device corresponds to a predefined input device type, and the movement parameters include gaze data from the eye tracking input device. In some embodiments, input devices includes an eye tracking input device, a head-mounted display, and a hand-held controller, and the user's eye, hand, and head movements are coordinated.

Abstract: An electronic device tracks, for a user performing a target acquisition movement within a 3D space, movement parameters of a plurality of input devices of the user. The electronic device predicts, for the user, a region of interest within the 3D space, using a regression model, based on the movement parameters. The region of interest includes a plurality of targets in close proximity. The electronic device predicts an endpoint of the target acquisition movement, within the region of interest, using a pointer facilitation technique. In some embodiments, the plurality of input devices includes an eye tracking input device, each input device corresponds to a predefined input device type, and the movement parameters include gaze data from the eye tracking input device. In some embodiments, input devices includes an eye tracking input device, a head-mounted display, and a hand-held controller, and the user's eye, hand, and head movements are coordinated.

Abstract: The disclosed system may include (1) a processor that generates an artificial environment that includes a virtual object, (2) a display that presents the artificial environment, (3) an input subsystem that detects tracks positioning of a body, and (4) a plurality of haptic actuators that are arranged to apply haptic feedback to a first plurality of locations on the body, where the processor (a) determines, based on the positioning of the body, a virtual contact of one of a second plurality of locations on the body with the virtual object, where the second plurality of locations is different from the first plurality of locations, and (b) activates, in response to the virtual contact, at least one of the plurality of haptic actuators based on a mapping of the second plurality of locations to the plurality of haptic actuators. Various other systems and methods are also disclosed.