Abstract: An Adaptive Tangible User Interface (ATUI) for use in an extended reality environment in which tangible interfaces are composed in real time based on identified affordances of existing objects in the physical environment and the input tasks of a user. An extended reality system can be provided with instructions executable by one or more processors to perform processing including: generating a representation of the real-world environment within a field of view of the user; identifying physical objects within the real-world environment; generating a set of possible performable gestures afforded by available object affordance factors; determining potential input tasks; composing performable gestures for the potential input tasks; and selecting a physical object for use as an adaptive tangible user interface. Techniques for designing a virtual user interface, overlaying the virtual user interface on a selected ATUI physical object, and maintaining alignment of the virtual user interface, are also provided.

Abstract: One embodiment of the present application sets forth a method for playback of a sense-making operation. The method includes receiving first session data that includes a set of timeline steps. Each timeline step included in the set of timeline steps corresponds to a user action performed on a data set. The method further includes receiving a playback command to display a first sequence of timeline steps included in the set of timeline steps. The method further includes rendering a first graph for display based on at least one timeline step included in the first sequence of timeline steps.

Abstract: Features described herein generally relate to providing spatiotemporal guidance within a 360-degree video. Particularly, while a 360-degree video is being displayed to a user, a current location of the view of the user within the 360-degree video is determined. Additionally, regions of interest may be identified within the 360-degree video, along with their location and a time in which the regions of interest are active within the 360-degree video. A visual guide is then overlaid onto the 360-degree video that indicates a current location of the view of the user, as well as locations of one or more regions of interest, as well as the time during which each region of interest is active (able to be viewed) within the 360-degree video. By viewing the visual guide, the user may be able to anticipate a location and timing of regions of interest within the 360-degree video and adjust their gaze to the correct location at the correct time to view such regions of interest.

Abstract: An Adaptive Tangible User Interface (ATUI) for use in an extended reality environment in which tangible interfaces are composed in real time based on identified affordances of existing objects in the physical environment and the input tasks of a user. An extended reality system can be provided with instructions executable by one or more processors to perform processing including: generating a representation of the real-world environment within a field of view of the user; identifying physical objects within the real-world environment; generating a set of possible performable gestures afforded by available object affordance factors; determining potential input tasks; composing performable gestures for the potential input tasks; and selecting a physical object for use as an adaptive tangible user interface. Techniques for designing a virtual user interface, overlaying the virtual user interface on a selected ATUI physical object, and maintaining alignment of the virtual user interface, are also provided.

Abstract: A non-transitory, computer-readable storage medium includes instructions to be executed at an extended-reality (XR) headset is described herein. The instructions cause the XR headset to present, via the XR headset worn by a first user, a three-dimensional volumetric representation of an area of space within an XR application that was selected to be collaboratively edited by the first user and a second user. The three-dimensional volumetric representation of the area of space is viewable by the second user. The instructions further cause the XR headset to receive an indication that the second user has provided an input to add an XR object to the area of space. The instructions further cause the XR headset to, in response to receiving the indication, update the three-dimensional volumetric representation to include the area of space with the XR object.

Abstract: Embodiments include a method for navigating an electronic document. The method includes displaying a navigation pane that includes a group of logical document elements associated with the electronic document. The method also includes detecting a first user input. The method further includes determining that the first user input is configured to select a first logical document element included in the group of logical document elements. The method also includes selecting the first logical document element based on the first user input. The method further includes navigating to a portion of the document associated with the first logical document element. Embodiments also include a system and a computer-readable medium for navigating an electronic document.

Abstract: Features described herein generally relate to providing spatiotemporal guidance within a 360-degree video. Particularly, while a 360-degree video is being displayed to a user, a current location of the view of the user within the 360-degree video is determined. Additionally, regions of interest may be identified within the 360-degree video, along with their location and a time in which the regions of interest are active within the 360-degree video. A visual guide is then overlaid onto the 360-degree video that indicates a current location of the view of the user, as well as locations of one or more regions of interest, as well as the time during which each region of interest is active (able to be viewed) within the 360-degree video. By viewing the visual guide, the user may be able to anticipate a location and timing of regions of interest within the 360-degree video and adjust their gaze to the correct location at the correct time to view such regions of interest.

Abstract: An Adaptive Tangible User Interface (ATUI) for use in an extended reality environment in which tangible interfaces are composed in real time based on identified affordances of existing objects in the physical environment and the input tasks of a user. An extended reality system can be provided with instructions executable by one or more processors to perform processing including: generating a representation of the real-world environment within a field of view of the user; identifying physical objects within the real-world environment; generating a set of possible performable gestures afforded by available object affordance factors; determining potential input tasks; composing performable gestures for the potential input tasks; and selecting a physical object for use as an adaptive tangible user interface. Techniques for designing a virtual user interface, overlaying the virtual user interface on a selected ATUI physical object, and maintaining alignment of the virtual user interface, are also provided.

Abstract: In various embodiments, a ranking application automatically ranks designs included in a design space based on user preference(s). The ranking application determines that a first design included in the design space is a first positive example of user preference(s). The ranking application then computes a score associated with a second design that is also included in the design space based on a first attribute value and a second attribute value. The first attribute value is associated with both the first design and an attribute and the second value is associated with both the second design and the attribute. Subsequently, the ranking application orders the designs based on the first score and a second score associated with the second design to generate a ranked list of designs. The ranking application then displays the ranked list of designs via a graphical user interface to facilitate exploration of the design space.

Abstract: In various embodiments, a visualization engine generates graphs that facilitate sense making operations on data sets. A graph includes nodes that are associated with a data set and edges that represent relationships between the nodes. In operation, the visualization engine computes pairwise similarities between the nodes. Subsequently, the visualization engine computes a layout for the graph based on the pairwise similarities and user-specified constraints. Finally, the visualization engine renders a graph for display based on the layout, the nodes, and the edges. Advantageously, by interactively specifying constraints and then inspecting the topology of the automatically generated graph, the user may efficiently explore salient aspects of the data set.

Abstract: An electronic device tracks, for a user performing a target acquisition movement within a 3D space, movement parameters of a plurality of input devices of the user. The electronic device predicts, for the user, a region of interest within the 3D space, based on the movement parameters. The region of interest includes a plurality of targets in close proximity. The electronic device predicts an endpoint of the target acquisition movement, within the region of interest. In some embodiments, the plurality of input devices includes an eye tracking input device, each input device corresponds to a predefined input device type, and the movement parameters include gaze data from the eye tracking input device. In some embodiments, input devices includes an eye tracking input device, a head-mounted display, and a hand-held controller, and the user's eye, hand, and head movements are coordinated.

Abstract: A disclosed computer-implemented method may include (1) tracking a gaze of a user as the user interacts with a user interface, (2) determining, based on tracking of the gaze of the user, that a detected user interaction with the user interface represents a false positive input inference by the user interface, and (3) executing at least one remedial action based on determining that the detected user interaction represents the false positive input inference by the user interface. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: A design application is configured to visualize and explore large-scale generative design datasets. The design explorer includes a graphical user interface (GUI) engine that generates a design explorer, a composite explorer, and a tradeoff explorer. The design explorer displays a visualization of a multitude of design options included in a design space. The design explorer allows a user to filter the design space based on input parameters that influence a generative design process as well as various design characteristics associated with the different design options. The composite explorer displays a fully interactive composite of multiple different design options. The composite explorer exposes various tools that allow the user to filter the design space via interactions with the composite. The tradeoff explorer displays a tradeoff space based on different rankings of design options. The different rankings potentially correspond to competing design characteristics specified by different designers.

Abstract: In one embodiment, a system includes an automatic speech recognition (ASR) module, a natural-language understanding (NLU) module, a dialog manager, one or more agents, an arbitrator, a delivery system, one or more processors, and a non-transitory memory coupled to the processors comprising instructions executable by the processors, the processors operable when executing the instructions to receive a user input, process the user input using the ASR module, the NLU module, the dialog manager, one or more of the agents, the arbitrator, and the delivery system, and provide a response to the user input.

Abstract: An electronic device tracks, for a user performing a target acquisition movement within a 3D space, movement parameters of a plurality of input devices of the user. The electronic device predicts, for the user, a region of interest within the 3D space, based on the movement parameters. The region of interest includes a plurality of targets in close proximity. The electronic device predicts an endpoint of the target acquisition movement, within the region of interest. In some embodiments, the plurality of input devices includes an eye tracking input device, each input device corresponds to a predefined input device type, and the movement parameters include gaze data from the eye tracking input device. In some embodiments, input devices includes an eye tracking input device, a head-mounted display, and a hand-held controller, and the user's eye, hand, and head movements are coordinated.

Abstract: An electronic device tracks, for a user performing a target acquisition movement within a 3D space, movement parameters of a plurality of input devices of the user. The electronic device predicts, for the user, a region of interest within the 3D space, using a regression model, based on the movement parameters. The region of interest includes a plurality of targets in close proximity. The electronic device predicts an endpoint of the target acquisition movement, within the region of interest, using a pointer facilitation technique. In some embodiments, the plurality of input devices includes an eye tracking input device, each input device corresponds to a predefined input device type, and the movement parameters include gaze data from the eye tracking input device. In some embodiments, input devices includes an eye tracking input device, a head-mounted display, and a hand-held controller, and the user's eye, hand, and head movements are coordinated.

Abstract: In one embodiment, a banded slider application obtains values from users via a banded slider. In operation, the banded slider application generates a banded slider that includes multiple sections. Notably, the interior of a section included in the banded slider is visually distinguishable from an interior of another section that is adjacent to the section. Subsequently, the banded slider application performs operation(s) to display the banded slider and, in response, receives a user selection of a location along the banded slider. The banded slider application then computes a specified value based on the location. Advantageously, empirical evidence shows that the banded slider enables precise and/or repeatable specification of values without inducing bias associated with an inherent propensity for users to select locations that are at or near the decorations (e.g., tick marks) along conventional sliders.

Abstract: A design application is configured to visualize and explore large-scale generative design datasets. The design explorer includes a graphical user interface (GUI) engine that generates a design explorer, a composite explorer, and a tradeoff explorer. The design explorer displays a visualization of a multitude of design options included in a design space. The design explorer allows a user to filter the design space based on input parameters that influence a generative design process as well as various design characteristics associated with the different design options. The composite explorer displays a fully interactive composite of multiple different design options. The composite explorer exposes various tools that allow the user to filter the design space via interactions with the composite. The tradeoff explorer displays a tradeoff space based on different rankings of design options. The different rankings potentially correspond to competing design characteristics specified by different designers.

Abstract: A design application is configured to visualize and explore large-scale generative design datasets. The design explorer includes a graphical user interface (GUI) engine that generates a design explorer, a composite explorer, and a tradeoff explorer. The design explorer displays a visualization of a multitude of design options included in a design space. The design explorer allows a user to filter the design space based on input parameters that influence a generative design process as well as various design characteristics associated with the different design options. The composite explorer displays a fully interactive composite of multiple different design options. The composite explorer exposes various tools that allow the user to filter the design space via interactions with the composite. The tradeoff explorer displays a tradeoff space based on different rankings of design options. The different rankings potentially correspond to competing design characteristics specified by different designers.

Abstract: A method for producing an arc detection signal on the basis of a plurality of observation signals comprises producing an arc detection part-signal for each of at least two observation signals. Producing each of the part-signals includes correlating the respective observation signal with a correlation signal by influencing the correlation signal with the respective observation, thereby producing a correlation result; producing or modifying a coefficient on the basis of the correlation result; and weighting the respective observation signal with the coefficient. The arc detection part-signals are added to form the arc detection signal.