Abstract: A feedback mechanism that reports software issues between users of software applications and the developers of the software applications. The feedback mechanism generates feedback logs that capture moments of user frustration at the moment a user encounters issues with using a particular software application executing on a client device. The feedback mechanism is triggered to generate a feedback log by the user via a predetermined set of user inputs. Once generated, the feedback log captures an associated importance level, a user description, and/or context information (such as application and command activity information) for the particular software application and one or more other software applications that interacted with the particular software application executing on the client device. The feedback log can also capture multimedia content such as audio, images, and videos. The feedback log is then transmitted to a server of a developer of the particular software application.

Abstract: One embodiment of a computer-implemented method for analyzing human motion data includes receiving a set of motion data that indicates one or more movements of a first person within a real-world environment; generating a virtual avatar corresponding to the first person based on the set of motion data; determining a position of the virtual avatar within an extended reality (ER) scene based on the one or more movements; and displaying the virtual avatar in the ER scene according to the determined position.

Abstract: A command map GUI that illustrates command usage patterns of one or more entities. A server receives and stores command usage data from a plurality of users/clients, each user/client executing a software application having a set of commands. A current user/client displays, via a GUI, graphical representations of the command usage data received from the server. The server receives new command usage data from a user/client included in the one or more entities. In response, the server automatically updates command usage data for the one or more entities, pushes the updated command usage data to the current user/client, and causes the GUI to display graphical representations of the updated command usage data. Thus, the command usage data of the one or more entities is automatically updated and displayed in the GUI in real-time or near real-time as new commands are continually invoked by users in the one or more entities.

Abstract: A workstation enables operation of a 2D input device with a 3D interface. A cursor position engine determines the 3D position of a cursor controlled by the 2D input device as the cursor moves within a 3D scene displayed on a 3D display. The cursor position engine determines the 3D position of the cursor for a current frame of the 3D scene based on a current user viewpoint, a current mouse movement, a CD gain value, a Voronoi diagram, and an interpolation algorithm, such as the Laplacian algorithm. A CD gain engine computes CD gain optimized for the 2D input device operating with the 3D interface. The CD gain engine determines the CD gain based on specifications for the 2D input device and the 3D display. The techniques performed by the cursor position engine and the techniques performed by the CD gain engine can be performed separately or in conjunction.

Abstract: A command map GUI that illustrates command usage patterns of a first entity and/or a comparison between the first entity and a second entity. A server receives and stores command usage data from a plurality of clients, each client executing a software application that enables a set of commands. A client displays the GUI based on command usage data received from the server. The GUI displays a circle chart comprising a plurality of segments representing various command categories, each segment including a wedge that represents the amount of usage of the corresponding command category. The GUI also displays a plurality of data points, each data point representing a command, wherein the distance from the center of the circle chart represents the amount of usage of the corresponding command. The GUI may display a certification and/or an unused command recommended for a user based on command usage patterns of the user.

Abstract: A feedback mechanism that reports software issues between users of software applications and the developers of the software applications. The feedback mechanism generates feedback logs that capture moments of user frustration at the moment a user encounters issues with using a particular software application executing on a client device. The feedback mechanism is triggered to generate a feedback log by the user via a predetermined set of user inputs. Once generated, the feedback log captures an associated importance level, a user description, and/or context information (such as application and command activity information) for the particular software application and one or more other software applications that interacted with the particular software application executing on the client device. The feedback log can also capture multimedia content such as audio, images, and videos. The feedback log is then transmitted to a server of a developer of the particular software application.

Abstract: A command map GUI that illustrates command usage patterns of a first entity and/or a comparison between the first entity and a second entity. A server receives and stores command usage data from a plurality of clients, each client executing a software application that enables a set of commands. A client displays the GUI based on command usage data received from the server. The GUI displays a circle chart comprising a plurality of segments representing various command categories, each segment including a wedge that represents the amount of usage of the corresponding command category. The GUI also displays a plurality of data points, each data point representing a command, wherein the distance from the center of the circle chart represents the amount of usage of the corresponding command. The GUI may display a certification and/or an unused command recommended for a user based on command usage patterns of the user.

Abstract: A command map GUI that illustrates command usage patterns of a first entity and/or a comparison between the first entity and a second entity. A server receives and stores command usage data from a plurality of clients, each client executing a software application that enables a set of commands. A client displays the GUI based on command usage data received from the server. The GUI displays a circle chart comprising a plurality of segments representing various command categories, each segment including a wedge that represents the amount of usage of the corresponding command category. The GUI also displays a plurality of data points, each data point representing a command, wherein the distance from the center of the circle chart represents the amount of usage of the corresponding command. The GUI may display a certification and/or an unused command recommended for a user based on command usage patterns of the user.

Abstract: A workstation enables operation of a 2D input device with a 3D interface. A cursor position engine determines the 3D position of a cursor controlled by the 2D input device as the cursor moves within a 3D scene displayed on a 3D display. The cursor position engine determines the 3D position of the cursor for a current frame of the 3D scene based on a current user viewpoint, a current mouse movement, a CD gain value, a Voronoi diagram, and an interpolation algorithm, such as the Laplacian algorithm. A CD gain engine computes CD gain optimized for the 2D input device operating with the 3D interface. The CD gain engine determines the CD gain based on specifications for the 2D input device and the 3D display. The techniques performed by the cursor position engine and the techniques performed by the CD gain engine can be performed separately or in conjunction.

Abstract: One embodiment of a computer-implemented method for automatically generating command recommendations for a software workflow comprises identifying a plurality of command sequences stored in a database based on a current command being interacted with in a graphical user interface; computing a score for each command sequence included in the plurality of command sequences based on one or more commands included in the command sequence and one or more commands included in a command history; determining at least one command sequence included in the plurality of command sequences to output based on the scores; and outputting the at least one command sequence for display.

Abstract: A subtask assignment system for assisting groups of workers to complete a task more efficiently. The task may comprise a physical assembly task of an object. The physical assembly task comprises a plurality of subtasks that must each be completed to complete the physical assembly task. The subtask assignment system may include an assignment server connected to a plurality of user devices via a network, each user device being operated by a particular worker. The assignment server may execute an assignment engine that receives inputs describing the overall task and group of workers, generates a task model representing the task based on the inputs, populates a parameters table based on the inputs, and automatically determines subtask assignments for the group of workers based on the task model and the parameters table. The assignment server determines an optimal subtask to assign to each worker based on the parameters.

Abstract: In various embodiments a computer-implemented method for providing sustainability insights to a user designing an object. The method includes determining a value of a sustainability metric associated with a design of an object; determining a target value for the sustainability metric; determining an amount of progress made towards achieving the target value for the sustainability metric based on the value of the sustainability metric and the target value for the sustainability metric; and displaying, via a graphical user interface (GUI), a visual indication of the amount of progress made towards achieving the target value for the sustainability metric.

Abstract: In various embodiments a computer-implemented method for providing sustainability insights to a user designing an object. The method includes determining a first value of a sustainability metric associated with a design of an object, displaying, via a graphical user interface (GUI), a visual indication of the first value of the sustainability metric, and detecting a change to the design of the object. The method further includes, in response to detecting the change to the design of the object, determining a second value of the sustainability metric and displaying, via the GUI, a visual indication of the second value of the sustainability metric.

Abstract: One embodiment of the invention disclosed herein provides a system that includes a mirror apparatus with a first surface to which a half-silvered mirror film is applied, where the mirror apparatus transmits a transmitted image from a second surface to the first surface. The system further includes a servo-controlled dimmer that adjusts a level of ambient light associated with the mirror apparatus. The system further includes a motion sensing device that tracks positions of a plurality of points associated with an object; wherein the object is situated on the half-silvered mirror film side of the mirror apparatus. The system further includes a computing device including a memory that stores instructions that, when executed by a processor included in the computing device, cause the processor to control the servo-controlled dimmer to adjust the ambient light such that both the transmitted image and a reflected image is visible on the first surface.

Abstract: A hybrid workstation enables a virtual reality (VR) interface, a traditional (TD) interface, and transitions between the interfaces. The VR interface comprises three-dimensional (3D)-based software and hardware components. The TD interface comprises two-dimensional (2D)-based software and hardware components. The state of the hybrid workstation is defined by three parameters comprising interface (VR interface or TD interface), position (seated or standing), and movement (stationary or room-scale). The hybrid workstation detects a transition from a current state to a next state upon determining that any of the three parameters have changed. The hybrid workstation then determines a transition response based on the particular transition that is detected. The transition response comprises a set of operations that are performed on the VR interface and/or the TD interface that mitigate the disruption and inefficiency caused when the particular transition occurs.

Abstract: A finger device initiates actions on a computer system when placed in contact with a surface. The finger device includes instrumentation that captures images and gestures. When in contact with a surface, the finger device captures images of the surface and gestures made on the surface. The finger device also transmits the images and gesture data to the computer system. An application on the computer system matches the images received from the finger device to a representation of the surface, identifies an action associated with the surface representation and gesture, and executes the action. Instrumenting the finger instead of the surface, allows a user to configure virtually any surface to accept touch input.

Abstract: Techniques disclosed herein combine computer vision with eye tracking by identifying, via computer vision, safety hazards in a video captured by a camera mounted on a pair of safety glasses, and generating an alert if a user wearing the safety glasses has not (recently) noticed the hazard. Whether the user has noticed the hazard is determined based on eye tracking information extracted from a video captured by another camera that is mounted on the safety glasses and points toward the user. As a result, safety hazards may be automatically detected and reported to the user. In addition, only those hazards that have not been (recently) noticed by the user cause an alert to be generated, so the user is not distracted with unnecessary notifications.

Abstract: A computer-implemented method for generating a virtual collection of digital materials includes: generating a virtual three-dimensional (3D) design workspace; and, in response to a first operation that is associated with a first media file: automatically generating a virtual 3D representation of the first media file; and automatically incorporating the virtual 3D representation of the first media file into the virtual 3D design workspace.

Abstract: One embodiment of the present application sets forth a computer-implemented method for remotely monitoring performance of a task in real time, comprising receiving, in real time from a first student computing device, first student data that includes a first set of actions performed in a first student application instance executing on the first student device, comparing a first student action included in the first set of actions to a first target action, in response to comparing the first student action to the first target action, identifying a first issue indicator associated with the first student action, determining a first remedy associated with at least one of the first target action and the first issue indicator, and performing a first remediation action associated with the first remedy.

Abstract: Approaches for generating virtual representations of smart objects in a 3D visual programming interface. The interface displays a 3D virtual environment containing virtual objects that represents a real-world environment containing smart objects. The 3D virtual environment displays virtual objects in a manner that is spatially accurate relative to the physical objects in the real-world environment. For each virtual object representing a physical object, a logic node (port node) is displayed, the port node representing the set of functions associated with the physical object. The interface enables users to create, delete, or modify different types of logic nodes (representing functions) and create, delete, or modify links (representing data connections) between logic nodes within the 3D virtual environment. The authoring of the logic nodes and links produces an executable program.