Abstract: A method, system, computer-readable media, and apparatuses for providing a shared vehicle experience. The method includes capturing an exterior video stream that depicts an exterior environment of a vehicle, and receiving remote user information indicating a bodily movement of a remote user. The method further includes generating and displaying an augmented video stream comprising a dynamic avatar representing the remote user as a virtual passenger, the dynamic avatar being updated based on the remote user information while the augmented video stream is being displayed in the vehicle. At least a portion of the exterior video stream and occupant information are sent to a computer device that causes, based on the at least a portion of the exterior video stream and the occupant information, a display device of the remote user to output an additional augmented video stream that provides the remote user with an experience of being in the vehicle.

Abstract: The disclosure includes embodiments for providing augmented graphical data on a user device. In some embodiments, a method includes receiving, by the user device, a Vehicle-to-Everything (V2X) wireless message transmitted by a ride share vehicle and including V2X data describing the ride share vehicle. The method includes generating augmented graphical data based on the V2X data, where the augmented graphical data describes an augmented version of an image captured by the user device and depicting a real-life environment that includes the ride share vehicle, where the augmented version highlights a position of the ride share vehicle within the real-life environment. The method includes presenting the augmented graphical data on the user device so that the ride share vehicle is more easily located in the real-life environment.

Abstract: Enhancement layers for data visualization over data sets are provided herein, as is a process for performing data visualization enhancement operations using enhancement layers. A data set may be received for display. A first display layer may be generated. The first display layer may include a base layer rendering the data set in a table. A plurality of data elements in the data set may be identified as having a relationship. The relationship may be identified by a machine-learning process. A second display layer may be generated. The second display layer may include an enhancement layer rendering the relationship between the identified plurality of data elements. The first display layer may be displayed. The second display layer may be displayed over the first display layer. The layers may be visually aligned based on the plurality of data elements.

Abstract: Disclosed are some implementations of systems, apparatus, methods and computer program products for facilitating the identification of a viewport within a browser window of a screen that is shared via a screen-sharing application. By accurately identifying the location and dimensions of the viewport within the browser window, it is possible to render the viewport in the correct location within a screen of a remotely located device.

Abstract: Provided are mechanisms and processes for inserting a visual element into a multi-view digital media representation (MVIDMR). In one example, a process includes analyzing an MVIDMR to determine if there is an appropriate location to insert a visual element. Once a location is found, the type of visual element appropriate for the location is determined, where the type of visual element includes either a three-dimensional object to be inserted in the MVIDMR or a two-dimensional image to be inserted as or projected onto a background or object in the MVIDMR. A visual element that is appropriate for the location is then retrieved and inserted into the MVIDMR, such that the visual element is integrated into the MVIDMR and navigable by a user.

Abstract: Behavior of an industrial system is communicated to an operator through graphical representations of gauges having a scale and pointer that represent parameters of the system. The pointer is positioned relative to the scale to indicate a measured parameter value. In various embodiments, when the parameter value is within operating limits, a first range is displayed that corresponds to the operating limits. When the parameter value has gone outside of the operating limits, the displayed range is changed, in various embodiments, to a second range that goes beyond the operating limits. A local visual indicator is also displayed, in particular embodiments, when the parameter value has gone outside of the operating limits. In a number of embodiments, such a tool can help to make the operator better aware of abnormal parameters of the system for early detection and correction of problematic operating conditions.

Abstract: A method, an apparatus, and a computer program product conduct online visual searches through an augmented reality (AR) device having an optical see-through head mounted display (HMD). An apparatus identifies a portion of an object in a field of view of the HMD based on user interaction with the HMD. The portion includes searchable content, such as a barcode. The user interaction may be an eye gaze or a gesture. A user interaction point in relation to the HMD screen is tracked to locate a region of the object that includes the portion and the portion is detected within the region. The apparatus captures an image of the portion. The identified portion of the object does not encompass the entirety of the object. Accordingly, the size of the image is less than the size of the object in the field of view. The apparatus transmits the image to a visual search engine.

Abstract: A digital medium environment is described to dynamically modify or extend an existing path in a user interface. An un-parameterized input is received that is originated by user interaction with a user interface to specify a path to be drawn. A parameterized path is fit as a mathematical ordering representation of the path to be drawn as specified by the un-parametrized input. A determination is made as to whether the parameterized path is to extend or modify the existing path in the user interface. The existing path is modified or extended in the user interface using the parameterized path in response to the determining that the parameterized path is to modify or extend the existing path.

Abstract: The present disclosure describes techniques for identifying images of users in visual media data. One example method includes receiving visual media data from a client device, wherein the visual media data was captured in real time by the client device; detecting a presence of an image of a human in the visual media data; determining a user identification associated with the human based on the detected presence of the image of the human in the visual media data; retrieving data corresponding to the user based on the user identification; generating user graphics data based on the retrieved data corresponding to the user; and transmitting the user graphics data to the client device, wherein the client device is configured to display the user graphics data with the visual media data.

Abstract: An information processing apparatus according to an embodiment of the present technology includes an acquisition unit; and a display control unit. The acquisition unit is capable of acquiring a first image obtained by capturing an image of a real space reflected on a user's eyeball, and a second image obtained by capturing an image related to the real space displayed on a predetermined display unit, the real space displayed on the predetermined display unit being reflected on the eyeball. The display control unit controls, on a basis of the acquired first image and the acquired second image, image display performed by the predetermined display unit.

Abstract: A computer-implemented technique is described herein for generating a digital representation of real-world surfaces in an environment. The technique involves receiving sensor data captured by one or more depth-sensing devices. The technique then provides a low-detail (LD) representation of surfaces in the physical environment based on the sensor data; that LD representation describes one or more planes in the physical environment. The technique then generates a high-detail (HD) representation of the surfaces based on the sensor data and the LD representation. Finally, the technique provides an output result based on the LD representation and/or the HD representation. According to one illustrative aspect, the technique produces the HD representation such that it is non-duplicative of information that is already present in the LD representation. The technique performs this task by identifying and excluding HD information that is already adequately represented by the LD representation.

Abstract: On a display configured to provide a photorepresentative view from a user's vantage point of a physical environment in which the user is located, a method is provided comprising receiving, from the user, an input selecting a theme for use in augmenting the photorepresentative view. The method further includes obtaining, optically and in real time, environment information of the physical environment and generating a spatial model of the physical environment based on the environment information. The method further includes identifying, via analysis of the spatial model, one or more features within the spatial model that each corresponds to one or more physical features in the physical environment. The method further includes based on such analysis, displaying, on the display, an augmentation of an identified feature, the augmentation being associated with the theme.

Abstract: Embodiments for managing text in rendered images by one or more processors are described. An image rendered by a display device is detected. The rendered image includes an object component and a text component at least partially overlapping the object component. A size of the object component of the image is caused to change. Based on a comparison of the changed size of the object component of the image to a size of the text component of the image, one or more text modification option is caused to be rendered by the display device. An indication of a selection of at least one of the one or more text modification option is received. The text component of the image is caused to change based on the selected one or more text modification option.

Abstract: Instructions indicative of changing a view of a virtual object may be received by a device. At least a portion of the virtual object may be viewable from a viewpoint that is at a given distance from a surface of the virtual object. The device may cause a change of the view along a rotational path around the virtual object in response to the receipt of the instructions based on the given distance being greater than a threshold distance. The device may cause a change of the view along a translational path indicative of a shape of the surface of the virtual object in response to the receipt of the instructions based on the given distance being less than the threshold distance.

Abstract: A display apparatus, an information processing system using the same, and a control method that are capable of providing information on a plurality of objects. A display apparatus includes a control unit and a display unit. The control unit groups a plurality of objects distributed in a reality space or a virtual space around a user and generates a distribution display, the distribution display displaying a region in which the grouped objects are distributed. The display unit presents the distribution display in a field of view of the user.

Abstract: Embodiments of the present disclosure present devices, methods, and computer readable medium for techniques to display rectangular content in non-rectangular display areas without clipping or cutting off the content. These bounding path techniques can be employed for electronic devices with rounded corners and for display of content within software windows for applications, in which the windows have non-rectangular corners. The techniques disclosed include content shifting, aspect fit, run length encoding and corner encoding. These techniques can be applied to both static content and for dynamic content. Memory optimization techniques are disclosed to reduce the memory requirements for encoding display bitmaps and for optimal performance. The run length encoding feature can reduce the time and decrease the memory requirements for determining a location where the content can fit within a viewable area of the display. The corner encoding technique provides for encoding areas with non-linear curves.

Abstract: One disclosed example provides a computing device comprising a logic subsystem comprising a processor, and memory storing instructions executable by the logic subsystem. The instructions are executable to display via a display system one or more holographic objects, receive depth image data from a depth image sensor, detect a user input setting a trajectory for a selected holographic object, in response to detecting the user input setting the trajectory for the selected holographic object, determine the trajectory for the selected holographic object set by the user input, determine, based upon the depth image data and the trajectory, a surface intersected by the trajectory of the selected holographic object, and display via the display system the selected holographic object as travelling along the trajectory and changing in form upon encountering the surface.

Abstract: Large data sets (e.g., with millions of records) are represented by a heat map within a user interface (UI). Each record in the data set includes a label. The labels of the records are assigned to leaf nodes of a data structure. The leaf nodes are mapped to a grid of cells according to a layout method. Furthermore, values are determined for the cells based on data records having the labels mapped to the cells. A visual property is selected for each cell based on the corresponding value. Since the data labels are stored in leaf nodes that are connected to internal nodes, if a zoom state of the heat map results in a display of a number of data labels that exceeds the number of cells in the grid, values of the cells can be updated according to values determined from the internal nodes without losing the connections between the cells and the underlying leaf nodes.

Abstract: A modeling method searches for a sequence matched to a user input using a fluid animation graph generated based on similarities among frames included in sequences included in the fluid animation graph and models a movement corresponding to the user input based on a result of the searching. Provided also is a corresponding apparatus and a method for preprocessing for such modeling.

Abstract: Certain embodiments involve calculating a vanishing point location of an image to realistically blend multiple images. For example, a method for modifying image content based on a vanishing point location computed for a background image includes receiving the background image and classifying a set of planes in the background image. The method also includes identifying, using plane boundaries, a first set of line segments that define first convergence points. Additionally, the method includes identifying a second set of line segments that are positioned within individual planes and that define second convergence points. Further, the method includes grouping the first convergence points and the second convergence points into a cluster and computing the vanishing point location from an average of point locations in the cluster. Furthermore, the method includes manipulating a feature image overlaid on the background image to generate a blended image based on the vanishing point location.