Abstract: Provided are methods, systems, and devices for generating semantic objects and an output based on the detection or recognition of the state of an environment that includes objects. State data, based in part on sensor output, can be received from one or more sensors that detect a state of an environment including objects. Based in part on the state data, semantic objects are generated. The semantic objects can correspond to the objects and include a set of attributes. Based in part on the set of attributes of the semantic objects, one or more operating modes, associated with the semantic objects can be determined. Based in part on the one or more operating modes, object outputs associated with the semantic objects can be generated. The object outputs can include one or more visual indications or one or more audio indications.

Abstract: Methods, systems, and apparatus include computer programs encoded on a computer-readable storage medium, including a method for providing information. A request is received by a call routing server to establish a call between a client device and a remote telecommunications device. A given transmission criterion that triggered distribution of the particular digital component to the client device is determined by a call context server. A set of contextual information that is mapped to the given transmission criterion is identified, by the call context server, in a data store storing a mapping of transmission criteria to contextual information. The client device is connected, by the call routing server, to the remote telecommunications device using the phone number. The set of contextual information is transmitted to the remote telecommunications device or a computing device that is associated with the remote telecommunications device while the call is being connected or in progress.

Abstract: Methods, systems, and apparatus include computer programs encoded on a computer-readable storage medium, including a method for providing information. A request is received by a call routing server to establish a call between a client device and a remote telecommunications device. A given transmission criterion that triggered distribution of the particular digital component to the client device is determined by a call context server. A set of contextual information that is mapped to the given transmission criterion is identified, by the call context server, in a data store storing a mapping of transmission criteria to contextual information. The client device is connected, by the call routing server, to the remote telecommunications device using the phone number. The set of contextual information is transmitted to the remote telecommunications device or a computing device that is associated with the remote telecommunications device while the call is being connected or in progress.

Abstract: A method includes: receiving, in a device, data defining an augmented reality (AR) environment, the data specifying a location of a first AR object in the AR environment; determining a physical inclination of the device; assigning a perception inclination to a map of the AR environment, the perception inclination based on the determined physical inclination; and triggering rendering of the map and an aspect of the AR environment on a display of the device, wherein the location of the first AR object is marked on the map and the map appears to have the perception inclination with regard to the display.

Abstract: A method includes: triggering rendering of an augmented reality (AR) environment having a viewer configured for generating views of the AR environment; triggering rendering, in the AR environment, of an object with an outside surface visualized using a mesh having a direction oriented away from the object; performing a first determination that the viewer is inside the object as a result of relative movement between the viewer and the object; and in response to the first determination, increasing a transparency of the outside surface, reversing the direction of at least part of the mesh, and triggering rendering of an inside surface of the object using the part of the mesh having the reversed direction, wherein the inside surface is illuminated by light from outside the object due to the increased transparency.

Abstract: A method includes: receiving, in a first device, a relative description file for physical markers that are positioned at locations, the relative description file defining relative positions for each of the physical markers with regard to at least another one of the physical markers; initially localizing a position of the first device among the physical markers by visually capturing any first physical marker of the physical markers using an image sensor of the first device; and recognizing a second physical marker of the physical markers and a location of the second physical marker without a line of sight, the second physical marker recognized using the relative description file.

Abstract: Systems and methods for inserting and transforming content are provided. For example, the inserted content may include augmented reality content that is inserted into a physical space or a representation of the physical space such as an image. An example system and method may include receiving an image and identifying a physical location associated with a display management entity within the image. The example system and method may also include retrieving content display parameters associated with the display management entity. Additionally, the example system and method may also include identifying content to display and displaying the content using the display parameters associated with the display management entity.

Abstract: Methods, systems, and apparatus include computer programs encoded on a computer-readable storage medium, including a method for providing information. A request is received by a call routing server to establish a call between a client device and a remote telecommunications device. A given transmission criterion that triggered distribution of the particular digital component to the client device is determined by a call context server. A set of contextual information that is mapped to the given transmission criterion is identified, by the call context server, in a data store storing a mapping of transmission criteria to contextual information. The client device is connected, by the call routing server, to the remote telecommunications device using the phone number. The set of contextual information is transmitted to the remote telecommunications device or a computing device that is associated with the remote telecommunications device while the call is being connected or in progress.

Abstract: Contextual content is provided to a first conversation participant via a client device of the first conversation participant. Communication information associated with a conversation is received via the first client device interface. Context information associated with the conversation is retrieved from the received communication information. One or more concepts associated with the conversation are identified based on the context information. Content is selected for presenting on the client device based on the identified concepts. The selected content is then presented to the first conversation participant in a second client device interface.

Abstract: Data is asynchronously provided to a participant of a conversation. A temporal model is maintained for each of a plurality of client devices associated with the conversation. A temporal model describes a state of an associated client device. Data for sending to a client device is identified based on conversation context information describing a context of a conversation participant associated with the client device. A determination of whether to send the identified data to the client device is made based on the temporal model associated with the client device. The temporal model associated with the client device is updated based on the determination.

Abstract: A gesture-based search interface is provided on a client device. A concept interface is displayed within the search interface, the concept interface including a plurality of selected concept tabs. A content interface is also displayed within the search interface, the content interface configured to, in response to a selection of a concept tab, display content associated with a concept represented by the selected concept tab. A gesture input is received at the client device, for instance a touch input received at a touch-screen of the client device. A concept input mechanism is presented in response to the gesture input, and an additional concept tab is presented within the concept interface in response to receiving a concept via the concept input mechanism. The content interface displays content associated with the received concept when the additional concept tab is selected.

Abstract: Conversation information is provided to a conversation participant. Audio data is received a client device associated with a conversation participant. The client device maintains a buffer of received audio data, for instance audio data received in a previous interval of time. A recall request is received by the client device for information associated with the buffered audio data. The buffered audio data is analyzed responsive to the recall request to identify the requested information. The identified information is then presented at the client device.

Abstract: A user interface (UI) is provided on a client device to a user. The UI includes a concept bar and a content window. The concept bar includes a plurality of concept tabs associated with concepts currently relevant to a collaborative communication session involving the user and other participants. The concept tabs are configured to enable interaction with the concept tabs by the user. The content window is presented separately from the concept bar, and includes content relevant to the collaborative communication session based on the concept tabs presented by the concept bar. The content presented by the content window is modified in response to interaction by the user with the concept tabs.