Abstract: The present disclosure generally relates to providing electronic devices with faster, more efficient methods and context-specific user interfaces for indicating time. Such methods and interfaces optionally complement or replace other methods for indicating time. Such methods and interfaces reduce the cognitive burden on a user and produce a more efficient human-machine interface. For battery-operated computing devices, such methods and interfaces conserve power and increase the time between battery charges.

Abstract: The disclosed computer-implemented method may include accessing a media item that includes multiple media item segments that are to be played back in a specific manner. The method may also include generating playgraphs for the media item, where the playgraphs define different playback paths between media item segments. The method may next include selecting a specific playgraph from the generated playgraphs, and then providing the selected playgraph to a playback device. Playback of the media item according to the selected playgraph may thereby provide a customized presentation of the media item. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: A background music providing method includes: based on a user command for executing a content recognition mode being received, obtaining a data corresponding to the content, reproduced on the display apparatus, in the content recognition mode; transmitting the obtained data to an external source; obtaining information corresponding to the content based on the data from the external source; and displaying a result UI corresponding to the obtained information on the display apparatus.

Abstract: A viewing abandonment factor estimation device includes a memory; and a processor configured to include an estimation model for estimating a factor, the estimation model including a plurality of feature quantities measurable for viewing of a video relevant to an adaptive bit rate video distribution as inputs and the factor of the viewing abandonment in the viewing as an output.

Abstract: A real-time conversation is monitored between a user and an intelligent virtual assistant (IVA). A visualization may be generated and displayed to the user on the user computing device based on one or more topics identified in the conversation. The conversation between the user and the IVA may continue and is continued to be monitored. The visualization can be updated as the conversation continues, e.g., based on further topics being identified.

Abstract: In one aspect, an example method includes (i) while a media playback device of a vehicle is playing back content received on a first channel, sending, by the media playback device to a server, a preview request, the preview request identifying a second channel that is different from the first channel; (ii) receiving, by the media playback device from the server, a response to the preview request, the response including identifying information corresponding to content being provided on the second channel; and (iii) while the media playback device is playing back the content received on the first channel, providing, by the media playback device for display, at least a portion of the identifying information corresponding to content being provided on the second channel.

Abstract: In aspects, methods and apparatus are provided for the generation of haptic command signals to cause haptic effect outputs at one or more haptic output devices. The haptic command signals may be generated based on haptic media, supplementary media, and/or haptic device capability. Generating the haptic command signals may include creation or modification of haptic effects, distribution of haptic effects, and/or warping of haptic signals. The methods and apparatus may operate according to combinations of developer provided rules and system enabled inferences. Numerous other aspects are provided.

Abstract: A system that incorporates the subject disclosure may include, for example, a gaming system that cooperates with a graphical user interface to enable user modification and enhancement of one or more audio streams associated with the gaming system. In embodiments, the audio streams may include a game audio stream, a chat audio stream of conversation among players of a video game, and a microphone audio stream of a player of the video game. Additional embodiments are disclosed.

Abstract: An electronic apparatus, including a memory configured to store a first artificial intelligence model; and a processor connected to the memory and configured to: based on receiving an input audio signal, obtain an input frequency spectrum image representing a frequency spectrum of the input audio signal, input the input frequency spectrum image to the first artificial intelligence model, obtain an output frequency spectrum image from the first artificial intelligence model, obtain an output audio signal based on the output frequency spectrum image, wherein the first artificial intelligence model is trained based on a target learning image, and wherein the target learning image represents a target frequency spectrum of a specific style, and is obtained from a second artificial intelligence model based on a random value.

Abstract: Disclosed herein are system, method, and computer program product embodiments for storing files in a storage location that is associated with an image object that is displayed in a real-time view on a mobile device. Examples of an image object include physical objects and augmented objects. Display of the real-time view includes the image object as well as interfaces for interacting with the image object including creating a storage location associated with the image object. Moreover, security features may be based on using information associated with the image object to securely store the file, either locally on the mobile device or over a network (e.g., at a cloud-based location) using the mobile device.

Abstract: A plurality of music samples and a plurality of images corresponding to the music samples may be stored in a database. The plurality of music samples may be sorted in an order of priority. Information associated with the plurality music samples may be sent to a user device. The user device may display the plurality of images corresponding to the plurality of music samples in the order of priority. The user device may receive information indicative of at least one video associated with a music sample in response to receiving user input indicative of a selection of an image among the plurality of images. The user device may display at least one sample video image corresponding to the at least one video associated with the music sample.

Abstract: Embodiments facilitate the intuitive creation, maintenance, and distribution of action datasets that include computing events or tasks that can be reproduced when a command is received by a digital assistant. The digital assistant can generate new action datasets, on-board new action datasets, and receive new action datasets or updates to existing action datasets locally or via a digital assistant server, among other things. The digital assistant server can also receive action datasets, maintain action datasets, and distribute action datasets to one or more digital assistants, among other things.

Abstract: A system for providing mobile content to a mobile communication device includes a first computing system including one or more servers to cause a graphical user interface to be displayed at a second computing system, the graphical user interface (i) enabling a user of the second computing system to at least one of create, edit, or select the mobile content and (ii) enabling the user of the second computing system to provide a phone number associated with the mobile communication device, the mobile communication device being separate and remote from the first computing system and the second computing system.

Abstract: One example method of operation may include determining whether a received command will be locally processed by a control device, determining an audio stream is associated with the received command, forwarding the audio stream to a server, and forwarding an audio output to a termination device based on a processed audio stream.

Abstract: Novel tools and techniques are provided for implementing voice monitoring and tracking, and, more particularly, to methods, systems, and apparatuses for implementing voice monitoring and tracking of participants in group settings. In various embodiments, a computing system might receive, from at least one audio sensor among the one or more audio sensors disposed within the first space, voice signals corresponding to voices associated with individuals present within the first space. The computing system might analyze the received voice signals to identify one or more individuals who are present within the first space. The computing system might present, within a user interface of the user device associated with the user, information regarding the identified one or more individuals to assist the user in coordinating discussions among the individuals present within the first space.

Abstract: An image display method for a terminal device that includes a display section having an input section includes displaying a plurality of images including a first image, a second image adjacent to the first image, and a third image adjacent to the second image along a predetermined axis, receiving selection of the first image based on touch input, performing, when a first movement instruction to move the first image to a gap between the second image and the third image is received, display in a first display form indicating that the first image has been moved to the gap between the second image and the third image, and performing, when a second movement instruction to move the first image to a position different from the gap between the second image and the third image is received, display in a second display form different from the first display form.

Abstract: A messaging system, comprising an electronic message having integrated digital content that is scripted by seamless linking of multiplicity of electronic media components. An electronic media component is comprised of a compilation of one or more electronic media element, with an electronic media element comprised of one or more data. Communication protocols for delivery and receipt of the electronic message is used, with the multiplicity of electronic media components of a received electronic message seamlessly executed in an order, arrangement, and sequence intended by the scripted digital content at one of a first and second client-device.

Abstract: Immersive web-based simulator for digital assistant-based applications is provided. A system can provide, for display in a web browser, an inner iframe configured to load, in a secure, access restricted computing environment, an application configured to integrate with a digital assistant. The application can be provided by a third-party developer device. The system can provide, for display in a web browser, an outer iframe configured with a two-way communication protocol to communicate with the inner iframe. The system can provide a state machine to identify a current state of the application loaded in the inner frame, and load a next state of the application responsive to a control input.

Abstract: Systems and methods for efficient management of an audio/video conferences is disclosed. The method includes receiving an audio question from a first user of a plurality of users connected to a conference, recording the audio question and preventing an immediate transmission of the audio question to the plurality of users connected to the conference, analyzing the recorded audio question to determine that the audio question is relevant to a second user of the plurality of users and not relevant to a third user of the plurality of users, preventing the audio question from being transmitted to the third user, and transmitting the audio question to the second user of the plurality of users.

Abstract: Further disclosed herein is a system for facilitating generation of an interactive story based on non-interactive data, in accordance with some embodiments. Accordingly, the system may include a communication device, a processing device, and a storage device. Further, the communication device may be configured for receiving non-interactive data from a source device, transmitting interactive story data to a user device, receiving a request from the user device, and transmitting a response to the user device. Further, the processing device may be configured for analyzing the non-interactive data, generating the interactive story data based on the analyzing, analyzing the at least one request, and generating the response based on the analyzing of the interactive story data and the analyzing of the request. Further, the storage device may be configured for storing the non-interactive data, the interactive story data, the request, and the response.

Abstract: Systems and processes for accelerating task performance are provided. An example method includes, at an electronic device with a display, displaying a candidate shortcut affordance associated with a user activity, detecting a first set of inputs corresponding to a selection of the candidate shortcut affordance, in response to detecting the first set of inputs, displaying a first set of candidate task affordances, detecting a second set of inputs corresponding to a selection of a candidate task affordance associated with a first task, displaying a second set of candidate task affordances, detecting a third set of inputs corresponding to a selection of a candidate task affordance associated with a second task, and in response to detecting the second set of inputs and the third set of inputs, associating the first task and the second task with a task sequence for a voice shortcut corresponding to the user activity.

Abstract: Systems, methods, and apparatus for dynamically partitioning items in a list into one or more subsets in a manner tailored to a current modality of a client device is disclosed herein. Multimodal client devices can engage in a variety of interactions across the multimodal spectrum including voice only interactions, voice forward interactions, multimodal interactions, visual forward interactions, visual only interactions, etc. A list can be partitioned into subsets in part based on a currently modality of a multimodal device, one or more list attributes indicating additional information about the list, etc.

Abstract: A system and method for an interactive digitally rendered avatar of a subject person during a video presentation is described. In one embodiment, the method includes transmitting a video presentation featuring a subject person to a plurality of users via a first communication format. The method also includes receiving from at least one user of the plurality of users during the video presentation, a request to initiate an interactive session with an avatar of the subject person. In response to the request, the method includes generating a first avatar of the subject person and initiating a first interactive session between the first avatar and the at least one user. The method further includes engaging in the first interactive session between the first avatar of the subject person and the at least one user via a second communication format that is different than the first communication format.

Abstract: The method provides for one or more processor receiving on a personal device, a mixture of sounds within a sound stream from multiple sources. The one or more processors identifying one or more sounds of the mixture of sounds from the multiple sources, based on a sound separation technique. The one or more processors displaying on a user interface of the personal device an icon corresponding respectively to a classification of the one or more sounds identified from the multiple sources. The one or more processors receiving a selection of a sound from the mixture of the multiple sounds, based on an action by a user of the personal device selecting the icon displayed on the user interface of the personal device, and the one or more processors recording the sound from the mixture of the multiple sounds selected by the user.

Abstract: An image sensor includes a pixel array having a plurality of pixels arranged in rows and columns, a plurality of pixel readout lines coupled to respective pixels, a multiplexing circuit coupled to the pixel readout lines, a plurality of analog-to-digital converters coupled to the multiplexing circuit, and a controller configured to provide pixel readout signals of pixels arranged in a same column to the analog-to-digital converters through the multiplexing circuit for concurrent signal conversion.

Abstract: Multiple applications may execute on a computing device and the computing system may monitor the multiple applications, identify a set e applications generating sound and determine whether at least one sound related criterion is satisfied. If at least one sound related criterion is satisfied, the computing system displays sound indicators for the set of applications generating sound.

Abstract: A system and method for an interactive digitally rendered avatar of a subject person during a video presentation is described. In one embodiment, the method includes transmitting a video presentation featuring a subject person to a plurality of users via a first communication format. The method also includes receiving from at least one user of the plurality of users during the video presentation, a request to initiate an interactive session with an avatar of the subject person. In response to the request, the method includes generating a first avatar of the subject person and initiating a first interactive session between the first avatar and the at least one user. The method further includes engaging in the first interactive session between the first avatar of the subject person and the at least one user via a second communication format that is different than the first communication format.

Abstract: A system for measuring sound levels is provided. The system comprises a processor, a memory, and an application stored in the memory that when executed on the processor receives sound levels recorded by each of a plurality of sound sensors located in a coverage area. The application also samples noise levels from the received sound levels at least one location within the coverage area. The application also derives values based at least on the samples and on estimates of sound attenuation at the at least one location. The application also creates a heat map based at least on the derived values, the heat map representing at least noise levels experienced within the coverage area.

Abstract: A method for identifying a product which appears in a video stream. The method includes playing the video stream on a video playback device, identifying key scenes in the video stream containing product images, selecting product images identified by predetermined categories of trained neural-network object identifiers stored in training datasets. Object identifiers of identified product images are stored in a database. Edge detection and masking is then performed based on at least one of shape, color and perspective of the object identifiers. A polygon annotation of the object identifiers is created using the edge detection and masking. The polygon annotation is annotated to provide correct object identifier content, accuracy of polygon shape, title, description and URL of the object identifier for each identified product image corresponding to the stored object identifiers. Also disclosed is a method for an end user to select and interact with an identified product.

Abstract: This application relates to an image processing method and apparatus, a storage medium, and a computer device. The method can include obtaining image frames acquired from a real scene, and playing the obtained image frames one by one according to an acquisition time sequence. The method can further include determining a position corresponding to a target object in the real scene when a trajectory formed by a movement of the target object in a plurality of the obtained image frames meets a trigger condition, rendering a virtual entry in a currently played image frame according to the position, and displaying virtual content in the virtual entry. The solutions provided in this application improve image processing efficiency.

Abstract: Systems and methods enable a computing system to recognize a sequence of repeated actions and offer to automatically repeat any such recognized actions. An example method includes determining a current sequence of user actions is similar to a previous sequence of user actions, determining whether the previous sequence is reproducible and, when reproducible, initiating display of a prompt that requests approval for completing the current sequence based on the previous sequence and, responsive to receiving an indication of approval, completing the previous sequence. Another example method includes determining that a first current sequence of user interactions is complete and is not similar to any saved sequence of user interactions, saving the first current sequence as a previous sequence, identifying a second current sequence as satisfying a similarity threshold with the previous sequence, and initiating display of a prompt that requests approval for saving the previous sequence as a shortcut.

Abstract: In one general aspect, a computer-implemented method includes identifying current choices with different verbosity levels for a current turn in a conversation; normalizing multi-dimensional verbosity vectors for each of the current choices to obtain a normalized value for each of the current choices; determining a state definition for the current turn in the conversation, utilizing the normalized values for each of the current choices; providing the state definition for the current turn in the conversation and the normalized values for each of the current choices to a trained reinforcement learning module; receiving, from the trained reinforcement learning module, a score associated with each of the current choices for the current turn in the conversation; and selecting one of the current choices to be entered for the current turn in the conversation, based on the score associated with each of the current choices for the current turn in the conversation.

Abstract: Systems and processes for accelerating task performance are provided. An example method includes, at an electronic device with a display, displaying a candidate shortcut affordance associated with a user activity, detecting a first set of inputs corresponding to a selection of the candidate shortcut affordance, in response to detecting the first set of inputs, displaying a first set of candidate task affordances, detecting a second set of inputs corresponding to a selection of a candidate task affordance associated with a first task, displaying a second set of candidate task affordances, detecting a third set of inputs corresponding to a selection of a candidate task affordance associated with a second task, and in response to detecting the second set of inputs and the third set of inputs, associating the first task and the second task with a task sequence for a voice shortcut corresponding to the user activity.

Abstract: A technique for improving meeting participation in electronically calendared meetings includes a data processing system receiving an electronic invitation to a virtual meeting that requires access to one or more referenced resources for a meeting invitee to fully participate in the meeting. Whether the invitee has access to the referenced resources is determined by a data processing system. In response to determining that the invitee does not have access to the referenced resources, access for the invitee to the referenced resources is provisioned by a data processing system. Finally, the meeting is added to an electronic calendar associated with the invitee.

Abstract: An emergency rescue request notification method using an infotainment system and a system therefor are provided. The emergency rescue request notification method in the vehicle includes detecting an accident of the vehicle, collecting information corresponding to the detected accident, generating an emergency rescue request message based on the collected information, searching for an FM radio channel with the highest receive sensitivity, changing and transmitting a program type of the found FM radio channel to a specific value using an FM radio data system (RDS) message, and transmitting the emergency rescue request message over the found FM radio channel.

Abstract: An electronic device and method are disclosed. The electronic device includes a display, a microphone, a communication circuit, a processor, and a memory. The memory stores instructions that, when executed by the processor, implement the method. The method includes determining whether the electronic device is communicatively coupled to an external display device, when the electronic device is not communicatively coupled to the external display, receiving a first user utterance, executing a task corresponding to at least one of a word, phrase or sentence included in the first user utterance as indicated by the mapping, the task preconfigured by a user, and when the electronic device is communicatively coupled to the external display device, displaying at least one of a text and a graphical user interface (GUI) indicating the at least one word, phrase, and sentence on the external display.

Abstract: A method performed by a computing system for directing a voice command to a function associated with a visual target includes receiving a set of time-variable sensor-based data streams, including an audio data stream and a targeting data stream. The targeting data stream is stored in a buffer as buffered targeting data. Presence of a spoken utterance is identified within the audio data stream and is associated with a temporal identifier corresponding in time to the set of sensor-based data streams. A voice command corresponding to the spoken utterance is identified. A visual targeting vector within the buffered targeting data and a visual target of that visual targeting vector is identified at a time corresponding to the temporal identifier. The voice command is directed to a function associated with the visual target to generate an output.

Abstract: A non-transitory computer readable storage medium has instructions executed by a processor to specify a group of collaborators. Each collaborator in the group of collaborators is polled for window information for each window to be shared among the collaborators in a composite window collection. The window information includes end user device attributes for each collaborator and window metadata for each window to be shared among the collaborators in the composite window collection. Required parameters are calculated for each window to be shared among the collaborators in the composite window collection. The required parameters include window visibility criteria in the composite window collection. Sending clients in the group of collaborators are instructed on required parameters for each window to be shared among the collaborators in the composite window collection.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing search information. One of the methods includes receiving search information from a user and sending the search information to a cloud server to cause the cloud server to perform search processing based on the search information. The method further includes pushing display information to the user on a display interface before the cloud server returns a result associated with the search processing.

Abstract: Methods, systems, and apparatus, including computer-readable media storing executable instructions, for enhanced video conference management. In some implementations, a participant score for each participant in a set of multiple participants in the communication session. Each of the participant scores is based on at least one of facial image analysis or facial video analysis performed using image data or video data captured for the corresponding participant during the communication session. Each of the participant scores is indicative of an emotional or cognitive state of the corresponding participant. The participant scores are used to generate an aggregate representation of the emotional or cognitive states of the set of multiple participants. During the communication session, output data is comprising the aggregate representation of the emotional or cognitive states of the set of multiple participants is provided for display.

Abstract: A Bluetooth device and a method of operating the Bluetooth device are provided. The Bluetooth device includes a communication circuit and a processor coupled to the communication circuit. The communication circuit is configured to receive a setting data through a control channel. The processor is configured to alter, by the setting data, at least one of executing parameters to modify operating environments, and the processor is further configured to perform operations of Bluetooth communications according to the operating environments which have been modified.

Abstract: Methods, systems, and computer-readable media are provided that cause a system to generate read states for virtual lines tracked and displayed within a viewport for reading content read by a user. The position of, and number of words assigned to, the virtual lines can be calculated. The read states can be based on: a duration of time that each of the virtual lines remains in the viewport, and the number of words assigned to each of the virtual lines. The duration of time is determined by a counter. Methods, systems, and computer-readable media are provided that cause a computer system to receive one or more read states; determine a reading status of a user with respect to reading content; and, enabling one or more user privileges related to the reading content for the user as a result of a determination that the user has read at least a predetermined threshold amount.

Abstract: Methods, apparatus, and computer readable media related to interaction between a user and an automated assistant during a dialog between the user and the automated assistant. Some implementations are directed to adapting a graphical and/or audible presentation of search results provided by the automated assistant for presentation to the user. The adaptation may be in response to attribute(s), of one or more of the search results, referenced in spoken and/or typed textual input provided by the user during the dialog. Some of those implementations may enable a user to provide textual input to navigate the search results within the dialog and within resource and/or interface constraints associated with the dialog. Some of those implementations may additionally and/or alternatively enable adapting, based on textual input provided by a user to the automated assistant, when and/or whether search results having certain attributes are provided to the user by the automated assistant.

Abstract: Novel tools and techniques are provided for implementing voice monitoring and tracking, and, more particularly, to methods, systems, and apparatuses for implementing voice monitoring and tracking of participants in group settings. In various embodiments, a computing system might receive, from at least one audio sensor among the one or more audio sensors disposed within the first space, voice signals corresponding to voices associated with individuals present within the first space. The computing system might analyze the received voice signals to identify one or more individuals who are present within the first space. The computing system might present, within a user interface of the user device associated with the user, information regarding the identified one or more individuals to assist the user in coordinating discussions among the individuals present within the first space.

Abstract: Systems, methods, and computer-readable media for collecting analytic data for application navigation with an electronic device are provided. A navigation event operative to navigate away from the presentation of a particular type of application content of an application (e.g., a news article of a news aggregator application) or any other suitable analytic event may be carried out on an electronic device, in response to which the device may be operative to collect certain data for defining an analytics payload of data that may then be shared by the device for any suitable analysis, such as to analyze how a user arrived at that presented article, how long a user viewed the article, whether or how often a user played back any video embedded in the article, and/or the like, where such analysis may be used to more effectively recommend news articles to the user in the future.

Abstract: An electronic device obtains one or more images of a scene. After obtaining the one or more images of the scene, the electronic device detects a plurality of objects within the scene, provides a first audible description of the scene, and detects a user input that selects a respective object of the plurality of objects within the scene. The first audible description of the scene provides information corresponding to the plurality of objects as a group. In response to the user input selecting the respective object within the scene, the electronic device provides a second audible description of the respective object. The second audible description is distinct from the first audible description and includes a description of one or more characteristics specific to the respective object.

Abstract: A device and method for backward compatibility for virtual reality (VR), mixed reality (MR), augmented reality (AR), computer vision, and graphics systems. The device and method enable rendering audio data with more degrees of freedom on devices that support fewer degrees of freedom. The device includes memory configured to store audio data representative of a soundfield captured at a plurality of capture locations, metadata that enables the audio data to be rendered to support N degrees of freedom, and adaptation metadata that enables the audio data to be rendered to support M degrees of freedom. The device also includes one or more processors coupled to the memory, and configured to adapt, based on the adaptation metadata, the audio data to provide the M degrees of freedom, and generate speaker feeds based on the adapted audio data.

Abstract: In response to a user identity request, a system can receive user identity data associated with the user identity from a first mobile device. Based on the user identity data, the system can allocate an interface template to the user identity, wherein the interface template comprises scorecard data, from a second mobile device, associated with a scoring parameter related to an input field of the interface template. Furthermore, the system can prompt an input, via the first mobile device, to the input field of the interface template. Additionally in response to receiving input data associated with the input, the system can compare the input data to the scoring parameter.

Abstract: Provided is an information processing system including an output control unit that controls a display output unit in a manner that a display object indicating a sequential passage of time is displayed. The display object indicates a playback position of content, the display object including a plurality of areas corresponding to a plurality of pieces of the content. The present technology enables a user to intuitively perceive the relationship between the plurality of pieces of content and the piece of content that is currently being played back.

Abstract: A method for controlling a user interface of an electronic device by providing for the benefit of a user a projection of an operating interface includes a projection device to project an operating interface on a surface and controlling a detecting device to detect control operations on the projected interface by the user. A type of the user's control operation is determined, wherein the types of the control operations can include gestures and touch operations. The electronic device is controlled to perform a function in response to the touch operation or the gesture operation.