Abstract: A method for making a customized earpiece includes creating a unique identifier associated with a user, scanning an ear of the user with an electronic device that includes at least one camera system that configured to perform three dimensional mapping image scans, associating the unique identifier with one or more scans obtained via the electronic device, receiving, at a database, the one or more scans via transmission from the electronic device, receiving, at the database, one or more earpiece parameters via transmission from the electronic device, forming, via a three-dimensional printer, a mold having an internal configuration corresponding to the one or more scans and the one or more earpiece parameters. The mold can then be utilized to create a custom-fit earpiece that includes customized internal components and other features that match the earpiece parameters provided by the user. A system utilizing the above method is also included.

Abstract: An apparatus for rendering communication audio signal within an immersive audio scene, the apparatus including circuitry configured to: obtain at least one spatial audio signal for rendering within the immersive audio scene; obtain the communication audio signal and positional information associated with the communication audio signal; obtain a rendering processing parameter associated with the communication audio signal; determine a rendering method based on the rendering processing parameter; determine an insertion point in a rendering processing for the determined rendering method and/or a selection of rendering elements for the determined rendering method based on the rendering processing parameter.

Abstract: Embodiments of this specification describe technologies for interaction with a digital assistant. One method comprises: based on a storage configuration of the digital assistant, determining whether interaction information between a user and the digital assistant comprises one of: information corresponding to a first type or information depending on the first type of information indicated by the storage configuration; in response to the interaction information comprising the first type of information and the first type of information being not stored, writing the first type of information into a storage area; in response to the interaction information comprising information depending on the first type of information and the first type of information having been stored, reading the stored first type of information from the storage area; and determining, based on the stored or read first type of information, a response of the digital assistant to the user.

Abstract: Machine intelligence platform system and methods include a server, coupled to a processor, and configured to execute instructions that: receive an input from a user; translate the input to a perceived intent; apply one or more algorithms to the perceived intent; and output a response to the user. The server includes a user interface (UI) layer configured to receive the input from a user and to transmit an output to the user, an intent layer configured to translate input received from the UI layer into a perceived intent, an intelligence layer configured to apply one or more algorithms to the perceived intent based on one or more classes of data, the classes of data selected from: (i) static data and (ii) dynamic data, and a data layer configured to store and retrieve the one or more classes of data.

Abstract: An utterance imaging device reduces a cognitive load on utterance details by extracting some character strings from character strings recognized as sounds from an utterance, acquiring an image based on the some character strings, and outputting the image to a position corresponding to a speaker related to the utterance.

Abstract: Disclosed is a food texture presentation apparatus including a synthesizer that acquires, with reference of a recipe of a food product selected, audio signals of mastication sounds of ingredients contained in the food product from a database and synthesizes the acquired audio signals of the ingredients into an audio signal of a food texture to be presented, and a presentation unit that uses the synthesized audio signal to present the food texture of the food product.

Abstract: A system and method for a podcast community that creates an avenue for listeners to provide feedback to podcasters. These solutions include websites, web applications, mobile applications and algorithms that connect people listening to podcasts around the world. The mobile application creates a forum where podcast listeners can listen and comment on podcast episodes. Listeners can interact with each other, podcasters and featured guests on the applications. Users and podcasters can also attach media files to comments and podcasts respectively.

Abstract: A method and an apparatus for noise reduction, an electronic device, and a storage medium are disclosed. The method includes: generating a reference noise signal by picking up external noise; identifying a keyword in the reference noise signal, and determining a direction of desired speech based on the identified keyword; extracting a desired speech signal in the direction of desired speech, and acquiring an unwanted noise signal by filtering out the desired speech signal from the reference noise signal; and generating inverse noise by filtering the unwanted noise signal, to cancel the external noise. Thus, this method not only makes it convenient for users to receive desired speech by effectively extracting the desired speech, but also improves the noise reduction effect by eliminating the unwanted noise.

Abstract: A system that incorporates the subject disclosure may include, for example, a gaming system that cooperates with a graphical user interface to enable user modification and enhancement of one or more audio streams associated with the gaming system. In embodiments, the audio streams may include a game audio stream, a chat audio stream of conversation among players of a video game, and a microphone audio stream of a player of the video game. Additional embodiments are disclosed.

Abstract: As part of a dialog session between a user and an automated assistant, implementations can process, using a streaming ASR model, a stream of audio data that captures a portion of a spoken utterance to generate ASR output, process, using an NLU model, the ASR output to generate NLU output, and cause, based on the NLU output, a stream of fulfillment data to be generated. Further, implementations can further determine, based on processing the stream of audio data, audio-based characteristics associated with the portion of the spoken utterance captured in the stream of audio data. Based on the audio-based characteristics and/the stream of NLU output, implementations can determine whether the user has paused in providing the spoken utterance or has completed providing of the spoken utterance. If the user has paused, implementations can cause natural conversation output to be provided for presentation to the user.

Abstract: A method includes providing, for each respective audio channel of a plurality of audio channels provided by an operating system of a computing device, a set of successive audio processing stages to apply to the respective audio channel. The method also includes providing, by the operating system, an application programming interface (API) configured to set a plurality of parameters for adjusting the set of successive audio processing stages for each respective audio channel. The method additionally includes receiving, via the API and from an application running on the computing device, one or more values for one or more parameters of the plurality of parameters. The method further includes adjusting, by the operating system, the plurality of audio channels based on the received one or more values for the one or more parameters.

Abstract: The present disclosure generally relates to providing electronic devices with faster, more efficient methods and context-specific user interfaces for indicating time. Such methods and interfaces optionally complement or replace other methods for indicating time. Such methods and interfaces reduce the cognitive burden on a user and produce a more efficient human-machine interface. For battery-operated computing devices, such methods and interfaces conserve power and increase the time between battery charges.

Abstract: The disclosed computer-implemented method may include accessing a media item that includes multiple media item segments that are to be played back in a specific manner. The method may also include generating playgraphs for the media item, where the playgraphs define different playback paths between media item segments. The method may next include selecting a specific playgraph from the generated playgraphs, and then providing the selected playgraph to a playback device. Playback of the media item according to the selected playgraph may thereby provide a customized presentation of the media item. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: A background music providing method includes: based on a user command for executing a content recognition mode being received, obtaining a data corresponding to the content, reproduced on the display apparatus, in the content recognition mode; transmitting the obtained data to an external source; obtaining information corresponding to the content based on the data from the external source; and displaying a result UI corresponding to the obtained information on the display apparatus.

Abstract: A viewing abandonment factor estimation device includes a memory; and a processor configured to include an estimation model for estimating a factor, the estimation model including a plurality of feature quantities measurable for viewing of a video relevant to an adaptive bit rate video distribution as inputs and the factor of the viewing abandonment in the viewing as an output.

Abstract: A real-time conversation is monitored between a user and an intelligent virtual assistant (IVA). A visualization may be generated and displayed to the user on the user computing device based on one or more topics identified in the conversation. The conversation between the user and the IVA may continue and is continued to be monitored. The visualization can be updated as the conversation continues, e.g., based on further topics being identified.

Abstract: In one aspect, an example method includes (i) while a media playback device of a vehicle is playing back content received on a first channel, sending, by the media playback device to a server, a preview request, the preview request identifying a second channel that is different from the first channel; (ii) receiving, by the media playback device from the server, a response to the preview request, the response including identifying information corresponding to content being provided on the second channel; and (iii) while the media playback device is playing back the content received on the first channel, providing, by the media playback device for display, at least a portion of the identifying information corresponding to content being provided on the second channel.

Abstract: In aspects, methods and apparatus are provided for the generation of haptic command signals to cause haptic effect outputs at one or more haptic output devices. The haptic command signals may be generated based on haptic media, supplementary media, and/or haptic device capability. Generating the haptic command signals may include creation or modification of haptic effects, distribution of haptic effects, and/or warping of haptic signals. The methods and apparatus may operate according to combinations of developer provided rules and system enabled inferences. Numerous other aspects are provided.

Abstract: A system that incorporates the subject disclosure may include, for example, a gaming system that cooperates with a graphical user interface to enable user modification and enhancement of one or more audio streams associated with the gaming system. In embodiments, the audio streams may include a game audio stream, a chat audio stream of conversation among players of a video game, and a microphone audio stream of a player of the video game. Additional embodiments are disclosed.

Abstract: An electronic apparatus, including a memory configured to store a first artificial intelligence model; and a processor connected to the memory and configured to: based on receiving an input audio signal, obtain an input frequency spectrum image representing a frequency spectrum of the input audio signal, input the input frequency spectrum image to the first artificial intelligence model, obtain an output frequency spectrum image from the first artificial intelligence model, obtain an output audio signal based on the output frequency spectrum image, wherein the first artificial intelligence model is trained based on a target learning image, and wherein the target learning image represents a target frequency spectrum of a specific style, and is obtained from a second artificial intelligence model based on a random value.

Abstract: Disclosed herein are system, method, and computer program product embodiments for storing files in a storage location that is associated with an image object that is displayed in a real-time view on a mobile device. Examples of an image object include physical objects and augmented objects. Display of the real-time view includes the image object as well as interfaces for interacting with the image object including creating a storage location associated with the image object. Moreover, security features may be based on using information associated with the image object to securely store the file, either locally on the mobile device or over a network (e.g., at a cloud-based location) using the mobile device.

Abstract: A plurality of music samples and a plurality of images corresponding to the music samples may be stored in a database. The plurality of music samples may be sorted in an order of priority. Information associated with the plurality music samples may be sent to a user device. The user device may display the plurality of images corresponding to the plurality of music samples in the order of priority. The user device may receive information indicative of at least one video associated with a music sample in response to receiving user input indicative of a selection of an image among the plurality of images. The user device may display at least one sample video image corresponding to the at least one video associated with the music sample.

Abstract: Embodiments facilitate the intuitive creation, maintenance, and distribution of action datasets that include computing events or tasks that can be reproduced when a command is received by a digital assistant. The digital assistant can generate new action datasets, on-board new action datasets, and receive new action datasets or updates to existing action datasets locally or via a digital assistant server, among other things. The digital assistant server can also receive action datasets, maintain action datasets, and distribute action datasets to one or more digital assistants, among other things.

Abstract: A system for providing mobile content to a mobile communication device includes a first computing system including one or more servers to cause a graphical user interface to be displayed at a second computing system, the graphical user interface (i) enabling a user of the second computing system to at least one of create, edit, or select the mobile content and (ii) enabling the user of the second computing system to provide a phone number associated with the mobile communication device, the mobile communication device being separate and remote from the first computing system and the second computing system.

Abstract: One example method of operation may include determining whether a received command will be locally processed by a control device, determining an audio stream is associated with the received command, forwarding the audio stream to a server, and forwarding an audio output to a termination device based on a processed audio stream.

Abstract: Novel tools and techniques are provided for implementing voice monitoring and tracking, and, more particularly, to methods, systems, and apparatuses for implementing voice monitoring and tracking of participants in group settings. In various embodiments, a computing system might receive, from at least one audio sensor among the one or more audio sensors disposed within the first space, voice signals corresponding to voices associated with individuals present within the first space. The computing system might analyze the received voice signals to identify one or more individuals who are present within the first space. The computing system might present, within a user interface of the user device associated with the user, information regarding the identified one or more individuals to assist the user in coordinating discussions among the individuals present within the first space.

Abstract: An image display method for a terminal device that includes a display section having an input section includes displaying a plurality of images including a first image, a second image adjacent to the first image, and a third image adjacent to the second image along a predetermined axis, receiving selection of the first image based on touch input, performing, when a first movement instruction to move the first image to a gap between the second image and the third image is received, display in a first display form indicating that the first image has been moved to the gap between the second image and the third image, and performing, when a second movement instruction to move the first image to a position different from the gap between the second image and the third image is received, display in a second display form different from the first display form.

Abstract: A messaging system, comprising an electronic message having integrated digital content that is scripted by seamless linking of multiplicity of electronic media components. An electronic media component is comprised of a compilation of one or more electronic media element, with an electronic media element comprised of one or more data. Communication protocols for delivery and receipt of the electronic message is used, with the multiplicity of electronic media components of a received electronic message seamlessly executed in an order, arrangement, and sequence intended by the scripted digital content at one of a first and second client-device.

Abstract: Immersive web-based simulator for digital assistant-based applications is provided. A system can provide, for display in a web browser, an inner iframe configured to load, in a secure, access restricted computing environment, an application configured to integrate with a digital assistant. The application can be provided by a third-party developer device. The system can provide, for display in a web browser, an outer iframe configured with a two-way communication protocol to communicate with the inner iframe. The system can provide a state machine to identify a current state of the application loaded in the inner frame, and load a next state of the application responsive to a control input.

Abstract: Systems and methods for efficient management of an audio/video conferences is disclosed. The method includes receiving an audio question from a first user of a plurality of users connected to a conference, recording the audio question and preventing an immediate transmission of the audio question to the plurality of users connected to the conference, analyzing the recorded audio question to determine that the audio question is relevant to a second user of the plurality of users and not relevant to a third user of the plurality of users, preventing the audio question from being transmitted to the third user, and transmitting the audio question to the second user of the plurality of users.

Abstract: Further disclosed herein is a system for facilitating generation of an interactive story based on non-interactive data, in accordance with some embodiments. Accordingly, the system may include a communication device, a processing device, and a storage device. Further, the communication device may be configured for receiving non-interactive data from a source device, transmitting interactive story data to a user device, receiving a request from the user device, and transmitting a response to the user device. Further, the processing device may be configured for analyzing the non-interactive data, generating the interactive story data based on the analyzing, analyzing the at least one request, and generating the response based on the analyzing of the interactive story data and the analyzing of the request. Further, the storage device may be configured for storing the non-interactive data, the interactive story data, the request, and the response.

Abstract: Systems and processes for accelerating task performance are provided. An example method includes, at an electronic device with a display, displaying a candidate shortcut affordance associated with a user activity, detecting a first set of inputs corresponding to a selection of the candidate shortcut affordance, in response to detecting the first set of inputs, displaying a first set of candidate task affordances, detecting a second set of inputs corresponding to a selection of a candidate task affordance associated with a first task, displaying a second set of candidate task affordances, detecting a third set of inputs corresponding to a selection of a candidate task affordance associated with a second task, and in response to detecting the second set of inputs and the third set of inputs, associating the first task and the second task with a task sequence for a voice shortcut corresponding to the user activity.

Abstract: Systems, methods, and apparatus for dynamically partitioning items in a list into one or more subsets in a manner tailored to a current modality of a client device is disclosed herein. Multimodal client devices can engage in a variety of interactions across the multimodal spectrum including voice only interactions, voice forward interactions, multimodal interactions, visual forward interactions, visual only interactions, etc. A list can be partitioned into subsets in part based on a currently modality of a multimodal device, one or more list attributes indicating additional information about the list, etc.

Abstract: A system and method for an interactive digitally rendered avatar of a subject person during a video presentation is described. In one embodiment, the method includes transmitting a video presentation featuring a subject person to a plurality of users via a first communication format. The method also includes receiving from at least one user of the plurality of users during the video presentation, a request to initiate an interactive session with an avatar of the subject person. In response to the request, the method includes generating a first avatar of the subject person and initiating a first interactive session between the first avatar and the at least one user. The method further includes engaging in the first interactive session between the first avatar of the subject person and the at least one user via a second communication format that is different than the first communication format.

Abstract: The method provides for one or more processor receiving on a personal device, a mixture of sounds within a sound stream from multiple sources. The one or more processors identifying one or more sounds of the mixture of sounds from the multiple sources, based on a sound separation technique. The one or more processors displaying on a user interface of the personal device an icon corresponding respectively to a classification of the one or more sounds identified from the multiple sources. The one or more processors receiving a selection of a sound from the mixture of the multiple sounds, based on an action by a user of the personal device selecting the icon displayed on the user interface of the personal device, and the one or more processors recording the sound from the mixture of the multiple sounds selected by the user.

Abstract: Multiple applications may execute on a computing device and the computing system may monitor the multiple applications, identify a set e applications generating sound and determine whether at least one sound related criterion is satisfied. If at least one sound related criterion is satisfied, the computing system displays sound indicators for the set of applications generating sound.

Abstract: An image sensor includes a pixel array having a plurality of pixels arranged in rows and columns, a plurality of pixel readout lines coupled to respective pixels, a multiplexing circuit coupled to the pixel readout lines, a plurality of analog-to-digital converters coupled to the multiplexing circuit, and a controller configured to provide pixel readout signals of pixels arranged in a same column to the analog-to-digital converters through the multiplexing circuit for concurrent signal conversion.

Abstract: A system and method for an interactive digitally rendered avatar of a subject person during a video presentation is described. In one embodiment, the method includes transmitting a video presentation featuring a subject person to a plurality of users via a first communication format. The method also includes receiving from at least one user of the plurality of users during the video presentation, a request to initiate an interactive session with an avatar of the subject person. In response to the request, the method includes generating a first avatar of the subject person and initiating a first interactive session between the first avatar and the at least one user. The method further includes engaging in the first interactive session between the first avatar of the subject person and the at least one user via a second communication format that is different than the first communication format.

Abstract: A system for measuring sound levels is provided. The system comprises a processor, a memory, and an application stored in the memory that when executed on the processor receives sound levels recorded by each of a plurality of sound sensors located in a coverage area. The application also samples noise levels from the received sound levels at least one location within the coverage area. The application also derives values based at least on the samples and on estimates of sound attenuation at the at least one location. The application also creates a heat map based at least on the derived values, the heat map representing at least noise levels experienced within the coverage area.

Abstract: A method for identifying a product which appears in a video stream. The method includes playing the video stream on a video playback device, identifying key scenes in the video stream containing product images, selecting product images identified by predetermined categories of trained neural-network object identifiers stored in training datasets. Object identifiers of identified product images are stored in a database. Edge detection and masking is then performed based on at least one of shape, color and perspective of the object identifiers. A polygon annotation of the object identifiers is created using the edge detection and masking. The polygon annotation is annotated to provide correct object identifier content, accuracy of polygon shape, title, description and URL of the object identifier for each identified product image corresponding to the stored object identifiers. Also disclosed is a method for an end user to select and interact with an identified product.

Abstract: This application relates to an image processing method and apparatus, a storage medium, and a computer device. The method can include obtaining image frames acquired from a real scene, and playing the obtained image frames one by one according to an acquisition time sequence. The method can further include determining a position corresponding to a target object in the real scene when a trajectory formed by a movement of the target object in a plurality of the obtained image frames meets a trigger condition, rendering a virtual entry in a currently played image frame according to the position, and displaying virtual content in the virtual entry. The solutions provided in this application improve image processing efficiency.

Abstract: Systems and methods enable a computing system to recognize a sequence of repeated actions and offer to automatically repeat any such recognized actions. An example method includes determining a current sequence of user actions is similar to a previous sequence of user actions, determining whether the previous sequence is reproducible and, when reproducible, initiating display of a prompt that requests approval for completing the current sequence based on the previous sequence and, responsive to receiving an indication of approval, completing the previous sequence. Another example method includes determining that a first current sequence of user interactions is complete and is not similar to any saved sequence of user interactions, saving the first current sequence as a previous sequence, identifying a second current sequence as satisfying a similarity threshold with the previous sequence, and initiating display of a prompt that requests approval for saving the previous sequence as a shortcut.

Abstract: In one general aspect, a computer-implemented method includes identifying current choices with different verbosity levels for a current turn in a conversation; normalizing multi-dimensional verbosity vectors for each of the current choices to obtain a normalized value for each of the current choices; determining a state definition for the current turn in the conversation, utilizing the normalized values for each of the current choices; providing the state definition for the current turn in the conversation and the normalized values for each of the current choices to a trained reinforcement learning module; receiving, from the trained reinforcement learning module, a score associated with each of the current choices for the current turn in the conversation; and selecting one of the current choices to be entered for the current turn in the conversation, based on the score associated with each of the current choices for the current turn in the conversation.

Abstract: Systems and processes for accelerating task performance are provided. An example method includes, at an electronic device with a display, displaying a candidate shortcut affordance associated with a user activity, detecting a first set of inputs corresponding to a selection of the candidate shortcut affordance, in response to detecting the first set of inputs, displaying a first set of candidate task affordances, detecting a second set of inputs corresponding to a selection of a candidate task affordance associated with a first task, displaying a second set of candidate task affordances, detecting a third set of inputs corresponding to a selection of a candidate task affordance associated with a second task, and in response to detecting the second set of inputs and the third set of inputs, associating the first task and the second task with a task sequence for a voice shortcut corresponding to the user activity.

Abstract: A technique for improving meeting participation in electronically calendared meetings includes a data processing system receiving an electronic invitation to a virtual meeting that requires access to one or more referenced resources for a meeting invitee to fully participate in the meeting. Whether the invitee has access to the referenced resources is determined by a data processing system. In response to determining that the invitee does not have access to the referenced resources, access for the invitee to the referenced resources is provisioned by a data processing system. Finally, the meeting is added to an electronic calendar associated with the invitee.

Abstract: An emergency rescue request notification method using an infotainment system and a system therefor are provided. The emergency rescue request notification method in the vehicle includes detecting an accident of the vehicle, collecting information corresponding to the detected accident, generating an emergency rescue request message based on the collected information, searching for an FM radio channel with the highest receive sensitivity, changing and transmitting a program type of the found FM radio channel to a specific value using an FM radio data system (RDS) message, and transmitting the emergency rescue request message over the found FM radio channel.

Abstract: An electronic device and method are disclosed. The electronic device includes a display, a microphone, a communication circuit, a processor, and a memory. The memory stores instructions that, when executed by the processor, implement the method. The method includes determining whether the electronic device is communicatively coupled to an external display device, when the electronic device is not communicatively coupled to the external display, receiving a first user utterance, executing a task corresponding to at least one of a word, phrase or sentence included in the first user utterance as indicated by the mapping, the task preconfigured by a user, and when the electronic device is communicatively coupled to the external display device, displaying at least one of a text and a graphical user interface (GUI) indicating the at least one word, phrase, and sentence on the external display.

Abstract: A method performed by a computing system for directing a voice command to a function associated with a visual target includes receiving a set of time-variable sensor-based data streams, including an audio data stream and a targeting data stream. The targeting data stream is stored in a buffer as buffered targeting data. Presence of a spoken utterance is identified within the audio data stream and is associated with a temporal identifier corresponding in time to the set of sensor-based data streams. A voice command corresponding to the spoken utterance is identified. A visual targeting vector within the buffered targeting data and a visual target of that visual targeting vector is identified at a time corresponding to the temporal identifier. The voice command is directed to a function associated with the visual target to generate an output.

Abstract: A non-transitory computer readable storage medium has instructions executed by a processor to specify a group of collaborators. Each collaborator in the group of collaborators is polled for window information for each window to be shared among the collaborators in a composite window collection. The window information includes end user device attributes for each collaborator and window metadata for each window to be shared among the collaborators in the composite window collection. Required parameters are calculated for each window to be shared among the collaborators in the composite window collection. The required parameters include window visibility criteria in the composite window collection. Sending clients in the group of collaborators are instructed on required parameters for each window to be shared among the collaborators in the composite window collection.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing search information. One of the methods includes receiving search information from a user and sending the search information to a cloud server to cause the cloud server to perform search processing based on the search information. The method further includes pushing display information to the user on a display interface before the cloud server returns a result associated with the search processing.