Abstract: Sound effect recommendations for visual input are generated by training machine learning models that learn coarse-grained and fine-grained audio-visual correlations from a reference visual, a positive audio signal, and a negative audio signal. A trained Sound Recommendation Network is configured to output an audio embedding and a visual embedding and use the audio embedding and visual embedding to compute a correlation distance between an image frame or video segment and one or more audio segments retrieved from a database. The correlation distances for the one or more audio segments in the database are sorted and one or more audio segments with the closest correlation distance from the sorted audio correlation distances are determined. The audio segment with the closest audio correlation distance is applied to the input image frame or video segment.

Abstract: Pose of a person depicted within a video may be determined. The pose of the person depicted within the video may be used to edit the video. Visual effects may be applied to the video based on the pose of the person depicted within the video. Timing of the video may be remapped to timing of music providing accompaniment for the video edit.

Abstract: Embodiments of the present disclosure disclose a channel change method and a related apparatus. The channel change method includes: receiving a live stream of a first channel, where the live stream of the first channel includes N media file sets; separately encoding the live stream of the first channel in different coding manners, to generate both a main stream and a sub stream; and generating a playlist of the first channel according to channel information of the first channel, coding information of the main stream, and coding information of the sub stream. The playlist instructs the client to perform channel change according to the main stream and the sub stream in response to that a client sends a channel change instruction.

Abstract: A method and system for transmitting and receiving an audio signal over a video signal in a single cable. The method and system including receiving an analog video signal, the analog video signal comprising one or more rows of video data, an audio header, and one or more quantized audio data. The method includes detecting, the audio header in a blank interval of the analog video and determining a reference level of the audio header. The method and system include extracting, in response to detecting the audio header, the one or more quantized audio data and converting the one or more quantized audio data to an original value of audio data based on the reference level of the audio header. The method and system are configured for storing the one or more quantized audio data in the original value in a First-in-First-Out (FIFO) buffer, and reconstructing, utilizing the FIFO buffer, a continuous audio signal from the one or more quantized audio data in the original value.

Abstract: Voice storage data acquisition means of a display timing determination device acquires voice storage data storing a plurality of voices to be output sequentially. Timing data acquisition means acquires timing data on provisional display timings of a plurality of pieces of character information, which are to be sequentially displayed during reproduction of the voice storage data and represent content of the respective voices. Waveform analysis means analyzes a voice waveform of the voice storage data to acquire an output timing of each of the voices. Display timing determination means determines a definitive display timing of each of the pieces of character information based on the output timing of each of the voices acquired by the waveform analysis means and the provisional display timings of the respective pieces of character information determined based on the timing data.

Abstract: The present invention relates to a method and/or a device for transmitting and receiving a broadcast signal for a broadcast service on the basis of an XML subtitle. The method for transmitting a broadcast signal, according to one embodiment of the present invention, comprises the steps of: encoding video data, subtitle data, and signaling information including metadata related to the subtitle data; generating a broadcast signal including the encoded video data, subtitle data, and signaling information; and transmitting the generated broadcast signal.

Abstract: The present disclosure is for controlling a size of a voice packet in a wireless communication system. A method for operating a base station includes: detecting a loss of at least one uplink voice packet; transmitting a downlink voice packet including an indication regarding a sampling rate change of a terminal according to the loss; and receiving an uplink voice packet according to a changed transmission rate.

Abstract: Methods, devices, and systems for processing audio information are disclosed. An exemplary method includes receiving an audio stream. The audio stream may be monitored by a low power integrated circuit. The audio stream may be digitized by the low power integrated circuit. The digitized audio stream may be stored in a memory, wherein storing the digitized audio stream comprises replacing a prior digitized audio stream stored in the memory with the digitized audio stream. The low power integrated circuit may analyze the stored digitized audio stream for recognition of a keyword. The low power integrated circuit may induce a processor to enter an increased power usage state upon recognition of the keyword within the stored digitized audio stream. The stored digitized audio stream may be transmitted to a server for processing. A response received from the server based on the processed audio stream may be rendered.

Abstract: First ratio acquisition means of a display timing determination device acquires, for each voice, a first ratio that relates to intervals between output timings of voices. Second ratio acquisition means acquires, for each piece of character information, a second ratio that relates to intervals between provisional display timings of pieces of character information. Identification means identifies, based on the first ratio of each voice and the second ratio of each piece of character information, an association relationship between the voice and the piece of character information. Display timing determination means determines a definitive display timing of each piece of character information based on the association relationship.

Abstract: A method and system are provided for the transfer and/or aggregation of data and, in particular, integrating data used in managing a professional services practice. The invention preferably transfers and/or aggregates data relating to the identity of clients and matters for whom professional services are being rendered with data relating to the work which data may be maintained in inconsistent, proprietary formats, comprising one or more of the following types of information: accounting; budgeting; docketing; time and billing: work product; word processing; records; project management; and/or other information relating to the professional services. The system of the present invention preferably comprises data storage and data processing means adapted to use the data in substantially portable and/or application-independent format, and/or and transfer or aggregate data between common, and/or proprietary data formats.

Abstract: The present principles relate to a method, for configuring an audio rendering and/or acquiring device of a communication system comprising a master device, the audio rendering and/or acquiring device being adapted to use at least one channel of a plurality of audio channels of the master device, the method being performed in the audio rendering and/or acquiring device. According to an embodiment, the method includes obtaining a state of at least one of the audio channels, the state of an audio channel being representative of a current assigning of the audio channel to another audio rendering and/or acquiring device and selecting the at least one audio channel to be used according to its state. The present principles also relate to the corresponding audio rendering and/or acquiring device, system, computer readable program product and computer readable storage medium.

Abstract: Transmitting audio and video signals, can include: detecting if the state of a video control signal has changed, where a video signal includes the video control signal and a video data signal; generating, if the state of the video control signal has not changed, a first serial data packet based on the video signal and an audio signal; generating, if the state of the video control signal has changed, a second serial data packet based on the video signal and the audio signal; transmitting over a serial link, an encoded data frame formed by encoding the first and second serial data packets in a predetermined encoding manner; decoding and de-serializing the encoded data frame to restore the video signal and the audio signal; and outputting the video signal to a video display circuit, and outputting the audio signal to an audio processor respectively.

Abstract: Haptic information in a series of frames of a media file is identified and time stamps corresponding thereto are determined in accordance with information embedded in a tag either preceding or appending the media file. The haptic effect information is automatically synchronized to the media file based on the information in one or more frames of the tag, whereby an actuator outputs the defined haptic effects in the tag in a manner synchronized with corresponding audio and/or video content of the media file.

Abstract: The invention is a multi-microphone voice processing SoC primarily for head worn applications. It bypasses the use of conventional pre-amp voice CODEC (ADC/DAC) chips all together by replacing their functionality with digital MEMS microphone(s) and digital speaker driver (DSD). Functionality necessary for speech recognition such as noise/echo cancellation, speech compression, speech feature extraction and lossless speech transmission are also integrated into the SoC. One embodiment is a noise cancellation chip for wired, battery powered headsets and earphones, as smart-phone accessory. Another embodiment is as a wireless Bluetooth noise cancellation companion chip. The invention can be used in headwear, eyewear glass, mobile wearable computing, heavy duty military, aviation and industrial headsets and other speech recognition applications in noisy environments.

Abstract: The present disclosure provides a lighting device and related voice broadcasting systems and methods. The lighting device includes a light-emitting module configured to provide lighting, a process and control module, a memory module configured to store audio contents stored in a local memory and downloaded from the Internet, and a voice input module configured to receive voice information from users. The process and control module is configured to receive voice information from the voice input module, to recognize and determine whether the voice information is a voice command, and to send control instructions to a corresponding module according to the matched voice command. A voice output module is configured to select and play a audio content according to the control instructions sent from the process and control module.

Abstract: The present technology relates to a signal processing apparatus, a signal processing method, a program, and a signal transmission system realizing an SDI (serial digital interface) capable of effectively transmitting an audio stream together with video data, for example, of which the frame rate is 100 Hz or 120 Hz. An audio multiplexing unit multiplexes an audio sample into a data area of horizontal lines of n2 (here, 2?n2?n1) rows after a first horizontal line in which the audio sample is generated, which is a predetermined data area arranged within a horizontal blanking area disposed for each horizontal line of video data in a data stream defined in a format of an SDI used for transmitting the video data, in a case where an audio is sampled at an interval of once or less for horizontal lines of n1 (here, n1?2) rows of the video data of a predetermined frame rate. For example, the present technology can be applied to a broadcast camera.

Abstract: A transmission system includes: a first timing signal generation unit; a second timing signal generation unit; a timing adjustment unit; a transmission processing unit; a first valid data generation unit which receives a first timing signal, receives only data according to valid timing of the first timing signal in a first image signal from a process signal to generate a first valid image signal, and receives only data according to valid timing of the first timing signal in a second image signal and a second timing signal from the process signal to output the received second image signal and the received second timing signal; and a second valid data generation unit which receives the second timing signal from the first valid data generation unit and receives only data according to valid timing of the second timing signal in the second image signal to generate a second valid image signal.

Abstract: Technology for smart line-in processing in an audio environment is disclosed. An example playback device includes a line-in connector for receiving a first audio signal, a network interface, and a processor. A computer readable storage medium has stored instructions executable by the processor to determine that the first audio signal is present at the line-in connector, and, in response to determining that the first audio signal is present at the line-in connector, (i) cease playback of a second audio signal being played by the playback device, wherein the second audio signal is not present at the line-in connector, (ii) cause the playback device to play at least a first portion of the first audio signal, and (iii) cause the playback device to transmit, via the network interface, at least a second portion of the first audio signal to another playback device.

Abstract: Systems and methods are disclosed herein for improving audio conferencing services. One aspect relates to processing audio content of a conference. A first audio signal is received from a first conference participant, and a start and an end of a first utterance by the first conference participant are detected from the first audio signal. A second audio signal is received from a second conference participant, and a start and an end of a second utterance by the second conference participant is detected from the second audio signal. The second conference participant is provided with at least a portion of the first utterance, wherein at least one of start time, start point, and duration is determined based at least in part on the start, end, or both, of the second utterance.

Abstract: A pulse wave shaper for reducing the radiation emission level is disclosed. The pulse wave shaper, comprises a first integrator, wherein the first integrator receives a first pulse wave and generates a second pulse wave and a second integrator coupled to the first integrator, wherein the second integrator receives the second pulse wave and generates a third pulse wave with a pulse wave amplitude. The first pulse wave comprises a first pulse wave shape, the second pulse wave comprises a second pulse wave shape, and the third pulse wave comprises a third pulse wave shape. The third pulse wave shape, when transmitted over a bus, generates a reduced radiation emission level.

Abstract: The present disclosure relates to a mobile terminal and an audio zooming method thereof capable of effectively capturing audio based on an image while capturing and reproducing video. According to the present disclosure, if an event for changing the capture location or range or capture mode of a subject occurs when capturing the subject while capturing the sound of the subject in a predetermined sound capture range, the sound of the subject may be captured by changing a sound capture angle and automatically controlling a sound capture range according to the relevant event, and if an event for changing the capture location or range or capture mode of a subject occurs, the sound of the subject may be captured by automatically controlling a sound capture range according to the event.

Abstract: An apparatus may include a digital display, processor circuit, and an audio isolation component. The audio isolation component may be operative on the processor circuit to identify a selected position on the digital display during presentation of a video, where the video comprises a video stream and two or more audio streams. The audio isolation component may be operative on the processor circuit to generate an audio beam from the one or more audio streams based upon the selected position.

Abstract: HDMI is a digital audio and video communications protocol commonly used in consumer electronics. HDMI is particularly synonymous with high fidelity audio and video. Even though HDMI is a digital communications protocol, the audio quality can be impaired by analog signal impairments and distortions even if there are no digital decoding errors. In particular, the very process by which the audio is converted from Digital (HDMI) to human audible “Analog Audio” can be prone to errors. This occurs when the Digital to Analog Converter (DAC) clock, which is derived from the HDMI TMDS clock or HDMI source, is “distorted” due to its jitter, resulting in erroneous sampling or outputting of vital audio samples, thereby reducing the audio quality of the experience. The present invention reduces the jitter on the TMDS clock, and hence the audio DAC clock, resulting in lower audio distortion.

Abstract: One embodiment provides an electronic apparatus, including: a first detector configured to attempt to detect a telop and a warning sound from a received video content at a first image reading interval and a first sound reading interval, respectively; and a second detector configured to attempt, upon a detection of at least one of a telop and a warning sound by the first detector, to detect a telop and a warning sound from the video content at a second image reading interval and a second sound reading interval which are shorter than the first image reading interval and the first sound reading interval, respectively.

Abstract: Methods and apparatus, including computer program products, for aligning video clips to closed caption files. A method includes receiving a video clip, applying speech-to-text to the received video clip, applying an initial alignment of the speech-to-text output to candidate closed caption text in a closed caption file, identifying one or more islands, and outputting the video clip with the aligned closed caption text.

Abstract: As information to be processed at an object-based video or audio-visual (AV) terminal, an object-oriented bitstream includes objects, composition information, and scene demarcation information. Such bitstream structure allows on-line editing, e.g. cut and paste, insertion/deletion, grouping, and special effects. In the interest of ease of editing, AV objects and their composition information are transmitted or accessed on separate logical channels (LCs). Objects which have a lifetime in the decoder beyond their initial presentation time are cached for reuse until a selected expiration time. The system includes a de-multiplexer, a controller which controls the operation of the AV terminal, input buffers, AV objects decoders, buffers for decoded data, a composer, a display, and an object cache.

Abstract: Audio data and video data are processed to determine one or more audible events and visual events, respectively. Contemporaneous presentation of the video data with audio data may be synchronized based at least in part on the audible events and the visual events. Audio processing functions, such as filtering, may be initiated for audio data based at least in part on the visual events.

Abstract: A visual display includes at least a first canvas configured to display a first session on the display and a second canvas configured to display a second session on the display. The first session includes first content received from a first content source and the second session includes second content having subject matter associated with the first content. The display includes a user agent configured to determine that the first content of the first session is associated with the second content of the second session and to pair the first and second canvases such that the first content and the second content are synchronized to each other.

Abstract: An installation method, an installation program and a computer-readable record medium are supplied.

Abstract: A system for constructing seamlessly viewable multimedia content from selectably presentable multimedia content blocks includes a block definition module for facilitating creation and modification of the content blocks. The block definition module includes a media assignment submodule for associating a synchronized audio and video segment with a content block. Also included is a block linking submodule for creating seamless connections between content blocks, whereby a transition between the connected blocks occurs substantially without interruption upon viewing the multimedia content. The block definition module further includes a layer submodule for associating an interactive layer having interactive controls with the content block.

Abstract: An audio signal processing method and a broadcasting output apparatus using the audio signal processing method are provided. The audio signal processing method includes selecting an audio signal to be processed from among a plurality of audio signals in which the same audio data is compressed in different formats, when the plurality of audio signals are received; and processing the selected audio signal. Therefore, it is possible to select a high quality audio signal from among audio signals compressed in various audio formats and to provide a user with the high quality sound.

Abstract: A data transmitting apparatus is provided. The data transmitting apparatus includes a packet generator configured to generate a packet including a first sub packet and a second sub packet, and a transmitter configured to transmit the generated packet to a data receiving apparatus, and the first sub packet and the second sub packet include different audio data related to a first content.

Abstract: Provided are data transmitting apparatuses and methods, data receives apparatuses and methods, and data transceiving systems and methods. A data transmitting apparatus includes: a packet generator configured to generate an audio metadata packet; and a transmitter configured to transmit the generated audio metadata packet to a data receiving apparatus, wherein a header of the generated audio metadata packet includes a split screen information field in relation to audio data represented by the generated audio metadata packet.

Abstract: For use as or in connection with a set-top box, a digital TV broadcast signal is decoded by processing its audio stream into and read from a FIFO buffer. According to certain embodiments, fullness of the FIFO buffer is compared to a reference fullness, which can be updated based on changes to the bit rate of the audio stream. In response to the FIFO buffer fullness, the set top box regulates the rate at which the audio stream is decoded. The disclosed decoding methods do not need to rely on the accuracy or presence of a system time encoded into the broadcast signal.

Abstract: According to one aspect, the invention provides an apparatus for converting data encoded in a graphics signal to at least one output signal. The apparatus includes an input, a plurality of outputs, signal processing circuitry and a controller. The input is adapted to receive the graphics signal where the graphics signal includes a plurality of frames generated at least in part from original data. The signal processing circuitry is adapted to locate, in the graphics signal, data corresponding to the original data, convert the data corresponding to the original data to output data and communicate the output data to the plurality of outputs. The controller is adapted to monitor a capacity of the signal processing circuitry and generate a signal that results in at least one disposable frame being added to the plurality of frames. The signal processing circuitry is adapted to discard the at least one disposable frame.

Abstract: According to one embodiment, an electronic device includes a reproduction controller and a transmitter. The reproduction controller is configured to reproduce a first type of information of a first content. The first content includes a plurality of types of information. The transmitter is configured to transmit an instruction to reproduce a second type of information of the first content to other electronic device.

Abstract: A method executed on a processor for controls audio during playing of a video segment. The method includes receiving a request to play one or more main videos; noting a request for audio matching among the main videos and one or more interstitial videos; determining requested audio parameters for the audio matching; identifying a first interstitial in the main videos in which the interstitial videos may be served, the first interstitial in proximity to a first main video; locating one or more candidate interstitial videos to serve in the first interstitial by matching audio parameters of each of the candidate videos and audio parameters of at least the first main video; and selecting to serve in the first interstitial, one or more interstitial videos having a closest audio match to the first main video.

Abstract: A method and system for communicating text descriptive data has a receiving device that receives a data signal having text description data corresponding to a description of a video signal. A text-to-speech converter associated with the receiving device converts the text description data to a first audio signal. A display device in communication with the text-to-speech converter converts the first audio signal associated with the receiving device to an audible signal.

Abstract: A control device signals user inputs to an audio-video display. The control device may be configured as a pillow speaker and include a speaker for reproducing audio from the audio-video display. The control device is coupled to the audio-video display by wiring. Shared signals in the wiring are used to provide power to operate the control device and are used to signal the user inputs to the audio-video display. A touch panel is used to sense user inputs. The touch panel may be transparent with an underlay containing indicia of user-selectable commands located below the touch panel. The arrangement and selection of commands available to the user may be modified by changing the underlay.

Abstract: A memory space configuration method applied in a video signal processing apparatus is provided. The method includes: arranging a first memory space and a second memory space in a memory, the first and second memory spaces being partially overlapped; determining a type of a signal source; when the signal source is a first video signal source, enabling a first processing circuit and buffering data associated with the first video signal source by using the first memory space; and, when the signal source is a second video signal source, enabling a second processing circuit and buffering data associated with the second video signal source by using the second memory space. The second processing circuit is disabled when the first processing circuit is enabled; the first processing circuit is disabled when the second processing circuit is enabled.

Abstract: A display, includes: a display section; a first output section; a second output section; and a housing containing the display section, the first output section, and the second output section, wherein, the display section has an aspect ratio with a width more than twice a height, the first output section is arranged along an upper side of the display section so as to face forward and is configured to output a plurality of channels of audio, and the second output section is arranged along a lower side of the display section so as to face forward and is configured to output a plurality of channels of audio.

Abstract: Systems and methods disclosed herein include systems and methods for delivering secondary content to a plurality of portable devices, the secondary content comprising events synchronized to primary content, the process including delivering an application to a plurality of portable display devices, the application configured to execute events on the portable display devices; and causing the events executed on the portable display devices to be synchronized with primary content.

Abstract: Disclosed herein is simultaneous processing of multiple MPEG audio packetized elementary streams (PES). Each audio PID gets processed separately, substantially simultaneously. Example embodiments of the systems and methods of video delivery to a multilingual audience disclosed herein enable the processing of two or more audio tracks within the same transport stream simultaneously and deliver each audio to separate audio outputs where one of the outputs may be going to a wireless headset, a secondary room or a secondary screen. The main language audio (PES) is rendered with the video on the main screen, or the different audio streams may be rendered concurrently in different rooms such as in a business application. The main screen would have the main video along with its original language audio while the dubbed audio will be processed and played at the same time with the original video.

Abstract: An apparatus may include a digital display, processor circuit, and an audio isolation component. The audio isolation component may be operative on the processor circuit to identify a selected position on the digital display during presentation of a video, where the video comprises a video stream and two or more audio streams. The audio isolation component may be operative on the processor circuit to generate an audio beam from the one or more audio streams based upon the selected position.

Abstract: A method and a system for deriving visual rhythm from a video signal are described. A feature extraction module receives the video signal and extracts a two-dimensional feature from the video signal. A one-dimensional video feature computation module derives a one-dimensional feature from the extracted two-dimensional feature. A visual rhythm detector module detects a visual beat and a visual tempo from the one-dimensional feature.

Abstract: Audio tracks may be added to a live video stream using one or more mixers that may decode the audio from a video stream, mix an additional audio stream, and encode the mixed audio stream. The system may make the new audio stream available for live download by consumers. The mixers may include a video playback mechanism to view the live video stream, as well as an audio capture and mixing system that may create a new audio track that may be synchronized with the video stream using timestamps. A consumer device may download and consume the video with the new audio track on a slight delay from the live video stream.

Abstract: Remote control signal detection systems and methods are operable to set media device operation preferences in a media device. An exemplary embodiment detects a remote control communication signal transmitted from a remote control, wherein the remote control communication signal includes a unique identifier associated with the transmitting remote control; determines that at least one foreign language preference is associated with the transmitting remote control; and reconfigures information generated by the media device into the preferred foreign language.

Abstract: A unified system of programming communication. The system encompasses the prior art (television, radio, broadcast hardcopy, computer communications, etc.) and new user specific mass media. Within the unified system, parallel processing computer systems, each having an input (e.g., 77) controlling a plurality of computers (e.g., 205), generate and output user information at receiver stations. Under broadcast control, local computers (73, 205), combine user information selectively into prior art communications to exhibit personalized mass media programming at video monitors (202), speakers (263), printers (221), etc. At intermediate transmission stations (e.g., cable television stations), signals in network broadcasts and from local inputs (74, 77, 97, 98) cause control processors (71) and computers (73) to selectively automate connection and operation of receivers (53), recorder/players (76), computers (73), generators (82), strippers (81), etc.

Abstract: One embodiment provides an electronic apparatus, including: a first detector configured to attempt to detect a telop and a warning sound from a received video content at a first image reading interval and a first sound reading interval, respectively; and a second detector configured to attempt, upon a detection of at least one of a telop and a warning sound by the first detector, to detect a telop and a warning sound from the video content at a second image reading interval and a second sound reading interval which are shorter than the first image reading interval and the first sound reading interval, respectively.

Abstract: A file for storing digital data with high compression rate stores digital data for video and audio signals in multiple streams interleaved with each other. Each track has a stream descriptor list and a stream data list. The stream descriptor list includes a stream header chunk, a stream format chunk, and a stream name chunk. For a video stream, the stream descriptor list also includes a stream header data chunk if the video stream is under digital rights management (DRM) protection. The file format is compatible with high level data compressing algorithms, such as MPEG-4, which provide data compression ratio about six to ten times higher than a standard DVD format.