Method and apparatus for transmitting and receiving data using HDMI
A method and device for transmitting and receiving data using HDMI (High-Definition Multimedia Interface) are disclosed. The method, if performed by a source device, includes: receiving a request from a sink device to transmit data processing capability information indicating whether the source device is capable of processing user-input data or not; transmitting the data processing capability information to the sink device; and receiving the user-input data from the sink device.
Latest LG Electronics Patents:
This application is the National Stage filing under 35 U.S.C. 371 of International Application No. PCT/KR2015/005958, filed on Jun. 12, 2015, which claims priority under 35 U.S.C. § 119(e) to U.S. Provisional Application No. 62/011,049, filed on Jun. 12, 2014, the contents of which are all hereby incorporated by reference herein in their entirety.
TECHNICAL FIELDThe present invention relates to a method and device for transmitting and receiving data using HDMI (High-Definition Multimedia Interface), and more particularly, to a method and device for transmitting and receiving user-input data between a sink device and a source device via HDMI.
BACKGROUND ARTHDMI is an interface/standard that develops a Digital Visual Interface (DVI) which is an interface standard of personal computers and displays for a use of AV electronic products. Since the HDMI transmits video/audio from a player to a display device without compressing it, there is very little latency between a source device and a sink device. And the HDMI has high format compatibility since the HDMI does not require separate decoder chip or software. In addition, the HDMI is available to make wirings between AV devices be simplified, which were complicated because video signals, audio signals and control signals are transmitted on only one cable, and the HDMI provides a High-bandwidth Digital Content Protection (HDCP) technique, thereby providing the copyright protection function.
DISCLOSURE Technical ProblemAn aspect of the present invention is to provide a method for transmitting and receiving data between a sink device and a source device via HDMI.
Another aspect of the present invention is to provide a method for transmitting and receiving user-input data between a sink device and a source device.
A still another aspect of the present invention is to provide a method for transmitting and receiving data input from a sink device with user input functionality.
A further aspect of the present invention is to provide a method for transmitting and receiving data input through a mouse with user input functionality, multi-touch, a mouse, and a touch-pen via HDMI.
A further aspect of the present invention is to provide a method for transmitting user input data of a processable type through HDMI by confirming whether user input data can be processed between a sink device and a source device.
Technical problems to be solved by the present invention are not limited to the above-mentioned technical problem, and other technical problems not mentioned above can be clearly understood by one skilled in the art from the following description.
Technical SolutionTo solve the above-described problems, the present invention provides a method and device for transmitting and receiving data using HDMI (High-Definition Multimedia Interface).
Specifically, a method for a source device to transmit and receive data according to one embodiment of the present invention includes: receiving a request from a sink device to transmit data processing capability information indicating whether the source device is capable of processing user-input data or not; transmitting the data processing capability information to the sink device; and receiving the user-input data from the sink device.
In the present invention, the data processing capability information further includes data type information indicating the type of the user-input data.
In the present invention, the data type information includes at least one of mouse type information, multi-touch type information, touch type information, or touch-pen type information which indicate the method of inputting the user-input data.
In the present invention, the user-input data is received over an HDMI CEC (Consumer Electronics Control) channel or an HEC (HDMI Ethernet Channel).
In the present invention, when the user-input data is received over the HEC, the method further comprises: receiving from the sink device an inquiry message requesting state information indicating whether the HEC is available or not; and transmitting to the sink device a first reporting message containing the state information, wherein the state information indicates either the active or inactive state of the HEC.
In the present invention, when the state information indicates the inactive state of the HEC, the method further comprises: receiving from the sink device a set message for activating the HEC; and activating the HEC and transmitting to the sink device a second reporting message containing state information indicating the active state of the HEC.
Further, the present invention provides a method for a sink device to transmit and receive data, the method including: requesting data processing capability information indicating whether or not the user input data can be processed to the source device; receiving the data processing capability information from the source device; and transmitting the user-input data to the source device.
In the present invention, the data processing capability information further includes data type information indicating the type of the user-input data.
In the present invention, the data type information includes at least one of mouse type information, multi-touch type information, touch type information, or touch-pen information which indicate the method of inputting the user-input data.
In the present invention, the user-input data is transmitted over an HDMI CEC (Consumer Electronics Control) channel or an HEC (HDMI Ethernet Channel).
In the present invention, when the user-input data is transmitted over the HEC, the method further comprises: transmitting to the source device an inquiry message requesting state information indicating whether the HEC is available or not; and receiving from the source device a first reporting message including the state information, wherein the state information indicates either the active or inactive state of the HEC.
In the present invention, when the state information indicates the inactive state of the HEC, the method further includes: transmitting to the source device a set message for activating the HEC; and receiving from the source device a second reporting message containing state information indicating the active state of the HEC, after activating the HEC.
Further, the present invention provides a source device for transmitting and receiving data using HDMI (High Definition Media Interface), the source device including: an HDMI transmitter for transmitting and receiving data via HDMI; and a control unit for controlling the HDMI transmitter, wherein the source device receives a request from a sink device to transmit data processing capability information indicating whether the source device is capable of processing user-input data or not, transmits the data processing capability information to the sink device, and receives the user-input data from the sink device.
In the present invention, the data processing capability information further includes data type information indicating the type of the user-input data.
In the present invention, the user-input data is received over an HDMI CEC (Consumer Electronics Control) channel or an HEC (HDMI Ethernet Channel).
In the present invention, when the user-input data is received over the HEC, the source device receives from the sink device an inquiry message requesting state information indicating whether the HEC is available or not, and transmits to the sink device a first reporting message containing the state information, wherein the state information indicates either the active or inactive state of the HEC.
Further, the present invention provides a sink device for transmitting and receiving data using HDMI (High Definition Media Interface), the sink device including: an HDMI transmitter for transmitting and receiving data via HDMI; and a control unit for controlling the HDMI transmitter, wherein the sink device requests data processing capability information indicating whether or not the user input data can be processed to the source device, receives the data processing capability information from the source device, and transmits the user-input data to the source device.
In the present invention, the data processing capability information further includes data type information indicating the type of the user-input data.
In the present invention, the user-input data is transmitted over an HDMI CEC (Consumer Electronics Control) channel or an HEC (HDMI Ethernet Channel).
In the present invention, when the user-input data is transmitted over the HEC, the sink device transmits to the source device an inquiry message requesting state information indicating whether the HEC is available or not, and receives from the source device a first reporting message containing the state information, wherein the state information indicates either the active or inactive state of the HEC.
Advantageous EffectsA method for transmitting and receiving data using HDMI according to one embodiment of the present invention has the advantage of transmitting and receiving data between a sink device and a source device.
The present invention may provide bi-directional communication that enable a source device and a sink device to transmit and receive user-input data.
The present invention may allow for transmitting user-input data to a source device through a sink device with user input functionality.
The present invention may allow a sink device and a source device to transmit and receive processable user-input data by exchanging information indicating whether they can process user-input data or not.
It is to be understood that the advantages that can be obtained by the present invention are not limited to the aforementioned advantages and other advantages which are not mentioned will be apparent from the following description to the person with an ordinary skill in the art to which the present invention pertains.
The above aspects, features and advantages of the present invention will become apparent from the following detailed description when taken in conjunction with the accompanying drawings. However, the present invention may be subjected to various modifications and have various embodiments. Specific embodiments are illustrated in the drawings and described in detail below. Throughout the specification, like reference numerals refer to like elements. When it is deemed that a detailed description of known functions or configurations may unnecessarily obscure the subject matter of the present invention, a detailed description thereof will be omitted.
Devices that transmit and receive video/audio/control data using HDMI can be called collectively an HDMI system, and the HDMI system can comprise a source device 1010, a sink device 1020, and an HDMI cable. In the HDMI system, a device that transmits video/audio data through HDMI corresponds to the source device 1010, a device that receives video/audio data through HDMI corresponds to the sink device 1020, and an HDMI cable supporting data transmission and reception connects the two devices.
As shown in
Additionally, the HDMI system provides a VESA (Video Electronics Standards Association) DDC (Display Data Channel). The DDC is used for configuration of one source device and one sink device and exchange of status information between them. A CEC protocol can provide a high-level control function among various audio-visual products in a user environment and may be used optionally. Also, an optional HEAC (HDMI Ethernet and Audio Return Channel) may provide Ethernet-compatible data networking among an ARC (Audio Return Channel) and connected devices in the opposite direction from a TMDS.
Video data, audio data and supplementary data may be transmitted and received through three TDMS data channels. Commonly, a TMDS clock runs a video pixel rate, and is transmitted through a TMDS clock channel. The TMDS clock may be used as a reference frequency for data recovery in three TMDS data channels in an HDMI receiver. In a source device, the data of 8 bits per TMDS data channel may be transformed into a sequence of 10 bits of which transition is minimized, which is DC balanced, and transmitted in serial manner with a rate of 10 bits per TMDS clock period.
In order to transmit audio data and supplementary data through the TMDS channel, the HDMI uses a packet structure. In order to attain high reliability for audio data and control data, data may be transmitted in word of 10 bits which is generated by using a BCH error correction code and an error reduction coding.
The source device can figure out configuration information and available functions of the sink device by reading out E-EDID (Enhanced Extended Display Identification Data) of the sink device in the DDC (Display Data Channel). In what follows, the E-EDID may be called EDID information.
A utility line can be used for an optional extension function such as HEAC.
In the HDMI system, the device that transmits video/audio data through HDMI corresponds to the source device 2100, and the device that receives video/audio data through HDMI corresponds to the sink device 2200.
The source device 2100 can include at least one of a display unit 2110, user input interface unit 2120, video encoding unit (video encoder) 2130, control unit 2140, HDMI transmitter 2150, memory unit 2160, storage unit 2170, multimedia unit 2180, or power supply unit 2190. The sink device 2200 can include at least one of an EDID EEPROM 2210, video decoding unit 2220, display unit 2230, user input interface unit 2240, HDMI receiver 2250, control unit 2260, power supply unit 2270, memory unit 2280, or multimedia unit 2290. In what follows, descriptions about units performing the same operation will not be repeated.
The source device 2100 represents a physical device transmitting or streaming contents stored in the storage unit to the sink device 2200. The source device 2100 can send a request message to the sink device; or receive and process a request message from the sink device. Also, the source device 2100 can provide an UI through which a response message that the sink device 2200 transmits with respect to a transmitted request message is processed and delivered to the user, and in case the source device 2100 includes the display unit 2110, the UI can be displayed.
The sink device 2200 can receive contents from the source device 2100, transmit a request message to the source device 2100, or transmit a response message by processing a message received from the source device 2100. The sink device 2200 can also provide an UI through which a response message received from the source device 2100 is processed and delivered to the user, and in case the sink device 2200 includes the display unit 2230, the UI can be displayed.
The source device 2100 and the sink device 2200 can include a user input interface unit 2120, 2240 that receives the user's action or input, and as an example, the user input interface 2120, 2240 can correspond to a remote controller, voice reception/recognition device, or touch input sensing/receiving device.
The memory unit 2160, 2280 represents a volatile physical device in which various types of data are stored temporarily.
The storage unit 2170 represents a nonvolatile physical device in which various types of data can be stored.
The EDID EEPROM 2210 represents an EEPROM that stores EDID information.
The aforementioned memory unit, storage unit, and EDID EEPROM all perform the function of storing data, which may be called collectively a memory unit.
The display unit 2110, 2230 displays data received through HDMI, data stored in a content storage, or UI on a screen according to the control of the control unit.
The multimedia unit 2180, 2290 plays various types of multimedia contents. The multimedia unit 2180, 2290 may be implemented independently of the control unit 2140, 2260 or implemented as one physical component together with the control unit.
The power supply unit 2190, 2270 supplies power required for operating a source device, sink device, and sub-units belonging to the source and sink devices.
The HDMI transmitter 2150 is the unit that is installed in the source device 2100 and transmits and receives data through HDMI. The HDMI transmitter 2150 transmits and receives data including a command between devices and a request, action, or response message as well as audio/video data.
The video encoding unit 2130 compresses video data to be transmitted through the HDMI transmitter 2150.
The HDMI receiver 2250 is the unit that is installed in the sink device 2200 and transmits and receives data through HDMI. The HDMI receiver 2250 transmits and receives data including a command between device
The video decoding unit 2130 performs decompression of compressed video data received through the HDMI receiver 2250.
In what follows, channels, data structure, and functions provided by the HDMI will be described in more detail.
As described above, the HDMI system provides a DDC (Display Data Channel), which is a protocol standard defined by the VESA (Video Electronics Standard Association) specifying transmission of digital information between the monitor and the computer graphic adaptor. HDMI devices can transmit information about display modes supported by the monitor to the graphic adaptor through the DDC, and the graphic adaptor can transmit images to the monitor according to the information. Before the DDC standard is approved, the VGA standard defined four pins (Pin 11, 12, 4, and 15) of an analog VGA connector for the purpose of recognizing monitor types; among the four pins, only the pin 11, 12, and 4 have been actually used, and 7 types of monitor types could be recognized. The following provide DDC specifications for the respective versions.
-
- DDC version 1 (approved in 1994)
- EDID (Extended Display Identification Data) is defined, which is a binary file format specifying monitoring information.
- Pin 12 is used as a data line, and an EDID block of 128 byte is transmitted consecutively from a monitor to a computer.
- DDC version 2 (approved in 1996)
- EDID is no longer defined by the DDC, but specified separately as a companion standard.
- DDC version 2 is based on I2C serial bus. Pin 12 is now used as the data line, and pin 15 is used as the clock line of I2C bus.
Pin 9 is used to supply 5V DC power (up to 50 mA) from the computer to the monitor to read the EDID stored in the EEPROM even if the monitor is powered off.
-
- DDC version 2 uses an 8 bit data offset and supports the EDID storage capacity ranging from 28 bytes to 256 bytes.
- E-DDC
- E-DDC replaces the DDC version 1 and 2, and version 1 was introduced in 1999. To use E-EDID (Enhanced EDID), the E-DDC allows up to 32 Kbytes of display information storage capacity.
- By employing a new I2C addressing scheme based on 8-bit segment index (0x00˜0x7F), 128 segments (1 segment=256 bytes) can be accessed, by which up to 32 bytes can be accessed.
- E-DDC version 1.1 was approved in 2004, which supports a video interface such as HDMI in addition to CE devices and VGA.
- E-DDC version 1.2 was approved in 2007, which supports display port and display ID
In what follows, EDID provided through the DDC will be described.
A general HDMI system may largely include an HDMI sink device 1020 and an HDMI source device 1010, and the sink device 1020 and the source device 1010 may include a bus interface, a micro controller (MICOM), a buffer, a bus protocol layer, and an upper layer.
In various embodiments according to the present invention, the sink device 1020 may be called a receiver or an initiator, and the source device 1010 may be called a transmitter or a follower, depending on the situation.
Here, the initiator may refer to a device that initiates, transfers, and controls a command, and the follower may refer to a device that responds to a command, implements a request, and informs of the result.
The sink device 1020 may include, for example, a TV and a repeater, and the source device 1010 may include, for example, a DVD player, a set-top box (STB), a personal computer (PC), a laptop, and a recorder.
The bus interface refers to a physical device that enables device-to-device transfer of data or messages such as commands, requests, actions, responses, etc.
The buffer refers to a physical device that temporarily stores sent messages or data to improve the reliability of the messages or data.
The MICOM refers to a physical device that generates a signal for data transfer or manages transmission priorities, retransmissions for reliable transfer, etc.
The MICOM includes a mode protocol, and the mode protocol refers to a protocol that manages efficient resources needed for high-speed and low-speed data transmissions. The mode protocol may include a high mode and a low mode. The high mode refers to a logical device that handles high-speed data transfer related processing of a bus structure connection, and the low mode refers to a logical device that handles low-speed data transfer related processing of bus structure connection.
The bus protocol layer refers to a logical device that processes data, etc. transmitted through a transfer method using a bus structure and transfers necessary information, etc. to the upper layer.
The upper layer refers to a logical, physical device that actually processes commands.
HDMI CEC stands for HDMI Consumer Electronics Control. As discussed above, HDMI Consumer Electronics Control refers to a protocol that provides a capability that allows the user to control multiple multimedia devices with one operation in a network connected by HDMI cables, which will be hereinafter referred to as HDMI CEC.
As shown in
There are five HDMI connector types: types A, B, C, D, and E. For example, type A is a general HDMI connector with 19 pins, type B is a connector with 29 pins that transmits UHD video, type C is a mini connector with 19 pins, type D is a micro connector with 19 pins, and type E is an automotive connector.
As discussed above, the HDMI transmitter and the HDMI receiver may include three TMDS (Transition Minimized Differential Signaling) data transmission channels and one clock channel that deliver multimedia data via the HDMI connector, and control channels such as a DDC (Display Data Channel) (not shown), a CEC (Consumer Electronics Control) channel, a utility channel (not shown), and an HPD (Hot Plug Detect) channel (not shown).
The TMDS channel consists of three data transmission channels, and transmits video and audio data.
The CEC channel is a control channel that delivers a CEC protocol, a control command for controlling devices connected through HDMI by using a TV remote control. This capability lets the user control devices connected through HDMI with one remote control, without the need to control each device one by one, allowing for one touch play—that is, the function that allows connected players to play using a TV remote control, thereby increasing user convenience.
The central processing unit of the sink device 1020 may include a graphical user interface (GUI) layer, an application layer, and a CEC protocol layer, and the central processing unit of the source device 1010 may include an application layer and a CEO protocol layer.
The GUI layer processes data received through the HDMI receiver to be output through a GUI interface. The application layers process data in a user-defined manner, and the CEC protocol layers process the transmitted CEC data and transfer necessary information to an upper layer. The CEC protocol layer may perform physical address allocation and logical address allocation according to the present invention.
The CEC converters of the sink device 1020 and source device 1010 generate signals for data transmission or manage transmission priority and re-transmission for reliable transmission. For example, the CEC converters may perform frame transmission, line error handling, and frame validation. Further, the CEC converters function as an interface that function as an interface that performs HDMI CEC signal processing through per-frame data communication with the CPUs
For example, the signal processors according to the present invention may process messages or data, such as commands, requests, actions, and responses between devices.
EDID is a data structure containing various types of information about the display device defined in the VESA and can be transmitted to the source device through the DDC channel or read by the source device. In the case of EDID, the data structure of version 1.3 has been used in the IT display device, CE display device, and video interface (HDMI).
Timing information specified in the EDID is intended for IT display devices and can use the EDID 1.3 extension block defined in the CEA-861 to represent the timing information of CE display devices. The version 3 CEA extension block is defined in the CEA-861B standard and specifies four optional data blocks (video, audio, speaker allocation, and vendor-specific data block).
In the video data block of
The HF-VSDB shown in
The fields included in the HF-VSDB of
-
- Length field: represents the total length of the data block, of which the minimum value is 7, and the maximum value is 31.
- IEEE OUI field: refers to IEEE Organizationally Unique Identifier, and the OUI assigned to the HDMI forum is 0xC45DD8.
- Version field: represents the version number of the HF-VSDB (HDMI Forum-VSDB), of which the value is 1.
- Max_TMDS_Character_Rate field: represents the maximum TMDS character rate supported. If the sink device does not support the maximum TMDS character rate more than 340 Mcsc, it is set to 0; otherwise, it is set to 1.
- 3D_OSD_Disparity: when this field is set to 1, it indicates that the sink device supports reception of 3D_OSD_Disparity Indication.
- Dual_view: when this field is set to 1, it indicates that the sink device supports reception of dual_view signaling.
- Independent_view field: when this field is set to 1, it indicates that the sink device supports reception of 3D independent view signaling.
- LTE_340Mcsc_scramble field: when this field is set to 1, it indicates that the sink device supports scrambling when the TMDS character rate is less than 340 Mcsc. And when the SCDC_Present is set to 0, this field also has to be set to 0.
- RR_Capable field: when this field is set to 1, it indicates that the sink device can initiate an SCDC read request. And if the SCDC_Present is set to 0, this field also has to be set to 0.
- SCDC_Present field: when this field is set to 1, it indicates that the sink device supports the SCDC function.
- DC_48 bit_420, DC_36 bit_420, DC_30 bit_420: when these fields are set to 1, it indicates that deep color 4:2:0 pixel encoding is supported by 10 bit/12 bit/16 bit per component.
In the present invention, information on the sink device's capability of processing user-input data may be transmitted via EDID HF-VSDB, which will be described later.
The SCDC (Status and Control Data Channel) corresponds to a point-to-point communication protocol based on which the source device and the sink device exchange data with each other. The SCDC communication can use the aforementioned DDC channel (I2C line). In other words, the SCDC is a one-to-one communication protocol based on the I2C serial communication that enables HDMI source devices and sink devices to exchange data among them. The SCDC includes a mechanism in which the sink device, an I2C slave, requests status check read from the source device, an I2C master, and the source device receiving the request reads the corresponding status from the sink device.
The SCDCS (SCDC Structure) can be stored in the memory of the sink device and include data having the structure as shown in
The fields included in the SCDCS of
-
- Sink Version field: provides version information of an SCDCS compliant sink device.
- Source Version field: when the SCDCS compliant sink device reads E-EDID from the sink device, and the SCDC_Present of the E-EDID is set to 1, the source version of the SCDCS is set to 1.
- Update Flags (Update_0, Update_1) field: when there is a change in the information that the sink device has to inform of the source device (Status, Character Error Detect, and so on), the corresponding bit is set to 1.
- TMDS Configuration (TMDS_Config) field: each of the TMDS_Bit_Clock_Ratio and Scrambling_Enable occupies one bit, and if the source device attempts to activate the scrambling function of the sink device, the corresponding bit is set to 1. If the TMDS_Bit_Clock_Ratio is 1/10, this field is set to 0 while it is set to 1 in the case of 1/40.
- Scrambler Status field: when the sink device detects a scrambled control code sequence, the corresponding bit is set to 1.
- Configuration (Config_0) field: this field is used to configure capability-related information of the source and the sink device. Currently, this field provides only the RR_Enable field that indicates whether the source device supports a read request of the sink device.
- Status Flags (Status_Flag_0, Status_Flag_1) field: indicates whether data received through the clock, channel 0, 1, and 2 have been decoded successfully.
- Err_Det_0˜2_UH field: represent the LSB and MSB of the error counter detected in the channel 0 to 3.
- Err_Det_Checksum field: is implemented so that one byte sum of error detection values of seven registers including checksum becomes 0.
As discussed above, CEC allows for operation of CEC-enabled devices connected through HDMI by using only one remote control. Once HDMI is connected, each device has a physical address, and devices that support CEC have a logical address.
Each device may send and receive messages via a CEO line when an event occurs, and the messages may have the following functions:
-
- One Touch Play: allows a device to be played and become the active source with a single button click.
- Routing Control: controls the routing of the HDMI network while the CEC switch is in use.
- System Standby: switches all connected devices to standby mode.
- One Touch Record: controls the recording of whatever is being shown on the TV.
- Preset Transfer: transfers the tuner channel setup to another TV set.
- Timer Programming: allows a device to set a timer on another device.
- System Information: allows devices to use the same OSD and Menu language settings as the TV
- Deck Control: allows a playback device to be controlled by another device.
- Tuner Control: allows a device to control another device's tuner.
- OSD display: allows a device to transfer text to the TV for on-screen display.
- Device OSD Name Transfer: transfers the preferred device names to the TV set.
- Device Menu Control: allows device menus to be controlled via the TV remote control.
- Remote Control Pass Through: allows remote control inputs to be passed through to other devices.
- Vendor Specific Commands: vender-defined commands
A CEC message is transmitted in a CEC frame, and as shown in (a) of
Each block has a length of 10 bits, and the message has a maximum length of 16*10 bits, excluding the start bit.
As shown in (c) of
Each of the data block and the header block may include an information bits field, an EOM (End Of Message) field, and an ACK field.
The information bits field may include data, an opcode or an address. The EOM field includes a bit to indicate whether a block is the last block of a message. For example, the EOM field being 0 may indicate that there are one or more data blocks, and the EOM field being 1 may indicate that the message has been done. Even when a message includes additional data after the EOM field has been transmitted, the device receiving the message should discard the same.
The initiator sets the ACK field to 1 to send it, and the follower marks it as ‘0’ to indicate the receipt of the message.
HEAC stands for HDMI Ethernet Audio Channel, which is hereinafter referred to as “HEAC”. In HEAC, Ethernet is standardized as IEEE 802.3, and audio data is standardized as IEC60958-1.
Pin 14 is used as Utility/HEC/ARC (Optional, HDMI 1.4+ with HDMI Ethernet Channel and Audio Return Channel), Pin 17 is used as DDC/CEC/HEC Ground, and Pin 19 is used as HEC/ARC (Optional, HDMI 1.4+ with HDMI Ethernet Channel and Audio Return Channel).
As shown in
The HEC network consists of a sink device, a repeater, and a source device that are connected to one another by HEAC cables. The repeater or source device including at least two HEC connectors has an internal Layer 2 switch (LS2 W) to forward a MAC frame.
ARC stands for Audio Return Channel. ARC allows digital audio signal transmitted from the sink device, e.g., a TV, through the repeater to be sent upstream to the repeater, e.g., an AV amp, via HDMI. In this case, the TV that transmits audio signals becomes the source device, and it is possible to find out what audio formats the amp supports by using CEC.
The HEC channel is controlled through CEC messages. In this case, a CEC command for controlling the HEC state is referred to as HEC CDC (Capability Discovery and Control).
The HEC may have the following states:
-
- Potential HEC: initial connection state (PHEC).
- Verified HEC: the HEC functionality support is verified (VHEC).
- Active HEC: the HEC functionality is activated (AHEC).
The HEC CDC is transmitted via CEC, and allows for the discovery of the HEC in the potential HEC state.
Also, the HEC may be activated or deactivated, and the channel state may be transferred.
As shown in (a) of
If another device that has received the <CDC_HEC_Discover> message has support for the HEC functionality, the another device may transmit a <CDC_HEC_ReportState> message in response to the <CDC_HEC_Discover> message.
However, if the another device that has received the <CDC_HEC_Discover> message has no support for the HEC functionality, the another device does not respond to the <CDC_HEC_Discover> message.
By this method, the device may find out if other devices connected by HDMI have support for the HEC functionality.
If the <CDC_HEC_ReportState> message indicates “inactive”, the device may transmit a <CEC_HEC_SetState> message to the another device in order to activate the HEC.
Upon receiving the <CEC_HEC_SetState> message, the another device may activate all HECs present between the device and the another device, and then transmit a <CEC_HEC_ReportState> message to the device to report the active state of the HEC (S13020).
Afterwards, the device may transmit a <CDC_HECSetState> message in order to deactivate the HEC in the active state (S13050).
Upon receiving the <CDC_HECSetState> message, the another device may deactivate all HECs between the device and the another device.
If part of the devices existing in the VHEC state has no support for the HEC functionality, the devices that have no support for the HEC functionality may return to the PHEC state (S13040).
(b) of
The start bit field, CEC header block field, CEC Opcode block field, and CEC Initiator Phy. Address field are as explained above in
The CDC Opcode field indicates what type of message the CDC message is, and the CDC parameter field may include parameters of each CDC message.
The present invention proposes a method for transmitting and receiving data obtained from an image pick-up device over the above-explained HEC.
The present invention proposes a method for transmitting and receiving user-input data between a sink device and a source device over HEC by using the data field of the MAC frame.
Referring to
Specifically, the source device 1010 and the sink device 1020 are connected by a HDMI cable (S15010). Once the HDMI cable is connected, the source device 1010 transitions a 5V power line from low level to high level and applies an electric current (S15020). By this, the source device 1010 may drive the EEPROM storing the sink device 2020's EDID information and related circuits.
The sink device 1020 may transition an HPD (Hot Plug Detect) line from low level to high level (S15030) to inform the source device 1010 that the cable is properly connected and the EDID-related circuits are activated to enable access to the EDID information.
Now, the source device 1010 may transmit an EDID information read request to the sink device 1020 over a DDC (S15040). In response to the EDID read request from the source device 1010, the sink device 1020 may transmit the EDID information stored in the EEPROM over the DDC (S15050). In the embodiment of the present invention, the EDID information may be transmitted in the above-described VSDB.
The source device 1010 may parse the received EDID information to determine operating parameters of the A/V data to be transmitted to the sink device 1020 (timing, format, etc.) (S15060), and transmit to the source device the determined operating parameters associated with the uncompressed A/V data to be transmitted.
The method explained with reference to
Therefore, the present invention proposes a method in which the sink device receives from the source device information about whether the source device is capable of processing user-input data and, if the source device is capable of processing user-input data, transmits the user-input data to the source device.
First of all, the steps S16010 through S16060 are performed in the same way as the steps S15010 through S15060 of
In
Upon receiving the request for data processing capability information, the source device 100 may transmit to the sink device 1020 information about whether it is capable of processing user-input data and, if so, information about data types it can process.
The data types may include a mouse type indicating data input from a mouse, a touch type indicating data input with a touch on a touchscreen or touchpad, a multi-touch type, or a touch-pen type indicating data input from a touch-pen, depending on the method of user input.
The sink device 1020 may display the received data processing capability information on the screen (S16090). This step is optional and may not be performed.
Afterwards, upon receiving data input from the user, the sink device 1020 may transmit the input data to the source device 1010 (S16100). With this method, the user data input into the sink device 1020 may be transferred to the source device 1010. The transferred data may be processed by the source device 1010.
The data processing capability information indicates whether the source device 1010 is capable of processing various data input from the user. If the source device 1010 is capable of processing user-input data, the data processing capability information may include data types the source device 1010 can process, or data types that can be processed, and be transmitted to the sink device (S17020).
The sink device 1010 may display the data processing capability information of the source device on the screen (S17030). The step S17030 is optional and may not be performed.
Afterwards, upon receiving data input from the user, the sink device 1020 may transmit the input data to the source device 1010 if the source device 1020 is capable of processing the input data (S17040).
The multi-touch refers to enabling the touchscreen or touchpad to recognize multiple, simultaneous touch points.
Referring to
Referring to
First of all, it is assumed that the source device 1010 and sink device 1020 of
Afterwards, the sink device 1020 may send the sink device 1020 a request for data processing capability information indicating whether the source device is capable of processing user-input data, through a CEC message such as <Request User Input capability> (S19010).
In response to the request, the source device 1010 may transmit to the sink device 1020 data processing capability information indicating whether it is capable of processing user-input data, through a CEC message such as <Report User Input capability>[capability] (S19020).
If the source device 1010 is capable of processing the user-input data, the source device 1010 may include data types it can process in a CEC message such as <Report User Input capability>[capability] and transmit it to the sink device 1020.
The sink device 1020 may display the data processing capability information on the screen (S19030). However, the step S19030 is optional and may not be performed.
Afterwards, the sink device 1020 may transmit the user-input data to the source device 1010 through a CEC message such as <User Input Data>[value] (S19040).
Referring to
First of all, it is assumed that the source device 1010 and sink device 1020 of
In order to transmit data over an HEC, the sink device 1020 may transmit through CEC message to the source device 1010 a CEC message such as <CDC_HEC_InquireState> inquiring about the state of the HEC described with reference to
In this case, in order for the source device 1010 and the sink device 1020 to use CEC, all devices in the HDMI CEC system should have their own unique physical address to activate the HDMI CEC functionality.
If an HDMI host device is a sink device, the sink device 1020 should perform a physical address allocation mechanism regardless of whether it has support for the CEC functionality or not. Other devices might not be allocated physical addresses unless they have support for the CEC functionality. A physical address may include 4 digits.
The sink device 1020 generates a physical address 0.0.0.0, and reads the address from EDID in the sink device 1020.
The sink device 1020 should generate a physical address of the source device 1010 connected to it. A portion of the EDID VSDB (Vendor Specific Data Block) of the source device is used for the physical address.
As a method for generating a physical address of the source device 1010, a subsequent digit may be incremented by 1 each time the source device 1010 shifts down to a lower layer. In the present invention, it is assumed that the physical address of the source device is 1.0.0.0.
The sink device 1020 may receive a CEC message such as <CDC_HEC_ReportState> containing information about the HEC message via the CEC, as a response to the CEC message inquiring about the state of the HEC (S20020).
The <CEC_HEC_ReportState> message may include the operands shown in Table 1 below.
If the HEC is inactive, the sink device 1020 may transmit a CEC message such as <CDC_HEC_SetState> to the source device 1010 over CEC (S20030) so as to activate all HECs present between the sink device 1020 and the source device 1010.
After the HEC is activate through the CEC message, the source device 1010 may transmit to the sink device a CEO message such as <CDC_HEC_ReportState> containing the HEC's state information, in order to inform the sink device 1020 that the HEC is activated (S20040).
However, if the HEC is already activated, then the steps S20030 and S20040 may not be performed.
Afterwards, the sink device 1020 may transmit a message such as <Request User Input capability> to the source device 1010 over the activated HEC or CEC channel so as to request data processing capability information of the source device (S20050).
In response to the request, the source device 1010 may transmit to the sink device 1020 a message such as <Report User Input capability>[capability] containing data processing capability information indicating whether it is capable of processing user-input data, over the HEC or CEC channel (S20060).
If the source device 1010 is capable of processing the user-input data, the source device 1010 may include data types it can process in a CEC message such as <Report User Input capability>[capability] and transmit it to the sink device 1020 over the HEC or CEC channel.
The sink device 1020 may display the data processing capability information on the screen (S20070). However, the step S20070 is optional and may not be performed.
Afterwards, if there is data input from the user, the sink device 1020 may include the user data in a message such as <User Input Data>[value] and transmit the input data to the source device 1010 over the HEC or CEC (S20080).
Referring to
First of all, it is assumed that the source device 1010 and sink device 1020 of
Afterwards, the sink device 1020 may transmit a message such as <Request User Input capability> to the source device 1010 over the HEC or CEC channel so as to request data processing capability information of the source device (S21010).
In response to the request, the source device 1010 may transmit to the sink device 1020 a message such as <Report User Input capability>[capability] containing data processing capability information indicating whether it is capable of processing user-input data, over the HEC or CEC channel (S21020).
If the source device 1010 is capable of processing the user-input data, the source device 1010 may include data types it can process in a CEC message such as <Report User Input capability>[capability] and transmit it to the sink device 1020 over the HEC or CEC channel.
The sink device 1020 may display the data processing capability information on the screen (S21030). However, the step S21030 is optional and may not be performed.
Afterwards, the steps S21040 through S21070 are performed in the same way as the steps S20010 through S20040 of
Afterwards, if there is data input from the user, the sink device 1020 may include the user data in a message such as <User Input Data>[value] and transmit the input data to the source device 1010 over the HEC or CEC (S21080).
First of all, it is assumed that the source device 1010 and sink device 1020 of
Afterwards, the sink device 1020 may determine if the source device 1010 has support for HEC (HDMI Ethernet Channel).
If the source device 1010 has no support for HEC, the sink device 1020 may send a request for data processing capability information of the source device through a CEC message such as <Request User Input capability> (S22010).
In response to the request, the source device 1010 may transmit to the sink device 1020 a message such as <Report User Input capability>[capability] containing data processing capability information indicating whether it is capable of processing user-input data (S22020).
If the source device 1010 is capable of processing the user-input data, the source device 1010 may include data types it can process in a CEC message such as <Report User Input capability>[capability] and transmit it to the sink device 1020.
The sink device 1020 may display the data processing capability information on the screen (S22030). However, the step S22030 is optional and may not be performed.
Afterwards, if there is data input from the user, the sink device 1020 may transmit the user-input data to the source device 100 through a message such as <User Input Data>[value] (S22040).
On the other hand, if the source device 1010 has support for HEC, the procedure of
The steps S23010 through S23080 are identical to the steps S20010 through S20080 of
Referring to
First of all, it is assumed that the source device 1010 and sink device 1020 of
Afterwards, the sink device 1020 may transmit a message such as <Request User Input capability> to the source device 1010 over the HEC or CEC channel so as to request data processing capability information of the source device (S24010).
In response to the request, the source device 1010 may transmit to the sink device 1020 a message such as <Report User Input capability>[capability] containing data processing capability information indicating whether it is capable of processing user-input data, over the HEC or CEC channel (S24020).
If the source device 1010 is capable of processing the user-input data, the source device 1010 may include data types it can process in a CEC message such as <Report User Input capability>[capability] and transmit it to the sink device 1020 over the HEC or CEC channel.
Afterwards, the sink device 1020 may determine if the source device 1010 has support for HEC (HDMI Ethernet Channel).
If the source device 1010 has no support for HEC, the sink device 1020 may display the data processing capability information on the screen (S24030). However, the step S24030 is optional and may not be performed.
Afterwards, if there is data input from the user, the sink device 1020 may transmit the user-input data to the source device 100 through a message such as <User Input Data>[value] (S24040).
On the other hand, if the source device 1010 has support for HEC, the procedure of
The steps S25010 through S25060 are identical to the steps S21030 through S21080 of
Referring to
Specifically, in the case of data input from the user through a mouse, the user-input data may include a state field, an X-coordinate field, and/or Y-coordinate field, as shown in (a) of
Descriptions of these fields are illustrated in (b) of
Referring to
Descriptions of these fields are illustrated in (b) of
Referring to
Descriptions of these fields are illustrated in (b) of
It will be apparent to those having ordinary skill in the technical field to which the present invention pertains that the above-described present invention is not limited to the above-described embodiments and the attached drawings, but that various substitutions, modifications and variations are possible within a range that does not depart from the technical spirit of the present invention.
Claims
1. A method for a source device to transmit and receive data using High-Definition Multimedia Interface (HDMI), the method comprising:
- receiving, from a sink device, a request for transmitting data processing capability information,
- wherein the data processing capability information indicates whether the source device supports a type of user input data detected by the sink device;
- transmitting, to the sink device, the data processing capability information; and
- when the type of the user input data is supported by the source device, receiving the user input data from the sink device,
- wherein, if an HDMI Ethernet Channel (HEC) between the source device and the sink device is active, the user input data is received over the HEC, and
- wherein, if the HEC is inactive, the user input data is received over an HDMI Consumer Electronics Control (CEC) channel.
2. The method of claim 1, wherein the data processing capability information further includes data type information indicating the type of the user input data.
3. The method of claim 2, wherein the data type information includes at least one of mouse type information, multi-touch type information, touch type information, or touch-pen type information which indicates a method of inputting the user input data.
4. The method of claim 3, wherein, when the user input data is received over the HEC, the method further comprises:
- receiving, from the sink device, an inquiry message requesting state information indicating whether the HEC is available or not; and
- transmitting, to the sink device, a first reporting message containing the state information,
- wherein the state information indicates either an active state or an inactive state of the HEC.
5. The method of claim 4, wherein, when the state information indicates the inactive state of the HEC, the method further comprises:
- receiving, from the sink device, a set message for activating the HEC; and
- transmitting, to the sink device, a second reporting message containing state information indicating the active state of the HEC, after activating the HEC.
6. A method for a sink device to transmit and receive data using High-Definition Multimedia Interface (HDMI), the method comprising:
- transmitting, to a source device, a request for transmitting data processing capability information,
- wherein the data processing capability information indicates whether the source device supports a type of user input data detected by the sink device;
- receiving, from the source device, the data processing capability information; and
- when the type of the user input data is supported by the source device, transmitting the user input data to the source device,
- wherein, if an HDMI Ethernet Channel (HEC) between the source device and the sink device is active, the user input data is transmitted over the HEC, and
- wherein, if the HEC is inactive, the user input data is transmitted over an HDMI Consumer Electronics Control (CEC) channel.
7. The method of claim 6, wherein the data processing capability information further includes data type information indicating the type of the user input data.
8. The method of claim 7, wherein, the data type information includes at least one of mouse type information, multi-touch type information, touch type information, or touch-pen information which indicates a method of inputting the user input data.
9. The method of claim 8, wherein, when the user input data is transmitted over the HEC, the method further comprises:
- transmitting, to the source device, an inquiry message requesting state information indicating whether the HEC is available or not; and
- receiving, from the source device, a first reporting message including the state information,
- wherein the state information indicates either an active state or an inactive state of the HEC.
10. The method of claim 9, wherein, when the state information indicates the inactive state of the HEC, the method further comprises:
- transmitting, to the source device, a set message for activating the HEC; and
- receiving, from the source device, a second reporting message containing state information indicating the active state of the HEC, after activating the HEC.
11. A source device for transmitting and receiving data using High-Definition Multimedia Interface (HDMI), the source device comprising:
- an HDMI transmitter configured to transmit and receive data via HDMI; and
- a processor configured to: control the HDMI transmitter to receive, from a sink device, a request for transmitting data processing capability information, wherein the data processing capability information indicates whether the source device supports a type of user input data detected by the sink device, control the HDMI transmitter to transmit, to the sink device, the data processing capability information, and when the type of the user input data is supported by the source device, control the HDMI transmitter to receive the user input data from the sink device, wherein, if an HDMI Ethernet Channel (HEC) between the source device and the sink device is active, the user input data is received over the HEC, and wherein, if the HEC is inactive, the user input data is received over an HDMI Consumer Electronics Control (CEC) channel.
12. The source device of claim 11, wherein the data processing capability information further includes data type information indicating the type of the user input data.
13. The source device of claim 12, wherein, when the user input data is received over the HEC, the source device receives from the sink device an inquiry message requesting state information indicating whether the HEC is available or not, and transmits to the sink device a first reporting message containing the state information, and
- wherein the state information indicates either an active state or an inactive state of the HEC.
14. A sink device for transmitting and receiving data using High-Definition Media Interface (HDMI), the sink device comprising:
- an HDMI transmitter configured to transmit and receive data via HDMI; and
- a processor configured to: control the HDMI transmitter to transmit, to a source device, a request for transmitting data processing capability information, wherein the data processing capability information indicates whether the source device supports a type of user input data detected by the sink device, control the HDMI transmitter to receive, from the source device, the data processing capability information, and when the type of the user input data is supported by the source device, control the HDMI transmitter to transmit the user input data to the source device, wherein, if an HDMI Ethernet Channel (HEC) between the source device and the sink device is active, the user input data is transmitted over the HEC, and wherein, if the HEC is inactive, the user input data is received over an HDMI Consumer Electronics Control (CEC) channel.
15. The sink device of claim 14, wherein the data processing capability information further includes data type information indicating the type of the user input data.
16. The sink device of claim 15, wherein, when the user input data is transmitted over the HEC, the sink device transmits to the source device an inquiry message requesting state information indicating whether the HEC is available or not, and receives from the source device a first reporting message containing the state information, and
- wherein the state information indicates either an active state or an inactive state of the HEC.
| 6266160 | July 24, 2001 | Saito |
| 6448958 | September 10, 2002 | Muta |
| 9779463 | October 3, 2017 | Fine |
| 20010014602 | August 16, 2001 | Sato |
| 20020100061 | July 25, 2002 | Tsusaka |
| 20030018783 | January 23, 2003 | Bos |
| 20080068649 | March 20, 2008 | Emori |
| 20100186064 | July 22, 2010 | Huang |
| 20100277337 | November 4, 2010 | Brodersen et al. |
| 20110007691 | January 13, 2011 | Awano |
| 20110053496 | March 3, 2011 | Hui |
| 20110239022 | September 29, 2011 | Tokoro |
| 20120090001 | April 12, 2012 | Yen |
| 20130002949 | January 3, 2013 | Raveendran et al. |
| 20130159565 | June 20, 2013 | Soyannwo |
| 20140157342 | June 5, 2014 | Yahata |
| 20150036175 | February 5, 2015 | Yun |
| 20160292810 | October 6, 2016 | Fine |
| 10-2013-0126973 | November 2013 | KR |
| 10-1364849 | February 2014 | KR |
- Steve Venuti, “Introducing HDMI 1.4 Specification Features”, Press Release [Online], HDMI, 2009 [retrieved on Aug. 20, 2015], Retrieved from the Internet <Url: http://www.hdmi.org/download/press_kit/PressBriefing_HDMI1_4_Final_0831.9.pdf>.
Type: Grant
Filed: Jun 12, 2015
Date of Patent: Dec 25, 2018
Patent Publication Number: 20170116138
Assignee: LG ELECTRONICS INC. (Seoul)
Inventors: Hyunsik Yang (Seoul), Hyeonjae Lee (Seoul), Jangwoong Park (Seoul), Dokyun Kim (Seoul), Jinkwon Lim (Seoul)
Primary Examiner: Paul R. Myers
Application Number: 15/317,902
International Classification: G06F 13/10 (20060101); G06F 13/42 (20060101); H04L 29/08 (20060101);
