INTEGRATED CIRCUIT DEVICE WITH CROSSBAR TO ROUTE TRAFFIC
An integrated circuit (IC) device according to an example includes an interconnect bus to communicate with an external memory device, wherein the interconnect bus includes a plurality of different channels to be coupled directly to a first set of masters. The IC device includes a crossbar unit to be coupled to a second set of masters, wherein the crossbar unit is to monitor bandwidth usage at the plurality of different channels, and selectively route traffic between the second set of masters and the plurality of different channels based on the monitored bandwidth usage.
Latest Cypress Semiconductor Corporation Patents:
Integrated circuits may use a variety of different types of interconnect busses. One example of an interconnect bus is an Advanced eXtensible Interface (AXI) bus. An AXI bus is a bus structure that may be used within a microcontroller and that connects subsystems (including, but not limited to, CPU subsystems, analog subsystems, digital subsystems, memory subsystems, clock subsystems, and I/O subsystems) and/or components (for example, analog-to-digital converters, memory, sensor controllers, and real time clocks). A subsystem of a microcontroller may be connected to an external memory via an interconnect bus, such as an AXI bus. However, unbalanced traffic on the AXI channels to the memory can lead to a performance loss.
In the following detailed description, reference is made to the accompanying drawings which form a part hereof, and in which is shown by way of illustration specific examples in which the disclosure may be practiced. It is to be understood that other examples may be utilized and structural or logical changes may be made without departing from the scope of the present disclosure. The following detailed description, therefore, is not to be taken in a limiting sense, and the scope of the present disclosure is defined by the appended claims. It is to be understood that features of the various examples described herein may be combined, in part or whole, with each other, unless specifically noted otherwise.
A subsystem of a microcontroller may be connected to an external memory via an interconnect bus, such as an Advanced eXtensible Interface (AXI) bus. Unbalanced traffic on the AXI channels to the memory may lead to a performance loss. A memory AXI channel may be connected to several masters through an arbiter. These masters may request more than 100% bandwidth of the channel but, at the same time, other masters may request less than 60% of the bandwidth of other memory AXI channels. This scenario may produce a bottleneck in a memory channel and generate back pressure to its masters. The response time per AXI request can increase, decreasing the overall performance of the system.
Some examples disclosed herein are directed to an integrated circuit (IC) device, such as a microcontroller device, which includes a crossbar unit that snoops the bandwidth usage in memory AXI data channels, and based on that information decides where to route future requests to balance the AXI traffic. In some examples, the crossbar unit balances the traffic routing of low priority read memory requests from low priority masters across the multiple channels of the interconnect bus based on information from a bandwidth monitoring mechanism to improve the bandwidth efficiency of the system.
Processor 104 includes a central processing unit (CPU) or another suitable processor. In one example, memory 106 stores machine readable instructions executed by processor 104 for operating the microcontroller 102. Memory 106 and external memory 114 includes any suitable combination of volatile and/or non-volatile memory, such as combinations of Random Access Memory (RAM), Read-Only Memory (ROM), flash memory, and/or other suitable memory. These are examples of non-transitory computer readable storage media. Memory 106 and external memory 114 are non-transitory in the sense that they do not encompass a transitory signal but instead are made up of at least one memory component to store machine executable instructions for performing techniques described herein.
In an example, memory 106 may be any type of memory that is embedded on the same die as processor 104 (e.g., the memory 106 may be within the same microcontroller chip as the processor 104). In an example, external (e.g., off-chip) memory 114 is external to the chip or chip-module that houses the microcontroller 102. For example, microcontroller 102 and external memory 114 may be disposed on the same printed circuit board (PCB), or equivalent structure, and may be coupled to each other over PCB tracks/pads, switches, buses, hubs, trace lines, interconnects, wires, and/or any other types of equivalent signal-conducting structures.
In an example, subsystem 110 may be coupled to external memory 114 via a communication link 113, which includes an interconnect bus. Subsystem 110 may be configured to read from external memory 114 and write to external memory 114 via the interconnect bus. In an example, the interconnect bus may include a plurality of different channels to be coupled directly to higher priority masters within the subsystem 110. The crossbar unit 112 may be coupled to a plurality of lower priority masters within the subsystem 110. The crossbar unit 112 may monitor bandwidth usage between the subsystem 110 and the external memory 114, and selectively route traffic between the plurality of lower priority masters and the plurality of different channels based on the monitored bandwidth usage. In other examples, the crossbar unit 112 may be coupled to any or all of the masters within the subsystem 110, and may balance output traffic based on snooping information (e.g., bandwidth usage).
In an example, the various subcomponents or elements of the system 100 may be embodied in a plurality of different systems, where different modules may be grouped or distributed across the plurality of different systems. To achieve its desired functionality, system 100 may include various hardware components. Among these hardware components may be a number of processing devices, a number of data storage devices, a number of peripheral device adapters, and a number of network adapters. These hardware components may be interconnected through the use of a number of busses and/or network connections. The processing devices may include a hardware architecture to retrieve executable code from the data storage devices and execute the executable code. The executable code may, when executed by the processing devices, cause the processing devices to implement at least some of the functionality disclosed herein.
In an example, interconnect bus 202 is an AXI interconnect bus. AXI is a bus structure within the microcontroller which connects subsystems (including, but not limited to, CPU subsystems, analog subsystems, digital subsystems, memory subsystems, clock subsystems, and I/O subsystems) and/or components (for example, analog-to-digital converters, memory, sensor controllers, and real time clocks). In an example, interconnect bus 202 includes three channels 204(1)-204(3) (collectively referred to as channels 204). In an example, interconnect bus 202 provides a bus infrastructure that serves as a routing fabric for AXI transactions initiated by bus masters, and also performs decoding, bus arbitration, and error handling.
Interconnect bus 202 is coupled to external memory 210. External memory 210 is an example implementation of external memory 114 (
In an example, channels 204 perform arbitration by port identification (ID), and arbiter 216 performs arbitration by master ID. In an example, arbitration provided by arbiter 216 is priority based with round-robin arbitration within an arbitration priority group. The priority may be looked up by the master ID. Arbitration may be deferred (i.e., the arbitration is calculated for the next cycle). The AXI master that currently performs a transaction takes part in the arbitration, which may cause idle cycles. However, an advantage is that the master with the highest priority may permanently win the arbitration and it can perform back-to-back transfers even if there are other requesting masters.
Graphics caches 226 include command cache 228 and pixel cache 230. JPEG decoder masters 233 include JPEG decoder read master 234(1), which is coupled directly to channel 204(1) of interconnect bus 202. 2D graphics masters includes drawing read master 234(2), command sequence read master 234(3), and fetchblit read masters 238(1)-238(3). Drawing read master 234(2) is coupled directly to channel 204(2) of interconnect bus 202. Command sequence read master 234(3) is coupled to channel 204(3) of interconnect bus 202 via command cache 228. Fetchblit read masters 238(1)-238(3) are coupled to crossbar unit 222 via pixel cache 230. In other examples, masters 238(1)-238(3) may be coupled directly to the crossbar unit 222.
Video input/output masters 240 include fetch warp master 242(1), fetch eco master 242(2), fetch decode master 242(3), fetch layer master 242(4), fetch decode master 242(5), fetch eco master 242(6), and fetch layer master 242(7). Fetch warp master 242(1) is coupled to channel 204(1) of interconnect bus 202 via pixel cache 230. Fetch eco master 242(2) is coupled directly to channel 204(3) of interconnect bus 202. Fetch decode master 242(3) is coupled directly to channel 204(1) of interconnect bus 202. Fetch layer master 242(4) is coupled directly to channel 204(2) of interconnect bus 202. Fetch decode master 242(5) is coupled directly to channel 204(2) of interconnect bus 202. Fetch eco master 242(6) is coupled directly to channel 204(3) of interconnect bus 202. Fetch layer master 242(7) is coupled directly to channel 204(3) of interconnect bus 202.
In an example, bus masters, such as masters 233, 236, and 240, which access the external memory 210 through the interconnect bus 202, are all internal to the subsystem 200(1). As there are many bus masters, the interconnect bus 202 takes cares of bus arbitration. In an example, each of the masters shown in
In the example shown in
The crossbar unit 222 includes three slave ports 232(1)-232(3) to receive read memory requests from low priority masters 238(1)-238(3), respectively. The crossbar unit 222 includes three master ports 220(1)-220(3) that are respectively coupled to channels 204(1)-204(3) of interconnect bus 202. The crossbar unit 222 may also include an Advanced High-Performance Bus (“AHB”) port to read/write internal registers, as well as reordering logic. In an example, the crossbar unit 222 includes a monitoring mechanism 224 to snoop or monitor the traffic at each of the communication links 206(1)-206(3) between the interconnect bus 202 and the external memory 210. In other examples, the monitoring mechanism 224 may monitor traffic at other locations within subsystem 200(1). The crossbar unit 222 may include an ordering mechanism to send AXI data transactions in order through the slave ports 232(1)-232(3).
In an example, crossbar unit 222 balances the traffic routing of low priority read memory requests from low priority masters 238 across the multiple channels 204 of the interconnect bus 202 based on the information from monitoring mechanism 224 to improve the bandwidth efficiency of the system. The numbers on the channels 204 indicate the percentage of the total bandwidth of that channel 204 that may be requested by each of the masters. For example, master 242(7) can request up to 40 percent of the bandwidth of channel 204(3). In an example, crossbar unit 222 dynamically arbitrates AXI accesses from the low priority masters 238 to the port 214(1), 214(2), or 214(3) of the external memory 210 with the lowest bandwidth, and thereby helps to ensure that high priority masters 242 are receiving their required bandwidth. The bandwidth requirements may not be constant in time, and in some time periods, some bus masters may demand more bandwidth than is available for one channel 204. In this bottleneck condition for one channel 204, there may be other channels 204 with less bandwidth demand than its maximum. The crossbar unit 222 addresses this issue by routing the read memory requests from the low priority masters to a channel 204 of interconnect bus 202 with less bandwidth demand to avoid congestions in the channels 204.
In an example, crossbar unit 222 includes a plurality of selectable operating modes, including a neutral mode, a static mode, a dynamic readiness mode, and a load dynamic mode. In the neutral mode, the crossbar unit 222 is deactivated, and all slave ports 232 are directly connected to their respective master ports 220. In the static mode, the crossbar unit 222 uses a static mapping between slave ports 232 and master ports 220 based on the value in a configuration register. In the dynamic readiness mode, the crossbar unit 222 uses a dynamic mapping between slave ports 232 and master ports 220 based on a ready status of arbiter inputs of the interconnect bus 202, and the port with the longest time since the arbiter was busy may be selected. In the load dynamic mode, the crossbar unit 222 uses a dynamic mapping between slave ports 232 and master ports 220 based on data bandwidth usage (e.g., outstanding transaction count for arbiter outputs of the interconnect bus 202), and the port with the lowest data bandwidth usage may be selected.
As shown in
In an example, crossbar unit 222 balances the traffic routing of read memory requests from masters 238(1) and 238(2) across the multiple channels 204 of the interconnect bus 202 based on the information from monitoring mechanism 224 to improve the bandwidth efficiency of the system. In an example, crossbar unit 222 balances the unbalanced traffic of the masters 238(1) and 238(2) so that each of the three channels 204 will receive 33.33% of the total bandwidth from the masters 238(1) and 238(2).
As an example, assume that without the crossbar unit 222 or with the crossbar unit 222 in the static mode, master 238(1) can request 50% of the bandwidth of channel 204(1), and master 238(2) can request 50% of the bandwidth of channel 204(2). Assume further that masters 234(1), 242(1), 242(3) can request 25%, 20%, and 20%, respectively, of the bandwidth of channel 204(1) maximum. If all of the masters connected to channel 204(1) are at 100% of their bandwidth usage, these masters will be using 115% (i.e., 25%+50%+20%+20%) of the bandwidth of channel 204(1). However, using the crossbar unit 222 in a load dynamic mode, the masters will use 98.33% (i.e., 25%+33.33% (max)+20%+20%) of the bandwidth of channel 204(1).
As shown in
The counters 306 may be used in different configurations depending on the operating mode of the crossbar unit. In the first configuration corresponding to the dynamic readiness mode, the counter 306 for each port 302 is reset when the arbiter is busy with higher priority traffic and sets a masn_arready bit to low. When the masn_arready bit is set to high, each cycle is counted by the counters 306. The counters 306 measure the time since masn_arready was low the last time. The port selection criteria is the port with the highest count value, and the arbiter 304 selects this port with a port selection signal 310. In the second configuration corresponding to the load dynamic mode, the counters 306 are incremented with the byte length of the address request and decremented when the requested data is received. In another example, the counters 306 are incremented by one with each address request, and decremented by one when the requested data is received.
Address channel crossbar 406 includes crossbar routing unit 412 and ID append logic elements 414(1)-414(3) (collectively referred to as ID append logic 414). Data channel crossbar 432 includes crossbar routing unit 433 and reordering logic elements 434(1)-434(3) (collectively referred to as reordering logic 434).
For every address request received via slave address ports 420, information is added to the request to be able to route the incoming data properly to its slave data port 440. In an example, every incoming address request is tagged to be able to later perform ordering at the data channel. Address requests are received via the slave address ports 420, and provided to the ID append logic 414 via slave address pipelines 418. In an example, ID append logic 414 appends ID information to each address request including a transaction ID 424 and a slave ID 426. The slave ID 426 is used to identify to which slave should be routed back the incoming data. The transaction ID 424 is used to identify the transaction order. For example, a data transaction with transaction ID “2” may be stored in reordering memory at the data channel crossbar 432 until it can be sent to the port if a transaction with transaction ID “1” is not yet received.
The ID append logic 414 provides the address requests with the appended ID information to the crossbar routing unit 412, which selectively routes the address requests with the appended ID information to output ports of the crossbar routing unit 412. The routing may be based on a counter value that may be incremented with a cnt_inc signal 408 and decremented with a cnt_dec signal 410. The address requests with the appended ID information are then sent to master address ports 402 via master address pipelines 404. Based on the address requests, data is read from the external memory and data transactions are received at master data ports 428. The data transactions are provided to the crossbar routing unit 433 via the master data pipelines 430. Crossbar routing unit 433 selectively routes the data transactions to the reordering logic 434.
In an example, the ID information of every master port is stored in FIFOs 422. The FIFO ID information may be used in the routing and ordering at the data channel. For example, if an address request is received at the slave address port 420(3), the request may be routed by the address channel crossbar 406 to the master address port 402(2), and the ID information may be stored in its FIFO 422. Once the data is read from the external memory and received at a master data port 428(2), the crossbar routing unit 433 routes it to the path of the slave data port 440(3) associated with the request. The crossbar routing unit routes the data using the slave ID 426 previously stored in the FIFO 422. In this example, the crossbar routing unit 433 routes the data to reordering logic 434(3). The reordering logic 434(3) receives the data and checks if the transaction ID 424 corresponds to the next transaction expected by the cache. The transaction may be stored in memory (e.g., memory 506 shown in
At some later time, the 0x110 data transaction arrives to the reordering logic 434. The reordering logic 434 will determine that its transaction ID matches the next transaction ID expected by the cache, and the transaction ID appended in the address channel is removed before sending it to the cache. The transaction ID is released (as indicated at 438 in
An example of the present disclosure is directed to an integrated circuit (IC) device.
The interconnect bus 602 may be an AXI bus. The crossbar unit 604 may selectively route the traffic in a manner that balances the traffic across the plurality of different channels. The interconnect bus 602 and the crossbar unit 604 may be part of a video processing subsystem of the IC device. The first set of masters may include a plurality of higher priority masters and the second set of masters may include a plurality of lower priority masters. The plurality of higher priority masters may include high priority masters and medium priority masters, and the plurality of lower priority masters may include low priority masters having a latency tolerance based priority that is lower than a latency tolerance based priority of the high priority masters and the medium priority masters.
The crossbar unit 604 may include at least one counter, and the monitoring the bandwidth usage at the plurality of different channels by the crossbar unit may include incrementing the at least one counter based on read requests sent to the external memory device. The crossbar unit 604 may increment the at least one counter in accordance with a byte length of data requested in each of the read requests. The crossbar unit 604 may decrement the at least one counter when the data requested in the read requests is received. The crossbar unit 604 may include reordering logic to reorder data transactions that are received out of an expected order by the crossbar unit from the external memory device, and the crossbar unit 604 may send the reordered data transactions to the second set of masters.
The crossbar unit 604 may include a plurality of selectable operating modes, and the crossbar unit 604 may selectively route requests between slave ports of the crossbar unit 604 and master ports of the crossbar unit 604 based on a currently selected one of the operating modes. The operating modes may include a load dynamic mode in which the crossbar unit 604 uses a dynamic mapping between the slave ports and the master ports based on data bandwidth usage for each of the plurality of different channels of the interconnect bus 602 (e.g., counting the on-the-fly data in the channels). The operating modes may further include a dynamic readiness mode in which the crossbar unit 604 uses a dynamic mapping between the slave ports and the master ports based on a ready status of the plurality of different channels of the interconnect bus 602, wherein the ready status includes respective lengths of time that the plurality of different channels have been busy. The operating modes may further include a neutral mode in which all of the slave ports are directly connected to respective ones of the master ports, and a static mode in which the crossbar unit uses a static mapping between the slave ports and the master ports based on a value in a configuration register.
Another example of the present disclosure is directed to a system with a crossbar unit.
The interconnect bus 706 may be an AXI bus, and the crossbar unit 712 may selectively route the traffic in a manner that balances the traffic across the plurality of different channels of the AXI bus. The crossbar unit 712 may include at least one counter, and the monitoring the bandwidth usage at the plurality of different channels by the crossbar unit 712 may include incrementing the at least one counter based on read requests sent to the at least one memory device. The crossbar unit 712 may include reordering logic to reorder data transactions that are received out of an expected order by the crossbar unit 712 from the at least one memory device, and wherein the crossbar unit 712 is to send the reordered data transactions to the second plurality of masters 710.
Another example of the present disclosure is directed to a method of routing read requests.
A crossbar unit may perform the selective routing at 806 in method 800, and the method 800 may further include selecting an operating mode of the crossbar unit; and selectively routing the read requests from the second plurality of low to the plurality of channels based on the monitored usage of the plurality of channels and the selected operating mode of the crossbar unit.
Although specific examples have been illustrated and described herein, a variety of alternate and/or equivalent implementations may be substituted for the specific examples shown and described without departing from the scope of the present disclosure. This application is intended to cover any adaptations or variations of the specific examples discussed herein. Therefore, it is intended that this disclosure be limited only by the claims and the equivalents thereof.
Claims
1. An integrated circuit (IC) device, comprising:
- an interconnect bus to communicate with an external memory device, wherein the interconnect bus includes a plurality of different channels to be coupled directly to a first set of masters; and
- a crossbar unit to be coupled to a second set of masters, wherein the crossbar unit is to monitor bandwidth usage at the plurality of different channels, and selectively route traffic between the second set of masters and the plurality of different channels based on the monitored bandwidth usage.
2. The IC device of claim 1, wherein the interconnect bus is an advanced extensible interface (AXI) bus.
3. The IC device of claim 1 wherein the crossbar unit is to selectively route the traffic in a manner that balances the traffic across the plurality of different channels.
4. The IC device of claim 1, wherein the interconnect bus and the crossbar unit are part of a video processing subsystem of the IC device.
5. The IC device of claim 1, wherein the first set of masters comprises a plurality of higher priority masters and the second set of masters comprises a plurality of lower priority masters.
6. The IC device of claim 5, wherein the plurality of higher priority masters includes high priority masters and medium priority masters, and wherein the plurality of lower priority masters comprise low priority masters having a latency tolerance based priority that is lower than a latency tolerance based priority of the high priority masters and the medium priority masters.
7. The IC device of claim 1, wherein the crossbar unit includes at least one counter, and wherein the monitoring the bandwidth usage at the plurality of different channels by the crossbar unit includes incrementing the at least one counter based on read requests sent to the external memory device.
8. The IC device of claim 7, wherein the crossbar unit is to increment the at least one counter in accordance with a byte length of data requested in each of the read requests.
9. The IC device of claim 8, wherein the crossbar unit is to decrement the at least one counter when the data requested in the read requests is received.
10. The IC device of claim 1, wherein the crossbar unit includes reordering logic to reorder data transactions that are received out of an expected order by the crossbar unit from the external memory device, and wherein the crossbar unit is to send the reordered data transactions to the second set of masters.
11. The IC device of claim 1, wherein the crossbar unit includes a plurality of selectable operating modes, and wherein the crossbar unit is to selectively route requests between slave ports of the crossbar unit and master ports of the crossbar unit based on a currently selected one of the operating modes.
12. The IC device of claim 11, wherein the operating modes include a load dynamic mode in which the crossbar unit uses a dynamic mapping between the slave ports and the master ports based on an outstanding transaction count for each of the plurality of different channels of the interconnect bus.
13. The IC device of claim 12, wherein the operating modes further include a dynamic readiness mode in which the crossbar unit uses a dynamic mapping between the slave ports and the master ports based on a ready status of the plurality of different channels of the interconnect bus, wherein the ready status includes respective lengths of time that the plurality of different channels have been busy.
14. The IC device of claim 13, wherein the operating modes further include a neutral mode in which all of the slave ports are directly connected to respective ones of the master ports, and a static mode in which the crossbar unit uses a static mapping between the slave ports and the master ports based on a value in a configuration register.
15. A system, comprising:
- at least one memory device; and
- a microcontroller external to the at least one memory device, the microcontroller comprising: an interconnect bus to communicate with the at least one memory device, wherein the interconnect bus includes a plurality of different channels; a first plurality of masters each coupled directly to one of the channels of the interconnect bus; a second plurality of masters; and a crossbar unit coupled to the second plurality of masters, wherein the crossbar unit is to monitor bandwidth usage at the plurality of different channels, and selectively route traffic between the second plurality of masters and the plurality of different channels based on the monitored bandwidth usage.
16. The system of claim 15, wherein the interconnect bus is an advanced extensible interface (AXI) bus, and wherein the crossbar unit is to selectively route the traffic in a manner that balances the traffic across the plurality of different channels of the AXI bus.
17. The system of claim 15, wherein the crossbar unit includes at least one counter, and wherein the monitoring the bandwidth usage at the plurality of different channels by the crossbar unit includes incrementing the at least one counter based on read requests sent to the at least one memory device.
18. The system of claim 15, wherein the crossbar unit includes reordering logic to reorder data transactions that are received out of an expected order by the crossbar unit from the at least one memory device, and wherein the crossbar unit is to send the reordered data transactions to the second plurality of masters.
19. A method, comprising:
- sending read requests from a first plurality of masters to an external memory device via a plurality of channels of an interconnect bus;
- monitoring usage of the plurality of channels; and
- selectively routing read requests from a second plurality of masters to the plurality of channels based on the monitored usage of the plurality of channels.
20. The method of claim 19, wherein a crossbar unit performs the selective routing, and wherein the method further comprises:
- selecting an operating mode of the crossbar unit; and
- selectively routing the read requests from the second plurality of masters to the plurality of channels based on the monitored usage of the plurality of channels and the selected operating mode of the crossbar unit.
Type: Application
Filed: Oct 7, 2021
Publication Date: Apr 13, 2023
Applicant: Cypress Semiconductor Corporation (San Jose, CA)
Inventors: Andreas Torno (Eching), Roland Richter (Puchheim), Joaquin Ibanez Montemayor (Gauting)
Application Number: 17/496,572