JOINT ASSOCIATION, ROUTING AND RATE ALLOCATION IN WIRELESS MULTI-HOP MESH NETWORKS

Abstract

A method and apparatus are described including collecting network information, determining an association, bandwidth allocation and routing scheme based on the collected network information, notifying a mesh access point of the association, the bandwidth allocation and the routing scheme and notifying a client node of its association information. Also described are a method and apparatus including measuring link quality and channel conditions, reporting results of the measuring act to a controller, receiving a routing decision and data forwarding instructions from the controller and forwarding the routing decision and the data forwarding instructions to a client node. Further described are a method and apparatus including measuring link quality and channel conditions, reporting results of the measuring act to a controller, receiving association instructions from the centralized controller and updating previously stored association instructions with the received association instructions.

Description

FIELD OF THE INVENTION

The present invention relates to wireless municipal mesh networks and in particular to a method and apparatus for providing joint association, routing and rate allocation in a fair manner.

BACKGROUND OF THE INVENTION

In multi-hop wireless networks, it has been shown that interference has a significant impact on network performance. In one prior art study, the throughput of wireless networks under two models of interference was investigated using a protocol model that assumed interference to be an all-or-nothing phenomenon and a physical model that considered the impact of interfering transmissions on the signal-to-noise ratio. Another prior art study considered the impact of interference on multi-hop wireless network performance. It used a conflict graph to model the effects of wireless interference and presented methods for computing upper and lower bounds on the optimal throughput for the given network and workload.

In addition to throughput, fairness is an important aspect in wireless mesh networks. Fairness has been extensively studied in wireless networks. Yet another prior art study showed that use of current IEEE 802.11 media access protocols for wireless backhaul networks can result in severe unfairness and even starvation for flows farther away from a gateway. Accordingly, the researchers developed a distributed layer 2 fairness algorithm to achieve fairness at the mesh access point (MAP)-aggregate granularity. In another study, the researchers proposed scheduling schemes for maximizing the sum of user utility in wireless networks, and pointed out that max-min fairness can be achieved as a special case using a certain choice of utility function. To derive a solution for max-min fair bandwidth allocation, other researchers used a network model with a number of simplifying assumptions. For example, they assumed that links that do not share nodes will never contend for channel access. Moreover, only single-hop flows were considered. Other prior art studied arbitrary link contention graphs, but once again only considered single-hop flows. In yet another prior art study, the researchers focused on fair bandwidth allocation in multi-hop wireless local area networks (WLANs). Given a determined tree structure, fair bandwidth allocation was performed via a Pump-and-Drain operation. In addition, the researchers designed an algorithm to construct a tree structure for improving throughput. However, none of the prior art studies jointly addressed the problem of association, routing and bandwidth/rate allocation in wireless mesh networks.

It is desirable to have a method and apparatus to jointly address the issues of association, routing and bandwidth/rate allocation in order to allocate the largest possible bandwidth to the participating stations while simultaneously allocate that bandwidth in a fair manner (as evenly as possible).

SUMMARY OF THE INVENTION

In a wireless municipal mesh (muni-mesh) network, the association mechanism, by which the client stations (STAs) become affiliated with the mesh access points (MAPs), and the routing algorithm, through which the logical topology of the relay backhaul is determined, organize the MAPs and the STAs into a two-tiered communication structure. As used herein, “/” denotes alternative names for the same or similar components or structures. That is, a “/” can be taken as meaning “or” as used herein. In the present invention, the problem of joint association, routing and bandwidth/rate allocation in wireless muni-mesh networks is investigated, motivated by the observation that the communication structure determined by association and backhaul routing affects the resulting allocated rates. Wireless interference is modeled using a conflict graph that captures the components specific to the two-tiered muni-mesh networks. The optimization goals are to maximize the network throughput and at the same time, to improve the fairness. First, a Linear Programming (LP) problem is formulated with the objective of maximizing the throughput. However, simply maximizing the throughput may lead to a severe bias on rates allocated to STAs. In order to achieve a good tradeoff between throughput and fairness, a max-min fairness model is considered. A rigorous formulation is provided to maximize the network throughput with a guaranteed maximum minimum rate allocation. Optimal algorithms for joint association, routing and rate allocation are developed herein for the cases allowing multiple MAP association and multi-path backhaul routing. Then the constraints of integral association and single-path routing are considered. If integral association and single-path routing are necessary, the problem formulation falls into mixed integer non-linear programming, which is NP-hard in general. To this end, a method to decouple the problems of logical topology construction and rate allocation is described. A heuristic method is used to construct the two-tiered logical communication topology and then bandwidth is allocated to the STAs within the determined logical topology.

Wireless municipal mesh (muni-mesh) networks are emerging as a promising solution for last-mile broadband Internet access. Unlike flat ad hoc networks, a mesh network has a hierarchical architecture, as shown in FIG. 1. The upper layer (also referred to as relay layer) includes mesh access points (MAPs). The MAPs are interconnected via wireless links to form a multi-hop backhaul, providing network access and data forwarding for the client stations (STAs). Some of the MAPs connect to the wired Internet backbone. These MAPs are referred to as gateways. Client nodes/STAs (e.g., laptops, computers, processors, mobile terminals, personal digital assistants (PDAs), dual-mode smart phones, etc.) form the lower layer (also referred to as access layer). The STAs associate themselves with nearby MAPs to access the network. A STA does not participate in packet relay and routing process, i.e. it is oblivious of the backhaul topology behind the MAPs. A STA simply sends (or receives) packets to (or from) its associated MAP, in the same way as it does in a single-hop WLAN. Packet delivery in the wireless backhaul is handled by the MAPs through backhaul routing. In general, the relay layer and the access layer work on orthogonal channels to avoid interference.

It is expected that most of the data traffic in a wireless muni-mesh network is between the STAs and the Internet through the MAPs and gateway(s). Such traffic needs to be efficiently delivered on the bandwidth-limited wireless channel through the access link (access layer) and the multi-hop backhaul path (relay layer). In addition, it is important to fairly allocate the limited bandwidth to all STAs, i.e. control the amount of traffic that a STA can send to or receive from the mesh network since users commonly pay the same flat rate to get Internet access.

In the present invention, the problem of joint association, routing and rate allocation in wireless mesh networks is investigated with the objectives of maximizing the network throughput and improving the fairness. Due to the shared nature of wireless medium, transmissions in a common neighborhood will interfere with each other, which make the rate allocation problem completely different from that in the wired networks. In a wireless muni-mesh network, there is a link between any pair of nodes (STAs and MAPs) if they are in direct transmission range of each other. A node here includes either a STA or a MAP. However, it is association and backhaul routing that determine the set of STA-MAP and MAP-MAP links that are actually being used and carry the data/traffic. Consequently, all the nodes (MAPs and STAs) are organized into a logical topology for communications. Since different logical topologies consist of different sets of links and have different interference patterns, the particular logical topology determines how much bandwidth a STA can be allocated under a given rate allocation policy. It is desirable that the total rate/bandwidth allocated to the STAs is as large as possible and the rate/bandwidth is allocated to each STA as evenly as possible in terms of fairness.

A method and apparatus are described including collecting network information, determining an association, bandwidth allocation and routing scheme based on the collected network information, notifying a mesh access point of the association, the bandwidth allocation and the routing scheme and notifying a client node of its association information. Also described are a method and apparatus including measuring link quality and channel conditions, reporting results of the measuring act to a controller, receiving a routing decision and data forwarding instructions from the controller and forwarding the routing decision and the data forwarding instructions to a client node. Further described are a method and apparatus including measuring link quality and channel conditions, reporting results of the measuring act to a controller, receiving association instructions from the centralized controller and updating previously stored association instructions with the received association instructions.

BRIEF DESCRIPTION OF THE DRAWINGS

The present invention is best understood from the following detailed description when read in conjunction with the accompanying drawings. The drawings include the following figures briefly described below where like-numbers on the figures represent similar elements:

FIG. 1 is a schematic diagram of a network at which the present invention is directed.

FIG. 2a is a schematic diagram of a 3 MAP network.

FIG. 2b is a connectivity graph of the 3 MAP network of FIG. 2a.

FIG. 2c is a conflict graph of the connectivity graph of FIG. 2b.

FIG. 3 is a flowchart of an exemplary embodiment of the method of the present invention in the gateway where the mesh network has a centralized controller and the mesh network uses a centralized MAC protocol.

FIG. 4 is a flowchart of an exemplary embodiment of the method of the present invention for a MAP, the system having a centralized controller and using a centralized MAC protocol.

FIG. 5 is a flowchart of an exemplary embodiment of the method of the present invention for a STA, the system having a centralized controller and using a centralized MAC protocol.

FIG. 6 is a flowchart of an exemplary embodiment of the method of the present invention for a centralized controller using a distributed MAC protocol.

FIG. 7 is a flowchart of an exemplary embodiment of the method of the present invention for a STA, the system having a centralized controller and using a distributed MAC protocol.

FIG. 8 is a flowchart of an exemplary embodiment of the method of the present invention for a MAP, the system having a centralized controller and using a distributed MAC protocol.

FIG. 9 is a block diagram of an exemplary embodiment of a gateway in accordance with the principles of the present invention.

FIG. 10 is a block diagram of an exemplary embodiment of a MAP in accordance with the principles of the present invention.

FIG. 11 is a block diagram of an exemplary embodiment of a STA in accordance with the principles of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

Referring to FIG. 1, a network system considered in the present invention is illustrated. The network system includes three elements: relay nodes (RNs) 105 (e.g., MAPs), client STAs (end devices) 110, and gateway(s) 115 (base station). The relay nodes may have multiple physical radio interfaces or a single physical radio interface divided into multiple logical interfaces. One or more physical or logical radio interfaces is an access interface. The other interfaces are relay interfaces. The access interface is used for end-users/client nodes/STAs to associate with one or more MAPs/RNs for accessing the network, while the relay interfaces are used to construct a backbone multi-hop wireless network for packet forwarding between relay nodes. One or more relay nodes connect to the wired infrastructure 120 through wired Internet backhaul interface 125, acting as the Internet gateway(s) or base station. Clients/end devices/STAs 110 do not participate in packet relay or routing process, and need to associate with one or more MAPs/RNs 105 to gain access to the network. The STAs 110 just send (or receive) packets to (or from) their associated MAPs 105. The rest of the packet delivery from the source to the destination is performed by the relay nodes 105 using a routing protocol. In the system model of the present invention, all the wireless interfaces are half-duplex, i.e., the interfaces can only either transmit or receive at a given time.

It is expected that most of the traffic in an infrastructure multi-hop network will be traffic to/from the wired network or Internet. In the present invention, focus is placed on improving the performance of communications between a client/STA and the outside wired Internet via the gateway/base station. To ensure the connectivity of the backhaul, the relay interfaces of all the MAPs are tuned to a common channel. Each MAP supports two interfaces. A MAP's access interface provides network access for the STAs associated with the MAP and the MAP's relay interface is used to construct and communicate over the backhaul relaying data/traffic between the gateway and the STAs associated with the MAP. Note that with modifications to the conflict graphs, the method of the present invention can be generalized to multi-radio multi-channel networks as well. In the access layer, the overlapping cells are tuned to operate on orthogonal channels to avoid inter-cell interference. The relay interface and the access interface also work on orthogonal channels so that the communications at the access layer and at the relay layer do not interfere with one another. A client device/STA only needs to support one single interface for access. The working channel for this interface is determined by the MAP(s) with which the STA is associated. It is assumed that each node transmits at the same fixed transmission power, i.e., there is a fixed transmission range T_r and a fixed interference rage I_r associated with each node. In the network, only STAs generate data/traffic. MAPs relay packets between the STAs and the gateway(s).

Given a mesh network with M MAPs and N STAs, a connectivity graph G(V⁺, E) is derived as follows, where V⁺=V_a+V_s. Every vertex aεV_a corresponds to a MAP in the network. An edge e=(a₁,a₂)εE corresponds to a wireless link between a₁εV_a and a₂εV_a if d(a₁,a₂)≦T_r where d is the Euclidean distance between a₁ and a₂. Each vertex uεV_s is a STA. There is an edge between u and v if d(u,v)≦T_r and vεV_a is a MAP. The edge (u,v) corresponds to a wireless link between STA u and MAP v. The second condition means that STAs only communicate with MAPs. Direct communication between two STAs is not allowed. That is, the STAs do not form a peer-to-peer network among themselves.

In the following, a protocol model is used to define the conditions for a successful wireless transmission and the interference is modeled using a conflict graph. In the protocol model, a transmission between node i and node j is successful if all of the following conditions are satisfied:

1. Node i and node j communicate on the same channel

2. d(i, j)≦T_r, where d(i,j) is the distance between i and j

3. Any node k, such that d(k,i)≦I_r or d(k, j)≦I_r remains silent during the transmission

The third condition means that both the sender and the receiver be free of interference. The sender should be free of interference in order to receive the receiver's acknowledgement successfully. Since every node transmits at the same fixed power and radio is inherently a broadcast medium where the communication channel is shared between multiple adjacent nodes within interference range, the interference area of a node i can be imagined as a disk D_i centered at i with radius I_r. Without confusion, D, is also used to denote the set of nodes covered by disk D_i and on the same channel as i, i.e., D_i is used to denote the set of interfering nodes of node i. Using this definition, the set of links/edges interfering with a link e=(i,j) can be written as:

I_e={(u,v)|uεD_i or uεD_j or vεD_i or vεD_j}

To incorporate wireless interference into the problem formulation, a conflict graph, G′(V′,E′) is defined, whose vertices correspond to the links of the connectivity graph G. There exists an edge in G′(V′,E′) between the vertices e₁=(x,y) and e₂=(u,v) if in G the links e₁ and e₂ interfere with each other, i.e., they cannot be active at the same time. Based on the protocol model, an edge is drawn if (u,v) is covered by I_xy or I_e1. In the backhaul relay layer, this encompasses the case where a conflict arises because links (x,y) and (u,v) having an endpoint in common (since relay interfaces work on the same channel, two links sharing an endpoint lie in the interference set of each other). However, things are different for the access layer. Each STA supports only one access interface. The working channel of the interface is not pre-configured. Instead the working channel is dynamically tuned to one of the associated MAPs' working channels. In the problem formulation, dynamic fractional association is permitted, i.e., a STA can associate with more than one MAP, which implies that a STA needs to work on multiple channels in a time-division manner since it has only one radio. Potentially, a STA can associate with all the MAPs within its range T_r, so there is a link between the STA and each of such MAPs in the connectivity graph G. Based on the conflict graph construction described above, there would be no edge between any pair of these links in G′ because these links work on orthogonal channels. However, due to a single radio each STA has, these links cannot be active at the same time. That is, a STA can work only on one channel and transmit to one MAP at a time. Therefore, the interference set of a STA-MAP link explicitly includes the links that share the same radio as the given link, and consequently an edge is drawn between any pair of such links in the conflict graph G′. Using the conflict graph, the set of links interfering with a link e=(x,y) can be represented in another way:

I_e={e′|(e,e′)εE′}

FIG. 2a illustrates the construction of the connectivity graph and the conflict graph in a 3-MAP network, where MAP A is the gateway 205. MAP B 210 and MAP C 210 have a link to A but are out of each other's range. The three MAPs work on channel ch1 in the backhaul. The STA S 215 can potentially associate with both B and C whose access interfaces work on orthogonal channels ch2 and ch3 respectively. FIG. 2b is essentially the same graph as FIG. 2a but with all of the elements represented as points. That is, gateway 205, MAP B 210, MAP C 210 and STA S 215 are all represented by a filled in circle. FIG. 2a is a schematic view of the 3 MAP network and FIG. 2b is a connectivity graph of the same 3 MAP network. FIG. 2c is a conflict graph showing while STA S can connect to both MAP B and MAP C, since it has only one radio interface STA S can only communicate with either MAP B or MAP C at any given time. The BS link and the CS link are on the conflict graph because STA S has only one radio. Gateway 205 can communicate with either or both MAP B or MAP C. However, since the AB link and the AC link have a common endpoint there is a conflict.

Next, mathematically formulating the joint association, routing and rate allocation problem is described. Suppose that there are M MAPs and N STAs in the network. To reach the performance upper limits, fractional association and multi-path routing are first allocated, i.e., a STA can associate with multiple MAPs and in the backhaul a traffic flow can be routed through multiple paths to the gateway. The rate allocation vector for the STAs is denoted by r={r_ij|iεV_s, jεV_a}, where r_ij is the rate allocated to STA i for its association with MAP j. The total rate allocated to STA i is therefore r_i=Σ_jr_ij and the network throughput is S(r)=Σ_i=1^NΣ_j=1^Mr_ij. When a STA is allocated a total rate of r_i, it can communicate with the wired network through the gateway with the total rate of r_i. An M-element vector f=[f₁, f₂, . . . f_M] denotes the traffic volumes at each MAP, where f_j represents the total traffic aggregated for j's associated STAs. Under multi-path routing, f_j may be distributed to multiple paths and cross different set of links to the gateway. R_j,e is used to denote how much bandwidth on link e is allocated for transmitting a flow belonging to f_j. The capacity of a link e=(u, v)εE is denoted with C_uv or C_e.

First, the LP formulation to determine association, routing and rate allocation to maximize the throughput is presented. In the following, h(e) and t(e) are used to denote the head (the sender) and the tail (the receiver) of a link e, respectively. “gw” is used to denote the gateway. The LP problem is called the Maximum Throughput Rate Allocation (MTRA) problem.

$\begin{array}{cc}\hat{s}=\max \sum _{i=1}^N\sum _{j=1}^Mr_{\mathrm{ij}}\mathrm{Subject}\mathrm{to}\text{:}& \left(1\right)\\ \sum _{j:\left(i,j\right)\in E}\frac{r_{\mathrm{ij}}}{C_{\mathrm{ij}}}\le 1,\forall i\in V_s& \left(2\right)\\ \sum _{i:\left(i,j\right)\in E}\frac{r_{\mathrm{ij}}}{C_{\mathrm{ij}}}\le 1,\forall j\in V_a& \left(3\right)\\ \sum _{i:\left(i,j\right)\in E}r_{\mathrm{ij}}\le f_j,\forall j\in V_a& \left(4\right)\\ \sum _{e:h\left(e\right)=j}R_{j,e}=f_j,\forall j\in V_a\backslash \left\{\mathrm{gw}\right]& \left(5\right)\\ \sum _{e:t\left(e\right)=j}R_{j,e}=0,\forall j\in V_a\backslash \left\{\mathrm{gw}\right\}& \left(6\right)\\ \sum _{e:h\left(e\right)=j}R_{j,e}=0j=\mathrm{gw}& \left(7\right)\\ \sum _{e:h\left(e\right)=v}R_{j,e}=\sum _{e:t\left(e\right)=v}R_{j,e}\forall v\in V_a\backslash \left\{j,\mathrm{gw}\right\}& \left(8\right)\\ \sum _{e\bigcup I_e}\sum _{j=1}^M\frac{R_{j,e}}{C_e}\le 1\forall e\in E& \left(9\right)\\ r\ge 0,R\ge 0,f\ge 0& \left(10\right)\end{array}$

In inequalities (2) and (3), R_ij/C_ij the fraction of STA i's time to send its own traffic to MAP j. (2) presents the radio constraint on a STA (the STA transmits to multiple associated MAPs in a time-division manner), indicating that the total rate allocated to STA i should not require more transmission time than STA i actually has. The inequality (3) means that the total traffic imposed on MAP j by its associated STAs should require no more receiving time than MAP j has. Equations and inequalities (4)-(8) present the law of flow conservation. Inequality (4) states that a MAP's traffic is the sum of the traffic from its associated STAs. Equation (5) shows that MAP j's traffic is distributed to its outgoing links, however, the sum of the rates on these links should equal f_j. Equation (6) indicates that in the backhaul there is no flow belonging to f_j on incoming links to MAP j since j is the source to the gateway. Equation (7) holds that there is no flow belonging to f_j on outgoing links of the gateway, because gateway is the sink. Equation (8) represents that, for any MAP, except the source to the gateway in the backhaul and the gateway, the amount of incoming flow is equal to the amount of outgoing flow. Inequality (9) is the condition of feasibility, which accounts for wireless interference and represents that the total usage of the links in an interference set should not exceed 1. The objective of equation (1) is to maximize the network throughput.

It is shown below that rate allocation with the objective to maximize the network throughput may result in a severe bias among STAs, i.e., some STAs are allocated very high rates, while others are starved. In wireless muni-mesh networks, it is important to fairly allocate resources among STAs because users generally pay the same flat rate to get Internet access service. Next, the fairness issue is addressed based on a max-min fairness model. The LP formulations are presented to maximize the minimum rate allocated to the STAs and then to maximize the throughput with the max-min rate guaranteed. This problem is called Max-Min Rate Allocation (MMRA) problem and is formulated in two steps.

$\begin{array}{cc}\mathrm{Step}1\text{:}& \\ r^{*}=\max r_{min}\mathrm{Subject}\mathrm{to}\text{:}\mathrm{Constaints}\left(2\right)-\left(9\right)& \left(11\right)\\ \sum _{j:\left(i,j\right)\in E}r_{\mathrm{ij}}\ge r_{min}\forall i\in V_s& \left(12\right)\\ r\ge 0,R\ge 0,f\ge 0,r_{min}\ge 0& \left(13\right)\\ \mathrm{Step}2\text{:}& \\ \hat{S}=\max \sum _{i=1}^N\sum _{j=1}^Mr_{\mathrm{ij}}\mathrm{Subject}\mathrm{to}\mathrm{Constraints}\left(2\right)-\left(9\right)& \left(14\right)\\ \sum _{j:\left(i,j\right)\in E}r_{\mathrm{ij}}\ge r^{*}\forall i\in V_sr\ge 0,R\ge 0,f\ge 0& \left(15\right)\end{array}$

In step 1, the minimum rate (r_min) allocated to the STAs is maximized. Since a STA can associate with multiple MAPs, the total rate allocated to a STA, for example STA i, is r_i=Σ_{j:(i, j)εE}r_ij, where j is a MAP with which STA i associates. The first eight conditions, equations and inequalities (2)-(9), are the same as in the maximum throughput rate allocation problem. Inequality (12) states that the rate allocated to any STA should be no less than r_min. By solving this LP problem, it is ensured that for any other rate allocation vector {r′_ij}, the minimum rate allocated is min{r′_i}≦r*. The resulting rate allocation from step 1 ensures the maximum minimum rate allocation value, however, it may not efficiently use the network resources.

In step 2, the network throughput is maximized while making sure that each STA is allocated a rate of at least r*. Therefore, solving step 1 to obtain r* and then solving step 2 can provide maximum throughput while ensuring max-min fairness.

So far, fractional association and multi-path routing have been considered. In fractional association and multi-path routing a STA can associate with multiple MAPs and the traffic from a source may be routed to the gateway via multiple paths. Many existing association schemes are confined to integral association, where a STA associates with only one MAP. Many current routing protocols are restricted to single-path routing. It is, therefore, useful to derive the performance bounds for integral association and single-path routing. The method by which integral association and single-path routing are introduced is by adding two sets of 0-1 variables, a_ijε{0,1} and u_j,eε{0,1} where a_ij indicates whether or not STA i associates with MAP j, while u indicates whether or not the link e is used by a flow belonging to f_j. The problem formulations described above can be extended for integral association and single-path routing by replacing r_ij with a_ijr_ij and R_j,e with u_j,eR_j,e, and adding the following two conditions:

1. At each STA i, Σ_{j:(i, j)εE}a_ij=1, where a_ijε{0,1}

2. For any f_j, at any MAP a, Σ_e:h(e)=au_j,e≦1, where u_j,eε{0,1}

The first condition states that a STA can associate with only one MAP. The basic idea of the second condition is that in a single-path routing, at any MAP a, there is at most one outgoing link that carries flow j. This problem formulation falls into mixed integer non-linear programming. In theory, solving such a problem is NP-hard.

To avoid solving a NP-hard problem under integral association and single-path routing, a method to decouple the problems of association, routing and rate allocation is described. Heuristic association and routing algorithms are presented to construct the logical topology used for communications, and then perform rate allocation within this logical topology. This scheme is practical but gives sub-optimal solutions.

The airtime cost specified in IEEE 802.11s is used as the routing metric. Airtime cost reflects the amount of channel resources consumed by transmitting a frame over a particular link. The airtime cost for a link is calculated as

$C_a=\left(O+\frac{S}{r}\right)\frac{1}{1-E}$

where O is the channel access overhead, including frame headers, training sequences, access protocol overhead, and S is the standard test frame length. Some representative values in IEEE 802.11b networks for these constants are: O=699 μs, and S=1024 bytes. r and E are the link data rate and the frame error rate for the test frame size S under the current channel conditions, respectively. These values can be estimated locally. The cost of a path is simply the summation of the airtime cost of the links on the path.

The routing protocol used in the backhaul is the Hybrid Wireless Mesh Protocol (HWMP) specified in the IEEE 802.11s standard. The HWMP defines a proactive routing mode and an on-demand routing mode. The proactive mode permits proactively establishing a route for communications with certain critical mesh nodes such as a gateway. With proactive routing, the data forwarding between the MAPs and the gateway can begin immediately without route discovery delay and extra data buffering. The on-demand routing mode is based on the enhanced Ad Hoc On Demand Distance Vector (AODV) protocol [IETF RFC 3561] and any mesh node may initiate an on-demand route discovery through route request/route reply procedure. The on-demand mode is for peer MAP-to-peer MAP communications. Focus herein is on proactive routing for communications between MAPs and gateway.

In the proactive routing mode, the gateway periodically advertises itself by broadcasting a root/route announcement messages that contains a path cost field and a sequence number. The value of the path cost is initialized to zero at the gateway and updated at intermediate MAPs during the propagation of the root/route announcement message. The sequence number is incremented each time a root/route announcement is sent by the gateway. Upon receiving a root/route announcement, a MAP updates the cost of the incoming path by adding the cost of the incoming link to the path cost carried in the root/route announcement. If the sequence number in the received message is larger than what has been seen up to this point in time or if the sequence number is the same but the path cost is better than the current value, the MAP updates its path to the gateway and rebroadcasts the root/route announcement. The topology builds away from the gateway as this process repeats until all the MAPs in the backhaul receive the root/route announcement message. In this way, a path is proactively established and maintained between each MAP and the gateway. The established paths form a tree rooted at the gateway. Note that other routing metrics and routing protocol can be used in the backhaul to establish the path between the MAPs and gateway. Note also that the reverse paths are established by the nodes of the tree replying to the announcement message.

In an earlier application (PCT/US ______), an end-to-end performance aware association mechanism was taught. The association metric, called JSEL, was defined as:

JSEL=βQ_a1+(1−β)C_bp  (16)

where Q_a1 was the access link metric that reflected the quality of the access link between the STA and the MAP. For a MAP j and a joining STA i,

$\begin{array}{cc}{Q}_{\mathrm{al}}\left(i,j\right)=\frac{1}{1-E_i}\sum _{n\in A\left(j\right)\bigcup i}\frac{S}{r_n}& \left(16a\right)\end{array}$

where A(j) denotes the set of STAs that currently associate with MAP j. S is the test frame size (e.g, 1024 bytes) and r_n is the link data rate between STA n and MAP j. E₁ denotes the packet loss rate on the link between STA i and MAP j if i transmits frames of size S at the data rate r_i. C_bp is the cumulative cost of the backhaul path from the MAP to the gateway. It is carried in the MAP beacon and probe response frames, which makes such information available to the STAs. βε[0,1] is a tunable parameter, which is used to balance the access link quality and backhaul path quality in equation (16).

Association and backhaul routing define a logical topology for communications in the network, i.e., indicating which links are actually used for carrying traffic. The next problem is to perform rate allocation within this logical communication topology to maximize the throughput or maximize the throughput with guaranteed max-min rate. The two formulated problems are denoted as MTRA-Suboptimal and MMRA-Suboptimal, respectively.

Given the logical communication topology, i.e., associations of STAs with MAPs and backhaul paths between each MAP and the gateway are known, the optimization variables are the rates allocated to the STAs. An N-element vector r=[r₁, r₂, . . . , r_N] is used to denote the rate allocation vector for the STAs, where r_i is the rate allocated to STA i. A(j) denotes the set of STAs that associate with MAP j, and use P(j) is used to denote the backhaul path between MAP j and the gateway. MAP j's data/traffic, denoted as is the total traffic aggregated from all j's associated STAs. The capacity of STA i's access link is denoted as C_i, and for a link e in the backhaul, C_e denotes link e's capacity. In the following, the problem formulation for maximizing the throughput with guaranteed max-min rate value is shown. The MMRA problem includes two steps.

$\begin{array}{cc}\mathrm{Step}1\text{:}& \\ r^{*}=\max r_{min}\mathrm{Subject}\mathrm{to}\text{:}& \left(17\right)\\ r_i\le C_i,\forall i\in V_s& \left(18\right)\\ \sum _{i:i\in A\left(j\right)}\frac{r_i}{C_i}\le 1,\forall j\in V_a& \left(19\right)\\ \sum _{i:i\in A\left(j\right)}r_i=f_j,\forall j\in V_a& \left(20\right)\\ \sum _{e\bigcup I_e}\sum _{j:e\in p\left(j\right)}\frac{f_j}{C_e}\ge 1\forall e\in E& \left(21\right)\\ r_i\ge r_{min},\forall i\in V_s& \left(22\right)\\ r\ge 0,R\ge 0,r_{min}\ge 0& \left(23\right)\\ \mathrm{Step}2\text{:}& \\ \hat{S}=\max \sum _{i=1}^Nr_i\mathrm{Subject}\mathrm{to}& \left(24\right)\\ r_i\le C_i,\forall i\in V_s& \left(25\right)\\ \sum _{i:i\in A\left(j\right)}\frac{r_i}{C_i}\le 1,\forall j\in V_a& \left(26\right)\\ \sum _{i:i\in A\left(j\right)}r_i=f_j,\forall j\in V_a& \left(27\right)\\ \sum _{e\bigcup I_e}\sum _{j:e\in P\left(j\right)}\frac{f_j}{C_e}\le 1\forall e\in E& \left(28\right)\\ r_i\ge r^{*},\forall i\in V_s& \left(29\right)\\ r\ge 0,f\ge 0,& \left(30\right)\end{array}$

The objective of equation (17) is to maximize the minimum rate allocated to STAs. Inequalities (18) and (25) indicate that the rate allocated to a STA cannot exceed the access link capacity. Inequalities (19) and (26) mean that the total traffic imposed on MAP j by its associated STAs should require no more receiving time than MAP j actually has. Equations (20) and (27) state that a MAP's traffic is the total traffic aggregated from its associated STAs. Inequalities (21) and (28) are the condition of feasibility, which accounts for wireless interference. They state that the usage of the links in an interference set should not exceed 1. Inequality (22) requires that the rate allocated to any STA should be no less than r_min. After solving r*, in step 2 the throughput is maximized while making sure that each STA is allocated a rate of at least r* as indicated in equation (24). Inequality (29) indicates that the rate allocated to any STA should be no less than r*. Inequalities (23) and (30) state that the allocated rate should be equal to or greater than 0.

The present invention is based on a centralized method to achieve joint optimization of association, routing and rate allocation in two-tiered muni-mesh networks based on a max-min fairness model. An objective is to improve the throughput without sacrificing fairness, i.e. maximizing the network throughput with guaranteed max-min rate allocation. In practice, it is difficult, if not impossible, to provide short-term throughput and fairness optimization because of the dynamics of network topology, link status and traffic. The method described herein achieves long-term max-min fairness to all the STAs. It can be used as the foundation in the design of a muni-mesh network control system for addressing the fairness issue that also maximizes the network throughput.

In terms of implementation, the system and method of the present invention first need information on the mesh backhaul network such as physical mesh topology, link data rate, link's interference set, as well as information on each STA such as the access link data rate that the STA experiences to/from each MAP. Second, the system and method of the present invention need a means to determine the logical two-tier logical communication topology including backhaul routing and STA-MAP association, and fair bandwidth allocation to each STA. Third, the system and method of the present invention need a mechanism to enforce these routing, association and rate allocation decisions. Note that if the wireless link is symmetric, the total bandwidth of upstream and downstream traffic for a STA can be allocated using the algorithm described above. Based on the traffic pattern, the total bandwidth is divided into the upstream and downstream flows.

FIG. 3 is a flowchart of an exemplary embodiment of the method of the present invention in the gateway where the mesh network has a centralized controller and the mesh network uses a centralized Medium Access Control (MAC) protocol such as IEEE 802.16j (multi-hop relay protocol). If the mesh network uses a centralized MAC protocol such as IEEE 802.16j multi-hop for relay networks, each MAP and STA periodically conducts local measurements and estimations of the necessary information such as its link data rate and channel conditions. The collected information is reported to the gateway, which executes the method of the present invention to determine the optimal STA-MAP association, backhaul routing, and bandwidth allocation to each STA (FIG. 3). The gateway can update its decisions periodically based on the collected information and any new information that is collected. After determining the routing and STA-MAP association, the gateway informs the MAPs and STAs of its decision.

Still referring to FIG. 3, the gateway collects network information from the MAPS and STAs at 305. The gateway then determines at 310 the optimal STA-MAP association backhaul routing and bandwidth allocation using the method of the present invention. The method can either achieve maximum throughput rate allocation as described in equations (1) to (10) or max-min rate allocation as described in equations (11) to (15). At 315 the gateway then notifies the MAPs and STAs of the MAP-STA association and backhaul routing that the gateway has determined. The gateway performs the bandwidth allocation via the centralized MAC protocol. The gateway then instructs the centralized MAC protocol to schedule transmissions based on the determined bandwidth allocation at 320. The gateway then performs a test at 325 to determine if it receives new information and needs to update any decisions it has made based on receiving new information from the MAPs and the STAs.

The MAPs (FIG. 4) and STAs (FIG. 5) perform routing and association process accordingly. Since a centralized MAC protocol is used, the gateway can enforce the STA's bandwidth allocation by scheduling the transmission.

FIG. 4 is a flowchart of an exemplary embodiment of the method of the present invention for a MAP, the system having a centralized controller and using a centralized MAC protocol. At 405 the MAP measures the link quality and channel conditions. The MAP reports (transmits/forwards) the measured link quality and channel conditions to the gateway at 410. A test is performed at 415 to determine if the MAP has received a backhaul routing decision/instructions from the central controller (resident in the gateway). If the MAP has received a backhaul routing decision from the central controller then the MAP updates routing and data forwarding/transmitting instructions/policy previously stored in the MAP and forwards the updated routing and data forwarding/transmitting instructions to the STAs associated with the MAP according to the instructions/decision received at 420. Based on the association decision, the controller (via the MAP) informs of a STA which MAP the STA needs to associate with and whether a STA currently associated with this MAP needs to change its association to another MAP. A test is performed at 425 to determine if the MAP is to continue. If the MAP is to continue, then the method proceeds to 405. If the MAP is not to continue then the MAP ceases its operation of measuring link quality and channel conditions. If the MAP has not received a backhaul routing decision/instructions from the central controller then the method proceeds to 425.

FIG. 5 is a flowchart of an exemplary embodiment of the method of the present invention for a STA, the system having a centralized controller and using a centralized MAC protocol. At 505 the STA measures the link quality and channel conditions. The STA reports (transmits/forwards) the measured link quality and channel conditions to the gateway at 510 (via the MAP). A test is performed at 515 to determine if the STA has received an association decision/instructions from the central controller (resident in the gateway) via the MAP with which the STA is associated. If the STA has received association instructions from the central controller (via the associated MAP) then the STA updates its association information according to the instructions/decision received at 520. A test is performed at 525 to determine if the STA is to continue. If the STA is to continue, then the method proceeds to 505. If the STA is not to continue then the STA ceases its operation of measuring link quality and channel conditions. If the STA has not received an association decision/instructions from the central controller at 515 then the method proceeds to 525.

If the mesh network uses a distributed MAC protocol such as IEEE 802.11 Distributed Coordination Function, the STAs and MAPs can be equipped with a module (software, hardware or firmware or any combination thereof) that periodically collects the information required by the method of the present invention. The collected information is reported to a central controller. The central controller makes or periodically updates its decisions of the optimal STA-MAP association, backhaul routing, and bandwidth allocation to each STA using the method of the present invention (FIG. 6). The method can either achieve maximum throughput rate allocation as described in equations (1) to (10) or max-min rate allocation as described in equations (11) to (15). The central controller notifies the STAs and MAPs of its decision. The STAs (FIG. 7) and MAPs (FIG. 8) perform the corresponding association and routing process according to the central controller's instructions. Since a distributed MAC protocol is used, a STA can be equipped with a module (software, hardware or firmware or any combination thereof) that regulates its upstream traffic into the network and the gateway can regulate the downstream traffic for the STA. The central controller may recalculate and update the optimal routing, association and bandwidth allocation over a relative long interval by using the maximum throughput rate allocation algorithm described in equations (1) to (10) or the max-min fairness rate allocation algorithm described in equations (11) to (15). Between two successive executions, it can only update the bandwidth allocation within the determined logical topology based on the rate allocation algorithm described in equations (17) to (30). In addition, if the distributed routing and association method is used for constructing the logical two-tier communication topology, the central controller only performs the bandwidth allocation within the determined logical topology using equations (17) to (30). After determining a new bandwidth allocation, the central controller informs the'STA of its decision. The STA updates its bandwidth allocation parameters.

FIG. 6 is a flowchart of an exemplary embodiment of the method of the present invention for a centralized controller using a distributed MAC protocol. The gateway collects network information from the MAPS and STAs at 605. The gateway then determines at 610 the optimal STA-MAP association backhaul routing and bandwidth allocation using the method of the present invention. The method can either achieve maximum throughput rate allocation as described by equations (1) to (10) or max-min rate allocation as described by equations (11) to (15). At 615 the gateway then notifies the MAPs and STAs of the MAP-STA association and backhaul routing that the gateway has determined. The gateway also notifies the STAs (via their associated MAPs) of their bandwidth allocation at 620. The gateway then performs a test at 625 to determine if it receives new information from the MAPs and the STAs and needs to update any decisions it has made based on receiving new information from the MAPs and the STAs.

FIG. 7 is a flowchart of an exemplary embodiment of the method of the present invention for a MAP, the system having a centralized controller and using a distributed MAC protocol. At 705 the MAP measures the link quality and channel conditions. The MAP reports (transmits/forwards) the measured link quality and channel conditions to the gateway at 710 (via the MAP). A test is performed at 715 to determine if the MAP has received a backhaul routing decision/instructions from the central controller (resident in the gateway). If the MAP has received a backhaul routing decision from the central controller then the MAP updates routing and data forwarding/transmitting instructions/policy previously stored in the MAP and forwards the updated routing and data forwarding/transmitting instructions according to the instructions/decision received at 720. A test is performed at 725 to determine if the MAP is to continue. If the MAP is to continue, then the method proceeds to 705. If the MAP is not to continue then the MAP ceases its operation of measuring link quality and channel conditions. If the MAP has not received a backhaul routing decision/instructions from the central controller then the method proceeds to 725.

FIG. 8 is a flowchart of an exemplary embodiment of the method of the present invention for a STA, the system having a centralized controller and using a distributed MAC protocol. At 805 the STA measures the link quality and channel conditions. The STA reports (transmits/forwards) the measured link quality and channel conditions to the gateway at 810. A test is performed at 815 to determine if the STA has received association decision/instructions from the central controller (resident in the gateway). If the STA has received association instructions from the central controller then the STA updates the associations. A test is performed at 825 to determine if the STA has received bandwidth allocation decisions/instructions from the centralized controller. If the STA has received bandwidth allocation instructions from the centralized controller then the STA updates the rate control policy according to the instructions received at 830. A test is performed at 835 to determine if the STA is to continue. If the STA is to continue, then the method proceeds to 805. If the STA is not to continue then the STA ceases operation of measuring link quality and channel conditions. If the MAP has not received a bandwidth allocation instructions from the centralized controller then the method proceeds to 835. If the MAP has not received association instructions/decisions form the centralized controller (815) then the method proceeds to 825.

FIG. 9 is a block diagram of an exemplary embodiment of a gateway in accordance with the principles of the present invention. The gateway has a radio interface 905, which may be a single radio interface with multiple logical interfaces or may be multiple radio interfaces in order to communicate with the MAPs directly and with the STAs via their associated MAPs. Radio interface 905 is also used to communicate with the Internet or any other wired line network via wired communication interface 910. Radio interface 905 also communicates with network information collection module 915, which can include one or more databases, storage devices or memory in order to store the link quality and channel condition information from the MAPs and STAs that the gateway receives from the MAPs and STAs. The network information collection module 915 also communicates with decision making module 920, which makes decisions regarding backhaul routing, associations and bandwidth allocations based on the information collected and stored in network information collection module 915. Decision making module also communicates with radio communication interface module 905 in order to transmit the decisions it makes to the MAPs and STAs (via their associated MAPs). Decision making module 920 also communicates with data rate control module and MAC protocol module 925. Data rate control and MAC module 925 is also in communications with radio communication interface module 905 in order to control the amount of data traffic for each STA.

FIG. 10 is a block diagram of an exemplary embodiment of a MAP in accordance with the principles of the present invention. The MAP includes a backhaul radio communication interface module 1005, which is used to communicate with other MAPs in the relay layer as well as to communicate with the gateway. Backhaul radio communication interface module also communicates with the STA-MAP communication interface module 1010 to forward data or control packets from backhaul to the STAs, or vice versa. Backhaul radio communication interface module also communicates with routing and data forwarding control module 1015, message process module 1020 and link measurement module 1025. Routing and data forwarding control module 1015 also communicates with message process module 1020. Message process module also communicates with both backhaul radio communication interface module 1005 and STA-MAP radio communication interface module 1010. Message process module processes messages received from or destined for the STAs as well as messages received from or destined for other MAPs in the relay layer as well messages received from or destined for the gateway. Message process module 1020 also communicates with link measurement module 1025, which receives and stores link quality measurement and channel condition information from the STAs with which this MAP is associated as well as making link quality and channel condition measurements for this MAP. Link quality measurement module also communicates with backhaul radio communication interface module 1005 in order to forward/transmit the link quality and channel conditions to other MAPs in the relay layer as well as to communicate the link quality and channel condition information to the gateway. Link measurement module 1025 also communicates with STA-MAP radio communication interface module 1010 in order to receive link quality and channel condition information from its associated STAs.

FIG. 11 is a block diagram of an exemplary embodiment of a STA in accordance with the principles of the present invention. The STA includes STA-MAP radio communication interface module 1105, which communicates with association control module 1110, message process module 1115, rate control module 1120 and link measurement module 1125. STA-MAP radio communication interface module 1105 provides the radio communication interface to communicate with the MAPs with which this STA is associated. A STA has only one physical radio interface but may have multiple logical radio interfaces. That is, a STA can be associated with multiple MAPs and if so, communicates with them using a time division multiplexing scheme. Association control module 1110 receives the association instructions from the gateway (via the MAPs with which this STA is associated) and stores the association information as well as forming and establishing those connections via messages exchanged between itself and its associated MAPs. The messages are exchanged via the STA-MAP radio communication interface module 1105. Association control module 1110 also communicates with message process module 1115, which processes messages received from or destined for the MAPs associated with this STA as well as messages received from or destined for the gateway. Message process module 1115 also communicates with rate control module 1120. Rate control module 1120 receives the rate control instructions from the gateway (via the MAPs with which this STA is associated) and stores the rate control information as well as operating in accordance with the rate control instructions. The STA also has link measurement module 1125 that is in communication with message process module 1115 and that measures link quality and channel conditions in order to provide that information to the gateway via its associated MAPs.

It is to be understood that the present invention may be implemented in various forms of hardware (e.g. ASIC chip), software, firmware, special purpose processors, or a combination thereof, for example, within a server, an intermediate device (such as a wireless access point or a wireless router) or mobile device. Preferably, the present invention is implemented as a combination of hardware and software. Moreover, the software is preferably implemented as an application program tangibly embodied on a program storage device. The application program may be uploaded to, and executed by, a machine comprising any suitable architecture. Preferably, the machine is implemented on a computer platform having hardware such as one or more central processing units (CPU), a random access memory (RAM), and input/output (I/O) interface(s). The computer platform also includes an operating system and microinstruction code. The various processes and functions described herein may either be part of the microinstruction code or part of the application program (or a combination thereof), which is executed via the operating system. In addition, various other peripheral devices may be connected to the computer platform such as an additional data storage device and a printing device.

It is to be further understood that, because some of the constituent system components and method steps depicted in the accompanying figures are preferably implemented in software, the actual connections between the system components (or the process steps) may differ depending upon the manner in which the present invention is programmed. Given the teachings herein, one of ordinary skill in the related art will be able to contemplate these and similar implementations or configurations of the present invention.

Claims

1. A method, said method comprising:

collecting network information;

determining routing, an association and bandwidth allocation based on said collected network information;

notifying a mesh access point of said association, said bandwidth allocation and said routing scheme;

notifying a client node of said association wherein said association is a mechanism by which said client node becomes affiliated with said mesh access point; and

notifying said client node of said bandwidth allocation for said client node.

2. The method according to claim 1, further comprising scheduling a data transmission based on said bandwidth allocation.

3. (canceled)

4. The method according to claim 1, wherein said collecting act is accomplished via one of a centralized medium access control protocol and a distributed medium access control protocol and wherein said method is performed by a centralized controller resident in a gateway.

5. (canceled)

6. (canceled)

7. The method according to claim 1, wherein said determining act further comprises determining one of a maximum throughput bandwidth rate allocation and a maximum minimum bandwidth rate allocation.

8. (canceled)

9. The method according to claim 2, wherein said scheduling act is accomplished via a centralized medium access control protocol.

10. The method according to claim 1, further comprising receiving updated network information.

11. An apparatus comprising:

means for collecting network information;

means for determining routing, an association and bandwidth allocation based on said collected network information;

means for notifying a mesh access point of said association, said bandwidth allocation and said routing scheme; and

means for notifying a client node of said association, wherein said association is a mechanism by which said client node becomes affiliated with said mesh access point; and

means for notifying said client node of said bandwidth allocation for said client node.

12. The apparatus according to claim 11, further comprising means for scheduling a data transmission based on said bandwidth allocation.

13. (canceled)

14. The apparatus according to claim 11, wherein said means for collecting is accomplished using one of a centralized medium access control protocol and a distributed medium access control protocol and wherein apparatus is a centralized controller resident in a gateway.

15. (canceled)

16. (canceled)

17. The apparatus according to claim 11, wherein said means for determining further comprises one of means for determining a maximum throughput bandwidth rate allocation and a maximum minimum bandwidth rate allocation.

18. (canceled)

19. The apparatus according to claim 12, wherein said means for scheduling is accomplished using a centralized medium access control protocol.

20. The apparatus according to claim 11, further comprising means for receiving updated network information.

21. A method, said method comprising:

measuring link quality and channel conditions;

reporting results of said measuring act to a controller;

receiving a routing decision and data forwarding instructions from said controller; and

forwarding said routing decision and said data forwarding instructions to a client node.

22. The method according to claim 21, wherein said routing decision is a backhaul routing decision.

23. The method according to claim 21, wherein said method is performed by a mesh access point.

24. An apparatus comprising:

means for measuring link quality and channel conditions;

means for reporting results of said measuring act to a controller;

means for receiving a routing decision and data forwarding instructions from said controller; and

means for forwarding said routing decision and said data forwarding instructions to a client node.

25. The apparatus according to claim 24, wherein said routing decision is a backhaul routing decision.

26. The apparatus according to claim 24, wherein said apparatus is a mesh access point.

27. A method, said method comprising:

measuring link quality and channel conditions;

reporting results of said measuring act to a controller;

receiving association instructions from said controller; and

updating previously stored association instructions based on said received association instructions, wherein association instructions permit an association to be made between a client node and a mesh access point.

28. The method according to claim 27, further comprising:

receiving bandwidth allocation instructions from said controller; and

updating said bandwidth allocation instructions.

29. The method according to claim 27, wherein said reporting act is accomplished via a mesh access point.

30. The method according to claim 27, wherein said receiving act is accomplished via a mesh access point.

31. The method according to claim 27, wherein said method is accomplished by a client node.

32. An apparatus comprising:

means for measuring link quality and channel conditions;

means for reporting results of said measuring act to a controller;

means for receiving association instructions from said controller; and

means for updating previously stored association instructions based on said received association instructions, wherein association instructions permit an association to be made between a client node and a mesh access point.

33. The apparatus according to claim 32, further comprising:

means for receiving bandwidth allocation instructions from said controller; and

means for updating said bandwidth allocation instructions.

34. The apparatus according to claim 32, wherein said means for reporting is accomplished via a mesh access point.

35. The apparatus according to claim 32, wherein said means for receiving is accomplished via a mesh access point.

36. The apparatus according to claim 32, wherein said apparatus is a client node.