Patent Description:
Modern access nodes of cellular communication systems are provided with antenna arrays and signal processing capabilities for operating cells via various radio beam configurations. An access node may generate radio beams with various characteristics in terms of beam direction and width from a site of the access node. Multiple beams may be operational concurrently. Different sets of radio beam configurations may provide different performance characteristics, depending on spatial distribution of terminal devices in a cell, their traffic demands, interference from neighbour cells, etc. Therefore, there may be a need to update the set of radio beam configurations at times.

<CIT> discloses that beam patterns may be associated with mobile terminals and assigned slot by slot. In other words, a beam pattern associated with a mobile terminal may be assigned to a slot, providing a stream to the mobile terminal.

<CIT> discusses how to apply beam forming control between base stations in accordance with varying traffic.

Some aspects of the invention are defined by the independent claims.

Some embodiments of the invention are defined in the dependent claims.

Some aspects of the disclosure are defined by the independent claims.

According to an aspect, there is provided an apparatus for allocating N radio beam configurations to access nodes, comprising means for performing the following: storing, in the at least one memory, a beam library defining a set of radio beam configurations for a coverage area of a plurality of cells managed by the access nodes; dividing the coverage area into sub-areas; collecting a set of channel quality metrics where each channel quality metric indicates, in one of the sub-areas, channel quality for a radio beam configuration of the beam library; collecting a traffic density parameter for each sub-area, the traffic density parameter indicating an amount of data traffic in the sub-area; performing the following steps a) to d) for a plurality of different sets of N radio beam configurations:.

In an embodiment, the means are configured to perform the steps a) to d) for at least a majority of possible combinations of N radio beam configurations in the beam library.

In an embodiment, the means are configured to determine a fairness parameter defining a target between a maximum throughput and a maximum coverage for the set of N radio beam configurations, to compute the service performance for the selected N radio beam configurations in step c) by using the fairness parameter, and to select the set of N radio beam configurations on the basis of the computed service performances.

In an embodiment, said N radio beam configurations comprise a determined number of radio beam configurations per cell, and wherein the means are configured to perform steps a) by using a Monte-Carlo tree search algorithm using a selection tree formed of the radio beam configurations in the beam library and comprising the following steps:.

In an embodiment, the means are configured to perform in step b) at least the following:.

In an embodiment, the means are configured to perform steps a) to d) during operation of the access nodes, to detect an event in the operation that requires modification of the radio beam configurations currently applied by the access nodes, to interrupt, in response to the detection, said performing the steps a) to d) and to select the set of N radio beam configurations on the basis of the available stored service performances.

According to an aspect, there is provided a computer-implemented method for allocating N radio beam configurations to access nodes, comprising: storing, in at least one memory, a beam library defining a set of radio beam configurations for a coverage area of a plurality of cells managed by the access nodes; dividing the coverage area into sub-areas; collecting a set of channel quality metrics where each channel quality metric indicates, in one of the sub-areas, channel quality for a radio beam configuration of the beam library; collecting a traffic density parameter for each sub-area, the traffic density parameter indicating an amount of data traffic in the sub-area; performing the following steps a) to d) for a plurality of different sets of N radio beam configurations:.

In an embodiment, the steps a) to d) are performed for at least a majority of possible combinations of N radio beam configurations in the beam library.

In an embodiment, at least some of the radio beam configurations are used in the plurality of different sets of N radio beam configurations, the method comprising storing in step d) the service performance for each use of the at least some of the radio beam configurations separately, thereby storing multiple service performance values for each of the at least some of the radio beam configurations, and using the stored multiple service performance values in subsequently performed steps a).

In an embodiment, a probability of selecting in step a) a radio beam configuration that has a greater service performance, in terms of the stored service performance values, is greater than a probability of selecting a radio beam configuration that has a smaller service performance in terms of the stored service performance values.

In an embodiment, the method further comprises determining a fairness parameter defining a target between a maximum throughput and a maximum coverage for the set of N radio beam configurations, computing the service performance for the selected N radio beam configurations in step c) by using the fairness parameter, and selecting the set of N radio beam configurations on the basis of the computed service performances.

In an embodiment, said N radio beam configurations comprise a determined number of radio beam configurations per cell, and wherein the steps a) are performed by using a Monte-Carlo tree search algorithm using a selection tree formed of the radio beam configurations in the beam library and comprising the following steps:.

In an embodiment, the method further comprises in step b) at least the following:.

In an embodiment, steps a) to d) are performed during operation of the access nodes, and wherein upon detecting an event in the operation that requires modification of the radio beam configurations currently applied by the access nodes, said performing the steps a) to d) is interrupted and the set of N radio beam configurations is selected on the basis of the available stored service performances.

According to an aspect, there is provided a computer program product comprising a computer program code readable by a computer, wherein the computer program code configures the computer to carry out a computer process for allocating N radio beam configurations to access nodes, the computer process comprising: storing, in at least one memory, a beam library defining a set of radio beam configurations for a coverage area of a plurality of cells managed by the access nodes; dividing the coverage area into sub-areas; collecting a set of channel quality metrics where each channel quality metric indicates, in one of the sub-areas, channel quality for a radio beam configuration of the beam library; collecting a traffic density parameter for each sub-area, the traffic density parameter indicating an amount of data traffic in the sub-area; performing the following steps a) to d) for a plurality of different sets of N radio beam configurations:.

Embodiments are described below, by way of example only, with reference to the accompanying drawings, in which.

The following embodiments are examples.

In the following, different exemplifying embodiments will be described using, as an example of an access architecture to which the embodiments may be applied, a radio access architecture based on long term evolution advanced (LTE Advanced, LTE-A) or new radio (NR, <NUM>), without restricting the embodiments to such an architecture, however. A person skilled in the art will realize that the embodiments may also be applied to other kinds of communications networks having suitable means by adjusting parameters and procedures appropriately. Some examples of other options for suitable systems are the universal mobile telecommunications system (UMTS) radio access network (UTRAN or E-UTRAN), long term evolution (LTE, the same as E-UTRA), wireless local area network (WLAN or WiFi), worldwide interoperability for microwave access (WiMAX), Bluetooth®, personal communications services (PCS), ZigBee®, wideband code division multiple access (WCDMA), systems using ultra-wideband (UWB) technology, sensor networks, mobile ad-hoc networks (MANETs) and Internet Protocol multimedia subsystems (IMS) or any combination thereof.

<FIG> shows terminal devices or user devices <NUM> and <NUM> configured to be in a wireless connection on one or more communication channels in a cell with an access node (such as (e/g)NodeB) <NUM> providing the cell. (e/g)NodeB refers to an eNodeB or a gNodeB, as defined in 3GPP specifications. The physical link from a user device to a (e/g)NodeB is called uplink or reverse link and the physical link from the (e/g)NodeB to the user device is called downlink or forward link. It should be appreciated that (e/g)NodeBs or their functionalities may be implemented by using any node, host, server or access point etc. entity suitable for such a usage.

A communications system typically comprises more than one (e/g)NodeB in which case the (e/g)NodeBs may also be configured to communicate with one another over links, wired or wireless, designed for the purpose. These links may be used not only for signalling purposes but also for routing data from one (e/g)NodeB to another. The (e/g)NodeB is a computing device configured to control the radio resources of communication system it is coupled to. The NodeB may also be referred to as a base station, an access point, an access node, or any other type of interfacing device including a relay station capable of operating in a wireless environment. The (e/g)NodeB includes or is coupled to transceivers. From the transceivers of the (e/g)NodeB, a connection is provided to an antenna unit that establishes bi-directional radio links to user devices. The antenna unit may comprise a plurality of antennas or antenna elements. The (e/g)NodeB is further connected to core network <NUM> (CN or next generation core NGC). Depending on the system, the counterpart on the CN side can be a serving gateway (S-GW, routing and forwarding user data packets), packet data network gateway (P-GW), for providing connectivity of user devices (UEs) to external packet data networks, or mobility management entity (MME), etc..

<NUM> specifications define two relay modes: out-of-band relay where same or different carriers may be defined for an access link and a backhaul link; and in-band-relay where the same carrier frequency or radio resources are used for both access and backhaul links. In-band relay may be seen as a baseline relay scenario. A relay node is called an integrated access and backhaul (IAB) node. It has also inbuilt support for multiple relay hops. IAB operation assumes a so-called split architecture having CU and a number of DUs. An IAB node contains two separate functionalities: DU (Distributed Unit) part of the IAB node facilitates the gNB (access node) functionalities in a relay cell, i.e. it serves as the access link; and a mobile termination (MT) part of the IAB node that facilitates the backhaul connection. A Donor node (DU part) communicates with the MT part of the IAB node, and it has a wired connection to the CU which again has a connection to the core network. In the multihop scenario, MT part (a child IAB node) communicates with a DU part of the parent IAB node.

<NUM> enables using multiple input - multiple output (MIMO) antennas, many more base stations or nodes than the LTE (a so-called small cell concept), including macro sites operating in co-operation with smaller stations and employing a variety of radio technologies depending on service needs, use cases and/or spectrum available. <NUM> mobile communications supports a wide range of use cases and related applications including video streaming, augmented reality, different ways of data sharing and various forms of machine type applications (such as (massive) machine-type communications (mMTC), including vehicular safety, different sensors and real-time control. <NUM> is expected to have multiple radio interfaces, namely below <NUM>, cmWave and mmWave, and also being capable of being integrated with existing legacy radio access technologies, such as the LTE. Integration with the LTE may be implemented, at least in the early phase, as a system, where macro coverage is provided by the LTE and <NUM> radio interface access comes from small cells by aggregation to the LTE. In other words, <NUM> is planned to support both inter-RAT operability (such as LTE-<NUM>) and inter-RI operability (inter-radio interface operability, such as below <NUM> - cmWave, below <NUM> - cmWave - mmWave). One of the concepts considered to be used in <NUM> networks is network slicing in which multiple independent and dedicated virtual sub-networks (network instances) may be created within the same infrastructure to run services that have different requirements on latency, reliability, throughput and mobility.

The current architecture in LTE networks is fully distributed in the radio and typically fully centralized in the core network. The low-latency applications and services in <NUM> require to bring the content close to the radio which leads to local break out and multi-access edge computing (MEC).

The communication system is also able to communicate with other networks <NUM>, such as a public switched telephone network or the Internet, or utilize services provided by them.

It should also be understood that the distribution of functions between core network operations and base station operations may differ from that of the LTE or even be non-existent. <NUM> (or new radio, NR) networks are being designed to support multiple hierarchies, where MEC servers can be placed between the core and the base station or node B (gNB).

Possible use cases are providing service continuity for machine-to-machine (M2M) or Internet of Things (IoT) devices or for passengers on board of vehicles, or ensuring service availability for critical communications, and future railway, maritime, and/or aeronautical communications. Satellite communication may utilize geostationary earth orbit (GEO) satellite systems, but also low earth orbit (LEO) satellite systems, in particular mega-constellations (systems in which hundreds of (nano)satellites are deployed). The on-ground cells may be created through an on-ground relay node or by a gNB located on-ground or in a satellite.

Typically, in multilayer networks, one access node provides one kind of a cell or cells, and thus a plurality of (e/g) NodeBs are required to provide such a network structure.

<FIG> illustrates a scenario where a number of cells <NUM>, <NUM>, <NUM> are illustrated. Each cell may be managed by an access node, e.g. similar to the access node <NUM>, or an access node may control multiple cells via sectorization. However, let us consider in the following embodiments the scenario with multiple cells managed by multiple access nodes. Accordingly, a coverage area under consideration is a combined coverage area of the multiple cells. <FIG> illustrates a simplified scenario with only three cells, but the number of cells may be different in other scenarios. In <FIG>, an access node may be positioned at the centre of each cell <NUM> to <NUM>. The combined coverage area of the cells may be covered by the access nodes via different arrangements of radio beam configurations. A radio beam configuration may be defined in terms of a beam direction and beam width in three dimensions. In <FIG>, the radio beam configurations are illustrated with the dotted ellipses spanning from the centres of the hexagonal cells. A single access node may operate multiple radio beam configurations to cover the whole coverage area of the cell, as illustrated in <FIG>. In some cases, even the boundaries of the cells may be subject to change as a result of changing the radio beam configurations of the cells, and this is illustrated by some radio beams extending to the neighbouring cells. By adapting the radio beam configurations, in particular by taking into account the combined coverage of the cells and access nodes, the system coverage and performance may be improved. A radio beam allocator <NUM> may be a central entity that jointly selects and allocates the radio beam configurations to the access nodes and to the cells according to embodiments described below.

Before proceeding to describe the embodiments, let us define some terms and parameters used below. Let us consider a set of C cells, and each cell j is assigned with NB beams from a beam library Uj. We define Bj c Uj as the chosen beams in cell j. A set of beams SoB is the union of all the allocated beams across all cells, namely SoB = B<NUM> ∪ B<NUM> ∪. In the following the set of beams may be understood as equal to a set of radio beam configurations. Let us remark that beam library may include a large number of beams with different beam-pointing directions in azimuth and elevation, different beam widths in azimuth and elevation that allows optimization of the system performance.

Let us discretize the coverage area of interest (the combined coverage area of the cells) into (x, y, z)s ("tiles") each identified by its coordinates <IMG>. (x, y, z)sub-area may equal to a cell provided by an access node, or it may be a sub-area within a cell. A coverage area of a cell may comprise a plurality of sub-areas, depending on the desired spatial resolution. Each <IMG> sub-area in the network coverage area ρ(x, y, z)a traffic density associated with it, the traffic density given by <IMG>(x, y, z) Each sub-area may be substantially smaller than a coverage area of a single cell, and the area covered by each sub-area may be selected according to the design, e.g. available computational resources. We remark that these<IMG> coordinates correspond to a (r, θ, ϕ)local coordinate system (GCS), while, for the purposes of the beamforming gain computation, it may be more convenient to use polar coordinates <IMG> with respect to a local c(x, y, z) oordinate system centred at the access node of the cell to which the location (x, y, z) would be associated.

Let us then describe a process for selecting N radio beam configurations for the access nodes. <FIG> illustrates an embodiment of such a process performed by the radio beam allocator <NUM>. The radio beam allocator may be connected to the access nodes, and it may reside in a radio access network or in the core network of the cellular communication system. Referring to <FIG>, the process comprises: storing, in a memory, a beam library <NUM> defining a set of radio beam configurations for a coverage area of a plurality of cells managed by the access nodes; dividing the coverage area into sub-areas and storing definitions of the sub-areas in a memory <NUM>, e.g. in terms of location coordinates (x, y, z); collecting (block <NUM>) a set of channel quality metrics where each channel quality metric indicates, in one of the sub-areas, channel quality for a radio beam configuration of the beam library; collecting (block <NUM>) a traffic density parameter for each sub-area, the traffic density parameter indicating an amount of data traffic in the sub-area; performing (block <NUM>) the following steps a) to d) for a plurality of different sets of N radio beam configurations:.

An advantage provided by the joint selection of the radio beam configurations is that the selection is not only the local optimization but provides an optimized solution for a wider area. Therefore, performance improvements may be acquired on a wider scale. It also reduces adverse effects of local estimations where each cell would be considered separately and potentially battle against one another.

In an embodiment, blocks <NUM> and <NUM> are performed during operation of the access nodes. The access nodes may collect the channel quality metrics from radio links they operate. Embodiments of the channel quality metrics include a reference signal reception power (RSRP) measured by the access nodes from uplink reference signals transmitted by the terminal devices and/or by the terminal devices from downlink reference signals transmitted by the access nodes, a path loss estimated by the access nodes and/or the terminal devices, a channel state information (CSI) or a channel quality indicator (CQI) defined in system specifications for cellular communication systems, and a signal-to-interference-plus-noise power ratio (SINR). The traffic density per sub-area may be measured by the access nodes from traffic volume of each radio link operated by the access node. The access nodes may map the terminal devices to the sub-areas by using positioning techniques such as a global navigation satellite system, angle-of-arrival positioning, and/or multilateration positioning (e.g. a time-difference-of-arrival, TDOA, measurements) performed by the access nodes.

In an embodiment, the steps a) to d) are performed for at least a majority of possible combinations of N radio beam configurations in the beam library. In an embodiment, the steps a) to d) are performed for at least some of the radio beam configurations of the radio beam library <NUM> multiple times, in different combinations of N radio beam configurations. For example, a given radio beam configuration may be combined with different sets of other radio beam configurations in different iterations of the steps a) to d) and, accordingly, the performance provided by the radio beam configuration with the different sets of other radio beam configurations becomes evaluated. Accordingly, in each iteration of the steps a) to d), a new combination of N radio beam configurations is tested and its performance evaluated and stored. In an embodiment, the majority of the radio beam configurations in the beam library <NUM> is tested in multiple different combinations of N radio beam configurations.

Let us then describe some embodiments of the various steps of the process of <FIG>. <FIG> illustrates an embodiment of block <NUM>. Before proceeding with the description of <FIG>, let us define used as an embodiment of the channel quality metric. Signal-to-interference (SIR or SINR) is used as a parameter in the embodiments described below, and let us describe the SINR in the present context. Let us suppose that cell j = <NUM>,. , C deploys the beams Bj, composed of NB beams chosen out of the beam library U(j). Gb(x, y, z) denotes a beamforming gain of beam b in the quantized sub-area (x, y, z). ) denote the tile-to-cell (equal to sub-area-to-cell) association T2C(x, y, z) that prescribes which cell serves each sub-area (x, y, z). Once the T2C is chosen, the radio beam that serves a sub-area (x, y, z) may be the one guaranteeing the highest received power among the available set of beams (GoB), and it is defined as: <MAT> Let us now define the interference IT<NUM>C(x, y, z) suffered at the tile or sub-area (x, y, z) given a certain tile-to-cell (T2C) association c(. The interference may come from the signals coming from all tiles (x', y', z') that are not associated with the same cell, and it can be written as: <MAT> where Lj(x, y, z) is the path gain from the serving access node j at the location (x, y, z) and η(x, y, z) is the average percentage of time that there is a transmission to tile (x, y, z), computed as: <MAT> Let us then define the SINR perceived in each sub-area (x, y, z) as <MAT> where σ<NUM> is the thermal noise power. In other embodiments, the SINR could be measured or estimated in a different manner. For example, the parameter η(x, y, z) may be omitted, or equivalently set equal to <NUM>, for the sake of lower complexity. In another embodiment, the term η(x, y, z) may be computed from Equation (<NUM>) by replacing ρ(x, y, z) (respectively, ρ(x',y',z')) by the ratio of ρ(x, y, z) (respectively, ρ(x', y', z')) to the corresponding spectral efficiency that can be realized in sub-area (x, y, z) (respectively, (x', y', z')).

The SINR expression in Equation (<NUM>) depends on the T2C that assigns each sub-area to a cell. In turn, the T2C itself depends on the SINR, since each (potential) terminal device in each sub-area will attach to a cell that provides the highest SINR. Therefore, it may be impractical to assume to know in advance, before the selected set of N radio beam configurations is actually deployed in the access nodes, the tile-to-cell association T<NUM>C* implemented by the terminal devices. Yet, a good way to estimate it and disentangle the mutual relationship between SINR and T2C is to estimate T<NUM>C* as one from which no terminal device in each sub-area has the interest to deviate unilaterally. In other words, a terminal device may assume that it would not achieve a higher SINR by attaching to a cell differing from T<NUM>C*(x, y, z), i.e. it assumes <MAT> where T<NUM>C(x', y', z') = T<NUM>C*(x', y', z') for (x', y', z') ≠ (x, y, z) and T<NUM>C(x, y, z) ≠ T<NUM>C*(x,y,z). Technically speaking, this is a Nash equilibrium known in game theory. In order to compute such a Nash equilibrium, a best response algorithm also known in the game theory may be used. The best response algorithm works iteratively and, for each sub-area, finds the best cell association with the assumption that the cell associations of the other sub-areas remain unchanged. <FIG> illustrates an embodiment of such a best response algorithm.

Referring to <FIG>, let us describe a general idea of using the SINR as a metric for cell associations according to the best response algorithm. In this embodiment, the above-described step b) comprises mapping, on the basis of the set of channel quality metrics, each sub-area a radio beam that provides the highest channel quality metric for the N radio beam configurations selected in step a), thereby performing cell association such that a different number of beams is mapped to different cells, and reiterating the cell associations of the sub-areas one-by-one by computing, for a sub-area, a signal-to-interference metric for each of the plurality of cells by considering the other sub-areas associated to different cells as sources of interferences and by selecting a cell providing the greatest signal-to-interference metric, thereby inducing at least one cell change to the mapping. Multiple reiterations may be performed per sub-area. Let us describe more detailed embodiments with reference to <FIG>.

In block <NUM>, the best response algorithm is initialized by associating, on the basis of the channel quality metrics collected in block <NUM>, each sub-area to a radio beam that provides the highest channel quality for the N radio beams selected in block <NUM>. This is basically cell association as well because each radio beam is linked to one of the cells. Then, the best response is performed by looping block <NUM>. In block <NUM>, the cell associations of the sub-areas are (re)iterated one-by-one by computing, for a sub-area, a signal-to-interference metric (e.g. the SINRGoB,T<NUM>C(x, y, z)) for each of the cells by considering the other sub-areas associated to different cells as sources of interference, and by selecting a cell providing the greatest signal-to-interference metric. The assumption in the selection may be that the selections for the other sub-areas will not be affected by the change. In other words, the selection does not take into account the consequences of the selection to other sub-areas. That characteristic will be taken into account via the iterations. Because the criterion in block <NUM> (SINR) differs from the criterion in block <NUM> (e.g. RSRP), at least one cell change occurs during iterations of block <NUM>. This causes a change in the interference scenario and the SINR metrics of the other sub-areas that may induce further cell changes. Accordingly, each sub-area may be iterated more than once in the process of <FIG>. As a criterion for stopping the iterations, a maximum number of iterations may be predefined. Another criterion may be to evaluate the number of cell changes during an iteration round with one iteration per sub-area. If the number of cell changes is below a threshold, e.g. no cell changes occurred, the process may end.

In an embodiment, a fairness parameter defining a target trade-off between maximizing the average SINR and the SINR of the worse-off users for the set of N radio beam configurations is used, and the fairness parameter may be used as an input in block <NUM>. A goal in block <NUM> may be to find the set of radio beam configurations that provides the best performance in the combined coverage area of the access nodes for which the set of N radio beam configurations is selected. To achieve fairness across terminal device, a utility function fα(. ) may be defined as <MAT> where different values of α correspond to different utility metrics:.

The function of the fairness metric α may be understood from the following perspective. Selection α=<NUM> indicates that the fairness metric causes preference of the average SINR over the SINR of the worse-off tiles, while selection α=∞ or selection of a very high value for α indicates that the fairness metric causes preference of the SINR of the worse-off tiles over the average SINR. α may be chosen according to the desired fairness (e.g. preference between the average SINR and the worst-case SINR). Our goal is to compute the set of beams (GoB) that maximizes the sum-utility of the SINR distribution across the sub-areas, and this may be computed in block <NUM> as follows: <MAT> where the parameter r(GoB) = Σ(x,y,z) ρ(x, y, z) fα (SINRGoB,T2C*(x, y, z)) may be computed in block <NUM>. r(GoB) may be considered as an embodiment of the service performance or a 'reward' of the set of radio beam configurations selected in block <NUM>. <FIG> illustrates a procedure for computing the reward or the service performance. Referring to <FIG>, the fairness parameter is defined in block <NUM>, and the service performance for the selected N radio beam configurations is computed in block <NUM> by using the fairness parameter. Since the fairness is included into the computation of the service performance, the fairness is inherently included as a parameter in the selection of the set of N radio beam configurations in block <NUM>.

In an embodiment of block <NUM>, a Monte-Carlo tree search (MCTS) algorithm is used for selecting the N radio beam configurations to be tested for the service performance. In computer science, the MCTS is known as a heuristic search algorithm for decision processes that uses randomness for solving complex deterministic problems. MCTS is a four-step procedure that is iterated over and over again. The four steps include.

Now, reflecting the MCTS to the present embodiments, a node may be understood as a new radio beam configuration or, from another perspective, a state where a new radio beam configuration is added to the set of radio beam configurations represented by the parent node. <FIG> illustrate the selection procedure according to the MCTS algorithm. With respect to the definition of the 'tree structure', the radio beam selection may have desired degrees of freedom that may be dependent or independent on the travelled route (past selections) in the tree. For example, selection of a radio beam configuration may preclude subsequent selections of some of the other radio beam configurations, thus following a pre-set or predetermined 'tree structure'. However, in other embodiments the algorithm may have in every step of the tree complete freedom to select any radio beam configuration from the beam library, with the ruling that already selected radio beam configuration(s) cannot be selected again for the same 'tree'. In this case, there is no pre-set 'tree structure' but a tree branch is formed by the selections.

Referring to <FIG>, the selection phase may include selecting a set of radio beam configurations from the root to a leaf node that has not been expanded to in previous iterations of the MCTS. The selection may be completely random, or it may have deterministic characteristics. The service performance computed in the past iterations may be stored for every node, as described above, and it may be used as a parameter for the determinism. A selection criterion may take into account an average of the service performances (reward) and/or a maximum of the service performances. This allows to steer the tree exploration procedure towards more promising branches. A metric for using as the selection criterion for a node may be defined as follows: <MAT> where maxVSmean ∈ [<NUM>,<NUM>] is an input parameter defining the weight between the average and maximum reward in the selection. As described in Equation (<NUM>), another criterion may be the number of visits to the node and the number of visits to its parent node. Parameter Cexploration ≥ <NUM> defines a weight for the numbers of visits. This parameter controls the random characteristic in the selection, and it may be set to zero after every radio beam configuration has been selected in the selecting and/or expansion step of the MCTS. Before that, the parameter may be set to one. The radio beam configuration (node) providing the greatest metric of Equation (<NUM>) may be selected, and the selection may proceed until a node (radio beam configuration) is found that has at least one child node that has not yet been selected in the process of block <NUM>. Thereafter, the process proceeds to the expansion step (<FIG>) where one of such child nodes is selected. The selection may be random or according to Equation (<NUM>) with the exception that, since the child node(s) have/has not been visited, the parameter using the numbers of visits may be omitted. The expansion may be understood as exploration of the child node.

Upon selecting the child node, the remaining radio beam configurations to reach the N radio beam configurations are selected in the simulation step (<FIG>). The selection may be arbitrary, e.g. random. Instead of making the simulation purely random, the 'dice' may be balanced, for example by using the channel quality metrics as a criterion. In an embodiment, each node in the simulation step is selected by first selecting a cell in random and, thereafter, selecting a radio beam configuration for the cell randomly but biased by a certain probability. The probability for selecting the radio beam configuration randomly is ε. The probability for selecting the radio beam configuration on the basis of the channel quality metric is <NUM>- ε, where <NUM> < ε < <NUM>. The channel quality metric may be used as the criterion such that the radio beam configuration that maximized an incremental RSRP or similar metric with already selected radio beam configurations becomes selected.

The incremental RSRP for a set of radio beams (RSRP(GoB)) may be defined as <MAT>.

This embodiment provides fast results and is useful for finding quickly a good set of N radio beam configurations for block <NUM>. In another embodiment, a radio beam configuration is selected across all cells randomly but biased by the certain probability. The probability for selecting the radio beam configuration randomly is ε. The probability for selecting the radio beam configuration on the basis of the channel quality metric is <NUM>- ε, where <NUM><ε<<NUM>. In an embodiment, ε << <NUM>, e.g. ε < <NUM> or ε < <NUM> or ε < <NUM> or ε=<NUM>. ε=<NUM> may be selected after every radio beam configuration has been selected at least once. Before that, ε≠<NUM> may be used. The channel quality metric may again be used as the criterion such that the radio beam configuration that maximized an incremental RSRP or similar metric with already selected radio beam configurations becomes selected. This embodiment is slower than the one described above but may result in better exploration, thus providing better set of N radio beam configurations for block <NUM>, given enough processing time. Upon selecting the N radio beam configurations, the process may proceed to blocks <NUM> and <NUM> where the cell associations are performed (block <NUM>) and the service performance r(GoB) is computed (block <NUM>), as described above. Upon computing the service performance, the service performance may be backpropagated to each selected radio beam configuration (<FIG>), i.e. the same service performance may be stored in association with every radio beam configuration. Upon executing the procedure of block <NUM> numerous times such that a given radio beam configuration becomes selected in the selection, expansion, and/or simulation multiple times, multiple service performance values becomes stored for the radio beam configuration. This helps in determining the radio beams that have the tendency of providing a high service performance, thus being more probable of getting selected in block <NUM>. In other words, the probability of selecting in step block <NUM> a radio beam configuration that has a greater service performance, in terms of the stored service performance values, is greater than a probability of selecting a radio beam configuration that has a smaller service performance in terms of the stored service performance values. The same applies to the selection step in the MCTS algorithm.

<FIG> illustrates a flow diagram that summarizes the embodiment where block <NUM> is performed by using the MCTS algorithm. For the sake of simplicity, let us assume that the process selects X radio beam configurations for every cell. In reality, X may be different for different cells. Referring to <FIG>, the process may start with the selection of a cell for which less than X radio beams is currently selected. In the first iteration, any one of the cells may be selected. In block <NUM>, a radio beam configuration is selected for the cell selected in block <NUM>. As described above, the radio beam configuration may be selected according to Equation (<NUM>), for example. In block <NUM>, it is determined whether the selected radio beam configuration is linked in the selection tree to a radio beam configuration that has never yet been selected. In order to make this determination, whenever an expansion is made to a node (radio beam configuration) in the expansion step (Figure 7B). If there is no such a radio beam configuration, the process proceeds to block <NUM> where it is checked whether or not the N radio beam configurations have already been selected. If not, the process returns to block <NUM> to continue the selection step of the MCTS. If the result in block <NUM> is that there is at least one unexplored radio beam configuration, expansion is made to such a radio beam configuration in block <NUM>. Subsequently, the simulation step is performed to select the remaining radio beam configurations, as described above, thus selecting the remaining radio beam configuration and ending up with N radio beam configurations. <FIG> illustrates an embodiment of the simulation in block <NUM>. Referring to <FIG>, a cell with less than the targeted X radio beams is selected in block <NUM>. In block <NUM>, a radio beam configuration for the selected cell is selected. As described above, parameter ε may be used for determining (rolling the dice) whether the selection is random or deterministic. Upon selecting the radio beam configuration, it is checked in block <NUM> whether N radio beam configurations have now been selected. If not, the process returns to block <NUM>. Otherwise, the process of <FIG> ends.

Thereafter, the service performance r(GoB) of the N radio beam configurations is computed in block <NUM>, and the service performance is backpropagated to every radio beam configuration that was selected in block <NUM> and block <NUM> (if executed). The backpropagation may be understood as an embodiment of storing the service performances, as described above. Block <NUM> may thus comprise blocks <NUM>, <NUM>, and <NUM>. If another iteration of the procedure is to be carried out, the procedure may proceed from the "end" to "start" in <FIG>. As the procedure of <FIG> (block <NUM>) is iterated numerous times, the N radio beam configurations may become selected already in the selection step of the MCTS algorithm. In such a case, the procedure of <FIG> proceeds from block <NUM> to block <NUM> without the expansion and the simulation in block <NUM>.

Depending on the number of cells involved in the process of <FIG>, the level of complexity selected with the above-described parameters, and the available computational resources, the execution may be time-consuming. However, one advantage of the embodiments is that it provides results even after the first iteration or after a few iterations. Therefore, in case there is a need to change the radio beam configurations currently used by the access nodes, the process of block <NUM> may be stopped at any time and the new set of N radio beam configurations may be selected (block <NUM>) according to any embodiment described above and allocated to the access nodes.

<FIG> illustrates an embodiment where block <NUM> is iterated during operation of the access nodes and, upon detecting an event in the operation that requires modification of the radio beam configurations currently applied by the access nodes, block <NUM> is interrupted and block <NUM> is executed by using the available service performances stored while executing iterations of block <NUM>. Referring to <FIG>, a current state of the system is that the access nodes operate their respective cells with the currently applied radio beam configurations selected, for example, according to earlier execution of the process of <FIG>. The access nodes or another network node may monitor the operation of the access nodes in block <NUM>, e.g. the traffic density, a number of radio link failures in the cells, reported channel quality metrics. Meanwhile, the channel quality metrics and the traffic densities for the sub-areas may be collected for the process of <FIG>. Meanwhile, block <NUM> may be executed by the radio beam allocator <NUM> according to any one of the above-described embodiments. Upon detecting an issue in the monitored operation, an interrupt signal is sent to the radio beam allocator <NUM> to stop the process of Figure <NUM> and to provide a new set of N radio beam configurations. In response to the interruption, the radio beam allocator executes block <NUM> and provides the new set of radio beam configurations for the access nodes.

<FIG> illustrates an apparatus comprising means for carrying out the process of <FIG> or any one of the embodiments described above. The apparatus may comprise at least one processor <NUM> and at least one memory <NUM> including a computer program code (software) <NUM>, wherein the at least one memory and the computer program code (software) are configured, with the at least one processor, to cause the apparatus to carry out the process of <FIG> or any one of its embodiments described above. The apparatus may be for the radio beam allocator <NUM> comprised in the network infrastructure of the cellular communication system. The apparatus may be a circuitry or an electronic device realizing some embodiments of the invention in the radio beam allocator. The apparatus carrying out the above-described functionalities may thus be comprised in the radio beam allocator, e.g. the apparatus may comprise a circuitry such as a chip, a chipset, a processor, a micro controller, or a combination of such circuitries for the radio beam allocator.

The memory <NUM> may be implemented using any suitable data storage technology, such as semiconductor-based memory devices, flash memory, magnetic memory devices and systems, optical memory devices and systems, fixed memory and removable memory. The memory <NUM> may comprise the beam library <NUM> and the database <NUM> storing definitions for the sub-areas. Furthermore, the at least one memory <NUM> may store a database <NUM> for the channel quality metrics and the traffic densities. In another embodiment, the traffic densities may be stored in the database <NUM> and the channel quality metrics per radio beam configuration in the beam library <NUM>.

The processor(s) may comprise, as sub-circuitries or sub-modules defined by physical circuits or combinations of the physical circuits and software <NUM>, a data collector module <NUM> and a radio beam allocator module <NUM>. The data collector <NUM> may collect the channel quality metrics and the traffic densities during the operation of the access nodes and store the collected data in the memory <NUM>. The radio beam allocator may comprise a beam selection module <NUM> configured to perform block <NUM> according to any one of the above-described embodiments, a sub-area-to-cell allocator module <NUM> configured to make cell associations for the sub-areas for the radio beam configurations selected by the beam selection module (block <NUM> according to any one of the above-described embodiments), and a service performance estimation module <NUM> configured to carry out blocks <NUM> and <NUM> according to any one of the above-described embodiments. The radio beam allocator <NUM> may then carry out the selection (block <NUM>) on the basis of the results of the service performance estimation module <NUM>, after the completion of block <NUM> or upon receiving the interruption (<FIG>).

The apparatus may further comprise a communication interface <NUM> comprising hardware and/or software for providing the apparatus with communication capability with the access nodes, as described above. The communication interface <NUM> may include hardware and software needed for realizing the communications over the required interface of the cellular communication system, e.g. according to specifications of an LTE or <NUM> interfaces.

As used in this application, the term 'circuitry' refers to one or more of the following: (a) hardware-only circuit implementations such as implementations in only analog and/or digital circuitry; (b) combinations of circuits and software and/or firmware, such as (as applicable): (i) a combination of processor(s) or processor cores; or (ii) portions of processor(s)/software including digital signal processor(s), software, and at least one memory that work together to cause an apparatus to perform specific functions; and (c) circuits, such as a microprocessor(s) or a portion of a microprocessor(s), that require software or firmware for operation, even if the software or firmware is not physically present.

This definition of 'circuitry' applies to uses of this term in this application. As a further example, as used in this application, the term "circuitry" would also cover an implementation of merely a processor (or multiple processors) or portion of a processor, e.g. one core of a multi-core processor, and its (or their) accompanying software and/or firmware. The term "circuitry" would also cover, for example and if applicable to the particular element, a baseband integrated circuit, an application-specific integrated circuit (ASIC), and/or a field-programmable grid array (FPGA) circuit for the apparatus according to an embodiment of the invention.

The processes or methods described in <FIG> or any of the embodiments thereof may also be carried out in the form of one or more computer processes defined by one or more computer programs. The computer program(s) may be in source code form, object code form, or in some intermediate form, and it may be stored in some sort of carrier, which may be any entity or device capable of carrying the program. Such carriers include transitory and/or non-transitory computer media, e.g. a record medium, computer memory, read-only memory, electrical carrier signal, telecommunications signal, and software distribution package. Depending on the processing power needed, the computer program may be executed in a single electronic digital processing unit or it may be distributed amongst a number of processing units.

Claim 1:
An apparatus for allocating N radio beam configurations to access nodes, comprising means for performing the following:
storing, in at least one memory, a beam library (<NUM>) defining a set of radio beam configurations for a coverage area of a plurality of cells managed by the access nodes, wherein each cell is capable of operating multiple radio beam configurations to cover the respective cell;
dividing the coverage area of the plurality of cells into sub-areas (<NUM>) such that a coverage area of a cell comprises a plurality of sub-areas;
collecting (<NUM>) a set of channel quality metrics where each channel quality metric indicates, in one of the sub-areas, channel quality for a radio beam configuration of the beam library;
collecting (<NUM>) a traffic density parameter for each sub-area, the traffic density parameter indicating an amount of data traffic in the sub-area;
performing the following steps a) to d) for a plurality of different sets of N radio beam configurations:
a) selecting (<NUM>), N radio beam configurations from the set of radio beam configurations;
b) mapping (<NUM>), on the basis of the set of channel quality metrics, each sub-area to a radio beam that provides the highest channel quality metric for the N radio beam configurations selected in step a), thereby performing cell association such that a different number of radio beams is mapped to different cells, and reiterating the cell associations of the sub-areas one-by-one by computing, for a sub-area, a signal-to-interference metric for each of the plurality of cells by considering the other sub-areas associated to different cells as sources of interferences and by selecting a cell providing the greatest signal-to-interference metric, thereby inducing at least one cell change to the mapping;
c) computing (<NUM>), on the basis of the mapping and the traffic density parameters, a service performance for the selected N radio beam configurations, wherein the service performance is weighted by the traffic density parameters, and
d) storing (<NUM>) the service performance as linked to each radio beam configuration of the selected N radio beam configurations;
selecting (<NUM>), on the basis of the stored service performances, a set of N radio beam configurations and allocating the N radio beam configurations to the access nodes.