 Research
 Open Access
 Published:
The Vienna LTE simulators  Enabling reproducibility in wireless communications research
EURASIP Journal on Advances in Signal Processingvolume 2011, Article number: 29 (2011)
Abstract
In this article, we introduce MATLABbased link and system level simulation environments for UMTS LongTerm Evolution (LTE). The source codes of both simulators are available under an academic noncommercial use license, allowing researchers full access to standardcompliant simulation environments. Owing to the open source availability, the simulators enable reproducible research in wireless communications and comparison of novel algorithms. In this study, we explain how link and system level simulations are connected and show how the link level simulator serves as a reference to design the system level simulator. We compare the accuracy of the PHY modeling at system level by means of simulations performed both with bitaccurate link level simulations and PHYmodelbased system level simulations. We highlight some of the currently most interesting research questions for LTE, and explain by some research examples how our simulators can be applied.
1. Introduction
Reproducibility is one of the pillars of scientific research. Although reproducibility has a long tradition in most nature sciences and theoretical sciences, such as mathematics, it is only recently that reproducible research has become more and more important in the field of signal processing [1, 2]. In contrast to results in fields of purely theoretical sciences, results of signal processing research articles can be reproduced only if a comprehensive description of the investigated algorithms (including the setting of all necessary parameters), as well as eventually required input data are fully available. Owing to the lack of space, a fully comprehensive description of the algorithm is often omitted in research articles. Even if an algorithm is explained in detail, for instance, by a pseudo code, initialization values are often not fully defined. Moreover, it is often not possible to include in an article all the necessary resources, such as data, which were processed by the presented algorithms. Ideally, all resources, including source code of the presented algorithms, should be made available for download to enable other researchers (and also reviewers of articles) to reproduce the results presented. Unfortunately, researcher's reality does not resemble this ideal situation, a circumstance that has recently been quite openly complained about [3].
In the past few years, several researchers have started to build up online resource databases in which simulation code and data are provided, see for example [4, 5]. However, it is still not a common practice in signal processing research. We are furthermore convinced that reproducibility should also play an important role in the review process of an article. Although thorough checking is very possibly impractical, it would make the presented studies more transparent to the review process. Reproducibility becomes even more important when the systems that are simulated become more and more complex, as it is the case in the evaluation of wireless communication systems. When algorithms for wireless systems are evaluated, authors often claim to use a standardcompliant transmission system and simply make reference to the corresponding technical specification. Since technical specifications are usually extensive, including a cornucopia of options, it is not always clear which parts of a specification were actually implemented and which parts were omitted for the sake of simplicity reasons. The situation of trying to reproduce someone else's results to compare them to one's own algorithm but not being able to do so (or only after extensive effort to discover the unreported details of the actual implementation) is familiar to most researchers. Without access to the details of the implementation, including all assumptions, comparisons of algorithms, developed by different researchers, are very difficult, if not impossible to carry out. A way out of this dilemma is offered by a publicly available simulation environment. In this study, we present such an opensource simulation environment that supports link and system level simulations of the Universal Mobile Telecommunications System (UMTS) LongTerm Evolution (LTE), specifically designed to support reproducibility. The development and publishing of this LTE simulation environment is based on our previous very good experience with a WiMAX physical layer simulator [6].
Furthermore, such simulators can be used as a reference for validation of algorithms, for example, when designing transmitter or receiver chips [7]. We also have used our simulators for generating LTE signals that are required to include realistic signals in related research [8], or as a reference for LTEcompliant measurements. In such cases, the simulator can serve not only as a data pump, but also as a vehicle to evaluate the received data.
LTE, the current evolutionary step in the third Generation Partnership Project (3GPP) roadmap for future wireless cellular systems, was introduced in 3GPP Release 8 [9]. Besides the definition of the novel physical layer, LTE also contains many other remarkable innovations. Most notable are (i) the redevelopment of the system architecture, now called System Architecture Evolution (SAE), (ii) the definition of network selforganization, and (iii) the introduction of home basestations. The main reasons for these profound changes in the Radio Access Network (RAN) system design are to provide higher spectral efficiency, lower delay (latency), and more multiuser flexibility than the currently deployed networks.
In the development and standardization of LTE, as well as in the implementation process of equipment manufacturers, simulations are necessary to test and optimize algorithms and procedures. This has to be carried out on the physical layer (link level) and in the network (system level) context:

1)
Link level simulations allow for the investigation of channel estimation, tracking, and prediction algorithms, as well as synchronization algorithms [10, 11]; MultipleInput MultipleOutput (MIMO) gains; Adaptive Modulation and Coding (AMC); and feedback techniques [12, 13]. Furthermore, receiver structures (typically neglecting intercell interference and impact of scheduling, as this increases simulation complexity and runtime dramatically) [14], modeling of channel encoding and decoding [15], physicallayer modeling crucial, for system level simulations [16], and the like are typically analyzed on link level. Although MIMO broadcast channels have been investigated quite extensively over the past few years [17, 18], there are still a lot of open questions that need to be resolved, both in theory and in practical implementation. For example, LTE offers the flexibility to adjust many transmission parameters, but it is not clear up to now how to exploit the available Degrees of Freedom (DoF) to achieve the optimum performance. Some recent theoretical results point out how to proceed in this matter [18, 19], but practical results for LTE are still missing.

2)
System level simulations focus more on networkrelated issues, such as resource allocation and scheduling [20, 21], multiuser handling, mobility management, admission control [22], interference management [23, 24], and network planning optimization [25, 26]. Furthermore, in a multiuser oriented system, such as LTE, it is not directly clear which figures of merit should be used to assess the performance of the system. The classical measures of (un)coded Bit Error Ratio (BER), (un)coded BLock Error Ratio (BLER), and throughput are not covering multiuser scenario properties. More comprehensive measures of the LTE performance are, for example, fairness, multiuser diversity, or DoF [27]. However, these theoretical concepts have to be mapped to performance values that can be evaluated by means of simulations [28, 29].
Around the world, many research facilities and vendors are investigating the above mentioned aspects of LTE. For that purpose, commercially available simulators applied in industry [30–32], as well simulators applied in academia [33], have been developed. Also, probably all major equipment vendors have implemented their own, proprietary simulators. Regardless of the simulation tools being commercial/noncommercial, the development framework (C, C++, MATLAB, WMSIM [33],...), or their claimed performance/flexibility, one fact is shared by all of the simulators. Their closed implementation disables access to implementation details and thus to any assumption that may have been included. As such, the reliability of the results relies purely on the faith of a proper implementation. Independent validation of results in such closed simulation environments is not easy, very timeconsuming, and often not feasible. Since the results were obtained with closed tools, simply repeating the same experiment is a daunting task. Transparency not only in the results, but also in the tools employed, thus greatly magnifies the credibility of the results.
The two simulators [34, 35] described in Sections 2 and 3 of this article are freely available at our homepage http://www.nt.tuwien.ac.at/ltesimulator/ under an open, free for noncommercial academic use license, which facilitates academic research and enables a closer cooperation between different universities and research facilities. In addition, developed algorithms can be shared under the same license again, making the comparison of algorithms easier, reproducible, and therefore refutable and more credible. To the best of the authors' knowledge, our two simulators are the first to be published in the context of LTE, including source code under an academic use license. Thus, the simulators provide opportunities for many institutions to directly apply their ideas and algorithms in the context of LTE. The availability of the simulators, together with the possibility to include links to the utilized simulator version and any resources needed furthermore, enables researchers to quickly reproduce published results [2].
The remainder of this article is organized as follows. In Sections 2 and 3, we describe the Vienna LTE Simulators and how they relate to each other. In Section 4, we provide a validation of the two simulators. Exemplary simulation results are shown in Section 5. Finally, we conclude the article in Section 6.
2. The Vienna LTE link level simulator
In this section, we describe the overall structure of the Vienna LTE Link Level Simulator, currently (January 2011) released in version 1.6r917. Furthermore, we present the capabilities of the simulator and provide some examples of its application.
A. Structure of the simulator
The link level simulator can be divided into three basic building blocks, namely, transmitter, channel model, and receiver (see Figure 1). Depending on the type of simulation, one or several instances of these basic building blocks are employed. The transmitter and receiver blocks are linked by the channel model, which is used to transmit the downlink data, while signaling and uplink feedback is assumed to be errorfree. Since signaling is stronger protected than data, by means of lower coding rates and/or lowerorder modulations, the assumption of errorfree signaling is in fact quite realistic. Equivalently, errors on the signaling channels will only occur when the data channels are already facing severe performance degradationa point of operation usually not targeted in investigations.
In the downlink, the signaling information passed on by the transmitter to the receiver contains coding, HARQ, scheduling, and precoding parameters. In the uplink, Channel Quality Indicator (CQI), Precoding Matrix Indicator (PMI), and Rank Indicator (RI) are signalled, which together form the Channel State Information (CSI) feedback. All simulation scenarios (see Section 2B) support the feedback of CQI, PMI, and RI, although it is also possible to set some or all of them to fixed values. Such a setting is required for specific simulations, such as throughput evaluation of a single Modulation and Coding Scheme (MCS).
A standardcompliant implementation of the downlink control channels would not affect the overall structure of our simulator and just requires the insertion of the control channels in the relevant resource elements [36]. On the other hand, nonerrorfree feedback transmissions would require a physical layer implementation of the LTE uplink, which is currently not in the scope of the simulator. (A first release of the uplink, however, is currently being implemented in the simulator and will be released soon.)
1) Transmitter
The layout of the transmitter is shown in Figure 2, which is also a graphical representation of the transmitter description defined in the TS36' standard series [36–38]. Based on User Equipment (UE) feedback values, a scheduling algorithm assigns Resource Blocks (RBs) to UEs and sets an appropriate MCS (coding rates between 0.076 and 0.926 with 4, 16, or 64QAM modulation [38]), the MIMO transmission mode (Transmit Diversity (TxD), Open Loop Spatial Multiplexing (OLSM), or Closed Loop Spatial Multiplexing (CLSM)), and the precoding/number of spatial layers for all served users. Such a channel adaptive scheduling allows for the exploitation of frequency diversity, time diversity, spatial diversity, and multiuser diversity.
Given the number of available DoF, the specific implementation of the scheduler algorithm has a large impact on the system performance and has been a hot topic in research [39–41]. In Section 5B, we provide performance evaluations of several schedulers.
2) Channel model
The Vienna LTE Link Level Simulator supports block and fastfading channels. In the blockfading case, the channel is constant during the duration of one subframe (1 ms). In the fastfading case, timecorrelated channel impulse responses are generated for each sample of the transmit signal. Currently (January 2011), the simulator supports the following channel models:

1)
Additive White Gaussian Noise (AWGN);

2)
Flat Rayleigh fading;

3)
Power Delay Profilebased channel models, such as ITU Pedestrian B, or ITU Vehicular A [42];

4)
Winner Phase II+ [43]
The most sophisticated of these channel models is the Winner Phase II+ model. It is an evolution of the 3GPP spatial channel model, and introduces additional features, such as support for arbitrary 3D antenna patterns.
3) Receiver
Figure 3 shows our implementation of the UE receiver. After disassembling the RBs according to the UE resource allocation, MIMO Orthogonal Frequency Division Multiplexing (OFDM) detection is carried out. The simulator currently supports ZeroForcing (ZF), Linear Minimum Mean Squared Error (LMMSE), and soft sphere decoding as detection algorithms. The detected soft bits are decoded to obtain the data bits and several figures of merit, such as coded/uncoded BER, BLER, and throughput.
Currently, four different types of channel estimators are supported within the simulator: (i) Least Squares (LS), (ii) Minimum Mean Squared Error (MMSE), (iii) Approximate LMMSE [44], and (iv) geniedriven (near) perfect channel knowledge based on all transmitted symbols.
LTE requires UE feedback to adapt the transmission to the current channel conditions. The LTE standard specifies three feedback indicators for that purpose: CQI, RI, and PMI [36]. The CQI is employed to choose the appropriate MCS, such as to achieve a predefined target BLER, whereas the RI and the PMI are utilized for MIMO preprocessing. Specifically, the RI informs the eNodeB about the preferred number of parallel spatial data streams, while the PMI signals the preferred precoder that is stemming from a finite code book as specified in [36]. Very similar feedback values are also employed in other systems such as WiMAX and WiFi. The simulator provides algorithms that utilize the estimated channel coefficients to evaluate these feedback indicators [13]. Researchers and engineers working on feedback algorithms can implement other algorithms using the provided feedback functions as a starting point to define their own functions.
Given this receiver structure, the simulator allows the investigation of various aspects, such as frequency synchronization [45], channel estimation [44], or interference awareness [46].
B. Complexity
Link level simulators are in practice a direct standardcompliant implementation of the Physical (PHY) layer procedures, including segmentation, channel coding, MIMO, transmit signal generation, pilot patterns, and synchronization sequences. Therefore, implementation complexity and simulation time are in general high. To obtain a simulator with readable and maintainable code, a highlevel language (MATLAB) has been chosen. This choice enabled us to develop the simulator in a fraction of the time required for an implementation in other languages such as C. Furthermore, MATLAB ensures crossplatform compatibility. While MATLAB is certainly slower than C, by means of code optimization (vectorization) and parallelization by the MATLAB Parallel/Distributed Computing Toolbox, simulation runtime can be greatly reduced. Severely difficulttovectorize and oftencalled functions are implemented in C and linked to the MATLAB code by means of MEX functions. Such functions include the channel coding/decoding [47], Cyclic Redundancy Check (CRC) computation [48], and soft sphere decoding.
Furthermore, it is possible to adjust the scale of the simulation to the specific needs. This is achieved by introducing three different simulation types with largely different computational complexity (Figure 4):
1) Singledownlink
This simulation type only covers the link between one eNodeB and one UE. Such a setup allows for the investigation of channel tracking, channel estimation [44], synchronization [11, 49], MIMO gains, AMC and feedback optimization [13], receiver structures [14] (neglecting interference and impact of the scheduling,^{a} modeling of channel encoding and decoding [15, 50], and physical layer modeling [51], which can be used for system level abstraction of the physical layer. To start a simple singledownlink simulation, run the file LTE _sim _batch _single _downlink.m.
2) Singlecell multiuser
This simulation covers the links between one eNodeB and multiple UEs. This setup additionally allows for the investigation of receiver structures that take into account the influence of scheduling, multiuser MIMO resource allocation, and multiuser gains. Furthermore, this setup allows researchers to investigate practically achievable multiuser rate regions. In the current implementation, the simulator fully evaluates the receivers of all users. However, if receiver structures are being investigated, the computational complexity of the simulation can considerably be reduced by only evaluating the user of interest. In order to enable a functional scheduler, it is sufficient to compute just the feedback parameters for all other users. To start a simple singlecell multiuser simulation, run the file LTE _sim _batch _single _cell _multi _user.m.
3) Multicell multiuser
This simulation is by far the computationally most demanding scenario and covers the links between multiple eNodeBs and UEs. This setup allows for the realistic investigation of interferenceaware receiver techniques [52], interference management (including cooperative transmissions [53] and interference alignment [54, 55]), and networkbased algorithms such as joint resource allocation and scheduling. Furthermore, despite the vast computational efforts needed, such simulations are crucial to verify system level simulations. To start a simple multicell multiuser simulation, run the file LTE _sim _batch _multi _cell _multi _user.m.
The simulation time, which depends mainly on the desired precision and statistical accuracy of the simulation results, the selected bandwidth, the transmission mode, and the chosen modulation order, is for most users a crucial factor. It should be noted that by a smart choice of the simulation settings, the simulation time can be decreased (e.g., when investigating channel estimation performance, the smallest bandwidth can be sufficient).
3. The Vienna LTE system level simulator
In this section, we describe the overall structure of the Vienna LTE System Level Simulator, currently developed (January 2011) version 1.3r427. We furthermore show how the PHY layer procedures have been abstracted in a low complexity manner.
A. Structure of the simulator
In system level simulations, the performance of a whole network is analyzed. In LTE, such a network consists of a multitude of eNodeBs that cover a specific area in which many mobile terminals are located and/or moving around. While simulations of individual physical layer links allow for the investigation of MIMO gains, AMC feedback, modeling of the channel code, and retransmissions [13, 44, 45, 50, 56], it is not possible to reflect the effects of cell planning, scheduling, or interference in a large scale with dozens of eNodeBs and hundreds of users. Simply performing physical layer simulations of the radio links between all terminals and basestations is unfeasible for system level investigations because of the vast amount of computational power required. Thus, the physical layer has to be abstracted by simplified models capturing its essential dynamics with high accuracy at low complexity.
Based on the standard approach in the literature [51, 57], our simulator consists of two parts: (i) a link measurement model, and (ii) a link performance model. The link measurement model reflects the link quality, given by the UE measurement reports, and is required to carry out link adaptation and resource allocation. The chosen link quality measure is evaluated per subcarrier. Based on the Signal to Interference and Noise Ratio (SINR), the UE computes the feedback (PMI, RI, and CQI), which is employed for link adaptation at the eNodeB as described in Section 2A. The scheduling algorithm assigns resources to users to optimize the performance of the system (e.g., in terms of throughput) based on this feedback [21]. Based on the link measurement model, the link performance model predicts the BLER of the link, based on the receiver SINR and the transmission parameters (e.g., modulation and coding). Figure 5 illustrates the interaction between the two models and the several physical layer parameters.
Implementationwise, the simulator follows the structure shown in Figure 6. Each network element is represented by a suitable class object, whose interactions are described below.
In order to generate the network topology, transmission sites are generated, to which three eNodeBs are appended, i.e., sectors, each containing a scheduler (see Figure 6). In the simulator, traffic modeling assumes full buffers in the downlink. A scheduler assigns PHY resources, precoding matrices, and a suitable MCS to each UE attached to an eNodeB. The actual assignment depends on the scheduling algorithm and the received UE feedback.
At the UE side, the received subcarrier postequalization symbol SINR is calculated in the link measurement model. The SINR is determined by the signal, interference, and noise power levels, which are dependent on the cell layout (defined by the eNodeB positions, largescale (macroscopic, macroscale) pathloss, shadow fading [58]), and the timevariant smallscale (microscopic, microscale) fading [59].
The CQI feedback report is calculated based on the subcarrier SINRs and the target transport BLER. The CQI reports are generated by an SINRtoCQI mapping [35] and made available to the eNodeB implementation via a feedback channel with adjustable delay. At the transmitter, the appropriate MCS is selected by the CQI to achieve the targeted BLER during the transmission. Especially in high mobility scenarios, the feedback delay caused by computation and signaling timings can lead to a performance degradation if the channel state changes significantly during the delay. In the link performance model, an AWGNequivalent SINR (γAWGN) is obtained via Mutual Information Effective Signal to Interference and Noise Ratio Mapping (MIESM) [60–62]. In a second step, γ_{AWGN} is mapped to BLER via AWGN link performance curves [34, 35]. The BLER value acts as a probability for computing ACK/NACKs, which are combined with the Transport Block (TB) size to compute the link throughput. The simulation output consists of traces, containing link throughput and error ratios for each user, as well as cell aggregates, from which statistical distributions of throughputs and errors can be extracted.
B. Complexity
One desirable functionality of a system level simulator is the ability to precalculate as many of the simulation parameters as possible. This not only reduces the computational load while carrying out a simulation, but also offers repeatability by loading an already partly precalculated scenario.
The precalculations involved in the LTE system level simulator are the generation of (i) eNodeBdependent largescale pathloss maps, (ii) sitedependent shadow fading maps, and (iii) timedependent smallscale fading traces for each eNodeBUE pair.
1) Pathloss and fading maps
The largescale pathloss and the shadow fading are modeled as positiondependent maps. The largescale pathloss is calculated according to wellknown models [58, 63] and combined with the antenna gain pattern of the corresponding eNodeB. Spacecorrelated shadow fading is obtained from a lognormal random distribution using a lowcomplexity variant of the Cholesky decomposition [64]. Intersite map correlation for shadow fading is similarly obtained. Figure 7 shows exemplary largescale pathloss and shadow fading maps.
2) Timedependent fading trace
While the largescale pathloss and the shadow fading are modeled as positiondependent trace, the smallscale fading is modeled as a timedependent trace. The calculation of this latter trace is based on the transmitter precoding, the smallscale fading MIMO channel matrix, and the receive filter. Currently, the receiver modeling is based on a linear ZF receiver. The smallscale fading trace consists of the signal power and the interference power after the receive filter. The breakdown into these two parts significantly reduces the computational effort since it avoids many complex multiplications required when directly working with MIMO channel matrices on system level [16, 35, 51].
4. Validation of the simulators
The validation of the simulators was performed in two steps. First, in Section 4A we compared the link level throughput with the minimum performance requirements stated by 3GPP in the technical specification TS 36.101 [65]. Second, in Section 4B, we crossvalidated the link and the system level simulators by comparing their results against each other. Other means of validation are being discussed in Section 4C.
A. 3GPP minimum performance requirements
The technical specification TS 36.101 [65] defines minimum performance requirements for a UE that utilizes a dualantenna receiver. These requirements have to be met by real devices and therefore have to be surpassed by our simulator, in which not every conceivable influential factor is incorporated.^{b} Such factors may include frequency and timing synchronization as well as other nonideal effects, such as quantization or nonideality of the manufactured physical components (e.g., I/Q imbalances, phase noise, and power amplifier nonlinearities).
In particular, TS 36.101 specifies reference measurement channels for the Physical Downlink Shared Channel (PDSCH) (comprising bandwidth, AMC scheme, overhead,...) and propagation conditions (power delay profiles, Doppler frequencies, and antenna correlation). The considered simulation scenarios are completely specified by referring to sections and test numbers in TS 36.101. For example, in TS 36.101 Section 8.2.1.1.1, the tests for a single transmit antenna N_{ T } = 1 and dual receive antenna N_{ R } = 2 scenario are defined. By referring to test number one in Section 8.2.1.1.1 of TS 36.101, the AMC mode is defined as Quadrature Phase Shift Keying (QPSK) with a target coding rate of 1/3, Extended Vehicular A (EVehA) channel model with a Doppler frequency of 5 Hz, and low antenna correlation. For our simulations presented in this article, we selected four test scenarios with a bandwidth of 10 MHz but different transmit modes (single antenna port transmission, OLSM, and TxD), different AMC schemes, and different channel models. Hybrid Automatic Repeat reQuest (HARQ) is supported by at most three retransmissions. The most important parameters of the test scenarios are listed in Table 1. The first scenario (8.2.1.1.1/1) refers to the test scenario described above. The OLSM scenario (8.2.1.3.2/1) utilizes a rank two transmission, that is, transmission of two spatial streams.
Simulation results for the considered scenarios are shown in Figure 8. The dashed horizontal lines correspond to 70% of the maximum throughput values for which TS 36.101 defines a channel signaltonoise ratio (SNR) requirement (shown as crosses in Figure 8). For all the considered test scenarios, the link level simulator outperforms the minimum requirements by approximately 23 dB. The small vertical bars within the markers in 8 are the 99% confidence intervals of the simulated mean throughput. Since the confidence intervals are much smaller than the distances between the individual throughput curves, we know that a repeated simulation with different seeds of the random number generators will lead to similar results and conclusions. Figure 8 can be reproduced by calling the script Reproducibility_RAN_sims.m included in the link level simulator.
B. Link and system level crosscomparison
Next, we crosscompare the performance of the link and system level simulators. We consider a single user singlecell scenario with different antenna configurations and transmit modes, as summarized in Table 2.
Depending on the channel conditions, we adapt the AMC scheme, the transmission rank, and the precoding matrices. For this purpose, we utilize the UE feedback schemes originally presented in [13]. In order to create an equivalent simulation scenario on link and system level, we do not employ shadow fading. While on link level the SNR is usually directly specified, on system level the SNR is a function of the user location in the cell. Without shadow fading, the user SNR on system level becomes a function of the distance between basestation and the user. This can be utilized to indirectly select appropriate SNR values in the system level simulator. The results of the link and system level comparisons are shown in Figure 9. For all the considered simulation scenarios, we obtain an excellent match between the results of the two simulators, confirming the validity of our Link Error Prediction (LEP) model [50] on system level. Figure 9 can be reproduced by running the script Reproducibility _LLvsSL _batch.m provided in the system level simulator package. Further comparisons between link and system level simulator results are shown in Section 5B.
In Table 2 we compare the simulation times of the link level simulator to those of the system level simulator. The simulations were conducted on a single core of a 2.66 GHz Quad Core CPU. The table also states the simulation speedup, defined as the ratio of the simulation times required with the link level and the system level simulator, respectively. The speedup of the system level simulator for a SingleInput SingleOutput (SISO) system equals four. This speedup is rather small because equalization, demodulation, and decoding (tasks that are abstracted on system level) have low complexity in a SISO system. With increasing system complexity also the speedup increases. We expected the largest speedup in the CLSM scenario, because it utilizes the largest antenna configuration. However, we measured the largest speedup of almost 18 in the OLSM simulation scenario. The reason is, that the precoder changes from one subcarrier to the next, while in the CLSM scenario, we assumed wideband feedback meaning that the same precoder is employed on all the subcarriers [13].
The link level simulator supports the parallel computing capabilities of MATLAB. With these features, it is possible to run several MATLAB instances in parallel on the multiple cores of a modern CPU. The simulation time of the link level simulator then decreases linearly with the number of CPU cores, while the system level simulator is currently not capable of parallel computing.
C. Further validation means
For a basic validation of the correctness of the results produced by the simulator, we checked the uncoded BER and throughput performance over frequency flat Rayleigh fading and AWGN channels, as the theoretical performance of these channels is known [66]. Furthermore, we crosschecked our results with those produced by the other industry simulators, by comparing with corresponding publications of the 3GPP RAN WG1, e.g., [28, 29]. Still, an open issue is to prove a correct functionality of each part of the simulator. Evaluation of the simulators has also been made possible for the whole research community, allowing everybody to modify the code to meet individual requirements and to check the code for correctness [67–69], as the simulator's changelog reflects. The first versions of the simulators have been released in May 2009 (link level simulator) and in March 2010 (system level simulator), respectively. To facilitate the exchange of bugs and/or results often referred to as "crowdsourcing," a forumc is also provided. While the authors acknowledge this is not a perfect form of validation, neither is any other.
5. Exemplary results
In this section, we show two exemplary simulation results obtained with the Vienna LTE simulators. First, we present a link level throughput simulation in which we compare the throughput of the different MIMO schemes to theoretic bounds. Based on this simulation setup, researchers can investigate algorithms such as channel estimation, detection, or synchronization. Second, we compare the performance of different stateoftheart schedulers in a singlecell multiuser environment. These schedulers serve as reference for researchers investigating advanced scheduling techniques.
A. Link level throughput
Before presenting the link level throughput results of the different LTE MIMO schemes, we introduce theoretic bounds for the throughput. We identify three bounds, namely, the mutual information, the channel capacity, and the socalled achievable mutual information. Depending on the type of channel state information available at the transmitter (only receive SNR, full, or quantized), an ideal transmission system is expected to attain one of these bounds.
1) Mutual information
The mutual information is the theoretic bound for the data throughput if only the receive SNR but no further channel state information is available at the transmitter side [70]:
where B_{sub} denotes the bandwidth occupied by a single data subcarrier, H_{ k } the N_{R}×N_{T} (= number of receive antennas × number of transmit antennas) dimensional MIMO channel matrix of the kth subcarrier, the energy of noise and interference at the receiver, N_{tot} the total number of usable subcarriers, and an identity matrix of size equal to the number of receive antennas N R. In Equation (1), we normalized the transmit power to one and the channel matrix according to . Therefore, Equation (1) does not show a dependence on the transmit power and the number N_{ T } of transmit antennas.
The bandwidth B_{sub} of a subcarrier is calculated as
where N_{s} is the number of OFDM symbols in one subframe (usually equal to 14 when the normal cyclic prefix length is selected), T_{sub} the subframe duration (1 ms), and T_{cp} the time required for the transmission of all cyclic prefixes within one subframe. Note that we are calculating the mutual information for all usable subcarriers of the OFDM system, thereby taking into account the loss in spectral efficiency caused by the guard band carriers. If different transmission systems that apply different modulation formats are to be compared, however, a fair comparison then requires calculating the mutual information over the entire system bandwidth instead of calculating it only over the usable bandwidth.
Current communication systems employ adaptive modulation and coding schemes to optimize the data throughput. For a specific receive SNR, assuming an optimum receiver, the modulation and coding scheme that maximizes the data throughput can be selected. Thus, if the transmitter knows the receive SNR, a throughput equal to the mutual information should be achieved.
2) Channel capacity
For calculating the channel capacity of a frequency selective MIMO channel [66], consider the singular value decomposition of the channel matrix H_{ k } scaled by the standard deviation σ_{n} of the additive white Gaussian noise impairment:
The optimum, capacityachieving, frequencydependent precoding at the transmitter is given by the unitary matrix V _{k}. If this precoding matrix is applied at the transmitter and also the optimum receive filter is employed, then the MIMO channel is separated into min(N_{R}, N_{T}) (with N R denoting the number of receive antennas and N_{T} the number of transmit antennas) independent SISO channels, each with a gain of , m = 1...min(N_{R}, N_{T}), k = 1... N_{tot}. The channel capacity is obtained by optimally distributing the available transmit power over these parallel SISO subchannels. The optimum power distribution P_{k, m}is the solution of the optimization problem:
where the second equation is a transmit power constraint that ensures an average transmit power equal to the number of data subcarriers: P_{t} = N_{tot}. Note that owing to the definition of in Equation (3), the power distribution P_{k, m}and thus P_{t} remain dimensionless. We calculate the power coefficients maximizing Equation (4) by the waterfilling algorithm described in [66]. In order to achieve a throughput equal to the channel capacity, the transmitter needs full channel state information and has to apply the optimum precoder. Furthermore, the receiver needs to apply the optimum receive filter to separate the parallel SISO subchannels.
3) Achievable mutual information
Both mutual information and channel capacity do not consider system design losses caused, for example, by the transmission of cyclic prefix or reference symbols, or the quantization of the transmitter precoding. In order to obtain a tighter bound for the link level throughput, we therefore consider these effects in the definition of the socalled achievable mutual information. In the case of openloop transmission, in which spacetime coding is employed at the transmitter, we obtain for the achievable mutual information:
with N_{L} denoting the number of spatial transmission layers. The N_{R}N_{L}×N T dimensional matrix is the effective channel matrix including the spacetime coding [71]. The factor F accounts for the inherent system losses due to the transmission of the cyclic prefix and the reference symbols. In detail, the factor F is calculated as
where N_{ref} is the number of reference symbols per resource block, and N_{sc} = 12 is the number of subcarriers in each RB. In LTE, the number of reference symbols depends on the number of transmit antennas. Therefore, the efficiency factor F decreases with increasing number of transmit antennas (see Table 3).
In the case of closedloop transmission, a channeladapted precoding matrix W is chosen from a set (defined in the standard) and applied to the transmit signal. We calculate the achievable mutual information for closedloop transmission as
In Figure 10, the throughput of a 2×2 LTE system with 5 MHz bandwidth, perfect channel knowledge, and a Soft Sphere Decoder (SSD) receiver is shown and compared to the previously presented theoretic bounds. The difference between channel capacity and mutual information is only small, and, therefore, even knowledge of the full channel state information at the transmitter does not considerably increase the potential performance. In contrast, the difference between the mutual information and the achievable mutual information is much larger, resulting in a loss of 56% at an SNR of 15 dB. Most (41%) of this loss is due to the restrictions implied by the standard, as indicated by the achievable mutual information curves in Figure 10. At a rate of 16 Mbit/s, the difference between achievable mutual information and simulated throughput is approximately 4 dB. These findings are similar to the results we obtained when analyzing the performance of WiMAX and HighSpeed Downlink Packet Access (HSDPA) in [72].
Figure 10 furthermore shows that, for SNRs lower than 14 dB, the TxD mode outperforms OLSM. Only at larger SNRs, above 20 dB, where the throughput of the TxD mode saturates, OLSM benefits from the second spatial stream and outperforms TxD.
Figure 10 can be reproduced by executing the script Physical _Layer _batch.m provided in the Vienna LTE Link Level Simulator package.
B. LTE scheduling
In this section, the performance of various multiuser LTE scheduling techniques is compared by means of link level and system level simulations. By appropriately selecting the simulation parameters in the link level, as well as the system level, we are able to show that the results obtained by the two simulators are equivalent.
In particular, we consider in the Vienna LTE System Level Simulator one sector of a singlecell SISO system with 20 randomly positioned users. The user positions yield the largescale path loss and shadow fading coefficients of all the users, and as a consequence, the average receive SNRs, which are distributed in a range of 2.7 dB to 36 dB. These average receive SNRs of the 20 users are set in the Vienna LTE Link Level Simulator to ensure the same propagation environment as on system level. Further simulation parameters of both simulators are summarized in Table 4.
The simulation results are averaged over 2,500 smallscale fading and noise realizations. In order to guarantee exactly the same channel realizations for all scheduler simulations on system level, the user positions, as well as the small and largescale fading realizations are loaded from pregenerated files. On link level, the seeds of the random number generators for fading and noise generation are set at the beginning of each simulation.
A performance comparison of different scheduling strategies is shown in Figures 11 and 12 in terms of total sector throughput and fairness (Jain's fairness index [73]). The figures show that the results produced by the link and system level simulators are very similar for both throughput and fairness. The largest difference between the results of the two simulators is less than 2%, while the 99% confidence intervals (too small to be identified in the figures) of the simulated throughput are much smaller. Thus, we conclude that the system level simulator is properly calibrated; that is, the approximation and modeling of the link level does not result in large errors on system level.
The considered schedulers pursue different goals for resource allocation. The best CQI scheduler tries to maximize total throughput and completely ignores fairness by just assigning resources to the users with the best channel conditions. This is reflected in the simulation results in Figures 11 and 12, showing the highest system throughput and the lowest fairness for the best CQI scheduler. In contrast, the maxminscheduler assigns the resources in a way that equal throughput for all users is guaranteed, thereby maximizing Jain's fairness index [73]. Round robin scheduling does not consider the user equipment feedback and cyclically assigns the same amount of resources to each user. Thus, ignoring the user equipment feedback results in the worst throughput performance of all schedulers consider here. The proportional fair scheduler emphasizes multiuser diversity by scheduling the user who has the best current channel realization relative to its own average. The resource fair scheduling strategy guarantees an equal amount of resources for all users while trying to maximize the total throughput. In the simulations, the proportional fair strategy outperforms resource fair in terms of throughput as well as fairness thereby resulting in a good tradeoff between throughput and fairness. Further details about the implemented schedulers, as well as more simulation results, can be found in [21].
The presented simulation results can be reproduced by calling the script Reproducibility _Schedulers _batch.m that can be found in the directory "paper scripts" of the link level and the system level simulator, respectively. More examples of the Vienna LTE simulators also in the context of LTEAdvanced are presented in [74].
6. Conclusions
In this paper, we presented the Vienna LTE Simulators, consisting of a link level and a system level simulator. Both simulators are available under a noncommercial open source academicuse license and thereby enable researchers to implement and test algorithms in the context of LTE. The open source availability of the simulators facilitates researchers to reproduce published results in the context of LTE, and thus supports the comparison of novel algorithms with previous stateoftheart. So far (July 2011), the simulators have been downloaded more than 18,000 times from all over the world.
Endnotes
^{a}Note that the scheduler in a multiuser system will change the statistics of the individual user's channel, thus influencing the receiver performance. ^{b}After all, the purpose of a simulation model is to abstract and thus simplify complex situations.^{c}http://www.nt.tuwien.ac.at/forum and http://www.nt.tuwien.ac.at/forum.
Abbreviations
 3GPP:

third generation partnership project
 AMC:

adaptive modulation and coding
 ARQ:

automatic repeat request
 AWGN:

additive white Gaussian noise
 BER:

bit error ratio
 BLER:

block error ratio
 CDF:

cumulative density function
 CDMA:

codedivision multiple access
 CoMP:

cooperative multipoint
 CPICH:

common pilot channel
 CQI:

channel quality indicator
 CRC:

cyclic redundancy check
 CSI:

channel state information
 DoF:

degrees of freedom
 DTxAA:

double transmit antenna array
 ECR:

effective code rate
 EESM:

exponential effective SINR mapping
 FDD:

frequency division duplex
 FFT:

fast fourier transform
 GSM:

global system for mobile communications
 HSDPA:

highspeed downlink packet access
 HSPA:

highspeed packet access
 HSDPCCH:

highspeed dedicated physical control channel
 HSDSCH:

highspeed downlink shared channel
 HSPDSCH:

highspeed physical downlink shared channel
 HSSCCH:

highspeed shared control channel
 HSUPA:

highspeed uplink packet access
 IMS:

IP multimedia subsystem
 ICI:

inter carrier interference
 ISI:

inter symbol interference
 ITU:

international telecommunication union
 LEP:

link error prediction
 LTEA:

LTE advanced
 LMMSE:

linear minimum mean squared error
 MAChs:

medium access control for HSDPA
 MCS:

modulation and coding scheme
 MIESM:

mutual information effective SINR mapping
 MIMO:

multipleinput multipleoutput
 MUMIMO:

multiUser MIMO
 MVU:

minimum variance unbiased
 NACK:

nonacknowledged
 PCI:

precoding control information
 PMI:

precoding matrix indicator
 PedA:

pedestrian A
 PedB:

pedestrian B
 RAN:

radio access network
 RB:

resource block
 RI:

rank indicator
 ROI:

region of interest
 RLC:

radio link control
 RRC:

radio resource control
 UE:

user equipment
 OFDMA:

orthogonal frequency division multiple access
 OFDM:

orthogonal frequency division multiplexing
 PDP:

power delay profile
 SAE:

system architecture evolution
 SCM:

spatial channel model
 SISO:

singleinput singleoutput
 SM:

spatial multiplexing
 SINR:

signal to interference and noise ratio
 SNR:

signaltonoise ratio
 SQP:

sequential quadratic programming
 STMMSE:

spacetime MMSE
 SU:

single user
 TB:

transport block
 TBS:

transport block size
 TTI:

transmission time interval
 TxAA:

transmit antenna array
 UMTS:

universal mobile telecommunications system
 UTRA:

UMTS terrestrial radio access
 WCDMA:

wideband CDMA
 ZF:

zeroforcing.
References
 1.
Barni M, PerezGonzalez F: Pushing science into signal processing. IEEE Signal Process. Mag 2005,22(4):120119.
 2.
Vandewalle P, Kovačević J, Vetterli M: Reproducible research in signal processing. IEEE Signal Process. Mag 2009,26(3):3747.
 3.
Dohler M, Heath R Jr, Lozano A, Papadias CB, Valenzuela RA: Is the PHY layer dead? IEEE Communications Magazine 2011, (4):159165.
 4.
Buckheit JB, Donoho DL: Wavelab and reproducible research. Dept. of Statistics, Stanford Univ., Tech. Rep. 474, Tech. Rep 1995. [http://wwwstat.stanford.edu/~donoho/Reports/1995/wavelab.pdf]
 5.
Vandewalle P, Süsstrunk S, Vetterli M: A frequency domain approach to registration of aliased images with application to superresolution. EURASIP Journal on Applied Signal Processing 2006., 2006: Article ID 71459
 6.
Mehlführer C, Caban S, Rupp M: Experimental evaluation of adaptive modulation and coding in MIMO WiMAX with limited feedback. EURASIP Journal on Advances in Signal Processing, Special Issue on MIMO Systems with Limited Feedback 2008., 2008: Article ID 837102
 7.
Šimko M, Wu D, Mehlführer C, Eilert J, Liu D: Implementation Aspects of Channel Estimation for 3GPP LTE Terminals. In Proc. European Wireless (EW 2011). Vienna, Austria; 2011.
 8.
Dallinger R, Ruotsalainen H, Wichman R, Rupp M: Adaptive predistortion techniques based on orthogonal polynomials. Conference Record of the 44th Asilomar Conference on Signals, Systems and Computers, Pacific Grove (CA), USA 2010.
 9.
Technical Specification Group RAN: EUTRA; LTE physical layer  general description. 3GPP, Tech. Rep. TS 36.201 Version 8.3.0 2009.
 10.
Williams C, McLaughlin S, Beach MA: Exploiting multiple antennas for synchronization. IEEE Trans. Veh. Technol 2009,58(2):773787.
 11.
Wang Q, Caban S, Mehlführer C, Rupp M: Measurement based throughput evaluation of residual frequency offset compensation in WiMAX . Proc. 51st International Symposium ELMAR2009, Zadar, Croatia 2009, 233236.
 12.
Kolehmainen N, Puttonen J, Kela P, Ristaniemi T, Henttonen T, Moisio M: Channel quality indication reporting schemes for UTRAN long term evolution downlink. Proc. IEEE Vehicular Technology Conference Spring (VTC) 2008, 25222526.
 13.
Schwarz S, Mehlfuhrer C, Rupp M: Calculation of the spatial preprocessing and link adaption feedback for 3GPP UMTS/LTE. Proc. IEEE Wireless Advanced," London, UK 2010.
 14.
Boher L, Legouable R, Rabineau R: Performance analysis of iterative receiver in 3GPP/LTE DL MIMO OFDMA system. Proc. IEEE 10th International Symposium on Spread Spectrum Techniques and Applications (ISSSTA) 2008, 103108.
 15.
Wrulich M, Rupp M: Performance and modeling of LTE HARQ. Proc. International ITG Workshop on Smart Antennas (WSA 2009), Berlin, Germany 2009.
 16.
Wrulich M, Rupp M: Computationally efficient MIMO HSDPA systemlevel modeling. EURASIP Journal on Wireless Communications and Networking 2009., 2009: Article ID 382501
 17.
Cover TM: Comments on broadcast channels. IEEE Trans. Inf. Theory 1998,44(6):25242530. 10.1109/18.720547
 18.
Weingarten H, Steinberg Y, Shamai S: The capacity region of the gaussian multipleinput multipleoutput broadcast channel. IEEE Trans. Inf. Theory 2006,52(9):39363964.
 19.
Niesen U, Gupta P, Shah D: The balanced unicast and multicast capacity regions of large wireless networks. IEEE Trans. Inf. Theory 2010,56(5):22492271.
 20.
Skoutas D, Komnakos D, Vouyioukas D, Rouskas A: Enhanced dedicated channel scheduling optimization in WCDMA. Proc. 14th European Wireless Conference (EW) 2008.
 21.
Schwarz S, Mehlführer C, Rupp M: Low complexity approximate maximum throughput scheduling for LTE. Conference Record of the 44th Asilomar Conference on Signals, Systems and Computers, Pacific Grove, CA, USA 2010.
 22.
Peppas K, AlGizawi T, Lazarakis F, Axiotis D, Moussa A, Alexiou A: System level evaluation of reconfigurable MIMO techniques enhancements for HSDPA. Proc. IEEE Global Telecommunications Conference (GLOBECOM) 2004, 5: 28692873.
 23.
Gkonis P, Kaklamani D, Tsoulos G: Capacity of WCDMA multicellular networks under different radio resource management strategies. Proc. 3rd International Symposium on Wireless Pervasive Computing (ISWPC) 2008, 6064.
 24.
Castañeda M, Ivrlac M, Nossek J, Viering I, Klein A: On downlink intercell interference in a cellular system. Proc. IEEE 18th International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC) 2007, 15.
 25.
Nihtila T, Haikola V: HSDPA MIMO system performance in macro cell network. Proc. IEEE Sarnoff Symposium 2008.
 26.
Pedersen KI, Lootsma TF, Stottrup M, Frederiksen F, Kolding T, Mogensen PE: Network performance of mixed traffic on high speed downlink packet access and dedicated channels in WCDMA. Proc. IEEE 60th Vehicular Technology Conference (VTC) 2004, 6: 44964500.
 27.
Jafar SA, Fakhereddin MJ: Degrees of freedom for the MIMO interference channel. IEEE Trans. Inf. Theory 2007,53(7):26372642.
 28.
Nortel: Performance evaluation of CL MIMO under different UE speed. 3rd Generation Partnership Project (3GPP), Tech. Rep. R1080384 2008.
 29.
Nokia & NokiaSiemensNetworks: LTE performance benchmarking. 3rd Generation Partnership Project (3GPP), Tech. Rep. R1 071960 2007.
 30.
steepest ascent: 3GPP LTE toolbox and blockset. 2009.
 31.
mimoOn: mi!mobile. 2009.
 32.
Aricent: LTE layer 1  LTE baseband/PHY library. 2009.
 33.
Sánchez JJ, Gómez G, MoralesJiménez D, Entrambasaguas JT: Performance evaluation of OFDMA wireless systems using WMSIM platform. Proc. ACM 4th International Workshop on Mobility Management and Wireless Access (MobiWac) 2006, 131134.
 34.
Mehlführer C, Wrulich M, Ikuno JC, Bosanska D, Rupp M: Simulating the long term evolution physical layer. Proc. 17th European Signal Processing Conference (EUSIPCO 2009) Glasgow, Scotland, UK 2009, 14711478.
 35.
Ikuno JC, Wrulich M, Rupp M: System level simulation of LTE networks. Proc. 2010 IEEE 71st Vehicular Technology Conference (VTC2010Spring)," Taipei, Taiwan 2010.
 36.
Technical Specification Group RAN: EUTRA; physical channels and modulation. 3GPP, Tech. Rep. TS 36.211 Version 8.7.0 2009.
 37.
Technical Specification Group RAN: EUTRA; multiplexing and channel coding. 3GPP, Tech. Rep. TS 36.212 2009.
 38.
Technical Specification Group RAN: EUTRA; physical layer procedures. 3GPP, Tech. Rep. TS 36.213 2009.
 39.
Wang X, Giannakis G, Marques A: A unified approach to QoSguaranteed scheduling for channeladaptive wireless networks. Proceedings of the IEEE 2007,95(12):24102431.
 40.
Raymond Kwan CL, Zhang J: Multiuser scheduling on the downlink of an LTE cellular system. Research Letters in Communications 2008., 2008: Article ID 323048
 41.
Schwarz S, Mehlführer C, Rupp M: Throughput maximizing multiuser scheduling with adjustable fairness. Proc. IEEE International Conference on Communications (ICC 2011), Kyoto, Japan 2011.
 42.
Members of ITU:: Recommendation ITUR M.1225: Guidelines for evaluation of radio transmission technologies for IMT2000. International Telecommunication Union (ITU), Tech. Rep 1997.
 43.
Hentilä L, Kyösti P, Kaske M, Narandzic M, Alatossava M:MATLAB implementation of the WINNER phase ii channel model ver1.1. 2007. [http://www.istwinner.org/phase_2_model.html]
 44.
Šimko M, Mehlführer C, Wrulich M, Rupp M: Doubly dispersive channel estimation with scalable complexity. Proc. International ITG Workshop on Smart Antennas (WSA 2010), Bremen, Germany 2010, 251256.
 45.
Wang Q, Mehlführer C, Rupp M: Carrier frequency synchronization in the downlink of 3GPP LTE. Proc. 21st Annual IEEE International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC 2010), Istanbul, Turkey 2010.
 46.
Šimko M, Mehlführer C, Zemen T, Rupp M: Inter carrier interference estimation in MIMO OFDM systems with arbitrary pilot structure. Proc. 73rd IEEE Vehicular Technology Conference (VTC2011Spring), Budapest, Hungary 2011.
 47.
I Solutions: Iterative Solutions Coded Modulation Library (ISCML).[http://www.iterativesolutions.com/]
 48.
Pircher T: pycrc CRC calculator and C source code generator.[http://www.tty1.net/pycrc/]
 49.
Wang Q, Mehlführer C, Rupp M: SNR optimized residual frequency offset compensation for WiMAX with throughput evaluation. Proc. 17th European Signal Processing Conference (EUSIPCO 2009), Glasgow, Scotland, UK 2009.
 50.
Ikuno JC, Mehlführer C, Rupp M: A novel link error prediction model for OFDM systems with HARQ. Proc. IEEE International Conference on Communications (ICC 2011), Kyoto, Japan 2011.
 51.
Wrulich M, Eder S, Viering I, Rupp M: Efficient linktosystem level model for MIMO HSDPA. Proc. of the 4th IEEE Broadband Wireless Access Workshop," New Orleans, LA, USA 2008.
 52.
Mehlführer C, Wrulich M, Rupp M: Intracell interference aware equalization for TxAA HSDPA. Proc. 3rd IEEE International Symposium on Wireless Pervasive Computing (ISWPC 2008), Santorini, Greece 2008, 406409.
 53.
Ibing A, Jungnickel V: Joint transmission and detection in hexagonal grid for 3GPP LTE. Proc. International Conference on Information Networking 2008 (ICOIN 2008) 2008.
 54.
Cadambe V, Jafar S: Interference alignment and degrees of freedom of the Kuser interference channel. IEEE Trans. Inf. Theory 2008,54(8):34253441.
 55.
Tresch R, Guillaud M: Cellular interference alignment with imperfect channel knowledge. IEEE International Conference on Communications Workshops 2009 (ICC Workshops 2009) 2009.
 56.
Wu P, Jindal N: Performance of hybridARQ in blockfading channels: A fixed outage probability analysis. IEEE Transactions on Communications 2010,58(4):11291141.
 57.
Blankenship Y, Sartori P, Classon B, Desai V, Baum K: Link error prediction methods for multicarrier systems. Proc. IEEE 60th Vehicular Technology Conference (VTC2004Fall) 2004, 6: 41754179.
 58.
Technical Specification Group RAN: EUTRA; LTE RF system scenarios. 3GPP, Tech. Rep. TS 36.942 2008.
 59.
Zemen T, Mecklenbräuker C: Timevariant channel estimation using discrete prolate spheroidal sequences. IEEE Trans. Signal Process 2005,53(9):35973607.
 60.
Kim J, Ashikhmin A, van Wijngaarden A, Soljanin E, Gopalakrishnan N: On efficient link error prediction based on convex metrics. Proc. IEEE 60th Vehicular Technology Conference (VTC2004Fall) 2004, 6: 41904194.
 61.
Tsai S, Soong A: EffectiveSNR mapping for modeling frame error rates in multiplestate channels. 3GPP2, Tech. Rep. 3GPP2C3020030429010 2003.
 62.
Wan L, Tsai S, Almgren M: A fadinginsensitive performance metric for a unified link quality model. Proc. IEEE Wireless Communications and Networking Conference (WCNC2006) 2006, 4: 21102114.
 63.
Technical Specification Group RAN: Physical layer aspects for EUTRA. 3GPP, Tech. Rep. TS 25.814 2006.
 64.
Claussen H: Efficient modelling of channel maps with correlated shadow fading in mobile radio systems. Proc. IEEE 16th International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC2005) 2005, 1: 512516.
 65.
Technical Specification Group RAN: Evolved universal terrestrial radio access (EUTRA); user equipment (UE) radio transmission and reception. 3GPP, Tech. Rep. TS 36.101 Version 8.5.1 2009.
 66.
Paulraj A, Nabar R, Gore D: Introduction to SpaceTime Wireless Communications. 1st edition. Cambridge Univ. Press; 2003.
 67.
Feng Y, Krewski A, Schroeder WL: Simulation based comparison of metrics and measurement methodologies for OTA test of MIMO terminals. Proc. of the Fourth European Conference on Antennas and Propagation (EuCAP 2010) 2010.
 68.
Muntean VH, Otesteanu M, Muntean GM: QoS parameters mapping for the elearning traffic mix in LTE networks. Proc. International Joint Conference on Computational Cybernetics and Technical Informatics (ICCCCONTI 2010) 2010, 299304.
 69.
Wu D, Eilert J, Asghar R, Liu D: VLSI implementation of a fixedcomplexity softoutput MIMO detector for highspeed wireless. EURASIP Journal on Wireless Communications and Networking 2010., 2010: Article ID 893184
 70.
Mehlführer C, Caban S, Rupp M: Measurementbased performance evaluation of MIMO HSDPA. IEEE Transactions on Vehicular Technology, accepted for publication
 71.
Badic B, Rupp M, Weinrichter H: Adaptive channelmatched extended alamouti spacetime code exploiting partial feedback. ETRI Journal 2004,26(5):443451. 10.4218/etrij.04.0703.0006
 72.
Rupp M, Mehlführer C, Caban S: On achieving the Shannon bound in cellular systems. Proc. 20th International Conference Radioelektronika 2010," Brno, Czech Republik 2010.
 73.
Jain R, Chiu D, Hawe W: A Quantitative Measure of Fairness and Discrimination for Resource Allocation in Shared Computer Systems. DEC, Tech. Rep. TR301 1984.
 74.
Caban S, Mehlführer C, Rupp M, Wrulich M: Evaluation of HSDPA and LTE, From Testbed Measurements to System Level Performance. Wiley; 2011.
 75.
3GPP: Technical Specification Group Radio Access Networks; Deployment aspects (Release 8).2008. [http://www.3gpp.org/ftp/Specs/htmlinfo/25943.htm]
 76.
Technical Specification Group Radio Access Network: Deployment aspects (Release 8). 3GPP, Tech. Rep. TS 25.943 Version 8.0 2008.
Acknowledgements
This work has been funded by the Christian Doppler Laboratory for Wireless Technologies for Sustainable Mobility, KATHREINWerke KG, and A1 Telekom Austria AG. The financial support by the Federal Ministry of Economy, Family and Youth and the National Foundation for Research, Technology and Development is gratefully acknowledged. The authors would like to thank Christoph F. Mecklenbräuker for his valuable comments and fruitful discussions.
Author information
Additional information
Competing interests
The authors declare that they have no competing interests
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Received
Accepted
Published
DOI
Keywords
 LTE
 MIMO
 link level
 system level
 simulation
 reproducible research