- Research Article
- Open Access
Inverse Modeling of Respiratory System during Noninvasive Ventilation by Maximum Likelihood Estimation
© Esra Saatci and Aydin Akan. 2010
- Received: 2 October 2009
- Accepted: 31 May 2010
- Published: 22 June 2010
We propose a procedure to estimate the model parameters of presented nonlinear Resistance-Capacitance (RC) and the widely used linear Resistance-Inductance-Capacitance (RIC) models of the respiratory system by Maximum Likelihood Estimator (MLE). The measurement noise is assumed to be Generalized Gaussian Distributed (GGD), and the variance and the shape factor of the measurement noise are estimated by MLE and Kurtosis method, respectively. The performance of the MLE algorithm is also demonstrated by the Cramer-Rao Lower Bound (CRLB) with artificially produced respiratory signals. Airway flow, mask pressure, and lung volume are measured from patients with Chronic Obstructive Pulmonary Disease (COPD) under the noninvasive ventilation and from healthy subjects. Simulations show that respiratory signals from healthy subjects are better represented by the RIC model compared to the nonlinear RC model. On the other hand, the Patient group respiratory signals are fitted to the nonlinear RC model with lower measurement noise variance, better converged measurement noise shape factor, and model parameter tracks. Also, it is observed that for the Patient group the shape factor of the measurement noise converges to values between 1 and 2 whereas for the Control group shape factor values are estimated in the super-Gaussian area.
- Mean Square Error
- Chronic Obstructive Pulmonary Disease Patient
- Measurement Noise
- Maximum Likelihood Estimation
- Respiratory Signal
The assessment of the respiratory function is an important part of the clinical medicine . Although the clinicians use some standard evaluation techniques and there are bewildering variety of computerized test equipments, the automatic measurement of the lung mechanics requires further work. The main existing problems presented are the following. (i) The lung is a dynamic system such that its parameters should be monitored continuously even with the ventilatory assistance ; (ii) the signals measured at the output of this dynamic system, the input, and the system parameters might be nonlinearly related to each other over one breathing period [2, 3]; and (iii) the proposed methods for investigating the lung mechanics should not require any kind of patient's cooperation.
Using the measured respiratory signals (i.e., airway flow, , and airway pressure (mask pressure), ), in the literature, conventional least square (LS) and recursive least square methods were used to estimate the linear and nonlinear model parameters of the respiratory system [4–7]. Regarding the measured time series of airway flow and mask pressure, the abovementioned studies have two major assumptions: (i) the airway flow and the mask pressure are deterministic signals, and (ii) the uncertainty (referred to as a measurement noise) between the measurements and the model is zero-mean Gaussian distributed white noise. However, to the best of our knowledge, there is no study which attempts to define the noise in the respiratory system model fitting to the measured respiratory signals. Thus it is of interest to choose generalized noise model to express the measurement noise involved in the respiratory system identification problem.
In this study, we present the well-known Maximum Likelihood Estimation (MLE) for the respiratory parameter estimation, by assuming that the measurement noise is General Gaussian Distributed (GGD). MLE together with GGD constitute a statistically powerful method which allows more degrees of freedom to explore the statistical parameters of the measurement noise. In the simulations, recently presented nonlinear Resistance-Capacitance (RC) and widely used linear Resistance-Inductance-Capacitance (RIC) models [5, 8] were used to represent the respiratory system. Accordingly, one of our aims was to derive the theoretical expressions of the presented lung models in the framework of the MLE algorithm with the GGD noise model. In this respect, the artificially produced airway flow and the mask pressure signals that mimic the patients with Chronic Obstructive Pulmonary Disease (COPD) under non-invasive mechanical ventilation were used for the estimator assessment. Then, the parameters of both respiratory models were estimated from the observed signals collected from the COPD patients under non-invasive mechanical ventilation (Patient group) and the healthy subjects (Control group).
The rest of the paper is organized as follows. Section 2 reviews the nonlinear RC and RIC models of the respiratory system during non-invasive ventilation. The measurement equations of the models are also drawn in Section 2. In Section 3, MLE and GGD are summarized and the estimation of the RIC and nonlinear RC models' parameters is explained. Also estimator performance assessment criteria (i.e., the Cramer-RAO Lower Bound (CRLB)) were depicted in the same section. In Section 4, the experimental procedure was explained. The results of the simulations are presented and discussed in Section 5. Finally, in Section 6 conclusions are drawn.
where represents the effect of the maximal patient's effort on , and are the inspiration duration and the total duration of one respiration cycle, respectively. In this paper is added to the unknown parameter vector whereas and are set to constant values derived from the experimental signals. The time constant is an important parameter for mostly determining the expiratory asynchrony in the noninvasive ventilation . A constant value was chosen for in order to resemble the respiratory system.
Parameters of the respiratory signals in the simulations. ER and EMP stand for experimental reading and estimated model parameter, respectively.
300 (3 s)
where is the GGD measurement noise; and are the discrete versions of and ; discrete time steps are , and and are the parameter vectors to be estimated.
Deriving (4) and (5) constitutes the first step for the respiratory parameter estimation by MLE.
We now need to define the measurement noise and propose the probability distribution for the best convergence of the parameters.
3.1. Generalized Gaussian Distributed Noise Model
where is the many-to-one function that yields the left side of (4) or (5). can be defined as , where is the Gamma function and is a scaling factor which allows that . The variance and the shape factor of GGD are represented as and , respectively. These two parameters should be estimated in order to define the measurement noise. It is reminded that since the respiratory system, consequently respiratory signals, differs between diseased and healthy cases, we expect the parameters of GGD-based measurement noise to provide the valuable information about the respiratory models fit to the measured signals.
3.1.1. Measurement Noise Variance Estimation
It should also be noted that, in the above derivation, the system model parameters, , and the measurement noise shape factor, , are considered as known quantities.
3.1.2. Measurement Noise Shape Factor Estimation
where and denote the fourth- and second- order central moments of the measurement noise, respectively. However, (14) cannot be solved in the explicit form. Thus, a lookup table was generated for the inversion of the Kurtosis equation.
3.2. Estimation of the Model Parameters
Equations (15), (17), and (7) form the basis of the MLE algorithm. It should also be noted that in the above derivation the measurement noise shape factor, , and variance, , are considered as known quantities.
3.3. Estimator Performance Measurement
The MLE algorithm, shown in Algorithm 1, was coded in Matlab and applied first to the artificially generated respiratory signals (mask pressure, airway flow, and lung volume), then to respiratory signals acquired from the COPD patients with the noninvasive ventilator assistance, and finally to the healthy subjects. Before depicting the results from the real respiratory signals, the performance of the estimator which is bounded by the respiratory models and the properties of the respiratory signals should be demonstrated. In statistical signal processing there are two ways to measure the estimator's ability: (i) computing the Lower Bounds (LBs) on the estimator's variance and (ii) calculating the Mean Square Error (MSE) on the estimated parameters. Both LB and MSE are calculated with the true value of the parameters, thus with the artificial signals. In the case of real signals, we estimated the parameters from five different breath cycles of the same subject and plotted on the same figure. Apart from the effects of the small differences between breath cycles, the estimator is expected to result in the same parameter estimations. This procedure acts as a self-performance measurement in the real signal processing.
Algorithm 1: MLE Algorithm.
the parameter vector
the variance of ,
the shape factor of ,
for ( is the maximum number of iteration)
Estimate by (13)
Estimate by (14) and lookup table
Calculate the gradient vector of the logarithmic likelihood function by (15)
Calculate the Hessian matrix by (17)
Calculate by (7)
Continue until is converged
3.3.1. Artificial Respiratory Signal
The airway flow inside the upper airways was simulated as a sinusoidal signal with the parameters shown in Table 1. The lung volume (i.e., Tidal Volume) was calculated by the integration of the airway flow over one breathing cycle. Pressure inside the facemask was calculated by (14) for the nonlinear RC model and by (12) for the RIC model with the help of the model parameters shown in Table 1. Zero-mean white Gaussian noise with different SNR levels was then added to the airway pressure and airway flow.
3.3.2. Initial Values
Initial values selected for the simulations. stands for the Gaussian distribution.
Variance of ,
Shape factor of ,
Nonlinear RC model
Variance of ,
Shape factor of ,
3.3.3. Cramer-Rao Lower Bounds
Pham and DeFigueiredo  showed that ML estimate of the mean of GGD noise is unbiased for . Moreover, the asymptotic behavior of ML estimates for the uniform and Laplacian noises has been investigated in  yielding that, even if the priori distribution of a noise is unknown, the stochastic CRB can be attained asymptotically by the ML estimator derived for a Gaussian signal. Hence, for the GGD-type measurement noise having shape factors other than , we use asymptotic property of MLE and accept (19) for the bound calculation.
We can claim with some confidence that presented CRLB values are the minimum attainable estimator variance bound for the nonlinear RC model. First, CRLB is computed by the real values of the model parameters (no initialization problem), and second, for the GGD-type measurement noise, asymptotic efficiency and lack of bias of the ML estimates can be used (Gaussian noise case). However, we note that, because the Hessian matrix depends on the nonlinear model parameters as well as GGD noise parameters, maximization of the Fisher Information Matrix constitutes high variance bounds. Thus we do not claim that the ML estimators are the best choice among the estimator family. On the other hand, both MSE and CRLB curves clearly suggest that, for the nonlinear RC model, ML estimator gives the optimum variance with regard to the CRLB.
3.3.4. Mean Square Error
and is plotted versus signal-to-noise ratio (SNR). The only reason to use different SNR is to demonstrate the estimator's ability in estimating the parameters' embedded different noise variances. Since the measurement noise consists of the residuals between the real measured signal and the used respiratory model, we expect to estimate various measurement noise variances.
Seven male and one female patients with COPD and four male and two female healthy nonsmoking subjects (without any respiratory disease) were recruited. Patients were breathing with the support of a non-invasive ventilator (Respironics, Inc., BIPAP S/T IPAP: ; PEEP: ) via facemask (Respironics, Inc., spectrum size: medium and small), whereas subjects from Control Group were breathing via facemask without the support of the non-invasive ventilation. In both Groups, the mask pressure, the airway flow, and tidal volume were measured by the pneumotachograph and the pressure transducer system (Hans Rudolph, Inc., Research pneumotachograph system). Acquired signals are digitized by a sampling rate of . During acquisition, subjects were awake and in supine position breathing through the facemask. At least 10 breathing cycles of the airway flow, the mask pressure, and the lung volume signals were recorded by the data acquisition system (National Instrument DAQCard-6036E ADC-16bit) and stored into the computer for signal processing.
The airway flow signal was the first software filtered to remove high-frequency noise with 8th-order Butterworth low-pass filter with cutoff frequency of , and then processed to detect the breathing cycle onset and end. Recorded signals were divided by breathing cycles with the consideration of the ventilator trigger time, the inspiration, and the expiration time. Five clear breathing cycles were chosen for the processing step. Accordingly, the parameters , , (i.e., , , and ), PEEP, and were set to the real values measured from the subject's respiratory signals. and were and was set to . MLE algorithm depicted in Algorithm 1 was applied to the measured respiratory signals, and the resulting measurement noise variance, measurement noise shape factor, and parameter convergence tracks were plotted. In order to assess the estimator, results from five different breath cycles were illustrated on the same figure.
5.1. Measurement Noise Variance and Shape Factor Estimation
From Figures 4 and 5, we can observe that measurement noise variance is much higher in the Patient group than in the Control group. As it is explained in the above section, the initial is set to times higher in the Patient group due to the convergence of the variance, and in the RIC model it is increased to nearly . Also we can see that increase in is higher in the RIC model; thus, for the nonlinear RC model, estimated measurement noise variance is lower in the Patient group. Hence, first important finding can be drawn that Patient group respiratory signals are fitted to the nonlinear RC model with lower measurement noise variance (i.e., lower the variance of the residuals) than to the linear RIC model. Since the lower the variance the better the distribution spotted (which means that the residuals are concentrated to the mean with minimum variance), it is easily concluded that the nonlinear RC model is better fitted to the respiratory signals acquired from Patient group. On the other hand, for the Control group it is totally reverse. Respiratory signals from each healthy subject resulted in higher in the nonlinear RC model, so that the RIC model is better fitted to the respiratory signals from Control group.
We can also support the above argument with the estimates. From Figure 6(b) we see that nearly all breaths were converged to , but Figure 6(a) shows more scattered convergence of the waveforms. Control group signals also converge to the specific value for the RIC model, whereas in the nonlinear RC model they were spread in the super-Gaussian area (see Figure 7). Since it is desirable to have concentrated convergence tracks, RIC and nonlinear RC models better describe the respiratory signals from Control and Patient groups, respectively.
Moreover, Figures 6 and 7 show another very important finding: respiratory signals from Patient group resulted in the shape factors in the sub-Gaussian area whereas super-Gaussian distributed measurement noise was achieved by the Control group respiratory signals. This very distinct result directly indicates the distribution of the measurement noise (i.e., the residuals). The Patient group respiratory signals are fitted to the respiratory models with sub-Gaussian distributed residuals (mostly Laplacian-type ), whereas super-Gaussian distributed residuals resulted when Control group respiratory signals are processed.
These above findings are the direct consequence of three important effects: (i) the properties of the measured respiratory signals (i.e., airway flow and mask pressure), (ii) the noninvasive ventilator, and (iii) the used respiratory system models. The properties of the measured signals are defined as the length of the processed signals (usually very short in the Patient group), energy content of the signal (airway flow is the energy signal in the Control group, whereas for the Patient group it is defined as a power signal), shape of the signal (Control group signals are uniform and smooth signals without sharp edges), and the uncertainty hidden in the signal. Noninvasive ventilator has major contribution to the properties of the respiratory signal, and more importantly respiratory system response is altered with the presence of ventilator-generated pressure. Finally, respiratory models have influence on the result by execution of different mathematical relations. Hence, these items have effects on the results in different scale by comprising the differences between Patient and Control groups and between the RIC and nonlinear RC models.
5.2. Convergence of Parameters for Measured Respiration Signals
If RIC and nonlinear RC models were compared to each other, we saw that RIC model resulted in very flat estimations (fast convergence). However in the nonlinear model, we have convergence problems at the nonlinear parameters ( and ) for the Control group (see Figure 9(b)). It is true, even though we have very smooth and estimates. This result encourages the findings that nonlinear RC model is not a good representation of the Control group respiratory signals. On the other hand, it can be easily depicted from Figure 8 that breath-to-breath variations are higher in the RIC model than in the nonlinear RC model for the Patient group. Since it is desirable to have minimum breath-to-breath variations, we again conclude that, for Patient group, nonlinear RC model is better fitted to the measured respiratory signals.
The closer look at Figures 8 and 9 reveals the estimated parameter values. We can see that, for both groups, parameter in the RIC model and parameter in the nonlinear RC model; as well as parameter in the RIC and nonlinear RC models were converged to the more or less same values. was estimated for the Control group, whereas always was observed in the Patient group. That shows that the healthy person uses inspiratory muscles less than the COPD patients. We also observed that parameters and are always higher values in the Patient group than in the Control group. Finally, parameter was converged to values less than in the Control group, whereas it is well above for the Patient group.
5.3. Performance of the MLE for Measured Respiration Signals
The MLE approach and its theoretical performance of the MLE were covered in Section 3.2, and the estimator performance on the parameter convergence was discussed in Section 5.2. However, to be complete, we have to mention that MLE method has potentially serious limitations and constraints in terms of convergence in measured respiratory signal processing. As seen from Figure 8(b) and Figure 9(b), for the nonlinear RC model we have considerable convergence difficulties on nonlinearly related parameters. Moreover, it is observed that MLE required longer computation time for the nonlinear RC model than for the linear RIC model. Performance degradation on MLE can easily be attributed to the nonlinear, non-Gaussian state-space models. The major estimation problem central to gradient-based approaches, such as MLE, is essentially dealing with the initialization. However, as it is covered earlier, confounds between the parameter estimates, including the intraindividual differences, demonstrated the ability of the MLE with the non-Gaussian noise as a diagnostic tool for the COPD patients. Thus, we see these methodological difficulties not so much as a hurdle but more as an even stronger incentive for the biomedical scientists to include intensive repeated researches in nonlinear and non-Gaussian models.
In this paper we introduced a time-domain methodology to determine the respiratory mechanics of COPD patients under the non-invasive ventilation based on the inverse system modeling approach. Maximum likelihood estimation implemented by Newton-Raphson algorithm yielded optimum estimators for both the linear RIC and the nonlinear RC models. Moreover, the use of generalized Gaussian distribution provided a crucial factor in explaining the measurement noise distribution in the real signal case. We found that respiratory signals from Control group are better represented by the RIC model compared to the nonlinear RC model. On the other hand, the nonlinear RC model is fitted to respiratory signals from Patient group with lower measurement noise variance, better converged measurement noise shape factor, and model parameter tracks. Also, it is observed that, in the Control group, the shape factor of the measurement noise is much larger than in the COPD patients group. That indicates that the uncertainties between the patients' respiratory signals and the respiratory models have Laplacian distribution, whereas for the Control group it is in the super-Gaussian area.
Finally, MLE is proven to be very powerful statistical signal processing technique for the parameter estimation in the non-Gaussian noise. By using the real respiratory signals, the respiratory system is identified for Patient and Control groups. However, although the algorithm is applied to the dataset obtained in our labs, the validation with more datasets and subjects will confirm the applicability of the MLE algorithm.
The authors gratefully acknowledge the contribution of Prof. Dr. Ertugrul Eris for the technical support, Prof. Dr. Nurhayat Yildirim for the COPD patients' data acquisition, and reviewers' comment. This paper was partially supported by The Research Fund of The University of Istanbul. Project nos. are 3898, BYP-6687, and T-965/06102006.
- Hughes JMB, Pride MB: Lung Function Tests: Physiological Principles and Clinical Applications. W. B. Saunders, London, UK; 2000.Google Scholar
- Polak AG, Mroczka J: Nonlinear model for mechanical ventilation of human lungs. Computers in Biology and Medicine 2006, 36(1):41-58.View ArticleGoogle Scholar
- Athanasiades A, Ghorbel F, Clark JW Jr., Niranjan SC, Olansen J, Zwischenberger JB, Bidani A: Energy analysis of a nonlinear model of the normal human lung. Journal of Biological Systems 2000, 8(2):115-139. 10.1142/S0218339000000080View ArticleGoogle Scholar
- Eberhard A, Carry P-Y, Perdrix J-P, Fargnoli J-M, Biot L, Baconnier PF: A program based on a 'selective' least-squares method for respiratory mechanics monitoring in ventilated patients. Computer Methods and Programs in Biomedicine 2003, 71(1):39-61. 10.1016/S0169-2607(02)00030-5View ArticleGoogle Scholar
- Diong B, Nazeran H, Nava P, Goldman M: Modeling human respiratory impedance. IEEE Engineering in Medicine and Biology Magazine 2007, 26(1):48-55.View ArticleGoogle Scholar
- Bates JHT, Lauzon A-M: A nonstatistical approach to estimating confidence intervals about model parameters: application to respiratory mechanics. IEEE Transactions on Biomedical Engineering 1992, 39(1):94-100. 10.1109/10.108133View ArticleGoogle Scholar
- Suki B, Yuan H, Zhang Q, Lutchen KR: Partitioning of lung tissue response and inhomogeneous airway constriction at the airway opening. Journal of Applied Physiology 1997, 82(4):1349-1359.Google Scholar
- Saatçi E, Akan A: Lung model parameter estimation by unscented Kalman filter. Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, 2007 2556-2559.Google Scholar
- Yamada Y, Du H-L: Analysis of the mechanisms of expiratory asynchrony in pressure support ventilation: a mathematical approach. Journal of Applied Physiology 2000, 88(6):2143-2150.Google Scholar
- Kokkinakis K, Nandi AK: Exponent parameter estimation for generalized Gaussian probability density functions with application to speech modeling. Signal Processing 2005, 85(9):1852-1858. 10.1016/j.sigpro.2005.02.017View ArticleMATHGoogle Scholar
- Kay SM: Fundamentals of Statistical Signal Processing. Prentice-Hall, Englewood Cliffs, NJ, USA; 1993.MATHGoogle Scholar
- Pham TT, DeFigueiredo RJP: Maximum likelihood estimation of a class of non-Gaussian densities with application to Lp deconvolution. IEEE Transactions on Acoustics, Speech, and Signal Processing 1989, 37(1):73-82. 10.1109/29.17502MathSciNetView ArticleGoogle Scholar
- Sieskul BT, Jitapunkul S: An asymptotic maximum likelihood for estimating the nominal angle of a spatially distributed source. International Journal of Electronics and Communications 2006, 60(4):279-289. 10.1016/j.aeue.2005.03.010View ArticleGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.