# A New Approach in Regression Analysis for Modeling Adsorption Isotherms

Authors: Dana D. Marković; Branislava M. Lekić; Vladana N. Rajaković-Ognjanović; Antonije E. Onjia; Ljubinka V. Rajaković
Journal: The Scientific World Journal
 (2014)

---

## Abstract

Numerous regression approaches to isotherm parameters estimation appear in the literature. The real insight into the proper modeling pattern can be achieved only by testing methods on a very big number of cases. Experimentally, it cannot be done in a reasonable time, so the Monte Carlo simulation method was applied. The objective of this paper is to introduce and compare numerical approaches that involve different levels of knowledge about the noise structure of the analytical method used for initial and equilibrium concentration determination. Six levels of homoscedastic noise and five types of heteroscedastic noise precision models were considered. Performance of the methods was statistically evaluated based on median percentage error and mean absolute relative error in parameter estimates. The present study showed a clear distinction between two cases. When equilibrium experiments are performed only once, for the homoscedastic case, the winning error function is ordinary least squares, while for the case of heteroscedastic noise the use of orthogonal distance regression or Margart’s percent standard deviation is suggested. It was found that in case when experiments are repeated three times the simple method of weighted least squares performed as well as more complicated orthogonal distance regression method.


---

## Body

## 1. Introduction

Adsorption is a mass transfer process that plays a central role in potable water purification, wastewater treatment, both analytical and preparative chromatograph, and different types of chemical analyses as a technique for sample preconcentration and speciation of analytes. The predominant scientific basis for sorbent selection and design of an adsorption system is the knowledge about equilibrium partitioning between two phases often expressed in the form of adsorption isotherm. Based on the isotherms, the following important factors can be estimated: capacity of the sorbent, the method of sorbent regeneration, and the product purities [1]. Additionally, transport behavior of environmentally significant reactive species is controlled by the sorption behavior of these solutes to soil surfaces. Adsorption isotherms are incorporated into geochemical modeling software (such as MINEQL, Visual MINTEQ, and ChemEQL) in order to understand and predict the mobility of the sorbed substances. Determination of the optimum isotherm equation and accurate estimates of the isotherm parameters are apparently important for all the mentioned purposes.A frequently applied method for determining single solute adsorption isotherms is the conventional batch method based on mixing known amounts of adsorbent with solutions of various initial concentrations (Co) and measuring the equilibrium concentrations (Ce,exp). Solving the mass balance, corresponding equilibrium loadings (qe,exp) can be simply calculated [2]. Once pairs (Ce,exp,qe,exp) are obtained, they are plotted and subjected to the fitting procedure. Candidate theoretical models are subsequently fitted to the experimental data (parameters of the model functions qe,exp=f(Ce,exp) are determined) and finally the best fitting model is chosen to represent the experimental system. Two different steps of the described procedure can be noticed: firstly, the method used for obtaining parameter values and, secondly, the method used for the isotherm selection.The most commonly used empirical adsorption isotherm models are the Langmuir and Freundlich isotherms [3]. In the past decades, the equations of these two parameter functions were routinely linearized, and the parameters were directly obtained by linear regression. The preferred one among the linearized equations would have been chosen by the coefficient of determination (R2) closer to one. Nonlinear regression, being an iterative procedure, gained popularity in the era of microcomputers. Parameter estimates in this method are obtained through minimization of the quadratic error between experimental data qe,exp and model outputs qe,calc for all sample points. Literature survey summarized in a review paper of Foo and Hameed [4] showed that besides ordinary least squares (OLS), researchers use many other error functions, namely, hybrid fractional error function (HYBRD), Marquardt’s percent standard deviation (MPSD), average relative error (ARE), and sum of absolute errors (EABS). The coefficient of determination (R2), root mean squared error (RMSE), all of the mentioned error functions, and sometimes Akaike information criterion [5] are calculated to measure the goodness of fit and as a criterion for the selection of optimum isotherm.However, El-Khaiary noticed that both dependent and independent variables used for construction of isotherm equations are affected by experimental errors and first used the method known as orthogonal distance regression (ODR) for the isotherm parameter estimation [6].Having so many options open, the researcher has to decide which one to apply. The paper of El-Khaiary and Malash [7] contains the insightful analysis of the probably most common error: misuse of linearization. Studies comparing the accuracy of different error functions in predicting the isotherm parameters and the optimum isotherm are presented in the literature [8–10]. An important limitation to these earlier studies is that they have been conducted primarily on experimental data. However, there are a few drawbacks of such approach: the true, underlying isotherm function is not known and the final conclusion about which of the applied criteria has properly discovered it cannot be drawn. Also, the values of the true parameters are not known and it is not possible to decide which of the modeling approaches achieved the most accurate parameter estimates. Yet, another problem is that, even proving the validity of some method in just one particular case, one cannot easily generalize the conclusion and suggest the use of the method without sound background theory.Valuable information can be obtained when laboratory experiments are simulated through extensive Monte Carlo calculations. This technique allows for both complete specification and absolute control of all relevant parameters, a condition that real experiments never approximate well. An advantage of Monte Carlo simulations is that they can be repeated thousands of times in a reasonable time and at very low cost.This study was performed with the aim to answer the question which modeling approach should be applied in particular case. A few aspects of the problem were addressed. Do the isotherm equation type and number of parameters make the difference? How do the properties of the analytical method for the initial and equilibrium concentrations determination affect the parameter estimation procedure? What is the preferred method if one has some information about the measurement error structure? And what is the winning method in the case when the only available information is the isotherm dataset that consists of 5–10 points, with no replication?The Monte Carlo technique was used as a tool to test the differences between nonlinear and orthogonal distance regression methods. Tendencies within modeling approaches were revealed on a large number of generated datasets, allowing the precision and accuracy of parameter estimates to be determined by comparison with true parameter values. Five isotherm models in the presence of five noise precision models (NPMs) were analyzed by eight modeling approaches. Three levels of reality were distinguished—theoretical level at the one side, when the noise structure is exactly known, and the two experimental levels at the other side: one in the absence of data about noise structure and the second when the estimates of standard deviations could be obtained.As a result of this investigation, a clear strategy for data reduction in the field of adsorption is presented.


## 2. Theoretical Background

### 2.1. Adsorption Isotherms

Over the years, a wide variety of equilibrium isotherm models have been formulated. In general, an adsorption isotherm is the relationship between quantity of the component retained on a solid phase(qe) and the remaining sorbate concentration in the fluid phase (Ce), mathematically expressed as  qe=f(Ce).  The main drawback of the isotherms is that the isotherm does not provide automatically any information about the reactions involved, and mechanistic interpretations must be carefully verified [11]. Additionally, they cannot take into account the effect of ionic strength, pH of the solution, composition of the media, and temperature. Despite these limitations, isotherms are largely employed to describe sorption phenomena. Giles et al. [12] classified isotherms as ‘‘C,’’ ‘‘L,’’ ‘‘H,’’ and ‘‘S,’’ based on the 4 main shapes of isotherms commonly observed. According to this classification, ‘‘C’’ isotherm is a line of zero-origin, and ‘‘L’’ and ‘‘H’’ are concave curves supported by the fact that the ratio between the concentration of the compound remaining in solution and adsorbed on the solid increases when the solute concentration increases. The ‘‘H’’ type isotherm is only a particular case of the ‘‘L’’ isotherm, where the initial slope is very high. Progressive saturation of the solid is supported by these concave isotherms and two possibilities are distinguished: the curve reaches a strict asymptotic plateau (the solid has a limited sorption capacity), and the curve does not reach any plateau (the solid does not show clearly a limited sorption capacity). ‘‘S’’ type of adsorption isotherm is sigmoidal-shaped and thus has got a point of inflection. It is always a result of at least two opposite mechanisms. Compared to the ‘‘L’’ and ‘‘H’’ isotherms, the ‘‘S’’ class occurs less frequently [13], and it will not be addressed in this paper.From a mathematical point of view, isotherm equations can be grouped into rational, power, and transcendental functions [3]. Important for the convergence properties and computational difficulty is the number of parameters. Most of the isotherms used for liquid-phase adsorption description are two or three parameter isotherms, while for the adsorption of gases hybrid isotherms with significantly higher number of parameters are also present in the literature [14]. The equations of five adsorption isotherms addressed in this paper are listed in Table 1.Table 1
Adsorption isotherm models.
No.
Type
Type of function
Nonlinear form
Linear form
True parameters
Reference
θ
1
θ
2
θ
3
1
Langmuir
Rational
q
e
=
q
max
K
L
C
e
1
+
K
L
C
e
1
q
e
=
1
q
max
K
L
1
C
e
+
1
q
max
q
max
=
0.6
K
L
=
0.4
/
[15]
2
Freundlich
Power
q
e
=
K
F
C
e
1
/
n
F
ln
q
e
=
ln
K
F
+
1
n
F
ln
C
e
K
F
=
0.1
n
=
1.2
/
[16]
3
Jovanovic
exp*
q
e
=
q
J
(
1
-
e
-
K
J
C
e
)
/
q
J
=
5.1
K
J
=
0.02
/
[17]
4
Redlich-Peterson
Rational
q
e
=
K
R
C
e
1
+
a
R
C
e
g
/
K
R
=
0.5
a
R
=
0.25
g
=
0.85
[18]
5
Sips
Rational
q
e
=
q
S
K
S
C
e
m
S
1
+
K
S
C
e
m
S
/
q
S
=
5.0
K
S
=
0.1
m
S
=
0.7
[19]
*Exponential.They were chosen to be widely used and to represent different types of mathematical functions (Langmuir, Redlich-Peterson, and Sips isotherms are rational functions, Freundlich isotherm is a power function, and Jovanovic isotherm is a transcendental function) and different number of parameters (Langmuir, Freundlich, and Jovanovic are two-parameter isotherms, and Redlich-Peterson and Sips are three-parameter isotherms). To avoid unnecessary repetitions, detailed characteristics of the isotherms are not presented. Additional information can be found in the literature.


### 2.2. Method of Least Squares

Let independent data pairs(xi,yi), i=1,…,n, be observed from the underlying true values (Xi,Yi), and accept the assumption that only dependent variable yi is affected by measurement error:
(1)xi=Xi,yi=Yi+εi,
where εi is additive, zero mean, white, Gaussian noise. The noise is assumed to be homoscedastic with constant population standard deviation σε, written in short notation εi~N(0,σε). Although (1) is not absolutely satisfied in practice, and it is often the case that xi have errors, these errors can be safely ignored if they are much smaller than the corresponding errors in yi [6].Assume the smooth functionY=f(X;θ) is a true model, where θ∈Rp is a vector of true parameters. With more data points than parameters (n>p), it is not possible to solve the model and calculate the values of the true parameters. Instead, the question is how to obtain the best compromise so that the model predictions (y^i) are on the whole as close as possible to the observed data values. Closeness for any single observation may be measured by the vertical distance (ψi) from the data point to the fitted curve:
(2)yi=y^i+ψi.Closeness averaged over the entire data set is often measured by the sum of the squares of the individual distances. Any pointθ^=(θ^1,θ^2,…,θ^p) in Θ={θ=(θ1,θ2,…,θp)∈Rp,θi>0,i=1,…,p} which minimizes the functional,
(3)ErrFun(θ^)=∑i=1nwi2(f(xi;θ^)-yi)2,
where wi are data weights and equation for the fitted curve reads y^i=f(xi;θ^), is called the least squares estimate of the unknown parameters, if it exists [20]. Condition θi>0, i=1,…,p, in the definition of the set Θ is a specific feature of the modeling adsorption isotherms and meets the criterion for the isotherm to be positive, increasing, and concave on the set [0, ∞), namely, to be ‘‘L’’ or ‘‘H’’ type isotherm.


#### 2.2.1. Weighting Schemes in the Method of Least Squares

In the method of OLS the observations are assumed to be homoscedastic and all of the points are assigned equal weightswi=1, i=1,…,n.  In the absence of more complete information, it is commonly accepted that uniform weighting is satisfactory, and OLS are widely used in model fitting [21]. If the assumption of constant standard deviations of measurement errors is relaxed, the heteroscedasticity is characterized by an n element vector σε=(σε1,σε2,…,σεn), where each σεi is population standard deviation of the noise at yi:εi~N(0,σεi). Weights calculated by
(4)wi=1σεi
are introduced into (3) in order to account for inconstant variance and the method is referred to as weighted least squares (WLS) or sometimes “chi-square fitting” [22]. The assumption that the weights are known exactly is not valid in real applications so estimated weights must be used instead [23].Ideally, observation weights should be estimated according to individual estimates of measurement error such thatwi=1/sdyi, where sdyi is the standard deviation of ith measurement. These are called instrumental weights.When individual error estimates are unavailable, other empirical weights may provide a simple approximation of standard deviation. For the peculiar case of heteroscedasticity important in many analytical methods, relative standard deviations are reasonably constant over a considerable dynamic range. Thus,σεi is proportional to yi and the weights can be estimated as wi=1/yi.However, the error structure in real data usually lies somewhere on a continuous between a constant absolute error (homoscedastic) at one extreme and a constant percentage error at the other. Between these two there is an error for which the standard deviation is proportional to the square root of the expected value:wi=1/yi0.5. This type of weights is called Poisson weights or hybrid weights and they should be applied when the shot noise is present. Shot noise is dominant when a finite number of particles that carry energy (ions, electrons, and photons) are counted at the detector part of the instrument. The characteristic expressions for each weighting type are presented in Table 2.Table 2
Types of weights.
Type of weights
Expression
Absolute weights
1
Poisson weights
1
/
y
i
0.5
Assumption of constant percentage error
1
/
y
i
Instrumental weights
1
/

sd

y
iISOFIT, a software package for fitting sorption isotherms to experimental data by weighted least squares, supports three alternatives: uniform weighting, sorbed relative where weights are inversely proportional to sorbed concentrations, and solute relative where weights are inversely proportional to measured solute concentrations [24].


### 2.3. Orthogonal Distance Regression Methods

In a more general situation, considerable errors can occur in both variables. It is stated that if the errors inxi are greater than one-tenth of the errors in yi, then the overall error is significantly increased. Moreover, the regression parameters and their confidence intervals are then biased using (ordinary) weighted least squares [25].Let the considerable error be also present in the measurements of the independent variable(5)xi=Xi+δi,
where δi~N(0,σδi).Again, the model will not fit the observed data points(xi,yi), i=1,…,n, exactly, so the corresponding set of points (x^i,y^i), i=1,…,n, that do fit the model exactly and that are at the same time the closest to experimental data points is to be considered. For each data point, the value of independent variable x^i is expressed introducing an error term φi:
(6)x^i=xi+φi.The valuesy^i are predicted by the model function
(7)y^i=f(xi+φi;θ^).A reasonable way to estimate the unknown parameters in this case is to minimize the weighted sum of squares of all errors by minimizing the functional:(8)ErrFun(θ^,φ^)=∑i=1nwi2(ψi2+di2φi2),on the setΘ×Φ, where wi and di are data weights in the y and x directions, respectively, and
(9)Φ∶={φ=(φ1,φ2,…,φn)∈Rn,xi+φi≥0,i=1,…,n}.Commonly, (8) is expressed in its expanded form, where the difference between calculated and experimentally observed value of y is emphasized:
(10)ErrFun(θ^,φ^)=∑i=1nwi2[(f(xi+φi;θ^)-yi)2+di2φi2].This approach is known as errors in variables or orthogonal distance regression or total least squares. Conditionxi+φi≥0, i=1,…,n, in the defining relation (9) is set in order to meet the natural condition that concentration is a nonnegative value.


#### 2.3.1. Weighting Schemes in the Method of Orthogonal Distance Regression

In orthogonal distance regression analysis of sorption data, units of the variables on the axes are not the same. It is necessary to introduce weights as constants selected to scale each type of variableyi or xi. This is done in order to put the model errors (ψi and φi) on a comparable basis, so it will be meaningful to add them all together into the sum of error function in (8). Typically, weights are chosen as estimates of the population standard deviation of the experimental measurements of each variable type: wi=1/sdyi and widi=1/sdxi. Another way is to assign weights to be proportional to the inverse of experimental values: wi=1/yi and widi=1/xi. The effect of such weights is that at the same time heteroscedasticity is accounted for and scaled model errors in y and x direction are dimensionless.In Figure1 differences between different OLS and orthogonal distance regression methods with and without weighting are presented.Geometric illustration of differences among different regression methods: (a) OLS without weighting, (b) orthogonal distance regression without weighting, and (c) orthogonal distance regression with weighting.
(a)
(b)
(c)Geometrically, if the data pairs(xi,yi) and the curve  y^=f(x^;θ^) are presented in the Cartesian coordinates in ordinary least squares, minimization of the error function corresponds to minimization of the shortest distances from data points to a line in a direction that is parallel to the vertical axis. Figure 1(a) is a standard geometric illustration of the least squares method. Instead of the vertical offsets, the shortest distances from points to the line are considered in the method of orthogonal distance regression. If the data are homoscedastic, and the units of x and y are the same, all the weights wi and di are equal to one. Equation (8) is then simplified to a formula that possesses a meaning of the sum of the areas of the circles shown in Figure 1(b):
(11)ErrFun(θ^,φ^)=∑i=1n[(yi-y^i)2+(xi-x^i)2].In this case, the radii of these circles are equal to distances between the points(xi,yi)  and the fitting line. Put in other words, the fitting line is a tangent line to all circles.Geometrical representation of a case whenx and y are variables that do not have the same units or the data is heteroscedastic is presented in Figure 1(c). Weights are introduced and half axes of the ellipses in Figure 1(c) correspond to the combined measure of the distance expressed in (8). While the global minimum of this error function is unique, this kind of straightforward geometrical representation is no longer meaningful.Orthogonal distance regression methods have been used in the fields of science such as economy [26], automatic control [27], and pharmacology [28], and a significant work has been done for the development of stable and efficient algorithm for ODR estimation of parameters.


## 2.1. Adsorption Isotherms

Over the years, a wide variety of equilibrium isotherm models have been formulated. In general, an adsorption isotherm is the relationship between quantity of the component retained on a solid phase(qe) and the remaining sorbate concentration in the fluid phase (Ce), mathematically expressed as  qe=f(Ce).  The main drawback of the isotherms is that the isotherm does not provide automatically any information about the reactions involved, and mechanistic interpretations must be carefully verified [11]. Additionally, they cannot take into account the effect of ionic strength, pH of the solution, composition of the media, and temperature. Despite these limitations, isotherms are largely employed to describe sorption phenomena. Giles et al. [12] classified isotherms as ‘‘C,’’ ‘‘L,’’ ‘‘H,’’ and ‘‘S,’’ based on the 4 main shapes of isotherms commonly observed. According to this classification, ‘‘C’’ isotherm is a line of zero-origin, and ‘‘L’’ and ‘‘H’’ are concave curves supported by the fact that the ratio between the concentration of the compound remaining in solution and adsorbed on the solid increases when the solute concentration increases. The ‘‘H’’ type isotherm is only a particular case of the ‘‘L’’ isotherm, where the initial slope is very high. Progressive saturation of the solid is supported by these concave isotherms and two possibilities are distinguished: the curve reaches a strict asymptotic plateau (the solid has a limited sorption capacity), and the curve does not reach any plateau (the solid does not show clearly a limited sorption capacity). ‘‘S’’ type of adsorption isotherm is sigmoidal-shaped and thus has got a point of inflection. It is always a result of at least two opposite mechanisms. Compared to the ‘‘L’’ and ‘‘H’’ isotherms, the ‘‘S’’ class occurs less frequently [13], and it will not be addressed in this paper.From a mathematical point of view, isotherm equations can be grouped into rational, power, and transcendental functions [3]. Important for the convergence properties and computational difficulty is the number of parameters. Most of the isotherms used for liquid-phase adsorption description are two or three parameter isotherms, while for the adsorption of gases hybrid isotherms with significantly higher number of parameters are also present in the literature [14]. The equations of five adsorption isotherms addressed in this paper are listed in Table 1.Table 1
Adsorption isotherm models.
No.
Type
Type of function
Nonlinear form
Linear form
True parameters
Reference
θ
1
θ
2
θ
3
1
Langmuir
Rational
q
e
=
q
max
K
L
C
e
1
+
K
L
C
e
1
q
e
=
1
q
max
K
L
1
C
e
+
1
q
max
q
max
=
0.6
K
L
=
0.4
/
[15]
2
Freundlich
Power
q
e
=
K
F
C
e
1
/
n
F
ln
q
e
=
ln
K
F
+
1
n
F
ln
C
e
K
F
=
0.1
n
=
1.2
/
[16]
3
Jovanovic
exp*
q
e
=
q
J
(
1
-
e
-
K
J
C
e
)
/
q
J
=
5.1
K
J
=
0.02
/
[17]
4
Redlich-Peterson
Rational
q
e
=
K
R
C
e
1
+
a
R
C
e
g
/
K
R
=
0.5
a
R
=
0.25
g
=
0.85
[18]
5
Sips
Rational
q
e
=
q
S
K
S
C
e
m
S
1
+
K
S
C
e
m
S
/
q
S
=
5.0
K
S
=
0.1
m
S
=
0.7
[19]
*Exponential.They were chosen to be widely used and to represent different types of mathematical functions (Langmuir, Redlich-Peterson, and Sips isotherms are rational functions, Freundlich isotherm is a power function, and Jovanovic isotherm is a transcendental function) and different number of parameters (Langmuir, Freundlich, and Jovanovic are two-parameter isotherms, and Redlich-Peterson and Sips are three-parameter isotherms). To avoid unnecessary repetitions, detailed characteristics of the isotherms are not presented. Additional information can be found in the literature.


## 2.2. Method of Least Squares

Let independent data pairs(xi,yi), i=1,…,n, be observed from the underlying true values (Xi,Yi), and accept the assumption that only dependent variable yi is affected by measurement error:
(1)xi=Xi,yi=Yi+εi,
where εi is additive, zero mean, white, Gaussian noise. The noise is assumed to be homoscedastic with constant population standard deviation σε, written in short notation εi~N(0,σε). Although (1) is not absolutely satisfied in practice, and it is often the case that xi have errors, these errors can be safely ignored if they are much smaller than the corresponding errors in yi [6].Assume the smooth functionY=f(X;θ) is a true model, where θ∈Rp is a vector of true parameters. With more data points than parameters (n>p), it is not possible to solve the model and calculate the values of the true parameters. Instead, the question is how to obtain the best compromise so that the model predictions (y^i) are on the whole as close as possible to the observed data values. Closeness for any single observation may be measured by the vertical distance (ψi) from the data point to the fitted curve:
(2)yi=y^i+ψi.Closeness averaged over the entire data set is often measured by the sum of the squares of the individual distances. Any pointθ^=(θ^1,θ^2,…,θ^p) in Θ={θ=(θ1,θ2,…,θp)∈Rp,θi>0,i=1,…,p} which minimizes the functional,
(3)ErrFun(θ^)=∑i=1nwi2(f(xi;θ^)-yi)2,
where wi are data weights and equation for the fitted curve reads y^i=f(xi;θ^), is called the least squares estimate of the unknown parameters, if it exists [20]. Condition θi>0, i=1,…,p, in the definition of the set Θ is a specific feature of the modeling adsorption isotherms and meets the criterion for the isotherm to be positive, increasing, and concave on the set [0, ∞), namely, to be ‘‘L’’ or ‘‘H’’ type isotherm.


### 2.2.1. Weighting Schemes in the Method of Least Squares

In the method of OLS the observations are assumed to be homoscedastic and all of the points are assigned equal weightswi=1, i=1,…,n.  In the absence of more complete information, it is commonly accepted that uniform weighting is satisfactory, and OLS are widely used in model fitting [21]. If the assumption of constant standard deviations of measurement errors is relaxed, the heteroscedasticity is characterized by an n element vector σε=(σε1,σε2,…,σεn), where each σεi is population standard deviation of the noise at yi:εi~N(0,σεi). Weights calculated by
(4)wi=1σεi
are introduced into (3) in order to account for inconstant variance and the method is referred to as weighted least squares (WLS) or sometimes “chi-square fitting” [22]. The assumption that the weights are known exactly is not valid in real applications so estimated weights must be used instead [23].Ideally, observation weights should be estimated according to individual estimates of measurement error such thatwi=1/sdyi, where sdyi is the standard deviation of ith measurement. These are called instrumental weights.When individual error estimates are unavailable, other empirical weights may provide a simple approximation of standard deviation. For the peculiar case of heteroscedasticity important in many analytical methods, relative standard deviations are reasonably constant over a considerable dynamic range. Thus,σεi is proportional to yi and the weights can be estimated as wi=1/yi.However, the error structure in real data usually lies somewhere on a continuous between a constant absolute error (homoscedastic) at one extreme and a constant percentage error at the other. Between these two there is an error for which the standard deviation is proportional to the square root of the expected value:wi=1/yi0.5. This type of weights is called Poisson weights or hybrid weights and they should be applied when the shot noise is present. Shot noise is dominant when a finite number of particles that carry energy (ions, electrons, and photons) are counted at the detector part of the instrument. The characteristic expressions for each weighting type are presented in Table 2.Table 2
Types of weights.
Type of weights
Expression
Absolute weights
1
Poisson weights
1
/
y
i
0.5
Assumption of constant percentage error
1
/
y
i
Instrumental weights
1
/

sd

y
iISOFIT, a software package for fitting sorption isotherms to experimental data by weighted least squares, supports three alternatives: uniform weighting, sorbed relative where weights are inversely proportional to sorbed concentrations, and solute relative where weights are inversely proportional to measured solute concentrations [24].


## 2.2.1. Weighting Schemes in the Method of Least Squares

In the method of OLS the observations are assumed to be homoscedastic and all of the points are assigned equal weightswi=1, i=1,…,n.  In the absence of more complete information, it is commonly accepted that uniform weighting is satisfactory, and OLS are widely used in model fitting [21]. If the assumption of constant standard deviations of measurement errors is relaxed, the heteroscedasticity is characterized by an n element vector σε=(σε1,σε2,…,σεn), where each σεi is population standard deviation of the noise at yi:εi~N(0,σεi). Weights calculated by
(4)wi=1σεi
are introduced into (3) in order to account for inconstant variance and the method is referred to as weighted least squares (WLS) or sometimes “chi-square fitting” [22]. The assumption that the weights are known exactly is not valid in real applications so estimated weights must be used instead [23].Ideally, observation weights should be estimated according to individual estimates of measurement error such thatwi=1/sdyi, where sdyi is the standard deviation of ith measurement. These are called instrumental weights.When individual error estimates are unavailable, other empirical weights may provide a simple approximation of standard deviation. For the peculiar case of heteroscedasticity important in many analytical methods, relative standard deviations are reasonably constant over a considerable dynamic range. Thus,σεi is proportional to yi and the weights can be estimated as wi=1/yi.However, the error structure in real data usually lies somewhere on a continuous between a constant absolute error (homoscedastic) at one extreme and a constant percentage error at the other. Between these two there is an error for which the standard deviation is proportional to the square root of the expected value:wi=1/yi0.5. This type of weights is called Poisson weights or hybrid weights and they should be applied when the shot noise is present. Shot noise is dominant when a finite number of particles that carry energy (ions, electrons, and photons) are counted at the detector part of the instrument. The characteristic expressions for each weighting type are presented in Table 2.Table 2
Types of weights.
Type of weights
Expression
Absolute weights
1
Poisson weights
1
/
y
i
0.5
Assumption of constant percentage error
1
/
y
i
Instrumental weights
1
/

sd

y
iISOFIT, a software package for fitting sorption isotherms to experimental data by weighted least squares, supports three alternatives: uniform weighting, sorbed relative where weights are inversely proportional to sorbed concentrations, and solute relative where weights are inversely proportional to measured solute concentrations [24].


## 2.3. Orthogonal Distance Regression Methods

In a more general situation, considerable errors can occur in both variables. It is stated that if the errors inxi are greater than one-tenth of the errors in yi, then the overall error is significantly increased. Moreover, the regression parameters and their confidence intervals are then biased using (ordinary) weighted least squares [25].Let the considerable error be also present in the measurements of the independent variable(5)xi=Xi+δi,
where δi~N(0,σδi).Again, the model will not fit the observed data points(xi,yi), i=1,…,n, exactly, so the corresponding set of points (x^i,y^i), i=1,…,n, that do fit the model exactly and that are at the same time the closest to experimental data points is to be considered. For each data point, the value of independent variable x^i is expressed introducing an error term φi:
(6)x^i=xi+φi.The valuesy^i are predicted by the model function
(7)y^i=f(xi+φi;θ^).A reasonable way to estimate the unknown parameters in this case is to minimize the weighted sum of squares of all errors by minimizing the functional:(8)ErrFun(θ^,φ^)=∑i=1nwi2(ψi2+di2φi2),on the setΘ×Φ, where wi and di are data weights in the y and x directions, respectively, and
(9)Φ∶={φ=(φ1,φ2,…,φn)∈Rn,xi+φi≥0,i=1,…,n}.Commonly, (8) is expressed in its expanded form, where the difference between calculated and experimentally observed value of y is emphasized:
(10)ErrFun(θ^,φ^)=∑i=1nwi2[(f(xi+φi;θ^)-yi)2+di2φi2].This approach is known as errors in variables or orthogonal distance regression or total least squares. Conditionxi+φi≥0, i=1,…,n, in the defining relation (9) is set in order to meet the natural condition that concentration is a nonnegative value.


### 2.3.1. Weighting Schemes in the Method of Orthogonal Distance Regression

In orthogonal distance regression analysis of sorption data, units of the variables on the axes are not the same. It is necessary to introduce weights as constants selected to scale each type of variableyi or xi. This is done in order to put the model errors (ψi and φi) on a comparable basis, so it will be meaningful to add them all together into the sum of error function in (8). Typically, weights are chosen as estimates of the population standard deviation of the experimental measurements of each variable type: wi=1/sdyi and widi=1/sdxi. Another way is to assign weights to be proportional to the inverse of experimental values: wi=1/yi and widi=1/xi. The effect of such weights is that at the same time heteroscedasticity is accounted for and scaled model errors in y and x direction are dimensionless.In Figure1 differences between different OLS and orthogonal distance regression methods with and without weighting are presented.Geometric illustration of differences among different regression methods: (a) OLS without weighting, (b) orthogonal distance regression without weighting, and (c) orthogonal distance regression with weighting.
(a)
(b)
(c)Geometrically, if the data pairs(xi,yi) and the curve  y^=f(x^;θ^) are presented in the Cartesian coordinates in ordinary least squares, minimization of the error function corresponds to minimization of the shortest distances from data points to a line in a direction that is parallel to the vertical axis. Figure 1(a) is a standard geometric illustration of the least squares method. Instead of the vertical offsets, the shortest distances from points to the line are considered in the method of orthogonal distance regression. If the data are homoscedastic, and the units of x and y are the same, all the weights wi and di are equal to one. Equation (8) is then simplified to a formula that possesses a meaning of the sum of the areas of the circles shown in Figure 1(b):
(11)ErrFun(θ^,φ^)=∑i=1n[(yi-y^i)2+(xi-x^i)2].In this case, the radii of these circles are equal to distances between the points(xi,yi)  and the fitting line. Put in other words, the fitting line is a tangent line to all circles.Geometrical representation of a case whenx and y are variables that do not have the same units or the data is heteroscedastic is presented in Figure 1(c). Weights are introduced and half axes of the ellipses in Figure 1(c) correspond to the combined measure of the distance expressed in (8). While the global minimum of this error function is unique, this kind of straightforward geometrical representation is no longer meaningful.Orthogonal distance regression methods have been used in the fields of science such as economy [26], automatic control [27], and pharmacology [28], and a significant work has been done for the development of stable and efficient algorithm for ODR estimation of parameters.


## 2.3.1. Weighting Schemes in the Method of Orthogonal Distance Regression

In orthogonal distance regression analysis of sorption data, units of the variables on the axes are not the same. It is necessary to introduce weights as constants selected to scale each type of variableyi or xi. This is done in order to put the model errors (ψi and φi) on a comparable basis, so it will be meaningful to add them all together into the sum of error function in (8). Typically, weights are chosen as estimates of the population standard deviation of the experimental measurements of each variable type: wi=1/sdyi and widi=1/sdxi. Another way is to assign weights to be proportional to the inverse of experimental values: wi=1/yi and widi=1/xi. The effect of such weights is that at the same time heteroscedasticity is accounted for and scaled model errors in y and x direction are dimensionless.In Figure1 differences between different OLS and orthogonal distance regression methods with and without weighting are presented.Geometric illustration of differences among different regression methods: (a) OLS without weighting, (b) orthogonal distance regression without weighting, and (c) orthogonal distance regression with weighting.
(a)
(b)
(c)Geometrically, if the data pairs(xi,yi) and the curve  y^=f(x^;θ^) are presented in the Cartesian coordinates in ordinary least squares, minimization of the error function corresponds to minimization of the shortest distances from data points to a line in a direction that is parallel to the vertical axis. Figure 1(a) is a standard geometric illustration of the least squares method. Instead of the vertical offsets, the shortest distances from points to the line are considered in the method of orthogonal distance regression. If the data are homoscedastic, and the units of x and y are the same, all the weights wi and di are equal to one. Equation (8) is then simplified to a formula that possesses a meaning of the sum of the areas of the circles shown in Figure 1(b):
(11)ErrFun(θ^,φ^)=∑i=1n[(yi-y^i)2+(xi-x^i)2].In this case, the radii of these circles are equal to distances between the points(xi,yi)  and the fitting line. Put in other words, the fitting line is a tangent line to all circles.Geometrical representation of a case whenx and y are variables that do not have the same units or the data is heteroscedastic is presented in Figure 1(c). Weights are introduced and half axes of the ellipses in Figure 1(c) correspond to the combined measure of the distance expressed in (8). While the global minimum of this error function is unique, this kind of straightforward geometrical representation is no longer meaningful.Orthogonal distance regression methods have been used in the fields of science such as economy [26], automatic control [27], and pharmacology [28], and a significant work has been done for the development of stable and efficient algorithm for ODR estimation of parameters.


## 3. Materials and Methods

### 3.1. Numerical Experiments

Numerical experiments were designed to be as close as possible representation of a typical experimental setup in adsorption studies. It was adopted that batch experiments are performed in laboratory bakers containing mass of sorbentm and volume V of sorbate solution. Initial concentrations of sorbate solutions (Coi,true) are chosen to be 0.5, 1.0, 5.0, 10.0, 50.0, and 100.0. All units are ignored since they are irrelevant. Further on, it was assumed that the theoretical adsorption isotherm expressed in terms of its true parameters is exactly matching the adsorption process. Values of the true parameters were arbitrarily set to get the operative expression qe,true=f(Ce,true), where Ce,true is errorless equilibrium sorbate concentration and qe,true is errorless equilibrium sorbate loading. At the same time, mass balance expressed in (12) is satisfied:
(12)qei,true=(Coi,true-Cei,true)mV.The true equilibrium concentration is then calculated solving the equation:(13)f(Cei,true;θ)-(Coi,true-Cei,true)mV=0.It is assumed that simple univariate chemical measurement system with additive, zero mean, white Gaussian measurement noise is used as an analytical tool to determineCoi,true and Cei,true. Thus random noise (δio~N(0,σδio) and δie~N(0,σδie), resp.) was added to these values to obtain simulated experimental concentrations:
(14)Coi,exp=Coi,true+δio,Cei,exp=Cei,true+δie.The rest of the procedure was identical as if the experiments were performed in laboratory. The equilibrium sorbent loading was calculated from (12), and the collected data was subjected to fitting routines.Flow chart of laboratory experiment and a matching numerical experiment is presented in Figure2.Figure 2
Flow chart illustrating the steps in adsorption equilibrium experiment and a matching numerical experiment.


### 3.2. Noise Precision Models

Since a wide variety of substances (toxic metals, organic pollutants, etc.) are in focus of adsorption research community, also a wide variety of analytical techniques are used for initial and equilibrium concentrations determination. Accordingly, the measurement errors they introduce differ in type and magnitude. There are different mathematical models, named noise precision models (NPMs), that have been proposed to estimate the change of analytical precision as a function of the analyte concentration. List of such models for specific analytical methods, together with explanations of error sources, can be found in literature [23]. In this paper, the NPMs were chosen to be the simplest physically plausible [29]. Firstly, the six different magnitudes of homoscedastic noise were used (H1–H6). Noise population standard deviations were from very low (0.01, 0.02) and medium (0.05, 0.1) to high (0.2, 0.4).  The noise of the data was therefore between 0.01% and 0.4% of the data range. Secondly, the five types of heteroscedastic noise, linear (Lin), quadratic (Quad), hockey stick (HS), constant relative standard deviation of 5% (RSD5%), and  constant relative standard deviation of 10% (RSD10%), were involved. Expressions of the NPMs used in the study and their relevant parameters are listed in Table 3.Table 3
Noise precision models.
No.
NPM
Expression
Type
1
H1
σ
=
0.01
H*
2
H2
σ
=
0.02
H
3
H3
σ
=
0.05
H
4
H4
σ
=
0.1
H
5
H5
σ
=
0.2
H
6
H6
σ
=
0.4
H
7
Lin
σ
=
0.02
+
0.05
C
Het**
8
Quad
σ
=
0.02
+
0.02
C
+
0.0002
C
2
Het
9
HS
σ
=
(
0.02
2
+
0.05
2
C
2
)
0.5
Het
10
RSD5%
σ
=
0.05
C
Het
11
RSD10%
σ
=
0.1
C
Het
*H: homoscedastic; **Het: heteroscedastic.


### 3.3. Methods for Fitting Adsorption Isotherms

Although there are some experiments where it is reasonable to assume that one variable (x) is largely free from errors, such an assumption is manifestly not true in cases of adsorption isotherms. The value on the x-axis is an equilibrium concentration, Ce,exp, which is determined by chemical analysis and thus inevitably affected by the measurement error. Equilibrium loading, qe,exp, (which is on the y-axis) is calculated from the equilibrium concentration, and as a result an error in this concentration appears in both coordinates. Particular attention must be given to equations in which one variable is involved on both sides, since the independence of errors is not fulfilled [30].  The use of orthogonal distance regression modeling procedure would be statistically correct in this case.Since this study is based on simulated data, population standard deviations of measurement errors are known and (10) can be transformed into theoretical orthogonal distance regression criterion (TODR) introducing the relations
(15)wi=1σεi,widi=1σδi,for the weights on they- and x-axes, respectively. It can be noticed that the population standard deviation of the error on the x-axis is actually the population standard deviation of the equilibrium concentration:
(16)σδi=σδie.For they axis, σεi is calculated based on (12). According to the error propagation law
(17)σεi2=k2[(σδie)2+(σδio)2],wherek=V/m, it is assumed that only the error of the Co,exp and Ce,exp determination is significant, while mass and volume can be accurately and precisely measured.Final formulation of the TODR error function which is minimized in case of theoretical fitting of adsorption data is presented as(18)TODR=∑i=1n[(qei,exp-qei,calσεi)2+(Cei,exp-Cei,calσδie)2].Although TODR cannot be used outside the theoretical domain, it was included in this study to serve as a golden standard. It is expected to represent the best possible results that can be achieved with the certain observations in possession.A typical isotherm data set in the experimental domain consists of 5–10 points. Very often, researches perform their experiments in triplicate [31–33], but in cases when the reagents are expensive or toxic there are no replications. By these two different methods, different levels of data quality are obtained. The objective of this paper was to take both of these cases into consideration.Data obtained in only one numerical experiment (matching the case when the laboratory experiments are performed with no replication) were fitted by the use of four error functions: OLS, ODR, MPSD, and HYBRD. Their expressions are presented in Table4. Least squares fitting of the linearized data (LIN) was additionally applied only on the Langmuir and Freundlich equations.Table 4
Definitions of error functions in cases when there are no replicated concentration measurements.
Name
Abbreviation
Domain
Expression
Theoretical orthogonal distance regression
TODR
Theoretical
∑
i
=
1
n
[
(
q
e
i
,
exp
-
q
e
i
,
cal
σ
ε
i
)
2
+
(
C
e
i
,
exp
-
C
e
i
,
cal
σ
δ
i
e
)
2
]
Ordinary least squares
OLS
Experimental
∑
i
=
1
n
(
q
e
i
,
exp
-
q
e
i
,
cal
)
2
Orthogonal distance regression
ODR
Experimental
∑
i
=
1
n
[
(
q
e
i
,
exp
-
q
e
i
,
cal
q
e
i
,
exp
)
2
+
(
C
e
i
,
exp
-
C
e
i
,
cal
C
e
i
,
exp
)
2
]
Marquardt’s percent standard deviation
MPSD
Experimental
∑
i
=
1
n
(
q
e
i
,
exp
-
q
e
i
,
cal
q
e
i
,
exp
)
2
Hybrid fractional error function
HYBRD
Experimental
∑
i
=
1
n
(
q
e
i
,
exp
-
q
e
i
,
cal
)
2
q
e
i
,
expFormulae of the error functions in Table4 are a bit different from the ones reviewed in [4]. The key reason is that the number of data points is constant all the time, and there will be no isotherm ranking based on this error functions, so the constants n-p were removed for the sake of simplicity. Parameter estimates obtained with these slightly modified error functions are the same because the multiplication of error function with a constant nonzero value does not affect the position of a global minimum.OLS, MPSD, and HYBRD are basically least squares methods with different types of weights included. OLS is the approach with all weights equal to one. In case of MPSD, assumption of constant percentage error is accepted and weighting by the equilibrium loading is applied. For the HYBRD error functions weights are of the Poisson type. ODR abbreviation in this context is used for the orthogonal distance regression analog of the MPSD. Assumption of constant percentage error is accepted for both of the axes, and the weights are1/qe,exp and 1/Ce,exp for the y- and x-axes, respectively.The second group of calculations matched the case when laboratory experiments are performed in triplicate. Means of equilibrium sorbent loading (q-ei,exp) and equilibrium sorbate concentration (C-ei,exp) from three subsequent numerical experiments were passed to the following error functions: experimental weighted orthogonal distance regression (E3WODR), triplicate orthogonal distance regression (E3ODR), and weighted least squares (WLS). Definitions of error functions for replicated measurements are listed in Table 5.Table 5
Definitions of error functions for replicated measurements.
Name
Abbreviation
Domain
Expression
Experimental weighted orthogonal distance regression
E3WODR
Experimental
∑
i
=
1
n
[
(
q
-
e
i
,
exp
-
q
e
i
,
cal
sd

y
i
)
2
+
(
C
-
e
i
,
exp
-
C
e
i
,
cal
sd

x
i
)
2
]
Weighted least squares
WLS
Experimental
∑
i
=
1
n
(
q
-
e
i
,
exp
-
q
e
i
,
cal
sd

y
i
)
2
Triplicate orthogonal distance regression
E3ODR
Experimental
∑
i
=
1
n
[
(
q
-
e
i
,
exp
-
q
e
i
,
cal
q
-
e
i
,
exp
)
2
+
(
C
-
e
i
,
exp
-
C
e
i
,
cal
C
-
e
i
,
exp
)
2
]It is important to say that E3WODR is the experimental realization of TODR. Estimates of standard deviation of the variables on they- and x-axes are calculated as described in Section 2.3.1 incorporating the following equations:
(19)sdyi=∑j=13(qei,exp-q-ei,exp)j22,(20)sdxi=∑j=13(Cei,exp-C-ei,exp)j22.Weighting in the E3ODR method is based on the mean values of equilibrium sorbent loading and equilibrium sorbate concentration:(21)wi=1q-ei,exp,widi=1C-ei,exp.For the WLS method, instrumental weights are calculated based on (19).


### 3.4. Numerical Calculations

The present work was carried out using Windows-based PC with hardware configuration containing the dual processor AMD Athlon M320 (2.1 GHz each) and with 3 GB RAM. All calculations were performed using Matlab R2007b. Perturbations were generated using Mersenne Twister random number generator. For the purpose of fitting, built-in Matlab function fminsearch was used for OLS, MPSD, HYBRD, and WLS [34]. It is based on the Nelder-Mead simplex direct search algorithm. Orthogonal distance regression calculations used the dsearchn function as a tool to find the set of (x^i,y^i) values.It is important to note that one complete numerical experiment and all associated computations were performed for each simulation step, for 2000 steps per combination (one type of isotherm and one type of NPM). The reason simulations were chosen to have 2000 steps was the compromise between the aim to have resulting histograms of quality high enough to facilitate quantitative comparison with theory and to prevent the process from lasting unacceptably long. Few of the simulations took longer than 12 hours, with the most averaging around 8 hours in length. It could be noticed that simulations with higher values of noise standard deviation in general lasted longer. The explanation is the rise in the number of function evaluations and the number of iterations before the convergence is achieved.


## 3.1. Numerical Experiments

Numerical experiments were designed to be as close as possible representation of a typical experimental setup in adsorption studies. It was adopted that batch experiments are performed in laboratory bakers containing mass of sorbentm and volume V of sorbate solution. Initial concentrations of sorbate solutions (Coi,true) are chosen to be 0.5, 1.0, 5.0, 10.0, 50.0, and 100.0. All units are ignored since they are irrelevant. Further on, it was assumed that the theoretical adsorption isotherm expressed in terms of its true parameters is exactly matching the adsorption process. Values of the true parameters were arbitrarily set to get the operative expression qe,true=f(Ce,true), where Ce,true is errorless equilibrium sorbate concentration and qe,true is errorless equilibrium sorbate loading. At the same time, mass balance expressed in (12) is satisfied:
(12)qei,true=(Coi,true-Cei,true)mV.The true equilibrium concentration is then calculated solving the equation:(13)f(Cei,true;θ)-(Coi,true-Cei,true)mV=0.It is assumed that simple univariate chemical measurement system with additive, zero mean, white Gaussian measurement noise is used as an analytical tool to determineCoi,true and Cei,true. Thus random noise (δio~N(0,σδio) and δie~N(0,σδie), resp.) was added to these values to obtain simulated experimental concentrations:
(14)Coi,exp=Coi,true+δio,Cei,exp=Cei,true+δie.The rest of the procedure was identical as if the experiments were performed in laboratory. The equilibrium sorbent loading was calculated from (12), and the collected data was subjected to fitting routines.Flow chart of laboratory experiment and a matching numerical experiment is presented in Figure2.Figure 2
Flow chart illustrating the steps in adsorption equilibrium experiment and a matching numerical experiment.


## 3.2. Noise Precision Models

Since a wide variety of substances (toxic metals, organic pollutants, etc.) are in focus of adsorption research community, also a wide variety of analytical techniques are used for initial and equilibrium concentrations determination. Accordingly, the measurement errors they introduce differ in type and magnitude. There are different mathematical models, named noise precision models (NPMs), that have been proposed to estimate the change of analytical precision as a function of the analyte concentration. List of such models for specific analytical methods, together with explanations of error sources, can be found in literature [23]. In this paper, the NPMs were chosen to be the simplest physically plausible [29]. Firstly, the six different magnitudes of homoscedastic noise were used (H1–H6). Noise population standard deviations were from very low (0.01, 0.02) and medium (0.05, 0.1) to high (0.2, 0.4).  The noise of the data was therefore between 0.01% and 0.4% of the data range. Secondly, the five types of heteroscedastic noise, linear (Lin), quadratic (Quad), hockey stick (HS), constant relative standard deviation of 5% (RSD5%), and  constant relative standard deviation of 10% (RSD10%), were involved. Expressions of the NPMs used in the study and their relevant parameters are listed in Table 3.Table 3
Noise precision models.
No.
NPM
Expression
Type
1
H1
σ
=
0.01
H*
2
H2
σ
=
0.02
H
3
H3
σ
=
0.05
H
4
H4
σ
=
0.1
H
5
H5
σ
=
0.2
H
6
H6
σ
=
0.4
H
7
Lin
σ
=
0.02
+
0.05
C
Het**
8
Quad
σ
=
0.02
+
0.02
C
+
0.0002
C
2
Het
9
HS
σ
=
(
0.02
2
+
0.05
2
C
2
)
0.5
Het
10
RSD5%
σ
=
0.05
C
Het
11
RSD10%
σ
=
0.1
C
Het
*H: homoscedastic; **Het: heteroscedastic.


## 3.3. Methods for Fitting Adsorption Isotherms

Although there are some experiments where it is reasonable to assume that one variable (x) is largely free from errors, such an assumption is manifestly not true in cases of adsorption isotherms. The value on the x-axis is an equilibrium concentration, Ce,exp, which is determined by chemical analysis and thus inevitably affected by the measurement error. Equilibrium loading, qe,exp, (which is on the y-axis) is calculated from the equilibrium concentration, and as a result an error in this concentration appears in both coordinates. Particular attention must be given to equations in which one variable is involved on both sides, since the independence of errors is not fulfilled [30].  The use of orthogonal distance regression modeling procedure would be statistically correct in this case.Since this study is based on simulated data, population standard deviations of measurement errors are known and (10) can be transformed into theoretical orthogonal distance regression criterion (TODR) introducing the relations
(15)wi=1σεi,widi=1σδi,for the weights on they- and x-axes, respectively. It can be noticed that the population standard deviation of the error on the x-axis is actually the population standard deviation of the equilibrium concentration:
(16)σδi=σδie.For they axis, σεi is calculated based on (12). According to the error propagation law
(17)σεi2=k2[(σδie)2+(σδio)2],wherek=V/m, it is assumed that only the error of the Co,exp and Ce,exp determination is significant, while mass and volume can be accurately and precisely measured.Final formulation of the TODR error function which is minimized in case of theoretical fitting of adsorption data is presented as(18)TODR=∑i=1n[(qei,exp-qei,calσεi)2+(Cei,exp-Cei,calσδie)2].Although TODR cannot be used outside the theoretical domain, it was included in this study to serve as a golden standard. It is expected to represent the best possible results that can be achieved with the certain observations in possession.A typical isotherm data set in the experimental domain consists of 5–10 points. Very often, researches perform their experiments in triplicate [31–33], but in cases when the reagents are expensive or toxic there are no replications. By these two different methods, different levels of data quality are obtained. The objective of this paper was to take both of these cases into consideration.Data obtained in only one numerical experiment (matching the case when the laboratory experiments are performed with no replication) were fitted by the use of four error functions: OLS, ODR, MPSD, and HYBRD. Their expressions are presented in Table4. Least squares fitting of the linearized data (LIN) was additionally applied only on the Langmuir and Freundlich equations.Table 4
Definitions of error functions in cases when there are no replicated concentration measurements.
Name
Abbreviation
Domain
Expression
Theoretical orthogonal distance regression
TODR
Theoretical
∑
i
=
1
n
[
(
q
e
i
,
exp
-
q
e
i
,
cal
σ
ε
i
)
2
+
(
C
e
i
,
exp
-
C
e
i
,
cal
σ
δ
i
e
)
2
]
Ordinary least squares
OLS
Experimental
∑
i
=
1
n
(
q
e
i
,
exp
-
q
e
i
,
cal
)
2
Orthogonal distance regression
ODR
Experimental
∑
i
=
1
n
[
(
q
e
i
,
exp
-
q
e
i
,
cal
q
e
i
,
exp
)
2
+
(
C
e
i
,
exp
-
C
e
i
,
cal
C
e
i
,
exp
)
2
]
Marquardt’s percent standard deviation
MPSD
Experimental
∑
i
=
1
n
(
q
e
i
,
exp
-
q
e
i
,
cal
q
e
i
,
exp
)
2
Hybrid fractional error function
HYBRD
Experimental
∑
i
=
1
n
(
q
e
i
,
exp
-
q
e
i
,
cal
)
2
q
e
i
,
expFormulae of the error functions in Table4 are a bit different from the ones reviewed in [4]. The key reason is that the number of data points is constant all the time, and there will be no isotherm ranking based on this error functions, so the constants n-p were removed for the sake of simplicity. Parameter estimates obtained with these slightly modified error functions are the same because the multiplication of error function with a constant nonzero value does not affect the position of a global minimum.OLS, MPSD, and HYBRD are basically least squares methods with different types of weights included. OLS is the approach with all weights equal to one. In case of MPSD, assumption of constant percentage error is accepted and weighting by the equilibrium loading is applied. For the HYBRD error functions weights are of the Poisson type. ODR abbreviation in this context is used for the orthogonal distance regression analog of the MPSD. Assumption of constant percentage error is accepted for both of the axes, and the weights are1/qe,exp and 1/Ce,exp for the y- and x-axes, respectively.The second group of calculations matched the case when laboratory experiments are performed in triplicate. Means of equilibrium sorbent loading (q-ei,exp) and equilibrium sorbate concentration (C-ei,exp) from three subsequent numerical experiments were passed to the following error functions: experimental weighted orthogonal distance regression (E3WODR), triplicate orthogonal distance regression (E3ODR), and weighted least squares (WLS). Definitions of error functions for replicated measurements are listed in Table 5.Table 5
Definitions of error functions for replicated measurements.
Name
Abbreviation
Domain
Expression
Experimental weighted orthogonal distance regression
E3WODR
Experimental
∑
i
=
1
n
[
(
q
-
e
i
,
exp
-
q
e
i
,
cal
sd

y
i
)
2
+
(
C
-
e
i
,
exp
-
C
e
i
,
cal
sd

x
i
)
2
]
Weighted least squares
WLS
Experimental
∑
i
=
1
n
(
q
-
e
i
,
exp
-
q
e
i
,
cal
sd

y
i
)
2
Triplicate orthogonal distance regression
E3ODR
Experimental
∑
i
=
1
n
[
(
q
-
e
i
,
exp
-
q
e
i
,
cal
q
-
e
i
,
exp
)
2
+
(
C
-
e
i
,
exp
-
C
e
i
,
cal
C
-
e
i
,
exp
)
2
]It is important to say that E3WODR is the experimental realization of TODR. Estimates of standard deviation of the variables on they- and x-axes are calculated as described in Section 2.3.1 incorporating the following equations:
(19)sdyi=∑j=13(qei,exp-q-ei,exp)j22,(20)sdxi=∑j=13(Cei,exp-C-ei,exp)j22.Weighting in the E3ODR method is based on the mean values of equilibrium sorbent loading and equilibrium sorbate concentration:(21)wi=1q-ei,exp,widi=1C-ei,exp.For the WLS method, instrumental weights are calculated based on (19).


## 3.4. Numerical Calculations

The present work was carried out using Windows-based PC with hardware configuration containing the dual processor AMD Athlon M320 (2.1 GHz each) and with 3 GB RAM. All calculations were performed using Matlab R2007b. Perturbations were generated using Mersenne Twister random number generator. For the purpose of fitting, built-in Matlab function fminsearch was used for OLS, MPSD, HYBRD, and WLS [34]. It is based on the Nelder-Mead simplex direct search algorithm. Orthogonal distance regression calculations used the dsearchn function as a tool to find the set of (x^i,y^i) values.It is important to note that one complete numerical experiment and all associated computations were performed for each simulation step, for 2000 steps per combination (one type of isotherm and one type of NPM). The reason simulations were chosen to have 2000 steps was the compromise between the aim to have resulting histograms of quality high enough to facilitate quantitative comparison with theory and to prevent the process from lasting unacceptably long. Few of the simulations took longer than 12 hours, with the most averaging around 8 hours in length. It could be noticed that simulations with higher values of noise standard deviation in general lasted longer. The explanation is the rise in the number of function evaluations and the number of iterations before the convergence is achieved.


## 4. Results and Discussion

### 4.1. Postprocessing of the Results

This study included 55 numerical simulations on the whole (each of the five isotherms presented in Table1 was paired with the 11 noise precision models presented in Table 3) and they were individually subjected to the same postprocessing routine. The raw results of each numerical simulation were 2000 (two or three element) vectors of estimated parameters per modeling approach. Firstly, the cases when the particular fitting algorithm did not converge were counted, and corresponding parameter estimates were removed from further consideration. The second step in postprocessing procedure was to calculate percentage errors for all the parameter estimates:
(22)el,j=θ^l,j-θlθl100%,wherel is the parameter ordinal number in the isotherm equation (l∈{1,2} for the Langmuir, Freundlich, and Jovanovic isotherms and l∈{1,2,3} for Redlich-Peterson and Sips equations) and j is the number of numerical experiments. The third step was to identify and remove the outlier values. An el,j value was considered as an outlier if it is greater than 75th percentile plus 1.5 times the interquartile range or if it is less than 25th percentile minus 1.5 times the interquartile range. The outliers were removed to once again match the simulated and real cases. It is common practice to discard the fitting results if they do not correspond to common sense. Sets of percentage error on parameters obtained in the described way were used for statistical evaluation.


### 4.2. Statistical Evaluation

The normal probability plots were used to graphically assess whether the obtained parameter estimates could come from a normal distribution. Inspection of such plots showed that in general they are not linear. Distributions other than normal introduce curvature, so it was concluded that nonnormal distribution is involved. One representative example is presented in Figure3.Figure 3
Normal probability plot for the parameters of Redlich-Peterson isotherm and OLS processing.Thus, median of percentage error (mE) was used as a measure of accuracy of the method based on a particular error function, and mean absolute relative error (MARE),(23)MARE=1kf∑j=1kf|el,j|,
where kf is the number of converged fits for the particular method in a simulation, was used as a measure of precision. The individual performance of each modeling approach was evaluated for each isotherm and for each type of noise.Comparison of the methods was done separately for the two following groups of data: observations with no replications and data from triplicate experiments.Properties of different modeling approaches in case when the experiments are performed once are presented  in Figures4, 5, 6, 7, and 8 for the Langmuir, Freundlich, Jovanovic, Redlich-Peterson, and Sips adsorption isotherms, respectively.Properties of different modeling approaches for determination of parameters in Langmuir isotherm (experiments performed once): (a) mE and (b) MARE.
(a)
(b)Properties of different modeling approaches for determination of parameters in Freundlich isotherm (experiments performed once): (a) mE and (b) MARE.
(a)
(b)Properties of different modeling approaches for determination of parameters in Jovanovic isotherm (experiments performed once): (a) mE and (b) MARE.
(a)
(b)Properties of different modeling approaches for determination of parameters in Redlich-Peterson isotherm (experiments performed once): (a) mE and (b) MARE.
(a)
(b)Properties of different modeling approaches for determination of parameters in Sips isotherm (experiments performed once): (a) mE and (b) MARE.
(a)
(b)Properties of different modeling approaches in case when the experiments are performed three times are presented in  Figures A.1–A.5 as in Supplementary Material available online athttp://dx.doi.org/10.1155/2014/930879, for the Langmuir, Freundlich, Jovanovic, Redlich-Peterson, and Sips adsorption isotherms, respectively.Due to a huge quantity of results obtained in this study, some rules had to be put on what is going to be presented in figures. For every type of isotherm, the figures are organized to have two sections: one where mE values are presented (figures labeled (a)) and the other where MARE values are presented (figures labeled (b)). Each section of the plot contains 7 subplots. In one subplot, the results of the applied methods for one NPM are summarized. Trends were noticed and discussed based on the six levels of homoscedastic noise, but in order to make figures compact just two out of six NPMs (H2 as an example of low noise, and H5 as an example of high noise) were presented as the first two subplots. The next five (3–7) subplots were reserved for heteroscedastic NPMs. An additional remark is valid for all the figures in the following paragraph: it was not possible to use the same scale in all subplots, due to large differences in the magnitudes of the outcomes from subplot to subplot. Nevertheless, it does not introduce any problem because the comparison of methods is done in frames of a subplot, and cross comparisons between different NPMs (and subplots) are not of substantial importance.


#### 4.2.1. Experiments with No Replications and Homoscedastic Noise

As expected, for the very low level of homoscedastic noise (H1 and H2 noise precision models), all of the examined methods performed well. With the increasing of noise standard deviation, the accuracy and precision of the methods became worse, and differences between methods started to appear.Generalizing the results of all the five isotherms, the following statements can be placed. Regardless of the mathematical type of isotherm equation (rational, power, or exponential) and the number of parameters (two or three), the OLS method had the best properties. In the group of methods applicable in practice, it achieved mE values closest to zero and the lowest values of MARE, almost identical to ones determined by the theoretical method TODR. mE of the other tested methods showed higher discrepancy from zero, and MARE values were higher. ODR and MPSD methods had a very bad performance, while the results of the HYBRD method were somewhere in between.Closeness of the results of OLS and TODR methods showed that in case of homoscedastic noise, the presence of measurement error on both axes is not of great importance, as it could be expected. What is more, the weighting by1/qe,exp and 1/Ce,exp for the y- and x-axes, respectively, in the ODR method is actually wrong since the population standard deviations are constant at all concentrations. That is the reason why the ODR method is biased and of low precision. In the recent study, the different modeling approaches were tested on a Langmuir isotherm with perturbations of data with the fixed error N(0, 0.05) and with ±5% error proportional to concentration  [35]. Surprisingly, authors found that the ODR gives the most accurate estimates (lowest mean, standard deviation, and interquartile range) of the isotherm parameters among different methods when the experimental data have a fixed error.For the two parameter isotherms (Langmuir and Freundlich), linearized models were tested due to their popularity. Modeling of linearized Langmuir equation was the only exception from the rule that the greater the population standard deviation of the noise, the greater the discrepancies of parameter estimates from their true values. Regardless of the level of noise, the LIN method presented equally bad results. The mE was about −65% and MARE in the range 60–85% for both of the parameters. For the Freundlich isotherm, LIN model was more accurate than HYBRD, MPSD, and ODR and had about the same variability as MPSD, still resigning in the group of modeling approaches whose usage is not advised in the case of homoscedastic data.


#### 4.2.2. Experiments with No Replications and Heteroscedastic Noise

Looking at the subplots 3–7 of Figures5–8 where the results of modeling Freundlich, Jovanovic, Redlich-Peterson, and Sips isotherm are presented, the pattern of the OLS method performance can be easily recognized. For all of the isotherms and all of the tested NPMs, this method was the poorest of all the methods, in both the aspects of its accuracy and precision. This is the expected result because the basic assumptions when the OLS method is valid are not met. It is interesting to note that for the Langmuir isotherm (Figure 4, subplots 3–7), OLS method was the most accurate method, but the precision was still very, very poor (always more than  35% for the qmax and more than 100% for the KL). The same as for the other isotherm types, the use of OLS for the Langmuir isotherm is not advised in the presence of any type of heteroscedastic noise.The ODR method was generally as accurate as TODR. The greatest deviation of mE from zero was −3.2% for the RSD10% noise type andKF parameter of Freundlich isotherm, 5.7% for the Lin noise type and KJ parameter of Jovanovic isotherm, −7.5% for the HS noise type and aR parameter of Redlich-Peterson isotherm, and −10.9% for the HS noise type and qS parameter of Sips isotherm. Only for the Langmuir isotherm, difference between mE of the ODR and TODR was more pronounced, reaching the absolute maximum value of 30.0% for KL.  The MARE of ODR was higher than the MARE of TODR but the lowest among the other tested methods. Typical values of MARE of Langmuir isotherm were in the range 27%–39% for qmax and 39.7%–70.4% for KL. For the Freundlich isotherm, MARE was below 10% for both of the parameters and all types of NPMs. The precision in case of Redlich-Peterson isotherm was roughly about 20% for KR and g and two or three times higher for the aR. For the Sips isotherm, the maximum MARE was 53.7% for aR in case of RSD10%, but most of the time it was roughly about 30%. Direct comparison of ODR and MPSD qualified MPSD as the second best choice method. Its accuracy and variability were at the same level or closely followed the ODR. The HYBRD method was neither accurate nor precise, again performing between the worst (OLS) and the best (ODR) methods. The same can be stated for the LIN method of the Langmuir and Freundlich isotherms.


#### 4.2.3. Experiments Performed in Triplicate

In case when the equilibrium adsorption experiments are performed once and the estimates of standard deviation of the measurement error are not available weighting is restricted to be fixed or to be some function of measured variable. When the experiments are done in triplicate, this restriction is released since the estimates of standard deviations could be obtained. The adsorption literature, surprisingly, rarely takes into account these important statistical details related to the processing of data in regression analysis with replicate measurements. Commonly, but not properly, data from triplicate measurements are just averaged, and their mean values are further on processed like OLS. Weighted regression is a way of preserving the information and thus should be preferred.In  Figures A.1–A.5 (in Supplementary Material), the results of modeling Langmuir, Freundlich, Jovanovic, Redlich-Peterson, and Sips isotherm are presented. At first glance, it can be noticed that the accuracy and precision of the methods are better than in case of one experiment per point.The E3WODR method had the best properties, WLS performed slightly worse, and E3ODR was ranked the third. The exception was only the Freundlich equation, where MARE values tended to lower for E3ODR method in case of heteroscedastic noise. However, difference between E3WODR and E3ODR was less than 1%, and thus this particular behavior is not of great importance.


## 4.1. Postprocessing of the Results

This study included 55 numerical simulations on the whole (each of the five isotherms presented in Table1 was paired with the 11 noise precision models presented in Table 3) and they were individually subjected to the same postprocessing routine. The raw results of each numerical simulation were 2000 (two or three element) vectors of estimated parameters per modeling approach. Firstly, the cases when the particular fitting algorithm did not converge were counted, and corresponding parameter estimates were removed from further consideration. The second step in postprocessing procedure was to calculate percentage errors for all the parameter estimates:
(22)el,j=θ^l,j-θlθl100%,wherel is the parameter ordinal number in the isotherm equation (l∈{1,2} for the Langmuir, Freundlich, and Jovanovic isotherms and l∈{1,2,3} for Redlich-Peterson and Sips equations) and j is the number of numerical experiments. The third step was to identify and remove the outlier values. An el,j value was considered as an outlier if it is greater than 75th percentile plus 1.5 times the interquartile range or if it is less than 25th percentile minus 1.5 times the interquartile range. The outliers were removed to once again match the simulated and real cases. It is common practice to discard the fitting results if they do not correspond to common sense. Sets of percentage error on parameters obtained in the described way were used for statistical evaluation.


## 4.2. Statistical Evaluation

The normal probability plots were used to graphically assess whether the obtained parameter estimates could come from a normal distribution. Inspection of such plots showed that in general they are not linear. Distributions other than normal introduce curvature, so it was concluded that nonnormal distribution is involved. One representative example is presented in Figure3.Figure 3
Normal probability plot for the parameters of Redlich-Peterson isotherm and OLS processing.Thus, median of percentage error (mE) was used as a measure of accuracy of the method based on a particular error function, and mean absolute relative error (MARE),(23)MARE=1kf∑j=1kf|el,j|,
where kf is the number of converged fits for the particular method in a simulation, was used as a measure of precision. The individual performance of each modeling approach was evaluated for each isotherm and for each type of noise.Comparison of the methods was done separately for the two following groups of data: observations with no replications and data from triplicate experiments.Properties of different modeling approaches in case when the experiments are performed once are presented  in Figures4, 5, 6, 7, and 8 for the Langmuir, Freundlich, Jovanovic, Redlich-Peterson, and Sips adsorption isotherms, respectively.Properties of different modeling approaches for determination of parameters in Langmuir isotherm (experiments performed once): (a) mE and (b) MARE.
(a)
(b)Properties of different modeling approaches for determination of parameters in Freundlich isotherm (experiments performed once): (a) mE and (b) MARE.
(a)
(b)Properties of different modeling approaches for determination of parameters in Jovanovic isotherm (experiments performed once): (a) mE and (b) MARE.
(a)
(b)Properties of different modeling approaches for determination of parameters in Redlich-Peterson isotherm (experiments performed once): (a) mE and (b) MARE.
(a)
(b)Properties of different modeling approaches for determination of parameters in Sips isotherm (experiments performed once): (a) mE and (b) MARE.
(a)
(b)Properties of different modeling approaches in case when the experiments are performed three times are presented in  Figures A.1–A.5 as in Supplementary Material available online athttp://dx.doi.org/10.1155/2014/930879, for the Langmuir, Freundlich, Jovanovic, Redlich-Peterson, and Sips adsorption isotherms, respectively.Due to a huge quantity of results obtained in this study, some rules had to be put on what is going to be presented in figures. For every type of isotherm, the figures are organized to have two sections: one where mE values are presented (figures labeled (a)) and the other where MARE values are presented (figures labeled (b)). Each section of the plot contains 7 subplots. In one subplot, the results of the applied methods for one NPM are summarized. Trends were noticed and discussed based on the six levels of homoscedastic noise, but in order to make figures compact just two out of six NPMs (H2 as an example of low noise, and H5 as an example of high noise) were presented as the first two subplots. The next five (3–7) subplots were reserved for heteroscedastic NPMs. An additional remark is valid for all the figures in the following paragraph: it was not possible to use the same scale in all subplots, due to large differences in the magnitudes of the outcomes from subplot to subplot. Nevertheless, it does not introduce any problem because the comparison of methods is done in frames of a subplot, and cross comparisons between different NPMs (and subplots) are not of substantial importance.


### 4.2.1. Experiments with No Replications and Homoscedastic Noise

As expected, for the very low level of homoscedastic noise (H1 and H2 noise precision models), all of the examined methods performed well. With the increasing of noise standard deviation, the accuracy and precision of the methods became worse, and differences between methods started to appear.Generalizing the results of all the five isotherms, the following statements can be placed. Regardless of the mathematical type of isotherm equation (rational, power, or exponential) and the number of parameters (two or three), the OLS method had the best properties. In the group of methods applicable in practice, it achieved mE values closest to zero and the lowest values of MARE, almost identical to ones determined by the theoretical method TODR. mE of the other tested methods showed higher discrepancy from zero, and MARE values were higher. ODR and MPSD methods had a very bad performance, while the results of the HYBRD method were somewhere in between.Closeness of the results of OLS and TODR methods showed that in case of homoscedastic noise, the presence of measurement error on both axes is not of great importance, as it could be expected. What is more, the weighting by1/qe,exp and 1/Ce,exp for the y- and x-axes, respectively, in the ODR method is actually wrong since the population standard deviations are constant at all concentrations. That is the reason why the ODR method is biased and of low precision. In the recent study, the different modeling approaches were tested on a Langmuir isotherm with perturbations of data with the fixed error N(0, 0.05) and with ±5% error proportional to concentration  [35]. Surprisingly, authors found that the ODR gives the most accurate estimates (lowest mean, standard deviation, and interquartile range) of the isotherm parameters among different methods when the experimental data have a fixed error.For the two parameter isotherms (Langmuir and Freundlich), linearized models were tested due to their popularity. Modeling of linearized Langmuir equation was the only exception from the rule that the greater the population standard deviation of the noise, the greater the discrepancies of parameter estimates from their true values. Regardless of the level of noise, the LIN method presented equally bad results. The mE was about −65% and MARE in the range 60–85% for both of the parameters. For the Freundlich isotherm, LIN model was more accurate than HYBRD, MPSD, and ODR and had about the same variability as MPSD, still resigning in the group of modeling approaches whose usage is not advised in the case of homoscedastic data.


### 4.2.2. Experiments with No Replications and Heteroscedastic Noise

Looking at the subplots 3–7 of Figures5–8 where the results of modeling Freundlich, Jovanovic, Redlich-Peterson, and Sips isotherm are presented, the pattern of the OLS method performance can be easily recognized. For all of the isotherms and all of the tested NPMs, this method was the poorest of all the methods, in both the aspects of its accuracy and precision. This is the expected result because the basic assumptions when the OLS method is valid are not met. It is interesting to note that for the Langmuir isotherm (Figure 4, subplots 3–7), OLS method was the most accurate method, but the precision was still very, very poor (always more than  35% for the qmax and more than 100% for the KL). The same as for the other isotherm types, the use of OLS for the Langmuir isotherm is not advised in the presence of any type of heteroscedastic noise.The ODR method was generally as accurate as TODR. The greatest deviation of mE from zero was −3.2% for the RSD10% noise type andKF parameter of Freundlich isotherm, 5.7% for the Lin noise type and KJ parameter of Jovanovic isotherm, −7.5% for the HS noise type and aR parameter of Redlich-Peterson isotherm, and −10.9% for the HS noise type and qS parameter of Sips isotherm. Only for the Langmuir isotherm, difference between mE of the ODR and TODR was more pronounced, reaching the absolute maximum value of 30.0% for KL.  The MARE of ODR was higher than the MARE of TODR but the lowest among the other tested methods. Typical values of MARE of Langmuir isotherm were in the range 27%–39% for qmax and 39.7%–70.4% for KL. For the Freundlich isotherm, MARE was below 10% for both of the parameters and all types of NPMs. The precision in case of Redlich-Peterson isotherm was roughly about 20% for KR and g and two or three times higher for the aR. For the Sips isotherm, the maximum MARE was 53.7% for aR in case of RSD10%, but most of the time it was roughly about 30%. Direct comparison of ODR and MPSD qualified MPSD as the second best choice method. Its accuracy and variability were at the same level or closely followed the ODR. The HYBRD method was neither accurate nor precise, again performing between the worst (OLS) and the best (ODR) methods. The same can be stated for the LIN method of the Langmuir and Freundlich isotherms.


### 4.2.3. Experiments Performed in Triplicate

In case when the equilibrium adsorption experiments are performed once and the estimates of standard deviation of the measurement error are not available weighting is restricted to be fixed or to be some function of measured variable. When the experiments are done in triplicate, this restriction is released since the estimates of standard deviations could be obtained. The adsorption literature, surprisingly, rarely takes into account these important statistical details related to the processing of data in regression analysis with replicate measurements. Commonly, but not properly, data from triplicate measurements are just averaged, and their mean values are further on processed like OLS. Weighted regression is a way of preserving the information and thus should be preferred.In  Figures A.1–A.5 (in Supplementary Material), the results of modeling Langmuir, Freundlich, Jovanovic, Redlich-Peterson, and Sips isotherm are presented. At first glance, it can be noticed that the accuracy and precision of the methods are better than in case of one experiment per point.The E3WODR method had the best properties, WLS performed slightly worse, and E3ODR was ranked the third. The exception was only the Freundlich equation, where MARE values tended to lower for E3ODR method in case of heteroscedastic noise. However, difference between E3WODR and E3ODR was less than 1%, and thus this particular behavior is not of great importance.


## 4.2.1. Experiments with No Replications and Homoscedastic Noise

As expected, for the very low level of homoscedastic noise (H1 and H2 noise precision models), all of the examined methods performed well. With the increasing of noise standard deviation, the accuracy and precision of the methods became worse, and differences between methods started to appear.Generalizing the results of all the five isotherms, the following statements can be placed. Regardless of the mathematical type of isotherm equation (rational, power, or exponential) and the number of parameters (two or three), the OLS method had the best properties. In the group of methods applicable in practice, it achieved mE values closest to zero and the lowest values of MARE, almost identical to ones determined by the theoretical method TODR. mE of the other tested methods showed higher discrepancy from zero, and MARE values were higher. ODR and MPSD methods had a very bad performance, while the results of the HYBRD method were somewhere in between.Closeness of the results of OLS and TODR methods showed that in case of homoscedastic noise, the presence of measurement error on both axes is not of great importance, as it could be expected. What is more, the weighting by1/qe,exp and 1/Ce,exp for the y- and x-axes, respectively, in the ODR method is actually wrong since the population standard deviations are constant at all concentrations. That is the reason why the ODR method is biased and of low precision. In the recent study, the different modeling approaches were tested on a Langmuir isotherm with perturbations of data with the fixed error N(0, 0.05) and with ±5% error proportional to concentration  [35]. Surprisingly, authors found that the ODR gives the most accurate estimates (lowest mean, standard deviation, and interquartile range) of the isotherm parameters among different methods when the experimental data have a fixed error.For the two parameter isotherms (Langmuir and Freundlich), linearized models were tested due to their popularity. Modeling of linearized Langmuir equation was the only exception from the rule that the greater the population standard deviation of the noise, the greater the discrepancies of parameter estimates from their true values. Regardless of the level of noise, the LIN method presented equally bad results. The mE was about −65% and MARE in the range 60–85% for both of the parameters. For the Freundlich isotherm, LIN model was more accurate than HYBRD, MPSD, and ODR and had about the same variability as MPSD, still resigning in the group of modeling approaches whose usage is not advised in the case of homoscedastic data.


## 4.2.2. Experiments with No Replications and Heteroscedastic Noise

Looking at the subplots 3–7 of Figures5–8 where the results of modeling Freundlich, Jovanovic, Redlich-Peterson, and Sips isotherm are presented, the pattern of the OLS method performance can be easily recognized. For all of the isotherms and all of the tested NPMs, this method was the poorest of all the methods, in both the aspects of its accuracy and precision. This is the expected result because the basic assumptions when the OLS method is valid are not met. It is interesting to note that for the Langmuir isotherm (Figure 4, subplots 3–7), OLS method was the most accurate method, but the precision was still very, very poor (always more than  35% for the qmax and more than 100% for the KL). The same as for the other isotherm types, the use of OLS for the Langmuir isotherm is not advised in the presence of any type of heteroscedastic noise.The ODR method was generally as accurate as TODR. The greatest deviation of mE from zero was −3.2% for the RSD10% noise type andKF parameter of Freundlich isotherm, 5.7% for the Lin noise type and KJ parameter of Jovanovic isotherm, −7.5% for the HS noise type and aR parameter of Redlich-Peterson isotherm, and −10.9% for the HS noise type and qS parameter of Sips isotherm. Only for the Langmuir isotherm, difference between mE of the ODR and TODR was more pronounced, reaching the absolute maximum value of 30.0% for KL.  The MARE of ODR was higher than the MARE of TODR but the lowest among the other tested methods. Typical values of MARE of Langmuir isotherm were in the range 27%–39% for qmax and 39.7%–70.4% for KL. For the Freundlich isotherm, MARE was below 10% for both of the parameters and all types of NPMs. The precision in case of Redlich-Peterson isotherm was roughly about 20% for KR and g and two or three times higher for the aR. For the Sips isotherm, the maximum MARE was 53.7% for aR in case of RSD10%, but most of the time it was roughly about 30%. Direct comparison of ODR and MPSD qualified MPSD as the second best choice method. Its accuracy and variability were at the same level or closely followed the ODR. The HYBRD method was neither accurate nor precise, again performing between the worst (OLS) and the best (ODR) methods. The same can be stated for the LIN method of the Langmuir and Freundlich isotherms.


## 4.2.3. Experiments Performed in Triplicate

In case when the equilibrium adsorption experiments are performed once and the estimates of standard deviation of the measurement error are not available weighting is restricted to be fixed or to be some function of measured variable. When the experiments are done in triplicate, this restriction is released since the estimates of standard deviations could be obtained. The adsorption literature, surprisingly, rarely takes into account these important statistical details related to the processing of data in regression analysis with replicate measurements. Commonly, but not properly, data from triplicate measurements are just averaged, and their mean values are further on processed like OLS. Weighted regression is a way of preserving the information and thus should be preferred.In  Figures A.1–A.5 (in Supplementary Material), the results of modeling Langmuir, Freundlich, Jovanovic, Redlich-Peterson, and Sips isotherm are presented. At first glance, it can be noticed that the accuracy and precision of the methods are better than in case of one experiment per point.The E3WODR method had the best properties, WLS performed slightly worse, and E3ODR was ranked the third. The exception was only the Freundlich equation, where MARE values tended to lower for E3ODR method in case of heteroscedastic noise. However, difference between E3WODR and E3ODR was less than 1%, and thus this particular behavior is not of great importance.


## 5. Conclusions and Recommendations

The accuracy of model parameters will depend on whether the appropriate conceptual model was chosen, whether the experimental conditions were representative of environmental conditions, and whether an appropriate parameter estimation method was used.Recently our group faced the problem of modeling the adsorption isotherms [36, 37] and the intention of this study was to single out the method of parameter estimation which is suitable for adsorption isotherms. A detailed investigation has been carried out to determine whether the mathematical type of isotherm function and the type of measurement noise (homoscedastic or heteroscedastic) are key factors that lead to modeling approach choice. Commonly used methods: OLS and least squares of linearized equations, methods that are far less present in literature: HYBRD and MPSD, and a method that is hardly ever used in adsorption field: orthogonal distance regression, were compared. Evaluations of these methods were conducted on a large number of data sets, allowing precision and accuracy of parameter estimates to be determined by comparison with true parameter values.It was demonstrated that trends that could be noticed do not show dependence on isotherm type. Only the magnitude of percent errors in parameter estimates classifies some of the equation types and their particular parameters as difficult to fit (aR in Redlich-Peterson isotherm). It was shown that the impact of measurement error noise type is significant. Neglecting the information about noise structure can lead to biased and/or imprecise parameter estimates and the researcher should obtain the information about the measurement error type of the analytical method used for concentration determination. (Testing the analytical system for heteroscedasticity should be a part of validation protocol necessary for the limit of detection calculation [38, 39].) As expected, OLS method performed superior in case of homoscedastic noise, no matter whether the noise is high or low. The results for heteroscedastic noise types revealed the potential of using ODR method, with weighting proportional to 1/qe,exp and  1/Ce,exp for the y- and x-axes, respectively. In this situation, use of this method resulted in smaller bias and better precision. Although frequently being used in present adsorption literature for fitting adsorption isotherms, OLS method is an unfavorable method for the heteroscedastic data, performing much worse than other nonlinear methods.The accuracy and variability of orthogonal distance regression-based methods (ODR for experiments performed once and E3ODR and E3WODR for experiments preformed in triplicate) are closely followed by the analog methods that do not take into account the influence of measurement error on both axes: MPSD and WLS.Linearization of isotherm equations was once again discarded in this study. Since the survey of the literature published in last decade showed that in over 95% of the liquid phase adsorption systems the linearization is the preferred method [4], a lot of attention should be put on education and spreading the right principles among researches.Further research that is currently in progress in our group will hopefully resolve the issue of adequate model selection in adsorption studies.



---

*Source: 930879-2014-01-30.xml*