XLSTAT-Time

View tutorialsXLSTAT-Time is an Excel add-in which has been developed to provide XLSTAT-Pro users with a powerful solution for time series analysis and forecasting.

XLSTAT-Time functions provide you with outstanding tools to find out the degree of dependence between the values of a time series, to discover trends - seasonal or not, to apply specific pretreatments such as the Autoregressive Moving Average variants and finally to build predictive models. All XLSTAT-Time functions have been intensively tested against other software to guarantee the users fully reliable results.

Features

You can find tutorials that explains how XLSTAT-Time works here.

Demo version

A trial version of XLSTAT-Time is included in the main XLSTAT-Pro download.

Prices and ordering

For prices, on-line ordering and other purchasing information please go to our ordering page.

 

 

 

DETAILED DESCRIPTIONS

Fourier transformation

Fourier transformation transforms one complex-valued function of a real variable into another. The domain of the original function is typically time. The domain of the new function is typically called the frequency domain. It describes which frequencies are present in the original function. In effect, the Fourier transform decomposes a function into oscillatory functions. The expression “Fourier transform” refers both to the frequency domain representation of a function, and to the process or formula that "transforms" one function into the other.

Fourier transformation use

Fourier transformation is used to transform a time series or a signal to its Fourier coordinates, or to do the inverse transformation. While the Excel function is limited to powers of two for the length of the time series, XLSTAT is not restricted. Outputs optionally include the amplitude and the phase.

 

 

Spectral analysis

View a tutorialSpectral analysis allows transforming a time series into its coordinates in the space of frequencies, and then to analyze its characteristics in this space. The magnitude and phase can be extracted from the coordinates. It is then possible to build representations such as the periodogram or the spectral density, and to test if the series is stationary. By studying the spectral density, seasonal components and/or noise can be identified. Spectral analysis is a very general method used in a variety of domains.

The spectral representation of a time series X_t, (t=1,…,n), decomposes X_t into a sum of sinusoidal components with uncorrelated random coefficients. From there we can obtain decomposition the autocovariance and autocorrelation functions into sinusoids.

Spectral density

The spectral density corresponds to the transform of a continuous time series. However, we usually have only access to a limited number of equally spaced data, and therefore, we need to obtain first the discrete Fourier coordinates (cosine and sine transforms), and then the periodogram. From the periodogram, using a smoothing function, we can obtain a spectral density estimate which is a better estimator of the spectrum.

The spectral density estimate (or discrete spectral average estimator) of the time series X_t uses weights. The weights, are either fixed by the user, or determined by the choice of a kernel. XLSTAT suggests the use of the following kernels:

• Parzen
• Quadratic spectral
• Tukey-Hanning
• Truncated

White noise tests

XLSTAT optionally displays two test statistics and the corresponding p-values for white noise: Fisher's Kappa and Bartlett's Kolmogorov-Smirnov statistic.

XLSTAT-Time spectral analysis

Using fast and powerful methods, XLSTAT automatically computes the Fourier cosine and sine transforms of X_t, for each Fourier frequency, and then the various functions that derive from these transforms.

 

 

Descriptive statistics

View a tutorialOne of the key issues in time series analysis is to determine whether the value we observe at time t depends on what has been observed in the past or not. If the answer is yes, then the next question is how.

Autocovariances, autocorrelations, and partial autocorrelations

The sample autocovariance function (ACVF) and the autocorrelation function (ACF) give an idea of the degree of dependence between the values of a time series. The visualization of the ACF or of the partial autocorrelation function (PACF) helps to identify the suitable models to explain the past observations and to do predictions. The theory shows that the PACF function of an AR(p) – an autoregressive process of order p - is zero for lags greater than p.

Cross-correlations

The cross-correlations function (CCF) allows to relate two time series, and to determine if they co-vary and to which extend.
The ACVF, the ACF, the PACF and CCF are computed by this tool.

Normality and white noise tests at different time lags

One important step in time series analysis is the transformation of time which goal is to obtain a white noise. Obtaining a white noise means that all deterministic and autocorrelations components have been removed. Several white noise tests, based on the ACF, are available to test whether a time series can be assumed to be a white noise or not.

 

 

Time Series Transformation

XLSTAT offers four different possibilities for transforming a time series X_t into Y_t, (t=1,…,n):

Box-Cox transform (fixed or optimised)

Box-Cox transformation to improve the normality of the time series; the Box-Cox transformation is defined by the following equation:

Y_t = [ ( X²_t - 1 ) / λ , (X_t > 0, λ ≠ 0 ) or (X_t ≥ 0, λ > 0 ) ; ln( X_t ), (X_t > 0, λ = 0) ]

XLSTAT accepts a fixed value of λ, or it can find the value that maximizes the likelihood of the residuals, the model being a simple linear model with the time as sole explanatory variable.

Differencing (1-B)^d(1-B_s)^D

Differencing, to remove trend and seasonalities and to obtain stationarity of the time series. The difference equation writes:

Y_t = (1-B)^d (1-B^s)^D X_t

where d is the order of the first differencing component, s is the period of the seasonal component, D is the order of the seasonal component, and B is the lag operator defined by:

BX_t = X_t-1

The values of (d, D, s) can be chosen in a trial and error process, or guessed by looking at the descriptive functions (ACF, PACF). Typical values are (1,1,s), (2,1,s). s is 12 for monthly data with a yearly seasonality, 0 when there is no seasonality.

Detrending and deseasonalizing

Detrending and deseasonalizing, using the classical decomposition model which writes:

X_t = m_t + s_t + e_t

where m_t is the trend component and s_t the seasonal component, and e_t is a N(0,1) white noise component.

XLSTAT allows fitting this model in two separate and/or successive steps:

Detrending by polynomial regression

X _t = m _t + e _t = S_i=0..k a_itⁱ + e_t

where k is the polynomial degree. The a_i parameters are obtained by fitting a linear model to the data. The transformed time series writes:

Y _t = e _t = X _t - = S_i=0..p a_itⁱ

Deseasonalization by linear model

X_t = s_t + e_t = µ + b_i + e_t, i = t mod p

where p is the period. The b_i parameters are obtained by fitting a linear model to the data. The transformed time series writes:

Y_t = e_t = X_t - µ - b_i

Note: there exist many other possible transformations. Some of them are available in the transformations tool of XLSTAT-Pro (see the "Preparing data" section). Linear filters may also be applied. Moving average smoothing methods which are linear filters are available in the "Smoothing" tool of XLSTAT.

 

 

Smoothing of time series

Several smoothing methods are available in the XLSTAT-Time software. They are described below.

Simple exponential smoothing

This model is sometimes referred to as Brown's Simple Exponential Smoothing, or the exponentially weighted moving average model.
Exponential smoothing is useful when one needs to model a value by simply taking into account past observations. It is called "exponential" because the weight of past observations decreases exponentially. This method it is not very satisfactory in terms of prediction, as the predictions are constant after n+1.

Double exponential smoothing

This model is sometimes referred to as Brown's Linear Exponential Smoothing or Brown's Double Exponential Smoothing. It allows taking into account a trend that varies with time. The predictions take into account the trend as it is for the last observed data.

Holt’s linear exponential smoothing

This model is sometimes referred to as the Holt-Winters non seasonal algorithm. It enables taking into account a permanent component and a trend that varies with time. This model adapts itself quicker to the data compared with the double exponential smoothing. It involves a second parameter. The predictions for t>n take into account the permanent component and the trend component.

Holt-Winters seasonal additive model

This method considers a trend that varies with time and a seasonal component with a period p. The predictions take into account the trend and the seasonality. The model is called additive because the seasonality effect is stable and does not grow with time.

Holt-Winters seasonal multiplicative model

View a tutorialThis method ponders a trend that varies with time and a seasonal component with a period p. The predictions take into account the trend and the seasonality. The model is called multiplicative because the seasonality effect varies with time. The more the discrepancies between the observations are high, the more the seasonal component increases.

Note 1: for all the above models, XLSTAT estimates the values of the parameters that minimize the mean square error (MSE). However, it is also possible to maximize the likelihood, as, apart from the Holt-Winters multiplicative model, it is possible to write these models as ARIMA models. For example, the simple exponential smoothing is equivalent to an ARIMA(0,1,1) model, and the Holt-Winters additive model is equivalent to an ARIMA (0,1,p+1)(0,1,0) p. If you prefer to maximize the likelihood, we advise you to use the ARIMA procedure of XLSTAT.

Note 2: for all the above models, initial values for S, T and D, are required. XLSTAT offers several options, including backcasting to set these values. When backcasting is selected, the algorithm reverses the series, starts with simple initial values corresponding to the Y(x) option, then computes estimates and uses these estimates as initial values.

Moving average

This model is a simple way to take into account past and optionally future observations to predict values. It works as a filter that is able to remove noise. While with the smoothing methods defined below, an observation influences all future predictions (even if the decay is exponential), in the case of the moving average the memory is limited to q. If the constant l is set to zero, the prediction depends on the past q values and on the current value, and if l is set to one, it also depends on the next q values. Moving averages are often used as filters, and not as way to do accurate predictions.

Fourier smoothing

The concept of the Fourier smoothing is to transform a time series into its Fourier coordinates, then remove part of the higher frequencies, and then transform the coordinates back to a signal. This new signal is a smoothed series.

XLSTAT-Time offers a wide selection of ARIMA models such as ARMA (Autoregressive Moving Average), an ARIMA (Autoregressive Integrated Moving Average) or a SARIMA (Seasonal Autoregressive Integrated Moving Average).

 

 

ARIMA

View a tutorialXLSTAT-Time offers a wide selection of ARIMA models such as ARMA (Autoregressive Moving Average), an ARIMA (Autoregressive Integrated Moving Average) or a SARIMA (Seasonal Autoregressive Integrated Moving Average).

ARIMA algebra

The models of the ARIMA family allow to represent in a synthetic way phenomena that vary with time, and to predict future values with a confidence interval around the predictions.

The mathematical writing of the ARIMA models differs from one author to the other. The differences concern most of the time the sign of the coefficients. XLSTAT is using the most commonly found writing, used by most software.
Si we define by X_t a series with mean µ, then if the series is supposed to follow an ARIMA(p,d,q)(P,D,Q)s model, we can write:

[ Y_t = (1 – B)^d (1 – B^s)^D X_t - µ ;
Φ(B)Ø(B^s))Y_t = θ(B) Θ(B^s) Z_t, Z_t∞N(0,σ²) ]

with

[ Φ(z) = 1 – Σ^p_i=1 Φ_i zⁱ, Ø(z)= 1 – Σ^p_i=1 Ø_i zⁱ ;
θ(z) = 1 + Σ^q_i=1 θ_i zⁱ, Θ(z) = 1 + Σ^q_i=1 Θ_i zⁱ ]

p is the order of the autoregressive part of the model.
q is the order of the moving average part of the model.
d is the differencing order of the model.
D is the differencing order of the seasonal part of the model.
s is the period of the model (for example 12 if the data are monthly data, and if one noticed a yearly cyclicity in the data).
P is the order of the autoregressive seasonal part of the model.
Q is the order of the moving average seasonal part of the model.

• Remark 1: the Y_t process is causal if and only if for any z such that |z|≤1, f(z)≠0 and q(z)≠0.
• Remark 2: if D=0, the model is an ARIMA(p,d,q) model. In that case, P, Q and s are considered as null.
• Remark 3: if d=0 and D=0, the model simplifies to an ARMA(p,q) model.
• Remark 4: if d=0, D=0 and q=0, the model simplifies to an AR(p) model.
• Remark 5: if d=0, D=0 and p=0, the model simplifies to an MA(q) model.

Explanatory variables

XLSTAT allows you to take into account explanatory variables through a linear model. Three different approaches are possible:

1. OLS: A linear regression model is fitted using the classical linear regression approach, then the residuals are modeled using an (S)ARIMA model.
2. CO-LS: If d or D and s are not zero, the data (including the explanatory variables) are differenced, then the corresponding ARMA model is fitted at the same time as the linear model coefficients using the Cochrane and Orcutt (1949) approach.
3. GLS: A linear regression model is fitted, then the residuals are modeled using an (S)ARIMA model, then we loop back to the regression step, in order to improve the likelihood of the model by changing the regression coefficients using a Newton-Raphson approach.

Note: if no differencing is requested (d=0 and D=0), and if there are no explanatory variables in the model, the constant of the model is estimated using CO-LS.

 

 

Mann-Kendall Trend Tests

View a tutorialMann-Kendall trend test is a nonparametric test to be used when a trend is identified in a series, even if there is a seasonal component in the series.

Mann-Kendall test history

This test is the result of the development of the nonparametric trend test first proposed by Mann (1945). This test was further studied by Kendall (1975) and improved by Hirsch et al (1982, 1984) who allowed to take into account a seasonality.

Mann-Kendall trend test hypotheses

The null hypothesis H0 for these tests is that there is no trend in the series.

The three alternative hypotheses are that there is a negative, non-null, or positive trend.

The Mann-Kendall tests are based on the calculation of Kendall's tau measure of association between two samples, which is itself based on the ranks with the samples.

Mann-Kendall trend test

In the particular case of the trend test, the first series is an increasing time indicator generated automatically for which ranks are obvious, which simplifies the calculations.

To calculate the p-value of this test, XLSTAT can calculate, as in the case of the Kendall tau test, an exact p-value if there are no ties in the series and if the sample size is less than 50. If an exact calculation is not possible, a normal approximation is used, for which a correction for continuity is optional but recommended.

Seasonal Mann-Kendall test

In the case of seasonal Mann-Kendall test, we take into account the seasonality of the series. This means that for monthly data with seasonality of 12 months, one will not try to find out if there is a trend in the overall series, but if from one month of January to another, and from one month February and another, and so on, there is a trend.

For this test, we first calculate all Kendall's tau for each season, then calculate an average Kendall’s tau. The variance of the statistic can be calculated assuming that the series are independent (eg values of January and February are independent) or dependent, which requires the calculation of a covariance. XLSTAT allows both (serial dependence or not).

To calculate the p-value of this test, XLSTAT uses a normal approximation to the distribution of the average Kendall tau. A continuity correction can be used.

 

 

Homogeneity tests for time series

View a tutorialPrinciples of homogeneity tests for time series

Homogeneity tests enables you to determine if a series maybe consider as homogeneous over time, or if there is a time at which a change occurs.

Homogeneity tests involve a large number of tests, XLSTAT-Time offer four tests (Pettitt, Buishand, SNHT, or von Neumann), for which the null hypothesis is that a time series is homogenous between two given times.

The variety of the tests comes from the fact that there are many possible alternative hypotheses: changes in distribution, changes in average (one or more times) or presence of trend.

Homogeneity test p-value approximation

The tests presented in this tool correspond to the alternative hypothesis of a single shift. For all tests, XLSTAT provides p-values using Monte Carlo resamplings. Exact calculations are either impossible or too costly in computing time.

Note 1: If you have a clear idea of the time when the shift occurs, one can use the tests available in the parametric or nonparametric tests sections. For example, assuming that the variables follow normal distributions, one can use the test z (known variance) or the Student t test (estimated variance) to test the presence of a change at time t. If one believes that the variance changes, you can use a comparison test of variances (F-test in the normal case, for example, or Kolmogorov-Smirnov in a more general case).

Note 2: The tests presented below are sensitive to a trend (for example a linear trend). Before applying these tests, you need to be sure you want to identify a time at which there is a shift between two homogeneous series.

Pettitt’s test

The Pettitt's test is a nonparametric test that requires no assumption about the distribution of data. The Pettitt's test is an adaptation of the tank-based Mann-Whitney test that allows identifying the time at which the shift occurs.
In his article of 1979 Pettitt describes the null hypothesis as being that the T variables follow the same distribution F, and the alternative hypothesis as being that at a time t there is a change of distribution. Nevertheless, the Pettitt test does not detect a change in distribution if there is no change of location. For example, if before the time t, the variables follow a normal N(0,1) distribution and from time t a N (0,3) distribution, the Pettitt test will not detect a change in the same way a Mann-Whitney would not detect a change of position in such a case. In this case, one should use a Kolmogorov Smirnov based test or another method able to detect a change in another characteristic than the location. We thus reformulate the null and alternative hypotheses:

H0: The T variables follow one or more distributions that have the same location parameter.

Two-tailed test: Ha: There exists a time t from which the variables change of location parameter.

Left-tailed test: Ha: There exists a time t from which the variables location is reduced by D.

Left-tailed test: Ha: There exists a time t from which the variables location is augmented by D.

Alexandersson’s SNHT test

The SNHT test (Standard Normal Homogeneity Test) was developed by Alexandersson (1986) to detect a change in a series of rainfall data. The test is applied to a series of ratios that compare the observations of a measuring station with the average of several stations. The ratios are then standardized. The series of X_i corresponds here to the standardized ratios. The null and alternative hypotheses are determined by:

H0: The T variables Xi follow a N(0,1) distribution.

Ha: Between times 1 and n the variables follow an N(µ₁, 1) distribution, and between n+1 and T they follow an N(µ₂,1) distribution.

Buishand’s test

The Buishand’s test (1982) can be used on variables following any type of distribution. But its properties have been particularly studied for the normal case. In his article, Buishand focuses on the case of the two-tailed test, but for the Q statistic presented below the one-sided cases are also possible. Buishand has developed a second statistic R, for which only a bilateral hypothesis is possible.

In the case of the Q statistic, the null and alternative hypotheses are given by:

H0: The T variables follow one or more distributions that have the same mean.
Two-tailed test: Ha: There exists a time t from which the variables change of mean.

Left-tailed test: Ha: There exists a time t from which the variables mean is reduced by D.

Left-tailed test: Ha: There exists a time t from which the variables mean is augmented by D.

von Neumann’s ratio test

The von Neumann ratio test is very powerful at all times but does not allow detecting the time of the change.