Transforming the data with XLSTAT - Example of a Box-Cox transformation

Dataset for variable transformation

An Excel sheet with both the data and the results can be downloaded by clicking here. In this tutorial we show how to create transform a variable to be closer to the Normal distribution.

The dataset contains the measurements of waste in the production for 47 batches. We would like to make a regression with several process variables but the hypothesis of Normality of the variable Level of waste is not acceptable. We need to make a transformation of this variable before attempting a multilinear regression. After showing you different options to transform data we will use the Box-Cox transformation of XLSTAT.

The results of the Normality test are displayed bellow.

statistical software

Variable transformation in XLSTAT

There are several ways to transform data in XLSTAT.

Variable transformation with Microsoft Excel tools

First you can take advantage of Microsoft Excel and use the available function in the software. First place the cursor where you would like to have the results displayed. You will access the menu Insert Function by clicking on the fx icon above the spreadsheet.

data analysis software

Then you can select one of the functions listed under either Financial, Math & Trig, Statistical, Database or XLSTAT (last entry).

principal component analysis software

This gives you access to a wide range of general transformation.

Variable transformation with XLSTAT tools

In XLSTAT we offer you the opportunity to use some more specific functions. You will find them in the option Preparing data / Variables transformation.

partial least squares softwarepartial least squares software

Setting up a Box-Cox transformation

In the dialog box that opens you should first select the variables you wish to transform, in this example we select the variable Level of waste in the column B. Also as the column has a label we tick the option Column labels.

Also we can select the Observation labels option by ticking the box and selecting the column A which contains the identifications of the batches.

The results will be displayed in a new sheet as the option Sheet is selected. If you wish to have them at a specific place select the option Range.

The most general transformation is an unbiased standardization (Standardize (n-1)) as usually people work on a sample and not the full population.
However there are more transformations available when you tick the option Other.

statistical software

Then go on the next tab Transformations that contains the following options:

  • Standardize (n): to standardize the variables using the biased standard deviation.
  • Center: to center the variables, the average of the resulting variables will be 0.
  • 1 / Standard deviation (n-1): to divide the variables by their unbiased standard deviation.
  • 1 / Standard deviation (n): to divide the variables by their biased standard deviation.
  • Rescale from 0 to 1: to rescale the data from 0 to 1.
  • Rescale from 0 to 100: to rescale the data from 0 to 100.
  • Binarize (0/1): to convert all values that are not 0 to 1, and leave the 0s unchanged.
  • Sign (-1/0/1): to convert all values that are negative to -1, all positive values to 1, and leave the 0s unchanged.
  • Arcsin: to transform the data to their arc-sine.
  • Box-Cox transformation: to improve the normality of the sample. XLSTAT accepts a fixed value of l, or it can find the value that maximizes the likelihood of the sample, assuming the transformed sample follows a normal distribution.
  • Winsorize: to remove data that are not within an interval defined by two percentiles: let p1 and p2 be two values comprised between 0 and 1, such that p1 < p2

Select the option Box-Cox transformation as we are trying to get the variable Level of waste closer to a Normal distribution. Also select the option Optimize to let XLSTAT find the best Lambda.

statistical software

The last tab Missing data help you decide what to do in case of missing data. The option selected by default Do not accept missing data will give you a warning in case of missing data. Leave that option selected.

statistical analysis software

Click on OK to start the computations.

Results of the Box-Cox transformation

In the result sheet called Variables transformation you will find the Transformed data with the value of Lambda used.

statistical software

You can now compute the Normality test on those transformed data. As you can see bellow now the transformed variable Level of waste is following a Normal distribution.

statistical software

Click here for other tutorials.

About KCS

Kovach Computing Services (KCS) was founded in 1993 by Dr. Warren Kovach. The company specializes in the development and marketing of inexpensive and easy-to-use statistical software for scientists, as well as in data analysis consulting.

Mailing list Join our mailing list

Home | Order | MVSP | Oriana | XLStat
QDA Miner | Accent Composer | Stats Books
Stats Links | Anglesey

Share: FacebookFacebook TwitterTwitter RedditReddit
Del.icio.usDel.icio.us Stumble UponStumble Upon

 

Like us on Facebook

Get in Touch

  • Email:
    sales@kovcomp.com
  • Address:
    85 Nant y Felin
    Pentraeth, Isle of Anglesey
    LL75 8UY
    United Kingdom
  • Phone:
    (UK): 01248-450414
    (Intl.): +44-1248-450414