In Calculation Bug Fixed, an old but ongoing thread in the Daily Dose of Excel blog, I mentioned a problem with Excel 2007’s trendline regression formulas. Apparently small regression coefficients were treated like small errors that occur in the insignificant digits when converting from binary to decimal. I had documented the error in May of 2007, and while following up in Daily Dose, I tested in Excel 2007 SP1, and the error has been corrected. I’m here not to raise unnecessary alarms among users who have already updated to SP1, but to report correction of this problem, and to describe the errors for those who have still not updated.

The problem is illustrated with datasets having small Y values. Here is a table that uses the same X values and Y values that differ by their power of ten:

The data is charted below, on a semilog plot to get all curves in the plot on the same basis, with trendline formulas next to each curve.

The regression coefficients are reproduced below.

All of the R² values are the same, and the slope and intercept values differ only by their power of ten, where they appear in the formula. Apparently the algorithm that removes binary to decimal conversion errors overzealously removes some of the regression coefficients in data sets with small values.

The coefficients calculated using SLOPE(), INTERCEPT(), CORREL(), and LINEST() are not affected by this overcorrection.

Related Posts:

• Graphical Approach to a Simple Physics Problem
• Deming Regression Utility
• Regression Approach to a Simple Physics Problem
• Deming Regression
• Trendline Fitting Errors
• Two Color XY-Area Combo Chart – Guest Post
• Polynomial Fit vs. Statistical Process Control
• Goal Seek – Optimization Approach to a Simple Physics Problem
• Choosing a Trendline Type
• Plot Two Time Series And Trendlines With Different Dates