How do I calculate a linear regression?
Finding relationships between variables in the Earth sciences
An introduction to linear regressions
Does lake depth affect water column stability? Is the age of a volcanic island related to its distance from a hot spot? Is the soil pH related to the amount of sulfides? Earth scientists can investigate the relationships between these things using linear regressions.
Linear regression provides a statistical analysis of the relationship between two variables. A linear change is when one factor changes by a constant amount with respect to a second factor. A line that models this relationship is usually calculated through the least squares method, resulting in the equation `y=mx+b`. If there is a linear relationship, the resulting equation then helps you predict the value of one variable (`x` or `y`) based on knowing the value of the other variable.
The least squares method is a way to find a line that best fits the data through a calculation to minimize the sum of the squared distance of each point to that line.
When do I need to calculate a linear regression?
Linear regressions are used when you want to determine if there is a linear relationship between two variables. You may need to first plot the data in a scatterplot (see 'How do I plot points on a graph?') to visually determine if there is a relationship between the two variables, and if that relationship appears linear. The equation of your calculated best-fitting line can then be used to predict values of one variable based on given or known values of the other variable.
How do I calculate a linear regression?
Here are the steps to take when using least squares analysis for a linear regression:
Can we use the distance from the hot spot to determine the age of the older volcanic islands? Data provided are the distance from the hot spot in kilometers (km) and the age of the volcanic islands in millions of years (Ma).
|Distance (km)||Age (Ma)|
How to Calculate a Linear Regression with the Least Squares Method
The dependent variable is always plotted on the y-axis (when graphing) and "depends" on the other variable.
Step 1. Decide which variable is the independent variable and which is the dependent variable. For graphing and calculating linear regressions, the independent variable is represented as `x`, and the dependent variable is represented as `y`.
Step 2. Calculate `x^2` for every value of `x`, and `y^2` for every value of `y`. For each pair of values, calculate `x xx y`.
Step 3. Now, you will add up some of these values you just calculated. The `Sigma` symbol means "sum of", so in this step, you are adding up all of the values for each of these groups.
Calculate `Sigmax`, `Sigmay`, `Sigma(x^2)`, `Sigma(y^2)`, and `Sigma(x xx y)`.
For example, to calculate `Sigmax`, you will add up all values of `x`, and to calculate `Sigma(y^2)`, you will add up all of the values of `y^2` that you calculated in Step 2.
Step 4. Familiarize yourself with the equation of a line: `y=mx+b`.
The `x` and `y` in this equation represent data and will remain as `x` and `y` in the equation.
The `m` is the slope of the line, and the `b` is the y-intercept, or where the line crosses the y-axis. Performing linear regression will help you calculate the values for `m` (Step 5) and `b` (Step 6) to replace in the equation.
In this example, there are 6 values for `x` and 6 values for `y` , so `n = 6` .
Step 5. Calculate m (slope): `(n(Sigma(x xx y)) – (Sigmax)(Sigmay))/(n(Sigma(x^2)) – (Sigmax)^2)` .
This may look complicated, but don't worry! You already calculated the values for each of these components in Step 3. For this calculation, simply plug in those values that you calculated in Step 3.
Step 6. Calculate b (intercept): `(Sigmay – m(Sigmax))/(n)`
Step 7. Replace 'b' and 'm' in the line equation: `y=mx+b`.
How to Use Excel to Calculate a Linear Regression Using the Data Analysis Toolpak
Now let's use a statistical analysis tool in Excel to determine a linear regression for the Kilauea volcano data.
Step 1. Enter your data into an Excel spreadsheet in two columns. To help visualize the relationship between the variables, create a scatterplot using the Excel graph feature and insert a trendline. A trendline shows you a best fit line for the data on the chart; it is often calculated with a least squares but can be calculated several different ways.
Step 2. Under the tab "Data," select "Data Analysis." If you do not see "Data Analysis" as an option, you must activate the Data Analysis Toolpak.
Step 3. Now use the Regression tool on your data.
Step 4. Determine the line equation for your data. Write it in the form of `y=mx+b` and look for the `R^2` value.
Step 5. Check to see if this line equation matches what you calculated by hand above. Note that the values of `m` and `b` may differ slightly due to different rounding within the calculations, but they should be close. Do they match? Hurray! You now know how to do a linear regression with two different methods.
How do you use the line equation from the linear regression?
One of the most important things a scientist does with data is to discover if there is a relationship between two factors. A linear regression shows us if there is a strong positive or negative linear relationship, and that conclusion is often the goal of a study.
Another important use of linear regressions is as a tool to solve for an unknown. Once you have a line equation from your linear regression, you can solve for `x` if you have `y`, or solve for `y` if you have `x`. For example, your unknown may be the concentration of a salt or metal in a solution or what the temperature will be at a certain level of carbon dioxide.
You are studying an island in the Hawaiian hot spot chain approximately 1000 km from Kilauea. Based on your linear regression, how old are the rocks here?
Where do you use linear regressions in Earth science?
- Determination of the velocity of tectonic plates or seismic waves
- Determination of the concentration of an unknown solution based on various measurements of standards of known concentrations
- Relating environmental or ecological responses to a measured factor
- Determination of the relationship of temperature to gas concentrations or chemical components
Two format options we can choose from
More help (resources for students)
- Khan Academy has a review page on linear regression and a chalkboard animation showing a least squares calculation example.
- This Statistics How To entry includes explanations, examples, and videos.
- A tutorial on Excel spreadsheets
Pages written by Dr. Laura Treible (Savannah State University) and Dr. Melanie Szulczewski (University of Mary Washington).