Tutorials › Calculus I › Deriving Newton’s Tangent-Line Iteration

Optimization and Newton's Method · Tutorial 885 of 1495

Deriving Newton's Tangent-Line Iteration

Learn how setting a tangent-line approximation equal to zero leads to Newton’s iteration and how to interpret each update geometrically.

Advanced 10 min read

What You'll Learn

  • Derive Newton’s update by finding the x-intercept of a tangent line.
  • State the differentiability and nonzero-slope conditions needed for one update.
  • Interpret the next estimate as the tangent line’s intersection with the x-axis.
  • Work through tangent-line updates for three different functions.
  • Identify why a tangent-line intercept need not be an actual root.
  • Recognize the sign error that can arise when solving for the intercept.

From a Root-Finding Problem to a Tangent Line

A root of a function \(f\) is an input \(r\) for which \(f(r)=0\). For many functions, an exact root is difficult to find directly. Newton’s method produces a sequence of estimates by replacing the function near a current estimate with its tangent line, then asking where that line crosses the \(x\)-axis.

This construction gives a specific update formula. It does not, by itself, prove that the estimates approach a root. Here the goal is to derive the formula and understand its geometric meaning, while keeping clear the conditions needed to form an update.

Definition: Let \(x_n\) be a current estimate for a root of \(f\). If \(f\) is differentiable at \(x_n\) and \(f'(x_n)\ne 0\), Newton’s tangent-line update is $$ x_{n+1}=x_n-\frac{f(x_n)}{f'(x_n)}. $$ The update is obtained by taking the \(x\)-intercept of the tangent line to the graph of \(f\) at \((x_n,f(x_n))\).

Deriving the Update Formula

Assume \(f\) is differentiable at \(x_n\). The tangent line to \(y=f(x)\) at the point \((x_n,f(x_n))\) has slope \(f'(x_n)\). Using the point-slope form of a line, its equation is

$$ y=f(x_n)+f'(x_n)(x-x_n). $$

The \(x\)-intercept is the point on this line where \(y=0\). Write its \(x\)-coordinate as \(x_{n+1}\). Substituting \(y=0\) and \(x=x_{n+1}\) into the line equation gives

$$ 0=f(x_n)+f'(x_n)(x_{n+1}-x_n). $$

If \(f'(x_n)\ne 0\), divide by \(f'(x_n)\) and isolate \(x_{n+1}\):

$$ x_{n+1}-x_n=-\frac{f(x_n)}{f'(x_n)}, \qquad x_{n+1}=x_n-\frac{f(x_n)}{f'(x_n)}. $$

The negative sign is a consequence of solving for the intercept: the function value \(f(x_n)\) is moved to the other side of the equation. The formula can also be understood as a correction to the current estimate. The correction is \(-f(x_n)/f'(x_n)\); its size and direction depend on both the height of the graph at \(x_n\) and the slope there.

Derivation: The tangent line at the current point has equation \(y=f(x_n)+f'(x_n)(x-x_n)\). Setting \(y=0\) locates its \(x\)-intercept. Solving that equation requires \(f'(x_n)\ne0\), and produces \(x_{n+1}=x_n-f(x_n)/f'(x_n)\). Thus the iteration is exactly the tangent-line intercept construction.

Why the Tangent Line Is a Local Approximation

The tangent line is not usually the graph itself. Its role is to approximate the graph near the point where they touch. Differentiability at \(x_n\) means that, for a small change \(h\), the function can be written as

$$ f(x_n+h)=f(x_n)+f'(x_n)h+r(h), \qquad \lim_{h\to 0}\frac{r(h)}{h}=0. $$

The first two terms on the right give the tangent-line prediction; \(r(h)\) is the remaining error, which becomes small relative to \(h\) as \(h\) approaches zero. Newton’s construction uses that linear prediction to estimate where the function would be zero. It does not set the full function equal to zero at the new point. The actual value \(f(x_{n+1})\) may therefore differ from zero.

This explains both the appeal and the limitation of the method. When a tangent line represents the graph well near a root, its intercept can be informative. But the construction alone gives no guarantee that the intercept is close to a root, or that repeating the construction will succeed.

Worked Tangent-Line Updates

Worked Example: A Tangent to a Quadratic

Find the Newton update from \(x_0=2\) for \(f(x)=x^2-5\).

First evaluate the function and its derivative at the current estimate:

$$ f(2)=2^2-5=4-5=-1, \qquad f'(x)=2x, \qquad f'(2)=2(2)=4. $$

The tangent line at \((2,-1)\) is

$$ y=f(2)+f'(2)(x-2) =-1+4(x-2) =-1+4x-8 =4x-9. $$

Set \(y=0\) to find its \(x\)-intercept:

$$ 0=4x-9, \qquad 4x=9, \qquad x=\frac{9}{4}. $$

Therefore the update is \(x_1=\frac94\). Check the result in the tangent-line equation: \(4(\frac94)-9=9-9=0\), as required for an \(x\)-intercept. The update need not be a root of \(f\): \(f(\frac94)=(\frac94)^2-5=\frac{81}{16}-\frac{80}{16}=\frac1{16}\), which is not zero.

Worked Example: A Tangent to a Square-Root Function

Find the Newton update from \(x_0=1\) for \(f(x)=\sqrt{x}-2\). The function is differentiable at \(1\), and its derivative is \(f'(x)=\frac{1}{2\sqrt{x}}\) for \(x>0\).

Evaluate the function and derivative at \(1\):

$$ f(1)=\sqrt{1}-2=1-2=-1, \qquad f'(1)=\frac{1}{2\sqrt{1}}=\frac12. $$

The tangent line at \((1,-1)\) is

$$ y=-1+\frac12(x-1) =-1+\frac{x}{2}-\frac12 =\frac{x}{2}-\frac32. $$

Set the tangent-line height to zero and solve:

$$ 0=\frac{x}{2}-\frac32, \qquad \frac{x}{2}=\frac32, \qquad x=3. $$

Thus \(x_1=3\). Substitution checks the intercept: \(\frac{3}{2}-\frac{3}{2}=0\). This verifies the tangent-line calculation; it does not assert that \(f(3)=0\).

Worked Example: A Tangent to a Reciprocal Function

For \(f(x)=\frac1x-\frac12\), find the update from \(x_0=1\). The function is defined and differentiable at \(1\), and \(f'(x)=-\frac{1}{x^2}\) for \(x\ne0\).

At the current estimate,

$$ f(1)=\frac11-\frac12=\frac12, \qquad f'(1)=-\frac{1}{1^2}=-1. $$

The tangent line at \((1,\frac12)\) is

$$ y=\frac12-(x-1) =\frac12-x+1 =\frac32-x. $$

Its \(x\)-intercept satisfies

$$ 0=\frac32-x, \qquad x=\frac32. $$

Therefore \(x_1=\frac32\). Substituting into the line gives \(\frac32-\frac32=0\), confirming the intercept. The function itself is not zero there: \(f(\frac32)=\frac{2}{3}-\frac12=\frac{4}{6}-\frac{3}{6}=\frac16\).

Conditions and Limits of the Construction

To form a Newton update at \(x_n\), two conditions matter. First, \(f\) must be differentiable at \(x_n\), so that the tangent line is defined. Second, \(f'(x_n)\) must be nonzero, so that the tangent line has a unique \(x\)-intercept that can be found by division in the update formula.

If \(f'(x_n)=0\), the formula is undefined. Geometrically, the tangent is horizontal: if \(f(x_n)\ne0\), it does not meet the \(x\)-axis; if \(f(x_n)=0\), the current point is already a root, but the quotient in the formula still cannot be evaluated. These situations require separate consideration rather than applying the update formula as written.

There is also a domain requirement. The new estimate must be a valid input for \(f\) if you want to evaluate the function there or form another tangent. The tangent-line calculation can produce an \(x\)-coordinate outside the domain. Even when it remains in the domain, the construction alone does not establish that later estimates will approach a root.

A Common Sign Error

A frequent mistake is to move \(f(x_n)\) to the other side of the tangent-intercept equation without changing its sign. For the quadratic example, the correct equation was \(0=-1+4(x-2)\). An incorrect rearrangement would be

$$ 4(x-2)=-1, \qquad x-2=-\frac14, \qquad x=\frac74. $$

This answer does not satisfy the tangent-line equation: substituting \(x=\frac74\) into \(y=4x-9\) gives \(y=7-9=-2\), not \(0\). The correction is to rearrange carefully:

$$ 0=-1+4(x-2) \quad\Longrightarrow\quad 1=4(x-2) \quad\Longrightarrow\quad x-2=\frac14 \quad\Longrightarrow\quad x=\frac94. $$

Checking the proposed intercept by substitution is a quick way to catch this sign error.

Geometric Meaning of the Iteration

At each stage, the graph provides a point \((x_n,f(x_n))\). The tangent line through that point is used as a simpler, linear stand-in for the graph near \(x_n\). The next estimate \(x_{n+1}\) is the point where that line crosses the horizontal axis. In this sense, the update replaces the question “Where does the graph meet the axis?” with the locally simpler question “Where does the tangent line meet the axis?”

The geometric description helps interpret the signs in the formula. If the graph is above the axis at \(x_n\), then \(f(x_n)>0\); if its tangent slope is positive, the intercept lies to the left, as the negative correction \(-f(x_n)/f'(x_n)\) indicates. If the slope is negative instead, the correction is positive. The formula records the signed horizontal movement needed to reach the tangent’s intercept.

Newton’s method is useful because it turns derivative information into a root estimate. Its essential step is the tangent-line construction, not a guarantee about what happens after that step. Understanding this distinction makes it easier to use the iteration correctly: derive the line, solve for its intercept, check the calculation, and verify that the required conditions hold at the point where the update is formed.

Check Your Understanding

Answer these questions using the tangent-line construction and its conditions.

  1. Starting from \(y=f(x_n)+f'(x_n)(x-x_n)\), derive the formula for \(x_{n+1}\) by setting \(y=0\).
  2. Why must \(f'(x_n)\ne0\) to use the Newton update formula as written?
  3. In the geometric interpretation, what does \(x_{n+1}\) represent?
  4. Why does finding the tangent line’s \(x\)-intercept not prove that \(f(x_{n+1})=0\)?
  5. What error is made by rearranging \(0=-1+4(x-2)\) as \(4(x-2)=-1\)?

Test yourself: Calculus I final exam practice

Ready to check what you know? Work a full-length practice final, then open the complete worked solutions.

Want all 1,114 practice problems?

This tutorial covers one topic. Calc Pass covers the full Calculus AB & BC curriculum (the core of Calculus I and II): full review, every practice question, and step-by-step solutions to each one.

QR code to download the Calc Pass app

Get the Calc Pass App

Scan to download and practice on the go, with instant scoring.

Calc Pass Volume 1: 1,114 Practice Questions book cover

Vol. 1: 1,114 Questions

The complete practice question bank, organized by AB & BC topic.

View on Amazon
Calc Pass Volume 2: Solutions Manual book cover

Vol. 2: Solutions Manual

Fully worked solutions to every question in Volume 1.

View on Amazon