Understanding epsilon-delta proofs

First, get and read this. Really good.

before you even START with epsilon-delta . . .


| x – 3 | < 1;

SAYS in English “x is within 1 unit of 3.”

You have to be fluent with that idea before starting ε-delta; proofs.

Let’s look at a picture of this inequality on the real number line:

x lies here

So for example, if x = 2.8:

| 2.8 - 3 | < 1
| -0.2 | < 1
0.2 < 1    ===   TRUE

Now let’s try for x = 3.5.

| 3.5 - 3 | < 1
| 0.5 | < 1
0.5 < 1   ===   TRUE

So, | x – 3 | < 1 MEANS x must be within 1 unit of 3 on the real number line.

To be able to understand epsilon-delta at all, you have to get into the habit of looking at an inequality like

| x – 10 | < 5

And immediately just say in a snap “That inequality says that x is within 5 units of 10″

Or
| x – 0.4 | < 0.00001

And say “That inequality says that x is within 0.00001 units of 0.4.”

In general, for any inequality with the format:

| x – c | < a

That says in plain english that “x is within a units of c.”


Epsilon-delta proofs are actually easy.

The meat of epsilon-delta proofs

The meat of epsilon-delta proofs is just this idea.


if
0 < | x – c | < δ

then
| f(x) – L | < ε

Epsilon-delta says:


AS WE RESTRICT x to being within δ units of c, then, as a result of that restriction, f(x) becomes restricted to being within ε units of L.

If the above statement is true, then and only then can we say

lim   f(x) = L
x->c


So, here’s the “definition of a limit”, but with more explanation in English words:

The limit:

lim f(x) = L
x->c

exists if and only if

when we restrict x to be within δ units of c,

0 < | x – c | < δ

then, as a consequence of that restriction, we in effect are restricting f(x) to be within ε units of L.

| f(x) – L | < ε

If that happens, then we know that the limit of f(x) as x -> c is equal to L.

Ok, but how do you do an epsilon-delta proof?

So here’s an example of how this stuff works.

Use epsilon-delta to "show" that

lim  3x - 3  =  12
x->5

I know what you’re thinking. “Can’t we just do this:”


lim  3x - 3
x->5

= 15 - 3

= 12

but nooooooo! That’s not good enough for epsilon-stupid. You must “show” it.

Use epsilon-delta to "show" that

lim  3x - 3  =  12
x->5

So, what we use the “definition of a limit” as stated at the top of this page (you should memorize it really for use on tests (YES they DO ALWAYS put epsilon-delta on tests . . )

The limit above exists if and only if for each ε > 0, there exists a δ > 0 such that:

IF
    0 < | x - c | < δ            [ c = 5 though, plug in: ]
    0 < | x - 5 | < δ

THEN
      | f(x) - L | < ε         [ f(x)= 3x - 3, and L = 12, plug in: ]
      | ( 3x - 3 ) - 12 | < ε

So read that in English as:

“IF x is within δ units of 5 . . . “

“. . . THEN ( 3x – 3 ) is within ε units of 12.”

The key to epsilon-delta proofs is you have to relate epsilon and delta.

You have to argue that IF 0 < | x – 5 | < δ ( x is within δ units of 5 ), THEN we can conclude that | ( 3x – 3 ) – 12 | < ε (THEN ( 3x – 3 ) is within ε units of 12 ).

HMM! Hopefully, this is starting to make some sense. Here is how you proceed.

Let’s work with the THEN part (the | f(x) – L | statement), and break it down a bit:

      | ( 3x - 3 ) - 12 | < ε
      | 3x - 15 | < ε

Let’s FACTOR (because we love to factor)

      | (3)(x - 5) | < ε
     3| (x - 5) | < ε
      | (x - 5) | < ε/3;

That looks familiar! Suddenly, the | f(x) – L | < ε looks a lot like the | x – c | < δ statement.

HMM!!!

We can relate the epsilon statement and the delta statement ( 0 < | x – c | < δ ) in this way:

CHOOSE δ = ε/3. (Get used to the idea of “CHOOSING” δ)

Then, we go:

      | x - 5 | < ε/3   [ CHOOSE δ = ε/3 ]

      | x - 5 | < δ

WOW!!!!! How marvellous. It will seem very very strange to you that in the middle of this “mathematical rigor”, we end up going and “choosing” δ = ε/3. You’ll see that this “choice” doesn’t really hurt the “rigor” of what we’re doing though. . . just keep at it.

Next we have to show that this “δ” we’ve chosen ( δ = ε/3 ) “WORKS”.

So we go back to the original statement:

IF
    0 < | x - c | < δ            [ c = 5, chose δ = ε/3 ]
    0 < | x - 5 | < ε/3;

THEN
      | f(x) - L | < ε         [ f(x)= 3x - 3, and L = 12, plug in: ]
      | ( 3x - 3 ) - 12 | < ε
      | 3x - 15 | < ε
     3| x - 5 | < ε
      | x - 5 | < ε/3

Wonder of wonders! It “WORKS”, because the statement has now changed from:

“IF x is within δ units of 5 . . . THEN ( 3x – 3 ) is within ε units of 12.”

To:
“IF x is within ε/3 units of 5, THEN x is within ε/3 units of 5.”

Which cannot be argued against.

Remember, its not stupid. Its “rigorous”.

45 Comments

    • Chip
    • Posted February 1, 2008 at 9:47 am
    • Permalink

    holly crap i love you…if your a girl can i marry you? no like seriously, i mean it – I. LOVE. YOU.

  1. glad it helped!

    • ..
    • Posted February 8, 2008 at 8:01 am
    • Permalink

    WOW. i’ve been trying to figure this out all day. and now I suddenly understand within 5 mins. You’re a life saver. :)

    • Ann
    • Posted February 14, 2008 at 4:34 am
    • Permalink

    THANK YOU SO MUCH! i swear calc professors are useless. and the whole epsilon-delta thing is somewhat useless, its so repetitive. anyways, u mind explaining the way to prove the limits of crazy polynomials? by using those given limit laws , they are so confusing!

    and when the number infront of |x-c| doesnt work out to be the same as it shows up with delta, we were told to let it be smaller than a constant and find the constant. that is confusing too. do u know what im saying? lol cus im confused about what ive just mentioned too . . .

    • AnonyMouse
    • Posted February 15, 2008 at 9:22 pm
    • Permalink

    It’s beautiful (it really is) how well you’ve explained this concept. Well-done, and thank you.

    • Anonymous
    • Posted March 20, 2008 at 9:59 pm
    • Permalink

    dude you are my god! Thanks soo much, I’m going to give my idiot teacher an anonymous note to look at this site!

    • Pavan
    • Posted March 20, 2008 at 9:59 pm
    • Permalink

    Thanks for the lucid explanations. Makes everything much more clear now. Probably some book authors should read this and take tips.

    • Sim
    • Posted August 10, 2008 at 6:27 am
    • Permalink

    Brilliant!@#$% That’s an amazingly clear Explanation. You just explained what 5 Calc lectures didn’t teach me in about 1.7% of the time. Good work.

    • CogitoErgoCogitoSum
    • Posted August 31, 2008 at 11:11 pm
    • Permalink

    Dont delta-epsilon proofs require you to show that as delta decreases, so does epsilon? If epsilon increases while delta decreases, the limit doesnt exist… right?

    Im still struggling with this concept.

    See, every demonstration I have seen, the tutor picks and chooses a nice, simple linear function ahead of time. What if you used f(x) = x^2. Or f(x) = sin(x). Or f(x) = x/x as x -> 0. Your example work isnt so apparent or intuitive any more.

    How do you use d-e to prove sin(x)/x, as x->0 equals 1?

    See… you have to already know your L beforehand. You use d-e to DEMONSTRATE L is the correctly presumed limit, not to prove L is the limit. Right?

    Because you have to know L first in order to use this. In fact, you have to know what x approaches first in order to assert what the limit approaches… you have to know your x->a and your f(x)->L.

    But what if you pick the wrong L? What if L isnt your limit? How does d-e fail?

    • Anonymous
    • Posted September 4, 2008 at 1:49 am
    • Permalink

    I think the point of e-d proofs (key word being proof) is to prove the L, after you already know it.

    Sweet explanation though, helped a lot.

    • madmann
    • Posted September 5, 2008 at 9:03 am
    • Permalink

    Aloha CogitoErgoCogitoSum,

    I agree with you that these epsilon-delta proofs are not proofs at all the way they are usually done. They have always disturbed me because the logic is circular and very unsatisfying. That last step of “showing that the delta works” is really only checking that you did the correct algebraic manipulations the first time around (or are consistent in making the same mistake). It’s like verifying your solution to an algebraic equation. You are also correct that nearly every time someone does one of these “proofs,” they pick some very simple linear function, but more important, they never show what the “failure mode” is for trying to prove the wrong limit. In fact, there is no “failure” (at least none corresponding to anything stated in the e-d definition) if you follow the steps above using the wrong limit. Try L = 13 instead of 12, for example. With proper algebraic manipulation, you get delta = (1-epsilon)/3. The only problem I see with this delta is that when epsilon goes to zero (as you would want), delta goes to 1/3 (which is absurd), but NOTHING in the e-d definition says this is a problem. Do we have Cauchy to thank for that, or have the calculus textbooks been remiss in not stating this requirement? I think you stated it correctly when you said that there is ANOTHER condition that must be met: as epsilon decreases to zero, delta HAS TO ALSO DECREASE TO ZERO. That’s where the failure occurs, and that is what would make these proofs more sound.

    Your example of sin(x)/x is classic. In fact, most limits involving trigonometric functions are proven not with epsilon-delta, but by the Squeeze Theorem.

    • Johan
    • Posted September 8, 2008 at 12:50 am
    • Permalink

    This has helped me a lot, thank you very much. :)

    • Anonymous
    • Posted September 9, 2008 at 11:37 pm
    • Permalink

    this helped so much! thank you!

    • Anonymous
    • Posted September 29, 2008 at 8:49 pm
    • Permalink

    ur the man …….

    • Somedude
    • Posted October 24, 2008 at 3:27 am
    • Permalink

    This makes sense.

    • Anonymous
    • Posted October 29, 2008 at 2:05 pm
    • Permalink

    You’re fabulous.
    A + in Calculus for meee =)

    • Anonymous
    • Posted December 6, 2008 at 8:47 am
    • Permalink

    love you too man

    • Anonymous
    • Posted January 29, 2009 at 1:32 am
    • Permalink

    polygamy time! We all love you!

    • Scott
    • Posted January 31, 2009 at 9:06 am
    • Permalink

    Awesome job on this.

    • pamparumpum
    • Posted February 4, 2009 at 12:36 pm
    • Permalink

    YESSS. Thank you!

    • Anonymous
    • Posted February 24, 2009 at 5:36 pm
    • Permalink

    tht was an awesome explanaition!

    • leila
    • Posted March 19, 2009 at 5:03 pm
    • Permalink

    wonderful! you real saved my dollars. your explanations are much clear, if it wasn’t for you i would have failed calculus.

  2. Thanks, but please take time now to explain the delta neighborhood in 3D space and its relation to epsilon. Also, after selecting a neat working example, please choose one like
    lim x/sqrt(x+y)
    f(x,y)-> (1,1)

    and show d-e proof. Need help. (did that problem come out aligned correctly? prob not)

    Thanks

  3. Thanks!!

    • Nicole
    • Posted June 15, 2009 at 3:58 pm
    • Permalink

    THANK-YOU X 10 to the 6th power!!!! I have a week’s worth of precal and calculus homework to do before this friday so I can go to my cousin’s wedding and I don’t understand ANY of it!! It’s an online college course to boot…
    Your explanation was so simple!!! I cannot believe it was so easy to understand!! Keep up the good work!! THANKYOUTHANKYOUTHANKYOUTHANKYOU!!!!!!!!!!!!!

    • Brandon
    • Posted August 23, 2009 at 8:31 am
    • Permalink

    This is the greatest and most clear explanation of this concept I have ever heard. I’ve been struggling with this for quite some time now I have it…finally! Thanks so much!!!

    • Tim
    • Posted August 27, 2009 at 4:29 pm
    • Permalink

    That is great! can you do that with the product property for limits? That written explanation makes all the difference and that’s what I need for the product property proof.

  4. HOLY %$##%$%$$ YOU’RE MY GOD

    • Stephanie
    • Posted September 14, 2009 at 4:00 am
    • Permalink

    I know you posted this a long time ago but it must be helping lots of people because it’s the 2nd listing on google (searching limits delta epsilon)! This is my THIRD calculus class and am just NOW understanding this bull! THANK YOU so much. If you are not a teacher, you should be because God has blessed you!

    • mehraj
    • Posted September 18, 2009 at 6:43 am
    • Permalink

    hello sir,this method is easy to understand and works really very good. thank you

  5. I did not get it in class but I got it after reading the book. Im trust making sure that what I got is right and wow, you make it look so simple. Thanks so much, im bookmarking this blog and I’ll come back for others lessons

    • MEHRAJ AHMED
    • Posted September 22, 2009 at 9:39 am
    • Permalink

    hopeful to see much more in future

    • MEHRAJ AHMED KASHMIR
    • Posted September 22, 2009 at 9:47 am
    • Permalink

    it is so easy that i take this as a game where you take epsilons and get deltas. so it is all to work with epsilons and deltas and make fun out of it with the help of this method. thanks once again.

    • David
    • Posted September 30, 2009 at 2:14 am
    • Permalink

    THANK YOU. You have no idea.

    • Dillon
    • Posted October 7, 2009 at 9:42 pm
    • Permalink

    Thank you omg TAs and Calc Profs/Textbooks are useless…

    Awesome blog

    • Guy who sucks @ Calc
    • Posted October 7, 2009 at 10:54 pm
    • Permalink

    This is really fantastic. Four lectures of sitting through this nonsense explained absolutely nothing; and one 10-min reading did it. Now I’m able to do these problems and proofs. I still feel that the whole d-e concept is stupid and pointless, but this definitely explains it very well.

    GENIUS. THANK YOU.

    • Anonymous
    • Posted October 23, 2009 at 4:32 am
    • Permalink

    this is amazing. thank you so much

    • From s
    • Posted October 27, 2009 at 8:05 am
    • Permalink

    oh my god!!! i now understand ^^

    • oneeb
    • Posted October 31, 2009 at 8:20 pm
    • Permalink

    how can we prove limit x->2 2x^2=8 using this method

    • oneeb
    • Posted October 31, 2009 at 8:23 pm
    • Permalink

    kindly tell me how can we prove limit x->2 2x^2=8 using this?

    • zoe
    • Posted November 2, 2009 at 6:53 pm
    • Permalink

    awesome, that made so much more sense then what the professor dribbled out between yawns, thanks!

    • trapped in math
    • Posted November 6, 2009 at 7:53 pm
    • Permalink

    This was really very helpful.. U R a life savEr! (:

    • Anonymous
    • Posted November 28, 2009 at 1:44 pm
    • Permalink

    Thankyou so much, this is the clearest explanation of epsilon-delta I can find on the internet.
    The IF-THEN logic of the delta-epsilon proof never really struck me, until now.
    THANKYOU

    • Calc. tutor
    • Posted December 11, 2009 at 12:39 am
    • Permalink

    I found this blog with a google search when I was trying to refresh my memory of how epsilon-delta proofs worked so that I could help a friend in their calc class. I used to tutor calc for a college, and these were the problems that made all of the tutors,myself included, run in terror everytime the calc 1 students would come in with these problems. Your fantastic explination really helped me remember what I learned 3 years ago and was probably better than the explination my professor gave then.

    • Anonymous
    • Posted February 8, 2010 at 10:41 pm
    • Permalink

    You have no idea how much I love you right now. No. Idea. Thanks so much.


2 Trackbacks/Pingbacks

  1. By Understanding epsilon-delta proofs | Dave on 12 Aug 2009 at 2:39 am

    [...] is a terrific blog post here explaining epsilon-delta proofs. Something we are looking at in Maths at the [...]

  2. By Trying to define a limit | Dave on 21 Aug 2009 at 5:25 am

    [...] Summarising some points from here. [...]

Post a Comment