• Log InLog In
  • Register
Liquid`
Team Liquid Liquipedia
EDT 12:28
CEST 18:28
KST 01:28
  • Home
  • Forum
  • Calendar
  • Streams
  • Liquipedia
  • Features
  • Store
  • EPT
  • TL+
  • StarCraft 2
  • Brood War
  • Smash
  • Heroes
  • Counter-Strike
  • Overwatch
  • Liquibet
  • Fantasy StarCraft
  • TLPD
  • StarCraft 2
  • Brood War
  • Blogs
Forum Sidebar
Events/Features
News
Featured News
[ASL22] Ro4 Preview: Mirror Mirror4[ASL22] Ro8 Preview: Within Reach5[ASL22] Ro8 Preview: In A Tizzy11[ASL22] Ro16 Preview: Holy Diver5[ASL22] Ro16 Preview: Rough Waters10
Community News
Weekly Cups Results (Sep 28-Oct 4)0SC4ALL: II SC2 Complete Invited Player Lineup10StarCraft II 5.0.17 PTR Patch Notes (Sept 30, 2026)75Weekly Cups (Sept 21-27): herO and ByuN double2Weekly Cups (Sep 13-20): herO scores triple3
StarCraft 2
General
StarCraft II 5.0.17 PTR Patch Notes (Sept 30, 2026) How do you feel about the mass reverts in the 5.0.17 PTR? Weekly Cups Results (Sep 28-Oct 4) SC4ALL: II SC2 Complete Invited Player Lineup Back to SC2 after 14 years - Protoss CTRL groups?
Tourneys
Stellar Fest TWO the Moon (Dec 16-20) Sparkling Tuna Cup - Weekly Open Tournament 2026 GSTL Grand Finals Sea Duckling Open (Global, Bronze-Diamond) SC2 INu's Battles#21 [ 3-Days tournament ]
Strategy
[H] ZvP Mid-Late Game: Stalkers Collossi HT
Custom Maps
[M] (2) Sweltering Sands [M] (2) Frigid Storage
External Content
Mutation # 546 Catch the Train The PondCast: SC2 News & Results Mutation # 545 And Drops and Rifts Mutation # 544 Double Trouble
Brood War
General
Sagi.gg Launcher Released 20-year-old Valorant player starting StarCraft BGH Auto Balance -> http://bghmmr.eu/ Fantasy returning? BSL Season 23
Tourneys
[ASL22] Semifinal B [ASL22] Semifinal A [Megathread] Daily Proleagues [ASL22] Ro8 Day 4
Strategy
Cliff Jump Revisited (1 in a 1000 strategy) Replay Review Process - What do you do? Simple Questions, Simple Answers
Other Games
General Games
General RTS Discussion Thread Nintendo Switch Thread Warcraft III: The Frozen Throne Stormgate/Frost Giant Megathread Total Annihilation Zero
Dota 2
Dota 2 Champions League Season 3 Begins April 25! Official 'what is Dota anymore' discussion
League of Legends
[TL LoL EUW IHs] Teemo shall perish
Heroes of the Storm
Heroes of the Storm 2.0
Hearthstone
Deck construction bug
TL Mafia
TL Mafia Community Thread
Community
General
Russo-Ukrainian War Thread US Politics Mega-thread Canadian Politics Mega-thread Dating: How's your luck? Artificial Intelligence Thread
Fan Clubs
Serral Fan Club
Media & Entertainment
Movie Discussion! [Manga] One Piece Diablo Animated Series on Netflix
Sports
Football (Soccer) Thread MLB/Baseball 2023
World Cup 2022
Tech Support
Computer Build, Upgrade & Buying Resource Thread
TL Community
Recent Gifted Posts
Blogs
[ASL22] Ro4 Day1 Ticket Giv…
bITt.mAN
Escaping Into Video Games: G…
TrAiDoS
38 yo Retired SWE loo…
PurE)Rabbit-SF
Can Bots Beat Pros?? Starcr…
namkraft
[meme] I finally understa…
LUCKY_NOOB
Regacy Esports:Our Goa…
regacyesports
Customize Sidebar...

Website Feedback

Closed Threads



Active: 9438 users

The Math Thread - Page 11

Forum Index > General Forum
Post a Reply
Prev 1 9 10 11 12 13 32 Next All
FiWiFaKi
Profile Blog Joined February 2009
Canada9859 Posts
Last Edited: 2017-09-13 18:11:25
September 13 2017 18:10 GMT
#201
On September 14 2017 00:34 AbouSV wrote:
Show nested quote +
On September 13 2017 14:49 FiWiFaKi wrote:
On September 13 2017 14:48 Acrofales wrote:
@fiwi: a mathematically elegant way of doing it is in the answer above yours.


Oh, I'm just too dumb to understand it, I see.

edit: Oh nevermind, I get it. I read the problem and I got too excited about trying to solve it rather than properly reading the comments that followed.

A right answer is a right answer Shows the difference between how an engineer vs how a mathematician approaches a problem.


i.e. Python vs Excel :p


Matlab if I have an idea about the method of the solution, Excel when I have no idea how to start, Mathematica if I want to be a smart ass instead of being practical ^^.

But that was all abou being clever and finding how to start it, not about the software.
In life, the journey is more satisfying than the destination. || .::Entrepreneurship::. Living a few years of your life like most people won't, so that you can spend the rest of your life like most people can't || Mechanical Engineering & Economics Major
JimmyJRaynor
Profile Blog Joined April 2010
Canada17903 Posts
Last Edited: 2017-09-27 03:57:12
September 27 2017 03:41 GMT
#202
A pretty cool introduction to Regularized Adjusted Plus-Minus (RAPM) for NBA players. It starts off by introducing basic Adjusted Plus Minus (APM)

https://squared2020.com/2017/09/18/deep-dive-on-regularized-adjusted-plus-minus-i-introductory-example/

the best part is his reference to Dan Rosenbaum's original work. he explains why Rosenbaum threw away certain players from his analysis back in 2004.
Ray Kassar To David Crane : "you're no more important to Atari than the factory workers assembling the cartridges"
HKTPZ
Profile Joined May 2017
105 Posts
September 28 2017 16:39 GMT
#203
Hey y'all.

I've been messing around with differentiation of exponential functions last few days and there's something that I cant seem to figure out so I thought I'd ask TeamLiquid for advise/help/inspiration.

By the definition of differentiation, the derivative of a^x is a^x times the limit of ((a^h))-1/h) as h goes to 0. Evaluating that limit is trivial by applying L'H BUT that rests upon already knowing the derivative of a^x so assuming that isnt known how does one figure out that limit?

the brute approach obviously is just convincing oneself that the derivate of 2^x is 2^x itself times a constant which appears to be approximately 0.7

then one could do the same for 8^x and come to the realization that the derivative of 8^x is 8^x times a constant which is about 3 times as great as 0.7 - which suggests we're looking at something logarithmic - the base of which can be approximated by a Taylor Series etc etc

this approach seems so bruteish and non-elegant so my question is: is there a cleverer and more elegant way to evaluate the limit which holds the key to differentiation of exponential functions?

(help me know if my wording was too poor/confusing - English is not my first language)
Liebig
Profile Joined August 2010
France738 Posts
September 28 2017 17:37 GMT
#204
a^x = exp(ln(a^x))=exp(x*ln(a))

so the derivative of a^x is ln(a)*a^x
HKTPZ
Profile Joined May 2017
105 Posts
Last Edited: 2017-09-28 17:45:57
September 28 2017 17:41 GMT
#205
On September 29 2017 02:37 Liebig wrote:
a^x = exp(ln(a^x))=exp(x*ln(a))

so the derivative of a^x is ln(a)*a^x

you're missing the point my friend (maybe I explained poorly)

Im asking how to approach that limit question if one does NOT know beforehand what the derivative of a^x (including e^x) is.
jodljodl
Profile Joined October 2016
182 Posts
Last Edited: 2017-09-28 19:58:01
September 28 2017 19:26 GMT
#206
meeh :/
i tried using latex to bbcode converter but it doesnt work the way i want it to
So in short and without formality:

You want the proof that the limit f(x), x -> 0 with f(x) = (b^x - 1)/x exists. Did i get that right?
You proof this by showing that f is strictly monotonic increasing in R+, which you can do by using the mean value theorem.
Hence, the limit f(x), x -> 0 equals inf{ f(x) | x in R+} =: s. (1)
Now you take a convergent seqeuence in R\{0}, h_n, with limit h_n -> 0 and show limit |h_n| = s (via monotonic increase and infimum property).
You can easily show that f(-h) = b^(-h) f(h) with h in R+. Also x -> b^x is continuos in 0, so limit b^(-|h_n|) = b^0 = 1.
Hence, limit b^(-|h_n|) f(h_n) = 1 s = s. (2)

d in R+. From (1) follows theres N_1 in Naturals with |f( |h_n| ) - s| < d for all n > N_1.
From (2) follows theres N_2 in Naturals with | b^(-|h_n|) f( |h_n| ) - s | < d for all n > N_2.
For all n in Naturals is f(h_n) either f( |h_n| ) or b^(-|h_n|) f( |h_n| ), so | f(h_n) - s | < d for all n in Naturals with n > max{N_1 , N_2}.

Hope this is helpful. Never did do any math in english so im lacking all the vocabulary. however, i hope you can follow my "proof".


Edit: There is an elegant way to determine the derivate of a^x (and hence the limit you are looking for). Which is excactly what the dude wrote before me:
a^x = exp( x ln(a) ) and it tells you the limit is ln(a). I dont think you need to look any further for a clever and elegant way. Because you already use it all the time The common derivation rules and the fact that exp is derivable on the entire definition range.
(Btw. you dont need L'H to proof any of this.)
Kim Doh Woo
Liebig
Profile Joined August 2010
France738 Posts
September 28 2017 19:39 GMT
#207
Oh sorry, that was my bad.

Can't really answer on how to approach the limit question without knowing exponential before, but my 2 cents:

So if you assume you don't know exponential, the only way (i know of) that you can define a^x is as the unique solution to the functional equation f(x+y)=f(x)*f(y) and f(1)=a for a > 0.

So f'(x) must be such that f'(x+y)=f'(x)*f(y)
So, now you have f'(x)=f'(0)*f(x)

And now I'm stuck cause one of the definition of e^x is as the solution of differential equation f'(x)=f(x)

But that gives an answer to why there is some constant times the function itself.
Simberto
Profile Blog Joined July 2010
Germany12020 Posts
September 28 2017 20:33 GMT
#208
I think one of the working definitions of e is that the derivative of e^x is e^x. If you choose any of the different ways to define e, you can prove from there that that sentence is true. I don't remember the specifics, but it works.

If you have that as set, and also have the chain rule of calculus proven, you can take the way that Liebig explained above.

And that is an absolutely fine way to prove the thing you wanted to prove, or to approach the series. You know other things, and derive the result from them. So you don't know what the derivative of a^x is, but you know what the derivative of e^x is, either by definition or by something that follows from that definition.

You are trying to take the way in the opposite direction. You don't start with proving what the derivative of a^x is, and go to e^x from there, you go the other way and start with e^x, and go to a^x.
jodljodl
Profile Joined October 2016
182 Posts
September 28 2017 21:16 GMT
#209
exp is not defined by exp'(x) = exp(x). Its defined by a power series (exp(x) = sum x^n/n! , n= 0 to infinity) or as the limit of the sequence (1 + x/n)^n , n -> infty.

But besides that i agree with you, simberto. It feels like HKTPZ goes about it the wrong way.
Thats also what i was trying to say in some way:
You already know d(a^x)/dx = ln(a) a^x because of the chain rule and exp properties you use daily, d(a^x)/dx = d(exp(x ln(a)))/dx = exp(x ln(a)) ln(a) = a^x ln(a).
And d(a^x)/dx = lim ( a^(x+h) - a^x )/h = a^x lim (a^h - 1)/h with h -> 0.
In short a^x ln(a) = d(a^x)/dx = a^x lim (a^h - 1)/h.

Commonly you calculate d(a^x)/dx = a^x ln(a) via derivation rules. These are no rules of thumb but proven generalization that work always for the right parameters.
So the clever and elegant way you are looking for to determine the limit lim (a^h - 1)/h, is the set of derivation rules and exp properties.
Kim Doh Woo
AbouSV
Profile Joined October 2014
Germany1278 Posts
September 28 2017 21:46 GMT
#210
On September 29 2017 06:16 jodljodl wrote:
exp is not defined by exp'(x) = exp(x). Its defined by a power series (exp(x) = sum x^n/n! , n= 0 to infinity) or as the limit of the sequence (1 + x/n)^n , n -> infty.


Exponential can also be defined as the only solution of y' = y, with y(0) = 1, implying exp'(x) = exp(x).
Joni_
Profile Joined April 2011
Germany355 Posts
Last Edited: 2017-09-28 22:35:04
September 28 2017 22:23 GMT
#211
On September 29 2017 06:46 AbouSV wrote:
Show nested quote +
On September 29 2017 06:16 jodljodl wrote:
exp is not defined by exp'(x) = exp(x). Its defined by a power series (exp(x) = sum x^n/n! , n= 0 to infinity) or as the limit of the sequence (1 + x/n)^n , n -> infty.


Exponential can also be defined as the only solution of y' = y, with y(0) = 1, implying exp'(x) = exp(x).

You need a lot more mathematical background to prove that this differential equation has a unique solution than you need to define the exponential function by it's series representation.
Also the series representation can be generalized more easily (say to the case of bounded operators acting on possibly infinite-dimensional banach spaces) and it allows you to verify properties of the (real) exponential function like its limit behaviour when concatenated with polynomial functions in a very simple way.. I dont really see the advantage of using your proposed definition, as long as it's not part of a class for say engineers that are primarily interested in solving differential equations.

Mind you I dont want to say that either definition is really more "correct" (at least in the case of real exponential functions), I just think that using the series representation fits more naturally into the way an analysis class is structured. At least where I'm from, maybe it's different if you do several classes of "calculus" before developing an axiomatic theory..

Edit: The more I think about it the less I like your way of defining the exponential function. It really only works properly in the case of functions defined on at least some open neighbourhood of 0 on the real axis. And at the very least as soon as you try to generalize to the complex plane you will inevitably need the series representation to prove uniqueness of the solution anyway, bc you will need some form of an identity theorem for holomorphic functions... Just feels like it really only is useful in a setting where the people being taught are interested only in the theory of ordinary differential equations on the set of real functions and their strong solutions....
Simberto
Profile Blog Joined July 2010
Germany12020 Posts
Last Edited: 2017-09-28 23:25:03
September 28 2017 23:02 GMT
#212
On September 29 2017 07:23 Joni_ wrote:
Show nested quote +
On September 29 2017 06:46 AbouSV wrote:
On September 29 2017 06:16 jodljodl wrote:
exp is not defined by exp'(x) = exp(x). Its defined by a power series (exp(x) = sum x^n/n! , n= 0 to infinity) or as the limit of the sequence (1 + x/n)^n , n -> infty.


Exponential can also be defined as the only solution of y' = y, with y(0) = 1, implying exp'(x) = exp(x).

You need a lot more mathematical background to prove that this differential equation has a unique solution than you need to define the exponential function by it's series representation.
Also the series representation can be generalized more easily (say to the case of bounded operators acting on possibly infinite-dimensional banach spaces) and it allows you to verify properties of the (real) exponential function like its limit behaviour when concatenated with polynomial functions in a very simple way.. I dont really see the advantage of using your proposed definition, as long as it's not part of a class for say engineers that are primarily interested in solving differential equations.

Mind you I dont want to say that either definition is really more "correct" (at least in the case of real exponential functions), I just think that using the series representation fits more naturally into the way an analysis class is structured. At least where I'm from, maybe it's different if you do several classes of "calculus" before developing an axiomatic theory..

Edit: The more I think about it the less I like your way of defining the exponential function. It really only works properly in the case of functions defined on at least some open neighbourhood of 0 on the real axis. And at the very least as soon as you try to generalize to the complex plane you will inevitably need the series representation to prove uniqueness of the solution anyway, bc you will need some form of an identity theorem for holomorphic functions... Just feels like it really only is useful in a setting where the people being taught are interested only in the theory of ordinary differential equations on the set of real functions and their strong solutions....


I remember at least three different definitions of e or exp. One via the infinite series, one via the differential equation, and one as the limit of (1+1/n)^n. Though i admit that i had to look that last one up. It has been a bit since my introductory maths classes, but i am rather certain that you can prove that they are all equivalent anyways. So basically, just use whichever is most useful in the situation you are in. The differential equation is probably not the most useful for introductory maths classes for maths students due to the problems that you mention. And except for maths students, noone cares about the exact way something can be derived from other stuff and whether that is actually correct.

Edit: Also, from the infinity series of the exp function to d/dx exp(x) = exp(x) you just need to derive polynoms. And derivatives of polynoms are easily proven by the definition of the derivative. So with regards to the original question, it doesn't really matter with which one we start. The way to d/dx a^x (and the limit in question) from not a lot of other stuff is:
Prove d/dx x^n = n x^n-1
prove chain rule
define exp = infinite series x^n/n!
do some work to get a reasonable definition of ln(x)
derive d/dx exp(x) = exp(x)
define a^x as exp(x lna)
derive via ruleset that has been proven.
Joni_
Profile Joined April 2011
Germany355 Posts
Last Edited: 2017-09-28 23:34:16
September 28 2017 23:25 GMT
#213
On September 29 2017 08:02 Simberto wrote:
Show nested quote +
On September 29 2017 07:23 Joni_ wrote:
On September 29 2017 06:46 AbouSV wrote:
On September 29 2017 06:16 jodljodl wrote:
exp is not defined by exp'(x) = exp(x). Its defined by a power series (exp(x) = sum x^n/n! , n= 0 to infinity) or as the limit of the sequence (1 + x/n)^n , n -> infty.


Exponential can also be defined as the only solution of y' = y, with y(0) = 1, implying exp'(x) = exp(x).

You need a lot more mathematical background to prove that this differential equation has a unique solution than you need to define the exponential function by it's series representation.
Also the series representation can be generalized more easily (say to the case of bounded operators acting on possibly infinite-dimensional banach spaces) and it allows you to verify properties of the (real) exponential function like its limit behaviour when concatenated with polynomial functions in a very simple way.. I dont really see the advantage of using your proposed definition, as long as it's not part of a class for say engineers that are primarily interested in solving differential equations.

Mind you I dont want to say that either definition is really more "correct" (at least in the case of real exponential functions), I just think that using the series representation fits more naturally into the way an analysis class is structured. At least where I'm from, maybe it's different if you do several classes of "calculus" before developing an axiomatic theory..

Edit: The more I think about it the less I like your way of defining the exponential function. It really only works properly in the case of functions defined on at least some open neighbourhood of 0 on the real axis. And at the very least as soon as you try to generalize to the complex plane you will inevitably need the series representation to prove uniqueness of the solution anyway, bc you will need some form of an identity theorem for holomorphic functions... Just feels like it really only is useful in a setting where the people being taught are interested only in the theory of ordinary differential equations on the set of real functions and their strong solutions....


I remember at least three different definitions of e or exp. One via the infinite series, one via the differential equation, and one as the limit of (1+1/n)^n. Though i admit that i had to look that last one up. It has been a bit since my introductory maths classes, but i am rather certain that you can prove that they are all equivalent anyways. So basically, just use whichever is most useful in the situation you are in. The differential equation is probably not the most useful for introductory maths classes for maths students due to the problems that you mention. And except for maths students, noone cares about the exact way something can be derived from other stuff and whether that is actually correct.

Your last one should read (1+x/n)^n if you want to define the actual exponential map, I think.

Of course they are "equivalent" as long as you stay in the realm of real functions. But that was precisely the point I was trying to make. Understanding why the differential equation a) has a solution and b) the solution is unique requires way more machinery than covering convergent series. The simplestway of proving that the differential exquation in question has a solution is to give one. But if you are going to define the exponential function that way, then you can hardly use the exponential function to show that a solution exists. Using the series expression would also defeat the purpose of using the differential equation to actually define the exponential function.
So all that is left is relying on more sophisticated tools like some kind of existence/uniqueness result for differential equations, I guess. That does seem rather 'high level' for such simple endavours.

I mean assuming we want to define the exp-function as the unique solution to the differential equation... How would I go about proving that the differential equation has a solution that is unique? Even attempting to go for some fix point iteration seems a bit ridiculous because that relies on an understanding of convergent sequences (which correspond 1:1 to convergent series - the exact thing we were trying to avoid).

Concerning your edit:
You cant just assume that the derivative of a series (i.e. the limit of finite sums) is the same as the limit of the derivative of the finite sums. There are certain setting where limits and derivatives can be exchanged but this is NOT true in General and you should always make very sure why exactly you are allowed to interchange limits (after all taking a derivative is just another limit).
In this case the uniform convergence of the series on compact sets and the pointwise convergence of the (continuous) derivatives saves the day, but we should try to always make sure we know the reasons why certain operations yield correct results.

Of course after making sure that all this is allowed, you're perfectly right. Then all that remains to do is exchange the series' limit and the d/dx and differentiate dem juicy polynomials. :>
Acrofales
Profile Joined August 2010
Spain18453 Posts
September 29 2017 06:19 GMT
#214
On September 29 2017 08:25 Joni_ wrote:
Show nested quote +
On September 29 2017 08:02 Simberto wrote:
On September 29 2017 07:23 Joni_ wrote:
On September 29 2017 06:46 AbouSV wrote:
On September 29 2017 06:16 jodljodl wrote:
exp is not defined by exp'(x) = exp(x). Its defined by a power series (exp(x) = sum x^n/n! , n= 0 to infinity) or as the limit of the sequence (1 + x/n)^n , n -> infty.


Exponential can also be defined as the only solution of y' = y, with y(0) = 1, implying exp'(x) = exp(x).

You need a lot more mathematical background to prove that this differential equation has a unique solution than you need to define the exponential function by it's series representation.
Also the series representation can be generalized more easily (say to the case of bounded operators acting on possibly infinite-dimensional banach spaces) and it allows you to verify properties of the (real) exponential function like its limit behaviour when concatenated with polynomial functions in a very simple way.. I dont really see the advantage of using your proposed definition, as long as it's not part of a class for say engineers that are primarily interested in solving differential equations.

Mind you I dont want to say that either definition is really more "correct" (at least in the case of real exponential functions), I just think that using the series representation fits more naturally into the way an analysis class is structured. At least where I'm from, maybe it's different if you do several classes of "calculus" before developing an axiomatic theory..

Edit: The more I think about it the less I like your way of defining the exponential function. It really only works properly in the case of functions defined on at least some open neighbourhood of 0 on the real axis. And at the very least as soon as you try to generalize to the complex plane you will inevitably need the series representation to prove uniqueness of the solution anyway, bc you will need some form of an identity theorem for holomorphic functions... Just feels like it really only is useful in a setting where the people being taught are interested only in the theory of ordinary differential equations on the set of real functions and their strong solutions....


I remember at least three different definitions of e or exp. One via the infinite series, one via the differential equation, and one as the limit of (1+1/n)^n. Though i admit that i had to look that last one up. It has been a bit since my introductory maths classes, but i am rather certain that you can prove that they are all equivalent anyways. So basically, just use whichever is most useful in the situation you are in. The differential equation is probably not the most useful for introductory maths classes for maths students due to the problems that you mention. And except for maths students, noone cares about the exact way something can be derived from other stuff and whether that is actually correct.

Your last one should read (1+x/n)^n if you want to define the actual exponential map, I think.

Of course they are "equivalent" as long as you stay in the realm of real functions. But that was precisely the point I was trying to make. Understanding why the differential equation a) has a solution and b) the solution is unique requires way more machinery than covering convergent series. The simplestway of proving that the differential exquation in question has a solution is to give one. But if you are going to define the exponential function that way, then you can hardly use the exponential function to show that a solution exists. Using the series expression would also defeat the purpose of using the differential equation to actually define the exponential function.
So all that is left is relying on more sophisticated tools like some kind of existence/uniqueness result for differential equations, I guess. That does seem rather 'high level' for such simple endavours.

I mean assuming we want to define the exp-function as the unique solution to the differential equation... How would I go about proving that the differential equation has a solution that is unique? Even attempting to go for some fix point iteration seems a bit ridiculous because that relies on an understanding of convergent sequences (which correspond 1:1 to convergent series - the exact thing we were trying to avoid).

Concerning your edit:
You cant just assume that the derivative of a series (i.e. the limit of finite sums) is the same as the limit of the derivative of the finite sums. There are certain setting where limits and derivatives can be exchanged but this is NOT true in General and you should always make very sure why exactly you are allowed to interchange limits (after all taking a derivative is just another limit).
In this case the uniform convergence of the series on compact sets and the pointwise convergence of the (continuous) derivatives saves the day, but we should try to always make sure we know the reasons why certain operations yield correct results.

Of course after making sure that all this is allowed, you're perfectly right. Then all that remains to do is exchange the series' limit and the d/dx and differentiate dem juicy polynomials. :>

If you define e^x as an infinite series, then the derivative is obviously the derivative of that infinite series. You don't need the general case, you need this very specific case. You should of course prove f(x) = f'(x) for f(x) = e^x, using whatever definition of the derivative has your preference.
Joni_
Profile Joined April 2011
Germany355 Posts
Last Edited: 2017-09-29 07:25:32
September 29 2017 07:24 GMT
#215
On September 29 2017 15:19 Acrofales wrote:
Show nested quote +
On September 29 2017 08:25 Joni_ wrote:
On September 29 2017 08:02 Simberto wrote:
On September 29 2017 07:23 Joni_ wrote:
On September 29 2017 06:46 AbouSV wrote:
On September 29 2017 06:16 jodljodl wrote:
exp is not defined by exp'(x) = exp(x). Its defined by a power series (exp(x) = sum x^n/n! , n= 0 to infinity) or as the limit of the sequence (1 + x/n)^n , n -> infty.


Exponential can also be defined as the only solution of y' = y, with y(0) = 1, implying exp'(x) = exp(x).

You need a lot more mathematical background to prove that this differential equation has a unique solution than you need to define the exponential function by it's series representation.
Also the series representation can be generalized more easily (say to the case of bounded operators acting on possibly infinite-dimensional banach spaces) and it allows you to verify properties of the (real) exponential function like its limit behaviour when concatenated with polynomial functions in a very simple way.. I dont really see the advantage of using your proposed definition, as long as it's not part of a class for say engineers that are primarily interested in solving differential equations.

Mind you I dont want to say that either definition is really more "correct" (at least in the case of real exponential functions), I just think that using the series representation fits more naturally into the way an analysis class is structured. At least where I'm from, maybe it's different if you do several classes of "calculus" before developing an axiomatic theory..

Edit: The more I think about it the less I like your way of defining the exponential function. It really only works properly in the case of functions defined on at least some open neighbourhood of 0 on the real axis. And at the very least as soon as you try to generalize to the complex plane you will inevitably need the series representation to prove uniqueness of the solution anyway, bc you will need some form of an identity theorem for holomorphic functions... Just feels like it really only is useful in a setting where the people being taught are interested only in the theory of ordinary differential equations on the set of real functions and their strong solutions....


I remember at least three different definitions of e or exp. One via the infinite series, one via the differential equation, and one as the limit of (1+1/n)^n. Though i admit that i had to look that last one up. It has been a bit since my introductory maths classes, but i am rather certain that you can prove that they are all equivalent anyways. So basically, just use whichever is most useful in the situation you are in. The differential equation is probably not the most useful for introductory maths classes for maths students due to the problems that you mention. And except for maths students, noone cares about the exact way something can be derived from other stuff and whether that is actually correct.

Your last one should read (1+x/n)^n if you want to define the actual exponential map, I think.

Of course they are "equivalent" as long as you stay in the realm of real functions. But that was precisely the point I was trying to make. Understanding why the differential equation a) has a solution and b) the solution is unique requires way more machinery than covering convergent series. The simplestway of proving that the differential exquation in question has a solution is to give one. But if you are going to define the exponential function that way, then you can hardly use the exponential function to show that a solution exists. Using the series expression would also defeat the purpose of using the differential equation to actually define the exponential function.
So all that is left is relying on more sophisticated tools like some kind of existence/uniqueness result for differential equations, I guess. That does seem rather 'high level' for such simple endavours.

I mean assuming we want to define the exp-function as the unique solution to the differential equation... How would I go about proving that the differential equation has a solution that is unique? Even attempting to go for some fix point iteration seems a bit ridiculous because that relies on an understanding of convergent sequences (which correspond 1:1 to convergent series - the exact thing we were trying to avoid).

Concerning your edit:
You cant just assume that the derivative of a series (i.e. the limit of finite sums) is the same as the limit of the derivative of the finite sums. There are certain setting where limits and derivatives can be exchanged but this is NOT true in General and you should always make very sure why exactly you are allowed to interchange limits (after all taking a derivative is just another limit).
In this case the uniform convergence of the series on compact sets and the pointwise convergence of the (continuous) derivatives saves the day, but we should try to always make sure we know the reasons why certain operations yield correct results.

Of course after making sure that all this is allowed, you're perfectly right. Then all that remains to do is exchange the series' limit and the d/dx and differentiate dem juicy polynomials. :>

If you define e^x as an infinite series, then the derivative is obviously the derivative of that infinite series. You don't need the general case, you need this very specific case. You should of course prove f(x) = f'(x) for f(x) = e^x, using whatever definition of the derivative has your preference.

Not sure what youre trying to say? Or even what part of my post you are referring to exactly? If it's about the last part..:
"The derivative of the series" would be d/dx \lim_n\sum_{k=0}^n x^k/k! and all that I said is that you need a reason for why this would equal \lim_n d/dx \sum_{k=0}^n x^k/k!, i.e., a reason for why you are allowed to exchange the order of derivative and limit. This is NOT trivial or true for arbitrary series. It is however exactly what you need to do to reduce the case of differentiating the exponential function to the case of differentiating polynomials, i.e., applying the differentiation to the finite sums.

One possible way to go about this is using this: https://math.stackexchange.com/questions/409178/can-i-exchange-limit-and-differentiation-for-a-sequence-of-smooth-functions

I know that in some cases in courses for engineers (or even physicists) people pretend like limits can be arbitrarily exchanged. Time to accept that this is just wrong and only ever done because it would be too time-consuming to give the full picture.
HKTPZ
Profile Joined May 2017
105 Posts
Last Edited: 2017-09-29 08:25:38
September 29 2017 08:23 GMT
#216
Clearly, I didnt manage to ask my question the right way so I will try to rephrase ^^

I know a^x can be rewritten as e^(x*lna) and I know the derivative of e^x is e^x times ln e which simplifies to e^x and I know Leibniz' chain rule.

Im asking: WITHOUT using that knowledge, is there a clever and elegant way to show that lim ((a^h)-1)/h as h goes to 0 is exactly 1/n of lim (((a^n)^h)-1)/h as h goes to 0 implying there is a connection to log.

I can show that lim ((a^h)-1)/h as h goes to 0 exists but Im at a loss trying to show the limit is ln a (what the base is is trivial - the point is to show the connection to logarithmic behaviour)
Acrofales
Profile Joined August 2010
Spain18453 Posts
September 29 2017 09:34 GMT
#217
On September 29 2017 16:24 Joni_ wrote:
Show nested quote +
On September 29 2017 15:19 Acrofales wrote:
On September 29 2017 08:25 Joni_ wrote:
On September 29 2017 08:02 Simberto wrote:
On September 29 2017 07:23 Joni_ wrote:
On September 29 2017 06:46 AbouSV wrote:
On September 29 2017 06:16 jodljodl wrote:
exp is not defined by exp'(x) = exp(x). Its defined by a power series (exp(x) = sum x^n/n! , n= 0 to infinity) or as the limit of the sequence (1 + x/n)^n , n -> infty.


Exponential can also be defined as the only solution of y' = y, with y(0) = 1, implying exp'(x) = exp(x).

You need a lot more mathematical background to prove that this differential equation has a unique solution than you need to define the exponential function by it's series representation.
Also the series representation can be generalized more easily (say to the case of bounded operators acting on possibly infinite-dimensional banach spaces) and it allows you to verify properties of the (real) exponential function like its limit behaviour when concatenated with polynomial functions in a very simple way.. I dont really see the advantage of using your proposed definition, as long as it's not part of a class for say engineers that are primarily interested in solving differential equations.

Mind you I dont want to say that either definition is really more "correct" (at least in the case of real exponential functions), I just think that using the series representation fits more naturally into the way an analysis class is structured. At least where I'm from, maybe it's different if you do several classes of "calculus" before developing an axiomatic theory..

Edit: The more I think about it the less I like your way of defining the exponential function. It really only works properly in the case of functions defined on at least some open neighbourhood of 0 on the real axis. And at the very least as soon as you try to generalize to the complex plane you will inevitably need the series representation to prove uniqueness of the solution anyway, bc you will need some form of an identity theorem for holomorphic functions... Just feels like it really only is useful in a setting where the people being taught are interested only in the theory of ordinary differential equations on the set of real functions and their strong solutions....


I remember at least three different definitions of e or exp. One via the infinite series, one via the differential equation, and one as the limit of (1+1/n)^n. Though i admit that i had to look that last one up. It has been a bit since my introductory maths classes, but i am rather certain that you can prove that they are all equivalent anyways. So basically, just use whichever is most useful in the situation you are in. The differential equation is probably not the most useful for introductory maths classes for maths students due to the problems that you mention. And except for maths students, noone cares about the exact way something can be derived from other stuff and whether that is actually correct.

Your last one should read (1+x/n)^n if you want to define the actual exponential map, I think.

Of course they are "equivalent" as long as you stay in the realm of real functions. But that was precisely the point I was trying to make. Understanding why the differential equation a) has a solution and b) the solution is unique requires way more machinery than covering convergent series. The simplestway of proving that the differential exquation in question has a solution is to give one. But if you are going to define the exponential function that way, then you can hardly use the exponential function to show that a solution exists. Using the series expression would also defeat the purpose of using the differential equation to actually define the exponential function.
So all that is left is relying on more sophisticated tools like some kind of existence/uniqueness result for differential equations, I guess. That does seem rather 'high level' for such simple endavours.

I mean assuming we want to define the exp-function as the unique solution to the differential equation... How would I go about proving that the differential equation has a solution that is unique? Even attempting to go for some fix point iteration seems a bit ridiculous because that relies on an understanding of convergent sequences (which correspond 1:1 to convergent series - the exact thing we were trying to avoid).

Concerning your edit:
You cant just assume that the derivative of a series (i.e. the limit of finite sums) is the same as the limit of the derivative of the finite sums. There are certain setting where limits and derivatives can be exchanged but this is NOT true in General and you should always make very sure why exactly you are allowed to interchange limits (after all taking a derivative is just another limit).
In this case the uniform convergence of the series on compact sets and the pointwise convergence of the (continuous) derivatives saves the day, but we should try to always make sure we know the reasons why certain operations yield correct results.

Of course after making sure that all this is allowed, you're perfectly right. Then all that remains to do is exchange the series' limit and the d/dx and differentiate dem juicy polynomials. :>

If you define e^x as an infinite series, then the derivative is obviously the derivative of that infinite series. You don't need the general case, you need this very specific case. You should of course prove f(x) = f'(x) for f(x) = e^x, using whatever definition of the derivative has your preference.

Not sure what youre trying to say? Or even what part of my post you are referring to exactly? If it's about the last part..:
"The derivative of the series" would be d/dx \lim_n\sum_{k=0}^n x^k/k! and all that I said is that you need a reason for why this would equal \lim_n d/dx \sum_{k=0}^n x^k/k!, i.e., a reason for why you are allowed to exchange the order of derivative and limit. This is NOT trivial or true for arbitrary series. It is however exactly what you need to do to reduce the case of differentiating the exponential function to the case of differentiating polynomials, i.e., applying the differentiation to the finite sums.

One possible way to go about this is using this: https://math.stackexchange.com/questions/409178/can-i-exchange-limit-and-differentiation-for-a-sequence-of-smooth-functions

I know that in some cases in courses for engineers (or even physicists) people pretend like limits can be arbitrarily exchanged. Time to accept that this is just wrong and only ever done because it would be too time-consuming to give the full picture.


Thank you for talking down to engineers and physicists. I am actually a mathematician (well, at least I got my propaedeuse in math, never completed my BSc as I moved to CS which got less hooked up on infinitessimal details )

Anyway, I see your problem, and I think you are simply misunderstanding what I am saying. I do see that there is a more fundamental problem with Simberto's approach, and it's all in the definition of e^x as an infinite series, but it's not in the proof of the derivative. So lets clarify that first:

We define:

f(x) = sum x^n/n! (with n 0 to infinity)

Now:

df /dx = d / dx sum x^n/n! (with n 0 to infinity) (by definition)

Now we have to prove that df / dx = f.

Lemma:
d / dx sum x^n/n! (with n 0 to N) = sum x^n/n! (with n 0 to N - 1).

Proof:

Base step:
d / dx sum x^n/n! (with n 0 to 2) = d / dx (1 + x) = 1 = sum x^n/n! (with n 0 to 1).
(little square box)

Inductive step:
Assume
d / dx sum x^n/n! (with n 0 to M) = sum x^n/n! (with n 0 to M - 1).

d / dx sum x^n/n! (with n 0 to M + 1) = d / dx (x^(M + 1)/(M + 1)! + sum x^n/n! (with n 0 to M) )
= d / dx (x^(M + 1)/(M + 1)! + d / dx sum x^n/n! (with n 0 to M)
= (M + 1)x^M / (M + 1)! + d / dx sum x^n/n! (with n 0 to M)
= x^M / M! + d / dx sum x^n/n! (with n 0 to M)
= x^M / M! + sum x^n/n! (with n 0 to M - 1)
= sum x^n/n! (with n 0 to M)
(little square box)

QED.

Theorem:

d / dx sum x^n/n! (with n 0 to infinity) = sum x^n/n! (with n 0 to infinity).

Proof (using Lemma above):
lim(N -> inf) d / dx sum x^n/n! (with n = 0 to N) = lim(N - > inf) sum x^n/n! (with n = 0 to N - 1) = lim(N - > inf) sum x^n/n! (with n = 0 to N) = lim(N -> inf) sum x^n/n!

QED

So there we have it: f(x) = f'(x) for f defined as above.

Now, of course, there is a problem, and that is that we haven't defined a^x, only e^x. I believe the usual solution is to simply define a^x = e^(x ln a). And from then onwards it's easy. But I'm not sure that this satisfies what the original question was asking.
Shalashaska_123
Profile Blog Joined July 2013
United States142 Posts
September 29 2017 09:34 GMT
#218
On September 29 2017 01:39 HKTPZ wrote:
Hey y'all.

I've been messing around with differentiation of exponential functions last few days and there's something that I cant seem to figure out so I thought I'd ask TeamLiquid for advise/help/inspiration.

By the definition of differentiation, the derivative of a^x is a^x times the limit of ((a^h))-1/h) as h goes to 0. Evaluating that limit is trivial by applying L'H BUT that rests upon already knowing the derivative of a^x so assuming that isnt known how does one figure out that limit?

the brute approach obviously is just convincing oneself that the derivate of 2^x is 2^x itself times a constant which appears to be approximately 0.7

then one could do the same for 8^x and come to the realization that the derivative of 8^x is 8^x times a constant which is about 3 times as great as 0.7 - which suggests we're looking at something logarithmic - the base of which can be approximated by a Taylor Series etc etc

this approach seems so bruteish and non-elegant so my question is: is there a cleverer and more elegant way to evaluate the limit which holds the key to differentiation of exponential functions?

(help me know if my wording was too poor/confusing - English is not my first language)


Hello, HKTPZ.

Honestly, I would do it the way Liebig suggested.

On September 29 2017 02:37 Liebig wrote:
a^x = exp(ln(a^x))=exp(x*ln(a))

so the derivative of a^x is ln(a)*a^x


If we can't use that approach, though, then we have to go back to the definition of the derivative.

[image loading]

The function we have is f(x) = a^x. Plug this into the definition.

[image loading]

Use one of the properties of exponents.

[image loading]

Factor a^x and bring it in front of the limit. This can be done because it doesn't depend on h.

[image loading]

We have here the indeterminate form 0/0, so we can apply L'hopital's rule.

[image loading]

The denominator is just 1, so it disappears. In the numerator, the constant disappears. We're just left with what we set out to find from the beginning.

[image loading]

This is just f'(0).

[image loading]

We stated at the beginning that f(x) = a^x. Substitute it here.

[image loading]

We thus have a differential equation for f(x). Divide both sides by f(x).

[image loading]

The left side is just the derivative of ln f.

[image loading]

Now integrate both sides with respect to x.

[image loading]

Exponentiate both sides so that we just have f(x) on the left side.

[image loading]

Use one of the properties of exponents.

[image loading]

Use a new constant for e^C.

[image loading]

Now substitute a^x for f(x).

[image loading]

We can determine A by setting x = 0. Doing so gives us 1 = A.

[image loading]

All that's left to do is to solve for f'(0). Take the natural log of both sides.

[image loading]

Use the property of logs that allows us to bring the power of the argument to the coefficient.

[image loading]

ln e = 1 and x cancels from both sides. We're left with the value of f'(0).

[image loading]

f'(x) = a^xf'(0). Therefore,

[image loading]

I hope this helped you out.

Sincerely,
Shalashaska_123
Acrofales
Profile Joined August 2010
Spain18453 Posts
September 29 2017 09:35 GMT
#219
On September 29 2017 17:23 HKTPZ wrote:
Clearly, I didnt manage to ask my question the right way so I will try to rephrase ^^

I know a^x can be rewritten as e^(x*lna) and I know the derivative of e^x is e^x times ln e which simplifies to e^x and I know Leibniz' chain rule.

Im asking: WITHOUT using that knowledge, is there a clever and elegant way to show that lim ((a^h)-1)/h as h goes to 0 is exactly 1/n of lim (((a^n)^h)-1)/h as h goes to 0 implying there is a connection to log.

I can show that lim ((a^h)-1)/h as h goes to 0 exists but Im at a loss trying to show the limit is ln a (what the base is is trivial - the point is to show the connection to logarithmic behaviour)

As in the post above. Please define a^x in a suitably formal manner, and we can take it from there
Acrofales
Profile Joined August 2010
Spain18453 Posts
Last Edited: 2017-09-29 09:43:17
September 29 2017 09:38 GMT
#220
On September 29 2017 18:34 Shalashaska_123 wrote:
+ Show Spoiler [long] +


On September 29 2017 01:39 HKTPZ wrote:
Hey y'all.

I've been messing around with differentiation of exponential functions last few days and there's something that I cant seem to figure out so I thought I'd ask TeamLiquid for advise/help/inspiration.

By the definition of differentiation, the derivative of a^x is a^x times the limit of ((a^h))-1/h) as h goes to 0. Evaluating that limit is trivial by applying L'H BUT that rests upon already knowing the derivative of a^x so assuming that isnt known how does one figure out that limit?

the brute approach obviously is just convincing oneself that the derivate of 2^x is 2^x itself times a constant which appears to be approximately 0.7

then one could do the same for 8^x and come to the realization that the derivative of 8^x is 8^x times a constant which is about 3 times as great as 0.7 - which suggests we're looking at something logarithmic - the base of which can be approximated by a Taylor Series etc etc

this approach seems so bruteish and non-elegant so my question is: is there a cleverer and more elegant way to evaluate the limit which holds the key to differentiation of exponential functions?

(help me know if my wording was too poor/confusing - English is not my first language)


Hello, HKTPZ.

Honestly, I would do it the way Liebig suggested.

On September 29 2017 02:37 Liebig wrote:
a^x = exp(ln(a^x))=exp(x*ln(a))

so the derivative of a^x is ln(a)*a^x


If we can't use that approach, though, then we have to go back to the definition of the derivative.

[image loading]

The function we have is f(x) = a^x. Plug this into the definition.

[image loading]

Use one of the properties of exponents.

[image loading]

Factor a^x and bring it in front of the limit. This can be done because it doesn't depend on h.

[image loading]

We have here the indeterminate form 0/0, so we can apply L'hopital's rule.

[image loading]

The denominator is just 1, so it disappears. In the numerator, the constant disappears. We're just left with what we set out to find from the beginning.

[image loading]

This is just f'(0).

[image loading]

We stated at the beginning that f(x) = a^x. Substitute it here.

[image loading]

We thus have a differential equation for f(x). Divide both sides by f(x).

[image loading]

The left side is just the derivative of ln f.

[image loading]

Now integrate both sides with respect to x.

[image loading]

Exponentiate both sides so that we just have f(x) on the left side.

[image loading]

Use one of the properties of exponents.

[image loading]

Use a new constant for e^C.

[image loading]

Now substitute a^x for f(x).

[image loading]

We can determine A by setting x = 0. Doing so gives us 1 = A.

[image loading]

All that's left to do is to solve for f'(0). Take the natural log of both sides.

[image loading]

Use the property of logs that allows us to bring the power of the argument to the coefficient.

[image loading]

ln e = 1 and x cancels from both sides. We're left with the value of f'(0).

[image loading]

f'(x) = a^xf'(0). Therefore,

[image loading]

I hope this helped you out.

Sincerely,
Shalashaska_123

Holy wowzerz. You generated a million different images from latex, uploaded them to imgur and included them here. You're my hero.

Also, a super elegant solution, but there is one slight hitch:

"The left side is just the derivative of ln f."

It's easy to prove, but you'd still have to return to first principles. I think you don't escape needing to define e^x in order to be able to define ln x as its inverse. And then you'd need to prove that sentence there. Which means a lot of work.
Prev 1 9 10 11 12 13 32 Next All
Please log in or register to reply.
Live Events Refresh
Next event in 7h 32m
[ Submit Event ]
Live Streams
Refresh
StarCraft 2
ProTech150
UpATreeSC 105
BRAT_OK 39
StarCraft: Brood War
Calm 4265
Bisu 1848
Soulkey 1459
EffOrt 924
Mini 671
Larva 401
Horang2 375
ZerO 350
actioN 204
ggaemo 175
[ Show more ]
Dewaltoss 122
Yoon 115
Shinee 101
Mind 94
hero 76
Sharp 70
sorry 61
Snow 51
Barracks 45
Hyun 39
Bale 29
Trap 27
ToSsGirL 22
Terrorterran 21
NaDa 17
Rock 15
scan(afreeca) 13
Sacsri 9
Noble 8
zelot 8
ajuk12(nOOB) 7
Dota 2
Gorgc5710
Dendi1324
420jenkins284
XaKoH 140
League of Legends
Reynor72
Counter-Strike
fl0m3555
Fnx 684
x6flipin638
pashabiceps54
edward27
Heroes of the Storm
crisheroes380
Other Games
Liquid`RaSZi1374
hiko981
FrodaN435
B2W.Neo395
Liquid`VortiX218
XBOCT200
Livibee173
QueenE108
TKL 82
Mew2King46
ZerO(Twitch)19
Organizations
Other Games
WardiTV169
Dota 2
PGL Dota 2 - Main Stream30
[ Show 14 non-featured ]
StarCraft 2
• StrangeGG 55
• AfreecaTV YouTube
• intothetv
• Kozan
• IndyKCrew
• Migwel
StarCraft: Brood War
• HerbMon 38
• BSLYoutube
• STPLYoutube
• ZZZeroYoutube
Dota 2
• WagamamaTV649
League of Legends
• Nemesis3458
• TFBlade787
Other Games
• Shiphtur488
Upcoming Events
PiGosaur Cup
7h 32m
Patches Events
23h 32m
The PondCast
1d 17h
INu's Battles
1d 18h
Percival vs TBD
Zoun vs herO
OSC
2 days
Replay Cast
2 days
OSC
3 days
BSL: Ladder Tournament
4 days
Sparkling Tuna Cup
4 days
Patches Events
4 days
[ Show More ]
BSL Open Qualifier
5 days
BSL Open Qualifier
5 days
WardiTV Weekly
6 days
Liquipedia Results

Completed

CSL 2026 AUTUMN (S22)
Blizzard Classic Cup 2026
Copium Cup

Ongoing

ASL Season 22
Super Anchor Qualifying S3
Acropolis #5
Acropolis #5 - GSB
ESL Pro League Season 24
Stake Ranked Episode 4
1win Private Club #1
Logitech G Play Connect 2026
SL StarSeries Fall 2026
FISSURE Playground #3
BLAST Open Fall 2026
Esports World Cup 2026
BLAST Bounty Summer 2026
BLAST Bounty Summer Qual

Upcoming

Acropolis #5 - GSC
BSL Season 23
SC4ALL II: Brood War
BSL 23: Non-Korean Championship
HSC XXX
Stellar Fest 2: Lunar Cup
SC4ALL II: StarCraft II
Kung Fu Cup 2026 Grand Finals
RSL Offline Finals
HCC Season 3
eXTREMESLAND 2026
PGL Major Singapore 2026
Stake Ranked Episode 6
BLAST Rivals Fall 2026
IEM Beijing 2026
Stake Ranked Episode 5
PGL Masters Bucharest 2026
1win Private Club #2
Thunderpick World Champ. '26
TLPD

1. ByuN
2. TY
3. Dark
4. Solar
5. Stats
6. Nerchio
7. sOs
8. soO
9. INnoVation
10. Elazer
1. Rain
2. Flash
3. EffOrt
4. Last
5. Bisu
6. Soulkey
7. Mini
8. Sharp
Sidebar Settings...

Advertising | Privacy Policy | Terms Of Use | Contact Us

Original banner artwork: Jim Warren
The contents of this webpage are copyright © 2026 TLnet. All Rights Reserved.