Multivariable calculus
Partial Derivatives of ln(e^x + e^y)
For f(x, y) = ln(e^x + e^y), the partial with respect to x is e^x/(e^x + e^y) and the partial with respect to y is e^y/(e^x + e^y). Both lie strictly between 0 and 1 and they add to exactly 1, so the function increases in every coordinate direction.
One logarithm, one frozen exponential
Set and use . When moves, is a constant with derivative , so and only the first term survives in the numerator.
At both partials are and the height is . At they are and : the larger input takes the larger share of the slope.
The mistake: turning a log of a sum into a sum of logs
- is not . That would be , a product rather than a sum, and it would make both partials equal .
- Writing differentiates as though moved too. Only belongs in the numerator of the partial.
There is a clean check on the diagonal. Since , the function reduces to , a plane of slope along that line. The two partials there are each, and they add to the you see.
Why the two partials add to one
The sum is at every point, so the two slopes are weights that trade against each other. When one input dominates, its weight runs to and the other to : at the partial is already about .
That is the sense in which this log-sum-exp function is a smooth maximum. It stays between and , and its partials switch smoothly between and instead of jumping the way the slopes of do along . Neither partial is ever zero, so the surface has no critical point.
Frequently asked questions
Why is ln(e^x + e^y) called a smooth maximum?
Because it never differs from max(x, y) by more than ln 2, about 0.693, and its partials move continuously from 0 to 1 as the two inputs trade places, where max(x, y) has a crease along the line y = x.
Is either partial ever zero?
No. Both exponentials are positive, so each partial lies strictly between 0 and 1. The gradient is never the zero vector, which means this function has no critical points anywhere.