Biological Physics/Stirling's Approximation

Calculating entropy directly calls for us to calculate factorials. Taking factorials of relatively small numbers is not a problem (at least with a computer). However, once you begin to work in systems that have a very large number of particles and energy packets (on the order of a mole, or $10^{23}$), it becomes clear that a direct calculation for factorials is not feasible. Rather, an approximation for the entropy must be developed. We will look more closely at what is known as Stirling's Approximation.

Recall that the multiplicity Ω for ideal solids is $\mathrm{\Omega }=\frac{(N+n-1)!}{n!(N-1)!}$
and entropy is
$S=k_B\mathrm{l}\mathrm{n}(\mathrm{\Omega })$.
$S=k_B\mathrm{l}\mathrm{n}(\frac{(N+n-1)!}{n!(N-1)!})$.
By the rules of logarithms,
$\frac{S}{k_B}=[\mathrm{l}\mathrm{n}(N+n-1)!-\mathrm{l}\mathrm{n}(n!)-\mathrm{l}\mathrm{n}(N-1)!]$.

All terms are essentially logarithms of factorials, so let's study the general case.

The integral of the natural log is approximately equal to the sum of the natural log over all integers when the included integers spans a large range, i.e., Avogadro's number.

$\mathrm{l}\mathrm{n}(x!)=\mathrm{l}\mathrm{n}((x)(x-1)(x-2)(x-3)...(2)(1))$,
which implies by the rules of logarithms $\mathrm{l}\mathrm{n}(x!)=\mathrm{l}\mathrm{n}(x)+\mathrm{l}\mathrm{n}(x-1)+\mathrm{l}\mathrm{n}(x-2)+...+\mathrm{l}\mathrm{n}(2)+\mathrm{l}\mathrm{n}(1)$, or
$\mathrm{l}\mathrm{n}(x!)=\sum _{i=0}^x\mathrm{l}\mathrm{n}(i)$.
For very large values (think on the order of magnitude of moles), this can be approximated by
$\mathrm{l}\mathrm{n}(x!)\approx \underset{1}{\overset{x}{\int }}\mathrm{l}\mathrm{n}(i)di$, which has a solution $\underset{1}{\overset{x}{\int }}\mathrm{l}\mathrm{n}(i)di=i\mathrm{l}\mathrm{n}(i)-i{|}_1^x$.
And by the fundamental theorem of calculus, $\mathrm{l}\mathrm{n}(x!)\approx x\mathrm{l}\mathrm{n}(x)-x+1$. For very large numbers, the 1 becomes negligible, so $\mathrm{l}\mathrm{n}(x!)\approx x\mathrm{l}\mathrm{n}(x)-x$. So this gives us the following approximations

$\mathrm{l}\mathrm{n}(N+n-1)\approx (N+n-1)\mathrm{l}\mathrm{n}(N+n-1)-(N+n-1)$

$\mathrm{l}\mathrm{n}(x!)\approx n\mathrm{l}\mathrm{n}(n)-n$

$\mathrm{l}\mathrm{n}(N-1)\approx (N-1)\mathrm{l}\mathrm{n}(N-1)-(N-1)$

So $(N+n-1)\mathrm{l}\mathrm{n}(N+n-1)-\mathrm{l}\mathrm{n}(n)-\mathrm{l}\mathrm{n}(N-1)\approx (N+n-1)\mathrm{l}\mathrm{n}(N+n-1)-(N+n-1)-n\mathrm{l}\mathrm{n}(n)+n-(N-1)\mathrm{l}\mathrm{n}(N-1)+(N-1)$.

With some simplification,
$(N+n-1)\mathrm{l}\mathrm{n}(N+n-1)-n\mathrm{l}\mathrm{n}(n)-(N-1)\mathrm{l}\mathrm{n}(N-1)$

Once again, let's make the assumption that these numbers are very large, making 1 negligible. So $(N+n)\mathrm{l}\mathrm{n}(N+n)-n\mathrm{l}\mathrm{n}(n)-(N)\mathrm{l}\mathrm{n}(N)$

Therefore, entropy can be approximated with $S=k_B[(N+n)\mathrm{l}\mathrm{n}(N+n)-n\mathrm{l}\mathrm{n}(n)-(N-1)\mathrm{l}\mathrm{n}(N-1)]$. This is Stirling's Approximation. If you recall that numbers out in front of a logarithm can be written as the power of the number inside the logarithm, so $S=k_B[\mathrm{l}\mathrm{n}((N+n{)}^{(N+n)})-\mathrm{l}\mathrm{n}(n^n)-\mathrm{l}\mathrm{n}(N^N)]$, or $S=k_B\mathrm{l}\mathrm{n}[\frac{(N+n{)}^{(N+n)}}{(n^n)(N^N)}]$. For calculations, the first equation would be better since it doesn't exponentiate before it takes a logarithm. Template:Autonav Template:BookCat