Synthesis: The Thermodynamic-Statistical Dictionary
~8 min read · Tier toggle changes depth (T1 plain · T2 standard · T3 rigour)
You should be comfortable with the four thermodynamic potentials and the definition of entropy as a state function. Familiarity with the Boltzmann distribution and the concept of a partition function is assumed.
Why this matters
This lecture unifies the macroscopic laws of thermodynamics with the microscopic counting of states.
Up to this point, we have treated thermodynamics as a set of empirical constraints on macroscopic variables and statistical mechanics as a probabilistic description of microstates. The synthesis of these two frameworks reveals that they are not merely compatible but identical. Every thermodynamic potential is a generating function for statistical averages, and every Maxwell relation is a consequence of the symmetry of mixed partial derivatives of a single statistical quantity, the partition function. This "dictionary" allows us to translate any measurable thermodynamic property into a calculation involving molecular energy levels, and vice versa.
The Bridge Between Worlds
Imagine you have a box of gas. A thermodynamicist describes it using pressure, volume, and temperature. A statistical physicist describes it using the positions and momenta of every atom. These seem like different languages, but they describe the same reality. The key to translating between them is the idea that the macroscopic state is the most probable arrangement of microscopic states. When a system is in equilibrium, it spends most of its time in the macrostate that has the largest number of corresponding microstates. This "most probable" macrostate is what we measure in the lab. The partition function, \( Z \), acts as the bridge. It sums up the statistical weights of all possible microstates. By taking logarithms and derivatives of this single number, we can recover energy, entropy, pressure, and chemical potential. It is a complete dictionary: if you know the energy levels of the molecules, you know the thermodynamics of the gas.
Entropy and Temperature from Counting
The foundation of the dictionary is the identification of entropy with the number of accessible microstates. For an isolated system, the equilibrium state is the one that maximises the total number of microstates \( \Omega \). This leads directly to the Boltzmann entropy formula, which establishes entropy as an additive quantity. This additivity is crucial because it allows us to define a temperature that is consistent across subsystems in thermal contact.
From this definition, we can derive the statistical definition of temperature. By considering two systems exchanging energy, we find that equilibrium occurs when the rate of change of entropy with respect to energy is equal for both systems. This leads to the fundamental relation:
This equation is the statistical counterpart to the thermodynamic definition of temperature. It shows that temperature is not a primitive concept but a measure of how the number of microstates changes as energy is added to the system. A low temperature means that adding a little energy multiplies the number of microstates enormously (\(\partial S/\partial U\) is large); at high temperature the same energy adds relatively few (\(\partial S/\partial U\) is small).
The Partition Function as a Generating Function
For a system in contact with a heat reservoir, the relevant statistical object is the canonical partition function \( Z \). It is defined as the sum of Boltzmann factors over all microstates. The Helmholtz free energy \( F \) is directly related to this sum. This relationship is the central result of the canonical ensemble.
Once \( F \) is known, all other thermodynamic quantities can be obtained by differentiation. The internal energy is the average energy, which can be expressed as a derivative of \( \ln Z \) with respect to \( \beta \). The entropy is the negative derivative of \( F \) with respect to \( T \). This structure is powerful because it reduces the complexity of thermodynamics to the calculation of a single sum. If the energy levels \( E_i \) are known, \( Z \) can be calculated, and the entire thermodynamic behaviour of the system follows.
Maxwell Relations and Symmetry
Thermodynamics provides a set of constraints known as Maxwell relations, which relate different partial derivatives of state variables. These relations arise from the fact that thermodynamic potentials are state functions, meaning their mixed partial derivatives are equal. In statistical mechanics, these relations are automatically satisfied because they are derived from the same partition function. For example, the relation between pressure and temperature can be derived from the Helmholtz free energy.
This relation connects the change in entropy with volume at constant temperature to the change in pressure with temperature at constant volume. In the statistical framework, since \( S = -(\partial F/\partial T)_V \) and \( P = -(\partial F/\partial V)_T \) with \( F = -kT\ln Z \), both sides of this equation are derived from derivatives of \( F(T,V) \). The equality of mixed partials \( \frac{\partial^2 F}{\partial T \partial V} = \frac{\partial^2 F}{\partial V \partial T} \) ensures that the thermodynamic and statistical descriptions are consistent. This symmetry is a profound check on the validity of the statistical mechanical model.
The derivations
The Partition Function and F = -kT ln Z
For a system in thermal contact with a reservoir at temperature T, normalizing the Boltzmann distribution pi ∝ e−βEi over microstates i forces the introduction of the canonical partition function Z = ∑i e−βEi (with β = 1/kT). The Helmholtz free energy is then F = −kT ln Z, and the internal energy, entropy, and every thermodynamic quantity follow as derivatives of ln Z.
Boltzmann Entropy and Statistical Temperature
For an isolated composite of two macroscopic systems exchanging energy at fixed total U = U1 + U2, the equilibrium energy partition is the one that maximises the total number of accessible microstates Ω = Ω1Ω2. Requiring this maximum forces the entropy to take the form S = k ln Ω (additive, monotonic in Ω) and identifies the statistical temperature through 1/T = (∂S/∂U)V,N, reproducing the thermodynamic entropy of the Clausius relation dS = δQ/T.
The Maxwell Relations
Equality of mixed second partials of the potentials yields the four Maxwell relations linking entropy derivatives to measurable mechanical quantities.
A common pitfall is to call the partition function extensive. It is \(\ln Z\), and hence \(F = -kT\ln Z\), that is extensive: for independent subsystems the partition functions multiply, \(Z = Z_A Z_B\), so their logarithms add. For interacting systems \(Z\) does not factorise at all, and additivity of \(\ln Z\) holds only in the thermodynamic limit, when surface and interaction-range effects are negligible; in small systems fluctuations matter and the choice of ensemble becomes physically important. C
Worked example
Problem. Consider a two-level system with ground state energy \( E_0 = 0 \) and excited state energy \( E_1 = \epsilon \). Calculate the Helmholtz free energy \( F \) and the internal energy \( U \) at temperature \( T \). Assume \( k = 1.38 \times 10^{-23} \ \mathrm{J/K} \) and \( \epsilon = 1.0 \times 10^{-20} \ \mathrm{J} \). Find \( U \) at \( T = 300 \ \mathrm{K} \).
- Write the partition function \( Z \). Since there are two states, \( Z = e^{-\beta E_0} + e^{-\beta E_1} = 1 + e^{-\beta \epsilon} \).
- Calculate \( \beta \epsilon \). \( \beta = \frac{1}{kT} = \frac{1}{(1.38 \times 10^{-23})(300)} \approx 2.415 \times 10^{20} \ \mathrm{J^{-1}} \). Thus, \( \beta \epsilon = (2.415 \times 10^{20})(1.0 \times 10^{-20}) = 2.415 \).
- Calculate \( Z \). \( Z = 1 + e^{-2.415} \approx 1 + 0.0893 = 1.0893 \).
- Calculate \( F \). \( F = -kT \ln Z = -(1.38 \times 10^{-23})(300) \ln(1.0893) \approx -(4.14 \times 10^{-21})(0.0855) \approx -3.54 \times 10^{-22} \ \mathrm{J} \).
- Calculate \( U \). \( U = -\frac{\partial \ln Z}{\partial \beta} = \frac{\epsilon e^{-\beta \epsilon}}{1 + e^{-\beta \epsilon}} = \frac{\epsilon}{e^{\beta \epsilon} + 1} \). \( U = \frac{1.0 \times 10^{-20}}{e^{2.415} + 1} \approx \frac{1.0 \times 10^{-20}}{11.19 + 1} \approx \frac{1.0 \times 10^{-20}}{12.19} \approx 8.20 \times 10^{-22} \ \mathrm{J} \).
Units check. \( \epsilon \) is in Joules, \( \beta \) is in \( \mathrm{J^{-1}} \), so \( \beta \epsilon \) is dimensionless. \( U \) is a weighted average of energies, so it has units of Joules. The result is consistent.
Entropy follows from the dictionary as well: \(S = (U - F)/T = (8.20 \times 10^{-22} + 3.54 \times 10^{-22})/300 = 3.91 \times 10^{-24}\ \mathrm{J\,K^{-1}} = 0.283\,k\), between 0 (ground state only) and \(k\ln 2 = 0.693\,k\) (both states equally likely).
Three quick tests
- Why is the partition function \( Z \) necessary for the canonical ensemble?
Answer
It normalizes the Boltzmann distribution and serves as the generating function for thermodynamic potentials like \( F \). - What is the physical meaning of temperature in statistical mechanics?
Answer
It is a measure of the change in entropy with respect to energy, \( 1/T = \partial S / \partial U \). - How do Maxwell relations arise in statistical mechanics?
Answer
They are consequences of the equality of mixed partial derivatives of the thermodynamic potentials, which are derived from the partition function.
Problem set for PU-203 →
Each derivation in this unit ends with five graded problems with full solutions.
Lecture notes checked line by line by the editor; every number in the worked example was recomputed.
Derivations cited: D-156 · D-155 · D-016 · Threads: energy, matter, chance