Fluctuation Formula for Heat Capacity

Introduction

Heat capacity is often introduced as the slope of mean internal energy against temperature. In a canonical ensemble it can also be found from the spread of energies at one temperature. This is useful in molecular simulation and conceptually important near phase changes, where large energy fluctuations signal a strong thermal response. The formula is exact under specified conditions, but using it from finite data requires care.

Core explanation

For fixed V and N with temperature-independent energy levels, Q(β) = Σ j e^(−βE j) and β = 1/(kT). Its first log derivative gives U = −∂ln Q/∂β. A second derivative gives ∂²ln Q/∂β² = ⟨E²⟩ − ⟨E⟩² = Var(E). Since dβ/dT = −1/(kT²), differentiating U with T yields C V = Var(E)/(kT²). This relates a response to temperature to spontaneous equilibrium fluctuations of E at that temperature.

The identity implies C V ≥ 0 for this simple canonical system because a variance cannot be negative. It does not mean every measured heat capacity under every constraint must be interpreted with this exact formula. Constant-pressure heat capacity belongs to different natural fluctuations, and systems with temperature-dependent effective Hamiltonians need extra derivative terms. A simulation using an approximate potential must also be evaluated against that potential's own statistical ensemble.

Numerical estimation uses a trajectory of equilibrium energies E₁, E₂, … . Compute sample averages of E and E², subtract to estimate variance, and divide by kT². However, consecutive simulation frames are often correlated. Ten thousand adjacent frames are not ten thousand independent samples if energy relaxes slowly. Block averaging or an autocorrelation-time estimate can assess uncertainty. Near a phase transition, a trajectory may remain trapped in one phase, missing rare transitions and underestimating the true energy spread.

For N weakly correlated particles, Var(E) typically grows with N, so total C V is extensive. The relative energy fluctuation falls with size as discussed earlier. A sharp finite-system heat-capacity peak can reflect substantial changes in accessible states or phase-like switching, but a peak alone is not proof of a true singular transition in the thermodynamic limit.

Step-by-step reasoning

Verify canonical T,V,N conditions and a fixed Hamiltonian. Obtain energies sampled from equilibrium, calculate ⟨E⟩ and ⟨E²⟩, and form their nonnegative difference. Divide by kT² using per-particle k if E is total system energy in joules. Compare with a derivative-based estimate if possible and evaluate sampling correlation and phase-space coverage before claiming precision.

Visual explanation

Draw two histograms of sampled energy at the same T. A narrow histogram has small variance and C V; a broad histogram has larger variance and C V. Mark mean and one standard deviation on each. Add a timeline with long correlated clusters to show why closely spaced simulation samples do not automatically provide independent evidence.

Real-world analogy

An object that responds strongly to a small temperature change may explore a wider range of energetic configurations even while temperature is held fixed. Think of a flexible spring whose position varies more when it is easy to move. The analogy illustrates response and fluctuation, while the exact heat-capacity relation comes from differentiating Boltzmann probabilities.

Real-world example

Canonical Monte Carlo simulations can estimate a model crystal's heat capacity from energy fluctuations at one temperature. If the sample alternates between two structural states, the energy histogram may become broad or bimodal and the estimated C V can peak. Long sampling is needed so both states are visited in the correct proportions.

Why?

Increasing temperature changes the Boltzmann weights. High-energy states gain relative probability; how strongly the mean energy shifts depends on how far energies are spread about the current mean. The algebra of Q makes this dependence exactly the variance divided by kT². It is a precise version of the intuition that more accessible energy variation permits more heat uptake.

Common misconception

Subtracting ⟨E⟩² from ⟨E²⟩ is not optional; using ⟨E²⟩ alone makes the result depend on the arbitrary energy zero. Another error is to treat a noisy finite sample's tiny negative numerical variance as physical; a true variance is nonnegative, and cancellation or sampling errors need correction. Correlated frames do not provide independent uncertainty estimates.

Worked example

Suppose a small canonical model at T = 300 K has mean energy ⟨E⟩ = 4.0 × 10⁻²⁰ J and ⟨E²⟩ = 2.0 × 10⁻³⁹ J². Then Var(E) = 2.0 × 10⁻³⁹ − (4.0 × 10⁻²⁰)² = 4.0 × 10⁻⁴⁰ J². With kT² = (1.381 × 10⁻²³)(300²) ≈ 1.243 × 10⁻¹⁸ J K, C V ≈ 3.22 × 10⁻²² J K⁻¹. The squared-mean subtraction is essential to the result.

Quick check

1. If every sampled energy is shifted upward by 10 J, should a correct variance-based C V change? Answer: No. Shifting all energies and their mean by the same constant leaves every deviation E − ⟨E⟩ unchanged, so variance and C V are unchanged.

Exam focus

State fixed T,V,N and temperature-independent energy levels. Write Var(E) = ⟨E²⟩ − ⟨E⟩² before substituting. Check units: J² divided by J K gives J K⁻¹. In simulations, describe equilibration and correlation rather than reporting many decimal places from short trajectories.

Advanced insight

Other fluctuations generate other susceptibilities. In the grand canonical ensemble, number variance relates to ∂⟨N⟩/∂μ, and density fluctuations relate to compressibility. These relations become especially informative near critical points, where correlated fluctuations can extend over long distances and finite-size effects grow.

Summary

Canonical C V equals Var(E)/(kT²) for fixed V,N and a temperature-independent Hamiltonian. The formula ties heat-capacity response to equilibrium energy fluctuations and is useful in simulation. Reliable numerical use requires adequate equilibration, decorrelated sampling and care near phase changes.

Practice questions

1. A canonical system's energy standard deviation doubles at unchanged T. How does C V change? Answer: Variance is the square of standard deviation, so it quadruples. Since kT² is unchanged, C V quadruples. 2. Why is a variance formula preferable to ⟨E²⟩ alone for heat capacity? Answer: Variance is independent of the arbitrary energy zero and measures fluctuations about the mean. ⟨E²⟩ alone includes the mean's squared value and can change under a constant energy shift. 3. A simulation samples only one of two metastable phases near coexistence. What bias may result? Answer: It may miss between-phase energy variation and underestimate the equilibrium variance and heat-capacity peak. Longer or enhanced sampling may be needed.