Microstates and Boltzmann Entropy

Introduction

Boltzmann's relation S = k B ln Ω connects entropy with the number of microscopic arrangements compatible with a macroscopic state, when those microstates are equally probable. It explains why entropy is additive for independent systems even though the number of combined arrangements multiplies.

Core explanation

Imagine a macrostate described only by a few bulk quantities. Ω counts the microscopic states compatible with those quantities under specified constraints. If all counted microstates are equally probable, Boltzmann's formula gives S = k B ln Ω, where k B ≈ 1.381 × 10⁻²³ J K⁻¹. A larger Ω gives a larger S because the natural logarithm increases with its argument. Ω itself is dimensionless, so taking its logarithm is mathematically appropriate.

Suppose two independent systems have multiplicities Ω A and Ω B. Each state of A can be paired with each state of B, so the combined multiplicity is Ω AΩ B. Then S total = k B ln(Ω AΩ B) = k B ln Ω A + k B ln Ω B = S A + S B. This logarithmic property matches entropy's additivity for independent subsystems. A simple direct count without the logarithm would multiply rather than add.

The multiplicity ratio determines an entropy difference: ΔS = k B ln(Ω f/Ω i) for equal-probability models under comparable constraints. If final multiplicity is twice initial, ΔS = k B ln 2. If it is ten times initial, ΔS = k B ln 10. The numerical change per one particle is tiny because k B is tiny, but a macroscopic mole contains an enormous number of particles, so molar entropy changes can be measured in J mol⁻¹ K⁻¹. The gas constant R = N A k B connects molecular and molar scales.

An illustrative energy-sharing model has several energy quanta distributed among several particles or oscillators. There are usually more arrangements when energy is spread over many recipients than when all quanta sit in one place. Random exchanges therefore overwhelmingly favor high-multiplicity macrostates. “Overwhelmingly” matters: microscopic reversals are not logically impossible, but for astronomical particle counts they are extraordinarily improbable on ordinary observation timescales.

The equal-probability formula has limits. In general, microstates need not be equally probable. Statistical entropy then uses a probability-weighted expression S = −k BΣp i ln p i under appropriate conditions. The simple Boltzmann expression is a special case when p i = 1/Ω for each accessible microstate. Introductory examples usually choose that case deliberately.

Multiplicities must be counted for well-defined constraints, such as fixed energy, volume and particle number in a suitable model. Arbitrarily changing what counts as a microstate can change Ω and make comparisons meaningless. A school coin or box analogy is useful for understanding the logarithm, but actual molecular microstates include quantum energy levels and particle indistinguishability.

The relation does not say that every change with more visually scattered particles is spontaneous in isolation. Entropy of the total isolated system governs direction. Energy changes and thermal reservoirs affect which combined macrostates are accessible.

Step-by-step reasoning

1. Define the macrostate and constraints used to count Ω. 2. Confirm the equally probable microstate assumption. 3. Calculate S = k B ln Ω or ΔS = k B ln(Ω f/Ω i). 4. Use logarithm rules to combine independent systems. 5. Interpret larger multiplicity as higher entropy without equating it to visual messiness.

Visual explanation

Draw four possible labeled arrangements of two energy tokens across two boxes, then another state with more possible placements. Put Ω counts beneath each macrostate. A side panel shows Ω A × Ω B turning into S A + S B through a logarithm.

Real-world analogy

Two independent choices with three and four options create twelve paired outcomes. Counting outcomes multiplies, while the logarithm of twelve equals the sum of logarithms of three and four. This is why entropy can be additive even when microscopic possibilities multiply.

Real-world example

A dilute gas spreading through a larger container has vastly more position arrangements available to its molecules. The multiplicity ratio becomes enormous for many particles, making the spread macrostate overwhelmingly favored in the absence of constraints that counteract it.

Why?

Why is the logarithm used instead of S proportional directly to Ω? Independent systems have multiplied multiplicities but added macroscopic entropies; ln converts multiplication into addition.

Common misconception

“Boltzmann entropy counts only the different places molecules can stand.” Microstates include relevant positions, momenta and quantum energy occupations under defined constraints. Spatial boxes are a simplified teaching model.

Worked example

Suppose an idealized equally probable macrostate changes from Ω i = 100 to Ω f = 400. The entropy change is ΔS = k B ln(400/100) = k B ln 4 ≈ (1.381 × 10⁻²³)(1.386) ≈ 1.91 × 10⁻²³ J K⁻¹ for the modeled microscopic system. The positive sign follows the fourfold multiplicity increase. Do not report this as a molar value without scaling and a suitable molecular model.

Quick check

1. If Ω doubles, by how much does S change under the simple model? Answer: ΔS = k B ln 2, a positive increment.

Exam focus

State the equal-probability assumption and distinguish k B from the molar gas constant R. Use a ratio inside the logarithm for entropy differences and keep Ω dimensionless.

Advanced insight

For unequal microstate probabilities, S = −k BΣp i ln p i reduces to k B ln Ω when all Ω microstates have probability 1/Ω. This broader expression connects statistical thermodynamics with information-like measures, while physical entropy still depends on the defined thermodynamic ensemble and constraints.

Summary

Boltzmann entropy links S to the logarithm of equally probable microstate multiplicity. Greater multiplicity increases S, and the logarithm makes independent systems' entropies additive. Real molecular counting requires carefully defined states and may use probability weighting.

Practice questions

1. If Ω f/Ω i = 3, express ΔS. Answer: ΔS = k B ln 3 for the stated equally probable model. 2. If independent systems have Ω A = 5 and Ω B = 7, what is their combined multiplicity? Answer: 35, because each A state can pair with each B state. 3. Why is R useful when moving from molecular to molar entropy scales? Answer: R = N Ak B, linking per-microstate entropy scale to one mole of particles.