Physics › Section J · Thermodynamics › Topic J.6

Entropy and its statistical meaning

Ice melts in a warm drink, but a lukewarm drink never sorts itself into ice and hot liquid. Entropy is the quantity that captures this one-way behaviour, and counting the microscopic arrangements of a system shows why it almost always increases.

A new quantity for the second law

The second law has appeared so far as statements about heat flow and engines. It can also be written in terms of a single quantity, entropy, symbol \(S\). Like internal energy, entropy is a property of a system's state. Unlike energy, it is not conserved: in real processes the total entropy goes up. This version of the law covers every spontaneous process, from ice melting to perfume spreading through a room, and it rests on probability.

Defining a change in entropy

For a Carnot engine, \(Q_c/Q_h = T_c/T_h\), which can be rearranged to \(Q_h/T_h = Q_c/T_c\). The ratio of heat to temperature balances, and that ratio defines the entropy change. When heat \(Q\) is transferred reversibly to a system at a constant kelvin temperature \(T\),

\Delta S = \frac{Q}{T}

\(Q\) is positive for heat in and negative for heat out, so entropy rises when a system gains heat. The SI unit is the joule per kelvin, J/K. The same heat changes entropy more at a low temperature than at a high one. If \(T\) changes slightly during the transfer, the average temperature gives a good estimate.

Worked example: melting ice

Find the entropy change when 0.500 kg of ice melts at 0 °C. The latent heat of fusion of water is \(3.34 \times 10^5\) J/kg. 1. Heat needed:

Q = mL_f = (0.500)(3.34 \times 10^5) = 1.67 \times 10^5\ \text{J}

flowing in. 2. Melting happens at a fixed 273.15 K, so

\Delta S = \frac{1.67 \times 10^5\ \text{J}}{273.15\ \text{K}} = 611\ \text{J/K}

3. Check: the sign is positive, since heat flows in. The molecules leave fixed places in a crystal and move past one another, and a liquid can be arranged in far more ways than a solid.

Entropy is a state function

The formula \(\Delta S = Q/T\) holds only for reversible transfers, but real processes are irreversible. The way round this is that entropy, like \(U\), is a state function, so its change between two states is the same by any route. For a real process, imagine a reversible one linking the same start and end states and use that. For two large reservoirs exchanging heat, the reservoirs end up the same whether the heat flowed quickly or reversibly, so \(Q/T\) for each reservoir gives its true entropy change.

Worked example: heat flowing downhill

2400 J of heat flows directly from a reservoir at 480 K to one at 320 K. Find the total entropy change. 1. Hot reservoir, heat out: \(\Delta S_h = -2400/480 = -5.00\) J/K. 2. Cold reservoir, heat in: \(\Delta S_c = +2400/320 = +7.50\) J/K. 3. Total: \(\Delta S = -5.00 + 7.50 = +2.50\) J/K. 4. Check: the cold reservoir gains more entropy than the hot one loses because it is at a lower temperature, so the total must rise. Reversing the flow would make the total \(-2.50\) J/K, which is why heat never flows from cold to hot on its own.

The second law in entropy form

The total entropy of an isolated system never decreases: it stays constant in a reversible process and increases in every irreversible one. For a Carnot engine and its reservoirs over a cycle, the hot reservoir loses \(Q_h/T_h\) and the cold one gains the equal amount \(Q_c/T_c\), so the total change is zero. The entropy of one part can fall, provided the rest gains more. Water freezing in a freezer loses entropy, but the room gains more from the heat released at the back. Living things build ordered structures too, powered by sunlight, while the heat Earth radiates to cold space raises the entropy of the surroundings far more.

Entropy and energy that can no longer do work

When entropy rises, some energy becomes useless for work. Take the 2400 J above, with the coldest available reservoir at 200 K. Used directly from 480 K, a Carnot engine could turn \(2400(1 - 200/480) = 1400\) J into work. After flowing to 320 K first, it can give only \(2400(1 - 200/320) = 900\) J. The 500 J lost equals \(T_0 \Delta S\), where \(T_0 = 200\) K is the lowest temperature available: \(200 \times 2.50 = 500\) J. The energy still exists, but it can never again do that work. On the largest scale, as the universe expands and its stars burn out, temperature differences should fade towards a cold, uniform state with no usable energy, a far-future end known as heat death.

Worked example: counting coin arrangements

Toss six coins. A macrostate describes the overall result, such as "3 heads"; a microstate specifies every coin, such as HHTHTT. 1. There are \(2^6 = 64\) equally likely microstates. 2. Counting arrangements gives 1, 6, 15, 20, 15, 6 and 1 microstates for 0 to 6 heads. 3. So 3 heads has 20 microstates, a probability of \(20/64 = 31.3\%\), while 6 heads has just 1, a probability of \(1/64 = 1.6\%\). 4. Check: \(1 + 6 + 15 + 20 + 15 + 6 + 1 = 64\). Start with all heads, toss again, and you almost certainly get a mixed result, because mixed macrostates own most of the microstates.

Why the second law is about probability

With more particles, the odds become overwhelming. Put \(N\) gas molecules in a box and ask how likely it is that all of them are in the left half at one instant. Each has a chance of 1/2, so the probability is \((1/2)^N\). For 10 molecules it is about 1 in 1000; for 100 it is about \(8 \times 10^{-31}\); for the roughly \(10^{22}\) molecules in a few hundred cubic centimetres of air, it is unimaginably small. Nothing forbids a gas from bunching up, but evenly spread macrostates have vastly more microstates. The second law states what is overwhelmingly probable, which for large systems is as reliable as certainty, and it gives time its direction.

Boltzmann's formula

Ludwig Boltzmann linked entropy to the number of microstates \(W\) for a macrostate (here \(W\) is a count, not work):

S = k_B \ln W

where \(k_B = 1.381 \times 10^{-23}\) J/K is Boltzmann's constant. More microstates mean more entropy. Let a gas expand freely into a vacuum, doubling its volume. Each molecule has twice as many places to be, so \(W\) is multiplied by \(2^N\) and \(\Delta S = Nk_B \ln 2\). For one mole, \(N k_B = R\), so \(\Delta S = (8.314)(\ln 2) = 5.76\) J/K, although no heat flowed; the expansion is irreversible, so \(Q/T\) does not apply to it. "Disorder" is a loose name for this: high entropy means more possible arrangements.

Common mistakes to avoid

First, using Celsius in \(\Delta S = Q/T\); melting ice is at 273.15 K, not 0. Second, losing the sign: heat out of a system lowers its entropy. Third, applying \(Q/T\) to an irreversible process directly; use a reversible path between the same states, as for a free expansion, where \(Q = 0\) yet \(\Delta S > 0\). Fourth, claiming entropy can never decrease anywhere; only the total for an isolated system cannot. Fifth, thinking the second law is broken by a fridge or a living cell; their surroundings gain more entropy.

Key takeaways

For heat Q transferred reversibly at kelvin temperature T, ΔS = Q/T, in J/K. Entropy is a state function, so real processes are handled with a reversible path between the same states. The total entropy of an isolated system stays constant in reversible processes and increases in irreversible ones; local decreases need larger increases elsewhere. An entropy rise makes energy unavailable for work, by T₀ΔS. Statistically, S = k_B ln W: high-entropy macrostates have vastly more microstates, so systems move towards them with near certainty, giving time its direction.

Flashcards

Flashcard

Entropy, S

A state function whose total rises in every irreversible process

Unit: J/K.

Test your understanding

Question 1 of 5

0.200 kg of ice melts at 0 °C (L_f = 3.34 × 10⁵ J/kg). What is its entropy change?

Question 2 of 5

1200 J of heat flows directly from a reservoir at 400 K to a reservoir at 300 K. What is the total entropy change of the two reservoirs?

Question 3 of 5

Which of these entropy decreases is allowed by the second law?

Question 4 of 5

Four fair coins are tossed. What is the probability of exactly 2 heads and 2 tails?

Question 5 of 5

1.00 mol of an ideal gas expands freely into a vacuum, doubling its volume. No heat flows. What is its entropy change?

← Previous topicNext topic →