443
From Mathsoc wiki
Ma443 Statistical Physics
Lecturer: Dr. Stefan Sint
Website: Link
Derivation of canonical and grand canonical ensembles from maximising information entropy
Canonical ensemble
This is the ensemble for a system in contact with a heat bath, the constraints are
In what follows we will put
for brevity. The information entropy in this continuous case can be defined by
and we maximise it using Lagrange multipliers
and
, that is we seek to maximise
Differentiating with respect to
and setting the result equal to zero we find
where
, or, using the first constraint, we see that
This is known as the partition function.
Substituting for our probability into
we have
giving
Identifying the energy
with the internal energy
of thermodynamics, and comparing with the expression
, we see that we must have
Grand canonical ensemble - not quite correct
This is the ensemble for a system in contact with a heat and particle bath, the constraints are
Notice that this claims that particle number is continuous, which is wrong. I should fix this sometime.
We now wish to maximise
Differentiating with respect to
and setting the result equal to zero we find
where
, or, using the first constraint as before,
Subbing into the entropy for
gives
so
which can be rewritten, identifying
,
Recalling that
where
is the chemical potential, we see that we must have
and also
with
Possibly useful references
- Thermodynamics and Statistical Mechanics, Greiner (very good, clear book)
- James Binney's lecture notes
- Statistical Mechanics, Huang
- Elements of Statistical Mechanics, Sachs, Sexton, Sen
- SklogWiki

