The Density Matrix and von Neumann Equation
Statement
For a quantum system whose state is known only statistically — a mixed state realised as an ensemble \(\{p_i,\,|\psi_i\rangle\}\) with \(p_i\ge 0\) and \(\sum_i p_i = 1\) — the density operator \(\hat{\rho}=\sum_i p_i\,|\psi_i\rangle\langle\psi_i|\) encodes all measurable information. We prove that \(\hat{\rho}\) is Hermitian, positive semi-definite, and of unit trace; that under unitary Schrödinger evolution it obeys the von Neumann equation \(i\hbar\,\partial_t\hat{\rho}=[\hat{H},\hat{\rho}]\); and that the state of a subsystem \(A\) of a composite \(\mathcal{H}_A\otimes\mathcal{H}_B\) is the reduced density matrix \(\hat{\rho}_A=\operatorname{Tr}_B\hat{\rho}\), the unique operator reproducing every local expectation value.
Why it matters
A single ket \(|\psi\rangle\) describes only a pure state — maximal knowledge. The moment a system entangles with anything we do not track (a measuring apparatus, a thermal bath, a partner particle sent to a distant lab), no ket describes it, yet it still has definite statistics. The density matrix is the object that survives this loss of information: it is the true state space of quantum mechanics, of which pure states are merely the extreme points.
It is also the language in which quantum statistical mechanics, decoherence, open-system dynamics, and quantum information are actually written. The thermal state \(\hat{\rho}\propto e^{-\beta\hat{H}}\), the qubit Bloch ball, entanglement entropy, and the Lindblad master equation all begin here. On the chance thread it is where classical probability and quantum amplitude coexist; on the matter thread it is how a piece of the world behaves once the rest is traced away.
Assumptions
Derivation
Result
Reading. The density operator is the state of any quantum system for which we lack a wavefunction. Its three defining properties — Hermitian, positive, unit trace — encode "these are genuine probabilities." Expectation values are traces against it; it evolves by the commutator with \(\hat{H}\) (the operator analogue of the classical Liouville equation, with an extra minus sign relative to Heisenberg observables); and the accessible state of a part of a larger system is obtained by tracing out the rest. Purity is measured by \(\operatorname{Tr}\hat{\rho}^2\le 1\), with equality iff the state is pure.
Units check. \(|\psi_i\rangle\langle\psi_i|\) and the \(p_i\) are dimensionless, so \(\hat{\rho}\) and \(\operatorname{Tr}(\hat{\rho}\hat{A})\) carry the dimensions of \(\hat{A}\) alone — correct. In the von Neumann equation \([\hat{H},\hat{\rho}]\) has units of energy and \(i\hbar\,\partial_t\hat{\rho}\) has units of (J·s)(1/s) = J, so both sides are energies. \(\hat{\rho}_A\) remains dimensionless with \(\operatorname{Tr}_A\hat{\rho}_A=1\).
Limiting cases
- Pure state: one \(p_i=1\), so \(\hat{\rho}=|\psi\rangle\langle\psi|\) is a rank-one projector with \(\hat{\rho}^2=\hat{\rho}\) and \(\operatorname{Tr}\hat{\rho}^2=1\); the von Neumann equation reduces to the Schrödinger equation.
- Maximally mixed: \(\hat{\rho}=\hat{\mathbf 1}/d\) in \(d\) dimensions gives \([\hat{H},\hat{\rho}]=0\) — a stationary state of total ignorance, \(\operatorname{Tr}\hat{\rho}^2=1/d\).
- Product state: \(\hat{\rho}=\hat{\rho}_A\otimes\hat{\rho}_B\) (no correlations) yields \(\operatorname{Tr}_B\hat{\rho}=\hat{\rho}_A\) exactly, with no loss of purity on tracing.
- Thermal equilibrium: \(\hat{\rho}=e^{-\beta\hat{H}}/Z\) commutes with \(\hat{H}\), hence \(\partial_t\hat{\rho}=0\); the diagonal weights are Boltzmann factors.
- Energy eigenbasis: if \([\hat{\rho},\hat{H}]=0\) the populations \(\rho_{nn}\) are constant while coherences oscillate as \(\rho_{mn}(t)=\rho_{mn}(0)e^{-i(E_m-E_n)t/\hbar}\).
Breaks when
- Open systems / decoherence. When the system exchanges information with an unmonitored environment, its reduced dynamics are non-unitary: \(i\hbar\,\partial_t\hat{\rho}=[\hat{H},\hat{\rho}]\) is replaced by a Lindblad master equation with dissipator terms, and \(\operatorname{Tr}\hat{\rho}^2\) decreases. The von Neumann equation holds only for the closed total system.
- No tensor factorisation. For identical particles the physical Hilbert space is (anti)symmetrised, not a clean \(\mathcal{H}_A\otimes\mathcal{H}_B\); "trace out particle 2" is ambiguous and \(\hat{\rho}_A\) is not uniquely defined without specifying a mode/orbital partition.
- Non-Hermitian or time-dependent effective Hamiltonians. Effective \(\hat{H}\) with complex eigenvalues (e.g. modelling decay) break trace preservation; the naive commutator equation then leaks probability and must be handled with care.
- Explicit measurement/collapse. A projective measurement updates \(\hat{\rho}\mapsto \sum_k \hat{P}_k\hat{\rho}\hat{P}_k\) (or a conditioned single \(\hat{P}_k\hat{\rho}\hat{P}_k/p_k\)); this discontinuous, non-unitary jump is not generated by any \([\hat{H},\hat{\rho}]\).
Failure modes
- Confusing a mixture with a superposition. \(\tfrac12(|0\rangle\langle0|+|1\rangle\langle1|)\) (diagonal, no coherences) is not the state \(|{+}\rangle\langle{+}|\) with \(|{+}\rangle=\tfrac{1}{\sqrt2}(|0\rangle+|1\rangle)\) (off-diagonal terms present). They give different statistics for \(\hat{\sigma}_x\).
- Sign error in the equation of motion. Writing \(i\hbar\,\partial_t\hat{\rho}=[\hat{\rho},\hat{H}]\) flips the sign; the density matrix is not an observable, so it does not obey the Heisenberg equation \(i\hbar\,\dot{\hat A}=[\hat A,\hat H]\).
- Tracing the wrong factor. Computing \(\operatorname{Tr}_A\) when the subsystem of interest is \(A\) — you must trace out the complement \(B\).
- Assuming \(\hat{\rho}_A\) is pure because \(\hat{\rho}_{AB}\) is. For an entangled pure total state the reduced state is generically mixed; \(\operatorname{Tr}\hat{\rho}_A^2<1\) is the signature of entanglement.
- Treating off-diagonal elements as probabilities. Only the diagonal \(\rho_{nn}\ge0\) are populations; the coherences \(\rho_{mn}\) are complex and constrained by positivity \(|\rho_{mn}|^2\le\rho_{mm}\rho_{nn}\).
- Forgetting basis-dependence of "diagonal." Whether a state looks mixed-diagonal depends on basis; purity \(\operatorname{Tr}\hat{\rho}^2\) is the basis-independent invariant.
Discussion
The density matrix resolves a genuine conceptual gap: standard quantum mechanics assigns a ket to a system, but a subsystem of an entangled pair has no ket, and neither does a system whose preparation involved a classical coin flip. Both situations produce the same kind of object — a positive, unit-trace operator — yet they are physically different. "Proper" mixtures arise from classical ignorance about which \(|\psi_i\rangle\) was prepared; "improper" mixtures arise from entanglement with an inaccessible partner. Crucially, no local experiment can tell them apart, which is exactly why \(\hat{\rho}\) — not the ensemble list — is the physical state.
The von Neumann equation sits in a precise analogy with classical statistical mechanics. The classical phase-space density obeys the Liouville equation \(\partial_t f=\{H,f\}\) with the Poisson bracket; quantisation \(\{\,,\,\}\to \frac{1}{i\hbar}[\,,\,]\) turns this into \(\partial_t\hat{\rho}=\frac{1}{i\hbar}[\hat{H},\hat{\rho}]\). Both say the same thing: a distribution flows rigidly along the trajectories generated by \(H\), so its "shape" (entropy, eigenvalue spectrum) is conserved under closed evolution. Von Neumann entropy \(S=-\operatorname{Tr}(\hat{\rho}\ln\hat{\rho})\) is therefore constant in time for a closed system — irreversibility must come from coarse-graining or from tracing out an environment, never from the unitary dynamics itself.
The partial trace is where the arrow of decoherence enters. Take an entangled pure state \(|\Psi\rangle=\sum_k c_k|a_k\rangle|b_k\rangle\) (its Schmidt form); then \(\hat{\rho}_A=\sum_k|c_k|^2|a_k\rangle\langle a_k|\) is diagonal and mixed. The information that made the total state pure lives entirely in the \(A\)–\(B\) correlations, which the local observer cannot see. Decoherence is precisely this process running dynamically: as a system entangles with ever more environmental degrees of freedom, its reduced state loses coherences in the pointer basis and comes to look classical — without any collapse postulate, purely from unitary evolution of the whole plus a partial trace.
At the deepest level the density matrix is what makes quantum mechanics a probabilistic theory with a well-defined state space. Gleason's theorem shows that on a Hilbert space of dimension \(\ge3\), any consistent probability assignment to measurement outcomes is given by \(p=\operatorname{Tr}(\hat{\rho}\hat{P})\) for some density operator — the Born rule and the density matrix are forced, not postulated. The set of density operators is convex, with pure states as its extreme points; mixed states are the interior. This convex geometry is the arena of quantum information: entanglement measures, channel capacities, and the distinguishability of states are all statements about distances and boundaries in the space of \(\hat{\rho}\). Common misconceptions: that \(\hat{\rho}\) is "just a bookkeeping device for classical uncertainty" — it also captures irreducibly quantum coherence; that a diagonal \(\hat{\rho}\) is always classical — diagonality is basis-dependent; and that the reduced state's mixedness reflects our ignorance — for an entangled pure state it is objective and observer-independent.
Worked examples
Reading. Both states are "half up, half down" for a \(\hat{S}_z\) measurement, but only the coherent superposition points along \(+x\). The off-diagonal elements of \(\hat{\rho}\) are physically real, measurable quantities — not bookkeeping.
Reading. A local observer of one Bell qubit sees perfect randomness with no preferred axis. All correlations that made \(|\Phi^{+}\rangle\) pure are stored non-locally in the \(A\)–\(B\) link, invisible to either party alone. This is the operational content of "entanglement."
Problems
- Show that for any density operator \(\operatorname{Tr}\hat{\rho}^2\le 1\), with equality if and only if \(\hat{\rho}\) is pure.
Solution
Diagonalise \(\hat{\rho}=\sum_k \lambda_k|k\rangle\langle k|\) with \(\lambda_k\ge0\), \(\sum_k\lambda_k=1\). Then \(\operatorname{Tr}\hat{\rho}^2=\sum_k\lambda_k^2\). Since \(0\le\lambda_k\le1\), \(\lambda_k^2\le\lambda_k\), so \(\sum_k\lambda_k^2\le\sum_k\lambda_k=1\). Equality requires \(\lambda_k^2=\lambda_k\) for every \(k\), i.e. each \(\lambda_k\in\{0,1\}\); combined with \(\sum_k\lambda_k=1\) this forces exactly one eigenvalue equal to 1, so \(\hat{\rho}=|k\rangle\langle k|\) is a rank-one projector — a pure state. \(\blacksquare\) - A qubit is in the state \(\hat{\rho}=\tfrac12(\hat{\mathbf 1}+\vec r\cdot\vec{\hat\sigma})\) with Bloch vector \(\vec r=(0.6,\,0,\,0.0)\). Compute \(\langle\hat{\sigma}_x\rangle\), the purity, and state whether \(\hat{\rho}\) is a valid state.
Solution
For the Bloch form \(\langle\hat{\sigma}_i\rangle=\operatorname{Tr}(\hat{\rho}\hat{\sigma}_i)=r_i\), so \(\langle\hat{\sigma}_x\rangle=0.6\). Purity: \(\operatorname{Tr}\hat{\rho}^2=\tfrac12(1+|\vec r|^2)=\tfrac12(1+0.36)=0.68\). Validity requires \(|\vec r|\le1\): here \(|\vec r|=0.6\le1\), so \(\hat{\rho}\) is a valid mixed state (eigenvalues \(\tfrac12(1\pm0.6)=0.8,\ 0.2\ge0\)). It sits inside the Bloch ball, hence mixed since \(0.68<1\). - A two-level atom has \(\hat{H}=\tfrac{\hbar\omega_0}{2}\hat{\sigma}_z\) and initial state \(\hat{\rho}(0)=\tfrac12(\hat{\mathbf 1}+\hat{\sigma}_x)\). Solve the von Neumann equation for \(\hat{\rho}(t)\) and give \(\langle\hat{\sigma}_x(t)\rangle\).
Solution
\(\hat{\rho}(t)=\hat U\hat{\rho}(0)\hat U^\dagger\) with \(\hat U=e^{-i\hat H t/\hbar}=e^{-i\omega_0 t\hat\sigma_z/2}=\operatorname{diag}(e^{-i\omega_0 t/2},e^{+i\omega_0 t/2})\). Now \(\hat{\rho}(0)=\tfrac12\begin{pmatrix}1&1\\1&1\end{pmatrix}\). Conjugating multiplies the off-diagonal \((1,2)\) element by \(e^{-i\omega_0 t}\) and \((2,1)\) by \(e^{+i\omega_0 t}\): \(\hat{\rho}(t)=\tfrac12\begin{pmatrix}1&e^{-i\omega_0 t}\\ e^{+i\omega_0 t}&1\end{pmatrix}=\tfrac12(\hat{\mathbf 1}+\cos\omega_0 t\,\hat\sigma_x+\sin\omega_0 t\,\hat\sigma_y)\). Hence \(\langle\hat{\sigma}_x(t)\rangle=\operatorname{Tr}(\hat{\rho}\hat\sigma_x)=\cos\omega_0 t\): the coherence precesses (Larmor precession in the equatorial plane) while populations stay fixed. - For the pure product state \(|\Psi\rangle=|{\uparrow}\rangle_A\otimes\tfrac{1}{\sqrt2}(|{\uparrow}\rangle_B+|{\downarrow}\rangle_B)\), compute \(\hat{\rho}_A\) and \(\hat{\rho}_B\). Are they pure? Contrast with the Bell-pair worked example.
Solution
Because the state factorises, \(\hat{\rho}=\hat{\rho}_A\otimes\hat{\rho}_B\) with \(\hat{\rho}_A=|{\uparrow}\rangle_A\langle{\uparrow}|\) and \(\hat{\rho}_B=|{+}\rangle_B\langle{+}|\), \(|{+}\rangle=\tfrac1{\sqrt2}(|{\uparrow}\rangle+|{\downarrow}\rangle)\). Partial trace: \(\operatorname{Tr}_B\hat{\rho}=(\operatorname{Tr}\hat{\rho}_B)\hat{\rho}_A=\hat{\rho}_A\) since \(\operatorname{Tr}\hat{\rho}_B=1\); similarly \(\hat{\rho}_B\). Both are rank-one projectors: \(\operatorname{Tr}\hat{\rho}_A^2=\operatorname{Tr}\hat{\rho}_B^2=1\), pure. Contrast: a product pure state gives pure reduced states (entropy 0), whereas the Bell pair gave maximally mixed reduced states (entropy \(\ln2\)). Reduced-state mixedness is the diagnostic separating product from entangled. - A harmonic oscillator (frequency \(\omega\), \(\hbar\omega=0.10\ \text{eV}\)) is in thermal equilibrium at \(T=300\ \text{K}\). Write \(\hat{\rho}\) in the energy eigenbasis, and compute the ground-state population \(\rho_{00}\). (Use \(k_B T\approx 0.0259\ \text{eV}\).)
Solution
Thermal state \(\hat{\rho}=e^{-\beta\hat H}/Z\), \(\beta=1/k_BT\), diagonal in the number basis: \(\rho_{nn}=e^{-\beta E_n}/Z\) with \(E_n=\hbar\omega(n+\tfrac12)\). The half-quantum shifts cancel in the ratio, so \(\rho_{nn}=(1-e^{-\beta\hbar\omega})e^{-n\beta\hbar\omega}\) (geometric series \(Z_{\text{rel}}=1/(1-e^{-\beta\hbar\omega})\)). Numbers: \(\beta\hbar\omega=\hbar\omega/k_BT=0.10/0.0259=3.86\); \(e^{-3.86}=0.0210\). Ground-state population \(\rho_{00}=1-e^{-\beta\hbar\omega}=1-0.0210=0.979\). So about \(97.9\%\) of the population sits in the ground state — the mode is nearly frozen, as expected when \(\hbar\omega\gg k_BT\).