Skip to main content

The Cosmological Constant Problem Revisited

In a previous post we mentioned how the discrepancy in the classical and quantum estimates of the stiffness of space-time was another version of the cosmological constant problem (CCP). You will find some people claiming this is a non-problem, however, the CCP is actually one of the two great naturalness problems in modern physics. 

$$\Lambda \simeq 1.3 \times 10^{-52}\ \mathrm{m}^{-2}$$

yet naïve quantum field theory (QFT) estimates of vacuum energy overshoot the observed value by an astonishing factor of order $10^{121}$.

This discrepancy is often expressed as the ratio between the Planck energy density and the observed dark energy density:

$$\frac{\rho_{\text{Planck}}}{\rho_\Lambda} \sim 10^{121}$$

where

$$\rho_\Lambda = \frac{\Lambda c^2}{8\pi G}, \qquad \rho_{\text{Planck}} = \frac{c^5}{\hbar G^2}$$

 At face value, this looks like a total failure of theoretical physics. However, this interpretation rests on an assumption that turns out to be wrong: that vacuum degrees of freedom scale with volume


Where the naive QFT estimate comes from

 Now, Rugh and Zinkernagel's paper from 2000 works out the QFT vacuum energy density from a quantum harmonic oscillator in a box, where $\rho^{QFT}_{vac} \ c^2 = E/V$: $$\frac{E}{V} = \frac{1}{V} \sum_{\mathbf{k}} \frac{1}{2} \hbar \omega_{\mathbf{k}} \approx \frac{\hbar}{2 \pi^{2} c^{3}} \int_{0}^{\omega_{\max}} \omega^{3} \, d\omega = \frac{\hbar}{8 \pi^{2} c^{3}} \omega_{\max}^{4}$$ This zero-point vacuum energy density is a "bare" result, i.e. before interactions are considered. If we consider the QFT framework is valid up to the Planck energy scale, the standard approach is to insert $E_{Planck}=\hbar \ w_{max}$  into the QFT calculation above, which gives:

\begin{equation}
\rho^{QFT}_{vac} \ c^2 = \frac{c^7}{8 \pi^2 \hbar G^2}
\end{equation} The expression on the RHS is the famous cosmological constant problem, i.e. this result is 120 orders of magnitude greater than the observed vacuum energy density! The observed vacuum density $\rho^{obs}_{vac}$
is the CEH rest mass-energy divided by the volume of a sphere with radius $l_{\Lambda}$  

\begin{equation}
\rho^{obs}_{vac} \ c^2 = \frac{3 \ m_{CEH} \ c^2}{4\pi l_{\Lambda}^3} =  \frac{c^4 \Lambda} {8 \pi G}
\end{equation}
 


The CKN bound and UV–IR mixing

In 1998, Cohen, Kaplan, and Nelson (CKN) pointed out that a QFT placed in a region of size $L$ cannot be arbitrarily excited. If the total energy exceeds that of a black hole of the same size, the region collapses gravitationally.

Requiring gravitational stability implies

$$L^3 \Lambda_{\rm UV}^4 \lesssim \frac{c^4}{G} L,$$

or equivalently,

$$\Lambda_{\rm UV}^4 \lesssim \frac{c^4}{G L^2}.$$

This is a striking result: the ultraviolet cutoff depends on the infrared scale. This UV–IR mixing means that the number of physically accessible states does not scale with volume.  The number of high energy states (DOF) is proportional to the area of the box, not the volume, aka UV-IR mixing. 


Holography and the counting of degrees of freedom

The CKN bound is equivalent to the holographic principle, which states that the maximum entropy (and hence the number of degrees of freedom) contained in a region scales with its boundary area, not its volume:

$$S_{\max} = \frac{A}{4 L_{\rm Pl}^2}.$$

In this picture, all information about the bulk is encoded on the horizon. For an observer inside, that horizon information is inaccessible and therefore manifests as entropy. The cosmological constant problem can thus be rephrased as follows:

Local QFT dramatically overcounts the degrees of freedom of the vacuum by treating spacetime as a box of independent Planck cells. 

While the holographic principle equates the actual number of degrees of freedom of a bulk to its surface area not its volume
 
The holographic principle: all the information-energy about the volume is printed on the horizon of the can. Inside the can, the horizon information-energy is unavailable (can't read it, can't use it), so is, by definition, entropy $S_{dS}$   

De Sitter space and the cosmic event horizon

Our universe, both during inflation and in its current accelerated phase, is well approximated by a quasi–de Sitter spacetime with Hubble parameter

$$H_\Lambda = \sqrt{\frac{\Lambda}{3}},$$

and a cosmic event horizon of radius

$$\ell_\Lambda = \frac{1}{H_\Lambda}.$$

This horizon is not merely a causal boundary—it is a thermodynamic object with well-defined temperature and entropy:

$$T_{dS} = \frac{\hbar H_\Lambda}{2\pi k_B}, \qquad S_{dS} = \frac{A_H}{4 L_{\rm Pl}^2}.$$


Horizon energy and thermodynamic consistency

Using quasilocal energy methods (Brown–York), the total energy associated with the de Sitter horizon satisfies the horizon entanglement identity

$$E_0 = 2 k_B T_{dS} S_{dS}.$$

The gravitating energy inside the horizon (the Misner–Sharp mass) is half of this total:

$$E_H = \frac{1}{2} E_0.$$

Dividing this bulk energy by the horizon volume ($V = \frac{4}{3}\pi \ell_\Lambda^3$), one obtains

$$\rho_\Lambda c^2 = \frac{E_H}{V} = \frac{3 c^4}{8\pi G \ell_\Lambda^2}.$$

Using $\ell_\Lambda^{-2} = \Lambda/3$, this becomes

$$\rho_\Lambda = \frac{\Lambda c^2}{8\pi G},$$

which recovers precisely the observed dark energy density. This holographic approach dissolves the naive cosmological constant problem by correctly counting degrees of freedom, but! the numerical value of $\Lambda$ remains unexplained without an additional selection principle, e.g. Padmanabhan's cosmic information constraint, which fixes $\Lambda$ in terms of $\rho_{\mathrm{inf}}$ and $\rho_{\mathrm{eq}}$. 


What really resolves the cosmological constant problem

The CCP is not solved by cancelling enormous numbers. It is resolved by recognising that:

  • Vacuum energy is not a bulk sum over Planck cells.
  • Gravity enforces a holographic bound on degrees of freedom.
  • De Sitter space is a thermodynamic equilibrium state with finite entropy.
  • The cosmological constant is a state variable, not a dynamical field.

These four points eliminate the $10^{120}$ overcounting, but they do not, by themselves, predict the \textit{numerical value} of $\Lambda$. That requires an additional selection principle. Padmanabhan's cosmic information framework provides one: the accessible information content $I_c$ for an eternal observer is fixed at the quantum-gravitational unit $I_{\mathrm{QG}} = 4\pi$. 

In exact de Sitter equilibrium the horizon entropy is extremised, implying a constant $\Lambda$. Our universe, however, is \textit{not} in de Sitter equilibrium: Padmanabhan's holographic equipartition law, $dV_H/dt = L_P^2(N_{\mathrm{sur}} - N_{\mathrm{bulk}})$, shows that the current matter--$\Lambda$ epoch has $N_{\mathrm{sur}} \neq N_{\mathrm{bulk}}$, placing us away from the equilibrium fixed point. The de Sitter state is the asymptotic attractor, not the present condition --- and the approach to that attractor is governed by the same thermodynamic framework that dissolves the original problem. 


Emergent spacetime

Finally, holography suggests that spacetime itself is emergent : one may associate roughly one degree of freedom with each Planck area on the cosmic horizon. Bulk geometry, dynamics, and even gravity arise collectively from these boundary degrees of freedom.

In this sense, the cosmological constant does not introduce a new fundamental energy scale. Instead, it reflects the thermodynamic equilibrium of spacetime itself.

Dark energy can be exactly constant in value while being emergent in origin.



Comments

Popular posts from this blog

Blurring the horizon - the quantum width of the cosmic event horizon

A  paper by Zurek applied a random walk argument to a black hole horizon. Credit, Zurek, 2021 Zurek  ( Snowmass 2021 White Paper: Observational Signatures of Quantum Gravity )  called this a blurring of the horizon — a fuzzy, or uncertain horizon — and went through derivations supporting the idea that this length scale is the quantum uncertainty in the position of the black hole horizon: a dynamic quantum width of an event horizon. This is a concept which fundamentally applies to the Universe's own Cosmic Event Horizon (CEH). The Bekenstein-Hawking entropy gives the number of quantum degrees of freedom that can fluctuate. Below, we step out our own cosmic de Sitter derivation of the random walk argument. To do this, let $l_{\Lambda}$ represent the generalised de Sitter horizon scale. Due to the holographic UV/IR correspondence, this scale manifests dually: at the fundamental microscopic limit as $l_{UV} = 2L_p$ (the gravitational/casual limit, aka the Schwarzschild radi...

The Cosmic Strange Metal

       In condensed matter physics, a class of strongly correlated systems share three remarkable transport properties simultaneously. Strange metals, quantum spin liquids, and Sachdev-Ye-Kitaev (SYK) models all exhibit (i) a shear-viscosity-to-entropy ratio at or near the conjectured KSS minimum $\eta/s = \hbar/(4\pi k_B)$, (ii) a Lyapunov exponent saturating the Maldacena-Shenker-Stanford (MSS) chaos bound $\lambda_L = 2\pi k_B T/\hbar$, and (iii) a Planckian dissipation time $\tau = \hbar/(k_BT)$ governing all transport. These systems have no quasiparticle description. Their low-energy physics is instead captured, in known cases, by a gravitational dual via holography. This post argues that the cosmological horizon of a de Sitter (dS) universe belongs to this same universality class, with every quantitative bound matched, provided one applies the correspondence to the horizon membrane rather than the bulk spacetime. The membrane paradigm as the physical basis Th...

Our cosmic event horizon on a string

A Cosmic Stringy Adventure ! As we previously discussed, our spacetime characterised by a positive cosmological constant $\Lambda$. The natural bounds are then a minimal  ultraviolet (UV) length $l_{UV} = 2L_P$ and an infrared (IR) cosmological horizon $l_{\Lambda}$.  This dual-boundary spacetime enforces a fundamental Compton–gravitational duality . Every geometric scale $r$ carries two natural mass definitions: $$m_C(r) = \frac{\hbar}{rc}, \qquad m_G(r) = \frac{c^2}{4G}\ r$$ The product of these masses, $m_C \ m_G = M_P^2/4$, is scale-independent. They intersect exclusively at the UV boundary $r = l_{UV}$, defining a maximal local force in GR: $F_{max} = c^4 / 4G$. At the opposite extreme, the Compton mass evaluated at the IR horizon yields the fundamental  spectral gap  (not a particle) of the universe: $m_s = \hbar / (l_{\Lambda} c)$.  In this post, to explore how energy propagates through this dual-scale geometry, we model the mass gap $m_s$ as a null-ener...