In the context of cosmology the cosmological constant is a homogeneous energy density that causes the expansion of the universe to accelerate. Originally proposed early in the development of general relativity in order to allow a static universe solution it was subsequently abandoned when the universe was found to be expanding. Now the cosmological constant is invoked to explain the observed acceleration of the expansion of the universe. The cosmological constant is the simplest realization of dark energy, which is the more generic name given to the unknown cause of the acceleration of the universe. Its existence is also predicted by quantum physics, where it enters as a form of vacuum energy, although the magnitude predicted by quantum theory does not match that observed in cosmology.
Contents |
The cosmological constant first appeared in a 1917 paper by Einstein entitled "Cosmological Considerations in the General Theory of Relativity" (Einstein 1917), in which he motivates its introduction into the field theory of general relativity by the need to stabilize the universe against the attractive effect of gravity:
At the time, observations of our universe were limited primarily to stars in our own galaxy, so there was indeed observational evidence justifying the assumption that the universe was static. Einstein's goal was to obtain a Universe that satisfied Mach's principle of the relativity of inertia (for a historical discussion see Pais 1982, Sect 15e), and construct a cosmology that was finite, yet stable against gravitational collapse. The attempt proved futile, as shortly thereafter de Sitter (1917) demonstrated an empty universe solution to Einstein's equations (allowing inertia relative to space empty of matter) and Friedmann (1922) derived solutions to Einstein's equations that corresponded to an expanding universe. These results could be considered a prediction that the universe must be expanding or contracting, a remarkable implication of general relativity that was later borne out by observation. When Hubble observationally discovered the expansion of the universe Einstein finally abandoned the cosmological constant completely (Einstein 1931).
In the intervening years the cosmological constant came in and out of vogue as new observational results repeatedly seemed to require it, but then were explained in other ways. As of the early 1990s there were tantalising hints that the cosmological constant might again be needed. The universe appeared to be younger than the oldest stars it contained, a feature that was remedied if the universe was currently in an accelerating phase. Number counts of galaxies indicated that the volume contained within a solid angle at high redshift was larger than expected in a decelerating universe. Theoretical arguments from inflation and later observational results from the cosmic microwave background radiation indicated that the universe should be flat, but observations of large scale structure indicated that the matter density was inadequate to achieve this -- vacuum energy could make up the shortfall.
This set the stage for the discovery of the accelerating universe by two teams in 1998/1999. The High-Z supernova team and the Supernova Cosmology project both discovered that high-redshift supernovae were fainter than expected for a decelerating universe and that the difference could be explained if there was a cosmological constant of just the right magnitude needed to make the universe flat.
This was a dramatic convergence of observation and theory. Since then increasingly accurate probes have confirmed to high precision the need for dark energy, but the nature of the dark energy is now the issue being investigated. As of 2010 the measured properties of dark energy remain consistent with those of a cosmological constant. However, massive observing efforts are underway to test whether this is the correct explanation for the acceleration or whether some other sort of dark energy, perhaps one that changes with time or one that is motivated by some form of quantum gravity, is needed to explain the acceleration we see.
Greatest Blunder
In his autobiography, My World Line, George Gamow reported on a conversation he had with Einstein about the introduction of the cosmological constant into the field equations.
Much later, when I was discussing cosmological problems with Einstein, he remarked that the introduction of the cosmological term was the biggest blunder of his life. (Gamow 1970).
This second hand account has become one of the most frequently repeated quotes in cosmology.
To explore more deeply the nature of the Universe, we must use the mathematical language in Einstein's general relativity to relate the geometry of space-time (expressed by the metric tensor, \(g_{\mu\nu}\)) to the energy content of the universe, (expressed by the energy-momentum tensor, \(T_{\mu\nu}\)).
Arguably, one of Einstein's most significant discoveries was that the distribution of energy determines the geometry of space-time, which is encoded in his field equation,
\[\tag{1} R_{\mu\nu} - \frac{1}{2}Rg_{\mu\nu} = 8\pi G T_{\mu\nu}\ ,\]
where \(G\) is the gravitational constant.
Although this is the simplest form of the equations the freedom remains to add a constant term. This "cosmological constant" was what Einstein added in order to achieve a static universe, and it is given the symbol \(\Lambda\ .\)
\[\tag{2} R_{\mu\nu} - \frac{1}{2}Rg_{\mu\nu} + \Lambda g_{\mu\nu} = 8\pi GT_{\mu\nu}\]
When \(\Lambda\) is positive it acts as a repulsive force.
Vacuum energy arises naturally in quantum mechanics due to the uncertainty principle. In particle physics the vacuum refers to the ground state of the theory -- the lowest energy configuration. The uncertainty principle does not allow states of exactly zero energy, even in vacuum (virtual particles are created). Since in general relativity all forms of energy gravitate, this ground state vacuum energy impacts the dynamics of the expansion of the universe.
Vacuum energy should not have any dissipative processes such as heat conduction or viscosity, so it should take the form of a perfect fluid,
\[\tag{3} T_{\mu\nu} = (\rho + p)U_{\mu}U_{\nu}+p g_{\mu\nu}.\]
In order to maintain Lorentz invariance, vacuum energy should also have no preferred direction. Therefore the first term in the perfect fluid energy tensor must be zero, requiring
\[\tag{4} p^{vac}=-\rho^{vac},\]
which corresponds to an equation of state \(w^{vac}=p^{vac}/\rho^{vac} = -1\ ,\) and results in an energy-momentum tensor for vacuum energy,
\[\tag{5} T^{vac}_{\mu\nu} = p^{vac} g_{\mu\nu} = -\rho^{vac} g_{\mu\nu}.\]
We can split the energy-momentum tensor into a term describing the matter and energy, and a term describing the vacuum, \(T_{\mu\nu} = T_{\mu\nu}^{matter} +T_{\mu\nu}^{vac}\ .\) Einstein's equation including vacuum energy becomes,
\[\tag{6} R_{\mu\nu} - \frac{1}{2}Rg_{\mu\nu} = 8\pi G(T_{\mu\nu}^{matter} -\rho_{vac}g_{\mu\nu}).\]
Recall that the cosmological constant enters Einstein's equation in the form,
\[R_{\mu\nu} - \frac{1}{2}Rg_{\mu\nu} + \Lambda g_{\mu\nu} = 8\pi GT_{\mu\nu}.\]
So vacuum energy and the cosmological constant have identical behaviour in general relativity, as long as the vacuum energy density is identified with,
\[\tag{7} \rho^{vac} = \frac{\Lambda}{8\pi G}.\]
In an homogeneous, isotropic universe the geometry is defined by the Friedamnn-Lemaître-Robertson-Walker metric (FLRW metric) and the dynamics of the universe are governed by the Friedmann equations (Friedmann equations). The dynamics are driven by the energy content of the universe and the equation of state of the components that make up the energy density. The equation of state relates density \(\rho\) to pressure \(p\) according to \(w = p/\rho\ .\) The cosmological constant enters these equations in the following way, where \(a\) is the scale factor of the universe normalized to 1 at the present day, \(H=\dot{a}/a\) is Hubble's constant (an overdot represents differentiation with respect to time), and \(k\) is the curvature of the universe given by +1, 0, and -1 for positive, flat, and negative curvature respectively,
\[\tag{8} H^2 = \frac{8\pi G}{3}\rho - \frac{k}{a^2} +\frac{\Lambda}{3},\]
\[\tag{9} \frac{\ddot{a}}{a}=-\frac{4\pi G}{3}(\rho + 3p) + \frac{\Lambda}{3}.\]
These equations are more concisely written by considering both the cosmological constant and curvature as forms of energy density (\(\rho_\Lambda = \Lambda / 8\pi G\) and \(\rho_k = -3k/8\pi G a^2\)). Then Eqs. (8) and (9) become
\[\tag{10} H^2 = \frac{8\pi G}{3}\sum_i \rho_i,\]
\[\tag{11} \frac{\ddot{a}}{a}=-\frac{4\pi G}{3}\sum_i (\rho_i + 3p_i).\]
The different components have different equations of state, \(w_i\ ,\) which determines how their density changes with the expansion of the universe :
\[\tag{12} \rho_i = \rho_{i0} a^{-3(1+w_i)}\]
Pressureless matter has \(w=0\ ,\) radiation has \(w=1/3\ ,\) curvature has an effective \(w=-1/3\ ,\) cosmological constant has \(w=-1\ .\) (We have used \(w_\Lambda=-1\ ,\) which implies \(\rho_\Lambda + 3p_\Lambda = -2\rho_\Lambda\) in deriving Eq. (11).)
The current energy density of each component, \(\rho_{i0}\ ,\) is often represented as a fraction of the critical density, \(\rho_{\rm c}=3H_0^2/8\pi G\ ,\) which is the energy density required to close the universe (also calculated at the present day). Denoting this \(\Omega_i = \rho_{i0}/\rho_{\rm c}\) and using Eq. (12) allows us to write
\[\tag{13} H^2 = H_0^2\sum_i \frac{\rho_i}{\rho_{c}} = H_0^2\sum_i\Omega_i a^{-3(1+w_i)}\]
For pressure to do work there needs to be a pressure gradient -- a relatively high pressure region next to a relatively low pressure region -- that will then cause movement from high pressure to low. In a homogeneous universe there are no pressure gradients, so a positive pressure does no work and has no expanding effect (there are no low-pressure regions for it to push matter into). On the contrary, in general relativity all forms of energy gravitate so pressure effectively pulls, strengthening the attractive force of gravity (thus the factor of \(p\) in Eq. (9), which does not appear in Newtonian gravity). The cosmological constant has negative pressure, \(w=-1\ ,\) so its general relativistic contribution counteracts the normal force of gravity and provides an outwards acceleration.
Observational evidence for the accelerating universe is now very strong, with many different experiments covering vastly different timescales, length scales, and physical processes, all supporting the standard \(\Lambda\)CDM cosmological model, in which the universe is flat with an energy density made up of about 4% baryonic matter, 23% dark matter, and 73% cosmological constant. For more detail and references see the review by Frieman, Turner and Huterer 2008.
The critical observational result that brought the cosmological constant into its modern prominence was the discovery that distant type Ia supernovae (0<z<1), used as standard candles, were fainter than expected in a decelerating universe (Riess et al. 1998, Perlmutter et al. 1999). Since then many groups have confirmed this result with more supernovae and over a larger range of redshifts. Of particular importance are the observations that extremely high redshift (z>1) supernovae are brighter than expected, which is the observational signature that is expected from a period of deceleration preceding our current period of acceleration. These higher-redshift observations of brighter-than-expected supernovae protect us against any systematic effects that would dim supernovae for reasons other than acceleration.
Prior to the 1998 release of the supernova results there were already several lines of evidence that paved the way for the relatively rapid acceptance of the supernova evidence for the acceleration of the universe. Three in particular included:
Despite its success, the cosmological constant is not without problems (for further details on all the issues below see Weinberg (1989), Carroll (2001), and Padmanabhan (2003)).
The cosmological constant problem arises because, using naive naturalness arguments in quantum field theory, one cannot explain why the observed cosmological constant is so small. Quantum mechanical calculations that sum the contributions from all vacuum modes below an ultraviolet cutoff at the Planck scale give a vacuum energy density of \(\rho_\Lambda\sim10^{112} {\rm erg/cm}^3\ .\) This exceeds the cosmologically observed value of \(\rho_\Lambda\sim10^{-8} {\rm erg/cm}^3\) by about 120 orders of magnitude. See for instance Weinberg (1989) and Carroll (2004), Section 4.5.
The cosmological constant is not diluted as the universe expands, whereas the density of matter drops in inverse proportion to the volume. This means that there is only a fleeting moment of cosmological time during which the matter density will be of comparable magnitude to the vacuum energy density. Many argue that to be living in that moment is too unlikely to be coincidence. This has been called the coincidence problem, and has motivated theories beyond the cosmological constant with more general forms of dark energy that may change with time.
These unresolved issues have motivated the current observational effort to test whether the cosmological constant is a valid cause of the acceleration of the universe. Other theories, such as fledgling theories of quantum gravity (e.g. brane-motivated cosmologies), naturally produce dark energy candidates with properties different from the standard cosmological constant (Padmanabhan, 2003). Phenomenological theories such as quintessence have also been proposed, which have a time-varying value of dark energy. Although these models are designed partially to negate the coincidence problem by having dark energy solutions that can track the matter density, these then suffer a new fine-tuning problem as they introduce additional parameters whose values need to be fine-tuned to produce the evolution needed (Weinberg 1989, 2000).
Many argue that the coincidence problem is most simply solved by anthropic considerations. That is, were the value of the cosmological constant much higher or lower than the observed value it would disrupt structure formation in the universe and humans would not exist. Although many argue against anthropic solutions on philosophical grounds in preference for solutions that invoke some deeper physical principles, anthropic arguments are gaining more prominence, especially in light of the emergence of the string landscape. It had been hoped that string theory would give a well motivated fundamental explanation for the values of the constants of nature, but now it seems ours is only one of many possible solutions, which we find ourselves in by chance constrained by anthropic requirements (Polchinski, 2006).
Dark energy also encompasses the possibility that there is no additional energy density component to the universe, but rather that the equations of general relativity need revision. In this sense general relativity might be a limit of a more complete theory of gravity in the same way that Newtonian gravity is a low-energy limit of general relativity. This possibility is also known as dark gravity.
Internal references
Dark energy, Exact solutions of Einstein's equations, Friedmann equations, General relativity, Vacuum energy,