It is generally believed that quantum gravity is necessary to resolve the known tensions between general relativity and the quantum field theories of the standard model. Since perturbatively quantized gravity is non-renormalizable, the problem how to unify all interactions in a common framework has been open since the 1930s. Here, I propose a possibility to circumvent the known problems with quantizing gravity, as well as the known problems with leaving it unquantized: By changing the prescription for second quantization, a perturbative quantization of gravity is sufficient as an effective theory because matter becomes classical before the perturbative expansion breaks down. This is achieved by considering the vanishing commutator between a field and its conjugated momentum as a symmetry that is broken at low temperatures, and by this generates the quantum phase that we currently live in, while at high temperatures Planck's constant goes to zero.