Transient absorption anisotropy is a well-established technique in time-resolved liquid phase spectroscopy. Here, we show how the technique is applied in the gas phase for time-resolved photoelectron spectroscopy and what type of additional information can be obtained as compared to other techniques. We exemplify its use by presenting results on rotational revivals in pyrazine after excitation at 324 nm and provide new insights into two recent experiments: (i) the difference between Rydberg and valence state excitation after one- and two photon absorption in butadiene and (ii) excitation to the two lowest lying vibronic modes of the degenerate pi 3p Rydberg state in 1-azabicyclo[2.2.0]octane. Going forward, we expect the technique to be used on a regular basis, especially with the advent of high harmonic probe sources and liquid beam setups where other techniques to extract polarization-dependent information such as velocity map imaging cannot easily be applied.