With climate change-induced sea ice decline in the Arctic Ocean, nitrogen is expected to become an increasingly important determinant of primary productivity. Nitrogen fixation is the conversion of molecular nitrogen to bioavailable ammonium by microorganisms called diazotrophs. Here, we report nitrogen fixation rates, diazotroph composition, and expression under different stages of declining sea ice in the Central Arctic Ocean (multiyear ice, five stations) and the Eurasian Arctic (marginal ice zone, seven stations). Nitrogen fixation in the Central Arctic Ocean was positively correlated with primary production, ranging from 0.4 ± 0.1 to 2.5 ± 0.87 nmol N L⁻¹ d⁻¹. Along two transects across the marginal ice zone, nitrogen fixation varied between days and ice regime from below detection up to 5.3 ± 3.65 nmol N L⁻¹ d⁻¹ associated with an ice-edge phytoplankton bloom. We show nitrogen fixation in sea ice-covered waters of the Arctic Ocean and provide insight into present and active non-cyanobacterial diazotrophs in the region.