Recent years have seen a growing interest in topological phases beyond the standard paradigm of gapped isolated systems. One recent direction is to explore topological features in non-Hermitian systems that are commonly used as effective descriptions of open systems. Another direction explores the fate of topology at critical points, where the bulk gap collapses. One interesting observation is that both systems, though very different, share certain topological features. For instance, both systems can host half-integer quantized winding numbers and have very similar entanglement spectra. Here we make this similarity explicit by showing the equivalence of topological invariants in critical systems with non-Hermitian point-gap phases, in the presence of sublattice symmetry. Also, the corresponding entanglement spectra show the same topological features. This correspondence may carry over to other features and even be helpful to deepen our understanding of non-Hermitian systems using our knowledge of critical systems and vice versa.