We briefly review the basics of Weyl geometry and its natural extension by a general linear distortion of the metric connection by a vector field. A special class of the connections has torsion but retains the Weyl's semi-metricity condition. We present ghost-free gravitational theories in this geometrical setup and highlight their possible cosmological applications, such as new self-tuning solutions and new bouncing solutions found in the quadratic-curvature theories. The vector distortion can mimic the cosmological effects of dark matter.