Inelastic Scattering of Transversely Phase-Structured Free Electrons