RMSNorm and the geometry

What layer norm keeps, and what RMSNorm leaves out