Radiation pressure. Remember, solar sails are a thing. At some point, you're blazing through spacetime so fast all that energy you're trying to share the same physical location with is impacting and ablating your hull material.

Relative velocity is a hell of a drug.