If you accidently make a rule in GMail you’re screwed? but hold on, you just want to remove the label so select all, right-click, “Label as” and untick the accidental label.
It’s a little unusual since you can’t simply pick an option to unlabel things but it works wonders.