Something you didn’t mention in your OP, do you have access to the underside of the tread. You said it wouldn’t be easy to remove. I’ll take your word on that, but if you can get at the bottom, some strategically placed wood bracing the bottom and some wood glue on top might be just as good.