No. If that were true, you’d get heat from “internal friction” when the rubber relaxes. But contraction is endothermic. The stretched state has lower entropy.
Likewise, rubber contacts when heated and expands when cooled.
More here, designed for kids: