Butterflies for freedom

I have been told that prior to and during the American Civil War, butterflies were worn as a symbol of “freedom” or anti-slavery, but have been unable to find any info. I do know that there are lots of period articles with butterflies but have not found any direct relation between them and anti-slavery.