My thing is chalk. Anything that feels chalky gives me this electrical-tingly feeling throughout my body. A bit like the feeling of sudden goose-bumps, but all over(especially mid-back).
I’ve gotten over this aversion to a certain degree. I can, for example, rub my hands over a fleece blanket now with no problems. Playing a game of pool on the other hand takes a bit more out of me.
Many years ago I had to use a chalk board during sales meetings. At first I was so focused on the texture of the stick of chalk that I could barely concentrate on what I needed to write. It took weeks for me to adjust to that oogy feeling.
I suggest that you buy a few swatches of the materials in question and, as you said, spend a couple minutes a day touching and handling the stuff.