Crossing One's Fingers...

People used to say “keep your fingers crossed” for good luck, but in cartoons and sit-coms, often the crossing of one’s fingers was some type of loophole to avoid making a binding promise. But, I never understood this. Where did the latter idea of breaking promises in this fashion come from? - Jinx