I love lychee and I eat it a lot here in Hawaii. The skin/rind is tough and encases the fruit. If the outside has mold then it is possible that the inside doesn’t and is safe to eat. The lychee that I have found to be bad or spoiled looked normal on the outside but was rotten on the inside.