Are any natural sweet foods poisonous? Fruits, berries etc?

Good defensive hedge plant: Carissa - Wikipedia

My Grandmother had a few of them and we would anxiously await the “ripening” when we could sample this lovely fruit safely.

Saw it for the first time in years at a plant stall in Andalucia recently.