You see, her venom is highly neuro-toxic. Which is to say that it attacks the central nervous system; causing intense pain, profuse sweating, difficulty in breathing, loss of conciousness, violent convulsions, and, finally… uh, death.
I’d probably leave it alone if it were in an unused corner. Not everything that looks like a black widow is a black widow, and even real black widows have venom more appropriate to killing things small enough for them to eat.
You can let it merrily eat more pestiferous insects & the like. If it’s really in the way, it makes sense to find some out-of-the-way corner of your yard to stick it, or kill it.