Both are right. If his estate is worth, say, $3 million, then the first $2 million are non-taxable. Of the remaining $1 million, allowable deductions reduce it to find the remaining taxable amount.
With his estate being worth $250,000 he is well under the standard exemption and (even if the amount reverts in a few years as is currently planned) his estate will not be taxed.