Joseph Priestley was a brilliant scientist. But he refused to concede the phlogiston theory was wrong, even when some of his own experiments provided evidence against it.
To address his point directly, the definition isn’t circular since we know what combustion “is” (stuff burning), we can point to it and say “this is combustion”, so that when phlogiston is defined we have a starting point. If the only definition for combustion was “releasing phlogiston” then it would be circular.