Bankers very much do not want high inflation, and very few, if any, people think that inflation is not high enough (so your question is based on completely false premises). The austerity measures (spending cuts and the like) that many governments, including the US, have been taking, mainly at the behest of bankers and the very wealthy (who also hate inflation, because it makes their money worth less), are largely designed to keep inflation low.
On the other hand, there are many economists, generally aligned with the political moderate left , who argue that austerity measures are the worst thing to do in a depressed economy such as the one we have all been living in during the past five years or so, and that putting money into the economy via deficit spending is the way to get the economy moving again, producing wealth and providing employment. (Obama’s “stimulus package” was designed to do this, but the economists in question argue that this was far too small and insufficiently sustained to do much good. From their perspective, we need much more stimulus.) One of the main risks of this strategy is that it is likely to cause inflation to increase. However, the economists who favor this plan argue both that in current conditions the inflation increase is not likely to be too large, and that this is a small price to pay for reducing unemployment and increasing growth, production, and wealth creation. It is not that they think inflation is a good thing as such, but that it is not nearly as bad as high unemployment levels and economic stagnation.
Although high levels of deficit spending by the government will also increase government debt in the short term, it will not cause the government to go broke. Governments can (literally if necessary) print as much money as they like, and it is argued that once the economy is in a healthier condition it will be much easier to pay off the debt because tax revenues will increase (even if tax rates are not increased, maybe even if they are cut) simply because more money is being made and exchanged by people and companies, and is thus subject to taxation. (This is essentially how the deficit was paid off, and a surplus achieved, during the economic boom of the later part of the Clinton administration, not by higher taxes or spending cuts, but through higer levels of economic activity and private-sector wealth creation.)
It is also worth noting that moderate levels of inflation are advantageous to people who are in long-term debt, such as middle class homeowners with mortgages (and governments with deficits!). Inflation means the value of what they owe is decreasing. I think it is pretty much universally agreed, though, that very high levels of inflation are bad, because they lead to economic instability. At the moment, however, inflation is very low and could undoubtedly stand to be larger without causing disruption. It is also pretty much universally agreed that deflation (i.e., the value of money increasing), even at quite moderate levels, is very bad for an economy, because it leads people to sit on their money, and deters them from investing in productive enterprises. If anybody is concerned that inflation,as such, is too low ( can’t say I have heard this) it is presumably because they think that its rate is in danger of soon sinking below zero, i.e., becoming negative, which is the same thing as deflation.
The argument, then, is between those who think it is very important to keep inflation very low and stable (mainly bankers, the very wealthy, and those who beholden to them, which includes many governments), and those who think a rise in inflation (provided it is not allowed to go too far) would be a small price to pay for lowered unemployment, economic growth, and higher wealth production.