Housing market is down and likely to be that way for another year or so. The low interest you are earning on the savings isn’t really impacting your ability to buy a house in the near to mid future. If house prices were booming then you should be concerned, but you are likely to more than make up for the low interest on your money by buying a house a lower price.
2-5 years out add a bit more uncertainty, but consider looking for bargain prices on houses in the next 1-2 years if it’s possible to commit to a location.