Quick-charge tech (as exemplified by the Tesla superchargers) can recharge a battery in an hour or less. It’s a lucky airline that can have an aircraft pull up to the gate, unload, service, and reload and pull out in less than an hour. I don’t think charge time is an issue. i would be more concerned about aircraft sitting in a lineup waiting to take off, as some US airports seem to be notorious for - but then, an electric aircraft just sitting needs only a small amount of power for instruments and AC. The props only need to turn when it’s moving. Perhaps that would be seen as a bonus - cheap idling.
On top of the issues of needing an aircraft mechanic to supervise any battery changes, take note of what Tesla also determined - battery swaps are not worth the hassle. The battery unit has to be encased in a solid structural package; then the vehicle has to have the structure to accommodate that battery pack. This results in redundant structures, each contributing weight - and the structure to allow easy access and change of batteries also complicates and adds to weight and complexity. Instead, the battery compartment is an integral part of the vehicle, structure as well as containment.
Another good example is cellphones. In the good old days, you could change batteries (and sometimes needed to). Modern smartphones are a sealed unit, so can be thinner, lighter, and as a bonus many are waterproof to a certain level of immersion.
The trick in both cases (sorry) is ensuring the battery lifetime and reliability is such that changing the batteries should only happen on a rare basis. With heavy use and fast charging. perhaps an aircraft using current battery tech would need new batteries every 2 years or so. (Based on the story of a Tesla used as a taxi between LA and Vegas being supercharged several times a day.)
As for fire issues, no doubt the aircraft battery pack would be better wired to detect hot spots (battery cell malfunctions) long before they become a safety issue.
As to whether passengers get off or stay on - the stated purpose is short commuter hops on feeder routes, for now, which is no different than what airlines do now. Passengers get on at small regional airports, get their luggage checked and security and printed boarding passes, thus reducing the strain on the main airports - plus using the feeder routes probably funnels them into the same airline’s longer routes, thus increasing their passenger count.