I cannot speak about the American experience. In Canada, fewer medical students specialize in family medicine each year. There is a shortage of family doctors for many reasons, not least growing populations and attempts to save money by funding fewer doctors.
In Canada, the majority of people who work in emergency rooms are family doctors who finished the two year residency and did an extra third year of training. Family doctors can also do extra formal training in anaesthesia, sports medicine, geriatrics, hospital medicine, palliative care, psychotherapy, simpler surgeries and procedures, geriatrics or addiction medicine. (But sometimes are also unofficially mentored into doing such roles where they are held to the same standards as specialists; I have done most of these roles). So it can be a very flexible degree, and in rural settings family doctors might have a very broad practice. Because of this flexibility, and wildly varying community needs, the skills and practice of remote, rural and urban doctors can be dramatically different.
Many family doctors are older and retiring soon. Although insurance companies, political disputes over things like abortion, and private payment are not that much of an issue in Canada, the specialty is seen as less prestigious and is often less remunerative. Administrative burdens can be very high. At times, it seems many specialists believe they know more about family or emergency medicine than people who have been doing it for decades (and don’t, more often than not). Some of these specialists view family medicine as a lesser choice. Hospital politics can be challenging.
The shortage of family doctors has somewhat improved remuneration, and a few payment schemes properly reward the work involved. But too much time is spent on managing a business, doing administrative work and charting, and duties which pay poorly or not at all (though this has improved). I welcome pharmacists and nurse practitioners being given a bigger role, but some family doctors see this as further disrespect.
But a skilled rural practitioner might be delivering babies, managing the cardiac and inpatient units, doing palliative care, harvesting organ donations, assisting emergency surgeries, transferring critically ill patients via ambulance or helicopter, working nights and weekends to keep the emergency room staffed, managing a full practice, practicing psychotherapy, looking after patients admitted to hospital, and more. That is a lot of knowledge and it requires years of training and practice to fulfill so many roles. Family medicine is not at all always a default option where it is easier to master the requirements of the practice. And every year, it seems specialists dump even more aspects of care on family doctors, who have to stay up to date with most of the subspecialties.