I am considering picking up a big old sturdy Marantz tape recorder for doing a few tunes for my next release. Tape can sound nice in a similar way to vinyl. I have recorded digitally and of course it is superior and more convenient in most instances but the “warmth” for want of a better term of a tape recorded acoustic guitar or synth can be lovely. I am sure there are filters for DAWs that will provide tape hiss etc. but hey the medium is the message. 
There is another layer of difficulty to altering what somebody said in a recording, due to coarticulation. Words slide into one another, although we perceive them as separate, and the gaps in speech are often not where they appear to be. That is going to be very hard to untangle when you’re ‘editing’ someone’s evidence.
http://swphonetics.com/coarticulation/whatcoart/
This naturally applies to any sort of recording technology.
I could be wrong but I don’t think REM’s entire last album was recorded on an iPhone. Stipe mentioned in an interview “My notepad is my iPhone, and in fact I recorded and wrote this entire record on my phone.” but the wiki article for the album states that “Collapse into Now was recorded in four different cities: Berlin, Germany, Nashville, Tennessee and New Orleans, Louisiana, with demoing taking place at Jackpot Studios, in Portland, Oregon.”
Thanks, good points. I assumed we’d digitize the whole recording, make edits digitally, and then re-record the whole tape. But I see we’d at least need the same tape recorder to do it.
With any audio application, it’s a nuisance to deal with a slew of audio files to represent one time sequence. Of course, with the right application to resplice the files, it’s no problem. But do you know any such script or application? It’s trivial to write, but most folks don’t write code.
This isn’t a problem with digital. It’s a design issue with some (maybe most) digital recorders. It’s definitely how my audio field recorder works: every time you turn it off and turn it on again, starting recording again creates a new file. I can’t append.
An append option would be trivial to implement, and I’d be astonished if there wasn’t a simple, cheap digital voice recorder that can do it, since this does seem like a fairly typical use-case. Once implemented, it blows away the cassette recorder, because importing or copying the data happens in an instant, rather than real time or some fraction thereof (e.g., 1 hour to copy 1 hour of audio, or for fancy ones that copy at 4x speed, 15 minutes to copy 1 hour.)
Quick search for voice recorder apps with append mode:
iPhone: Voice Record Pro 7 on the App Store (free)
Android: https://www.dictation.philips.com/dk/products/product/pocket_memo_voice_recorder_dpm8000_series/ ($4)
No doubt there are more.
I use a field recorder to record band rehearsals or gigs, because the built-in mics are far better than my phone’s, plus it can take an additional stereo feed from the PA, and because I might want to use my phone. But for recording musical ideas, I’d far rather use my phone, simply because I always have it with me, and sound quality isn’t important.