It’s kind of a cheat because it is technically parallel universes and the future going back to the past but the Novella “Mozart in Mirrorshades” has some of this.
I’ve always loved the Time Patrol stories by Poul Anderson. The Sorrow of Odin the Goth, part of that series, is my all-time favourite time-travel story. The series mostly consists of short stories and novellas, but it ends with a good-sized novel, The Shield of Time. There Will Be Time and The Dancer from Atlantis are other good time-travel stories by Anderson.
I’ll add to the recommendations for Replay, Elleander Morning, The Door Into Summer and Lest Darkness Fall, though I think of the latter more as alternate history than time travel.
Doomsday Book and To Say Nothing of the Dog, by Connie Willis, are also excellent.
As a kid I read nothing but SciFi short stories, so I was introduced to time travel with Jack Finney’s short story The Third Level – interesting, fun, and even a little sweet. And Light of Other Days by Bob Shaw. (But only some photons actually time travel…)
And if you liked anything about A Wrinkle In Time, you’ll be floored by A Swiftly Tilting Planet. It’s a much more mature sequel, and I ended up taking notes to keep all the time/plot twists straight.
In The Watch by Dennis Danvers, radical Pyotr Kropotkin is brought forward from post-revolutionary Russia to the USA in 1999!
Another vote for HG Wells “The Time Machine”. Seriously, he wrote this in 1895-when Einstein was an obscure patent clerk in Switzerland.
Heinlein’s “The Door Into Summer” is a good (if dated) look at a one-way time trip.
Time After Time but I did not like the book to much.
If you want a movie Les visiteurs (The Visitors) a good French comedy about medieval people traveling in our time.
**Devil on the Road **by Robert Westall
C.M. Kornbluth wrote an interesting one, about a physicist at the Los Alamos laboratory (WWII)-he gets put into a trance by a Navajo shaman, and travels to a future (where Japan and Germany have won the war). His time travel/dream is quite unpleasant …fortunately, he wakes up in his own time.
I forget the title.
Not that it truly matters if you didn’t like the book, but it’s worth pointing out that All Clear was the second of two volumes, and I can’t imagine reading it without first having read its predecessor (Black-Out), since they’re essentially two halves of one long novel.
I love Connie Willis. In addition to those two and To Say Nothing of the Dog (which is one of my all-time favorites), her Doomsday Book is also an excellent story with a time-travel premise.
I just skimmed and didn’t see Michael Chriton’s Timeline mentioned. I really enjoyed that book a lot. MUCH better than the movie.
No love for “To Say Nothing of the Dog” by Connie Willis? 
Oops…2 posts above…
One of the 2 books I recommended is now for free on Amazon.
Io Deceneus Journal of a time traveler
This is the book presentation:
It is never easy to be a “dreamer” in search of things real life cannot provide, wandering in an imaginary existence that never becomes reality. On a quiet evening, a Gate is taking human shape and links him to a Faction, the final form of social evolution in a galaxy where all civilizations are human-like except for the Erins -a mysterious experiment representing the next level of intelligent life in a self-conscious Universe. A galaxy where Earth, enslaved by a ruthless financial system, is considered an example of failed civilization. He has to help a far away culture in its evolution from the Paleolithic to Industrial Age.
Many Factions disappeared in Universe’s past enhancements and they want now to control the Erins. When they can’t, they go for destruction, stealthily, as they are not allowed to directly interfere.
Rogue Factions are carefully preparing a war of annihilation. It is hard to start conflicts with peaceful people, so their society and economy have to be undermined. Earth’s “model” is used for subversion and he is the best choice to counter it.
And he will become Deceneus, the “far sighted”, challenging the reader to consider the subject of free will and winding timelines.
The book was edited by: WritersServices (Macmillan) Writers and Artists (Bloomsbury)
I have lots of love for that book, I re-read it every now and then.
I actually thought that AWiT would be a time travel story as a kid, and, when it wasn’t, I gave up and read a “better” book, a book written for my age that I absolutely do not remember.
To be fair, though, the last three books in that series involve time travel proper, though not in any scientific sense. Many Waters, A Swiftly Tilted Planet, and An Acceptable Time all involve time travel. Of the three, I prefer Many Waters, which is about Sandy and Denys being sent back to the time of Noah. (L’Engle seemed to become more and more explicitly Christian as the series progressed.)
Are you actually re-reading it, or, . . .no, I’ve said too much already.
The Anubis Gates, by Tim Powers.
Lightning, by Dean Koontz.
I also liked Replay, by Ken Grimwood, which has an unusual take on “time travel”.
Up the Line and The Door Into Summer, I’ll second. Haven’t read the other two.
Could be a little hard to find, since it came out in the 70s and apparently wasn’t that big, but The Mirror, by Marlys Millhiser. Combines “present-day person goes to the past” and “person from the past comes to the present” rather interestingly.
“Two Dooms” http://www.irosf.com/q/zine/article/10452
Another vote for Outlander - easily one of my favourite books of all time.