And, like the Rosetta Stone and several other multilingual inscriptions, you could provide a future linguist the key to deciphering a “lost” language. For example, maybe the Hungarian language will be lost in the terrible persecutions committed by the Hispano-Polski-Danish Alliance between AD 4205 and AD 4390 and a future linguist will be able to compare your Hungarian inscription with your corresponding German and Chinese inscriptions (which they can read), and publish a new theory on how the long-lost Hungarian language was probably somewhat related to the language of the nomadic Neo-Finns that is spoken in some of the outlying colonies of the Reborn Republic of New New New Netherlands.
I remember reading a similar article back in the now defunct Omni magazine. I remember being fascinated by it because any kind of solution involved thinking not only about physical materials, but societal/cultural beliefs.
I’ll see your 4,000 years and raise you 8,000 years. Though they predate written language, the animistic totems at Gobekli Tepe are over 12,000 years old.
I really like the internally laser-etched glass idea! Sort of a statement of the level of technology of our time, could be small, and nearly indestructible except breakage.
Fired ceramics are good too but breakable and limited in how much info you could write.
If protected from abrasion, an engraved tablet made of polyethylene, polypropylene, or acetal (Delrin) is nearly much impervious to any chemical action.