# Why do some places on the internet replace apostrophes with odd characters?

**URL:** <https://boards.straightdope.com/t/why-do-some-places-on-the-internet-replace-apostrophes-with-odd-characters/720889>\
**Category:** Factual Questions\
**Created:** [May 26, 2015, 4:23pm UTC](https://boards.straightdope.com/t/why-do-some-places-on-the-internet-replace-apostrophes-with-odd-characters/720889 "2015-05-26T16:23:02Z")\
**Posts on this page:** 20\
**Page:** 1

<div class="post-metadata">

**Author:** ![Just\_Asking\_Questions](https://avatars.discourse-cdn.com/v4/letter/j/ba9def/32.png) [@Just\_Asking\_Questions](https://boards.straightdope.com/u/Just_Asking_Questions)\
**Post date:** [May 26, 2015, 4:23pm UTC](https://boards.straightdope.com/t/why-do-some-places-on-the-internet-replace-apostrophes-with-odd-characters/720889/1 "2015-05-26T16:23:02Z")

</div>

I have seen this on and off, but I’m not sure what is going on.

Someone will attempt to post a word such as “railroad’s” and it comes out “railroadâ€™s”, consistently replacing the apostrophe with “â€™”.

What causes this? Why are some writings affected and not others? And why these characters?

Is this on the writer’s end, or the internet site hosting the test, or my end? I’ve seen it on message boards as well as “regular” websites.

---

<div class="post-metadata">

**Author:** ![Really\_Not\_All\_That\_Bright](https://avatars.discourse-cdn.com/v4/letter/r/e8c25b/32.png) [@Really\_Not\_All\_That\_Bright](https://boards.straightdope.com/u/Really_Not_All_That_Bright)\
**Post date:** [May 26, 2015, 4:34pm UTC](https://boards.straightdope.com/t/why-do-some-places-on-the-internet-replace-apostrophes-with-odd-characters/720889/2 "2015-05-26T16:34:33Z")

</div>

Oooh. Good question!

---

<div class="post-metadata">

**Author:** ![kayaker](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/kayaker/32/441_2.png) [@kayaker](https://boards.straightdope.com/u/kayaker)\
**Post date:** [May 26, 2015, 4:40pm UTC](https://boards.straightdope.com/t/why-do-some-places-on-the-internet-replace-apostrophes-with-odd-characters/720889/3 "2015-05-26T16:40:02Z")

</div>

> [@Really\_Not\_All\_That\_Bright](#):
>
> Oooh. Good question!

Yep. I haven’t a clue.

---

<div class="post-metadata">

**Author:** ![OldGuy](https://avatars.discourse-cdn.com/v4/letter/o/3bc359/32.png) [@OldGuy](https://boards.straightdope.com/u/OldGuy)\
**Post date:** [May 26, 2015, 4:40pm UTC](https://boards.straightdope.com/t/why-do-some-places-on-the-internet-replace-apostrophes-with-odd-characters/720889/4 "2015-05-26T16:40:34Z")

</div>

I believe that this is caused when if you use smart quotes, i.e., the curly of slanted quote marks and apostrophe that Word automatically uses and the font that’s rendering the page you see does not support this.

---

<div class="post-metadata">

**Author:** ![Lemur866](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/lemur866/32/434_2.png) [@Lemur866](https://boards.straightdope.com/u/Lemur866)\
**Post date:** [May 26, 2015, 4:54pm UTC](https://boards.straightdope.com/t/why-do-some-places-on-the-internet-replace-apostrophes-with-odd-characters/720889/5 "2015-05-26T16:54:05Z")

</div>

Yes, the problem is when the application you’re creating the words on substitutes the neutral ASCII quotes or apostrophes with directional quotes or apostrophes. And then when someone opens the text in an application or browser that doesn’t support the directional quote, it displays a mess instead.

This is why directional apostrophes are pure evil. Stop creating them, for crying out loud.

---

<div class="post-metadata">

**Author:** ![friedo](https://avatars.discourse-cdn.com/v4/letter/f/8edcca/32.png) [@friedo](https://boards.straightdope.com/u/friedo)\
**Post date:** [May 26, 2015, 5:00pm UTC](https://boards.straightdope.com/t/why-do-some-places-on-the-internet-replace-apostrophes-with-odd-characters/720889/6 "2015-05-26T17:00:07Z")

</div>

It’s not about the font, it’s about encoding.

If you’re using something shitty like MS Word to write web pages, the software is fond of auto-replacing the ’ character with curly-quotes that are encoded as a different value. The ASCII apostrophe has a value of 39. Curly apostrophes do not appear in the 7-bit ASCII character set, nor in the 8-bit ISO-8859-1 character set, which is a superset of ASCII. They _do_ appear in the 8-bit [Windows-1252](http://en.wikipedia.org/wiki/Windows-1252#Code_page_layout) character set, which perversely mirrors ISO-8859-1 except replaces a bunch of control codes with things like the curly quotes and the Euro sign.

So, why the string â€™ specifically?

If you take the right curly single quotation-mark character, which in Unicode exists at the codepoint U+2019, and you mistakenly encode this value in Windows-1252 encoding, you get the bytes 226, 128, and 153, which correspond to the Windows-1252 characters â€™.

---

<div class="post-metadata">

**Author:** ![Heracles](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/heracles/32/487_2.png) [@Heracles](https://boards.straightdope.com/u/Heracles)\
**Post date:** [May 26, 2015, 5:01pm UTC](https://boards.straightdope.com/t/why-do-some-places-on-the-internet-replace-apostrophes-with-odd-characters/720889/7 "2015-05-26T17:01:58Z")

</div>

There are a few ways to encode an apostrophe in Unicode. The traditional one is code point U+0027, directly equivalent to the ASCII apostrophe.

What you’re seeing is U+2019, [Right single quotation mark](http://www.fileformat.info/info/unicode/char/2019/index.htm). If you look at that page, you can see that its encoding in UTF-8 is 0xE2 0x80 0x99.

It so happens that :  
U+00E2 = â  
U+0080 = €  
U+0099 = ™

As for where the error came from, it’s probably the author of the Web page who didn’t encode things correctly. Possibly they forgot to check the encoding when exporting the text from their text editor to HTML.

---

<div class="post-metadata">

**Author:** ![Derleth](https://avatars.discourse-cdn.com/v4/letter/d/b9e5f3/32.png) [@Derleth](https://boards.straightdope.com/u/Derleth)\
**Post date:** [May 26, 2015, 5:15pm UTC](https://boards.straightdope.com/t/why-do-some-places-on-the-internet-replace-apostrophes-with-odd-characters/720889/8 "2015-05-26T17:15:02Z")

</div>

> [@Lemur866](#):
>
> This is why directional apostrophes are pure evil. Stop creating them, for crying out loud.

No. Typography shouldn’t bow to temporary technical limitations. Character encoding standards are here, they’re widely-implemented, and they’re not going away.

You’re naïve if you imagine that a small number of 20ᵗʰ Century reactionaries will be able to keep computerized text in the typewriter age. ¡Viva el estándar Unicode!

---

<div class="post-metadata">

**Author:** ![Just\_Asking\_Questions](https://avatars.discourse-cdn.com/v4/letter/j/ba9def/32.png) [@Just\_Asking\_Questions](https://boards.straightdope.com/u/Just_Asking_Questions)\
**Post date:** [May 26, 2015, 6:51pm UTC](https://boards.straightdope.com/t/why-do-some-places-on-the-internet-replace-apostrophes-with-odd-characters/720889/9 "2015-05-26T18:51:20Z")

</div>

Thanks for the quick explanation.

So it would seem that when you see this it is because the original text was composed in MS word and moved over without checking the encoding?

---

<div class="post-metadata">

**Author:** ![friedo](https://avatars.discourse-cdn.com/v4/letter/f/8edcca/32.png) [@friedo](https://boards.straightdope.com/u/friedo)\
**Post date:** [May 26, 2015, 6:53pm UTC](https://boards.straightdope.com/t/why-do-some-places-on-the-internet-replace-apostrophes-with-odd-characters/720889/10 "2015-05-26T18:53:04Z")

</div>

This _particular_ mis-encoding happens when the curly-quote is encoded as UTF-8, but served by something that _thinks_ it’s in Windows-1252.

---

<div class="post-metadata">

**Author:** ![Saint\_Cad](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/saint_cad/32/18907_2.png) [@Saint\_Cad](https://boards.straightdope.com/u/Saint_Cad)\
**Post date:** [May 26, 2015, 7:15pm UTC](https://boards.straightdope.com/t/why-do-some-places-on-the-internet-replace-apostrophes-with-odd-characters/720889/11 "2015-05-26T19:15:47Z")

</div>

> [@Lemur866](#):
>
> This is why directional apostrophes are pure evil. Stop creating them, for crying out loud.

I concur if you are sending me stuff to put on the website and I ask for text file and you decide to “help me out” by sending me a Word doc.

To answer the OP, this is probably what happened and the web manager didn’t catch and change it.

---

<div class="post-metadata">

**Author:** ![leahcim](https://avatars.discourse-cdn.com/v4/letter/l/b4bc9f/32.png) [@leahcim](https://boards.straightdope.com/u/leahcim)\
**Post date:** [May 26, 2015, 7:43pm UTC](https://boards.straightdope.com/t/why-do-some-places-on-the-internet-replace-apostrophes-with-odd-characters/720889/12 "2015-05-26T19:43:19Z")

</div>

> [@friedo](#):
>
> This _particular_ mis-encoding happens when the curly-quote is encoded as UTF-8, but served by something that _thinks_ it’s in Windows-1252.

Is this the kind of thing that can be fixed by declaring an encoding in your HTML like this [article](http://www.w3.org/International/questions/qa-html-encoding-declarations.en) describes?

---

<div class="post-metadata">

**Author:** ![friedo](https://avatars.discourse-cdn.com/v4/letter/f/8edcca/32.png) [@friedo](https://boards.straightdope.com/u/friedo)\
**Post date:** [May 26, 2015, 7:55pm UTC](https://boards.straightdope.com/t/why-do-some-places-on-the-internet-replace-apostrophes-with-odd-characters/720889/13 "2015-05-26T19:55:49Z")

</div>

> [@leahcim](#):
>
> Is this the kind of thing that can be fixed by declaring an encoding in your HTML like this [article](http://www.w3.org/International/questions/qa-html-encoding-declarations.en) describes?

It depends. The problem might be caused by the web server sending the wrong content encoding header (in which case overriding that in the HTML might work (but the better solution is to fix the server config.)) But it can also be caused by something earlier in the chain server-side, like a misconfigured database, which is sending out stuff in the wrong encoding, or badly-written server-side code, which is failing to properly decode stuff from the filesystem or database.

Sometimes encoding problems can be notoriously difficult to track down.

---

<div class="post-metadata">

**Author:** ![Hermitian](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/hermitian/32/470_2.png) [@Hermitian](https://boards.straightdope.com/u/Hermitian)\
**Post date:** [May 26, 2015, 7:58pm UTC](https://boards.straightdope.com/t/why-do-some-places-on-the-internet-replace-apostrophes-with-odd-characters/720889/14 "2015-05-26T19:58:37Z")

</div>

My question in all this is why have we been seeing this on the web for like 15 years? Can’t the browsers or someone make it so that it works right?  
Is this an unfixable problem?

---

<div class="post-metadata">

**Author:** ![Acsenray](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/acsenray/32/4519_2.png) [@Acsenray](https://boards.straightdope.com/u/Acsenray)\
**Post date:** [May 26, 2015, 8:04pm UTC](https://boards.straightdope.com/t/why-do-some-places-on-the-internet-replace-apostrophes-with-odd-characters/720889/15 "2015-05-26T20:04:50Z")

</div>

> [@Derleth](#):
>
> No. Typography shouldn’t bow to temporary technical limitations.

Hear! Hear! Bravo.

---

<div class="post-metadata">

**Author:** ![friedo](https://avatars.discourse-cdn.com/v4/letter/f/8edcca/32.png) [@friedo](https://boards.straightdope.com/u/friedo)\
**Post date:** [May 26, 2015, 8:11pm UTC](https://boards.straightdope.com/t/why-do-some-places-on-the-internet-replace-apostrophes-with-odd-characters/720889/16 "2015-05-26T20:11:57Z")

</div>

> [@Hermitian](#):
>
> My question in all this is why have we been seeing this on the web for like 15 years? Can’t the browsers or someone make it so that it works right?  
> Is this an unfixable problem?

Guessing at character encodings is far more problematic than just rendering the crap that you’re given. Every shitty browser bug in history has been caused by trying to use flawed heuristics to guess what the author “really means.”

---

<div class="post-metadata">

**Author:** ![GusNSpot](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/gusnspot/32/436_2.png) [@GusNSpot](https://boards.straightdope.com/u/GusNSpot)\
**Post date:** [May 26, 2015, 9:23pm UTC](https://boards.straightdope.com/t/why-do-some-places-on-the-internet-replace-apostrophes-with-odd-characters/720889/17 "2015-05-26T21:23:36Z")

</div>

So, this is why when I use a **shift 7** I get this **&** in the posted post but shows as a normal **and** symbol in the post reply window?

Or it it because I don’t use IE or Chrome or \_\_\_\_\_\_ ???

It looks normal when I type in while composing the post but displays incorrectly in the actual post.

Huh??? 😕

---

<div class="post-metadata">

**Author:** ![Chronos](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/chronos/32/134_2.png) [@Chronos](https://boards.straightdope.com/u/Chronos)\
**Post date:** [May 26, 2015, 9:27pm UTC](https://boards.straightdope.com/t/why-do-some-places-on-the-internet-replace-apostrophes-with-odd-characters/720889/18 "2015-05-26T21:27:54Z")

</div>

That is a normal “and” symbol.

---

<div class="post-metadata">

**Author:** ![LSLGuy](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/lslguy/32/5813_2.png) [@LSLGuy](https://boards.straightdope.com/u/LSLGuy)\
**Post date:** [May 26, 2015, 9:31pm UTC](https://boards.straightdope.com/t/why-do-some-places-on-the-internet-replace-apostrophes-with-odd-characters/720889/19 "2015-05-26T21:31:59Z")

</div>

Gus: What do you mean by “It looks normal when I type in while composing the post but displays incorrectly in the actual post.”?

As far as I can see the symbol in your post is an ampersand. There are many shapes of ampersand, just like there are many shapes of the letter “A”. Each font draws the letters and symbols as slightly different shapes.

The font used inside the text input box and the font used to display posts are different on the SDMB. Which is a pretty common thing to see in web forms.

The fact the ampersand is a different shape has nothing to do with the issue that the OP is asking about.

---

<div class="post-metadata">

**Author:** ![Derleth](https://avatars.discourse-cdn.com/v4/letter/d/b9e5f3/32.png) [@Derleth](https://boards.straightdope.com/u/Derleth)\
**Post date:** [May 26, 2015, 9:38pm UTC](https://boards.straightdope.com/t/why-do-some-places-on-the-internet-replace-apostrophes-with-odd-characters/720889/20 "2015-05-26T21:38:46Z")

</div>

> [@GusNSpot](#):
>
> So, this is why when I use a **shift 7** I get this **&** in the posted post but shows as a normal **and** symbol in the post reply window?

& is in ASCII. Every Internet-connected Web-browsing computer on Earth agrees what byte to interpret as the & character. This is down to either a font difference or incipient insanity on your part, and right now, your description of what’s confusing you isn’t enough to rule out either.

I can explain fonts. Nobody can fully explain insanity.

[Next page](https://boards.straightdope.com/t/why-do-some-places-on-the-internet-replace-apostrophes-with-odd-characters/720889.md?page=2)
