UTF-8 Unicode vs. other encodings over time

Some eight years ago UTF-8 (Unicode) became the most used encoding on Web pages. At the time, though, it was used on only about 26% of Web pages, so it had a plurality but not an absolute majority.

Graph showing growth of the UTF-8 encoding

By the beginning of 2010 Unicode was rapidly approaching use on half of Web pages.
graph showing a steep rise in the use of UTF-8 and a steep decline in other major encodings

In 2012 the trends were holding up.

Note that the 2008 crossover point appears different in the latter two Google graphs, which is why I’m showing all three graphs rather than just the third.

A different source (with slightly different figures) provides us with a look at the situation up to the present, with UTF-8 now on 85% of Web pages. Expansion of UTF-8 is slowing somewhat. But that may be due largely to the continuing presence of older websites in non-Unicode encodings rather than lots of new sites going up in encodings other than UTF-8.
growth in Unicode UTF-8 encoding on Web pages, 2010-2015

Here’s the same chart, but focusing on encodings (other than UTF-8) that use Chinese characters, so the percentages are relatively low.

And here’s the same as the above, but with the results for individual languages combined.

By the way, Pinyin.info has been in UTF-8 since the site began way back in 2001. The reason that Chinese characters and Pinyin with tone marks appear scrambled within Pinyin News is that a hack caused the WordPress database to be set to Swedish (latin1_swedish_ci), of all things. And I haven’t been able to get it fixed; so just for the time being I’ve given up trying. One of these days….


Pinyin font: Skarpa

Today’s Pinyin-friendly font is Skarpa, by Aga Silva of Poland. It’s a bit quirky (e.g., second-tone o’s and lowercase q’s) but still sharp.

Hanyu Pinyin pangram using the Skarpa font

Skarpa was later modified into Skarpa 2, which is not free but which comes in several weights and types.

Most of Silva’s other fonts also can handle Pinyin with tone marks. Those are all commercial rather than free.

Popularity of Chinese character country code TLDs

Yesterday we looked at the popularity of the Chinese character TLD for Singapore Internet domains. Today we’re going to examine the Chinese character ccTLDs (country code top-level domains) for those places that use Chinese characters and compare the figures with those for the respective Roman alphabet TLDs.

In other words, how, for example, does the use of taiwan in traditional Chinese characters   .台灣 domains compare with the use of .tw domains?

Since, unlike the case with Singapore, I don’t have the registration figures, I’m having to make do with Google hits, which is a different measure. For this purpose, Google is unfortunately a bit of a blunt instrument. But at least it should be a fairly evenhanded blunt instrument and will be useful in establishing baselines for later comparisons.

A few notes before we get started:

  • Japan has yet to bother with completing the process for its own name in kanji (Japan, as written in kanji / Chinese characters), so it is omitted here.
  • Macau only recently asked for aomen in simplified Chinese characters    
  .澳门 and aomen in traditional Chinese characters    
  .澳門, so those figures are still at zero.
  • Oddly enough, there’s no taiwan_super in traditional Chinese characters   
  .臺灣 ccTLD, even though the Ma administration, which was in power when Taiwan’s ccTLDs went into effect, officially prefers the more complex form of taiwan_super in traditional Chinese characters   
  .臺灣 to taiwan in traditional Chinese characters   .台灣 — not to mention prefering it to taiwan in simplified Chinese characters    
  Google Hits Percent of Total
.mo 18400000 100.00
aomen in simplified Chinese characters    
  .澳门 0 0.00
aomen in traditional Chinese characters    
  .澳門 0 0.00
.tw 206000000 99.86
taiwan in simplified Chinese characters    
  .台湾 67600 0.03
taiwan_super in traditional Chinese characters   
  .臺灣 0 0.00
taiwan in traditional Chinese characters   .台灣 230000 0.11
.hk 193000000 99.94
xianggang  in Chinese characters 
  .香港 118000 0.06
.sg 97800000 100.00
xinjiapo  in Chinese characters 
  .新加坡 2 0.00
.cn 315000000 99.61
zhongguo in simplified Chinese characters  
  .中国 973000 0.31
zhongguo in traditional Chinese characters   
  .中國 251000 0.08

So in no instance does the Chinese character ccTLD reach even one half of one percent of the total for any given place.

Here are the results in a chart.

Graph showing that although China leads in domains in Chinese characters, they do not reach even one half of one percent of the total for China

Note that the ratio of simplified:traditional forms in China and Taiwan are roughly mirror images of each other, as is perhaps to be expected.

See also Platform on Tai, Pinyin News, December 30, 2011

Popularity of the Chinese character TLD for Singapore Internet domains

For quite a few years Singapore has had several choices for those wishing to register Singapore-specific domain names, including .com.sg, .net.sg,, .org.sg, .edu.sg, .gov.sg, .per.sg, and just .sg.

Of those, .sg is a top-level domain (TLD), whereas .com.sg, .net.sg,, .org.sg, .edu.sg, .gov.sg, and .per.sg are second-level domains. This post is mainly concerned with TLDs; but when I’m giving totals I also include .com.sg, .net.sg,, .org.sg, .edu.sg, .gov.sg, and .per.sg but exclude specific domains such as groupon.sg. OK, now back to the post.

Although English is the dominant language of Singapore, it is but one of four official languages there, along with Mandarin, Malay, and Tamil, with Mandarin (along with other Sinitc languages) being the most common of the latter three. Some three-quarters of the city-state’s population is ethnic Chinese, and around half of that group speak Mandarin as the main language in their homes. In addition, for decades Singapore has promoted its campaign to Strike Hard Against Hoklo, Cantonese, and Other Languages that Your Government Says Are Puny and Insignificant Because They Have Only Tens of Millions of Speakers Apiece Speak Mandarin.

So you might think that four years ago, when Singapore introduced Singapore’s name in Chinese characters ('Singapore' (Xinjiapo) in Chinese characters) as a top-level Internet domain (TLD), many in that multilingual society might jump at the chance to pick up some domain names ending with “Singapore” in Chinese characters. (Oh, it hurts me to use images instead of real text there; but until I get the hack fixed, that’s what I’m stuck with.)

Let’s take a look at what happened when the gates opened.

In September 2011, the first month that dot-Xinjiapo (.'Singapore' (Xinjiapo) in Chinese characters) domains became available, a total of 86 were registered. That’s not much of a land rush. The next month and the month after that saw no new registrations. But, OK, maybe they had a sunrise period limiting things. What happened later?

In December 2011 the number jumped to 218. This figure grew over the year 2012 to an all-time high that October of … 247 domains using the .'Singapore' (Xinjiapo) in Chinese characters TLD. Just 247. During the same month, Singapore had 143,887 registered domains, meaning that at the high point those with the Chinese character TLD were less than one fifth of one percent of the total. Since then, the number has fallen to a mere 210, with the percentage dropping to less than one eighth of one percent of the total.

Let’s look at this over time:

A Google search for the .'Singapore' (Xinjiapo) in Chinese characters domains reveals that those domains are even less used than the already astonishingly low registration numbers might indicate.

results of a Google search for  .??? domains

So that’s a total of two active dot-Xinjiapo domains, one of which is for sale. In other words, basically there’s just one being used. Ouch. That’s about as close to utter insignificance as a Singapore TLD can get.

Indeed, the only sort of Singapore-related domain that is of even less interest to the netizens of Singapore is one within the dot-Cinkappur TLD, with Singapore written in the Tamil script: 'Singapore' as written in Tamil

Dot-Cinkappur (.'Singapore' as written in Tamil) domains have been available since December 2011, which is just a few months after the introduction of dot-Xinjiapo domains. The middle of 2015 saw the all-time record high in dot-Cinkappur domain registrations: sixteen. Since then the number has dropped to just fifteen.

A search on Google for dot-Cinkappur domains reveals zero active sites.

source: Registration Statistics, Singapore Network Information Centre (SGNIC), accessed October 27, 2015

See also: sg domain names in Chinese characters lag, Pinyin News, June 23, 2010.

AP language exams and Chinese in U.S. high schools

Today I’m continuing my look at the U.S. high school Advanced Placement foreign language exams, focusing especially on the AP exam in Chinese Language and Culture. (See also AP exams: using highest and lowest scores to look at the case of Chinese.)In the graphs below, “Chinese” is the first column on the left.

The first and obvious point from graphing the numbers of high school students from the class of 2015 who took an AP foreign language exam is the dominance of Spanish. Combined, the exams for Spanish Language and Spanish Literature outnumber all of the other language exams put together … times three.


Now let’s look at the figures above broken down into the grade during which people took the exam. As you can see, there’s something different about when people take the Chinese exam. For all other foreign languages, most people take the exam their senior year. But the Chinese Language and Culture exam is most often taken by juniors.


That’s a little lopsided. So let’s take Spanish and Spanish Lit. out of the mix so we can compare the other languages more easily.

In just a few years Chinese has grown to be the third-most popular AP foreign language exam, behind Spanish and French. OK: way, way behind Spanish and about half of the number that French has. And Chinese comes in fourth if you count Spanish Literature. Still, Chinese now has more test takers than German. And it has more than Latin, Italian, and Japanese put together. But — you knew there’d be a but — the numbers for the AP Chinese Language and Culture exam are relatively large because most of the people who take it already know the language and didn’t learn it in an AP class. That is reflected in the charts above showing when people took the exam. (Note that Spanish also has a relatively high number of juniors taking the exam.)

The closest measure we have for native speakers and others with a much higher level of exposure to the language in question than other students is what students indicate themselves to the College Board on their answer sheets. Here’s how the College Board defines a “standard” student: They “generally receive most of their foreign language training in U.S. schools. They did not indicate on their answer sheet that they regularly speak or hear the foreign language of the exam, or that they have lived for one month or more in a country where the language is spoken.”

Here are the numbers for “standard” students in 2015 across various languages.


In this, Chinese drops from third place to fifth, behind Spanish, French, Latin (which is without a question on the standard group), and German, but still ahead of Italian and Japanese. When all test-takers are considered, AP exams in French outnumber those in Chinese by a little less than 2:1, which sounds very impressive (and, to some degree, it is). But when only the standard groups are considered, AP exams in French outnumber those in Chinese by more than 7:1.

Later in this series, we’ll look further at both the standard group and those not in it.

Emoji, language, and translation

A couple of days ago the New York Times ran a small piece, “How Emojis Find Their Way to Phones.” It contains the sort of nonsense about Chinese characters and language that often sets me off.

Fortunately, Victor Mair quickly posted something on this. J. Marshall Unger (Ideogram: Chinese Characters and the Myth of Disembodied Meaning, The Fifth Generation Fallacy, and Literacy and Script Reform in Occupation Japan) and S. Robert Ramsey (The Languages of China) quickly followed. But since those are in the comments to a Language Log post and thus may not be seen as much as they should be, I thought I’d link to them here.

The Language Log post itself is on Emoji Dick, which is billed as a translation of Moby Dick into emoji. As long as I’m writing, I might as well offer up a sample for you. See if you can determine the original English.


Did you try “Call me Ishmael”? Sorry. That’s not it. But if you guessed that I would choose the passage from Moby Dick that mentions Taiwan, give yourself bonus points.

Here’s what the above emoji supposedly translate:

Hereby the casks are sought to be kept damply tight; while by the changed character of the withdrawn water, the mariners readily detect any serious leakage in the precious cargo.

Now, from the South and West the Pequod was drawing nigh to Formosa and the Bashee Isles, between which lies one of the tropical outlets from the China waters into the Pacific.

Ah, of course. It’s all so clear now.

The next time you hear someone use “pictorial language,” “ideographs,” or the like in all seriousness, perhaps ask them for their own English translation of the above string of images.

Actually, Emoji Dick screwed this up some, as part belongs to the main text and part to a footnote.