{"id":723,"date":"2013-04-10T14:33:38","date_gmt":"2013-04-10T13:33:38","guid":{"rendered":"http:\/\/www.ericlee.info\/blog\/?p=723"},"modified":"2013-04-10T14:33:38","modified_gmt":"2013-04-10T13:33:38","slug":"unicode-drupal-php-mysql-a-love-story-not","status":"publish","type":"post","link":"https:\/\/www.ericlee.info\/blog\/unicode-drupal-php-mysql-a-love-story-not\/","title":{"rendered":"Unicode, Drupal, PHP, MySQL: A love story (not)"},"content":{"rendered":"

I have been trying to do something fairly simple: I wanted to write a web page that could render well on a small screen (like a mobile phone) and which would display content from the IUF website<\/a>. \u00a0How hard could this be?<\/p>\n

Well, it shouldn’t have been hard.<\/p>\n

The content on the IUF site, which is handled by a content management system called Drupal, is stored in a MySQL database. \u00a0The characters are encoded as Unicode (UTF-8) — because that’s what you need to do when you have multilingual content on your site, and the IUF site works in Arabic, Chinese, Russian and many other non-Latin languages.<\/p>\n

So it should have been fairly simple to write a few lines of code in the widely-used PHP programming language to read news headlines from the IUF’s database and show them on screen.<\/p>\n

Except that it was showing gibberish every time there was an accented character.<\/p>\n

I posted a message calling for help on the Drupal forums. \u00a0(Not a big response there.) \u00a0I wrote to three very smart friends who understand these things and they all had good ideas, and pointed me in different directions, but to no avail. \u00a0Nothing was working. \u00a0One suggested that I give up. \u00a0I nearly did give up.<\/p>\n

And then I decided to search again, and found this page<\/a> where a programmer named “HoboTraveler” (I’m guessing that’s not his real name) encountered a similar problem on January 21st, 2008, more than five years ago. \u00a0He writes asking for help, gets loads of tips, tries a million things, nearly gives up, and then, dozens of comments later, he solves the problem.<\/p>\n

He writes:<\/p>\n

I think I got it to work with multiple databases!<\/p>\n

I’ve inserted the line:<\/p>\n

mysql_query(‘SET NAMES utf8’);<\/p>\n

just after the mysql_connect() and it seems to work.<\/p><\/blockquote>\n

So I thought, what the hell, I’ll try that. \u00a0I tried everything else. \u00a0And “HoboTraveler”, whoever you are, you made my day.<\/p>\n

Lesson of the story: sometimes life is hard. \u00a0And thank God for Google.<\/p>\n","protected":false},"excerpt":{"rendered":"

I have been trying to do something fairly simple: I wanted to write a web page that could render well on a small screen (like a mobile phone) and which would display content from the…<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[5],"tags":[],"class_list":["post-723","post","type-post","status-publish","format-standard","hentry","category-web-exclusive"],"_links":{"self":[{"href":"https:\/\/www.ericlee.info\/blog\/wp-json\/wp\/v2\/posts\/723","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.ericlee.info\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.ericlee.info\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.ericlee.info\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.ericlee.info\/blog\/wp-json\/wp\/v2\/comments?post=723"}],"version-history":[{"count":1,"href":"https:\/\/www.ericlee.info\/blog\/wp-json\/wp\/v2\/posts\/723\/revisions"}],"predecessor-version":[{"id":724,"href":"https:\/\/www.ericlee.info\/blog\/wp-json\/wp\/v2\/posts\/723\/revisions\/724"}],"wp:attachment":[{"href":"https:\/\/www.ericlee.info\/blog\/wp-json\/wp\/v2\/media?parent=723"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.ericlee.info\/blog\/wp-json\/wp\/v2\/categories?post=723"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.ericlee.info\/blog\/wp-json\/wp\/v2\/tags?post=723"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}