{"id":332,"date":"2010-06-15T18:04:33","date_gmt":"2010-06-15T12:34:33","guid":{"rendered":"http:\/\/blog.pothi.com\/?p=332"},"modified":"2010-06-15T18:04:33","modified_gmt":"2010-06-15T12:34:33","slug":"indian-language-typing-on-computer","status":"publish","type":"post","link":"https:\/\/pothi.com\/blog\/2010\/06\/15\/indian-language-typing-on-computer\/","title":{"rendered":"Indian Language typing on Computer"},"content":{"rendered":"

Characters and Fonts<\/h3>\n

Before getting into Indian Language typing, let’s understand how does the computer understand what we type. We will understand this with the help of examples from English typing, since that is the language best handled by and understood on computers.<\/p>\n

Computer understands individual characters. All letters, numbers, symbols are a character to the computer.\u00a0 ‘A’ is a character, ‘a’ is another character, “,” (comma) is another character and so on.<\/p>\n

Then there are fonts, which tell the computer how to display a particular character. So, the same set of characters “Pothi.com” will appear different in different fonts.<\/p>\n

\"Pothi<\/a>As you can see, “P” is displayed by the font “Times New Roman” is different from the “P” displayed by the font “Arial”, which in turn is different from the “P” displayed by the font “Monotype Corsiva”. Similar is the case with other characters like “o”, “t” etc.<\/p>\n

What is important here is that computer still knows that a “P” is a “P”, irrespective of the font it is displayed in. That’s why when you use the “Find” or “Search” feature while typing, it will find you the word\/character you searched for, irrespective of how the font displays it. In fact, the underlying system that recognizes what character it is, does not care at all as to how the font displays it. In the following image, the first line in “Pothi.com” in a font called “MT Extra”. The second line is the name of the font!<\/p>\n

\"Pothi<\/a>As you can see, the display makes no sense for an English reading human. But the computer does not care.<\/p>\n

What this means is, that you can design a font, that displays certain English characters as certain letter in one of the Indian languages. We’ll take Hindi as an example.<\/p>\n

The same set of characters “Pothi.com” in a font called “Kruti Dev 010” become the following<\/p>\n

\"Pothi<\/a>Of course, it does not look anything like “Pothi.com” to English readers. Hindi readers can see Hindi alphabets (it’s not a meaningful combination). But to the computer, it is “Pothi.com”.<\/p>\n

However, with this font to my aide, I can now concoct certain character combination, which would look like meaningful Hindi words to Hindi Readers. For example character set “dje #i” generated the following<\/p>\n

\"Meaningful<\/a>Hindi Readers can identify meaningful words here. Even though for the computer it is just “dje #i”.<\/p>\n

This is one way of typing Hindi. And most of the Hindi Books are typeset in this way, using one of the fonts, that display an English character as a Hindi letter.<\/p>\n

When the ultimate aim is to print, this method works just fine. Once the book is printed, nobody cares what the original character stored in the computer was.<\/p>\n

But this method has issues – big ones. For example<\/p>\n

    \n
  1. No standardization: When you don’t have characters assigned for the letters of your language in the computer, each font developer is free to decide which character should be displayed like which letter. So, one font decides to display “A” as “\u0905” and the other font decides to display “d” as “\u0905”. What do you do then? In English, you can write something and then change the font at the click on a button. But in Hindi, if you change the font after writing, you will get totally different letters displaying on the screen, which are likely to be meaningless. Plus for each font you have to learn the typing all over again!Lack of standardization is also a problem in the Internet World. If you type the content in one font and send it to someone, the recipient has to have the same font on his computer, in order to see the meaningful text you have written. Any other font will not do. Compare this to English, where you may type in one font and the other person may not have that font. But he can still read it, because whatever English font he has understands the underlying characters and displays the correct letters for an English reader.<\/li>\n
  2. Not searchable: In this system, the computer does not understand underlying characters of Hindi language. It is just the English language characters wearing a different look as far as the computer is concerned. So, there is no good way of searching through this content. In the Internet age, this is a major disadvantage. A lot of content available on Internet today is discovered only by search and if you want your content to be discovered, it is important that it is typed in a way so that it is searchable.<\/li>\n<\/ol>\n

    Unicode<\/h3>\n

    It is to solve such problems that Unicode has come into picture. You can think of Unicode as something which enables computers to understand characters beyond English language. So, if your computer supports Unicode, it starts understanding not only the characters corresponding to “A”, “d”, “,” etc. but also the ones for “\u0915\u094d”, “\u0905” etc. And it’s not just the Indian languages, but it starts understanding characters corresponding to Chinese, Japanese, Arabic, Russian and most other major languages of the world!<\/p>\n

    So, with this you do not need to represent a random English character as a Hindi letter. The characters are available for Hindi and the font can now display those characters as the corresponding Hindi letters. Such fonts are called “Unicode compatible fonts”. To repeat, Unicode compatible Hindi fonts are the ones which do not represent an English characters as a Hindi letter, but which represent the Hindi characters as corresponding Hindi letters.<\/p>\n

    Typing and Input Method Editors (IMEs)<\/h3>\n

    So far, so good. Computer, somehow, understands the characters for Hindi and other languages. But how do you type in those languages? Your keyboard still has only English letters on it. So, when you press the key labeled “A”, the computer knows that you want to type the character “a”. But how do you tell the computer that you want to type the character “\u0905”.<\/p>\n

    Multi-language keyboards are a design challenge, and at least for Indian languages, nothing great has come out. So, different ways have been devised to use the same English keyboard for inputting non-English characters. To\u00a0 understand how these work, let’s consider this. As far as the computer is concerned (“A” and “a”) are two different characters. But from the keyboard, the same button is used to type either of them. How? “A” gets typed if either CAPS LOCK is on or the Shift key is pressed. Otherwise, it is “a” that gets typed. So, the computer decides that the character typed is “A” or “a” depending not only on the key pressed, but also depending on the state of CAPS LOCK and Shift key.<\/p>\n

    Following a similar tactic, we can give the computer some other signal that when the key labeled “A” is pressed, you have to enter neither “a”, nor “A”, but “\u0905”. How to give that signal? For that there are multiple methods. Basically computer programs have been created, that come in between the keyboard and computer storing the characters and depending on certain signals tell the computer which character has been entered. These programs are typically called “Input Method Editor (IME)”.<\/p>\n

    These IMEs do two things<\/p>\n

      \n
    1. They give you a way to specify the language you will be typing in<\/li>\n
    2. They assign particular keys on the keyboard to particular characters, depending on the language selected<\/li>\n<\/ol>\n

      Two examples of IMEs for Indian Languages are<\/p>\n

        \n
      1. Microsoft’s Indic Language IME<\/a><\/li>\n
      2. Google’s Indic IME<\/a><\/li>\n<\/ol>\n

        I have the first one installed on my computer and I’d use that as an example to illustrate how IME works. Once I install and configure Microsoft’s Indic IME for Hindi, I get a language selection button my taskbar\"Microsoft<\/a><\/p>\n

        If I select, English here, then things work as usual. If I select Hindi, then pressing Shift+D on my keyboard types “\u0905” instead of “D”. Pressing “j” types “\u0930” and so on. I can keep switching the language and type a piece of text which uses both the languages (as I am doing now).<\/p>\n

        To use an Indic IME like this, you still need to learn the key combinations that type the right characters for you. This combination may vary between different IMEs. In fact, even the same IME may provide you with different options for mapping of keys to characters. Microsoft’s Indic IME provides at least two such combinations for Hindi. One is called “INSCRIPT” layout, which I use (the key-character combinations I described in the previous paragraph was according to this layout). The other is Phonetic and as the name suggests, its key-character bindings are more phonetic; e.g. (A will “\u0905”, R will be “\u0930” and so on).<\/p>\n

        But the advantage over the earlier scheme of using non-Unicode compatible font is that once you have learned to use one IME, you can use any Unicode compatible font. You don’t need to learn the map for every font separately. Plus you text is standard compliant and searchable!<\/p>\n

        Google’s Transliteration Technology – Saviour for beginners!<\/h3>\n

        If you are a beginner with Hindi typing, you would probably want to use an IME with Phonetic key-character combination. For example, where “A” typed “\u0905”, R types “\u0930” etc. It is easier than using other combinations where the mapping may be very arbitrary.<\/p>\n

        But you still need to learn the exact key combinations for typing something. If you need to type Pothi (\u092a\u094b\u0925\u0940) in Hindi, do you type “Pothi” or “Pothee” or “Pothii”. With most IMEs only one of these will work.<\/p>\n

        Google’s IME is different here. It works more intelligently. Instead of assigning fix keys to the characters, it guesses the correct word from the combination you have entered. Basically from the various words you could possibly write, it guesses the word based on grammatical correctness and frequency of use in languages. If it guesses the wrong word, you have a way to change it to different word. In Google Transliteration all three “Pothi”, “Pothee” and “Pothii” produce the same (and correct) word \u092a\u094b\u0925\u0940.<\/p>\n

        So, you can essentially type words and so long as it is close phonetically, this IME will find the suitable word for you. This makes it a great tool for beginners. You can get started right away, write Hindi the way you do while chatting with your friends or in SMS and start getting output in a Unicode compatible\u00a0 font.<\/p>\n

        Google actually has an online service for this – http:\/\/www.google.co.in\/transliterate . So you don’t even have to download and install anything.<\/p>\n

        All is not well here though. Once you start typing in Hindi regularly, you will start feeling the limitations of Google Transliteration. We will not get into the details here. But if that happens at some point, it may make sense to invest some time in learning another IME, which uses fixed combinations.<\/p>\n

        Complex Text Layout (CTL)<\/h3>\n

        There is one major difference between Hindi (most Indian Languages) and English. In fact even between Hindi and Russian, Hindi and Chinese or Hindi and Japanese. The representation of a character changes depending on the context in Hindi and many other Indian languages. The representation of “\u0926\u094d”, for example is different in words \u0924\u0926\u094d\u092d\u0935 and \u0935\u093f\u0926\u094d\u092f\u093e. One has “\u0926\u094d” before “\u092d” and the other has “\u0926\u094d” before “\u092f”. Compare this to English where how “d” is displayed does not depend on which letter comes before and after it. So, for displaying Hindi correctly the computer needs to understand all possible ways of displaying the characters under different contexts. The technical term for this is “Complex Text Layout”. Most computers with modern operating systems have this ability now and in all likelihood, you will not have to do anything special about it. But if you find a problem in display where a character is identified correctly, but is not displayed correctly, then you would know that it is an issue with computer not understanding “Complex Text Layout”.<\/p>\n

        In Windows XP and Vista, the complex text layout is enabled by default. In Windows 2000, you needed to enable it specifically. I have not tested it on Windows 7, but hopefully things should not go retrograde.<\/p>\n

        Finally<\/h3>\n

        The description here is intended for a non-technical audience. Many concepts have been simplified and a purist technical person may be tempted to correct my usage of various terms (“You mean OS when you say computer!”). Let me just clarify that it is totally intentional. I just hope it has not become too technical for the non-technical audience \ud83d\ude42<\/p>\n

        Questions are welcome as comments!<\/p>\n","protected":false},"excerpt":{"rendered":"

        Characters and Fonts Before getting into Indian Language typing, let’s understand how does the computer understand what we type. We will understand this with the help of examples from English typing, since that is the language best handled by and understood on computers. Computer understands individual characters. All letters, numbers, symbols are a character to … Continue reading “Indian Language typing on Computer”<\/span><\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"spay_email":"","jetpack_publicize_message":"","jetpack_is_tweetstorm":false},"categories":[16],"tags":[],"jetpack_featured_media_url":"","jetpack_publicize_connections":[],"jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p7vAZr-5m","jetpack-related-posts":[{"id":5764,"url":"https:\/\/pothi.com\/blog\/2023\/06\/12\/creating-unforgettable-characters-a-guide-for-authors\/","url_meta":{"origin":332,"position":0},"title":"Creating Unforgettable Characters: A Guide for Authors","date":"June 12, 2023","format":"image","excerpt":"Creating exceptional characters lies at the heart of every successful story. Whether you're crafting a thrilling mystery, a heartwarming romance, or an epic fantasy, the strength of your characters can make or break your book. In this blog post, we will delve into the art of developing great characters that\u2026","rel":"","context":"In "Author Resources"","img":{"alt_text":"","src":"https:\/\/i1.wp.com\/pothi.com\/blog\/wp-content\/uploads\/2023\/06\/children-ge60005a90_1280-270x300.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":4194,"url":"https:\/\/pothi.com\/blog\/2016\/06\/22\/how-to-write-a-good-plot\/","url_meta":{"origin":332,"position":1},"title":"How to Write a Good Plot","date":"June 22, 2016","format":false,"excerpt":"The plot is the masterpiece of a novel. It\u2019s the hidden scaffolding on which a writer builds his palce. So how do you make a good one? What the masters wrote: You must of heard of Joseph Campbell\u2019s archetypes. Go through this link to understand more about typical protagonist situations\u2026","rel":"","context":"In "Writing"","img":{"alt_text":"","src":"https:\/\/upload.wikimedia.org\/wikipedia\/commons\/thumb\/a\/af\/Freytags_pyramid.svg\/2000px-Freytags_pyramid.svg.png","width":350,"height":200},"classes":[]},{"id":4679,"url":"https:\/\/pothi.com\/blog\/2019\/08\/12\/interview-anil-cs-rao\/","url_meta":{"origin":332,"position":2},"title":"Interview: Anil CS Rao","date":"August 12, 2019","format":false,"excerpt":"We spoke to Anil CS Rao, a graphic novelist in Hyderabad. Anil CS Rao is a self-trained digital artist specializing in comics and graphic novels. He studied engineering at Pratt Institute in 1988 and did an MFA in writing and an MS in architecture recently.\u00a0 His wife Padmaja who has\u2026","rel":"","context":"In "Interviews & Stories"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/pothi.com\/blog\/wp-content\/uploads\/2019\/08\/forSqSp.jpg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":4907,"url":"https:\/\/pothi.com\/blog\/2020\/03\/12\/thats-the-word-for-it-panglossian\/","url_meta":{"origin":332,"position":3},"title":"That's the Word for It: Panglossian","date":"March 12, 2020","format":false,"excerpt":"Panglossian comes from Pangloss, the name of a character from Voltaire's novel Candide, first published in 1759. In the novel, Pangloss is an unpragmatic optimist with an attitude reminiscent of the character Don Quixote. The word originates from the Greek Pan which means all and glossa which means tongue.- this\u2026","rel":"","context":"In "That's the word for it"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/pothi.com\/blog\/wp-content\/uploads\/2020\/03\/panglossian.jpg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":5380,"url":"https:\/\/pothi.com\/blog\/2021\/05\/28\/creativity-organizer-ideation-milanote\/","url_meta":{"origin":332,"position":4},"title":"Author Resource: Get More Creative Mileage With Milanote \ud83d\uddd2\ufe0f","date":"May 28, 2021","format":false,"excerpt":"Milanote is used by creatives to jot down notes, ideas, inspirations, outlines and descriptions in a visual board kind of format. It resembles Evernote but is more suited to the artistic sensibility. Milanote is geared towards creators. You even have a writing app software. Since writing isn't linear, Milanote is\u2026","rel":"","context":"In "Author Resources"","img":{"alt_text":"Quote about design","src":"https:\/\/i1.wp.com\/pothi.com\/blog\/wp-content\/uploads\/2021\/05\/Milanote.png?fit=1200%2C675&ssl=1&resize=350%2C200","width":350,"height":200},"classes":[]},{"id":5454,"url":"https:\/\/pothi.com\/blog\/2021\/07\/11\/the-ibiamitav-ghosh-jhumpa-lahiri-birthdays\/","url_meta":{"origin":332,"position":5},"title":"The Ibis and its Whereabouts - Amitav Ghosh and Jhumpa Lahiri","date":"July 11, 2021","format":false,"excerpt":"On this day, two extraordinary authors share a birthday. Amitav Ghosh's education spans from Dehradun to Oxford. For a short time he worked at The Indian Express and it was while he was studying at Oxford that he wrote his first book The Circle of Reason. From then, his writing\u2026","rel":"","context":"In "Writing"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"jetpack_likes_enabled":true,"_links":{"self":[{"href":"https:\/\/pothi.com\/blog\/wp-json\/wp\/v2\/posts\/332"}],"collection":[{"href":"https:\/\/pothi.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/pothi.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/pothi.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/pothi.com\/blog\/wp-json\/wp\/v2\/comments?post=332"}],"version-history":[{"count":0,"href":"https:\/\/pothi.com\/blog\/wp-json\/wp\/v2\/posts\/332\/revisions"}],"wp:attachment":[{"href":"https:\/\/pothi.com\/blog\/wp-json\/wp\/v2\/media?parent=332"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/pothi.com\/blog\/wp-json\/wp\/v2\/categories?post=332"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/pothi.com\/blog\/wp-json\/wp\/v2\/tags?post=332"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}