Merge lp:~widelands-dev/widelands/martin_i18n into lp:widelands

[SirVer]

Martin explored wesnoths code and duplicated their ideas to properly fix i18n under linux.

[SirVer (sirver)]

I applied martins code with some compile fixes for mac os x. I can report the following for Mac OS X:

1) If you manually set the locale to de, the game is properly localized
2) The locales list in the options menu does not show anything but the current locale (Deutsch), English and Try system language. Try system language does not work - the game is not in German. I guess all locales should be shown in the list under Mac OS and the system language should be recognized.

Martin, I also need an ID for the authors file.

review: Needs Fixing

[SirVer (sirver)]

Oh, I forgot: please test this branch before we merge it to trunk. We should get linux and windows testing at the very least.

[Martin (p-martin)]

2) sounds a little bit strange. I did not change any line of the code for the language list. Did this work before my patch?

Unfortunately, I'm not familiar with language issues under Mac OS X. But a large, well-known search engine told me, OS X would neither use LANG nor LANGUAGE environment variables. I don't know, if this information is correct. Do you know, from where programs on Apple's systems usually get the configured language in that case?

Also, you told me that you need an ID. Do you mean my name? user id? credit card pin? something else? ;)

review: Needs Information

[Hans Joachim Desserud (hjd)]

> Oh, I forgot: please test this branch before we merge it to trunk. We should
> get linux and windows testing at the very least.

Linux testing (Ubuntu 10.10 + Arch):
The list of locales is shown.
Selecting System language works.
Switching from one locale to another works. However, selecting a language when I don't have the locale installed on my machine does not work and print the following error
"No corresponding locale was found!"
Is this intentional behaviour, or a regression? I liked being able to switch between all languages.

I've read parts of the forum thread, but I am unsure if this has been mentioned already or not.

[Martin (p-martin)]

Thanks for testing and reporting, Hans Joachim.

> Is this intentional behaviour, or a regression?
I guess, the behaviour is not intentional - more a kind of restriction. AFAIK, gettext only works with those locales installed on the system. Or is this just a restriction by Ubuntu? I don't know.

> I liked being able to switch between all languages.
Did this work in 5825 or earlier? As long as gettext has been used, it never was the case with Ubuntu.

If it really was possible with other Linux distributions (to select non-installed languages), I would propose for the Not-Found-Case to set the locale to the selected language string or its first two characters. Then, Ubuntu still will switch back to English, if no corresponding locale was found. But other Linuxes might succeed in switching the language even if the locale isn't installed on the system.

[Tino (tino79)]

I've just tested the branch on win32 (gcc):
Before i started WL, i removed my WL config file.

Widelands starts in German.
The language list in Options shows 2 entries:
- (checked) Verwende Systemsprache, ("Try system language", the german strings seems somehow truncated here...)
- Englisch

Switching between system language (german) and english works fine.

My system
- Windows 7 x64 Professional English, with installed and activated german language pack

review: Needs Fixing (win32)

[Jari Hautio (jarih)]

I fixed it to compile with visual studio r5829.

I tested windows builds with msvc and mingw by merging the branch to trunk.

I had all language entries in both msvc and mingw builds, altough they were visible only after I copied the locale files to right place. I tried multiple languages and they seemed to work the same way as in trunk.

[Nasenbaer (nasenbaer)]

Looks generally good to me :). Good work martin!

About the different problems:
* the Mac problems SirVer faced are possibly based upon the clearing of LANGUAGE and the setting of LANG - I am quite sure that there was a comment somewhere, that macos needs the variable LANGUAGE set (perhaps "only the variable" ?) - however following the way of "never change a running system" (and it seems it does work before), we should try to not clear LANGUAGE initially and perhaps all the changes of LANG should be removed as well. SirVer could you please test, whether that solves your problems?
* I support Hans Joachim Desserud's wish, to not block languages, that can not be found - here on my German localized Mandriva Linux (just de and en locales installed) switching the language to Spanish or Swedish worked quite fine until now, ...

[Martin (p-martin)]

Sorry, still didn't find out, how to contribute code on this launchpad branch. So again, I posted a patch via pastebin: http://pastebin.com/qPmabxe7

The LANGUAGE environment variable is now used on Mac OS X, instead of LANG. Moreover, unsetting the variable now happens just under Linux.

If (in Linux) no installed locale for the selected language is found, I now set the LANG variable directly to the selected language. This should bring back the feature of selecting uninstalled languages on other distros than Ubuntu. Please try, if this patch works - or whether we still need to set the LANGUAGE variable again.

I can confirm, that it works with Ubuntu (except for the selection of uninstalled languages, but this should be no problem).

review: Needs Information

[SirVer (sirver)]

Okay, I found the problem with mac os x not filling the list: widelands checks in the CWD for the localedir and enumerates the locales it finds there but it tries to load the locales from the --localedir= commandline option. So things are a bit awkward - currently I can either have the list of all languages or get the game localized.

Okay, so we have success reports from windows, mac and linux. The problems described are likely not related to this bug.

Martin, with ID i mean your credit card. It is common that new developers pay a fee to join in the widelands development which is currently 50€.

...
just kidding. I need a name or nickname that you want to have apearing on our developers list:
http://wl.widelands.org/developers

I can then go ahead and merge this branch. Maybe you are also interested to sort the remaining issues out, even though they are not of your making?

review: Needs Information

[Martin (p-martin)]

> Okay, so we have success reports from windows, mac and linux.
You mean 5829? Or the later patch (see above)?

> I need a name or nickname that you want to have apearing on our
> developers list:
> http://wl.widelands.org/developers
Thank you!
You can add my name to the list like this: Martin Prussak (martin)
(for Coders and Translators, I think)
but my user IDs for widelands.org and launchpad.net are not the same...

[Hans Joachim Desserud (hjd)]

>I can confirm, that it works with Ubuntu (except for the selection of uninstalled languages, but this >should be no problem).
I'd preferably like to see this fixed before the branch is merged, as it is a somewhat strange regression. Out of curiosity I checked Wesnoth earlier today, and I was able to switch to other languages even when the locale wasn't installed.

Slightly off-topic:
Martin, for uploading code to Launchpad see https://help.launchpad.net/YourAccount/CreatingAnSSHKeyPair and https://help.launchpad.net/Code/UploadingABranch .

[Martin (p-martin)]

Again, I had a look at the Wesnoth-Project. What I didn't test before was the selection of uninstalled languages. This works in wesnoth - even with Ubuntu!!

I figured out, that the C++ code does not seem to make the difference. With the modification below, we nearly use the same way of locale selection like wesnoth.

More and more, I think that there may be some problems with our configuration or creation of the translation files.
When you compare the po/ directories of widelands and wesnoth, wesnoth has some additional files - such as "LINGUAS", which seems to be important, as it contains a list of all available languages. I did not find a kind of this file in widelands.
Also, the other stuff: make/cmake files/rules slightly more structured, and so on...

Seems to be another approach for our problem. But I have no clue of how to configure these files correctly :(
SirVer, do you know someone that is familiar with it?

[SirVer (sirver)]

Martin, I added you to the list of developers in the martin_i18n branch. Your latest patch didn't apply to this branch, could you repost the diff based on the current tip of the martin_i18n branch?

I have no idea about gettext and we have no specialist in this field in the team, otherwise we would have probably sorted this out already :(. Maybe the SVN log of wesnoth gives us a name of a specialist in their team that we could contact?

I am unsure about the state of this branch now. What needs to be done before this can be merged? It seems to improve the i18n situation in some circumstances and makes it worse in others, is this correct or did I mininterpret the current discussion?

[Martin (p-martin)]

Heureka! I got it!!! I just succeeded to use ANY language with Ubuntu. I thought, this wouldn't be possible, but however it is :)
Seems like it is very significant, which of the environment variables is set and which not.

I'll try to push the diff within the next hours - and then: let's start another testing round!!

[Martin (p-martin)]

Sorry! Again, I didn't succeed in pushing a diff to this branch.
So I opened my own:
https://code.launchpad.net/~p-martin/widelands/i18n/+merge/49506

Alternatively, you can use this patch: http://pastebin.com/VGDHxmki

Have a nice test ;)

[SirVer (sirver)]

I pulled your changes from the new branch to the martin_i18n branch to keep the history of commits intact. So the martin_i18n branch should contain your latest version now.

Testing wise the issues on mac os x are unchanged but do not provide a problem (as clever packaging will solve all path related problems and we will ship a .app package anyway).

if you contribute more fixes, please use the following sets of commands:

bzr get lp:~widelands-dev/widelands/martin_i18n # get this branch
cd martin_i18n
bzr pull lp:~widelands-dev/widelands/martin_i18n # has someone made any changes?
- make your changes
bzr commit -m "I changed this and this and that"
bzr push lp:~widelands-dev/widelands/martin_i18n # push the current version

So, testers on windows and linux once again please!

[Martin (p-martin)]

SirVer, thanks for merging. Meanwhile, I found out, what I did wrong: I changed my local copy of trunk, not of this branch - and therefore got the bzr error msg "branches have diverged", of course.
However, thank you for the complete set of commands to use - even though I hope, not to have to upload lots of subsequent changes ;)
Another question: Should I delete lp:p-martin/widelands/i18n now? Or maybe just its merge proposal? Or will this result in problems with this branch?

For all the testers: here are some points you should check:
 - widelands should start using your selected language (from config)
 - list in options menu should contain 42 languages plus system default
 - selection of installed language should work
 - selection of non-installed language should also work
 - "system language" should take effect without restarting widelands
 - please test with Linux (Ubuntu 10.10 already tested, works great!)
 - please test with Mac OS X
 - please test with Windows

Of course, this patch concentrates on Linux, but other system's functionality should at least be kept.

I'm looking forward to reading your results!

review: Needs Information

[SirVer (sirver)]

@Martin: you can delete the i18n branch, it will not interfere with this one. You can also keep it around, but set it to being inactive then please.

[Tino (tino79)]

On windows the language list doesn't get populated, it only contains system default and english, bot options are hardcoded in options.cc line 290ff.

I've tried to debug the way the list should be generated from the files in the locales dir, but i didn't get it to work.
It seems "g_fs->FindFiles(s->get_string("localedir", INSTALL_LOCALEDIR), "*", &files)" results in an empty filenameset_t files...

[Nasenbaer (nasenbaer)]

One left issue for me ... now setting other languages works fine, but not English language codes - instead Widelands gets translated to German...
Everything elese looks good :)!

review: Needs Fixing

[Nasenbaer (nasenbaer)]

> One left issue for me ... now setting other languages works fine, but not
> English language codes - instead Widelands gets translated to German...
> Everything elese looks good :)!

Ahh sorry forgot to say: Mandriva Linux 2010.2 32bit

[Martin (p-martin)]

@Nasenbaer: Although I did not encounter this problem with Ubuntu, I added a setenv of LANG, if the locale could not be found. It still works fine on my system - also for en_AU, en_CA and en_GB: for these, locales are found. But even starting widelands with non-installed brazilian portugese (pt_BR) is successful. Could you please retry, if it also works for Mandriva now?

@SirVer:
> clever packaging will solve all path related problems [...]
Tino's problem with only two entries in the language list in Windows - is it related to your path related problems on Mac OS X? I mean, should I have a look at it - or will it be removed by packaging anyway, as you wrote?

review: Needs Information

[Nasenbaer (nasenbaer)]

Hi, sorry that I answer so late, I fear we missunderstood each other ;).
Unfortunally your change did not change anything for me, but that's no wonder as you changed code for "if (locale not found)", but the English locales are installed and found - however Widelands is German and not English.

Following example:
=====================
selected language: cs
No corresponding locale found - trying to set it via LANGUAGE=cs, LANG=cs
selected language: (system language)
using locale de_DE.UTF-8
selected language: en
using locale en_US
=====================
* Czech translation works as it should
* Germans (default system language) works as it should
* English localisation does not work, but uses German localisation.

[Nasenbaer (nasenbaer)]

Okay, I fixed it for me - LANGUAGE is set in normal cases as well - can you please check if it works on Ubuntu as well?

[Martin (p-martin)]

@Nasenbaer: You're right, I misunderstood your previous post. When you posted the exact messages, I had the same idea - but you were faster pushing the fix ;)
I can confirm, that your fix still works on Ubuntu 10.10! So we seem to be pretty close to "the solution" :)

For Linux, everything should be working now. (what about Arch, Hans Joachim?)

I also tried to compile widelands on Windows XP (MinGW) to reproduce Tino's "unpopulated language list", but somehow failed :( Seems to be due to the fact that NTFS doesn't support soft links...
As some files are "missing", cmake fails. Is the BuildingWidelandsUnderWindows page still up to date? (although slightly off-topic)

review: Needs Information

[Hans Joachim Desserud (hjd)]

Everything seems to be working as expected on Arch (and Ubuntu as well): a long list of languages is shown, switching to installed/not installed language works, changing the config-file works.

Thanks for fixing languages without installed locale!

I wonder if bug 642853 and bug 642854 should be linked to this branch as it seems to fix those issues?

[Jari Hautio (jarih)]

@Martin: I have updated BuildingWidelandsUnderWindows page recently. Mingw build with with latest mingw, self compiled libraries and cmake should work. I have compiled this branch based on the described build commands.

I retested mingw build, and I experience same behaviour in trunk and in this branch: After building from clean checkout, only try system language and english are listed in language list. After I copy locale files from build directory to locale directory in top most directory, the rest of the languages are listed.

[Nasenbaer (nasenbaer)]

Okay, so this is a packing issue on Win32 as well.

Jari, the behaviour you describe is intended - Widelands searches in the locale directory (always the subdirectory "locale" of the Widelands directory) for translation directories - only found ones are listed - English is always shown (untranslated), same for "try system language"

I will finally merge the branch :)

Good work Martin! Thank you for FINALLY fixing this :)!

review: Approve (final approve)

[Nasenbaer (nasenbaer)]

Hans Joachim, you are of course right! Thank you for pointing to those bugs - I updated the states :)

[SirVer (sirver)]

Thanks a lot Martin and all testers! Makes me always warm and fuzzy when many work so nicely together on widelands.

[Martin (p-martin)]

I'd also like to thank all testers and coop developers!

I'm glad that wideland's behaviour in terms of i18n/l10n now works as expected so far. From now on, getting the game localized to their preferred languages without expert's knowlegde will be very easy - especially for new players :)

=== modified file 'src/i18n.cc'
--- src/i18n.cc	2010-11-01 21:43:46 +0000
+++ src/i18n.cc	2011-02-16 18:55:31 +0000
@@ -19,6 +19,7 @@
 
 #include "i18n.h"
 #include "log.h"
+#include "profile/profile.h"
 
 #include <config.h>
 
@@ -27,6 +28,15 @@
 #include <cstdlib>
 #include <utility>
 
+#if __APPLE__  && LIBINTL_VERSION >= 0x001201
+// for older libintl versions, setlocale is just fine
+#define SETLOCALE libintl_setlocale
+#elif _MSC_VER
+#define SETLOCALE setlocale
+#else
+#define SETLOCALE std::setlocale
+#endif
+
 extern int _nl_msg_cat_cntr;
 
 namespace i18n {
@@ -36,6 +46,7 @@
 /// \see grab_texdomain()
 std::vector<std::pair<std::string, std::string> > textdomains;
 
+std::string env_locale;
 std::string locale;
 std::string localedir;
 
@@ -70,8 +81,8 @@
 	char const * const dom = domain.c_str();
 	char const * const ldir = localedir.c_str();
 
+	bindtextdomain(dom, ldir);
 	bind_textdomain_codeset(dom, "UTF-8");
-	bindtextdomain(dom, ldir);
 	// log("textdomain %s @ %s\n", dom, ldir);
 	textdomain(dom);
 	textdomains.push_back(std::make_pair(dom, ldir));
@@ -100,55 +111,122 @@
 }
 
 /**
- * Set the locale to the given string
+ * Initialize locale to English.
+ * Save system language (for later selection).
+ * Code inspired by wesnoth.org
+ */
+void init_locale() {
+#ifdef _WIN32
+	env_locale = "";
+	locale = "English";
+	SETLOCALE(LC_ALL, "English");
+#else
+	// first, save environment variable
+	env_locale = getenv("LANG");
+	if (env_locale.empty())
+		env_locale = getenv("LANGUAGE");
+
+	locale = "C";
+	SETLOCALE(LC_ALL, "C");
+	SETLOCALE(LC_MESSAGES, "");
+#endif
+}
+
+/**
+ * Set the locale to the given string.
+ * Code inspired by wesnoth.org
  */
 void set_locale(std::string name) {
 	std::string lang(name);
 
+	log("selected language: %s\n", lang.empty()?"(system language)":lang.c_str());
+
+#ifndef _WIN32
+#ifndef __AMIGAOS4__
+#ifndef __APPLE__
+	unsetenv ("LANGUAGE"); // avoid problems with this variable
+#endif
+#endif
+#endif
+
+	std::string alt_str;
+	if (lang.empty()) {
+		// reload system language, if selected
+		lang = env_locale;
+		alt_str = env_locale + ",";
+	} else {
+		// otherwise, read alternatives from file
+		Profile loc("txts/locales");
+		Section * s = &loc.pull_section("alternatives");
+		alt_str = s->get_string(lang.c_str(), lang.c_str());
+		alt_str += ",";
+	}
+
 	// Somehow setlocale doesn't behave same on
 	// some systems.
 #ifdef __BEOS__
 	setenv ("LANG",   lang.c_str(), 1);
 	setenv ("LC_ALL", lang.c_str(), 1);
+	locale = lang;
 #endif
 #ifdef __APPLE__
 	setenv ("LANGUAGE", lang.c_str(), 1);
+	setenv ("LANG",     lang.c_str(), 1);
 	setenv ("LC_ALL",   lang.c_str(), 1);
+	locale = lang;
 #endif
-
 #ifdef _WIN32
 	putenv(const_cast<char *>((std::string("LANG=") + lang).c_str()));
+	locale = lang;
 #endif
 
 #ifdef linux
-	// hopefully this gets gettext to run on all linux distributions - some like
-	// ubuntu are very problematic with setting language variables.
-	// If this doesn't solve the problem on your linux-distribution, here comes
-	// a quote from
-	// http://www.gnu.org/software/automake/manual/
-	//  gettext/Locale-Environment-Variables.html
-	//
-	//   Some systems, unfortunately, set LC_ALL in /etc/profile or in similar
-	//   initialization files. As a user, you therefore have to unset this
-	//   variable if you want to set LANG and optionally some of the other LC_xxx
-	//   variables.
-
-	/* If lang is empty, fill it with $LANG */
-	if (lang.size() < 1)
-		if (char const * const l = getenv("LANG"))
-			lang = l;
-	/* Than set the variables */
-	setenv ("LANG",     lang.c_str(), 1);
-	setenv ("LANGUAGE", lang.c_str(), 1);
-	log
-		("LANG %s, LANGUAGE %s:%s\n",
-		 lang.c_str(), lang.c_str(), + lang.substr(0, 2).c_str());
+	char * res = NULL;
+	char const * encoding[] = {"", ".utf-8", "@euro", ".UTF-8"};
+	std::size_t found = alt_str.find(',', 0);
+	bool leave_while = false;
+	// try every possible combination of alternative and encoding
+	while (found != std::string::npos) {
+		std::string base_locale = alt_str.substr(0, int(found));
+		alt_str = alt_str.erase(0, int(found) + 1);
+
+		for (int j = 0; j < 4; ++j) {
+			std::string try_locale = base_locale + encoding[j];
+			res = SETLOCALE(LC_MESSAGES, try_locale.c_str());
+			if (res) {
+				locale = try_locale;
+				log("using locale %s\n", try_locale.c_str());
+				leave_while = true;
+				break;
+			} else {
+				//log("locale is not working: %s\n", try_locale.c_str());
+			}
+		}
+		if (leave_while) break;
+
+		found = alt_str.find(',', 0);
+	}
+	if (leave_while) {
+		setenv("LANG",     locale.c_str(), 1);
+		setenv("LANGUAGE", locale.c_str(), 1);
+	} else {
+		log
+			("No corresponding locale found - trying to set it via LANGUAGE=%s, LANG=%s\n",
+			 lang.c_str(), lang.c_str());
+		setenv("LANGUAGE", lang.c_str(), 1);
+		setenv("LANG",     lang.c_str(), 1);
+		SETLOCALE(LC_MESSAGES, "");    // set locale according to the env. variables
+		                               // --> see  $ man 3 setlocale
+		// assume that it worked
+		// maybe, do another check with the return value (?)
+		locale = lang;
+	}
 
 	/* Finally make changes known.  */
 	++_nl_msg_cat_cntr;
 #endif
-	setlocale(LC_ALL, ""); //  call to libintl
-	locale = lang.c_str();
+
+	SETLOCALE(LC_ALL, ""); //  call to libintl
 
 	if (textdomains.size()) {
 		char const * const domain = textdomains.back().first.c_str();

=== modified file 'src/i18n.h'
--- src/i18n.h	2010-04-12 09:11:24 +0000
+++ src/i18n.h	2011-02-16 18:55:31 +0000
@@ -48,6 +48,7 @@
 	~Textdomain()                         {release_textdomain();}
 };
 
+void init_locale();
 void set_locale(std::string);
 std::string const & get_locale();
 

=== modified file 'src/wlapplication.cc'
--- src/wlapplication.cc	2010-12-14 12:36:29 +0000
+++ src/wlapplication.cc	2011-02-16 18:55:31 +0000
@@ -286,6 +286,7 @@
 	init_settings();
 	if (m_default_datadirs)
 		setup_searchpaths(m_commandline["EXENAME"]);
+	init_language(); // search paths must already be set up
 	cleanup_replays();
 	init_hardware();
 
@@ -780,16 +781,6 @@
 	//then parse the commandline - overwrites conffile settings
 	handle_commandline_parameters();
 
-	// Set Locale and grab default domain
-	i18n::set_locale(s.get_string("language", ""));
-
-	std::string localedir = s.get_string("localedir", INSTALL_LOCALEDIR);
-	i18n::set_localedir(find_relative_locale_path(localedir));
-
-	i18n::grab_textdomain("widelands");
-
-	log("using locale %s\n", i18n::get_locale().c_str());
-
 	set_input_grab(s.get_bool("inputgrab", false));
 	set_mouse_swap(s.get_bool("swapmouse", false));
 
@@ -835,6 +826,23 @@
 }
 
 /**
+ * Initialize language settings
+ */
+void WLApplication::init_language() {
+	// retrieve configuration settings
+	Section & s = g_options.pull_section("global");
+
+	// Initialize locale and grab "widelands" textdomain
+	i18n::init_locale();
+	std::string localedir = s.get_string("localedir", INSTALL_LOCALEDIR);
+	i18n::set_localedir(find_relative_locale_path(localedir));
+	i18n::grab_textdomain("widelands");
+
+	// Set locale corresponding to selected language
+	i18n::set_locale(s.get_string("language", ""));
+}
+
+/**
  * Remember the last settings: write them into the config file
  */
 void WLApplication::shutdown_settings()

=== modified file 'src/wlapplication.h'
--- src/wlapplication.h	2010-11-21 11:44:22 +0000
+++ src/wlapplication.h	2011-02-16 18:55:31 +0000
@@ -222,6 +222,7 @@
 	bool poll_event(SDL_Event &, bool throttle);
 
 	bool init_settings();
+	void init_language();
 	std::string find_relative_locale_path(std::string localedir);
 	void shutdown_settings();
 

=== modified file 'txts/developers'
--- txts/developers	2011-02-07 14:53:40 +0000
+++ txts/developers	2011-02-16 18:55:31 +0000
@@ -68,6 +68,7 @@
 "<rt image=pics/genstats_nrwares.png image-align=left text-align=left><p font-size=12> Joachim Breitner (nomeata)</p></rt>"
 "<rt image=pics/genstats_nrwares.png image-align=left text-align=left><p font-size=12> Nizamov Shawkat</p></rt>"
 "<rt image=pics/genstats_nrwares.png image-align=left text-align=left><p font-size=12> Carl-Philip Hänsch (carli)</p></rt>"
+"<rt image=pics/genstats_nrwares.png image-align=left text-align=left><p font-size=12> Martin Prussak (martin)</p></rt>"
 "<rt text-align=left><p font-size=24 font-decoration=bold font-face=FreeSerif font-color=f4a131><br><br>"
 ""
 ""

=== added file 'txts/locales'
--- txts/locales	1970-01-01 00:00:00 +0000
+++ txts/locales	2011-02-16 18:55:31 +0000
@@ -0,0 +1,44 @@
+[alternatives]
+ar="ar,ar_AR,ar_AE,ar_BH,ar_DZ,ar_EG,ar_IN,ar_IQ,ar_JO,ar_KW,ar_LB,ar_LY,ar_MA,ar_OM,ar_QA,ar_SA,ar_SD,ar_SY,ar_TN,ar_YE"
+ca="ca,ca_ES,ca_ES@valencia,ca_FR,ca_IT"
+cs="cs,cs_CZ"
+da="da,da_DK"
+de="de,de_DE,de_AT,de_CH,de_LI,de_LU,de_BE"
+en="en,en_US,en_GB,en_AU,en_CA,en_AG,en_BW,en_DK,en_HK,en_IE,en_IN,en_NG,en_NZ,en_PH,en_SG,en_ZA,en_ZW"
+en_AU="en_AU,en,en_US,en_GB"
+en_CA="en_CA,en,en_US,en_GB"
+en_GB="en_GB,en,en_US"
+eo="eo,eo_XX"
+es="es,es_ES,es_MX,es_US"
+et="et,et_EE"
+eu="eu,eu_ES,eu_FR"
+fa="fa,fa_IR"
+fi="fi,fi_FI"
+fr="fr,fr_FR,fr_CH,fr_BE,fr_CA,fr_LU"
+gl="ga,gl_ES"
+he="he,he_IL"
+hu="hu,hu_HU"
+ia="ia"
+id="id,id_ID"
+it="it,it_IT,it_CH"
+ja="ja,ja_JP"
+ko="ko,ko_KR"
+la="la,la_AU"
+ms="ms,ms_MY"
+nb="nb,nb_NO"
+nl="nl,nl_NL,nl_BE,nl_AW"
+nn="nn,nn_NO"
+oc="oc,oc_FR"
+pl="pl,pl_PL"
+pt="pt,pt_PT,pt_BR"
+pt_BR="pt_BR,pt,pt_PT"
+ru="ru,ru_RU,ru_UA"
+si="si,si_LK"
+sk="sk,sk_SK"
+sl="sl,sl_SI"
+sr="sr,sr_RS,sr_ME"
+sv="sv,sv_FI,sv_SE"
+tr="tr,tr_TR,tr_CY"
+uk="uk,uk_UA"
+vi="vi,vi_VN"
+