If a command line program is unsure of stdout'

Question

I have a command line program written in Python, and when I pipe it through another program on the command line, sys.stdout.encoding is None. This makes sense, I suppose -- the output could be another program, or a file you're redirecting it into, or whatever, and it doesn't know what encoding is desired. But neither do I! This program will be used by many different people (humor me) in different ways. Should I play it safe and output only ascii (replacing non-ascii chars with question marks)? Or should I output UTF-8, since it's so widespread these days?

Answer 1

You should output UTF-8 because thats what everyone should be using. It's a bug not to be. ;)

Answer 2

You should use the value returned by locale.getpreferredencoding().

Answer 3

if your application doesn't really deal with a whole lot of internationalisation, ascii should suffice. but if not, i'd say utf-8 or better still utf-16 should be the order of the day.

Answer 4

I suggest you use the current locale.

Python2> import locale
Python2> locale.getpreferredencoding()
'UTF-8'

The system knows what it should be, and the other side, if it also uses the current locale, will do the right thing.