Copy stable/10@r272459 to releng/10.1 as part of
the 10.1-RELEASE process.

Approved by: re (implicit)
Sponsored by: The FreeBSD Foundation

Copy head (r256279) to stable/10 as part of the 10.0-RELEASE cycle.

Approved by: re (implicit)
Sponsored by: The FreeBSD Foundation

POSIX 1003.1-2008: add ENOTRECOVERABLE, EOWNERDEAD errnos.

Add entry for errno ECAPMODE.

MFC after: 3 days

libc: Fix typo in French translation.

PR: kern/177704
Submitted by: martymac
MFC after: 1 week

Add derived versions for common Simplified Chinese encodings.

MFC after: 2 weeks

Add zh_CN.UTF-8 catalog.

Reviewed by: alphachi <alphachi mediaspirit.org>
MFC after: 2 weeks

Fix warning from valgrind when a failed entry is tested.

PR: kern/173008
Submitted by: Zhihao Yuan <lichray@gmail.com>
Reviewed by: gabor
Approved by: cperciva (implicit)
MFC after: 1 week

libc: Use O_CLOEXEC for various internal file descriptors.

This fixes a race condition where another thread may fork() before CLOEXEC
is set, unintentionally passing the descriptor to the child process.

This commit only adds O_CLOEXEC flags to open() or openat() calls where no
fcntl(fd, F_SETFD, FD_CLOEXEC) follows. The separate fcntl() call still
leaves a race window so it should be fixed later.

Merge from English r198040: add C message catalogue entries for newer
errnos: EBADMSG, EMULTIHOP, ENOLINK, EPROTO, ENOTCAPABLE.

PR: docs/147983
Submitted by: pluknet
MFC after: 1 week

- More style(9) fixups

Approved by: delphij (mentor)

- Deal with some special cases [1]
- style(9) nits

Pointed out by: jilles [1]
Approved by: delphij (mentor)

- Fix some style(9) bugs

Pointed out by: bde

- style(9)

Approved by: delphij

Cache failing and opened catalogs in catopen() and related functions.
Continuous catopen() calls cause 4 failig stat(2) each, which means a lot
of overhead. It is also a good idea to keep the opened catalogs in the memory
to speed up further catopen() calls to the same catalog since these catalogs
are not big at all. In this case, we count references and only free() the
allocated space when the reference count reaches 0. The reads and writes to
the cache are syncronized with an rwlock when these functions are called from
a threaded program.

Requested by: kib
Approved by: delphij

- Update Galician catalog

- Update the Spanish NLS catalog

Reviewed by: carvay,
the.infamous.paul@gmail.com,
Joan Picanyol i Puig <lists-freebsd-es@biaix.org>,
Ing . Marcos Luis Ortiz Valmaseda <mlortiz@uci.cu>,
eskanete@gmail.com,
Jose M Rodriguez <josemi@freebsd.jazztel.es>,
Guillermo Hernandez <guillermo@QuerySoft.es>,
dani.doni@gmail.com

- Update Hungarian libc catalog

Sync with C.msg r199083.

Synchronize with C.msg revision 199083 and improve some existing messages.

Reviewed by: remko
Approved by: remko

Add Japanese catalogue entries for newer errnos: EBADMSG, EMULTIHOP,
ENOLINK, EPROTO, ENOTCAPABLE.

Add gai_strerror() catalog for ja_JP.UTF-8 and ja_JP.eucJP.

Add NLS catalogs support to gai_strerror(3).
Controlled by NLS define.

Fix comment.

Pointed out by: nyan
MFC after: 1 week

Add ja_JP.eucJP catalog.

Reviewed by: hrs, nork, takawata
MFC after: 1 week

Add ja_JP.UTF-8 catalog.

Reviewed by: hrs, nork, takawata
MFC after: 1 week

- Strip trailing CRs

Requested by: Alex Kozlov <spam@rm-rf.kiev.ua> (via private mail)

- Update Ukranian catalog

Submitted by: Alex Kozlov <spam@rm-rf.kiev.ua> (via private mail)

Add C message catalogue entries for newer errnos: EBADMSG, EMULTIHOP,
ENOLINK, EPROTO, ENOTCAPABLE.

Submitted by: Alan R. S. Bueno <alan.bsd at gmail.com>
MFC after: 3 days (most)

- Add Galician NLS catalog

More bogus props.

Remove bogus props

Expand $FreeBSD$

Improve the German translation.
Some parts (ERANGE, ETXTBSY) triggered by Christoph Mallon.

Discussed with: brueffer, gabor (previous version)

- Add Belarusian catalog

PR: conf/133004
Submitted by: Tatsiana Elavaya <t.elavaya@gmail.com>

o Spell.

- Add Ukranian catalog

Submitted by: Alex Kozlov <spam@rm-rf.kiev.ua> (via private mail)

- Fix typo

PR: kern/132773
Reported by: Alan R. S. Bueno <alan.bsd@gmail.com>
Submitted by: Murilo Opsfelder <mopsfelder@gmail.com>

- Add Brazilian Portuguese catalog [1]
- Fixes for German catalog [2]

PR: kern/132694 [1], conf/80504 [2]
Submitted by: Murilo Opsfelder <mopsfelder@gmail.com> [1],
brueffer [2]

- Create the buildworld object directories with mtree instead of various
mkdir calls
- Remove the ugly workaroung from libc NLS, which was to create some of
these directories

- Fix object directory creation when running threaded buildworld

- Reenable Native Language Support in libc. This feature was disabled due
to possible breakages in the catalog handling code. Since then, that
code has been replaced by the secure code from NetBSD but NLS in libc
remained turned off. Tests have shown that the feature is stable and
working so we can now turn it on again.

- Add several new catalog files:
- ca_ES.ISO8859-1
- de_DE.ISO8859-1
- el_GR.ISO8859-7 (by manolis@ and keramida@)
- es_ES.ISO8859-1 (kern/123179, by carvay@)
- fi_FI.ISO8859-1
- fr_FR.ISO8859-1 (kern/78756, by thierry@)
- hu_HU.ISO8859-2 (by gabor@)
- it_IT.ISO8859-15
- nl_NL.ISO8859-1 (corrections by rene@)
- no_NO.ISO8859-1
- mn_MN.UTF-8 (by ganbold@)
- sk_SK.ISO8859-2
- sv_SE.ISO8859-1
(The catalogs without explicit source has been obtained from NetBSD.)

Approved by: attilio

Use C comments since we now preprocess these files with CPP.

Add each directory's symbol map file to SYM_MAPS.

Add symbol maps and initial symbol version definitions to libc.

Reviewed by: davidxu

Better translation.

Use better Korean translation for `trap'

Requested by: many Korean users from bsdforum.or.kr
Submitted by: perky
Approved by: anholt (mentor)

Assorted markup fixes.

Approved by: re

Add korean NLS message catalogs for libc

Submitted by: Hye-Shik Chang <perky@FreeBSD.org>
PR: misc/78290

Add polish version of libc NLS catalog.

Backout NLS catalog handling, until all edge cases are resolved

Enable processing of NLS catalogs while building/installing of libc

Add russian version of libc NLS catalog

Translated by: Valeriy Kravchuk <openxs@ipnet.kiev.ua>
Alexey Dokuchaev <danfe@nsu.ru>

Add template NLS catalog for strerror(), strerror_r() and strsignal()
localization support

. Bump .Dd's
. Note POSIX 1003.1-2001 conformation
. Add ERRORS section for catgets(3)
. Note what catopen(3) returns EINVAL, if catalog is corrupt

Bring in NetBSD's improvements and cleanups to NLS subsystem, making
it type and endian clean and removing of stdio dependency from NLS
functions (catalog files now are processed via mmap())

Also following changes were done (against NetBSD version):

. If mmap() failed, set errno to EINVAL and do not try to munmap() file

Obtained from: NetBSD

Cleanup prototypes and remove dead code

MFC After: 3 days

Remove incomplete support for running FreeBSD userland on old NetBSD kernels
lacking the issetugid() and utrace() syscalls.

Back out the `hiding' of strlcpy and strlcat. Several people
vocally objected to this safety belt.

`Hide' strlcpy and strlcat (using the namespace.h / __weak_reference
technique) so that we don't wind up calling into an application's
version if the application defines them.

Inspired by: qpopper's interfering and buggy version of strlcpy

libc_r wasn't so tied to libc for 22 months.

Do not include <sys/syslimits.h> directly; it is not intended for general
consumption.

Now, malloc is fixed, remove ENOMEM hardcode

Set errno to ENOMEM for strdup too (due to malloc errno bug)

Always set errno to ENOMEM after malloc failed (as workaround).
Our malloc sometimes forget to set errno, f.e. for size overflow case.

Close descriptor, if error happens in loadCat()

Try harder to check lang as path component (".", "..", / inside).
Try harder to not overwrite failure errno.
style(9) whitespace reformatting for code readability.

Fix the style of the SCM ID's.
I believe have made all of libc .c's as consistent as possible.

mdoc(7) police: Use the new .In macro for #include statements.

Removed duplicate VCS ID tags, as per style(9).

Remove whitespace at EOL.

MAN[1-9] -> MAN.

Use .Rv macro instead of hardcoded message

Remove _THREAD_SAFE and make libc thread-safe by default by
adding (weak definitions to) stubs for some of the pthread
functions. If the threads library is linked in, the real
pthread functions will pulled in.

Use the following convention for system calls wrapped by the
threads library:
__sys_foo - actual system call
_foo - weak definition to __sys_foo
foo - weak definition to __sys_foo

Change all libc uses of system calls wrapped by the threads
library from foo to _foo. In order to define the prototypes
for _foo(), we introduce namespace.h and un-namespace.h
(suggested by bde). All files that need to reference these
system calls, should include namespace.h before any standard
includes, then include un-namespace.h after the standard
includes and before any local includes. <db.h> is an exception
and shouldn't be included in between namespace.h and
un-namespace.h namespace.h will define foo to _foo, and
un-namespace.h will undefine foo.

Try to eliminate some of the recursive calls to MT-safe
functions in libc/stdio in preparation for adding a mutex
to FILE. We have recursive mutexes, but would like to avoid
using them if possible.

Remove uneeded includes of <errno.h> from a few files.

Add $FreeBSD$ to a few files in order to pass commitprep.

Approved by: -arch

Prepare for mdoc(7)NG.

mdoc(7) police: use certified section headers wherever possible.

Fix typo

PR: misc/21596
Submitted by: TOGAWA Satoshi <toga@puyo.org>

Prevent buffer overflow if NLSPATH is too long

Add .El

Document %-macros and NLSPATH better.

Fully implement NLSPATH processing as described in SUSv2

Oops! don't set errno to ENOMEM explicitly if malloc() failed.

Found by: ache

* move $FreeBSD$ tag to its usual place (bottom of copyright)
* mdoc cleanup
* document missing errno values (ERRORS section)

Reviewed by: sheldonh

Finaly cleanup libc/nls code:

* rewrite catopen() to remove duplicate code chunks and optimize
* if empty string is passed to catopen() as name argument then
catopen() will set errno to ENOENT (File not found), not EINVAL
* move search code to LOOKUP() macro to shrink amount of duplicated code
* move common resource freeing actions to __nls_free_resources() function
* exclude from build code related to MCLoadAll defintion since it is not
using at all
* style(9) related whitespace changes

Reviewed by: ache

Rewrite using stdio. It cause program speedup since eliminates lots of small
read() syscalls. It not cause static binary size increasing because stdio
already picked via setlocale() called from catopen()

Treat empty lang as "C" lang too

Set rcsid to correct value
Resort #include files
Remove SYSV compatibility chunks

protect .h file contents correctly.

Remove unused indirect references to cat* functions.

Fix memory leak introduced by kris in rev 1.22

setlocale may return NULL, handle this case too by resetting to "C"

Move protection code down to handle NL_CAT_LOCALE case too.

Protect from badly formed LANG variable

catgets: detect if fd becomes invalid after exec and return default response

cosmetique, use NULL for pointers comparison

Explicetely describe catalog descriptor lifetime

Prevent internal buffer overflow due to expansion of $LANG and/or name
argument in catopen().

Reviewed by: chris, -audit

Introduce ".Lb" macro to libc manpages.

More libraries manpages updates following.

Remove single-space hard sentence breaks. These degrade the quality
of the typeset output, tend to make diffs harder to read and provide
bad examples for new-comers to mdoc.

Simplify sytem call renaming. Instead of _foo() <-- _libc_foo <-- foo(),
just use _foo() <-- foo(). In the case of a libpthread that doesn't do
call conversion (such as linuxthreads and our upcoming libpthread), this
is adequate. In the case of libc_r, we still need three names, which are
now _thread_sys_foo() <-- _foo() <-- foo().

Convert all internal libc usage of: aio_suspend(), close(), fsync(), msync(),
nanosleep(), open(), fcntl(), read(), and write() to _foo() instead of foo().

Remove all internal libc usage of: creat(), pause(), sleep(), system(),
tcdrain(), wait(), and waitpid().

Make thread cancellation fully POSIX-compliant.

Suggested by: deischen

Add three-tier symbol naming in support of POSIX thread cancellation
points. For library functions, the pattern is __sleep() <--
_libc_sleep() <-- sleep(). The arrows represent weak aliases. For
system calls, the pattern is _read() <-- _libc_read() <-- read().

Add gencat(1) to SEE ALSO section.

PR: docs/13658
Submitted by: Zahemszky Gabor <zgabor@code.hu>

$Id$ -> $FreeBSD$

Provide meaningful errno value on error return

Add reference to setlocale(3)

Return -1 for invalid descriptor in catclose

If passed catgets descriptor is NULL or -1, return default string immediately

Force loadType to 0

Implement NL_CAT_LOCALE
Manpages cleanup

Prototypes/typedefs cleanup
Fix error return codes

Add #ifndef __NETBSD_SYSCALLS around calls to issetugid() which
do not exist in NetBSD 1.3.

Removed the subdirectory paths from the definitions of MAN[1-9]. They
were a workaround for limitations in bsd.man.mk that were fixed about
2 years ago.

Plug even more failure memory leaks

Cleanup
Plug failure memory leaks
Use issetugid now
PR: 3492

Changed all paths to be relative to src/lib instead of src/lib/libc
so that all these makefiles can be used to build libc_r too.

Added .if ${LIB} == "c" tests to restrict man page builds to libc
to avoid needlessly building them with libc_r too.

Split libc Makefile into Makefile and Makefile.inc to allow the
libc_r Makefile to include Makefile.inc too.

Restricting $LANG was a really bad idea

Pointed out by: Everybody but Jordan.

Don't honor LANG or NLSPATH if we're setuid/setgid.

Fixes PR 2582

Submitted by: Julian Assange

Revert $FreeBSD$ to $Id$

Sort cross references.

Make the long-awaited change from $Id$ to $FreeBSD$

This will make a number of things easier in the future, as well as (finally!)
avoiding the Id-smashing problem which has plagued developers for so long.

Boy, I'm glad we're not using sup anymore. This update would have been
insane otherwise.

General -Wall warning cleanup, part I.
Submitted-By: Kent Vander Velden <graphix@iastate.edu>

Fixed docs/521.

Fix even more spelling errors in some more man pages.

and so on...

Add /usr/local/share/nls to default search path

Remove trailing whitespace.

Fix manpage rule

Add the nls code for XPG3-style message catalogs to libc.
Obtained from: NetBSD