- Copy stable/10 (r259064) to releng/10.0 as part of the
10.0-RELEASE cycle.
- Update __FreeBSD_version [1]
- Set branch name to -RC1

[1] 10.0-CURRENT __FreeBSD_version value ended at '55', so
start releng/10.0 at '100' so the branch is started with
a value ending in zero.

Approved by: re (implicit)
Sponsored by: The FreeBSD Foundation

Copy head (r256279) to stable/10 as part of the 10.0-RELEASE cycle.

Approved by: re (implicit)
Sponsored by: The FreeBSD Foundation

When copying the complement of the string loop to WINT_MAX as we are dealing
with a wint_t. WINT_MAX and WCHAR_MAX are the same on most architectures
except ARM EABI where wint_t is signed and wchar_t is unsigned.

mdoc: terminate quoted strings.

Reviewed by: brueffer

Remove superfluous paragraph macro.

Replace index() and rindex() calls with strchr() and strrchr().

The index() and rindex() functions were marked LEGACY in the 2001
revision of POSIX and were subsequently removed from the 2008 revision.
The strchr() and strrchr() functions are part of the C standard.

This makes the source code a lot more consistent, as most of these C
files also call into other str*() routines. In fact, about a dozen
already perform strchr() calls.

Add missing static keywords to tr(1)

Put parentheses in the right place.

Noted by: jilles@
Broken by: me. :-(

Build tr(1) with WARNS=6.

Remove the advertising clause from UCB copyrighted files in usr.bin. This
is in accordance with the information provided at
ftp://ftp.cs.berkeley.edu/pub/4bsd/README.Impt.License.Change

Also add $FreeBSD$ to a few files to keep svn happy.

Discussed with: imp, rwatson

tr: Fix '[=]=]' equivalence class.

A closing bracket immediately after '[=' should not be treated as special.

Different from the submitted patch, a string ending with '[=' does not cause
access beyond the terminating '\0'.

PR: bin/150384
Submitted by: Richard Lowe
MFC after: 2 weeks

Build usr.bin/ with WARNS=6 by default.

Also add some missing $FreeBSD$ to keep svn happy.

Revert most part of 200420 as requested, as more review and polish is
needed.

Remove unneeded header includes from usr.bin/ except contributed code.

Tested with: make universe

o Remove duplicate includes.

Obtained from: Slava Semushin via NetBSD

- Document all character classes our tr(1) supports. [1]
- Mention that some of them are POSIX extensions. [2]

PR: docs/85062 [1]
Submitted by: Toby Peterson [1]
Obtained from: wctype(3) [2]
MFC after: 3 days

Remove unused variables.

Expand contractions.

Sort sections.

Added the EXIT STATUS section where appropriate.

Formatting fixes.

(This exposes a bug in mdoc(7) for which a patch has been sent upstream.)

tr(1) attempts to convert \n[n][n] sequences into octal digits, but doesn't
check to see that a given digit is actually an octal digit. This leads to
unusual consequences if passed in values like \9.

Reported by: Joseph Davison (OpenDarwin project)
MFC after: 1 week

Tweak markup of quoted strings and characters: use Dq instead of enclosing
strings in ``obsolete quotes''. Use Li and Ql where appropriate.

Add a lengthy discussion of why "tr a-z A-Z" and "tr A-Z a-z" are not the
right way to perform case-conversion.

Fix description of cmap_lookup_hard().

Remove unused member of struct csclass: csc_value.

Splay the left and right subtrees on min - 1 and max + 1, respectively,
before trying to coalesce. Forgetting to splay caused us to miss many
opportunities for coalescing.

Initialize cs_invert to "false" in new csets.

Report input errors instead of ignoring them.

Update for multibyte character support: remove BUGS and change the
description of the -c option to refer to "values" instead of "byte values".

Add support for multibyte characters. The challenge here was to use
data structures that scale better with large character sets, instead of
arrays indexed by character value:
- Sets of characters to delete/squeeze are stored in a new "cset" structure,
which is implemented as a splay tree of extents. This structure has the
ability to store character classes (ala wctype(3)), but this is not
currently fully utilized.
- Mappings between characters are stored in a new "cmap" structure, which
is also a splay tree.
- The parser no longer builds arrays containing all the characters in a
particular class; instead, next() determines them on-the-fly using
nextwctype(3).

Mechanically kill hard sentence breaks.

Document incorrect handling of multibyte characters in input files
and character string arguments.

Back out [:upper:] and [:lower:] classes sorting, it is not required
by POSIX and gains nothing with current code.

Clarify upper/lower conversion description more.

Explain better what happens when [:lower:] <-> [:upper:]

No functional changes, just code reorganization from prev. commit, it
makes one malloc unneeded, removes two bzero's and makes code more readable.

"Bright ideas comes only _after_ commits."

POSIX require complex processing of 'c-c' ranges: if one of the endpoints
is octal sequence, range is taken in the byte values order, for non-octal
endpoints range is taken in the sorted collation order.

Implement it.

Special fix just for
tr -[cC]s '[:upper:]' '[:lower:]'
case (or vice versa):
chars taken from s2 can be different this time
due to lack of complex upper/lower processing,
so fill string2 again to not miss some.

Microoptimization of prev. patch: do strdup() only if (cflag || Cflag)

1) Fix -C - it was broken since introduced, wrong array sorted
2) Fix last (repeated) char after [:class:], it was \0 in original code

Remove charcoll() stabilization added in 1.16, it gains nothing but conflicts
with ranges.

POSIX requires 'c-c' must conform collate and be in collation order

This patch address two problems.

1st one is relatively minor: according our own manpage, upper and lower
classes must be sorted, but currently not.

2nd one is serious:
tr '[:lower:]' '[:upper:]'
(and vice versa) currently works only if upper and lower classes
have exact the same number of elements. When it is not true, like for
many ISO8859-x locales which have bigger amount of lowercase letters,
tr may do nasty things.

See this page
http://www.opengroup.org/onlinepubs/007908799/xcu/tr.html
for detailed description of desired tr behaviour in such cases.

Fix typos, mostly s/ an / a / where appropriate and a few s/an/and/
Add FreeBSD Id tag where missing.

mdoc(7) police: markup polishing.

Approved by: re

Use .Fl/Ar for flags and arguments.

ANSIify function definitions.
Add some constness to avoid some warnings.
Remove use register keyword.
Deal with missing/unneeded extern/prototypes.
Some minor type changes/casts to avoid warnings.

Reviewed by: md5

When translating and -C is specified, behave as if the complemented set was
in the locale collating order as required by SUSv3.

When translating and the -c option is specified, handle the case where the
second string argument is more than one character in length in the way
required by SUSv3 (and the way GNU textutils and SVR4 do it).

Use err instead of errx when malloc fails. "malloc" is not a helpful
error message.

Improve parsing of character and equivalence classes:
[:*] and [=*] are parsed as `infinitely many repetitions of :' (or *)
instead of literal characters (SUSv3)

Move the #include and #define's to the top of the file.

Bump the size of the equivalence set to NCHARS; this file was left out
of a previous commit implementing equivalence classes.

Sort sections. Avoid using "The -? option" at the start of option descriptions.

Don't treat the trailing ']' of an equivalence class expression as a
character in the set. tr -d '[=a=]' was deleting ]'s as well as a's.
Noticed by the textutils test suite.

Add the P1003.1-2001 -C option which complements the set of characters
(not byte values) specified by the first string argument.

Implement support for equivalence classes ([=e=]) when the mapping is
one-to-one (SUSv3)

remove __P

properly handle zero length first string when doing -c

PR: 34663
MFC After: 3 days

WARNS=2 fixes, use __FBSDID(), kill register keyword.

mdoc(7) police: utilize the new .Ex macro.

mdoc(7) police: s/BSD/.Bx/ where appropriate.

Remove whitespace at EOL.

mdoc(7) police: -column lists require column width specifiers.

mdoc(7) police: split punctuation characters + misc fixes.

Prepare for mdoc(7)NG.

mdoc(7) police: use the new features of the Nm macro.

Avoid use of direct troff requests in mdoc(7) manual pages.

Add DIAGNOSTICS section name

$Id$ -> $FreeBSD$

Add $Id$, to make it simpler for members of the translation teams to
track.

The $Id$ line is normally at the bottom of the main comment block in the
man page, separated from the rest of the manpage by an empty comment,
like so;

.\" $Id$
.\"

If the immediately preceding comment is a @(#) format ID marker than the
the $Id$ will line up underneath it with no intervening blank lines.
Otherwise, an additional blank line is inserted.

Approved by: bde

Submitted by: Joachim Kuebart, thanks.
Add -u option to force unbuffered output

Use err(3) instead of local redefinition. Cosmetic in usage().

compare return value from getopt against -1 rather than EOF, per the final
posix standard on the topic.

Merge from Lite2

Cast char's to (u_char) before passing them to isctype() functions.

Fix a couple of sign-extension bugs.

Submitted by: serg@bcs1.bcs.zaporizhzhe.ua (Sergey Shkonda)

Updated to BSD4.4lite2. Fixes PR836. `echo abcd | tr a-d A-BC-D' now
works.

Fix broken charclass handling
Add setlocale LC_CTYPE

Remove declamations which <ctype.h> already does for us.

Added #include <ctype.h>

Remove trailing whitespace.

Fix print class mistype

This commit was generated by cvs2svn to compensate for changes in r1590,
which included commits to RCS files with non-trunk default branches.