Update dirdeps.mk et al

bmake-20240309 includes updates to dirdeps and meta mode makefiles

Update meta mode makefiles

meta2deps - add checks to detect truncated/corrupted filemon data
(only known to happen on Linux hosts), to ensure we do not auto
update dependencies based on incomplete data.

meta.stage.mk adds STAGE_SHLIB_LINKS_FILTER and STAGE_LINK_AS_*

We also allow for hosts where egrep is deprecated for grep -E

Reviewed by: stevek

mk: Remove a double word in a comment

- s/to to/to/

MFC after: 3 days

Update dirdeps.mk et al to latest

Move some local tweaks to local.*.mk

Reviewed by: bdrewery
MFC after: 1 week
Differential Revision: https://reviews.freebsd.org/D27300

Update dirdeps.mk et al to latest

dirdeps.mk and meta.autodep.mk will now look for
Makefile.depend.options
to handle optional dependencies, the work is all done by
dirdeps-options.mk

Also update to latest meta.stage.mk and gendirdeps.mk

Reviewed by: bdrewery
Differential Revision: https://reviews.freebsd.org/D15701

Update dirdeps/meta bits from latest bmake.

Update meta* from bmake-20161212

Import latest meta.stage.mk 1.45 (r301462)

META MODE: Don't double stage SYMLINKS for shared libraries.

This also fixes truncating the path that the links were installed to, which
was most likely going to be the same directory the library was in anyhow.

Let bsd.sys.mk handle SYMLINKS via stage_symlinks. stage_libs continues to
handle the SHLIB_LINK though since it is not a SYMLINKS.

This fixes a race, seen easily in lib/libthr, where libpthread_p.a is created
by both stage_libs and stage_symlinks resulting in 'ln: File exists'.

Sponsored by: EMC / Isilon Storage Division
Discussed with: sjg

In jobs mode we can use .ORDER to force stage_links to run after other
stage_* targets.
In non-jobs mode we can achieve the same result by simply introducing
the targets in the correct order.
Thus in bsd*.mk we simply add targets to STAGE_TARGETS which we
realize in meta.stage.mk

Reviewed by: bdrewery

META_MODE: Fix stage_links not running in the right order without -j.

This fixes staging errors for non-parallel builds that have LINKS.

Creating hardlinks must always happen after the actual files are installed.
The staging code was protected by an .ORDER statement that only affected
parallel -j builds but not non-parallel builds. Fix this by making the
real stage_links.SET (stage_links.links, stage_links.mlinks, etc) targets
depend on the main targets for all of the other possible staging needs. For
example, stage_links.links will depend on stage_as and stage_files, which have
their own dependencies to stage_as.prog or stage_files.prog or stage_files.SET,
which is enough to satistfy the ordering.

Also remove the requirement that symlinks be created last, as they can
safely be made without the source being present unlike hardlinks. This also
fixes symlinks to come before hardlinks as it is possible, in theory, to
hardlink a symlink. This is not actually supported here though.

Sponsored by: EMC / Isilon Storage Division

Normally a staging conflict causes an error.
When bootstrapping different options, it is handy to be able to
make those warnings.

Latest dirdeps.mk and meta.stage.mk

Add support for dirdeps cache
and allow full path as key for STAGE_AS_*

Use latest version

We want to use stage_includes as a hook, so use NO_STAGE_INCLUDES
in include/Makefile to suppress normal behavior

We may need to supress SHLIB_LINKS with NO_SHLIB_LINKS

Ensure _objroot is correctly formatted

Add stage-install.sh so we can do away with the need to have
$STAGE_OBJTOP/include for src/include.

Sync latest versions

Allow staging to be help up (by .WAIT) until other
bits of all: are done.

One .ORDER should suffice

Stage*(): return early if no args, and thow error if cp etc., fails.

Simplify handling of chmod

Handle chmod of staged files/links

Latest version from Crufty

Sync FreeBSD's bmake branch with Juniper's internal bmake branch.

Requested by: Simon Gerraty <sjg@juniper.net>