release: Stage non-UFS images in vm-images-stage

When the VM image building code was updated to support building
non-UFS images, the vm-images-stage target was not updated to
install those newly built images to the FTP site. As a result, we
have been sending weekly snapshot announcements since August claiming
that ZFS VM images are available when they are not in fact present
anywhere publicly accessible.

Fixes: 32ae9a6b3937 "release: Build UFS and ZFS VM images"
Reported by: Michael Dexter
MFC after: 5 days

Remove $FreeBSD$: one-line sh pattern

Remove /^\s*#[#!]?\s*\$FreeBSD\$.*$\n/

Append the branch commit count to _SNAP_SUFFIX for development
snapshot builds.

Sponsored by: Rubicon Communications, LLC (netgate.com)

Fix staging riscv images.

Sponsored by: Rubicon Communications, LLC (netgate.com)

Makefile.inc1:
- New file. Adds logic to search for the git binary, as well
as determining the branch and revision, used in various
places.

Makefile:
- Remove searching for the svn{,lite} binary.

Makefile.ec2:
- Reduce duplicated code, removing searching for the svn{,lite}
binary, in addition to EC2_SVN{BRANCH,REV}.
- Rename EC2_SVN* with GIT* for consistency.

Makefile.mirrors:
- Remove the SRCBRANCH declaration, replaced with the exported
GITBRANCH variable.
- Update _SNAP_SUFFIX from SVNREVISION to GITREV, and remove
the leading 'r' from it, since it will break git hashes.
- Remove yet another instance of duplicated code to search for
the svn{,version}lite binary.

Sponsored by: Rubicon Communications, LLC (netgate.com)

Include files containing metadata specific to the branch in the
directory where the individual distribution sets exist.

The new metadata files include the build date, svn branch, and
revision of the build.

Requested by: Mellanox Technologies (via kib)
MFC after: 3 days
Sponsored by: Rubicon Communications, LLC (Netgate)

Fix the ftp-stage target for arm embedded builds.

The images were renamed from KERNCONF to BOARDNAME when
specified, which would result in an image name of:

12.0-CURRENT-arm-armv7-GENERIC.img

which would then be renamed to use the BOARDNAME for the
SoC the image is targeted to use. BOARDNAME was specified
for all images as of r336994, which now causes the ftp-stage
target to fail, as the rename is no longer necessary.

Sponsored by: The FreeBSD Foundation

Update the GUMSTIX image build to use arm/arm TARGET/TARGET_ARCH.
Update the TARGET/TARGET_ARCH matching in release/release.sh and
release/Makefile.mirrors for simplification.

Discussed with: mmel
MFC after: 3 days
Sponsored by: The FreeBSD Foundation

Support armv7 builds for userland

Make armv7 as a new MACHINE_ARCH.

Copy all the places we do armv6 and add armv7 as basically an
alias. clang appears to generate code for armv7 by default. armv7 hard
float isn't supported by the the in-tree gcc, so it hasn't been
updated to have a new default.

Support armv7 as a new valid MACHINE_ARCH (and by extension
TARGET_ARCH).

Add armv7 to the universe build.

Differential Revision: https://reviews.freebsd.org/D12010

Fix the ftp-stage target for RPI3 images by loosening the
constraints on the TARGET and TARGET_ARCH variables.

MFC after: 3 days
Sponsored by: The FreeBSD Foundation

Make Makefile.mirrors -ALPHA${N}-aware.

Approved by: re (implicit)
Sponsored by: The FreeBSD Foundation

Deprecate MD5 checksum generation in favor of SHA512.

This was discussed during the 10.2-RELEASE cycle, however
since we were nearing the end of the cycle, we decided to
defer this change until after 10.2-RELEASE.

Reminded by: so (delphij), jmg
MFC after: 5 days
Sponsored by: The FreeBSD Foundation

Consider PRERELEASE builds snapshots, in addition to CURRENT and
STABLE.

MFC after: 3 days
Sponsored by: The FreeBSD Foundation

Invert the build date and svn revision to match the namimg
convention that has been in use for a while.

MFC after: 3 days
Sponsored by: The FreeBSD Foundation

Fix a typo.

Submitted by: ian
MFC after: 3 days
Sponsored by: The FreeBSD Foundation

Use SVNREVISION and BUILDDATE if passed into the make(1)
environment, fallback to trying to figure it out otherwise.

MFC after: 3 days
Sponsored by: The FreeBSD Foundation

Reindent after r283575.

MFC after: 3 days
Sponsored by: The FreeBSD Foundation

Remove duplicate exists() sanity check.

MFC after: 3 days
Sponsored by: The FreeBSD Foundation

Set STAGE_TARGETS only if RELEASEDIR exists.

MFC after: 3 days
Sponsored by: The FreeBSD Foundation

Remove a continuation on error, since the relevant behavior can
only occur if a particular file exists.

MFC after: 3 days
Sponsored by: The FreeBSD Foundation

Fix staging virtual machine images for ftp propagation.

MFC after: 3 days
X-MFC-Note: needs all previous changes
Sponsored by: The FreeBSD Foundation

Fix a number of logic and/or naming problems in Makefile.mirrors.
Reduce a number of duplicated logic.

As of this commit, this file does exactly what it is needed to do.

MFC after: 3 days
X-MFC-Note: needs all previous changes
Sponsored by: The FreeBSD Foundation

Fix make(1) syntax error for non-embedded targets.

Sponsored by: The FreeBSD Foundation

If TARGET or EMBEDDED_TARGET == arm, set EMBEDDED variable,
which helps control some of the arm-specific bits a bit more
cleanly (but not really 'clean').

If BOARDNAME is defined (as is in the WANDBOARD configuration
RE uses), do some magic to work with the KERNCONF and BOARDNAME
to rename the file, making it a bit more intuitive for the
consumer to determine which they need.

Yes, it is ugly, that is why there is a big warning at the top.
It is, however, still much cleaner than the now 474-line shell
script, and this Makefile produces the hierarchy needed without
much evil.

MFC after: 1 week
X-MFC-Note: needs all previous Makefile.mirror commits
Sponsored by: The FreeBSD Foundation

Remove the arm/armv6 bits from Makefile.mirrors, which needs
some re-thinking.

Sponsored by: The FreeBSD Foundation

Include xz(1)-compressed images when not a snapshot build.

Do not suffix non-snapshot checksum files with SNAP_SUFFIX.

Sponsored by: The FreeBSD Foundation

cd(1) to .CURDIR before calling stat(1) to fix the path
to sh(1).

Include xz(1)-compressed images when renaming snapshot
builds.

Use OSRELEASE in place of REVISION-BRANCH for checksum
filenames.

Sponsored by: The FreeBSD Foundation

Avoid polluting the filesystem when not necessary.

Sponsored by: The FreeBSD Foundation

After the last influx of commits, and a REALLY BIG WARNING
to the top of the file.

Sponsored by: The FreeBSD Foundation

Fix more paths to the actual files.

Sponsored by: The FreeBSD Foundation

Fix more path variables.

Sponsored by: The FreeBSD Foundation

Provide the correct path to the checksum file.

Sponsored by: The FreeBSD Foundation

Also symlink the CHECKSUM.{SHA256,MD5} files.

Sponsored by: The FreeBSD Foundation

Also copy CHECKSUM.{SHA256,MD5} files.

Sponsored by: The FreeBSD Foundation

Fix a few incorrect variables and/or hard-coded paths.

Sponsored by: The FreeBSD Foundation

Sigh. Fix more syntax errors introduced by the last commit.

Sponsored by: The FreeBSD Foundation

Fix a make(1) syntax error.

Sponsored by: The FreeBSD Foundation

Temporarily 'rm -rf $FTPDIR' during additional testing.

Sponsored by: The FreeBSD Foundation

Always use the 'make install' directory as the source for images.
For RE purposes, we use the default (/R within the chroot), so
this helps avoid copying files multiple times and xz(1)-compressing
additional times when not needed.

Again, this Makefile is not for general consumption.

Sponsored by: The FreeBSD Foundation

Add a new file, Makefile.mirrors, which is intended to replace
a 474-line kludge of a shell script to pre-create the directory
hierarchy on ftp-master.

This is not in any way connected to the build, and there is no
intention to do so. This only intent here is to try to make
things a little bit easier for me. But I've probably just made
things worse.

Sponsored by: The FreeBSD Foundation