Add further -no-pie checks to Rumprun build tools

This builds upon the previous commit to add -no-pie anywhere the
relocatable flag (-Wl,-r) is used to handle compilers that enable -pie
by default (Such as Debian Stretch).

Make the disabling of the fallthrough warning dependent on GCC version

This should prevent older gcc versions from choking on unknown argument.

I have not tested this, just wrote the code directly on github. Use with caution.

Add the -Wimplicit-fallthrough=0 flag to allow compiling with GCC7

GCC7 comes with a new warning "implicit-fallthrough" which will prevent building the netbsd-src.

For more information: https://dzone.com/articles/implicit-fallthrough-in-gcc-7

Better separate bottom and toplevel rumprun builds

The platform builds has two steps, build and then install. The way the
original rules are set up require this to be done in separate make
invocations. Splitting the platform builds up into different top level
and bottom level stages means that we need to have top level and bottom
level build and install stages also.

build-rr.sh: Hide build output for custom commands

build-rr.sh: More finegrained build commands

As mentioned in previous commit, this is to make it possible to have
better fine grained control of what targets are built to get better
incremental compilation and parallel performance. Using these new
commands requires the platform implementation to understand some extra
rules: platform_obj platform_libs extra_libs.
Currently this will only work on the seL4 platform.

Move variable definitions into main build function

Move checkprevbuilds into main build function

After splitting buildrump function, it makes more sense for this to be
called in the dobuild function

Split buildrump function up into subfunctions

Make build-rr.sh -q silent option more effective

If -q is set, -s will now be passed down to make invocations. This
considerably reduces build log output.

Remove 5 second git timeout

build-rr.sh throws a warning with a 5 second timeout if it detects that
git submodules have changes. We apply patches to these which causes the
warning to always trigger. This commit suppresses the warning and
timeout.

Use C locale when invoking awk

If LANG is set to some locale that defines the decimal dot to be
something other than a dot (e.g., a comma), then awk will fail to parse
GCC and ld's version numbers.

seL4: Add seL4 as a target rumprun platform

Search existing value of XEN_HEADERS for Xen headers

This allows a caller to specify a specific location for the Xen
headers. For example, from a version of Xen just built in a
neighbouring directory.

(Without this it is not possible to build against a specific Xen
without being able to overwrite system header areas.)

If XEN_HEADERS is unset, or not suitable, use the existing search
strategy.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>

Switch to new-style pci hypercall defs

Fixes issue #38

build-rr: generate a sourceable $PATH-setting config

Useful e.g. if you want to test rumprun-packages where you
cannot easily use $RUMPRUN_CC etc.

config: provide RUMPRUN_CXX

build-rr: don't require "Binutils" in ld version string

Fixes probe on Fedora 21.

via jermar on irc

build-rr: throw an explicit error if cc/ld version check fails

g/c "doextras", it no longer does anything

build-rr: make ld 2.22 the minimum

Fixes Travis builds (hopefully ...)

build-rr: the stetson-harrison ld version in previous was wrong.

Apparently Travis sports an older version. Print it so that
I can fix the check.

build-rr: check cc/ld versions

Issue a warning or error for old or prehistoric tools,
respectively.

XXX: not sure how the ld check will work with GNU gold.
We'll see.

Issue reported by a number of users recently, including
in issue #69.

build app-tools earlier

Also add $RUMPRUN_CC to config.

A build-specific cc is needed because cc includes the lib path
in the binary for baking. After this change it's possible to use
config variables alone to build at least a simple unikernel for
testing (i.e. setting PATH to match the build dest is not required).

XXX: value is hardcoded to gcc, but that's not a practical problem as
long as support only gcc.

Add RUMPSTOP to config too, so that tests find it.

Include git branch in default obj/destdir names.

If we're not in a git repo, on master, or detached => nothing.

Add RUMPRUN_BAKE and RUMPRUN to config.

That way you don't have to twiddle with paths if you want to
build to an alternate tree while doing development.
(config is only for developers anyway)

Run the xen probe in a subshell.

Might fix Travis build failure. Who knows. Hard to say for
sure about the problems which I can't repeat locally.

Probe location of Xen headers.

Throw an intelligent error if they're not found.

XXX: would be nice to have a mechanism for providing a manual
override, but that sort of parameter passing needs a general
solution.

related to #67 (which can now be closed)

build-rr: abspath PLATFORMDIR

build-rr: catch errors from buildrump.sh probe

build-rr: run setvars also for install

Makes "./build-rr hw install" work. Without this fix the
default object directory would not get set.

build-rr: add -d to synopsis

build-rr: write "config" which includes both mk/sh configs

build-rr: update usage

get install-time vars from objdir

Make it clear that die produces an ERROR.

Throw nice error if user tries to install non-existent build

When building with -s, default destdir to rumprun-extsrc.

Mirrors what object dirs do.

checkprevbuilds is now necessary only for xen

build-rr: set -eu

Both were previously set, but now they're set in the same place.
No functional change intended.

Use destdir/rumprun-$MACHINE_GNU_ARCH$ as a GNU-like prefix.

Put rumptools into the object directory.

Update buildrump.sh and use new "probe" method.

The new probe method doesn't require any directories
to be created.

Use MACHINE_GNU_ARCH, not MACHINE_ARCH

That matches the terms (and make variables!) with the NetBSD
Makefiles and avoids mismatch lossage.

build-rr: don't override correct MACHINE_ARCH.

The lossage stems from the fact that NetBSD uses i386 as
MACHINE, i386 as MACHINE_ARCH, and i486 as MACHINE_GNU_ARCH.
We want to follow the MACHINE_GNU_ARCH since it actually makes sense.

Ok, maybe the platform Makefiles aren't ready for -j

build-rr: run platform make with -j

build-rr: simplify MACHINE_ARCH handling.

Make it rumprun[-MACHINE_ARCH[-PLATFORM]]

That way MACHINE_ARCH (if it exists in the particular name),
is always in the same spot, and the same holds for PLATFORM.

Install headers into destdir/include/rumprun.

That way they don't conflict with anything already
in destdir/include.

fix to previous: completely remove previnst check

build-rr: remove previnst check, not needed anymore.

g/c debugging aid that slipped into the public tree

Install libs to non-conflicting subdirs.

Platform-dependent libs go into lib/rumprun-platform-machine_arch
and platform-independent libs go into lib/rumprun-machine_arch.
(all libs are arch-dependent, naturally)

Allows xen and hw and various machine_arch installations
to coexist.

Add "-extsrc" to default object directory name for -s builds.

Default kernonly objdir to end with "-kernonly"

build-rr: nuke prevbuild platform from error message

Mirrors how the platform became a non-issue with (partial)
objdir build support.

build-rr: always create .rumprun-installation

Fixes blowing objdir away while installing to the same destdir
in the next build.

Prevent installing two different builds into same destdir.

Will be fixed, eventually ...

install toolchain to destdir

Build libs into objdir.

The grand implication of this commit is that now it's possible to
build both hw and xen from the same source tree (which is useful
mostly for me so that I can easily test things when developing).
nb. different target cpus are still not supported from the same
source tree.

At end of build, print RUMPRUN_SHCONF too

Create RUMPRUN_SHCONF, OBJDIR -> RROBJ, DESTDIR -> RRDEST.

Print RUMPRUN_MKCONF value at the end of build-rr run

create config.mk into objdir

Fix end-of-build prints a bit more.

add missing \n to printf

CONFIG -> RUMPRUN_MKCONF

If the name of the config file variable is not generic, devs
can set it in the env for convenience. make it so!

Record tool tuple in config.mk and use it.

Give app-tools its own Makefile instead of it being a .inc

This means that app-tools are now built directly by build-rr.sh
instead of being driven by platform/x/Makefile.

include platform in config.mk

g/c comment which makes little sense now

Create links at the right place.

(no wonder I couldn't repeat the travis failure, I forgot to
commit this change ... :)

Build librumprun_base as part of userland build-rr.sh cycle

Also, install the lib to destdir.

fix typo in previous

Install mainobj and use it from destdir in app-tools.

Note to devs: you must now "make && make install" in platform/foo

Support kernonly mode for Xen

nb. tests/nolibc won't build for xen; hw is hardcoded there

Don't panic if destdir exists as a directory

Destdir builds, part 1

Support a -d flag to build-rr.sh. Make some of the tools use
libraries and headers from that directory instead of a hardcoded
place.

Not everything is installed into destdir yet. More to come.

build-rr: accept -j as an argument

default is still -j4

build-rr.sh: set -u

build-rr.sh: fix typo in message

Accept -h as an alias for -?

Was missing from getopts param

improve help message formatting and option grouping

Install unwind.h

from #52

Usage: use the more widely accepted version of alphabetical order.

Accept a -o parameter which determines the build objdir

Only part of the objects go there as of now, and more work
is required to stuff all of the objects into objdir.

librumprun_unwind -> libunwind

There's nothing rumprun-specific in there. The original idea with the
rumprun prefix was to avoid namespace conflicts, but if someone wants
to link in another libunwind we'll be in trouble regardless. Also,
consistency with libcompiler_rt.

Cache truth value of having a working C++ compiler

Use "probe" to decide if -mno-red-zone is necessary

Use "buildrump.sh probe" to throw usage-derived errors early.

add KERNONLY to .prevbuild

Add nolibc mode -k to build-rr.sh

Currently only supported for the 'hw' platform. This builds rumprun
without any userland code (i.e. libc, app-tools), for custom builds
that invoke rump kernel functions directly.

Set -mno-red-zone for x86_64 hw too.

The TSS stuff doesn't work as hoped, and need to dig through some manuals
to see if that can be fixed.

set -mno-red-zone for CXXFLAGS too

xen: Ensure all modules are built with -mno-red-zone on x86_64

For Xen on x86_64, all rumprun modules (kernel, libc, application) must
be built with -mno-red-zone.

also build rumpkern_bmktc

Add initial ARM support.

A "hello world" works. This means that pthreads, TLS, scheduling
etc. work. There is no I/O support currently (except console).
Adding I/O support requires some fixes to NetBSD (most likely limited
to minor adjustments).

There are two paths to go from here: either add I/O device support,
or fix some structural problems in rumprun which make it assume x86.

print useful info at the end of build-rr

fix offline build

Create top-level link to rumprun components earlier.

earlier = when rumprun components have been built

be a bit smarter about quoting in previous

flag an explicit error if make/gmake/$MAKE cannot be found

Hide stderr from type to avoid extra verbosity (on some shells)

Include platform/machine in build mismatch error message

add further diagnostic messages

Prevent multiple different platform/machines builds.

Prevents damage to unsuspecting users. (issue #35)

follow local/global naming convention

Avoid && in the script since we use set -e

Fix CONFIG_CXX which was broken by the toolchain revamp two days ago.

Add an explicit error for trying to build using clang

add some sort of excuse for a usage display

create a full cross-toolchain worth of wrappers

build pci with STDJ

GNU-make is not always called make ... provide a way to override

- detect gmake as it is done in rumpctrl/buildnb.sh
- use -gmake wrapper in tests/buildtests.sh if MAKE is set to gmake

update src-netbsd and switch to new-style pci build

install headers from librumprun_tester too

build pci drivers with -j

BUILDXENMETAL -> PLATFORM

make "forgot to update submodules?" warning event cooler

Build librumprun-tester into platform-specific objdir

Should be possible to run two working ./build-rr {xen,hw} in
the same tree now.

inline makepci (we are the only user)

don't pass unnecessary options to buildrump.sh

fix "checkmodules"

group last loose-floating bits into subroutines

fold in common bits of build infra

pass args to buildrump()

even more subroutines

(still lacking a bit of clarity, but getting better)

more subroutines, less main

slap on a copyright

include _build-common.sh in build-rr.sh and remove former

Make the build scripts a bit less atrocious

The platform-specific build script called from the upper-level
build-rr.sh is replaced with platform.conf.

There's still more shoveling to do in here, but at least there's
a bit less stink now.

Rename baremetal -> hw, as discussed on rumpkernel-users

Migration: use "hw" where you would have previously used "baremetal".

Enable the RUMP_CURLWP=__thread optimization on all platforms.

Enable RUMP_CURLWP=__thread for baremetal

Third time's the charm! Also add a comment saying why it's not enabled
for Xen (even 64bit where it should theoretically work).

Still some funny-business with RUMP_CURLWP=__thread

Disable it before things are again sorted out.

Use RUMP_CURLWP=__thread on baremetal

Hold back on Xen until TLS works in our 32bit guests.

Revert "baremetal: Build without magic flags on x86_64"

This reverts commit 8f16ac7a3bcfa3f7954ea4c694538abd899688c8.

baremetal: Build without magic flags on x86_64

Signed-off-by: Martin Lucina <martin@lucina.net>

no longer ln -s app-tools (to be added as a unified directory)

don't pass potential "--" down to xenbaremetal.sh args

remember to export BUILD_QUIET too

move argument parsing to build-rr.sh

add common build script

remove common files, unified ones to be added on master branch

remove common files, unified ones to be added on master branch

ln mit kraft!

ln mit kraft!

build-rr.sh: use "ln -sf"

To stop ln from complaining when the target already exists.

Signed-off-by: Wei Liu <liuw@liuw.name>

add common top-level build script and adjust travis

Also link app-tools to top level.

+ simplify a bit

Pretend to support Xen

Keeps the contents of this script equal in both repos.

Move files into platform/baremetal

Prepares for the rumprun merge.