Break translators out of haiku.hpkg into a separate haiku_datatranslators.hpkg.

Translators and media-plugins are the main source of dependencies in haiku.hpkg,
and thus the main source of packages being pulled into chroots, especially
HaikuPorter chroots. (FFmpeg pulls in a rather large array of sub-
dependencies, itself.) So, here we break all the translators into their
own sub-package.

For now, haiku.hpkg is declared to depend on haiku_datatranslators,
so that users will not suddenly update and have no translators.
In the future, this will be dropped.

Note that this is only done for the primary arch at present.
Secondary architecture translators remain in the main secondary package
for now.

Change-Id: Id0b352f34f7110b79ec7787792bf3ae0edab4054
Reviewed-on: https://review.haiku-os.org/c/haiku/+/4477
Reviewed-by: waddlesplash <waddlesplash@gmail.com>

Move source and development packages out of /system/packages on release images

Activating all these packages on live boot (especially live DVD where we
also have the write overlay eating up RAM) significantly increases
memory requirements for running Haiku, to the point that Installer may
fail to run. Move them outside the packages/ directory so they are not
activated.

Installer already skips the _sources_ directory when installing, and
lists the contents of _packages_ with checkbox to decide what to include
in the install (they are put in system/packages on the target disk).

Fix from previous version: the Haiku package was installed to /system
instead of /system/packages.

Fixes #15621.

Replace HAIKU_{BOOTSTRAP,MINIMUM}_BUILD with HAIKU_BUILD_TYPE.

* Instead of separate variables, HAIKU_BUILD_TYPE is set to one of
'bootstrap', 'minimum' or 'regular'.
* Adjust uses of HAIKU_BOOTSTRAP_BUILD accordingly.

Refactor definition of Haiku image contents.

* Move actual definitions of respective image contents to files
underneath build/jam/images/definitions (minimum, bootstrap, regular).
* HaikuImage now only includes the image definitions for the selected
build profile and adds the Haiku packages.
* Simplified topmost Jamfile to some extent.
* Move definition of DESKBAR_APPLICATIONS and DESKBAR_DESKTOP_APPLETS
from build/jam/packages/Haiku to the respective image definition file.
* Sort and reformat several lists to make them more readable.

gawk: use the HaikuPorts package.

* left the in-tree version as its libintl is used by gdb.
* added as bootstrap package.

findutils: use the HaikuPorts package.

* removed in-tree version.
* added as bootstrap package.
* note: HaikuPorts package has no rdef for binaries.

HaikuImage: Add empty system non-packaged directories

... mirroring home/config/non-packaged/

Also, sort the list lexographically and move the creation of the non-packaged
decorators directory from HaikuImage to HaikuImageCommon along with the rest.

HaikuImage: activate GL components with mesa feature.

Add decorators to system non-packaged decorator directory

... commented out still for now. BeDecorator is almost ready,
MacDecorator and WinDecorator need a bunch more work still.

Update DecorInfo to scan for decorators

Look in system and user packaged and non-packaged decorator directories.

x86_64: Add BootManager, writembr

* Fix build of BootManager on x86_64 (signed vs unsigned error)
* Throw in writembr as it seems to build (untested)

x86_64: Add a bunch of video drivers that compile.

* Added cards need testing.
* 3dfx, ati, neomagic, and s3 still don't build due to some
more complex pointer size issues. (and I don't have hardware
to test on)

Add Haiku repository config only optionally

The HAIKU_ADD_HAIKU_REPOSITORY_CONFIG build variable can be set to add
the Haiku repository config to the image.

Add repository config for the Haiku repository to the image

* HaikuRepository rule: Create the repository config.
* HaikuImage: Add the repository config for the Haiku image. The
repository cache is not added, though (it would only be available, if
the repository had been built before).

Implements #10287. The Haiku repository is now available in Haiku by
default.

Revert "Add getconf to the image"

This reverts commit c229671d8e28fbe5c81de0a10f83b22bf93a4261.

Add getconf to the image

GL: Remove OpenGL kit, x86 Mesa

* Depend on Mesa packages to provide functionality

HaikuImage*: Create missing writable dirs in ~/config

Also reduce code duplication by moving the respective code to
HaikuImageCommon.

Sort translators list in alphabetical order

Add PSDTranslator to image

preferences: Remove CPUFrequency

We can't reliably set contemporary processors to an arbitrary frequency.
There are dependencies between cores and thechnologies like Turbo Boost
which may make actual frequency significantly different than the requested.

Moreover, it is the scheduler job to decide how much CPU performance is
needed and user shouldn't interfere with that.

Add SerialConnect to HaikuImage.

It's now complete enough.

Add setarch and getarch commands

Added fstrim command.

Later, there should be a service that runs this from time to time for all
devices that support it.

Conflicts:
build/jam/HaikuImage

x86_64: added wlan drivers to the image.

Add findpaths command line tool

It provides the new find_path*() functionality to the shell.

only builds fwcontrol for x86

x86_64: add acpi_battery to the image.

acpi_button: migrated to the new driver API.

* HaikuImage: SYSTEM_ADD_ONS_DRIVERS_POWER is now used for new drivers.

x86_64: added acpi_button

* tested OK!

Add non-packaged fonts directory to default image.

x86_64: added acpi to the image.

* embedded_controller crashes on x86_64, disabled for now.
* removed the -fno-pic compile option.
* synched HaikuBootstrap package with Haiku package.

Properly canonically name the boot loader package

Name the generated HPKG files properly

* rule AddPackageFilesToHaikuImage: Add "flags" parameter. The only
supported flag is "nameFromMetaInfo". It causes the packages to be
copied under their canonical file name onto the image.
* Use the new flag for all generated packages save haiku_loader.hpkg.

Also add repository cache files to image

This makes package management operations that require a repository cache
immediately usable (even offline). Also makes sense for the
update-{all,packages} build profile actions, since those update the
repository config which would otherwise no longer match a potentially
existing cache.

update-{all,packages} build action: Update repository config

Initial changes to remove /boot/common

* find_directory() and hard-coded paths use /boot/system instead of
/boot/common.
* The build system creates the writable directories in /boot/system
instead of /boot/common.
* The build system no longer installs any packages in /boot/common.

Add HaikuDepot to image.

Add group{add,del,mod}

Add userdel

Manually merge 1410faca6c30d39dc08a7bf7caa7630ce5a16d35.

Also mount the packagefs at ~/config

Build secondary architecture Haiku package for regular image

Also add secondary architecture packages to image.

Support building most system libraries for secondary arch

Also adjust the HaikuImageGet[Private]SystemLibs rules to support to
return the library targets matching the current architecture.

Replace build system vars [PRIVATE_]SYSTEM_LIBS by rules

... HaikuImageGetSystemLibs and HaikuImageGetPrivateSystemLibs.

More work towards hybrid support

* All packaging architecture dependent variables do now have a
respective suffix and are set up for each configured packaging
architecture, save for the kernel and boot loader variables, which
are still only set up for the primary architecture.
For convenience TARGET_PACKAGING_ARCH, TARGET_ARCH, TARGET_LIBSUPC++,
and TARGET_LIBSTDC++ are set to the respective values for the primary
packaging architecture by default.
* Introduce a set of MultiArch* rules to help with building targets for
multiple packaging architectures. Generally the respective targets are
(additionally) gristed with the packaging architecture. For libraries
the additional grist is usually omitted for the primary architecture
(e.g. libroot.so and <x86>libroot.so for x86_gcc2/x86 hybrid), so that
Jamfiles for targets built only for the primary architecture don't
need to be changed.
* Add multi-arch build support for all targets needed for the stage 1
cross devel package as well as for libbe (untested).

Move common image building code to HaikuImageCommon

Move common image building code to HaikuImageCommon

Remove more optional package related left-overs

Remove OptionLibPackages

Move image definition jamfiles to build/jam/images

Replace HAIKU_{BOOTSTRAP,MINIMUM}_BUILD with HAIKU_BUILD_TYPE.

* Instead of separate variables, HAIKU_BUILD_TYPE is set to one of
'bootstrap', 'minimum' or 'regular'.
* Adjust uses of HAIKU_BOOTSTRAP_BUILD accordingly.

Refactor definition of Haiku image contents.

* Move actual definitions of respective image contents to files
underneath build/jam/images/definitions (minimum, bootstrap, regular).
* HaikuImage now only includes the image definitions for the selected
build profile and adds the Haiku packages.
* Simplified topmost Jamfile to some extent.
* Move definition of DESKBAR_APPLICATIONS and DESKBAR_DESKTOP_APPLETS
from build/jam/packages/Haiku to the respective image definition file.
* Sort and reformat several lists to make them more readable.

gawk: use the HaikuPorts package.

* left the in-tree version as its libintl is used by gdb.
* added as bootstrap package.

findutils: use the HaikuPorts package.

* removed in-tree version.
* added as bootstrap package.
* note: HaikuPorts package has no rdef for binaries.

HaikuImage: Add empty system non-packaged directories

... mirroring home/config/non-packaged/

Also, sort the list lexographically and move the creation of the non-packaged
decorators directory from HaikuImage to HaikuImageCommon along with the rest.

HaikuImage: activate GL components with mesa feature.

Add decorators to system non-packaged decorator directory

... commented out still for now. BeDecorator is almost ready,
MacDecorator and WinDecorator need a bunch more work still.

Update DecorInfo to scan for decorators

Look in system and user packaged and non-packaged decorator directories.

x86_64: Add BootManager, writembr

* Fix build of BootManager on x86_64 (signed vs unsigned error)
* Throw in writembr as it seems to build (untested)

x86_64: Add a bunch of video drivers that compile.

* Added cards need testing.
* 3dfx, ati, neomagic, and s3 still don't build due to some
more complex pointer size issues. (and I don't have hardware
to test on)

Add Haiku repository config only optionally

The HAIKU_ADD_HAIKU_REPOSITORY_CONFIG build variable can be set to add
the Haiku repository config to the image.

Add repository config for the Haiku repository to the image

* HaikuRepository rule: Create the repository config.
* HaikuImage: Add the repository config for the Haiku image. The
repository cache is not added, though (it would only be available, if
the repository had been built before).

Implements #10287. The Haiku repository is now available in Haiku by
default.

Revert "Add getconf to the image"

This reverts commit c229671d8e28fbe5c81de0a10f83b22bf93a4261.

Add getconf to the image

GL: Remove OpenGL kit, x86 Mesa

* Depend on Mesa packages to provide functionality

HaikuImage*: Create missing writable dirs in ~/config

Also reduce code duplication by moving the respective code to
HaikuImageCommon.

Sort translators list in alphabetical order

Add PSDTranslator to image

preferences: Remove CPUFrequency

We can't reliably set contemporary processors to an arbitrary frequency.
There are dependencies between cores and thechnologies like Turbo Boost
which may make actual frequency significantly different than the requested.

Moreover, it is the scheduler job to decide how much CPU performance is
needed and user shouldn't interfere with that.

Add SerialConnect to HaikuImage.

It's now complete enough.

Add setarch and getarch commands

Added fstrim command.

Later, there should be a service that runs this from time to time for all
devices that support it.

Conflicts:
build/jam/HaikuImage

x86_64: added wlan drivers to the image.

Add findpaths command line tool

It provides the new find_path*() functionality to the shell.

only builds fwcontrol for x86

x86_64: add acpi_battery to the image.

acpi_button: migrated to the new driver API.

* HaikuImage: SYSTEM_ADD_ONS_DRIVERS_POWER is now used for new drivers.

x86_64: added acpi_button

* tested OK!

Add non-packaged fonts directory to default image.

x86_64: added acpi to the image.

* embedded_controller crashes on x86_64, disabled for now.
* removed the -fno-pic compile option.
* synched HaikuBootstrap package with Haiku package.

Properly canonically name the boot loader package

Name the generated HPKG files properly

* rule AddPackageFilesToHaikuImage: Add "flags" parameter. The only
supported flag is "nameFromMetaInfo". It causes the packages to be
copied under their canonical file name onto the image.
* Use the new flag for all generated packages save haiku_loader.hpkg.

Also add repository cache files to image

This makes package management operations that require a repository cache
immediately usable (even offline). Also makes sense for the
update-{all,packages} build profile actions, since those update the
repository config which would otherwise no longer match a potentially
existing cache.

update-{all,packages} build action: Update repository config

Initial changes to remove /boot/common

* find_directory() and hard-coded paths use /boot/system instead of
/boot/common.
* The build system creates the writable directories in /boot/system
instead of /boot/common.
* The build system no longer installs any packages in /boot/common.

Add HaikuDepot to image.

Add group{add,del,mod}

Add userdel

Manually merge 1410faca6c30d39dc08a7bf7caa7630ce5a16d35.

Also mount the packagefs at ~/config

Build secondary architecture Haiku package for regular image

Also add secondary architecture packages to image.

Support building most system libraries for secondary arch

Also adjust the HaikuImageGet[Private]SystemLibs rules to support to
return the library targets matching the current architecture.

Replace build system vars [PRIVATE_]SYSTEM_LIBS by rules

... HaikuImageGetSystemLibs and HaikuImageGetPrivateSystemLibs.

More work towards hybrid support

* All packaging architecture dependent variables do now have a
respective suffix and are set up for each configured packaging
architecture, save for the kernel and boot loader variables, which
are still only set up for the primary architecture.
For convenience TARGET_PACKAGING_ARCH, TARGET_ARCH, TARGET_LIBSUPC++,
and TARGET_LIBSTDC++ are set to the respective values for the primary
packaging architecture by default.
* Introduce a set of MultiArch* rules to help with building targets for
multiple packaging architectures. Generally the respective targets are
(additionally) gristed with the packaging architecture. For libraries
the additional grist is usually omitted for the primary architecture
(e.g. libroot.so and <x86>libroot.so for x86_gcc2/x86 hybrid), so that
Jamfiles for targets built only for the primary architecture don't
need to be changed.
* Add multi-arch build support for all targets needed for the stage 1
cross devel package as well as for libbe (untested).

Move common image building code to HaikuImageCommon

Move common image building code to HaikuImageCommon

Remove more optional package related left-overs

Remove OptionLibPackages

Move image definition jamfiles to build/jam/images