UPDATING revision 1.324
1$NetBSD: UPDATING,v 1.324 2021/11/20 16:18:18 martin Exp $ 2 3This file (UPDATING) is intended to be a brief reference to recent 4changes that might cause problems in the build process, and a guide for 5what to do if something doesn't work. 6 7For a more detailed description of the recommended way to build NetBSD 8using build.sh, see the BUILDING file. 9 10Note that much of the advice in this UPDATING file was written before 11build.sh existed. Nevertheless, the advice here may be useful for 12working around specific problems with build.sh. 13 14Sections are marked with "^^^^^". After the section on "Recent changes" 15are several sections containing more general information. 16 17See also: BUILDING, build.sh, Makefile. 18 19Recent changes: 20^^^^^^^^^^^^^^^ 21 2220211116: 23 Changes in the xorg build require clean obj dirs for external/mit/xorg 24 (or a full clealn/non-update build). 25 2620211112: 27 Device tree sources were updated for evbarm. Some device nodes 28 (in particular, ld(4) devices on the ROCKPro64) will be renumbered. 29 3020211014: 31 MKPIE default for aarch64 has changed, a clean build is required. 32 3320210917: 34 Changed MNT_ACLS to default to POSIX1e ACLs instead of NFSv4 35 ACLs, to be compatible with FreeBSD. If you are using NFSv4 ACLs 36 and have "acls" in /etc/fstab you'll need to change it to "nfs4acls". 37 3820210711: 39 Updated GMP sources may require cleaning in tools/gmp and/or in 40 external/lgpl3/gmp/lib, particularly if GCC itself does not build. 41 4220210417: 43 GCC 10 was enabled for several platforms. If builds fail in either 44 tools/gcc or external/gpl/gcc, first try cleaning those objects and 45 removing the $DESTDIR/usr/include/g++ subdirectory. 46 4720201230: 48 lint1/ops.c is no longer autogenerated. If this makes the build 49 fail, clean $OBJDIR/tools/*lint* and $OBJDIR/usr.bin/*xlint*. 50 5120201016: 52 MIPS kernel modules have been disabled until they work. This will 53 turn up in extra files in the DESTDIR, which should be cleaned. 54 5520200925: 56 GNU MPC and MPFR have been updated. At least MPFR needs cleaning 57 in both the tools and external dirs. 58 5920200912: 60 GCC 9 has arrived for Arm and x86 platforms, and will be coming 61 for several more, as will binutils 2.34. Clean as required. 62 6320200907: 64 GCC 9 is coming, and binutils has been updated for MIPS. This 65 probably requires cleaning the tools/binutils. 66 6720200811: 68 GCC updates may require cleaning the objdir. This may occur 69 due to GCC 7.5 update, GCC 8.4 move to gcc.old, or the upcoming 70 GCC 9 upgrade. 71 7220200614: 73 blacklist* has been renamed to blocklist*. postinstall(8) 74 should handle the migration 75 7620200601: 77 Due to a mistake in LIBISPRIVATE handling, .so libraries were 78 created in the build directories and need cleaning. 79 8020200311: 81 GCC 8 ports will need cleaning in src/tools/gcc and 82 src/external/gpl3/gcc due to GCC 8.4 update. 83 8420191118: 85 More architectures were switched to gcc8: 86 i386, ia64 powerpc64, sparc, sparc64, arm 87 The same comments as in 20191022 apply. 88 8920191112: 90 The LLVM update requires a clean rebuild for all architectures using 91 LLVM during the tools build phase (i386, amd64, aarch64). 92 9320191022: 94 Ports amd64 and aarch64 switched to GCC 8.3 by default. 95 In-place ("expert mode", build.sh -E) builds are not supported 96 when going from a GCC 7 userland to GCC 8. Do a regular 97 build to a different DESTDIR (or preferably: build.sh -U) at least 98 once and install sets, or download comp.{tar.xz,tgz} from the 99 daily builds and install that before doing the next in-place build. 100 10120191001: 102 GCC 8.3 was imported. Builds of src/tools/gcc may fail if 103 old builds with GCC 7 output now uses GCC 8. Clean this 104 directory, and also clean src/external/gpl3/gcc. 105 10620190903: 107 Files with names that coincide with existing files' names on 108 case-insensitive file systems were inadvertently committed, for 109 radeon GPU firmware. We cannot mark these as obsolete for 110 postinstall to fix, so if you updated src since 2019-08-26, and 111 ran build.sh distribution or ran build.sh release, you must 112 manually delete the following files in your DESTDIR (which is 113 usually $OBJDIR/destir.$ARCH), or from / if you have installed 114 them: 115 116 /libdata/firmware/radeon/bonaire_ce.bin 117 /libdata/firmware/radeon/bonaire_mc.bin 118 /libdata/firmware/radeon/bonaire_me.bin 119 /libdata/firmware/radeon/bonaire_mec.bin 120 /libdata/firmware/radeon/bonaire_pfp.bin 121 /libdata/firmware/radeon/bonaire_rlc.bin 122 /libdata/firmware/radeon/bonaire_sdma.bin 123 /libdata/firmware/radeon/bonaire_smc.bin 124 /libdata/firmware/radeon/bonaire_uvd.bin 125 /libdata/firmware/radeon/hainan_ce.bin 126 /libdata/firmware/radeon/hainan_mc.bin 127 /libdata/firmware/radeon/hainan_me.bin 128 /libdata/firmware/radeon/hainan_pfp.bin 129 /libdata/firmware/radeon/hainan_rlc.bin 130 /libdata/firmware/radeon/hainan_smc.bin 131 /libdata/firmware/radeon/hawaii_ce.bin 132 /libdata/firmware/radeon/hawaii_mc.bin 133 /libdata/firmware/radeon/hawaii_me.bin 134 /libdata/firmware/radeon/hawaii_mec.bin 135 /libdata/firmware/radeon/hawaii_pfp.bin 136 /libdata/firmware/radeon/hawaii_rlc.bin 137 /libdata/firmware/radeon/hawaii_sdma.bin 138 /libdata/firmware/radeon/hawaii_smc.bin 139 /libdata/firmware/radeon/kabini_ce.bin 140 /libdata/firmware/radeon/kabini_me.bin 141 /libdata/firmware/radeon/kabini_mec.bin 142 /libdata/firmware/radeon/kabini_pfp.bin 143 /libdata/firmware/radeon/kabini_rlc.bin 144 /libdata/firmware/radeon/kabini_sdma.bin 145 /libdata/firmware/radeon/kaveri_ce.bin 146 /libdata/firmware/radeon/kaveri_me.bin 147 /libdata/firmware/radeon/kaveri_mec.bin 148 /libdata/firmware/radeon/kaveri_mec2.bin 149 /libdata/firmware/radeon/kaveri_pfp.bin 150 /libdata/firmware/radeon/kaveri_rlc.bin 151 /libdata/firmware/radeon/kaveri_sdma.bin 152 /libdata/firmware/radeon/mullins_ce.bin 153 /libdata/firmware/radeon/mullins_me.bin 154 /libdata/firmware/radeon/mullins_mec.bin 155 /libdata/firmware/radeon/mullins_pfp.bin 156 /libdata/firmware/radeon/mullins_rlc.bin 157 /libdata/firmware/radeon/mullins_sdma.bin 158 /libdata/firmware/radeon/oland_ce.bin 159 /libdata/firmware/radeon/oland_mc.bin 160 /libdata/firmware/radeon/oland_me.bin 161 /libdata/firmware/radeon/oland_pfp.bin 162 /libdata/firmware/radeon/oland_rlc.bin 163 /libdata/firmware/radeon/oland_smc.bin 164 /libdata/firmware/radeon/pitcairn_ce.bin 165 /libdata/firmware/radeon/pitcairn_mc.bin 166 /libdata/firmware/radeon/pitcairn_me.bin 167 /libdata/firmware/radeon/pitcairn_pfp.bin 168 /libdata/firmware/radeon/pitcairn_rlc.bin 169 /libdata/firmware/radeon/pitcairn_smc.bin 170 /libdata/firmware/radeon/tahiti_ce.bin 171 /libdata/firmware/radeon/tahiti_mc.bin 172 /libdata/firmware/radeon/tahiti_me.bin 173 /libdata/firmware/radeon/tahiti_pfp.bin 174 /libdata/firmware/radeon/tahiti_rlc.bin 175 /libdata/firmware/radeon/tahiti_smc.bin 176 /libdata/firmware/radeon/verde_ce.bin 177 /libdata/firmware/radeon/verde_mc.bin 178 /libdata/firmware/radeon/verde_me.bin 179 /libdata/firmware/radeon/verde_pfp.bin 180 /libdata/firmware/radeon/verde_rlc.bin 181 /libdata/firmware/radeon/verde_smc.bin 182 183 We will re-import these radeon firmware images another way 184 later. 185 18620190727: 187 The uefi bootloader has gained tftp support and needs a clean 188 build. If you do update builds, manually clean its object 189 directory by something like: 190 cd sys/arch/i386/stand/efiboot && make clean 191 19220190723: 193 The jemalloc allocator in libc is now build without extended 194 debugging (for performance reasons). In update builds make sure 195 to rebuild it completly, by removing all affected object files, 196 including compat builds, something like: 197 cd /usr/obj && find . -type d -name jemalloc|xargs rm -rf 198 19920190207: 200 GCC 7 switched for many ports. Update builds are likely to fail. 201 20220180924: 203 A newer OpenSSL version has been imported. If you are doing 204 update builds, make sure to remove all old obj dirs, like: 205 cd /usr/obj && find . -type d -name openssl | xargs rm -rf 206 20720180717: 208 On aarch64 int64_t and related types have changed from long long 209 to long. This requires recompiling all C++ binaries. 210 21120180713: 212 On amd64 and i386 static binaries are now build position 213 independend. This requires recompilation of all object 214 files used to create the crunched /rescue binary. 215 Clean the rescue directory in your obj directory before 216 doing an update build, otherwise linking will fail. 217 21820180414: 219 Existing binutils was migrated to binutils.old. Manual 220 removal of tools/binutils objects directory may be required 221 to fix tools build failure. 222 22320180311: 224 bdftopcf was updated and may need cleaning in the 225 src/external/mit/xorg/tools/bdftopcf subdirectory if there are 226 link errors. 227 22820180212: 229 between OpenSSL and GCC updates, many things may fail to build. 230 any failure that looks like GCC or openssl is best handled by 231 a clean destdir and objdir. Full cleandir and destdir deletion 232 is recommended if build failures occur. 233 23420171225: 235 removal of the vadvise syscall requires manual removal of all 236 associated files from the libc build object directory (including 237 the .depend files) - a command like: 238 cd $OBJ && find . -type d -name libc | xargs rm -rf 239 For architectures that support multiple "compat" binary targets, 240 you'll need to cleanup both the regular libc directory and the 241 compat ones (the above command will do that). 242 24320171010: 244 a change to the build structure of external/bsd/acpica/bin/iasl 245 means that its objdir (or *.d and .depend at least) might need 246 to be manually removed - or a build done once without -u. 247 24820170822: 249 a new version of GMP has been imported and probably 250 will break parts of builds related to themselves or GCC, both 251 in the tools and the native section. Remove all GCC, GMP, MPFR 252 and MPC objdirs or build once without -u. 253 25420170816: 255 a new version of MPFR and MPC have been imported and probably 256 will break parts of builds related to themselves or GCC, both 257 in the tools and the native section. Remove all GCC, GMP, MPFR 258 and MPC objdirs or build once without -u. 259 26020170402: 261 a new version of dhcpcd has been imported, which does not support 262 update builds from the previous version. Remove your 263 external/bsd/dhcpcd object dir or build once without -u. 264 26520170211: 266 a new terminfo database has been imported. 267 The structure of it has changed slightly from prior versions and 268 an updated tic tool is required. 269 If you build.sh, don't use -u 270 27120170207: 272 various arch dependent libc/exect.S files were removed 273 Either remove the obj directories (lib/libc and compat/amd64/i386/lib 274 if it exists) or do a clean build. 275 (This is a bug in the make system, it should be corrected without 276 human intervention, but isn't.) 277 27820170104: 279 xinput build options have changed. 280 Remove the obj directory (external/mit/xorg/bin/xinput) 281 if you build.sh -u 282 28320170103: 284 a new version of flex has been imported. 285 Remove the file from obj (external/bsd/flex) 286 if you build.sh -u 287 28820161014: 289 a new version of OpenSSL has been imported. 290 Remove the files from obj (crypto/external/bsd/openssl) 291 if you build.sh -u 292 29320161009: 294 a new version of dhcpcd has been imported with slightly changed 295 build infrastructure. When doing a build.sh -u this requires 296 pruning the external/bsd/dhcpcd objdir. 297 29820160914: 299 i386, amd64, shark, ofppc and macppc have joined shark and x68k 300 ports in using xorg-server 1.18. This requires a clean destdir 301 and a clean objdir. 302 30320160527: 304 i386 needs a full cleandir or objdir deletion because PIE has 305 been enabled. (see the amd64 entry two down for further info) 306 30720160418: 308 libedit needs manual removal of all autogenerated files since 309 some of them are not autogenerated anymore. Remember that there 310 might be two copies of libedit if your platform builds "compat". 311 31220160410: 313 amd64 needs full "make cleandir" or deletion of objdir now that 314 PIE has been enabled for amd64. PIE, or position-independent 315 executables, means all code, including executables and not just 316 shared libraries, is position-independent and hence able to be 317 relocated by ASLR, address space layout randomization. 318 319 The change was made in Makefile variables for compiler and 320 linker flags, for which make(1) does not record dependencies, 321 hence it is unable to detect that all .o files need rebuilding. 322 323 Partial rebuilds with some modified source files will likely 324 fail when linking executables, since the linker refuses to mix 325 position-independent code with position-dependent code in 326 position-independent executables: 327 328 .../x86_64--netbsd/bin/ld: foo.o: relocation R_X86_64_32 against `...' cannot be used when making a shared object; recompile with -fPIC 329 33020160401: 331 Ports switching to GCC 5.3 will need a full "make cleandir". 332 Some people have found that cleandir is not sufficient, so if 333 in doubt delete the entire object directory tree for gcc. 334 33520160306: 336 NetBSD's regexp implementation is now part of libnbcompat. 337 Nblex, nbm4, nbpax, nbsed use it and they may crash on 338 non-NetBSD hosts if linked with stale object files produced 339 while they included a non-NetBSD regex.h. 340 In any case, you should "make cleandir" at least these tools 341 before updating your toolchain. 342 34320160125: 344 Dtrace has been enabled by default on some architectures. 345 When doing an update build, make sure to clean the etc/mtree 346 object directory before starting the build - otherwise the 347 needed directories in destdir will not be created. 348 An easy way to do this is: 349 cd src/etc/mtree && $TOOLDIR/bin/nbmake-$arch cleandir 350 35120150818: 352 New acpica requires "make cleandir" in src/external/bsd/acpica 353 again. 354 35520150413: 356 New acpica requires "make cleandir" and reinstalling yacc 357 in /usr/src/external/bsd/byacc and /usr/src/tools/yacc and 358 also "make cleandir" in /usr/src/external/bsd/acpica. 359 36020150404: 361 Lint changes require a full rebuild of the tool, so make 362 sure to build without -u option to build.sh, or manually 363 do a make cleandir in src/tools/lint1 and 364 src/usr.bin/xlint. 365 36620150310: 367 Improvements to openssl for arm mean that update builds of 368 the openssl libraries will fail. A make cleandir in 369 external/bsd/openssl/lib is needed 370 37120141026: 372 A mishap during the import of pppd may cause your corruption 373 in your cvs directory if you happened to do a cvs update 374 during a short period of time. To fix, just remove the 375 directory src/external/bsd/ppp/dist/pppd completely 376 and let cvs restore it on next update. 377 37820140721: 379 The src/external/mit/lua/src directory was accidentally created 380 and then deleted in the CVS repository. If you get errors like 381 382 cvs [update aborted]: cannot open directory 383 /cvsroot/src/external/mit/lua/src: No such file or directory 384 385 then delete your local copy of that directory tree and try again. 386 38720140530: 388 ARM eABI switched to DWARF based exception handling. This requires 389 rebuilding all C++ code. It is strongly advised to do a clean build. 390 39120140131: 392 The new compiler_rt/libc integration moved a few things. It is strongly 393 advised to do a clean build. At least lib/libc, the compat version(s) 394 of libc, libkern, rump and the kernels need to be cleaned. 395 39620131227: 397 1. The new ntpd runs in a restricted mode to prevent amplification 398 attacks. If you need ntpdc to work you need to explicitly enable 399 mode7 in your config file. Make sure you put the necessary restrict 400 statements to avoid being exposed. 401 2. strncat has moved from lib/libc to common/lib/libc; you might need 402 to make clean in libc 403 40420131129: 405 The GMP sources were updated, and builds will likely fail without 406 cleaning their build trees for both tools and in-tree, like below. 407 40820131128: 409 The MPC and MPFR sources were updated, and builds may require their 410 tools and in-tree directories cleaned for successful updates. 411 41220130605: 413 The kernel option FAST_IPSEC no longer exists, it's been renamed 414 to IPSEC (and the older IPSEC version removed). 415 41620130605: 417 Previous freetype installations erroneously installed private 418 header files. If you are building against a non-empty $DESTDIR, 419 please remove ${DESTDIR}//usr/X11R7/include/freetype2/freetype/. 420 42120130531: 422 The xdm update may cause build failure due to xdm.man being 423 in the obj tree. Make sure to ensure any like this: 424 nbmake: nbmake: don't know how to make xdm.man. Stop 425 is fixed by deleting the xdm.man in the obj tree. 426 42720130530: 428 Updates of many xsrc packages will leave old .pc files around. 429 Best to clean out the xsrc objdir entirely before rebuilds. 430 43120130301: 432 The removal of netiso requires manual removal of /usr/include/netiso 433 prior to the build and make cleandir in /usr/src/usr.bin/{ktruss,kdump} 434 43520120726: 436 The update of OpenSSL requires cleaning both the OpenSSL build 437 directory and DESTDIR. *Even non-update builds require cleaning 438 DESTDIR.* Builds done without taking these steps may fail, or in 439 some cases may succeed and install broken OpenSSL libraries that 440 cause third-party software to link incorrectly and/or crash. 441 44220120507: 443 The database schema for makemandb was changed. You will 444 need to update the database using 'makemandb -f' or wait 445 for the next weekly run to fix it. 446 44720120319: 448 sys/conf/Makefile.kern.inc has been modified to adjust the 449 size of db_symtab automatically. You need to update dbsym in 450 your $TOOLDIR to build kernels with options SYMTAB_SPACE. If 451 you don't want this behavior, add AUTO_SYMTAB_SPACE=no to your 452 mk.conf. 453 45420120216: 455 Default for MKCATPAGES changed to NO. Update builds will fail 456 unless DESTDIR is cleaned manually. If you built between 20120207 457 and 20120216, daily and weekly could have created an unreadable 458 /var/db/man.db index for apropos. Running makemandb -f or 459 the next run of weekly will fix it. 460 46120111227: 462 If you built between 20111225 and 20111227 you need to remove 463 /usr/lib/libpam.so.4* and /usr/lib/security/*.so.4, since the 464 bump has been reverted. 465 46620111125: 467 The "rnd" pseudodevice has been added to sys/conf/std, which 468 means it should no longer be explicitly listed in kernel 469 configuration files. The line "pseudo-device rnd" should be 470 removed from any custom kernel config files users may have. 471 47220111119: 473 A problem with the datastructures used by the rndctl(8) 474 utility (pointers in datastructures in an array, making 32->64 475 bit compatibility very painful) has been fixed in a 476 non-backwards-compatible way. If you replace your kernel, 477 replace your rndctl executable too. 478 47920111001: 480 the prop_*_send_syscall() functions from proplib(3) have been 481 changed and their new version is not backward compatible with the old 482 one. So ensure that all consumers of these functions (currently: 483 quota2 code and its tests) are updated together with the new lib. 484 48520110817: 486 sparc has been changed to use GCC 4.5.3, so any objdir or 487 DESTDIR for them should be deleted before updating. 488 48920110806: 490 i386 and amd64 have been changed to use GCC 4.5.3, so any 491 objdir or DESTDIR for them should be deleted before updating. 492 49320110805: 494 The update to GCC 4.5.3 requires a non-trivial portion of 495 the tree to be cleaned. Best to delete both objdir and 496 DESTDIR before running this update. So far, only the 497 sparc64, mips and powerpc platforms have changed. 498 49920110803: 500 The layout of external/public-domain/xz has changed. To do an 501 update build you will have to remove the contents of the OBJDIR 502 for external/public-domain/xz/bin by hand as the xz entry there 503 is now a directory. 504 50520110410: 506 The configuration of src/tools/gcc has changed. To do an 507 update build you have to clean both tools/binutils and 508 tools/gcc by hand. 509 51020110328: 511 Building the Xorg binary was moved into a subdirectory to fix 512 ordering issues with "make all". It may be necessary to remove 513 the OBJDIR for external/mit/xorg/server/xorg-server/hw/xfree86 514 if your update build fails, as the "Xorg" entry there is now a 515 directory. 516 51720110121: 518 Assembler files no longer use -traditional-cpp. This can break 519 the build of individual parts of the tree. This is handled 520 correctly by build.sh. Manual builds have to update /usr/share/mk 521 and re-run config(1) for any kernel configurations as needed. 522 52320101217: 524 The tcpdump(8) program was changed to drop privileges and chroot(2) 525 by default. It may be necessary to manually update passwd(5) and 526 group(5) in order to make the program work with existing setups. 527 52820101125: 529 The latest changes to setenv(3) dissallow setting environment 530 variables with names that contain '='. Revision 1.18 of env.c 531 assumed that this was allowed. Installing a new libc with an 532 old copy of /usr/bin/env causes env x=1 printenv | grep x= to 533 break which affects the autoconf tests for dependency finding, 534 so building gcc will end up printing: 535 checking dependency style of gcc... none 536 configure: error: no usable dependency style found 537 Fix it by rebuilding and re-installing env. 538 53920101119: 540 Recent Xorg updates in xsrc/external/mit/ may cause various build 541 or run-time problems. Delete your entire DESTDIR and OBJDIR if you 542 have any build problems with xsrc, or problems with mismatched 543 versions between xorg-server and drivers. 544 54520100604: 546 The update of ATF to 0.9 causes old tests written in shell to fail 547 unless they are rebuilt. If you are building with MKUPDATE=yes, 548 you need to clean the src/external/bsd/atf/tests/ and the src/tests/ 549 trees by hand. 550 55120100522: 552 Recent Xorg updates in xsrc/external/mit/ will cause various build 553 problems. Delete your entire DESTDIR and OBJDIR if you have any 554 build problems with xsrc. 555 55620100522: 557 private section of <ctype.h> was split, and now mklocale(1) 558 include ctype_local.h, so you have to make cleandir in tools/mklocale. 559 56020100520: 561 The location of the xkb compiled descriptions has changed. Please 562 remove usr/X11R7/lib/X11/xkb/compiled from your $DESTDIR. 563 56420100222: 565 The shared objects file extension has been changed from .so to 566 .pico, in order to avoid conflicts with shared libraries names 567 libXX.so. All now stale regular .so files can be removed from 568 your object directories. 569 57020100204: 571 The termcap database has been removed from the sources, 572 but has not been marked obsolete so it is not removed 573 from the system when upgrading. 574 As such, you will need to remove them from your object 575 and destination directories. 576 57720091101: 578 After updating, it may be necessary to make the 'cleandir' 579 target in src/tools/yacc/ and in src/usr.bin/yacc/ before a 580 'build.sh -u tools' or 'build.sh -u distribution'. Ditto 581 src/tools/lex/ and src/usr.bin/lex/. 582 58320091001: 584 On amd64 you must rebuild tools (to get the new binutils) 585 before building a kernel, or the build fails on cpufunc.S. 586 58720091001: 588 An error will create a ./usr/X11R7/lib/X11/xkb/compiled/xkb 589 symlink, failing the build. Delete the link, and the subdir 590 it is in, and retry your build. 591 59220090718: 593 libc build changed so that strchr() provides the extra entry 594 point for index(). Update build of libc.a (and libc_pic.a) 595 may fail because the archive contains the unwanted index.o. 596 (Similarly for strrchr() and rindex().) 597 59820090709: 599 Native Xorg was upgraded again. Builds will probably fail again 600 without a clean objdir, at least for src/external/mit/xorg. 601 60220090616: 603 Native Xorg was upgraded. Builds will need a clean objdir for 604 src/external/mit/xorg. Upgrading a system from sets will not 605 work properly yet as the /usr/X11R7/lib/X11/xkb/symbols/pc 606 subdirectory has been changed into a file, and this needs to 607 be manually "rm -r"'ed before installing xbase.tgz. 608 60920090501: 610 Several new functions were added to string.h/libc, and this 611 can cause autoconf problems during the tool build for people 612 who fail to clean out their tools objects properly. If you 613 note messages about stpcpy, stpncpy or strnlen accompanying a 614 failure during the tool build, clean out all your tools 615 objects and start again. 616 61720090325: 618 The i386 port was switched to i486 default toolchain. This requires 619 cleaning your src/tools directory and $TOOLDIR and rebuilding them. 620 62120090126: 622 The __posix_fadvise50 system call changed assembly stub type. You 623 need to 'rm -f __posix_fadvise50.*' in the libc build directory 624 to avoid using the old assembly stub. 625 62620090202: 627 pkg_install now depends on the pkgdb cache for automatic conflict 628 detection. It is recommended to rebuild the cache with 629 ``pkg_admin rebuild''. 630 63120090110: 632 time_t and dev_t have been bumped to 64 bit quantities. To upgrade: 633 1. Make sure your kernel has COMPAT_50 in it. Build and install. 634 This is needed even in the MODULAR kernel because there is 635 conditionally compiled code in rtsock.c. 636 2. make sure build.sh completes and the binaries in a chroot work 637 before installing. 638 3. If you don't use build.sh and you build directly to root, and 639 your build breaks in the middle, don't despair. Make sure headers 640 are installed properly, and start building libraries first libc 641 and libutil, install them and then continue building all the 642 libraries in src/lib and src/gnu/lib and install them. Once 643 the new libraries are installed, you can restart the build. 644 4. If you compile packages and you notice link time warnings, 645 rebuild the required packages to update their shared libraries. 646 Any package you rebuild will require rebuilding all the packages 647 that depend on it. 648 5. Next time you run pwd_mkdb with the new binary, the file 649 will be upgraded and it will not be backwards compatible. 650 6. The utmpx/wtmpx files (/var/run/utmpx and /var/log/wtmpx, see 651 lastlogx(5)) have been versioned, and there is a heuristic 652 for utmp. You are better off removing the old files after 653 upgrading. The automated clearing of /var/run during 654 boot, and the automated rotating of files in /var/log by 655 newsyslog(8), may mean that you do not have to remove the 656 files manually. 657 7. The optional accounting file (/var/account/acct, see 658 accton(8)) has not been versioned, and will need to be 659 removed. The automatic rotation of the accounting file by 660 /etc/daily limits the bad consequences of failure to remove 661 the file. 662 8. Application software that writes time_t to binary files on 663 disk will break or need attention. Most notably: if you are 664 using PostgreSQL < 8.4, you need to dump your databases, 665 rebuild PostgreSQL with the new time_t, then restore. 666 66720081219: 668 config(1) has been updated, and one of the files it creates - 669 swapnetbsd.o - has changed format. You need to rebuild config 670 (done automatically by build.sh) and then you need to rerun 671 config on all kernel configuration files before rebuilding those 672 kernels. 673 67420081205: 675 If you build with MKX11=no, you should remove /etc/rc.d/xdm and 676 /etc/rc.d/xfs from DESTDIR because those files were moved to the xetc 677 set and will appear as extra files for MKX11=no update builds. 678 67920081122: 680 On i386, various kernel options(4) in GENERIC including 681 file systems have been disabled and moved into kernel modules. 682 Before trying a new GENERIC kernel, you have to prepare the 683 following files as well as a new GENERIC kernel: 684 685 - build and install kernel modules from src/sys/modules 686 687 - install the latest bootloader, which will load a module 688 for the file system from which the kernel is loaded automatically 689 690 If you have to load your kernel from a file system which is not of 691 the same type as the root file system, you have to load the necessary 692 file system module manually on the boot prompt or in the boot.cfg file. 693 69420080827: 695 If you built and installed a libc from sources between 696 2008/08/20 and 2008/08/26 you got a broken strtouq(3) 697 which results in false errors reported by lint(1). 698 Since this breaks the libc build itself, manual help is 699 needed -- lint must be disabled temporarily, e.g.: 700 $ (cd lib/libc && make MKLINT=no dependall install) 701 70220080813: 703 MKDEBUG build was broken because the .depend files did not know 704 about .go files. You need to remove all .depend files and rebuild. 705 70620080802: 707 A regression in binary compatibility for pthread_mutex_t has 708 been fixed. Unfortunately, the price is breaking compatibility 709 for -current. 710 711 Threaded programs (using libpthread) and C++ programs (using 712 libstdc++) compiled after 20070907 and before 20080802 need to 713 be recompiled. 714 715 One way to find affected pkgsrc packages: 716 717 $ grep REQUIRES=/usr/lib/libpthread /var/db/pkg/*/+BUILD_INFO 718 $ grep REQUIRES=/usr/lib/libstdc++ /var/db/pkg/*/+BUILD_INFO 719 72020080731: 721 WAPBL (metadata journaling support) has been added, but at this 722 time isn't backwards compatible with pre-WAPBL aware kernels 723 and userland (fsck_ffs in particular). Please make sure you 724 don't use a journaled filesystem with an older kernel/userland, 725 especially an uncleanly mounted journaled filesystem. WAPBL 726 also requires the super block to be in the UFS2 format. You 727 can use fsck_ffs -c 4 to update the superblock format. 728 72920080721: 730 Assembler warnings are now fatal if $WARNS>0 and $NOGCCERROR 731 isn't defined. 732 73320080531: 734 The ioctl number of DRVSUSPENDDEV command on /dev/drvctl changed 735 from 125 (conflicted with DRVCTLCOMMAND) to 129. The drvctl(8) 736 utility needs to be rebuilt and reinstalled as older binaries 737 won't work correctly. The following sequence of commands: 738 739 $ (cd sys/sys/ && nbmake-$arch includes) 740 $ (cd sbin/drvctl/ && nbmake-$arch clean) 741 $ (cd sbin/drvctl/ && nbmake-$arch all) 742 743 leaves new drvctl utility in sbin/drvctl build directory. 744 74520080503: 746 The <bsd.lib.mk> variable MKPRIVATELIB was renamed to LIBISPRIVATE. 747 74820080521: 749 For a while, unprivileged UPDATE builds would fail to 750 succeed at the checkflist stage, complaining that 751 ${DESTDIR}/stand/<arch>/ did not exist. A fix for this 752 problem was committed to share/mk/bsd.kmodule.mk, revision 1.9. 753 If you already hit this problem, update the .mk file, 754 remove ${DESTDIR}/stand/<arch>, and re-run the build. 755 75620080303: 757 Linker warnings are now fatal if $WARNS>0. 758 75920080126: 760 The posix_fadvise system call has been changed from an assembly 761 stub, to a c file that calls an assembly stub. You need to 762 'rm -f posix_fadvise.* .depend' in the libc build directory to 763 avoid using the old assembly stub. 764 76520071209: 766 The acpiec(4) driver has been split into two attachments. If you 767 get ACPI errors before the attachment, please update your kernel 768 configuration file appropriately or see GENERIC for more details. 769 77020071115: 771 The it(4) driver has been renamed to itesio(4) and the old port 772 argument specified in the kernel configuration file is not valid 773 anymore. The itesio(4) driver now uses the Super I/O address port 774 rather than the EC address port. Please update your kernel 775 configuration file appropriately or see GENERIC for more details. 776 77720071028: 778 The pccons(4) driver has been removed from the NetBSD/shark port. 779 You need to update any custom kernel configuration file you have 780 to remove any references to pccons (which includes removing the 781 now useless XSERVER option) and replace them with the correct 782 entries for the wscons driver. See the GENERIC configuration file 783 for more details. 784 78520070913: 786 A latent bug in dhclient/dhcpd that caused it to be unable to 787 enumerate interfaces was fixed. The bug began to cause 788 problems after 20070911 when the kernel's SIOCGIFCONF 789 implementation was repaired. From 20070529 to 20070911 racoon 790 could not enumerate interfaces. (These are noted because 791 normal kernel/userspace version matching hygiene is not 792 sufficient to avoid this problem.) Ensure that both kernel 793 and userland are from after 20070913. 794 79520070703: 796 nbinstall has been renamed ${MACHINE_GNU_ARCH}-install. It 797 calls the target-specific strip program, and the logic to pass 798 down STRIP from make has been removed. This requires a 799 re-installation of tools. 800 80120070422: 802 The way OS emulations lookup filenames inside the emulation root 803 has been changed. Rather than modify the pathname (and copy back 804 to userspace) namei() and lookup() directly check the emulation 805 root. One side effect is that absolute symlinks inside the emulated 806 root file system will be relative to that file system - unless they 807 start /../ this is useful when the emulated root is a real install 808 that has such links. 809 This might affect symlinks that have been added to reference outside 810 the emulated root. 811 81220070412: 813 The pckbc driver on sgimips IP32 has been removed. Use macekbc 814 instead. See the GENERIC32_IP3x kernel configuration for an 815 example. 816 81720070319: 818 src/lib/libc/Makefile revision 1.129 broke libc and ld.elf_so 819 on many platforms due to incorrect flags settings. If you 820 updated and built after about 20070315, do "nbmake-$arch 821 cleandir" in src/lib/libc and src/libexec/ld.elf_so to force a 822 rebuild of object files that might have been built 823 incorrectly, and ensure that you have at least 824 src/lib/libc/Makefile 1.130. 825 82620070210: 827 src/sys/sys/{sa.h,savar.h} were removed. 828 find ${OBJDIR} \( -name .depend -o -name '*.d' \) -print \ 829 | xargs egrep -l '/sa.h|/savar.h' | xargs rm 830 will allow dependencies on those files to get get rebuilt 831 83220070209: 833 The threading model was changed when the newlock2 branch 834 was merged to NetBSD-current. If you boot with a new 835 kernel (version 4.99.10), then you also need a new pthread 836 library (/usr/lib/libpthread.so.0.7). If you boot with 837 an old kernel, then you need the old pthread library 838 (/usr/lib/libpthread.so.0.6). Provided you keep the kernel and 839 the pthread library in sync, old threaded applications should 840 continue to work with an old or new kernel. Note that named(8) 841 is the only threaded application in the base system. 842 84320061214: 844 Following the move of string_to_flags() and flags_to_string() 845 from the bin/ls/ sources to libutil, users doing UPDATE builds 846 will need to do a "make cleandir" in 847 tools/mtree/, tools/makefs/, tools/binstall/, tools/pax/, 848 bin/pax/, bin/ls/, usr.sbin/mtree/, usr.sbin/makefs/, 849 usr.bin/xinstall/, libexec/ftpd/, rescue/, as well 850 as the installation images in distrib/ 851 in order to excise stale references to the old stat_flags.h header 852 file in the ls sources -- stat_flags.h has been removed. 853 85420061108: 855 The configure script used in the src/tools/gcc compiler has been 856 changed to indicate that our libc has ssp support built-in and 857 does not depend on -lssp and -lssp-nonshared. You'll need to 858 make clean in src/tools/gcc first to rebuild the compiler. 859 86020061009: 861 The sysctl variables net.inet{,6}.tcp{,6}.newreno are no longer 862 available. Use net.inet{,6}.tcp{,6}.congctl.selected instead. 863 86420060814: 865 The vt, vidcconsole, kbd, and rpckbd drivers on acorn32 have been 866 withdrawn. Use vidcvideo and pckbd instead. See the GENERIC 867 kernel configuration for an example. X servers from the last 868 few years should cope. 869 87020060703: 871 MPACPI is no more. We always configure PCI interrupts using ACPI 872 if we have an ACPI kernel. The option MPACPI_SCANPCI has been renamed 873 to ACPI_SCANPCI. Thanks to work from fvdl. 874 87520060627: 876 socket(2) has changed, and its system call has been versioned. 877 For userlands with the old version of socket(2), make sure that 878 your kernel has 'options COMPAT_30' set, or else 'bad system call' 879 errors will result. 880 881Hints for a more successful build: 882^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 883 Use build.sh, but do not use its "expert mode": 884 This will automatically build the tools in the 885 correct order, and it will keep the tools and the 886 new build products from interfering with the running 887 system. This will allow you to ignore most of the 888 other advice in this file. 889 Build a new kernel first: 890 This makes sure that any new system calls or features 891 expected by the new userland will be present. This 892 helps to avoid critical errors when upgrading. 893 Use object directories: 894 This helps to keep stale object 895 files from polluting the build if a Makefile "forgets" 896 about one. It also makes it easier to clean up after 897 a build. It's also necessary if you want to use the 898 same source tree for multiple machines. 899 To use object directories with build.sh: 900 a) invoke build.sh with the "-M" or "-O" options. 901 To use object directories without using build.sh: 902 a) cd /usr/src ; make cleandir 903 b) Add "OBJMACHINE=yes" to /etc/mk.conf 904 c) Add "MKOBJDIRS=yes" to /etc/mk.conf 905 d) cd /usr/src ; make build 906 Note that running "make obj" in a directory will create 907 in obj.$MACHINE directory. 908 Build to a DESTDIR: 909 This helps to keep old installed files (especially libraries) 910 from interfering with the new build. 911 To build to a DESTDIR with build.sh, use the "-D" option. 912 To build to a DESTDIR without using build.sh, set the DESTDIR 913 environment variable before running make build. It should be 914 set to the pathname of an initially empty directory. 915 Problems: if you do not use build.sh, you might need to 916 update critical utilities without using DESTDIR since 917 nothing is executed from what is installed in DESTDIR. 918 (See critical utils, below.) 919 Build often: 920 This keeps critical utilities current enough to not choke 921 on any other part of the source tree that depends on up to 922 date functionality. If you use build.sh, you should not have 923 this problem. 924 925What to do if things don't work: 926^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 927When things don't work there are usually a few things that commonly 928should be done. 929 1) make includes 930 This should be done automatically by make build. 931 2) cd share/mk && make install 932 Again, automatically done by make build. 933 934Failsafe rebuild of a small part of the tree: 935^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 936To make sure you rebuild something correctly you want to do 937something like the following: 938 1) Make sure the includes and .mk files are up to date. 939 2) Make sure any program used to build the particular 940 utility is up to date. (yacc, lex, etc...) 941 3) cd ...path/to/util... 942 make cleandir 943 rm ...all obj directories... 944 make cleandir # yes, again 945 make obj 946 make depend && make 947 948Failsafe rebuild of the entire tree: 949^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 950If you really want to make sure the source tree is clean and 951ready for a build try the following. Note that sourcing /etc/mk.conf 952(a make(1) Makefile) in this manner is not right, and will not work 953for anyone who uses any make(1) features in /etc/mk.conf. 954 955---cut here--- 956#!/bin/sh 957. /etc/mk.conf 958 959if [ -z $NETBSDSRCDIR ] ; then 960 NETBSDSRCDIR=/usr/src 961fi 962if [ \! -d $NETBSDSRCDIR ] ; then 963 echo Unable to find sources 964 exit 1 965fi 966find $NETBSDSRCDIR -name \*.o -o -name obj.\* -o -name obj -exec rm \{\} \; 967 968if [ -z $BSDOBJDIR ] ; then 969 BSDOBJDIR=/usr/obj 970fi 971if [ -d $BSDOBJDIR ] ; then 972 rm -rf $BSDOBJDIR 973fi 974 975cd $NETBSDSRCDIR && make cleandir 976 977---cut here--- 978 979Critical utilities: 980^^^^^^^^^^^^^^^^^^^ 981 usr.bin/compile_et 982 usr.bin/make 983 usr.bin/yacc 984 usr.bin/lex 985 usr.bin/xlint 986 usr.bin/config 987 988Other problems and possible solutions: 989^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 990Symptom:Complaints involving a Makefile. 991Fix: Rebuild usr.bin/make: 992 cd usr.bin/make && make && make install 993 Or, a failsafe method if that doesn't work: 994 cd usr.bin/make && cc *.c */*.c -I . -o make && mv make /usr/bin 995 996Fix: Make sure .mk files are up to date. 997 cd share/mk && make install 998 999Symptom:Kernel `config' fails to configure any kernel, including GENERIC. 1000Fix: Rebuild usr.bin/config 1001 1002Symptom: 1003Fix: Rebuild usr.bin/yacc 1004 1005Symptom: 1006Fix: Rebuild usr.bin/lex 1007 1008Symptom: 1009Fix: rm /usr/lib/libbfd.a 1010 1011Symptom:Obsolete intermediate files are used during compilation 1012Fix: Try the following sequence of commands in the directory in question. 1013 make cleandir; rm `make print-objdir`; make cleandir; make obj 1014 (If you built the tree without "make obj" in the past, obsolete files 1015 may remain. The command tries to clean everything up) 1016 1017Symptom:.../sysinst/run.c:xx: warning: initialization from incompatible 1018 pointer type 1019Fix: Rebuild and install usr.bin/menuc 1020 1021Symptom:mklocale not found during build in share/locale/ctype 1022Fix: Build and install usr.bin/mklocale 1023 1024Symptom:undefined reference to `__assert13' or `__unsetenv13' 1025Fix: Rebuild and install lib/libc 1026 1027Symptom:usr.bin/config fails to build. 1028Fix: Try building with -DMAKE_BOOTSTRAP added to CFLAGS in Makefile. 1029 1030Symptom:undefined reference to `getprogname' or `setprogname' 1031Fix: Rebuild and install lib/libc 1032 1033Symptom:lint does not understand the '-X' option 1034Fix: May need to build & install libs with NOLINT=1 before rebuilding lint 1035 1036Symptom:Update build fails in src/tools/gcc complaining that a variable 1037 (e.g. CPPFLAGS) has changed since the previous run. 1038Fix: Run "nbmake-${ARCH} clean" in src/tools/gcc or do a clean build. 1039 1040Symptom:cvs [update aborted]: cannot open directory /cvsroot/src/...: 1041 No such file or directory. 1042Cause: If a directory is created by mistake, then it is sometimes 1043 deleted from the CVS repository using administrative commands 1044 that bypass the normal cvs access controls. If your cvs working tree 1045 contains references to a directory that has been deleted on the 1046 server in this way, then "cvs update" reports this error. 1047Fix: Recursively delete the affected directory from your working tree 1048 and try the update again. 1049