release50

DragonFly BSD 5.0

Version 5.0.0 released 16 October 2017
Version 5.0.1 released 06 November 2017
Version 5.0.2 released 04 December 2017

DragonFly version 5.0 brings the first bootable release of HAMMER2, DragonFly's next generation file system.

The details of all commits between the 4.8 and 5.0 branches are available in the associated commit messages for 5.0.0rc1, 5.0.0rc2, 5.0.0, 5.0.1, and 5.0.2.

Big-ticket items

HAMMER2

Preliminary HAMMER2 support has been released into the wild as-of the 5.0 release. This support is considered EXPERIMENTAL and should generally not yet be used for production machines and important data. The boot loader will support both UFS and HAMMER2 /boot. The installer will still use a UFS /boot even for a HAMMER2 installation because the /boot partition is typically very small and HAMMER2, like HAMMER1, does not instantly free space when files are deleted or replaced.

DragonFly 5.0 has single-image HAMMER2 support, with live dedup (for cp's), compression, fast recovery, snapshot, and boot support. HAMMER2 does not yet support multi-volume or clustering, though commands for it exist. Please use non-clustered single images for now.

ipfw Updates

IPFW has gone through a number of updates in DragonFly and now offers better performance. pf and ipfw3 are also still supported.

Improved graphics support

The i915 driver has been brought up to match what's in the Linux 4.7.10 kernel. Intel GPUs are supported up to the Kabylake generation.
vga_switcheroo(4) module added, allowing the use of Intel GPUs on hybrid-graphics systems.
The new apple_gmux driver enables switching to the Intel video chipset on dual Intel/NVIDIA and Intel/Radeon Macbook computers.

Other user-affecting changes

efisetup(8) added.
DragonFly can now support over 900,000 processes on a single machine.
Client-side SSH by default does not try password authentication, which is the default behavior in newer versions of OpenSSH. Pass an explicit '-o PasswordAuthentication=yes' or change /etc/ssh/ssh_config if you need the old behavior. Public key users are unaffected.

Details

Checksums

MD5 (dfly-x86_64-5.0.0_REL.img) = 0b37697389e4dc7380ad4dee1cadf9b0
MD5 (dfly-x86_64-5.0.0_REL.iso) = 599d5e151c0315c1112f7585a8265faf
MD5 (dfly-x86_64-5.0.0_REL.img.bz2) = b40b76dbdd88cafb8db85bc74a7e438f
MD5 (dfly-x86_64-5.0.0_REL.iso.bz2) = 22ecc945e0aacd1bb2ea2318b428a9b0

Upgrading

If you have an existing 4.8.x system and are running a generic kernel, the normal upgrade process, described below, will work.

Note that DSA OpenSSH keys were deprecated in the 4.6 to 4.8 release. If you are upgrading from a release older than 4.8 and use DSA OpenSSH keys, please update your private/public key pair or risk locking yourself out.

Change your local /usr/src to 5.0:

cd /usr/src
git fetch origin
git branch DragonFly_RELEASE_5_0 origin/DragonFly_RELEASE_5_0
git checkout DragonFly_RELEASE_5_0
git pull

And then rebuild: (in /usr/src )

make buildworld
make buildkernel
make installkernel
make installworld
make upgrade

Don't forget to upgrade your existing packages. 5.0 packages have already been built and are immediately available.

pkg upgrade

All changes since DragonFly 4.8

Kernel

if_sl, if_ppp, and if_faith are now built as modules and can be removed from kernel configs.
NX (no-execute) pmap support has been added.
Use 64-bit serials for poll/select's kevent.udata. This fixes an issue where serial cycling could cause spurious events to be reported.
Fix several issues for encrypted installations.
Fix a blocked-lock issue in procfs
Fix a serious permissions bug for sticky directories
Fix event preset bug
Fix an ACPI initialization ordering issue
Fix a CAM shutdown ordering issue
NX support added to kernel, but does not work with some interpreted or JIT languages so disabled by default.
Fix a crypto subsystem stall.
Ryzen CPUs can lockup when the instruction pre-fetcher (which can be speculative) transitions from a canonical to a non-canonical address. This can happen if the top of the user stack is mapped. Unmap the top of the user stack, and the top of the user stack is no longer considered to be part of userspace.
Longer stir in arc4random(), make arc4random per-cpu to reduce contention.
Fix a zget() panic which can occur during heavy paging
Fix clustering inefficiencies
tmpfs and vn can't handle certain swapoff situations. Be sure to fail a swapoff attempt under such conditions so not corruption occurs.
Fix a gcc code reordering problem related to td_critcount operations. This fixes a lockmgr() race.
Significantly reduce tsleep()/wakeup() queue collisions.
Do many more NUMA-localized allocations for per-cpu structures.
Add better AMD topology detection.
Restrict kill(-1, ...) to the current reaper group. This fixes issues during bulk builds via synth where third-party programs erroneously signal process -1 after a fork() failure.
Fix broken cpu rotator in lwkt_alloc_thread().
Fix a rare allproc scan vs p_ucred race
Fix unnecessary ucred duplication which led to potentially as many ucred allocations as vnodes.
Fix a memory ordering race in the shared lock mutex code.
Fix an ordering issue with coincident systimer interrupts. This improves user/sys/idle percentage reporting.
Change our MBR partition type from 0xA5 (which we shared with FreeBSD) to 0x6C
Fix a callout_stop()/callout_reset() rearming race
Improve flushing during low-memory situations
Add an emergency pager. The normal pager can pageout vnode-backed pages, but the complexity of the filesystem VFS can cause low-memory deadlocks during such flushes. The emergency pager only pages out anonymous memory and can recover these situations.
Fix the panic() code for AMD cpus that assumed mwait hinting support when there might not be any.
Improve TSC handling.
Fix a SMP tsleep_interlock() vs wakeup() race.
Validate the kernel up to 1 million processes (since PIDs are restricted to 6 digits, this is the max). Fix numerous issues that crop up under high-process-count conditions. Yes, it actually does work.
Increase the default posix-lock limit.
Remove a performance bottleneck related to large numbers of pipe() close() operations.
Scale tsleep() performance to hundreds of thousands of processes.
Refactor the maxproc calculation, allowing maxproc to be higher without improperly scaling maxvnodes and other resources to insane levels.
Refactor the load calculation code to not stall cpu 0 when a large number of processes are present (aka a million procsses).
Fix excessive call stack depth for stuck interrupts.
Refactor IPI vector assignments and reformulate INVLTLB IPIs

Networking

Direct input support for polling, on by default for ix(4).
Allow up to 64 TX and RX rings for X550 chipsets
Do not pad if_re chips which do not require explicit padding. This fixes UDP checksum generation on these chipsets.
Limit the number of accepted sockets that kevent() reports. Defaults to 32. Does not effect accept() calls. This deconfuses some third party applications.
Bring in vmx (VMWare virtual network driver, aka vmxnet3).
Add Kabylake support (add Kabylake PCI IDs)
Improve syncache performance.
Add an interface network filter to IPFW.
Add an ipfrag filter to IPFW.
Rework IPFW's states and tracks.
Reduce unnecessary IPIs by using sendmsg_oncpu() when possible.
Improve ipflow code.
Improve polling code.
Fix issue with accelerated IPv4/IPv6 fragment draining.
Randomize the local port.
MSI enabled by default for if_em devices which support it.

Other drivers

virtio_scsi(4) added
ig4(4) devices are now recognized.
internal updates to the isp(4) SCSI adapter driver.
ADMA2 mode is now supported for SD card data transfer.
UHS1 SD card disk format is now supported.
Properly delete /dev/dsp and /dev/mixer on sound module unload.
NVMe now handles devices without MSI-X support (aka virtualized NVMe).
vtnet and virtio_blk improvements.

Userland

HAMMER1 now is at an internal version of 7, reflecting a new, faster checksum operation.
kcollect(8) has been added for automatic data gathering on a running DragonFly system.
sshlockout(8) will now lock out based on number of attempts.
Fix a static buffer overflow in mfiutil
Fix a graphics compatibility enable test in 'window'
Fix several sscanf bugs in userland
usched now allows a process to change its own cpu affinity
Fix a bug in ceill()
Fix a seg-fault on crypt failure.
Many namespace cleanups to improve dports compatibility.
OpenSSH updated to 7.6p1

Various tools have been upgraded in the base system:

Hammer Changes

Improve concurrent dedup stability under heavy concurrent loads.
HAMMER to version 7. This version changes the CRC mechanic from an older slower CRC API to the ISCSI CRC code, which is 6x faster. Improves HAMMER performance. HAMMER supports both old and new CRC methods and is backwards compatible, but only files created after this change will use the new mechanism.

Clang status

A starting framework has been added for using clang as the alternate base compiler in DragonFly, to replace gcc 4.7. It's not yet complete. Clang can of course be added as a package.

Package updates

Many package updates but I think most notably we need to point to chrome60 finally getting into dports with accelerated video and graphics support.

64-bit status

Note that DragonFly is a 64-bit-only operating system as of 4.6, and will not run on 32-bit hardware.
AMD Ryzen is supported and DragonFly 5.0 has a workaround for a hardware bug.