DragonFly BSD

hammer

HAMMER2

HAMMER2, the successor of HAMMER, is under active development since 2012 and now the official default filesystem for DragonFly.

General Details

Because HAMMER2 is a block copy-on-write filesystem, the "atime" field is not supported and will typically just reflect local system in-memory caches or mtime.

The radix tree is dynamic in that each entry can dynamically control how many bits it chops off. This allows small files to be contained in just one or two levels regardless of the block seek positions. The depth of the radix tree is increased as needed via a splitting mechanism, and will also be recombined if it grows smaller. All block references are 64-bit aligned-byte-indexed references and thus portable regardless of physical sector size changes between underlying block devices.

Inodes are 1KB of which 512 bytes are used for the top-level radix tree OR 512 bytes of data. Any file less than or equal to 512 bytes stores its data directly in the inode. Files up to 256KB can be accommodated with direct inode block references.

Directory entries are hashed (semi-sorted hash algorithm), and directly embedded in the radix table's blockref structure for maximum performance. Files with very long filenames will contain a dataref, otherwise filenames are embedded in the directory entry itself. Because directory entries are hashed, seeking and lookups are able to use a radix search and no linear scan of the directory is needed.

The inode and directory entry structure is extremely well suited for any file size or directory size, from tiny to huge.

Because of the block-copy-on-write nature of the filesystem, the filesystem is able to create a snapshot trivially simply by copying the volume header's root block table (4 blockref entries). The directory topology actually starts with a SUPERROOT, and volume ROOTs are directory entries under the SUPERROOT. Though the entries are actually special-cased a bit and actually part of the root inode for each filesystem root. And since physical freeing of space is handled via a bulk meta-data scan, destroying a snapshot or volume can be done simply by wiping the inode and ignoring everything under it... the next bulkfree scan will reclaim any reclaimable space. Similarly with file deletions... the top-level data blockrefs can simply be removed. The inode can simply be removed from the radix tree.

Performance is very good. HAMMER2 uses a variable-sized block in powers of two, starting at 1KB, up to 64KB, for the last block of the file (straddling EOF). All earlier blocks in the file, if any, use 64KB blocks. The freemap is organized by domain to cluster various meta-data types together. Indirect blocks can be one of two sizes: 16KB or 64KB, allowing medium-sized files and directories to be optimally allocated. In addition, file data compression of a logical block can result in a smaller physical block. The physical layer always does 64KB I/O and can cluster the I/O on top of that.

Future and TBD Features

Automatic snapshotting in /etc/periodic.conf

    daily_snapshot_hammer2_enable="YES"
    daily_snapshot_hammer2_dirs="/"  # optional
    weekly_snapshot_hammer2_enable="YES"
    weekly_snapshot_hammer2_dirs="/"  # optional
    monthly_snapshot_hammer2_enable="YES"
    monthly_snapshot_hammer2_dirs="/"  # optional

Additional Reference Material

For more information, you can consult the following resources:

What is HAMMER1?

HAMMER1 was the original iteration of the hammer series of file-systems written for DragonFly. It provides instant crash recovery, multi-volume file systems, integrity checking, fine grained history/undo, networked mirroring, and historical read-only snapshots. Note that HAMMER2 is the default file system for DragonFly.

General details

Snapshots

Backups and history

For more details, please read the hammer(5) man page. People interested in porting HAMMER to other operating systems should contact Matthew Dillon at dillon at backplane.com.

Documentation

Document Description
hammer(5) Hammer starter manual page
hammer(8) Hammer utility manual page
undo(1) Hammer undo command
hammer.pdf Hammer major feature document
hammer Hammer mailing list - see mailing list page
NYCBSDCon Slideshow from NYCBSDCon 11 Oct 2008

General Administrative Notes

More help topics involving HAMMER can be found in the documentation section of this website.