9c7f8050f4
Kernel: * Add runtime quantity lfs_ravail, the number of disk-blocks reserved for writing. Writes to the filesystem first reserve a maximum amount of blocks before their write is allowed to proceed; after the blocks are allocated the reserved total is reduced by a corresponding amount. If the lfs_reserve function cannot immediately reserve the requested number of blocks, the inode is unlocked, and the thread sleeps until the cleaner has made enough space available for the blocks to be reserved. In this way large files can be written to the filesystem (or, smaller files can be written to a nearly-full but thoroughly clean filesystem) and the cleaner can still function properly. * Remove explicit switching on dlfs_minfreeseg from the kernel code; it is now merely a fs-creation parameter used to compute dlfs_avail and dlfs_bfree (and used by fsck_lfs(8) to check their accuracy). Its former role is better assumed by a properly computed dlfs_avail. * Bounds-check inode numbers submitted through lfs_bmapv and lfs_markv. This prevents a panic, but, if the cleaner is feeding the filesystem the wrong data, you are still in a world of hurt. * Cleanup: remove explicit references of DEV_BSIZE in favor of btodb()/dbtob(). lfs_cleanerd: * Make -n mean "send N segments' blocks through a single call to lfs_markv". Previously it had meant "clean N segments though N calls to lfs_markv, before looking again to see if more need to be cleaned". The new behavior gives better packing of direct data on disk with as little metadata as possible, largely alleviating the problem that the cleaner can consume more disk through inefficient use of metadata than it frees by moving dirty data away from clean "holes" to produce entirely clean segments. * Make -b mean "read as many segments as necessary to write N segments of dirty data back to disk", rather than its former meaning of "read as many segments as necessary to free N segments worth of space". The new meaning, combined with the new -n behavior described above, further aids in cleaning storage efficiency as entire segments can be written at once, using as few blocks as possible for segment summaries and inode blocks. * Make the cleaner take note of segments which could not be cleaned due to error, and not attempt to clean them until they are entirely free of dirty blocks. This prevents the case in which a cleanerd running with -n 1 and without -b (formerly the default) would spin trying repeatedly to clean a corrupt segment, while the remaining space filled and deadlocked the filesystem. * Update the lfs_cleanerd manual page to describe all the options, including the changes mentioned here (in particular, the -b and -n flags were previously undocumented). fsck_lfs: * Check, and optionally fix, lfs_avail (to an exact figure) and lfs_bfree (within a margin of error) in pass 5. newfs_lfs: * Reduce the default dlfs_minfreeseg to 1/20 of the total segments. * Add a warning if the sgs disklabel field is 16 (the default for FFS' cpg, but not usually desirable for LFS' sgs: 5--8 is a better range). * Change the calculation of lfs_avail and lfs_bfree, corresponding to the kernel changes mentioned above. mount_lfs: * Add -N and -b options to pass corresponding -n and -b options to lfs_cleanerd. * Default to calling lfs_cleanerd with "-b -n 4". [All of these changes were largely tested in the 1.5 branch, with the idea that they (along with previous un-pulled-up work) could be applied to the branch while it was still in ALPHA2; however my test system has experienced corruption on another filesystem (/dev/console has gone missing :^), and, while I believe this unrelated to the LFS changes, I cannot with good conscience request that the changes be pulled up.]
125 lines
4.5 KiB
Groff
125 lines
4.5 KiB
Groff
.\" $NetBSD: lfs_cleanerd.8,v 1.7 2000/09/09 04:49:56 perseant Exp $
|
|
.\"
|
|
.\" Copyright (c) 1993
|
|
.\" The Regents of the University of California. All rights reserved.
|
|
.\"
|
|
.\" Redistribution and use in source and binary forms, with or without
|
|
.\" modification, are permitted provided that the following conditions
|
|
.\" are met:
|
|
.\" 1. Redistributions of source code must retain the above copyright
|
|
.\" notice, this list of conditions and the following disclaimer.
|
|
.\" 2. Redistributions in binary form must reproduce the above copyright
|
|
.\" notice, this list of conditions and the following disclaimer in the
|
|
.\" documentation and/or other materials provided with the distribution.
|
|
.\" 3. All advertising materials mentioning features or use of this software
|
|
.\" must display the following acknowledgement:
|
|
.\" This product includes software developed by the University of
|
|
.\" California, Berkeley and its contributors.
|
|
.\" 4. Neither the name of the University nor the names of its contributors
|
|
.\" may be used to endorse or promote products derived from this software
|
|
.\" without specific prior written permission.
|
|
.\"
|
|
.\" THIS SOFTWARE IS PROVIDED BY THE REGENTS AND CONTRIBUTORS ``AS IS'' AND
|
|
.\" ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
|
|
.\" IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE
|
|
.\" ARE DISCLAIMED. IN NO EVENT SHALL THE REGENTS OR CONTRIBUTORS BE LIABLE
|
|
.\" FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL
|
|
.\" DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS
|
|
.\" OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION)
|
|
.\" HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT
|
|
.\" LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY
|
|
.\" OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF
|
|
.\" SUCH DAMAGE.
|
|
.\"
|
|
.\" from: @(#)lfs_cleanerd.8 8.2 (Berkeley) 12/11/93
|
|
.\"
|
|
.Dd December 11, 1993
|
|
.Dt LFS_CLEANERD 8
|
|
.Os
|
|
.Sh NAME
|
|
.Nm lfs_cleanerd
|
|
.Nd garbage collect a log-structured file system
|
|
.Sh SYNOPSIS
|
|
.Nm
|
|
.Op Fl bdfmqs
|
|
.Op Fl l Ar load-threshhold
|
|
.Op Fl n Ar number-of-segments
|
|
.Op Fl r Ar report-frequency
|
|
.Op Fl t Ar timeout
|
|
.Pa node
|
|
.Sh DESCRIPTION
|
|
The
|
|
.Nm
|
|
command starts a daemon process which garbage-collects
|
|
the log-structured file system residing at the point named by
|
|
.Ar node
|
|
in the global file system namespace.
|
|
This command is normally executed by
|
|
.Xr mount_lfs 8
|
|
when the log-structured file system is mounted.
|
|
The daemon will exit within a few minutes
|
|
of when the file system it was cleaning is unmounted.
|
|
.Pp
|
|
Garbage collection on a log-structured file system is done by scanning
|
|
the file system's segments for active, i.e. referenced, data and copying
|
|
it to new segments.
|
|
When all of the active data in a given segment has been copied to a new
|
|
segment that segment can be marked as empty, thus reclaiming the space
|
|
taken by the inactive data which was in it.
|
|
.Pp
|
|
The following options are available:
|
|
.Bl -tag -width indent
|
|
.It Fl b
|
|
Use bytes written, rather than segments read, when determining how many
|
|
segments to clean at once.
|
|
.It Fl d
|
|
Run in debug mode.
|
|
Do not become a daemon process, and print debugging information. More
|
|
.Fl d
|
|
s give more detailed debugging information.
|
|
.It Fl f
|
|
Use filesystem idle time as the criterion for aggressive cleaning,
|
|
instead of system load.
|
|
.It Fl l Ar load-threshhold
|
|
Clean more aggressively when the system load is below the given
|
|
threshhold. The default threshhold is 0.2.
|
|
.It Fl m
|
|
Use mmap, rather than rereading the Ifile to update the cleaner's
|
|
knowledge of the filesystem. Do not use this option.
|
|
.It Fl n Ar number-of-segments
|
|
Clean this number of segments at a time: that is, pass this many
|
|
segments' blocks through a single call to lfs_markv, or, if
|
|
.Fl b
|
|
was also given, pass this many segments' worth of blocks through a
|
|
single call to lfs_markv.
|
|
.It Fl q
|
|
Quit after cleaning once.
|
|
.It Fl r Ar report-frequency
|
|
Give an efficiency report after every
|
|
.Ar report-frequency
|
|
times through the main loop.
|
|
.It Fl s
|
|
When cleaning the file system, send only a few blocks through lfs_markv
|
|
at a time. Don't use this option.
|
|
.It Fl t Ar timeout
|
|
Poll the filesystem every
|
|
.Ar timeout
|
|
seconds, looking for opportunities to clean. The default is 300, that
|
|
is, five minutes. Note that
|
|
.Nm
|
|
will be automatically awakened when the filesystem is active, so it is
|
|
not usually necessary to set
|
|
.Ar timeout
|
|
to a low value.
|
|
.El
|
|
.Sh SEE ALSO
|
|
.Xr mount_lfs 8
|
|
.Xr lfs_bmapv 2
|
|
.Xr lfs_markv 2
|
|
.Xr lfs_segwait 2
|
|
.Sh HISTORY
|
|
The
|
|
.Nm
|
|
utility first appeared in
|
|
.Bx 4.4 .
|