lib/db: Add hacky way to adjust database parameters (#5889)

This adds a set of magical environment variables that can be used to
tweak the database parameters. It's totally undocumented and not
intended to be a long term or supported thing.

It's ugly, but there is a backstory. I have a couple of large
installations where the database options are inefficient or otherwise
suboptimal (24/7 compaction going on and stuff like that). I don't
*know* the correct database parameters, nor yet the formula or method to
derive them by, so this requires experimentation. Experimentation needs
to happen partly in production, and rolling out new builds for every
tweak isn't practical. This provides override points for all reasonable
values, while not changing anything by default.

Ideally, at the end of such experimentation, we'll know which values are
relevant to change and in what manner, and can provide a more user
friendly knob to do so - or do it automatically based on the database
size.

This commit is contained in:

Jakob Borg

2019-07-30 21:41:18 +02:00

parent 1e69997ecd

commit 897f238b91

2 changed files with 46 additions and 5 deletions

									
										lib/db/transactions.go
									
		-3
	
												View File
												
				@@ -12,9 +12,6 @@ import (

					"github.com/syndtr/goleveldb/leveldb/util"

				)

				// Flush batches to disk when they contain this many records.

				const batchFlushSize = 64

				// A readOnlyTransaction represents a database snapshot.

				type readOnlyTransaction struct {

					*leveldb.Snapshot