mirrors/prometheus
1
0
Fork 0
mirror of https://github.com/prometheus/prometheus.git synced 2025-12-07 10:31:03 +01:00
Code Issues Projects Releases Wiki Activity
prometheus/tsdb
History
Brian Brazil cf76daed2f Avoid WriteAt for Postings. 
Flushing buffers and doing a pwrite per posting is expensive
time wise, so go back to the old way for those. This doubles
our memory usage, but that's still small as it's only
~8 bytes per time series in the index. This is 30-40% faster.

benchmark                                                         old ns/op      new ns/op     delta
BenchmarkCompactionFromHead/labelnames=1,labelvalues=100000-4     1101429174     724362123     -34.23%
BenchmarkCompactionFromHead/labelnames=10,labelvalues=10000-4     1074466374     720977022     -32.90%
BenchmarkCompactionFromHead/labelnames=100,labelvalues=1000-4     1166510282     677702636     -41.90%
BenchmarkCompactionFromHead/labelnames=1000,labelvalues=100-4     1075013071     696855960     -35.18%
BenchmarkCompactionFromHead/labelnames=10000,labelvalues=10-4     1231673790     829328610     -32.67%

benchmark                                                         old allocs     new allocs     delta
BenchmarkCompactionFromHead/labelnames=1,labelvalues=100000-4     832571         731435         -12.15%
BenchmarkCompactionFromHead/labelnames=10,labelvalues=10000-4     894875         793823         -11.29%
BenchmarkCompactionFromHead/labelnames=100,labelvalues=1000-4     912931         811804         -11.08%
BenchmarkCompactionFromHead/labelnames=1000,labelvalues=100-4     933511         832366         -10.83%
BenchmarkCompactionFromHead/labelnames=10000,labelvalues=10-4     1022791        921554         -9.90%

benchmark                                                         old bytes     new bytes     delta
BenchmarkCompactionFromHead/labelnames=1,labelvalues=100000-4     129063496     126472364     -2.01%
BenchmarkCompactionFromHead/labelnames=10,labelvalues=10000-4     124154888     122300764     -1.49%
BenchmarkCompactionFromHead/labelnames=100,labelvalues=1000-4     128790648     126394856     -1.86%
BenchmarkCompactionFromHead/labelnames=1000,labelvalues=100-4     120570696     118946548     -1.35%
BenchmarkCompactionFromHead/labelnames=10000,labelvalues=10-4     138754288     136317432     -1.76%

Signed-off-by: Brian Brazil <brian.brazil@robustperception.io>
2019-12-16 15:30:49 +00:00
..
chunkenc
Correct spelling mistakes
2019-10-10 18:46:27 +08:00
chunks
return err instead of panic for corrupted chunk (#6040)
2019-12-04 09:37:49 +02:00
cmd/tsdb
Port tsdb to use pkg/labels. (#6326)
2019-11-18 11:53:33 -08:00
docs/format
Reduce memory used by postings offset table.
2019-12-11 19:59:31 +00:00
encoding
Avoid WriteAt for Postings.
2019-12-16 15:30:49 +00:00
errors
Moving tsdb into its own subdirectory
2019-08-13 13:58:49 +05:30
fileutil
Compute WAL size and use it during retention size checks (#5886)
2019-11-12 09:40:16 +07:00
goversion
fix the wrong word (#6069)
2019-09-30 09:54:55 -06:00
index
Avoid WriteAt for Postings.
2019-12-16 15:30:49 +00:00
record
Port tsdb to use pkg/labels. (#6326)
2019-11-18 11:53:33 -08:00
test
Port tsdb to use pkg/labels. (#6326)
2019-11-18 11:53:33 -08:00
testdata
Moving tsdb into its own subdirectory
2019-08-13 13:58:49 +05:30
tombstones
remove debug fmt.Println in tombstones. (#6135)
2019-10-14 14:45:26 +03:00
tsdbutil
Removed extra tsdb/testutil after merge.
2019-08-14 10:12:32 +01:00
wal
Simplify duration check for watcher WAL replay.
2019-11-26 16:53:11 -08:00
.gitignore
Moving tsdb into its own subdirectory
2019-08-13 13:58:49 +05:30
block_test.go
Extend PostingsForMatchers benchmark to cover Blocks too.
2019-12-11 19:59:31 +00:00
block.go
Reread index series rather than storing in memory.
2019-12-11 22:23:39 +00:00
CHANGELOG.md
fix-up tsdb-typo (#5954)
2019-08-28 14:43:02 +01:00
compact_test.go
Coalesce series reads where we can.
2019-12-12 08:38:14 +00:00
compact.go
Reread index series rather than storing in memory.
2019-12-11 22:23:39 +00:00
db_test.go
Reduce memory used by postings offset table.
2019-12-11 19:59:31 +00:00
db.go
tsdb: add error details in log. (#6415)
2019-12-09 10:37:01 +00:00
head_bench_test.go
Extend PostingsForMatchers benchmark to cover Blocks too.
2019-12-11 19:59:31 +00:00
head_test.go
Port tsdb to use pkg/labels. (#6326)
2019-11-18 11:53:33 -08:00
head.go
Reduce memory used by postings offset table.
2019-12-11 19:59:31 +00:00
mocks_test.go
Coalesce series reads where we can.
2019-12-12 08:38:14 +00:00
querier_bench_test.go
Extend PostingsForMatchers benchmark to cover Blocks too.
2019-12-11 19:59:31 +00:00
querier_test.go
Reduce memory used by postings offset table.
2019-12-11 19:59:31 +00:00
querier.go
Reduce memory used by postings offset table.
2019-12-11 19:59:31 +00:00
README.md
Edit TSDB README badges
2019-10-24 15:35:47 +05:30
repair_test.go
Port tsdb to use pkg/labels. (#6326)
2019-11-18 11:53:33 -08:00
repair.go
tsdb: add block meta version constant (#5994)
2019-09-09 12:28:01 +03:00
tsdbblockutil.go
Added CreateBlock and CreateHead functions to new file (#6331)
2019-11-21 19:10:25 +07:00
wal_test.go
Port tsdb to use pkg/labels. (#6326)
2019-11-18 11:53:33 -08:00
wal.go
Port tsdb to use pkg/labels. (#6326)
2019-11-18 11:53:33 -08:00

README.md

TSDB

GoDoc

This repository contains the Prometheus storage layer that is used in its 2.x releases.

A writeup of its design can be found here.

Based on the Gorilla TSDB white papers.

Video: Storing 16 Bytes at Scale from PromCon 2017.

See also the format documentation.