mirrors/prometheus

mirror of https://github.com/prometheus/prometheus.git synced 2025-10-16 10:01:02 +02:00

History

Arve Knudsen 5c4310aa37

[ENHANCEMENT] TSDB: Optimize querying with regexp matchers

Add method `PostingsForLabelMatching` to `tsdb.IndexReader`, to obtain postings for labels with a certain name and values accepted by a provided callback, and use it from `tsdb.PostingsForMatchers`.
The intention is to optimize regexp matcher paths, especially not having to load all label values before matching on them.

Plus tests, and refactor some `tsdb/index.Reader` methods.

Benchmarking shows memory reduction up to ~100%, and speedup of up to ~50%.

Signed-off-by: Arve Knudsen <arve.knudsen@gmail.com>
Co-authored-by: Bartlomiej Plotka <bwplotka@gmail.com>

2024-05-09 10:55:30 +01:00

..

tsdb tests: make work with labels SymbolTable

2024-02-26 11:45:25 +00:00

Fix language in docs and comments (#14041 )

2024-05-08 17:57:09 +02:00

Fix language in docs and comments (#14041 )

2024-05-08 17:57:09 +02:00

Fix language in docs and comments (#14041 )

2024-05-08 17:57:09 +02:00

tsdb/encoding: use Go standard errors package

2023-11-11 19:01:11 +01:00

Enable default revive rules (#13068 )

2023-11-29 17:23:34 +00:00

tests: remove err from message when testify prints it already

2024-02-01 14:18:01 +00:00

remove obsolete build tag

2024-01-17 22:26:32 +08:00

[ENHANCEMENT] TSDB: Optimize querying with regexp matchers

2024-05-09 10:55:30 +01:00

Fix language in docs and comments (#14041 )

2024-05-08 17:57:09 +02:00

tsdb: Delete blocks atomically; Remove tmp blocks on start; Added test. (#7772 )

2020-08-11 06:56:08 +01:00

Update tombstones.go

2023-11-11 19:22:06 +01:00

Revert "Adding small test update for temp dir using t.TempDir (#13293 )"

2023-12-30 19:17:30 +00:00

Merge pull request #13919 from GiedriusS/dont_forget_to_unregister

2024-04-18 16:44:03 -03:00

.gitignore

Moving tsdb into its own subdirectory

2019-08-13 13:58:49 +05:30

block_test.go

[ENHANCEMENT] TSDB: Optimize querying with regexp matchers

2024-05-09 10:55:30 +01:00

block.go

[ENHANCEMENT] TSDB: Optimize querying with regexp matchers

2024-05-09 10:55:30 +01:00

blockwriter_test.go

Add a chunk size limit in bytes (#12054 )

2023-08-24 15:21:17 +02:00

blockwriter.go

Fix language in docs and comments (#14041 )

2024-05-08 17:57:09 +02:00

CHANGELOG.md

Rename default branch to main

2021-02-22 20:28:02 +01:00

compact_test.go

Optimize histogram iterators (#13340 )

2024-01-23 17:02:14 +01:00

compact.go

Fix language in docs and comments (#14041 )

2024-05-08 17:57:09 +02:00

db_test.go

Write out of order hint when initially creating meta file (#13894 )

2024-04-08 17:34:14 +02:00

db.go

Fix language in docs and comments (#14041 )

2024-05-08 17:57:09 +02:00

example_test.go

Add context argument to Querier.Select (#12660 )

2023-09-12 12:37:38 +02:00

exemplar_test.go

Standardise exemplar label as "trace_id"

2024-02-15 14:20:08 +00:00

exemplar.go

Fix language in docs and comments (#14041 )

2024-05-08 17:57:09 +02:00

head_append.go

Fix language in docs and comments (#14041 )

2024-05-08 17:57:09 +02:00

head_bench_test.go

tsdb: use Go standard errors

2023-12-11 12:18:54 +00:00

head_read_test.go

[ENHANCEMENT] TSDB: Optimize querying with regexp matchers

2024-05-09 10:55:30 +01:00

head_read.go

[ENHANCEMENT] TSDB: Optimize querying with regexp matchers

2024-05-09 10:55:30 +01:00

head_test.go

golangci-lint: enable whitespace linter (#13905 )

2024-04-11 09:27:54 +01:00

head_wal.go

Fix language in docs and comments (#14041 )

2024-05-08 17:57:09 +02:00

head.go

TSDB: Don't rely on integer overflow in head compaction check (#13755 )

2024-03-26 12:17:38 +01:00

isolation_test.go

tsdb: turn off transaction isolation for head compaction (#11317 )

2022-09-27 19:31:23 +05:30

isolation.go

tsdb: create isolation transaction slice on demand

2023-10-21 13:45:47 +00:00

mocks_test.go

tsdb: use Go standard errors

2023-12-11 12:18:54 +00:00

ooo_head_read_test.go

Move from golang.org/x/exp/slices into slices now that we only support Go >= 1.21

2024-02-28 14:54:53 +01:00

ooo_head_read.go

[ENHANCEMENT] TSDB: Optimize querying with regexp matchers

2024-05-09 10:55:30 +01:00

ooo_head_test.go

ci(lint): enable godot; append dot at the end of comments

2023-10-31 19:53:38 +02:00

ooo_head.go

Fix issue where queries can fail or omit OOO samples if OOO head compaction occurs between creating a querier and reading chunks (#13115 )

2023-11-24 12:38:38 +01:00

ooo_isolation_test.go

Fix issue where queries can fail or omit OOO samples if OOO head compaction occurs between creating a querier and reading chunks (#13115 )

2023-11-24 12:38:38 +01:00

ooo_isolation.go

Fix issue where queries can fail or omit OOO samples if OOO head compaction occurs between creating a querier and reading chunks (#13115 )

2023-11-24 12:38:38 +01:00

querier_bench_test.go

Optimize label values with matchers by taking shortcuts (#13426 )

2024-01-23 11:40:21 +01:00

querier_test.go

[ENHANCEMENT] TSDB: Optimize querying with regexp matchers

2024-05-09 10:55:30 +01:00

querier.go

[ENHANCEMENT] TSDB: Optimize querying with regexp matchers

2024-05-09 10:55:30 +01:00

README.md

Fixed broken link in tsdb README.md

2022-10-07 16:20:20 +00:00

repair_test.go

tsdb tests: use go-cmp instead of DeepEquals

2024-02-08 19:32:33 +00:00

repair.go

tsdb: use Go standard errors

2023-12-11 12:18:54 +00:00

tsdbblockutil.go

Optimize histogram iterators (#13340 )

2024-01-23 17:02:14 +01:00

README.md

TSDB

This directory contains the Prometheus TSDB (Time Series DataBase) library, which handles storage and querying of all Prometheus v2 data.

Documentation

External resources

A writeup of the original design can be found here.
Video: Storing 16 Bytes at Scale from PromCon 2017.
Compression is based on the Gorilla TSDB white paper.

A series of blog posts explaining different components of TSDB: