11852 Commits

Author SHA1 Message Date
Callum Styan
934bb2dbc6 wip, rework compression testing after format PR was merged
Signed-off-by: Callum Styan <callumstyan@gmail.com>
2023-11-23 19:25:00 -08:00
Nicolás Pazos
b15d1c1d81 Pool snappy decompression for minimized request 2023-11-23 16:52:01 -08:00
Nicolás Pazos
6f957dba95 Optimize zstd decompression memory usage 2023-11-23 16:51:44 -08:00
Nicolás Pazos
1abce2acfc Use klauspost's flate 2023-11-23 16:51:32 -08:00
Nicolás Pazos
6afb30a06f Benchmarks refactor and include benchmark with dataset 2023-11-23 16:51:16 -08:00
Nicolás Pazos
c62a862aa6 Add FlateDefault option and improve zstd allocs 2023-11-23 16:51:11 -08:00
Nicolás Pazos
7740f35338 Benchmarks rename 2023-11-23 16:50:03 -08:00
Nicolás Pazos
a727653618 fix snappy allocations and improve benchmarks 2023-11-23 16:49:52 -08:00
Nicolás Pazos
1ef02aad26 optimize more allocs 2023-11-23 16:49:41 -08:00
Nicolás Pazos
08c3fc6ca9 fix: zstd to correctly reset buffer 2023-11-23 16:49:33 -08:00
Nicolás Pazos
8a4e5769fc Remove gzip option and various alloc optimizations 2023-11-23 16:49:03 -08:00
Nicolás Pazos
44844cb655 commented bench instances 2023-11-23 16:47:41 -08:00
Nicolás Pazos
32eb50917e No Close method and basic pooling 2023-11-23 16:47:24 -08:00
alexgreenbank
0ab4808153 Add alternative compression algos to experiment 2023-11-23 16:45:10 -08:00
Nicolás Pazos
f2bc16177d
Merge pull request #3 from prometheus/callum-rw-format-testing 2023-11-23 19:34:04 -03:00
Callum Styan
788dfc8cb4 fix minor lint issue + use labels Range function since it looks like
the tests fail to do `range labels.Labels` on CI

Signed-off-by: Callum Styan <callumstyan@gmail.com>
2023-11-23 11:55:56 -08:00
Callum Styan
63ea815a05 fix test panic
Signed-off-by: Callum Styan <callumstyan@gmail.com>
2023-11-23 11:32:45 -08:00
Callum Styan
e2acded6ca more cleanup, address review comments
Signed-off-by: Callum Styan <callumstyan@gmail.com>
2023-11-23 11:31:10 -08:00
Callum Styan
e672dd724d remove package-lock.json change again
Signed-off-by: Callum Styan <callumstyan@gmail.com>
2023-11-23 11:14:18 -08:00
Callum Styan
a3c6904243 more cleanup, mostly linting fixes
Signed-off-by: Callum Styan <callumstyan@gmail.com>
2023-11-20 17:28:05 -08:00
Callum Styan
a0cd7939e2 cleanup; remove some unused functions
Signed-off-by: Callum Styan <callumstyan@gmail.com>
2023-11-20 16:51:53 -08:00
Callum Styan
c377de109a use require instead of assert in custom marshal test
Signed-off-by: Callum Styan <callumstyan@gmail.com>
2023-11-20 16:43:44 -08:00
Callum Styan
c2c45d12cb More cleanup
Signed-off-by: Callum Styan <callumstyan@gmail.com>
2023-11-20 16:37:03 -08:00
Callum Styan
fb3ed046ac remove more format types we probably won't use
Signed-off-by: Callum Styan <callumstyan@gmail.com>
2023-11-20 16:19:42 -08:00
Callum Styan
bf773afd57 remove formats we've decided not to use
Signed-off-by: Callum Styan <callumstyan@gmail.com>
2023-11-19 19:05:30 -08:00
Callum Styan
eec966377d remove mistaken package lock changes
Signed-off-by: Callum Styan <callumstyan@gmail.com>
2023-11-15 10:12:00 -08:00
Callum Styan
e444439d59 test additional len and lenbytes formats
Co-authored-by: Nicolás Pazos <npazosmendez@gmail.com>
Signed-off-by: Callum Styan <callumstyan@gmail.com>
2023-11-15 10:04:38 -08:00
Callum Styan
1842c99f2f Add bytes slice (instead of slice of 32bit vars) format for testing
Co-authored-by: Nicolás Pazos <npazosmendez@gmail.com>
Signed-off-by: Callum Styan <callumstyan@gmail.com>
2023-11-13 21:53:44 -08:00
Callum Styan
81f2076dde fix label ranging
Signed-off-by: Callum Styan <callumstyan@gmail.com>
2023-11-13 16:12:19 -08:00
Callum Styan
e1e6406663 use exp slices for backwards compat. to go 1.20 plus add copyright
header to test file

Signed-off-by: Callum Styan <callumstyan@gmail.com>
2023-11-13 15:53:43 -08:00
Callum Styan
ed0c3b25c7 refactor new version flag to make it easier to pick a specific format
instead of having multiple flags, plus add new formats for testing

Signed-off-by: Callum Styan <callumstyan@gmail.com>
2023-11-13 15:41:01 -08:00
Nicolás Pazos
4bdb865ae3 minimally-tested exemplar support for rw 1.1
Signed-off-by: Nicolás Pazos <npazosmendez@gmail.com>
2023-11-09 17:00:16 -03:00
Nicolás Pazos
34f3f11ee2 remove all code from previous interning approach
the 'minimized' version is now the only v1.1 version

Signed-off-by: Nicolás Pazos <npazosmendez@gmail.com>
2023-11-09 17:00:16 -03:00
Nicolás Pazos
f259debb32 fix writeRequestMinimizedFixture
Signed-off-by: Nicolás Pazos <npazosmendez@gmail.com>
2023-11-09 16:59:57 -03:00
Nicolás Pazos
e2a5ea5397 Use unsafe []byte->string cast to reuse buffer
Signed-off-by: Nicolás Pazos <npazosmendez@gmail.com>
2023-11-09 15:08:49 -03:00
Nicolás Pazos
c9b6dddef9 manually optimize varint marshaling
Signed-off-by: Nicolás Pazos <npazosmendez@gmail.com>
2023-11-09 15:05:16 -03:00
Nicolás Pazos
761efc860e Use two uint32 to encode (offset,leng)
Signed-off-by: Nicolás Pazos <npazosmendez@gmail.com>
2023-11-09 15:03:18 -03:00
Nicolás Pazos
7a633a2eb9 fix build for stringlabels tag
Signed-off-by: Nicolás Pazos <npazosmendez@gmail.com>
2023-11-09 11:22:53 -03:00
Callum Styan
2935eab409 update tests
Signed-off-by: Callum Styan <callumstyan@gmail.com>
2023-11-09 10:35:43 -03:00
Callum Styan
d5f705f74b remove unused proto type
Signed-off-by: Callum Styan <callumstyan@gmail.com>
2023-11-09 10:35:43 -03:00
Nicolás Pazos
6621690915 Make LabelSymbols a fixed32 2023-11-09 10:35:43 -03:00
Callum Styan
eb63f30459 fix minor things
Signed-off-by: Callum Styan <callumstyan@gmail.com>
2023-11-09 10:35:43 -03:00
Callum Styan
3e5facc0c0 add functionality for new minimized remote write request format
Signed-off-by: Callum Styan <callumstyan@gmail.com>
2023-11-09 10:35:43 -03:00
Callum Styan
82c1df0aa1 add functions for translating between new proto formats symbol table and
actual prometheus labels

Co-authored-by: Marco Pracucci <marco@pracucci.com>
Signed-off-by: Callum Styan <callumstyan@gmail.com>
2023-11-09 10:35:43 -03:00
Callum Styan
7cea6fe126 Add minmized remote write proto format
Co-authored-by: Marco Pracucci <marco@pracucci.com>
Signed-off-by: Callum Styan <callumstyan@gmail.com>
2023-11-09 10:35:43 -03:00
Nicolás Pazos
46b84ab3fb lint 2023-11-09 10:18:12 -03:00
Nicolás Pazos
4654241f4b fix typo in log 2023-11-09 10:18:12 -03:00
Nicolás Pazos
cef9891cdd remote write handler to checks version header 2023-11-09 10:18:12 -03:00
Nicolás Pazos
e3f27aa2c7 fields rewording in handler 2023-11-09 10:18:12 -03:00
Nicolás Pazos
6f21272ca7 fix NewWriteClient and change new flags wording 2023-11-09 10:18:12 -03:00