196 Commits

Author SHA1 Message Date
Vault Automation
0c6c13dd38
license: update headers to IBM Corp. (#10229) (#10233)
* license: update headers to IBM Corp.
* `make proto`
* update offset because source file changed

Signed-off-by: Ryan Cragun <me@ryan.ec>
Co-authored-by: Ryan Cragun <me@ryan.ec>
2025-10-21 15:20:20 -06:00
Vault Automation
c9605c7eb0
VAULT-36947: Support force unloading a snapshot (#8740) (#9036)
* portion of changes for autoloading

* add test checking for panic

* add endpoint for force unloading

* separate method for force unload

* changelog

* don't redefine constants

Co-authored-by: miagilepner <mia.epner@hashicorp.com>
2025-09-01 09:16:35 +00:00
miagilepner
a18b4dfc9b
VAULT-37080: Fix changelog and comment (#31449) 2025-08-07 17:24:07 +00:00
miagilepner
beeb8c2032
VAULT-37080: Maintain redundancy zones for unhealthy nodes (#31443)
* ce changes

* changelog
2025-08-07 17:01:02 +02:00
miagilepner
bea32a14ab
VAULT-35369: Loaded snapshots CE (#30529)
* full load

* snapshot manager tested

* integration test

* more tetsts

* remove obselete test

* fix failing test

* move tesdata to ent folder

* add test for RaftDataDirPath

* fix race condition, don't create new barrier instance

* check for nil result

* remove encryption from the barrier storage wrapper

* Update physical/raft/fsm.go

Co-authored-by: Kuba Wieczorek <kuba.wieczorek@hashicorp.com>

* fmt

---------

Co-authored-by: Kuba Wieczorek <kuba.wieczorek@hashicorp.com>
2025-05-16 14:27:04 +02:00
Kuba Wieczorek
57da716ad0
Fix misformatted comment causing the CE-ENT diff to fail (#30439) 2025-04-29 14:59:26 +00:00
Kuba Wieczorek
dbc2f06fbd
[VAULT-35190] Implement logic for writing snapshot data to an FSM (#30416) 2025-04-29 14:43:53 +01:00
davidadeleon
6741773b0f
update vault auth submodules to api/v1.16.0 (#29548)
* update vault auth submodules to api/v1.16.0

* update go.mod

* make proto

---------

Co-authored-by: davidadeleon <ddeleon@hashicorp.com>
2025-02-11 07:28:45 -08:00
Nick Cabatoff
38c3e15e1e
Add support for reloading raft config (#29485) 2025-02-05 15:08:46 +00:00
miagilepner
46ee2d0024
Fix log level when starting a raft node (#29459) 2025-01-30 11:46:55 +01:00
Johan Brandhorst-Satzkorn
8d83c5d047
physical: use permitpool from go-secure-stdlib (#29331)
* sdk/physical: use permitpool from go-secure-stdlib

* physical: use permitpool from go-secure-stdlib

* fixup! sdk/physical: use permitpool from go-secure-stdlib

* fixup! sdk/physical: use permitpool from go-secure-stdlib
2025-01-24 12:33:44 -05:00
Mike Palmiotto
9d80c4548f
proto: bump protoc-gen-go to 1.36.3 (#29359) 2025-01-22 13:58:43 -05:00
miagilepner
dc0cd5af90
Exit raft removed checker if raft isn't initialized (#29329)
* check if not initialized

* add comment and fix flake
2025-01-10 14:16:43 -03:00
Josh Black
f625f506ed
CE changes for vault-31750 (#29303)
* ce changes for vault-31750

* add changelog

* make proto

* refactor naming

* clarify error message

* update changelog

* one more time

* make proto AGAIN
2025-01-09 11:58:29 -08:00
Ryan Cragun
357b2949e3
protobuf: rebuild protos with protobuf 1.36.2 (#29318)
* protobuf: rebuild protos with protobuf 1.36.2
* format: please buf formatter

Signed-off-by: Ryan Cragun <me@ryan.ec>
2025-01-08 21:35:04 +00:00
miagilepner
4f32443722
fixes for flakes in raft removed tests (#29270)
* fixes for flakes in raft removed tests

* one more fix
2025-01-07 13:56:07 +01:00
Ryan Cragun
f730d31bc6
protobuf: rebuild protos with protobuf 1.36 (#29229)
Signed-off-by: Ryan Cragun <me@ryan.ec>
2025-01-03 14:19:00 -07:00
miagilepner
9bde015070
VAULT-31758: Store when a node is removed in the raft stable store (#29090)
* implementation and test

* changelog

* verify servers are healthy before removing
2024-12-11 12:31:59 +01:00
miagilepner
5ed2f81102
VAULT-32568: Shutdown node when it's not in the raft config (#29052)
* add implementation and tests

* add eventually condition for test flake
2024-12-03 13:27:29 +01:00
Josh Black
2269cc3f7c
remove hashicorp-forge/bbolt and replace with official beta release (#28916)
* remove hashicorp-forge/bbolt and replace with official beta release

* get rid of redundant method

* go mod tidy

* make proto
2024-11-18 11:18:50 -08:00
divyaac
52ba156d47
Fix protoc issue (#28928) 2024-11-15 19:33:48 +00:00
miagilepner
d717b48f90
fix flaky TestRaft_Removed (#28817) 2024-10-31 14:48:22 +01:00
miagilepner
41c0a3040b
VAULT-31748: add removable node HA backend interface and raft implementation (#28726) 2024-10-30 18:19:49 +01:00
Ryan Cragun
b6145bc3bb
protobuf: rebuild protos with protobuf 1.35.1 (main) (#28617)
* protobuf: rebuild protos with protobuf 1.35.1
* protobuf: unpin protoc-gen-go-grpc on main

Signed-off-by: Ryan Cragun <me@ryan.ec>
2024-10-07 14:54:51 -06:00
VAL
53bb78ce5f
Log when MAP_POPULATE gets disabled (#28526)
* add warning for when MAP_POPULATE mmap flag not set

* Make mmap flags method handle any flags, where MAP_POPULATE is just one of them

* Only have the log print out on restores

* Add test, make logic more consistent

* Add changelog

* Add godoc for test

* Make test less dangerous
2024-10-02 12:27:25 -07:00
miagilepner
b5621aa368
VAULT-28477 Bootstrap and persist autopilot versions (#28186)
* add versions to raft bootstrap answer

* remove version faking

* save version state to storage

* logging and copy

* changelog

* use leader versions on upgrade

* add enterprise cluster test

* never drop persisted states

* rename to partialCopy, fix comment, fix log line
2024-08-30 08:32:26 +00:00
Jason O'Donnell
2a09bd47ba
raft/autopilot: fix panic during autopilot shutdown (#27726)
* raft/autopilot: fix panic during autopilot shutdown

* changelog
2024-07-09 16:52:40 +00:00
idnandre
b833d4714d
chore: fix deprecated ioutil nopcloser (#27650)
Signed-off-by: idnandre <andre@idntimes.com>
2024-07-03 13:38:34 -04:00
Josh Black
f33f1b15fc
improve autopilot logging when it starts up (#27464)
* improve autopilot logging when it starts up

* add changelog
2024-06-12 11:07:14 -07:00
Steven Clark
d152de025d
Pin generated proto files to 1.34.2 (#27438) 2024-06-11 12:29:45 -04:00
Josh Black
1c44349bd3
Augment raft test functions to allow specifying SetupOpts (#27387) 2024-06-06 12:42:31 -07:00
Paul Banks
a04c53eca2
Fix AP upgrade version issue (#27277)
* Fix AP upgrade version issue

* add heartbeat logging at trace level

* add log to show when heartbeats resume

* Test the plumbing

* Revert "Test the plumbing"

This reverts commit e25fcd83516cd8b5b0ca6b543be64049c6a45f51.

* Add CHANGELOG

* Add plumbing test

* Update misleading comment

---------

Co-authored-by: Josh Black <raskchanky@gmail.com>
2024-06-05 18:12:00 +01:00
Mike Palmiotto
2d75711019
make proto 1.34.1 (#26856) 2024-05-07 14:33:18 +00:00
Ryan Cragun
5d763ac052
proto: rebuild with the latest protoc-gen-go (#26698)
Signed-off-by: Ryan Cragun <me@ryan.ec>
2024-04-30 13:05:49 -06:00
Josh Black
a8a621f539
CE changes for https://github.com/hashicorp/vault-enterprise/pull/5695 (#26449) 2024-04-16 18:26:26 +00:00
Paul Banks
c605d1a846
Plumbing to support mount table path registration (#26176) 2024-03-27 13:25:31 +00:00
BiKangNing
f8ad26c89f
chore: fix function names (#26087)
Signed-off-by: depthlending <bikangning@outlook.com>
Co-authored-by: Chris Capurso <1036769+ccapurso@users.noreply.github.com>
2024-03-22 12:43:01 -04:00
Paul Banks
fc0abf2d9f
Remove CE-only warning from shared tests (#26052)
* Remove CE-only warning from shared tests

* Add tests for all warnings emitted during raft config parsing

* Unmark warnings as CE only that are universal
2024-03-20 17:08:33 +00:00
miagilepner
3c3c0d48db
Add stubs for new raft methods (#26051) 2024-03-20 10:44:39 +01:00
Paul Banks
3a2a922b26
Raft config refactor for mount entry size limit (#25992)
* CE parts for mount-namespace entry limit

* Remove redundant code from refactor

* Add doc comment note about ent-only use of interface

* Add CHANGELOG
2024-03-19 17:28:23 +00:00
miagilepner
b01ba81339
VAULT-23553: Revert "Don't panic on unknown raft ops" (#25991)
* Revert "Don't panic on unknown raft ops (#17732)"

This reverts commit c9b43008975b64f5420cf2f2013c985ee6690d9e.

* add test for panic

* add back changelog

* add godoc for test

* log -> l

* changelog

* Apply suggestions from code review

Co-authored-by: Josh Black <raskchanky@gmail.com>

---------

Co-authored-by: Josh Black <raskchanky@gmail.com>
2024-03-19 17:21:07 +01:00
suchsoon
f86e3d4a68
remove repetitive words (#25860)
Signed-off-by: suchsoon <silverjadebeauty@gmail.com>
2024-03-13 18:44:54 +00:00
Ryan Cragun
981aeabab0
lint: fix proto delta and simports (#25825)
Signed-off-by: Ryan Cragun <me@ryan.ec>
2024-03-07 18:10:51 +00:00
Josh Black
fa13dbd381
add gosimport to make fmt and run it (#25383)
* add gosimport to make fmt and run it

* move installation to tools.sh

* correct weird spacing issue

* Update Makefile

Co-authored-by: Nick Cabatoff <ncabatoff@hashicorp.com>

* fix a weird issue

---------

Co-authored-by: Nick Cabatoff <ncabatoff@hashicorp.com>
2024-02-13 14:07:02 -08:00
Paul Banks
186fdc373d
Fix raft tests so they don't capture the parent's t (#25382) 2024-02-13 17:22:38 +00:00
Josh Black
41529eca48
Don't call t.Parallel() when changing package level variables (#25122) 2024-01-29 12:38:47 -08:00
Josh Black
55d5880857
remove t.Parallel() from testBothRaftBackends (#25083) 2024-01-26 08:55:22 -08:00
Josh Black
ef26498e9c
Implement raft-wal (#21460)
* Implement raft-wal

* go mod tidy

* add metrics, fix a panic

* fix the panic for real this time

* PR feedback

* refactor tests to use a helper and reduce duplication

* add a test to verify we don't use raft-wal if raft.db exists

* add config to enable the verifier

* add tests for parsing verification intervals

* run the verifier in the background

* wire up the verifier

* go mod tidy

* refactor config parsing

* remove unused function

* trying to get the verifier working

* wire up some more verifier bits

* sorted out an error, added a new test, lots of debug logging that needs to come out

* fix a bug and remove all the debugging statements

* make sure we close raft-wal stablestore too

* run verifier tests for both boltdb and raft-wal

* PR feedback

* Vault 20270 docker test raft wal (#24463)

* adding a migration test from boltdb to raftwal and back
adding a migration test using snapshot restore

* feedback

* Update physical/raft/raft.go

Co-authored-by: Paul Banks <pbanks@hashicorp.com>

* PR feedback

* change verifier function

* make this shorter

* add changelog

* Fix Close behavior

* make supporting empty logs more explicit

* add some godocs

---------

Co-authored-by: hamid ghaf <hamid@hashicorp.com>
Co-authored-by: Hamid Ghaf <83242695+hghaf099@users.noreply.github.com>
Co-authored-by: Paul Banks <pbanks@hashicorp.com>
2024-01-25 10:08:50 -08:00
Paul Banks
2d88a454d9
Add support for larger transactions in Raft (#24991)
* Add support for larger transactions in Raft

* Add CHANGELOG

* Appease the new lint rules
2024-01-24 14:38:39 +00:00
Kit Haines
fb71d7f3c8
make-fmt (#24940) 2024-01-18 20:00:00 +00:00