347 Commits

Author SHA1 Message Date
Barry Chen
0f759c6fc6
feat: upsert the first storage node record with env var (#2087)
Also insert Sync 1.5 service with MySQL migration, and updated some docs.

Closes STOR-487
2026-02-27 13:16:15 -08:00
Barry Chen
66d9d11e27
feat: log when Sentry is not configured (#2073)
Some checks failed
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncserver-postgres (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-spanner-python-utils (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncserver-postgres-python-utils (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncserver-mysql (push) Has been cancelled
MySQL Build and Test / build-and-test-mysql (push) Has been cancelled
Postgres Build and Test / build-and-test-postgres (push) Has been cancelled
Publish Sync docs to pages / build-mdbook (push) Has been cancelled
Publish Sync docs to pages / build-openapi (push) Has been cancelled
Spanner Build, Test, and Push / build-and-test-spanner (push) Has been cancelled
MySQL Build and Test / build-mysql-image (push) Has been cancelled
MySQL Build and Test / mysql-e2e-tests (push) Has been cancelled
Postgres Build and Test / build-postgres-image (push) Has been cancelled
Postgres Build and Test / postgres-e2e-tests (push) Has been cancelled
Publish Sync docs to pages / combine-and-prepare (push) Has been cancelled
Publish Sync docs to pages / deploy (push) Has been cancelled
Spanner Build, Test, and Push / build-spanner-image (push) Has been cancelled
Spanner Build, Test, and Push / spanner-e2e-tests (push) Has been cancelled
* feat: log when Sentry is not configured

* Update syncserver-common/src/middleware/sentry.rs

Co-authored-by: Philip Jenvey <pjenvey@underboss.org>

* warn and optionally print backtrace

* Use error!

* panic!

* Cleanup and comment

* Cargo.lock

---------

Co-authored-by: Philip Jenvey <pjenvey@underboss.org>
2026-02-25 12:46:58 -08:00
Taddes
68081b2b7e
chore: update rust to 1.91 (#2082)
chore: update rust to 1.91
2026-02-24 17:02:54 -05:00
Barry Chen
b54129a334
chore: cargo upgrade deps (#2061)
Some checks failed
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncserver-postgres (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-spanner-python-utils (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncserver-postgres-python-utils (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncserver-mysql (push) Has been cancelled
MySQL Build and Test / build-and-test-mysql (push) Has been cancelled
MySQL Build and Test / build-mysql-image (push) Has been cancelled
MySQL Build and Test / mysql-e2e-tests (push) Has been cancelled
Postgres Build and Test / build-and-test-postgres (push) Has been cancelled
Postgres Build and Test / build-postgres-image (push) Has been cancelled
Postgres Build and Test / postgres-e2e-tests (push) Has been cancelled
Publish Sync docs to pages / build-mdbook (push) Has been cancelled
Publish Sync docs to pages / build-openapi (push) Has been cancelled
Publish Sync docs to pages / combine-and-prepare (push) Has been cancelled
Publish Sync docs to pages / deploy (push) Has been cancelled
Spanner Build, Test, and Push / build-and-test-spanner (push) Has been cancelled
Spanner Build, Test, and Push / build-spanner-image (push) Has been cancelled
Spanner Build, Test, and Push / spanner-e2e-tests (push) Has been cancelled
2026-02-17 19:03:57 -08:00
Barry Chen
0ddc3b0af1
chore: upgrade to Rust 2024 edition (#2048) 2026-02-11 11:00:29 -08:00
Taddes
62bd7d2c6a
docs: open api docs utoipa (#2023)
Some checks failed
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-postgres (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-spanner-python-utils (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-postgres-python-utils (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-mysql (push) Has been cancelled
MySQL Build and Test / build-and-test-mysql (push) Has been cancelled
Postgres Build and Test / build-and-test-postgres (push) Has been cancelled
Publish Sync docs to pages / build-mdbook (push) Has been cancelled
Publish Sync docs to pages / build-openapi (push) Has been cancelled
Spanner Build, Test, and Push / build-and-test-spanner (push) Has been cancelled
MySQL Build and Test / build-mysql-image (push) Has been cancelled
MySQL Build and Test / mysql-e2e-tests (push) Has been cancelled
MySQL Build and Test / deploy-mysql-dockerhub (push) Has been cancelled
Postgres Build and Test / build-postgres-image (push) Has been cancelled
Postgres Build and Test / postgres-e2e-tests (push) Has been cancelled
Postgres Build and Test / deploy-postgres-dockerhub (push) Has been cancelled
Publish Sync docs to pages / combine-and-prepare (push) Has been cancelled
Publish Sync docs to pages / deploy (push) Has been cancelled
Spanner Build, Test, and Push / build-spanner-image (push) Has been cancelled
Spanner Build, Test, and Push / spanner-e2e-tests (push) Has been cancelled
Spanner Build, Test, and Push / deploy-spanner-dockerhub (push) Has been cancelled
docs: open api docs utoipa
2026-02-06 17:05:36 -05:00
dependabot[bot]
854e6c5b7e
chore(deps): bump bytes from 1.10.1 to 1.11.1 (#2039)
Some checks failed
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / generate-timestamp (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-postgres (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-spanner-python-utils (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-postgres-python-utils (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-mysql (push) Has been cancelled
MySQL Build and Test / build-and-test-mysql (push) Has been cancelled
MySQL Build and Test / build-mysql-image (push) Has been cancelled
MySQL Build and Test / mysql-e2e-tests (push) Has been cancelled
MySQL Build and Test / deploy-mysql-dockerhub (push) Has been cancelled
Postgres Build and Test / build-and-test-postgres (push) Has been cancelled
Postgres Build and Test / build-postgres-image (push) Has been cancelled
Postgres Build and Test / postgres-e2e-tests (push) Has been cancelled
Postgres Build and Test / deploy-postgres-dockerhub (push) Has been cancelled
Publish Sync docs to pages / build (push) Has been cancelled
Publish Sync docs to pages / deploy (push) Has been cancelled
Spanner Build, Test, and Push / build-and-test-spanner (push) Has been cancelled
Spanner Build, Test, and Push / build-spanner-image (push) Has been cancelled
Spanner Build, Test, and Push / spanner-e2e-tests (push) Has been cancelled
Spanner Build, Test, and Push / deploy-spanner-dockerhub (push) Has been cancelled
Bumps [bytes](https://github.com/tokio-rs/bytes) from 1.10.1 to 1.11.1.
- [Release notes](https://github.com/tokio-rs/bytes/releases)
- [Changelog](https://github.com/tokio-rs/bytes/blob/master/CHANGELOG.md)
- [Commits](https://github.com/tokio-rs/bytes/compare/v1.10.1...v1.11.1)

---
updated-dependencies:
- dependency-name: bytes
  dependency-version: 1.11.1
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-02-03 12:44:57 -08:00
Taddes
8b15ac53de
bug: address reserve and custom collections (#1950)
address reserve and custom collections
2025-12-19 16:22:25 -05:00
Philip Jenvey
cb8e620a39
feat: support query logging via diesel's instrumentation (#1925)
* feat: support query logging via diesel's instrumentation

- upgrades to latest diesel-async/diesel for diesel-async's new
migration harness
- removes diesel_logger

Closes STOR-417
2025-12-12 15:43:37 -08:00
Barry Chen
4208f037f1
feat: impl {create,commit,append_to,get}_batch for Postgres 2025-12-08 15:56:45 -06:00
Philip Jenvey
1edfd870b3
feat: add the remaining postgres get methods (#1912)
* feat: add the remaining postgres get methods

- add a FromSql<Timestamp, _> for SyncTimestamp
- utilize Selectable for GetBso
- simplify bsos_query to rely on type inference of the result

Closes STOR-337
2025-12-08 11:53:41 -08:00
Taddes
4d6fe26a35
feat: postgres read and write locks (#1891)
Some checks failed
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
feat: postgres read and write locks
2025-12-02 20:38:45 -05:00
Philip Jenvey
f3a33250b6
feat: add get_bsos/bso_ids (#1899)
- switch sortindex to 32 bit: the API defines it as 9 digits max
- switch payload to TEXT

Closes STOR-336
Closes STOR-402
2025-12-02 15:32:54 -08:00
Philip Jenvey
36657fd62d
chore: tokenserver-db-postgres -> tokenserver-postgres 2025-11-10 13:45:17 -08:00
Philip Jenvey
51e487d1db
refactor: divvy up tokenserver-mysql's db module
and move tests back into tokenserver-db

Issue STOR-405
2025-11-06 14:05:59 -08:00
Philip Jenvey
992b190861
refactor: tokenserver-mysql models/pool/migrations -> db
Issue STOR-405
2025-11-06 13:53:04 -08:00
Taddes
7fa191e699
feat: create schema and orm models for sync postgres (#1873)
Some checks failed
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
feat: create schema and orm models for sync postgres
2025-10-31 18:17:34 -04:00
Philip Jenvey
bcc5990eea
feat: add syncstorage-postgres
Closes STOR-330
2025-10-17 16:13:05 -07:00
Philip Jenvey
e8d89d7ab6
refactor: move syncstorage-mysql's error -> db-common
so syncstorage-postgres can share it

Issue STOR-330
2025-10-17 16:13:05 -07:00
Philip Jenvey
d32c669b7a
refactor: move syncstorage's Db to async-trait (#1830)
Some checks failed
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Closes STOR-144
2025-10-03 14:45:18 -07:00
Taddes
d7e737ddab
feat: postgres node methods (#1828)
feat: postgres node methods
2025-10-02 15:05:48 -04:00
Philip Jenvey
0a56042d6a
Merge branch 'master' into release/0.21 2025-09-25 16:25:29 -07:00
Philip Jenvey
9b008f8dc0
chore: fix Cargo.lock 2025-09-24 10:48:47 -07:00
Philip Jenvey
a29c8a7d48
Merge branch 'master' into release/0.21 2025-09-23 23:51:34 -07:00
Philip Jenvey
bcf425c635
refactor: kill r2d2 references, share From<PoolError> 2025-09-23 18:32:54 -07:00
Philip Jenvey
192d64c7c3
feat: switch syncstorage to diesel-async
Closes STOR-364
2025-09-23 18:32:51 -07:00
Philip Jenvey
a46637db2c
chore: tag 0.21.1 2025-09-23 13:12:34 -07:00
Philip Jenvey
0400c2dd15
feat: adapt the test suite to the generic dyn DbPool (#1808)
Some checks failed
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
and moved the couple generic Db methods into the trait itself

Closes STOR-360
2025-09-19 13:20:49 -07:00
Taddes
0c3c06d50e
feat: create tokenserver postgres db pool (#1806)
Some checks failed
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
create tokenserver postgres db pool
2025-09-18 01:45:42 -04:00
Philip Jenvey
40b21345fa
refactor: move shared tokenserver db into tokenserver-db-common (#1801)
Closes STOR-354
2025-09-16 14:41:11 -07:00
Philip Jenvey
5dd9d4efe8
chore: tag 0.21.0 2025-09-11 14:07:13 -07:00
Philip Jenvey
f2698a4251
feat: switch tokenserver to diesel-async (#1790)
Some checks failed
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Closes STOR-326
2025-09-08 13:08:29 -07:00
Philip Jenvey
d89a05e745
chore: bump tracing-subscriber per RUSTSEC-2025-0055 2025-09-02 13:50:20 -07:00
Philip Jenvey
a59661d660
Merge branch 'master' into feat/diesel-2-STOR-77 2025-08-29 13:46:26 -07:00
Philip Jenvey
6f227eb663
chore: tag 0.20.1 2025-08-29 12:54:38 -07:00
Philip Jenvey
44148da7c8
merge master 2025-08-28 17:25:26 -07:00
Tommie Gannert
c924fae77a
chore: Bump validator to 0.19.0.
Cargo audit:

Crate:     idna
Version:   0.5.0
Title:     `idna` accepts Punycode labels that do not produce any non-ASCII when decoded
Date:      2024-12-09
ID:        RUSTSEC-2024-0421
URL:       https://rustsec.org/advisories/RUSTSEC-2024-0421
Solution:  Upgrade to >=1.0.0
Signed-off-by: Tommie Gannert <tommie@gannert.se>
2025-08-28 17:07:16 -07:00
Tommie Gannert
dc4e80151b
chore: Update Cargo.lock.
Signed-off-by: Tommie Gannert <tommie@gannert.se>
2025-08-28 17:07:16 -07:00
Philip Jenvey
0395cb0ed5
chore: tag 0.20.0 2025-08-13 17:53:04 -07:00
Philip Jenvey
f7db0eaa47
chore: tag 0.19.1 (#1750)
Some checks failed
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
2025-08-13 17:44:02 -07:00
Taddes
f7197fefb8
chore: update syncstorage rust (#1749)
chore: update syncstorage rust
2025-08-13 15:14:34 -04:00
Philip Jenvey
dd546f028e
chore: strip actix-web features (#1713)
Some checks are pending
Glean probe-scraper / glean-probe-scraper (push) Waiting to run
while providing an optional actix-compress feature

also disables actix-web's cookies and unicode features

Closes STOR-256
2025-07-02 14:04:43 -07:00
Taddes
31c3b866a4
refactor: remove purge_ttl.rs (#1702)
Some checks failed
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
refactor: remove purge_ttl.rs
2025-06-04 22:52:10 -04:00
Taddes
0768d4975d
chore: remove extraneous dependencies (#1700)
Some checks failed
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
chore: remove extraneous dependencies
2025-05-22 19:06:58 -04:00
Philip Jenvey
36614c3db4
chore: tag 0.18.3 2025-05-14 16:36:30 -07:00
Taddes
dadbcea3f7
docs: add tokenserver documentation to sync (#1681)
Some checks are pending
Glean probe-scraper / glean-probe-scraper (push) Waiting to run
docs: add tokenserver documentation to sync
2025-04-17 19:33:08 -04:00
Taddes
0675930a15
fix: resolve pyo3 vuln deprecations (#1682)
Some checks failed
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
fix: resolve pyo3 vuln deprecations
2025-04-11 18:21:35 -04:00
Philip Jenvey
c74ed32360
Merge branch 'master' into release/0.18 2025-03-24 11:40:34 -07:00
Nick Shirley
8c56cae890
chore: migrate unit tests to nextest and llvm-cov
* add nextest and llvm-cov for running unit tests. 
* test results and coverage output to store_test_results and store_artifacts. 
* upgrade build image and Docker Rust version 1.78.0 → 1.81.0

Closes SYNC-4611
2025-03-10 10:34:54 -06:00
Taddes
7c9bc0089d
docs: document pruning scripts (#1645)
* docs for tokenserver process_account_events

* add docs for spanner purge ttl

* add kubernetes workload references and status

* cargo update, update validator to 0.19, audit ignore due to diesel limitation
2025-01-07 13:23:09 -08:00