Philip Jenvey
0156613781
refactor: separate batch calls into a BatchDb trait
...
Issue STOR-330
2025-10-17 14:03:19 -07:00
Philip Jenvey
da27f9defb
refactor: stream/support/BATCH_COMMIT.txt -> db
...
Issue STOR-330
2025-10-17 14:03:19 -07:00
Philip Jenvey
21bcc42feb
refactor: String -> &str
...
Issue STOR-330
2025-10-17 14:03:19 -07:00
Philip Jenvey
84de327201
refactor: divvy up the db impl into its own mod
...
Issue STOR-330
2025-10-17 14:03:19 -07:00
Philip Jenvey
80358fe69c
refactor: models/batch -> db
...
Issue STOR-330
2025-10-17 14:03:19 -07:00
Philip Jenvey
d32c669b7a
refactor: move syncstorage's Db to async-trait ( #1830 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Closes STOR-144
2025-10-03 14:45:18 -07:00
Philip Jenvey
613f6ed37e
refactor: kill SpannerDb's RefCell ( #1826 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
along with its Clone impl
Closes STOR-331
Closes STOR-152
2025-09-30 10:09:52 -07:00
Barry Chen
730d6b8173
refactor(db): return only a SyncTimestamp from post_bsos db fns
...
Co-authored-by: Philip Jenvey <pjenvey@underboss.org>
2025-09-29 14:36:09 -05:00
Taddes
4a8ec9594a
chore: async sync method suffix ( #1821 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
chore: async sync method suffix and await additions
2025-09-24 06:10:40 -04:00
Philip Jenvey
b89b06d24f
feat: kill Db's impl of Clone ( #1789 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
by utilizing async closures' improved borrowing semantics
Closes STOR-350
2025-09-04 14:58:11 -07:00
Philip Jenvey
38cb38fbd9
refactor: switch syncstorage Db methods to &mut self
...
Closes STOR-327
2025-09-02 13:50:20 -07:00
Philip Jenvey
57af35c591
feat: emit sentry events for INVALID_ARGUMENT ( #1748 )
...
Glean probe-scraper / glean-probe-scraper (push) Waiting to run
and quiet some INTERNAL grpc errors
Closes STOR-313
2025-08-13 13:23:10 -07:00
Taddes
f7197fefb8
chore: update syncstorage rust ( #1749 )
...
chore: update syncstorage rust
2025-08-13 15:14:34 -04:00
Philip Jenvey
3e20b054cf
feat: quiet pool timeout events (emit as metrics) ( #1740 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Closes STOR-295
2025-08-07 10:58:51 -07:00
Taddes
b0c8ac50a0
refactor: sync sentry cleanup grpc errors ( #1716 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
refactor: sync sentry cleanup grpc errors
2025-07-11 20:10:32 -04:00
Taddes
1dc421474d
bug : fix stream one or none ( #1708 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
bug : fix stream one or none
2025-06-20 20:36:39 -04:00
Philip Jenvey
59df9f6427
test: make StreamedResultSet's stream generic
...
so we can test it
Issue STOR-212
2025-06-16 12:23:24 -07:00
Philip Jenvey
a51c01445e
refactor: move stream code into its own module
...
Issue STOR-212
2025-06-16 11:25:55 -07:00
Taddes
31c3b866a4
refactor: remove purge_ttl.rs ( #1702 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
refactor: remove purge_ttl.rs
2025-06-04 22:52:10 -04:00
Philip Jenvey
0148e04dd2
chore: bump to latest rust
...
for cargo nextest/backtrace
2025-05-07 16:49:09 -07:00
Philip Jenvey
0ca435fb1a
refactor: simplify metric_label to return a &str
...
Issue STOR-64
2025-04-23 16:01:07 -07:00
Taddes
c01021b87d
Feat: add task to release unused db conns ( #1640 )
...
Feat: add task to release unused db conns
2024-12-05 17:10:14 -05:00
JR Conlin
70f101f9d4
Chore/2410 update ( #1618 )
...
* chore: Update pyo3
Closes : #1617
---------
Co-authored-by: Philip Jenvey <pjenvey@underboss.org>
2024-12-04 13:53:56 -08:00
Taddes
9e9869ee06
feat: glean metrics logic ( #1626 )
...
feat: glean metrics logic
2024-11-26 17:04:38 -06:00
Philip Jenvey
9a97b6ce1a
fix: upgrade to latest deadpool ( #1631 )
...
which includes a fix for its incorrect metrics:
https://github.com/bikeshedder/deadpool/issues/92
Closes SYNC-4522
2024-11-21 14:59:40 -08:00
Philip Jenvey
b52e44ab52
feat: pickup the syncserver metrics settings ( #1598 )
...
and remove syncstorage dbg! statements
Issue SYNC-4259
2024-09-17 13:29:07 -07:00
Philip Jenvey
250ac94353
docs: clarify the handling of existing expired bsos in writes ( #1581 )
...
Closes #619
2024-07-03 16:59:02 -07:00
JR Conlin
5cdfd03498
docs: Remove commented code, unneeded TODO, unneeded collision tracking ( #1563 )
2024-05-20 12:52:36 -07:00
JR Conlin
771813087c
feat: Add normalized ReportableError to errors ( #1559 )
...
* feat: Add normalized ReportableError to errors
We want to do things like add tags and other features to sync errors the
way that we do in other packages. To do so, we're backporting
ReportableError from Autopush to Syncstorage.
This also addresses some clippy fixes required by 1.78
This continues to use the `Taggable` trait, which we may want to
port to autopush.
Closes SYNC-4262
2024-05-20 08:51:58 -07:00
JR Conlin
ab7b4221fd
bug: Allow threadpool size to be set. ( #1560 )
...
* bug: Allow threadpool size to be set.
It appears that the replacement for setting ACTIX_THREADPOOL would be to
call `ServiceBuilder.worker_max_blocking_threads()` This PR introduces
the ability to set this value by using the
`worker_max_blocking_threads`configuration variable.
Closes #SYNC-4271
2024-05-16 16:36:41 -07:00
Tarik Eshaq
1b11684648
feat: Puts pyo3 behind feature flag and derives tokens directly in Rust ( #1513 )
...
* Removes pyo3 and derives tokens directly in Rust
* Adds tests for JWT verifying
* Adds tests for token generation
* Adds metrics for oauth verify error cases
* Updates jsonwebtoken to not include default features (including pem loading)
* Adds context and logs errors during oauth verify
* Uses ring for cryptographic rng
* Adds back python impl under feature flag
* Uses one cached http client for reqwest
2024-02-12 11:14:15 -05:00
Tarik Eshaq
f87293cc38
Upgrades rustc in CI and Docker to 1.75
2024-02-08 14:08:45 -05:00
bendk
97985586b4
feat: Upgrading to Actix 4.x ( #1514 )
...
* Upgrading to Actix 4.x
Also:
- actix-http 3.x
- actix-rt 2.x
- actix-cors 0.6.x
- tokio 1.x
- reqwest 0.11.x
- deadpool 0.7.x
* Update crates after Actix upgrade
Also cleared out the audit exception list.
2024-01-23 13:59:54 -08:00
JR Conlin
cc8d5847dc
Chore/update 2312 ( #1510 )
...
* chore: Update for 12-2023
Closes : #1503 , #1502
switch to fetching mysql_pubkey.asc
Closes #1509 SYNC-4055
2024-01-12 15:44:44 -08:00
JR Conlin
9916b3bdb0
bug: Use google specified UA for x-goog-api-client ( #1506 )
...
* bug: Use google specified UA for `x-goog-api-client`
Closes SYNC-4047
Co-authored-by: Philip Jenvey <pjenvey@underboss.org>
---------
Co-authored-by: Philip Jenvey <pjenvey@underboss.org>
2023-12-11 12:10:36 -08:00
Philip Jenvey
18f4d59490
fix: restore emitting backend specific db errors to sentry ( #1500 )
...
SYNC-4023
2023-11-29 18:34:09 -08:00
Philip Jenvey
59283b5977
docs: remove outdated firefox-ios warning ( #1497 )
...
it no longer hardcodes syncstorage configuration having moved to the rust
component
2023-10-24 11:23:59 -07:00
Philip Jenvey
af416fc29f
feat: add dynamic routing headers to all Spanner ops ( #1491 )
...
and support the seemingly undocumented new leader aware routing header recently
added to other spanner clients (via a setting, disabled by default)
SYNC-3922
2023-10-18 14:58:15 -07:00
JR Conlin
1b9ebbf40f
Chore/contributor rollup ( #1479 )
...
* These needed to be rolled in due to various dependency changes.
* Fix the URL people should set to use their Custom Server (https://github.com/mozilla-services/syncstorage-rs/pull/1453 ) -
[Ekleog](https://github.com/Ekleog )
* Make docker files more podman friendly (https://github.com/mozilla-services/syncstorage-rs/pull/1431 ) -
[mb](https://github.com/mb )
* This PR also updates a number of dependencies
2023-10-18 14:24:41 -07:00
Philip Jenvey
fb70128824
fix: switch more test flags to cfg(debug_assertions) ( #1488 )
...
switch mutation usage to an explicit flag
fix the db tests' uid handling
SYNC-3955
2023-10-10 17:41:42 -07:00
Philip Jenvey
dc98e95ff3
refactor: quiet latest clippy warnings
2023-09-25 12:24:16 -07:00
JR Conlin
1f9323b7b3
feat: convert dependencies to use workspaces
...
Update package description and some dependencies to use `workspace`
inheritance.
* Also updates circleci to produce dockerhub image.
Closes #1461
Issue #1362
* f touch to retry circleci
* f try to pre-emptively lock protobuf to the older 2.25.2 version
* f force Cargo.lock to use protobuf 2.25.2, dammit
* f move protobuf pin to syncstorage-spanner
* f revert cargo.lock
* f revert #448
* f update base64 / tickle circleci
* f update cadence (and kick circleci)
* f clippy
* f switch to latest google-cloud-rust
* f update to use google-cloud-rust
2023-08-29 13:57:53 -07:00
Philip Jenvey
80d21e7143
merge master
2023-03-07 12:02:16 -08:00
Ethan Donowitz
b5b7e57f93
refactor: add database crates ( #1407 )
...
Closes #1277
2023-01-10 16:06:03 -05:00