Philip Jenvey
9ed0d0c2cd
feat: optimize batch_commit w/ MERGE INTO ( #2003 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-postgres (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-spanner-python-utils (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-postgres-python-utils (push) Has been cancelled
Publish Sync docs to pages / build (push) Has been cancelled
Publish Sync docs to pages / deploy (push) Has been cancelled
Closes STOR-457
2026-01-15 09:33:23 -08:00
Taddes
77868a3890
docs: sync api docs github ( #1986 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-postgres (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-spanner-python-utils (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-postgres-python-utils (push) Has been cancelled
Publish Sync docs to pages / build (push) Has been cancelled
Publish Sync docs to pages / deploy (push) Has been cancelled
docs: sync api docs github
2026-01-09 10:38:46 -05:00
Philip Jenvey
0cca7c7338
feat: get the timestamp from postgres ( #1962 )
...
also enable cfg(debug_assertions) for Db test methods (where we easily
can)
Closes STOR-441
2026-01-06 13:15:25 -08:00
Taddes
8b15ac53de
bug: address reserve and custom collections ( #1950 )
...
address reserve and custom collections
2025-12-19 16:22:25 -05:00
Philip Jenvey
daec191739
feat: re-enable warnings ( #1947 )
...
and update some comments
Closes STOR-430
2025-12-19 11:30:25 -08:00
Barry Chen
424ab1e7c9
fix: preserve existing value on batch append if new value is null/empty ( #1943 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Co-authored-by: Philip Jenvey <pjenvey@underboss.org>
2025-12-19 06:43:12 -08:00
Taddes
ad12d1873e
update collections for standard collections ( #1935 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
update collections for standard collections
2025-12-17 20:04:58 -05:00
Barry Chen
acc060dd45
Fix: use PRETOUCH_DT when inserting new user collection in Postgres ( #1938 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Co-authored-by: Philip Jenvey <pjenvey@underboss.org>
2025-12-17 11:58:40 -08:00
Barry Chen
a94d702ce7
fix: ensure Postgres return types and Rust value types match ( #1940 )
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
2025-12-16 18:44:37 -08:00
Philip Jenvey
5c022c04df
feat: switch to TIMESTAMPTZ ( #1932 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
- make SyncTimestamp::from_datetime generic over timezones
- compare expiry to CURRENT_TIMESTAMP now that they're TIMESTAMPTZ
- fix get_collection_timestamps not ignoring tombstones
- fix the gcs upload breaking due to failing tests
Closes STOR-420
2025-12-16 13:50:21 -08:00
Barry Chen
dc228c6a9e
Fix: ensure user collection exists before adding bsos or batches ( #1934 )
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
2025-12-15 11:32:28 -08:00
Barry Chen
9bc614d7b9
fix: set collection id col to auto-incr and fix get_collection_id ( #1929 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Inserting into collections in `get_or_create_collection_id` was failing.
The wrong column name was used in `get_collection_id`. It's also been
converted to Diesel ORM calls.
Closes STOR-422
2025-12-13 11:58:29 -08:00
Taddes
56c21e0fef
feat: UserIdentifier modification in lock and timestamp methods ( #1927 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
UserIdentifier modification in lock and timestamp methods
2025-12-12 21:02:49 -05:00
Philip Jenvey
cb8e620a39
feat: support query logging via diesel's instrumentation ( #1925 )
...
* feat: support query logging via diesel's instrumentation
- upgrades to latest diesel-async/diesel for diesel-async's new
migration harness
- removes diesel_logger
Closes STOR-417
2025-12-12 15:43:37 -08:00
Taddes
855066ced4
feat: create post/put bsos postgres ( #1911 )
...
feat: create post/put bsos postgres
2025-12-12 16:04:01 -05:00
Barry Chen
45b45a7d56
Update doc and types to match latest Postgres schema
2025-12-08 16:20:44 -06:00
Barry Chen
4bc0f3a47b
Review feedback changes
...
Co-authored-by: Philip Jenvey <pjenvey@underboss.org>
2025-12-08 15:56:45 -06:00
Barry Chen
4208f037f1
feat: impl {create,commit,append_to,get}_batch for Postgres
2025-12-08 15:56:45 -06:00
Taddes
278ffcc74a
feat: quota methods ( #1920 )
...
feat: quota methods
2025-12-08 15:41:18 -05:00
Philip Jenvey
1edfd870b3
feat: add the remaining postgres get methods ( #1912 )
...
* feat: add the remaining postgres get methods
- add a FromSql<Timestamp, _> for SyncTimestamp
- utilize Selectable for GetBso
- simplify bsos_query to rely on type inference of the result
Closes STOR-337
2025-12-08 11:53:41 -08:00
Barry Chen
8790e5a207
Use SyncTimestamp::as_naive_datetime
...
Co-authored-by: Philip Jenvey <pjenvey@underboss.org>
2025-12-04 16:43:02 -06:00
Barry Chen
f548ea1fc3
feat: add delete fns for Postgres db impls
2025-12-04 15:39:00 -06:00
Taddes
6b0b41c6d5
feat: impl for update collection ( #1900 )
...
feat: impl for update collection
2025-12-04 15:41:04 -05:00
Taddes
4d6fe26a35
feat: postgres read and write locks ( #1891 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
feat: postgres read and write locks
2025-12-02 20:38:45 -05:00
Philip Jenvey
f3a33250b6
feat: add get_bsos/bso_ids ( #1899 )
...
- switch sortindex to 32 bit: the API defines it as 9 digits max
- switch payload to TEXT
Closes STOR-336
Closes STOR-402
2025-12-02 15:32:54 -08:00
Taddes
455ad7aed2
feat: load and map collections impl ( #1898 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
feat: load and map collections impl
2025-11-20 18:17:19 -05:00
Philip Jenvey
70a7854b8f
Merge pull request #1896 from mozilla-services/feat/syncstorage-uid-pk-STOR-413
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
feat: prefer tokenserver's assigned uid as the PK
2025-11-18 14:25:36 -08:00
Taddes
ac10f5a7c2
feat: impl get collection and collection id methods ( #1887 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
feat: impl get collection and collection id methods
2025-11-13 14:08:13 -05:00
Philip Jenvey
30bb0556f6
refactor: divvy up the db module
...
Closes STOR-304
2025-11-10 13:45:13 -08:00
Taddes
a65d461094
feat: postgres db pool and session implementation ( #1875 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
We need to create the Postgres specific Db struct and associated methods. The majority of API methods will be implemented upon this struct, so this is to initialize the main logic so that the traits can be implemented.
This also encompasses additions to the Postgres-specific database pool implementation.
Several of the trait bounds (methods) have to be satisfied, but this stubs them out so that the PgDb has a common interface that is the same as those for MySQL and Spanner.
Doc comments added in shared error.rs crate for clarity, since it is a shared interface for all databases.
Removed dead code annotations for clippy that are no longer needed in Tokenserver.
Closes STOR-399
2025-11-10 13:14:22 -08:00
Taddes
7fa191e699
feat: create schema and orm models for sync postgres ( #1873 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
feat: create schema and orm models for sync postgres
2025-10-31 18:17:34 -04:00
Taddes
0c1198496d
feat: sync postgres schema ( #1853 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
feat: sync postgres schema
2025-10-28 17:53:33 -04:00
Philip Jenvey
bcc5990eea
feat: add syncstorage-postgres
...
Closes STOR-330
2025-10-17 16:13:05 -07:00