mirrors/syncstorage-rs
1
0
Fork 0
mirror of https://github.com/mozilla-services/syncstorage-rs.git synced 2026-04-03 12:42:28 +02:00
Code Issues Actions 4 Packages Projects Releases Wiki Activity
1,735 Commits 81 Branches 121 Tags
Commit Graph

1735 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Taddes
e6e1804f06
test 2025-12-19 13:06:45 -05:00
Taddes
d88d10228a
test 2025-12-19 12:57:07 -05:00
Taddes
97c8da5d20
test 2025-12-19 12:49:45 -05:00
Taddes
ab3cd6892c
test 2025-12-19 12:48:35 -05:00
Taddes
1669456a89
test workflow 2025-12-19 12:41:34 -05:00
Barry Chen
424ab1e7c9
fix: preserve existing value on batch append if new value is null/empty (#1943)
Some checks failed
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Details 
Co-authored-by: Philip Jenvey <pjenvey@underboss.org>
 2025-12-19 06:43:12 -08:00
Taddes
ad12d1873e
update collections for standard collections (#1935)
Some checks failed
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Details 
update collections for standard collections
 2025-12-17 20:04:58 -05:00
Barry Chen
acc060dd45
Fix: use PRETOUCH_DT when inserting new user collection in Postgres (#1938)
Some checks failed
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Details 
Co-authored-by: Philip Jenvey <pjenvey@underboss.org>
 2025-12-17 11:58:40 -08:00
Barry Chen
a94d702ce7
fix: ensure Postgres return types and Rust value types match (#1940)
Some checks failed
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Details
2025-12-16 18:44:37 -08:00
Philip Jenvey
5c022c04df
feat: switch to TIMESTAMPTZ (#1932)
Some checks failed
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Details 
- make SyncTimestamp::from_datetime generic over timezones
- compare expiry to CURRENT_TIMESTAMP now that they're TIMESTAMPTZ
- fix get_collection_timestamps not ignoring tombstones
- fix the gcs upload breaking due to failing tests

Closes STOR-420
 2025-12-16 13:50:21 -08:00
Barry Chen
6c6c06ffbe
chore: run Postgres tests and clippy in CI (#1923) 
Update CircleCI config to run and test sync server on Postgres
 2025-12-16 12:04:16 -08:00
Philip Jenvey
afaafc5704
fix: initializing the app once suffices (#1937) 
otherwise the postgres Pool init deadlocks on pending DDL statements
from the migration

Closes STOR-426
 2025-12-16 10:42:38 -08:00
Barry Chen
dc228c6a9e
Fix: ensure user collection exists before adding bsos or batches (#1934)
Some checks failed
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Details
2025-12-15 11:32:28 -08:00
Barry Chen
9bc614d7b9
fix: set collection id col to auto-incr and fix get_collection_id (#1929)
Some checks failed
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Details 
Inserting into collections in `get_or_create_collection_id` was failing.

The wrong column name was used in `get_collection_id`.  It's also been
converted to Diesel ORM calls.

Closes STOR-422
 2025-12-13 11:58:29 -08:00
Taddes
56c21e0fef
feat: UserIdentifier modification in lock and timestamp methods (#1927)
Some checks failed
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Details 
UserIdentifier modification in lock and timestamp methods
 2025-12-12 21:02:49 -05:00
Philip Jenvey
cb8e620a39
feat: support query logging via diesel's instrumentation (#1925) 
* feat: support query logging via diesel's instrumentation

- upgrades to latest diesel-async/diesel for diesel-async's new
migration harness
- removes diesel_logger

Closes STOR-417
 2025-12-12 15:43:37 -08:00
Taddes
855066ced4
feat: create post/put bsos postgres (#1911) 
feat: create post/put bsos postgres
 2025-12-12 16:04:01 -05:00
Barry Chen
75af89c024
Merge pull request #1926 from mozilla-services/dependabot/pip/tools/tokenserver/loadtests/urllib3-2.6.0
Some checks failed
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Details 
chore(deps-dev): bump urllib3 from 2.5.0 to 2.6.0 in /tools/tokenserver/loadtests
 2025-12-11 08:30:34 -06:00
dependabot[bot]
77836c6ce1
chore(deps-dev): bump urllib3 in /tools/tokenserver/loadtests 
Bumps [urllib3](https://github.com/urllib3/urllib3) from 2.5.0 to 2.6.0.
- [Release notes](https://github.com/urllib3/urllib3/releases)
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst)
- [Commits](https://github.com/urllib3/urllib3/compare/2.5.0...2.6.0)

---
updated-dependencies:
- dependency-name: urllib3
  dependency-version: 2.6.0
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
 2025-12-10 23:18:16 +00:00
grahamalama
853d184d4b
Add build and push workflow for preview environments (#1924)
Some checks failed
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Details 
* feat: added mozcloud-publish workflow to create and push container images to GAR when a preview label is added to a pull request

* feat: using latest version of build-and-push workflow without `package: write` requirements

* feat: Dockerfile changes to reduce build cache usage

In #1907, we saw the GHA runner running out of disk space due to a a large Docker build cache (~16GB). The goal of this PR is to reduce cache size while maintaining fast successive build times.

Changes:
  - Consolidated build stages: Merged cacher and builder stages
  - Added BuildKit cache mounts: Added --mount=type=cache for Cargo registry, git, and target directories, keeping dependency caches persistent across builds without inflating layer sizes
  - Pre-built Python wheels: Generate all Python dependency wheels in the builder stage and install from local cache in final stage, eliminating need for build tools in final image
  - Removed unnecessary packages (golang-go, build-essential, cargo, cmake, libpq-dev) from final stage, keeping only essential runtime libraries


* Add progress=plain to `docker build` commands in Circle workflows

---------

Signed-off-by: Graham Beckley <gbeckley@mozilla.com>
Co-authored-by: Dustin Lactin <dlactin@mozilla.com>
 2025-12-10 18:17:07 -05:00
Barry Chen
af18f92771
Merge pull request #1903 from mozilla-services/feat/postgres-batch-fns-STOR-340
Some checks failed
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Details 
feat: impl {create,commit,append_to,validate,get,delete}_batch for Postgres
 2025-12-08 17:07:52 -06:00
Barry Chen
45b45a7d56
Update doc and types to match latest Postgres schema 2025-12-08 16:20:44 -06:00
Barry Chen
4bc0f3a47b
Review feedback changes 
Co-authored-by: Philip Jenvey <pjenvey@underboss.org>
 2025-12-08 15:56:45 -06:00
Barry Chen
4208f037f1
feat: impl {create,commit,append_to,get}_batch for Postgres 2025-12-08 15:56:45 -06:00
Taddes
278ffcc74a
feat: quota methods (#1920) 
feat: quota methods
 2025-12-08 15:41:18 -05:00
Philip Jenvey
1edfd870b3
feat: add the remaining postgres get methods (#1912) 
* feat: add the remaining postgres get methods

- add a FromSql<Timestamp, _> for SyncTimestamp
- utilize Selectable for GetBso
- simplify bsos_query to rely on type inference of the result

Closes STOR-337
 2025-12-08 11:53:41 -08:00
Taddes
7103b3dae0
chore: adjust dependabot pr limit to 1 (#1918)
Some checks failed
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Details 
chore: adjust dependabot pr limit to 1
 2025-12-08 12:03:56 -05:00
Barry Chen
edd1f69435
Merge pull request #1915 from mozilla-services/dependabot/pip/tools/spanner/urllib3-2.6.0 
chore(deps): bump urllib3 from 2.5.0 to 2.6.0 in /tools/spanner
 2025-12-08 08:26:40 -06:00
Barry Chen
4ce47d8d00
Merge branch 'master' into dependabot/pip/tools/spanner/urllib3-2.6.0 2025-12-08 07:29:45 -06:00
Barry Chen
4a459c5baa
Merge pull request #1916 from mozilla-services/dependabot/pip/tools/tokenserver/urllib3-2.6.0 
chore(deps): bump urllib3 from 2.5.0 to 2.6.0 in /tools/tokenserver
 2025-12-08 07:29:30 -06:00
dependabot[bot]
4ab5dba88d
chore(deps): bump urllib3 from 2.5.0 to 2.6.0 in /tools/tokenserver 
Bumps [urllib3](https://github.com/urllib3/urllib3) from 2.5.0 to 2.6.0.
- [Release notes](https://github.com/urllib3/urllib3/releases)
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst)
- [Commits](https://github.com/urllib3/urllib3/compare/2.5.0...2.6.0)

---
updated-dependencies:
- dependency-name: urllib3
  dependency-version: 2.6.0
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
 2025-12-06 05:33:00 +00:00
dependabot[bot]
78ee28e70a
chore(deps): bump urllib3 from 2.5.0 to 2.6.0 in /tools/spanner 
Bumps [urllib3](https://github.com/urllib3/urllib3) from 2.5.0 to 2.6.0.
- [Release notes](https://github.com/urllib3/urllib3/releases)
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst)
- [Commits](https://github.com/urllib3/urllib3/compare/2.5.0...2.6.0)

---
updated-dependencies:
- dependency-name: urllib3
  dependency-version: 2.6.0
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
 2025-12-06 05:26:51 +00:00
Barry Chen
7f8f0dff86
Merge pull request #1901 from mozilla-services/feat/postgres-delete-fns-STOR-338
Some checks failed
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Details 
feat: add delete fns for Postgres db impls
 2025-12-05 08:35:29 -06:00
Barry Chen
8790e5a207
Use SyncTimestamp::as_naive_datetime 
Co-authored-by: Philip Jenvey <pjenvey@underboss.org>
 2025-12-04 16:43:02 -06:00
Barry Chen
f548ea1fc3
feat: add delete fns for Postgres db impls 2025-12-04 15:39:00 -06:00
Barry Chen
f397860c23
Merge pull request #1906 from mozilla-services/refactor/u64-DEFAULT_MAX_QUOTA_LIMIT-STOR-294
Some checks failed
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Details 
refactor: use u64 for DEFAULT_MAX_QUOTA_LIMIT
 2025-12-04 15:35:26 -06:00
Barry Chen
ec42126299
Merge branch 'master' into refactor/u64-DEFAULT_MAX_QUOTA_LIMIT-STOR-294 2025-12-04 14:45:51 -06:00
Taddes
6b0b41c6d5
feat: impl for update collection (#1900) 
feat: impl for update collection
 2025-12-04 15:41:04 -05:00
Barry Chen
4bca93ca67
Merge pull request #1910 from mozilla-services/chore/e2e-docker-healthcheck-STOR-416 
chore: add healthcheck to prevent e2e tests starting too early
 2025-12-04 12:13:09 -06:00
Barry Chen
ad0f6776a0
chore: add healthcheck to prevent e2e tests starting too early 2025-12-03 16:37:21 -06:00
Taddes
4d6fe26a35
feat: postgres read and write locks (#1891)
Some checks failed
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Details 
feat: postgres read and write locks
 2025-12-02 20:38:45 -05:00
Philip Jenvey
f3a33250b6
feat: add get_bsos/bso_ids (#1899) 
- switch sortindex to 32 bit: the API defines it as 9 digits max
- switch payload to TEXT

Closes STOR-336
Closes STOR-402
 2025-12-02 15:32:54 -08:00
Fritz Elfert
7ba0b4338f
feat: support systemd-journal logging (#1858)
Some checks failed
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Details
2025-12-02 14:01:09 -08:00
Barry Chen
f8d63999f4
refactor: use u64 for DEFAULT_MAX_QUOTA_LIMIT 2025-12-02 13:31:56 -06:00
Barry Chen
d73d7f8d64
Merge pull request #1904 from mozilla-services/dependabot/pip/tools/tokenserver/loadtests/werkzeug-3.1.4
Some checks failed
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Details 
chore(deps-dev): bump werkzeug from 3.1.3 to 3.1.4 in /tools/tokenserver/loadtests
 2025-12-02 08:31:40 -06:00
dependabot[bot]
740b5cc9aa
chore(deps-dev): bump werkzeug in /tools/tokenserver/loadtests 
Bumps [werkzeug](https://github.com/pallets/werkzeug) from 3.1.3 to 3.1.4.
- [Release notes](https://github.com/pallets/werkzeug/releases)
- [Changelog](https://github.com/pallets/werkzeug/blob/main/CHANGES.rst)
- [Commits](https://github.com/pallets/werkzeug/compare/3.1.3...3.1.4)

---
updated-dependencies:
- dependency-name: werkzeug
  dependency-version: 3.1.4
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
 2025-12-02 05:01:28 +00:00
Barry Chen
be170a507f
Merge pull request #1884 from mozilla-services/dependabot/pip/tools/tokenserver/loadtests/brotli-1.2.0
Some checks failed
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Details 
chore(deps-dev): bump brotli from 1.1.0 to 1.2.0 in /tools/tokenserver/loadtests
 2025-12-01 17:19:46 -06:00
dependabot[bot]
7b907bdfd7
chore(deps-dev): bump brotli in /tools/tokenserver/loadtests 
Bumps [brotli](https://github.com/google/brotli) from 1.1.0 to 1.2.0.
- [Release notes](https://github.com/google/brotli/releases)
- [Changelog](https://github.com/google/brotli/blob/master/CHANGELOG.md)
- [Commits](https://github.com/google/brotli/compare/go/cbrotli/v1.1.0...v1.2.0)

---
updated-dependencies:
- dependency-name: brotli
  dependency-version: 1.2.0
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
 2025-12-01 22:13:50 +00:00
Taddes
455ad7aed2
feat: load and map collections impl (#1898)
Some checks failed
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Details 
feat: load and map collections impl
 2025-11-20 18:17:19 -05:00
Barry Chen
6ebd3b5926
Merge pull request #1892 from mozilla-services/feat/postgres-purge-ttl-STOR-54 
feat: add script to purge expired items in Postgres
 2025-11-20 13:48:09 -06:00