Taddes
3cca75a9ba
feat: migrate code checks to github actions ( #2005 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-postgres (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-spanner-python-utils (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-postgres-python-utils (push) Has been cancelled
Publish Sync docs to pages / build (push) Has been cancelled
Publish Sync docs to pages / deploy (push) Has been cancelled
feat: migrate code checks to github actions
2026-01-16 19:01:58 -05:00
dependabot[bot]
cccdac909d
chore(deps): bump pyasn1 from 0.6.1 to 0.6.2 in /tools/spanner ( #2008 )
...
Bumps [pyasn1](https://github.com/pyasn1/pyasn1 ) from 0.6.1 to 0.6.2.
- [Release notes](https://github.com/pyasn1/pyasn1/releases )
- [Changelog](https://github.com/pyasn1/pyasn1/blob/main/CHANGES.rst )
- [Commits](https://github.com/pyasn1/pyasn1/compare/v0.6.1...v0.6.2 )
---
updated-dependencies:
- dependency-name: pyasn1
dependency-version: 0.6.2
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-01-16 14:07:34 -08:00
Philip Jenvey
52e56ba2f3
Merge pull request #2006 from mozilla-services/feat/more-browserid-removal-STOR-458
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-postgres (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-spanner-python-utils (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-postgres-python-utils (push) Has been cancelled
Publish Sync docs to pages / build (push) Has been cancelled
Publish Sync docs to pages / deploy (push) Has been cancelled
feat: kill long removed browserid references
2026-01-16 13:02:23 -08:00
Philip Jenvey
5f8ab5483f
chore: kill remaining requirements.txt
...
they're only used in the docker build and generated on the fly by
poetry there
2026-01-15 16:32:58 -08:00
Philip Jenvey
ab1887d283
feat: kill long removed browserid references
...
Closes STOR-458
2026-01-15 13:33:45 -08:00
Philip Jenvey
9ed0d0c2cd
feat: optimize batch_commit w/ MERGE INTO ( #2003 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-postgres (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-spanner-python-utils (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-postgres-python-utils (push) Has been cancelled
Publish Sync docs to pages / build (push) Has been cancelled
Publish Sync docs to pages / deploy (push) Has been cancelled
Closes STOR-457
2026-01-15 09:33:23 -08:00
dependabot[bot]
ea0055df75
chore(deps): bump urllib3 from 2.6.0 to 2.6.3 in /tools/spanner ( #1994 )
...
Bumps [urllib3](https://github.com/urllib3/urllib3 ) from 2.6.0 to 2.6.3.
- [Release notes](https://github.com/urllib3/urllib3/releases )
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst )
- [Commits](https://github.com/urllib3/urllib3/compare/2.6.0...2.6.3 )
---
updated-dependencies:
- dependency-name: urllib3
dependency-version: 2.6.3
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-01-15 08:24:23 -08:00
dependabot[bot]
230b4a3862
chore(deps): bump authlib in /tools/tokenserver/loadtests ( #1992 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-postgres (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-spanner-python-utils (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-postgres-python-utils (push) Has been cancelled
Publish Sync docs to pages / build (push) Has been cancelled
Publish Sync docs to pages / deploy (push) Has been cancelled
Bumps [authlib](https://github.com/authlib/authlib ) from 1.6.5 to 1.6.6.
- [Release notes](https://github.com/authlib/authlib/releases )
- [Changelog](https://github.com/authlib/authlib/blob/main/docs/changelog.rst )
- [Commits](https://github.com/authlib/authlib/compare/v1.6.5...v1.6.6 )
---
updated-dependencies:
- dependency-name: authlib
dependency-version: 1.6.6
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-01-14 16:14:47 -08:00
Barry Chen
ac614115f7
chore: clean out OnDuplicateKeyUpdate mysql diesel extension ( #2001 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-postgres (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-spanner-python-utils (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-postgres-python-utils (push) Has been cancelled
Publish Sync docs to pages / build (push) Has been cancelled
Publish Sync docs to pages / deploy (push) Has been cancelled
Co-authored-by: Philip Jenvey <pjenvey@underboss.org>
2026-01-14 11:58:20 -08:00
dependabot[bot]
0e08ba60f5
chore(deps-dev): bump werkzeug in /tools/tokenserver/loadtests ( #1990 )
...
Bumps [werkzeug](https://github.com/pallets/werkzeug ) from 3.1.4 to 3.1.5.
- [Release notes](https://github.com/pallets/werkzeug/releases )
- [Changelog](https://github.com/pallets/werkzeug/blob/main/CHANGES.rst )
- [Commits](https://github.com/pallets/werkzeug/compare/3.1.4...3.1.5 )
---
updated-dependencies:
- dependency-name: werkzeug
dependency-version: 3.1.5
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-01-14 10:53:53 -08:00
dependabot[bot]
fbbd87e0b5
chore(deps): bump urllib3 in /tools/integration_tests ( #1985 )
...
Bumps [urllib3](https://github.com/urllib3/urllib3 ) from 2.6.0 to 2.6.3.
- [Release notes](https://github.com/urllib3/urllib3/releases )
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst )
- [Commits](https://github.com/urllib3/urllib3/compare/2.6.0...2.6.3 )
---
updated-dependencies:
- dependency-name: urllib3
dependency-version: 2.6.3
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-01-14 10:04:15 -08:00
dependabot[bot]
cba780e5df
chore(deps-dev): bump urllib3 in /tools/tokenserver/loadtests ( #1984 )
...
Bumps [urllib3](https://github.com/urllib3/urllib3 ) from 2.6.0 to 2.6.3.
- [Release notes](https://github.com/urllib3/urllib3/releases )
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst )
- [Commits](https://github.com/urllib3/urllib3/compare/2.6.0...2.6.3 )
---
updated-dependencies:
- dependency-name: urllib3
dependency-version: 2.6.3
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-01-14 07:03:26 -08:00
Philip Jenvey
0bc8c98d9b
feat: bootstrap the sync-1.5 service table entry ( #1993 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-postgres (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-spanner-python-utils (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-postgres-python-utils (push) Has been cancelled
Publish Sync docs to pages / build (push) Has been cancelled
Publish Sync docs to pages / deploy (push) Has been cancelled
punt on adding this to mysql (for now): adapting the tests accordingly
and switch SERIAL columns to GENERATED BY DEFAULT AS IDENTITY
Closes STOR-449
2026-01-13 09:32:02 -08:00
dependabot[bot]
c13f7d7c56
chore(deps): bump urllib3 from 2.6.0 to 2.6.3 in /tools/tokenserver ( #1983 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-postgres (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-spanner-python-utils (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-postgres-python-utils (push) Has been cancelled
Publish Sync docs to pages / build (push) Has been cancelled
Publish Sync docs to pages / deploy (push) Has been cancelled
Bumps [urllib3](https://github.com/urllib3/urllib3 ) from 2.6.0 to 2.6.3.
- [Release notes](https://github.com/urllib3/urllib3/releases )
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst )
- [Commits](https://github.com/urllib3/urllib3/compare/2.6.0...2.6.3 )
---
updated-dependencies:
- dependency-name: urllib3
dependency-version: 2.6.3
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-01-09 09:44:16 -08:00
Taddes
77868a3890
docs: sync api docs github ( #1986 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-postgres (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-spanner-python-utils (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-postgres-python-utils (push) Has been cancelled
Publish Sync docs to pages / build (push) Has been cancelled
Publish Sync docs to pages / deploy (push) Has been cancelled
docs: sync api docs github
2026-01-09 10:38:46 -05:00
Barry Chen
e7b4ccdff3
chore: build image for postgres python utils ( #1987 )
2026-01-09 06:20:55 -08:00
Philip Jenvey
ba6cda12ca
chore: bump mbdook to 0.5.2 ( #1988 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-postgres (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-spanner-python-utils (push) Has been cancelled
Publish Sync docs to pages / build (push) Has been cancelled
Publish Sync docs to pages / deploy (push) Has been cancelled
fixes "ERROR mdbook_core::utils: invalid key `env`"
and add a docs badge
2026-01-08 13:59:41 -08:00
Philip Jenvey
01edad768e
test: fix flake in test_users_with_the_same_batch_id_get_separate_data ( #1981 )
...
due to _switch_user picking up old test data
Closes STOR-415
2026-01-08 11:52:50 -08:00
dependabot[bot]
1a4a0e486c
chore(deps): bump urllib3 from 2.5.0 to 2.6.3 ( #1982 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-postgres (push) Has been cancelled
Build, Tag and Push Container Images to GAR Repository / build-and-push-syncstorage-rs-spanner-python-utils (push) Has been cancelled
Publish Sync docs to pages / build (push) Has been cancelled
Publish Sync docs to pages / deploy (push) Has been cancelled
Bumps [urllib3](https://github.com/urllib3/urllib3 ) from 2.5.0 to 2.6.3.
- [Release notes](https://github.com/urllib3/urllib3/releases )
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst )
- [Commits](https://github.com/urllib3/urllib3/compare/2.5.0...2.6.3 )
---
updated-dependencies:
- dependency-name: urllib3
dependency-version: 2.6.3
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-01-08 06:58:15 -08:00
Barry Chen
c46408b016
chore(ci): use gh actions to build and deploy to GAR and ghcr ( #1976 )
2026-01-08 06:12:20 -08:00
dependabot[bot]
9612bc9504
chore(deps): bump urllib3 in /tools/integration_tests ( #1978 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Publish Sync docs to pages / build (push) Has been cancelled
Publish Sync docs to pages / deploy (push) Has been cancelled
Bumps [urllib3](https://github.com/urllib3/urllib3 ) from 2.5.0 to 2.6.0.
- [Release notes](https://github.com/urllib3/urllib3/releases )
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst )
- [Commits](https://github.com/urllib3/urllib3/compare/2.5.0...2.6.0 )
---
updated-dependencies:
- dependency-name: urllib3
dependency-version: 2.6.0
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Barry Chen <bchen@mozilla.com>
2026-01-07 08:06:28 -08:00
Taddes
17df9a4d4c
Chore: add 0 to mdbook env ver ( #1979 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Publish Sync docs to pages / build (push) Has been cancelled
Publish Sync docs to pages / deploy (push) Has been cancelled
Mdbook env ver
2026-01-06 19:46:46 -05:00
Taddes
1c12ca0695
chore: update mdbook and mermaid ( #1977 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Publish Sync docs to pages / build (push) Has been cancelled
Publish Sync docs to pages / deploy (push) Has been cancelled
chore: update mdbook and mermaid
2026-01-06 16:59:12 -05:00
Philip Jenvey
0cca7c7338
feat: get the timestamp from postgres ( #1962 )
...
also enable cfg(debug_assertions) for Db test methods (where we easily
can)
Closes STOR-441
2026-01-06 13:15:25 -08:00
Taddes
a108a0da8e
docs: architecture and system diagrams ( #1973 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Publish Sync docs to pages / build (push) Has been cancelled
Publish Sync docs to pages / deploy (push) Has been cancelled
docs: architecture and system diagrams
2026-01-02 16:45:33 -05:00
Taddes
a3ca41fe42
fix: further downgrade mermaid, internal dep env problem ( #1974 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Publish Sync docs to pages / build (push) Has been cancelled
Publish Sync docs to pages / deploy (push) Has been cancelled
fix: further downgrade mermaid, internal dep env problem
2025-12-31 19:39:03 -05:00
Taddes
38fce2f3f4
fix: update workflow not use script ( #1972 )
...
fix: update workflow not use script
2025-12-31 18:24:00 -05:00
Taddes
d05cf81858
fix: point to tokenserver api ( #1970 )
...
fix: point to tokenserver api
2025-12-31 17:24:35 -05:00
Taddes
0f6384f6b0
downgrade mdbook version as 5.2 causes broken pipe in preprocesser ( #1969 )
...
downgrade mdbook version as 5.2 causes broken pipe in preprocesser
2025-12-31 16:45:07 -05:00
Taddes
21b723607d
mermaid process update ( #1968 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Publish Sync docs to pages / build (push) Has been cancelled
Publish Sync docs to pages / deploy (push) Has been cancelled
mermaid process update
2025-12-30 18:49:16 -05:00
Taddes
6fca1c4022
chore: doc workflow fix ( #1967 )
...
chore: doc workflow fix
2025-12-30 17:08:22 -05:00
Taddes
8b72a3b8df
docs: build deploy docs GitHub pages ( #1965 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Publish Sync docs to pages / build (push) Has been cancelled
Publish Sync docs to pages / deploy (push) Has been cancelled
build deploy docs GitHub pages
2025-12-30 13:26:01 -05:00
Philip Jenvey
9fbeaee206
feat: emit unexpected verify.py exceptions to sentry ( #1951 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
making them internal vs plain unauth errors
Closes STOR-370
2025-12-19 23:09:14 -08:00
Barry Chen
7bf49d79a7
chore: use real exit codes for Postgres tests in CI ( #1944 )
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
2025-12-19 14:56:33 -08:00
Taddes
8b15ac53de
bug: address reserve and custom collections ( #1950 )
...
address reserve and custom collections
2025-12-19 16:22:25 -05:00
Philip Jenvey
daec191739
feat: re-enable warnings ( #1947 )
...
and update some comments
Closes STOR-430
2025-12-19 11:30:25 -08:00
Taddes
d4a3c24b0c
feat: postgres docker and gar ( #1945 )
...
postgres docker and gar
2025-12-19 13:19:16 -05:00
Barry Chen
424ab1e7c9
fix: preserve existing value on batch append if new value is null/empty ( #1943 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Co-authored-by: Philip Jenvey <pjenvey@underboss.org>
2025-12-19 06:43:12 -08:00
Taddes
ad12d1873e
update collections for standard collections ( #1935 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
update collections for standard collections
2025-12-17 20:04:58 -05:00
Barry Chen
acc060dd45
Fix: use PRETOUCH_DT when inserting new user collection in Postgres ( #1938 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Co-authored-by: Philip Jenvey <pjenvey@underboss.org>
2025-12-17 11:58:40 -08:00
Barry Chen
a94d702ce7
fix: ensure Postgres return types and Rust value types match ( #1940 )
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
2025-12-16 18:44:37 -08:00
Philip Jenvey
5c022c04df
feat: switch to TIMESTAMPTZ ( #1932 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
- make SyncTimestamp::from_datetime generic over timezones
- compare expiry to CURRENT_TIMESTAMP now that they're TIMESTAMPTZ
- fix get_collection_timestamps not ignoring tombstones
- fix the gcs upload breaking due to failing tests
Closes STOR-420
2025-12-16 13:50:21 -08:00
Barry Chen
6c6c06ffbe
chore: run Postgres tests and clippy in CI ( #1923 )
...
Update CircleCI config to run and test sync server on Postgres
2025-12-16 12:04:16 -08:00
Philip Jenvey
afaafc5704
fix: initializing the app once suffices ( #1937 )
...
otherwise the postgres Pool init deadlocks on pending DDL statements
from the migration
Closes STOR-426
2025-12-16 10:42:38 -08:00
Barry Chen
dc228c6a9e
Fix: ensure user collection exists before adding bsos or batches ( #1934 )
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
2025-12-15 11:32:28 -08:00
Barry Chen
9bc614d7b9
fix: set collection id col to auto-incr and fix get_collection_id ( #1929 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
Inserting into collections in `get_or_create_collection_id` was failing.
The wrong column name was used in `get_collection_id`. It's also been
converted to Diesel ORM calls.
Closes STOR-422
2025-12-13 11:58:29 -08:00
Taddes
56c21e0fef
feat: UserIdentifier modification in lock and timestamp methods ( #1927 )
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
UserIdentifier modification in lock and timestamp methods
2025-12-12 21:02:49 -05:00
Philip Jenvey
cb8e620a39
feat: support query logging via diesel's instrumentation ( #1925 )
...
* feat: support query logging via diesel's instrumentation
- upgrades to latest diesel-async/diesel for diesel-async's new
migration harness
- removes diesel_logger
Closes STOR-417
2025-12-12 15:43:37 -08:00
Taddes
855066ced4
feat: create post/put bsos postgres ( #1911 )
...
feat: create post/put bsos postgres
2025-12-12 16:04:01 -05:00
Barry Chen
75af89c024
Merge pull request #1926 from mozilla-services/dependabot/pip/tools/tokenserver/loadtests/urllib3-2.6.0
...
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
chore(deps-dev): bump urllib3 from 2.5.0 to 2.6.0 in /tools/tokenserver/loadtests
2025-12-11 08:30:34 -06:00
