27 Commits

Author SHA1 Message Date
Barry Chen
30478687d7
chore(ci): configure CircleCI for postgres builds
This commit enables Postgres builds and tests in CircleCI.  Only
Tokenserver supports Postgres at the moment, and the Python based
integration tests have an implicit dependency on MySQL, so the CI jobs only
use Postgres where possible.

The jobs have been split up and named more explicitly.  The hope is to
simply delete the mysql jobs in the future.
2025-10-27 13:23:48 -05:00
Taddes
835bc58555
test: refactor of tokenserver python tests to support postgres (#1855)
Some checks failed
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
test: refactor of tokenserver python tests to support postgres
2025-10-22 12:54:54 -04:00
Taddes
8995db6268
feat: ruff for python lint and format (#1742)
Some checks are pending
Glean probe-scraper / glean-probe-scraper (push) Waiting to run
feat: ruff for python lint and format
2025-08-12 20:26:55 -04:00
Taddes
77254b4a6e
refactor: python imports (#1730)
Some checks failed
Glean probe-scraper / glean-probe-scraper (push) Has been cancelled
refactor: unified python imports for consistency in local, production, and test environments
2025-08-04 15:37:46 -04:00
Taddes
f8715d4e91
feat: use poetry for dependency management (#1706)
Some checks are pending
Glean probe-scraper / glean-probe-scraper (push) Waiting to run
feat: use poetry for dependency management
2025-07-28 21:48:46 -04:00
Nick Shirley
6f15ad546d
test(e2e): run integration and e2e tests with pytest (#1697)
Some checks are pending
Glean probe-scraper / glean-probe-scraper (push) Waiting to run
- Update docker compose steps for mysql and spanner to use pytest
- Add infra and configuration for pytest to run tests
- Remove old "run.py" test setup

Closes STOR-235
2025-05-09 14:50:18 -06:00
Philip Jenvey
d0336c8869
fix: re-enable tokensever e2e tests
w/ the pyfxa 0.8.1 fix

Closes STOR-204
2025-05-02 13:43:41 -07:00
JR Conlin
dbbdd1dfc3
feat: Remove support for BrowserID (#1531)
* feat: Remove support for BrowserID
* mark test only functions as such. I think we can drop MapAndThenTrait for more recent implementations of rust.

Closes: SYNC-3684
2024-06-14 12:51:02 -07:00
JR Conlin
cc16082241
feat: Allow uid range for purge function (SYNC-4246) (#1547)
* feat: Allow uid range for purge function

In an attempt to parallelize this script after a very long delay,
specify a range so that multiple scripts can try to process
different ranges of the database.

Closes #1548
2024-04-30 08:53:27 -07:00
JR Conlin
b777fa0d96
bug: Add try/except handler for force (#1535)
* bug: Add try/except handler for force

This will wrap the force `delete_service_data` with a try/except handler
so as not to prevent the tokenserver record from being removed if the
delete_service_data fails.

* Try/except will capture any errors from trying to call the delete on a
given node, this could fail if the auth or node aren't correct.
* Override will override the attempted node. This will allow us to force
the delete message, even if the original data was copied over and the
node was incorrect.
2024-04-16 10:07:01 -07:00
JR Conlin
06ecb78e24
bug: Copy modified purge script from old tokenserver repo (#1512)
* bug: Copy modified purge script from old tokenserver  repo
2024-02-27 12:46:47 -08:00
Tarik Eshaq
1b11684648
feat: Puts pyo3 behind feature flag and derives tokens directly in Rust (#1513)
* Removes pyo3 and derives tokens directly in Rust

* Adds tests for JWT verifying

* Adds tests for token generation

* Adds metrics for oauth verify error cases

* Updates jsonwebtoken to not include default features (including pem loading)

* Adds context and logs errors during oauth verify

* Uses ring for cryptographic rng

* Adds back python impl under feature flag

* Uses one cached http client for reqwest
2024-02-12 11:14:15 -05:00
Ethan Donowitz
613f71ed99
feat: Add X-Content-Type-Options: nosniff to Tokenserver responses (#1403) 2022-09-23 17:17:54 -04:00
Ethan Donowitz
914e375b2b
bug: fix Tokenserver generation and keys_changed_at handling (#1397) 2022-09-15 10:58:26 -04:00
Ethan Donowitz
9bea32803c
bug: convert DbErrors to TokenserverErrors (#1327)
Closes #1316
2022-06-10 17:30:45 -04:00
Ethan Donowitz
a4c340e194
feat: Pass Tokenserver origin field through token payload (#1264)
Closes #1245
2022-04-04 10:08:31 -04:00
Ethan Donowitz
38d6a27b02
feat: add BrowserID support for Tokenserver (#1216)
Closes #1215
2022-03-31 15:13:04 -04:00
Ethan Donowitz
38de8332a5
bug: add missing Tokenserver headers (#1243)
Closes #1242
2022-03-16 17:26:24 -04:00
Ethan Donowitz
eac6b55889
refactor: Remove Tokenserver support for per-node secrets (#1211)
Closes #1208
2022-02-04 15:44:16 -05:00
Ethan Donowitz
ae6597022c
refactor: remove static service IDs (#1199)
Note: this commit contains a breaking change. Previously, there was a migration that included two services with static IDs by default, but this commit adds a new migration that removes those two services and adjusts the code to account for the change.

Closes #1144
2022-01-07 10:41:28 -05:00
Ethan Donowitz
aa18c1a01d
test: add Tokenserver integration tests to CI (#1180)
Closes #1174
2021-12-08 08:56:16 -05:00
Ethan Donowitz
a3d4f094cd
feat: add missing Tokenserver response fields (#1176)
Closes #1173
2021-12-07 11:44:07 -05:00
Ethan Donowitz
bed59e2cb7
feat: Tokenserver: add per-node secrets (#1169)
Closes #1104
2021-11-23 11:30:27 -05:00
Ethan Donowitz
0996cb154f
feat: Add client state validation (#1160)
Closes #1091
2021-11-11 10:38:16 -05:00
Ethan Donowitz
db739defbe
feat: Tokenserver: Add node assignment logic (#1158)
Closes #1051
2021-11-05 09:51:30 -04:00
Ethan Donowitz
337ab8f406
feat: Tokenserver: Add validations and user updating for generation, keys_changed_at, and client_state (#1145)
Closes #866
2021-10-28 14:36:17 -04:00
Ethan Donowitz
7209ccf551
test: Add Tokenserver integration tests (#1152)
Closes #1048
2021-10-05 16:59:23 -04:00