mirrors/etherpad-lite
1
0
Fork 0
mirror of https://github.com/ether/etherpad-lite.git synced 2025-11-07 11:41:00 +01:00
Code Issues Projects Releases Wiki Activity

Try/catch to skip invalid JSON in dirtyDB

Browse Source
This commit is contained in:
Achim Friedland 2018-11-02 20:10:36 +01:00 committed by muxator
parent 0443de4dc9
commit 5f836f6211
1 changed files with 5 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

7
bin/dirty-db-cleaner.py
View File

@ -31,8 +31,11 @@ with open(dirtydb_input, 'r') as fd:
print 'Reading %s' % dirtydb_input print 'Reading %s' % dirtydb_input
for line in fd: for line in fd:
lines += 1 lines += 1
data = json.loads(line) try:
dirtydb[data['key']] = line data = json.loads(line)
dirtydb[data['key']] = line
except:
print("Skipping invalid JSON!")
if lines % 10000 == 0: if lines % 10000 == 0:
sys.stderr.write('.') sys.stderr.write('.')
print print