mirrors/pgloader
1
0
Fork 0
mirror of https://github.com/dimitri/pgloader.git synced 2026-05-05 10:56:10 +02:00
Code Issues Projects Releases Wiki Activity

Fix time measurements of the write activity.

Browse Source 
When using --verbose or more detailed log messages, the summary prints
timings for both read and write operations separately. The write summary
timing took into account only the PostgreSQL batch activity, discarding the
formatting of the data done by pgloader.

As this formatting is quite heavy at the moment, the results are pretty
misleading without that information.
This commit is contained in:
Dimitri Fontaine 2017-10-21 21:04:55 +02:00
parent a9afddf8ed
commit 0a88645eb5
1 changed files with 7 additions and 6 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

13
src/pgsql/copy-from-queue.lisp
View File

@ -164,21 +164,22 @@
;; if current-batch is full, send data to PostgreSQL
;; and prepare a new batch
(when (batch-full-p current-batch)
(let ((batch-seconds
(send-current-batch unqualified-table-name)))
(incf seconds batch-seconds))
(incf seconds (send-current-batch unqualified-table-name))
(setf current-batch (make-batch))
;; give a little help to our friend, now is a good time
;; to garbage collect
#+sbcl (sb-ext:gc :full t))
(format-row-in-batch copy row current-batch
preprocessor pre-formatted)))
;; also add up the time it takes to format the rows
(let ((start-time (get-internal-real-time)))
(format-row-in-batch copy row current-batch
preprocessor pre-formatted)
(incf seconds (elapsed-time-since start-time)))))
;; the last batch might not be empty
(unless (= 0 (batch-count current-batch))
(send-current-batch unqualified-table-name))))))
(incf seconds (send-current-batch unqualified-table-name)))))))
;; each writer thread sends its own stop timestamp and the monitor keeps
;; only the latest entry