4 Commits

Author	SHA1	Message	Date
Klaus Post	c2eb60df4a	bz2: limit max concurrent CPU (#13458) ... Ensure that bz2 decompression will never take more than 50% CPU.	2021-10-18 08:44:36 -07:00
Klaus Post	5e53f767c4	Use concurrent bz2 decompression (#13360) ... Testing with `mc sql --compression BZIP2 --csv-input "rd=\n,fh=USE,fd=;" --query="select COUNT(*) from S3Object" local2/testbucket/nyc-taxi-data-10M.csv.bz2` Before 96.98s, after 10.79s. Uses about 70% CPU while running.	2021-10-14 11:11:07 -07:00
Klaus Post	b2c92cdaaa	select: Add more compression formats (#13142) ... Support Zstandard, LZ4, S2, and snappy as additional compression formats for S3 Select.	2021-09-06 09:09:53 -07:00
Harshavardhana	1f262daf6f	rename all remaining packages to internal/ (#12418) ... This is to ensure that there are no projects that try to import `minio/minio/pkg` into their own repo. Any such common packages should go to `https://github.com/minio/pkg`	2021-06-01 14:59:40 -07:00