| 4de5b84 | sdong | 24 April 2014, 00:51:16 UTC | Fix a bug in IterKey Summary: IterKey set buffer_size_ to a wrong initial value, causing it to always allocate values from heap instead of stack if the key size is smaller. Fix it. Test Plan: make all check Reviewers: haobo, ljin Reviewed By: haobo CC: igor, dhruba, yhchiang, leveldb Differential Revision: https://reviews.facebook.net/D18279 | 24 April 2014, 02:45:22 UTC |
| f9f8965 | Igor Canadi | 23 April 2014, 13:11:35 UTC | Print out stack trace in mac, too Summary: While debugging Mac-only issue with ThreadLocalPtr, this was very useful. Let's print out stack trace in MAC OS, too. Test Plan: Verified that somewhat useful stack trace was generated on mac. Will run PrintStack() on linux, too. Reviewers: ljin, haobo Reviewed By: haobo CC: leveldb Differential Revision: https://reviews.facebook.net/D18189 | 23 April 2014, 13:11:35 UTC |
| a570740 | sdong | 23 April 2014, 00:17:33 UTC | Expose number of entries in mem tables to users Summary: In this patch, two new DB properties are defined: rocksdb.num-immutable-mem-table and rocksdb.num-entries-imm-mem-tables, from where number of entries in mem tables can be exposed to users Test Plan: Cover the codes in db_test make all check Reviewers: haobo, ljin, igor Reviewed By: igor CC: nkg-, igor, yhchiang, dhruba, leveldb Differential Revision: https://reviews.facebook.net/D18207 | 23 April 2014, 05:13:21 UTC |
| 5f1daf7 | Lei Jin | 23 April 2014, 04:14:25 UTC | get rid of shared_ptr in memtable.cc Summary: Get rid of the devil. Probably won't impact anything on the perf side. Test Plan: make all check Reviewers: igor, haobo, sdong, yhchiang Reviewed By: haobo CC: leveldb, dhruba Differential Revision: https://reviews.facebook.net/D18153 | 23 April 2014, 04:14:25 UTC |
| 547bb6a | Lei Jin | 23 April 2014, 04:13:34 UTC | simplify ThreadLocalPtr a little bit Summary: make singleton a static member instead of dynamic object. This should also avoid the race on unique_ptr Test Plan: make all check Reviewers: igor, haobo, sdong Reviewed By: igor CC: leveldb Differential Revision: https://reviews.facebook.net/D18177 | 23 April 2014, 04:13:34 UTC |
| 86a0133 | sdong | 23 April 2014, 01:31:55 UTC | PlainTableReader to expose index size to users Summary: This is a temp solution to expose index sizes to users from PlainTableReader before we persistent them to files. In this patch, the memory consumption of indexes used by PlainTableReader will be reported as two user defined properties, so that users can monitor them. Test Plan: Add a unit test. make all check` Reviewers: haobo, ljin Reviewed By: haobo CC: nkg-, yhchiang, igor, ljin, dhruba, leveldb Differential Revision: https://reviews.facebook.net/D18195 | 23 April 2014, 02:29:05 UTC |
| 1068d2f | Igor Canadi | 23 April 2014, 01:38:10 UTC | Revert "Better port::Mutex::AssertHeld() and AssertNotHeld()" This reverts commit ddafceb6c2ecb83b7bdf6711ea1c30d97aeb3b8f. | 23 April 2014, 01:38:10 UTC |
| ddafceb | Igor Canadi | 23 April 2014, 00:26:21 UTC | Better port::Mutex::AssertHeld() and AssertNotHeld() Summary: Using ThreadLocalPtr as a flag to determine if a mutex is locked or not enables us to implement AssertNotHeld(). It also makes AssertHeld() actually correct. I had to remove port::Mutex as a dependency for util/thread_local.h, but that's fine since we can just use std::mutex :) Test Plan: make check Reviewers: ljin, dhruba, haobo, sdong, yhchiang Reviewed By: ljin CC: leveldb Differential Revision: https://reviews.facebook.net/D18171 | 23 April 2014, 00:26:21 UTC |
| 2912340 | Yueh-Hsuan Chiang | 22 April 2014, 20:46:42 UTC | Merge pull request #125 from ankgup87/master [Java] Add bloom filter JNI bindings | 22 April 2014, 20:46:42 UTC |
| 042221b | Ankit Gupta | 22 April 2014, 20:05:40 UTC | Merge branch 'master' of https://github.com/facebook/rocksdb | 22 April 2014, 20:05:40 UTC |
| 3992aec | Igor Canadi | 22 April 2014, 18:27:33 UTC | Support for column families in TTL DB Summary: This will enable people using TTL DB to do so with multiple column families. They can also specify different TTLs for each one. TODO: Implement CreateColumnFamily() in TTL world. Test Plan: Added a very simple sanity test. Reviewers: dhruba, haobo, ljin, sdong, yhchiang Reviewed By: haobo CC: leveldb, alberts Differential Revision: https://reviews.facebook.net/D17859 | 22 April 2014, 18:27:33 UTC |
| dd9f6f0 | Ankit Gupta | 22 April 2014, 17:51:39 UTC | Fix formatting | 22 April 2014, 17:51:39 UTC |
| e557297 | James Pearce | 22 April 2014, 16:12:19 UTC | New CLA form | 22 April 2014, 16:12:19 UTC |
| 7a5106f | Ankit Gupta | 22 April 2014, 16:01:57 UTC | Add doc | 22 April 2014, 16:01:57 UTC |
| 2214fd8 | Ankit Gupta | 22 April 2014, 15:58:43 UTC | Refactor filter impl | 22 April 2014, 15:58:43 UTC |
| 89cb481 | Ankit Gupta | 22 April 2014, 07:09:40 UTC | Fix doc | 22 April 2014, 07:09:40 UTC |
| 677b0d6 | Ankit Gupta | 22 April 2014, 07:04:56 UTC | Refactor filter impl | 22 April 2014, 07:04:56 UTC |
| 5e797cf | Ankit Gupta | 22 April 2014, 06:56:19 UTC | Change filter implementation | 22 April 2014, 06:56:19 UTC |
| cea2be2 | Ankit Gupta | 22 April 2014, 03:27:09 UTC | Fix formatting | 22 April 2014, 03:27:09 UTC |
| dc4b27a | Ankit Gupta | 22 April 2014, 03:25:30 UTC | Add bloom filters | 22 April 2014, 03:25:30 UTC |
| af6ad11 | Yueh-Hsuan Chiang | 22 April 2014, 00:49:47 UTC | Fix SIGFAULT when running sst_dump on v2.6 db Summary: Fix the sigfault when running sst_dump on v2.6 db. Test Plan: git checkout bba6595b1f3f42cf79bb21c2d5b981ede1cc0063 make clean make db_bench ./db_bench --db=/tmp/some/db --benchmarks=fillseq arc patch D18039 make clean make sst_dump ./sst_dump --file=/tmp/some/db --command=check Reviewers: igor, haobo, sdong Reviewed By: sdong CC: leveldb Differential Revision: https://reviews.facebook.net/D18039 | 22 April 2014, 00:49:47 UTC |
| c2da9e5 | Igor Canadi | 22 April 2014, 00:45:04 UTC | Flush before Fsync()/Sync() Summary: Calling Fsync()/Sync() on a file should give the guarantee that whatever you written to the file is now persisted. This is currently not the case, since we might have some data left in application cache as we do Fsync()/Sync(). For example, BuildTable() calls Fsync() without the flush, assuming all sst data is now persisted, but it's actually not. This may result in big inconsistencies. Test Plan: no test Reviewers: sdong, dhruba, haobo, ljin, yhchiang Reviewed By: sdong CC: leveldb Differential Revision: https://reviews.facebook.net/D18159 | 22 April 2014, 00:45:04 UTC |
| ba16c1f | Igor Canadi | 22 April 2014, 00:43:48 UTC | Move benchmark timing to Env::NowNanos() | 22 April 2014, 00:43:51 UTC |
| e316af5 | Yueh-Hsuan Chiang | 21 April 2014, 22:52:59 UTC | [Java] Add Java binding and Java test for ReadOptions. Summary: Add Java binding and test for rocksdb::ReadOptions. Test Plan: make rocksdbjava make jtest Reviewers: haobo, dhruba, sdong, ankgup87, rsumbaly, swapnilghike, zzbennett Reviewed By: haobo CC: leveldb Differential Revision: https://reviews.facebook.net/D18129 | 21 April 2014, 22:52:59 UTC |
| d0939cd | Igor Canadi | 21 April 2014, 22:42:04 UTC | Single-threaded asan_crash_test | 21 April 2014, 22:42:28 UTC |
| ef8b8a8 | Yueh-Hsuan Chiang | 21 April 2014, 22:40:46 UTC | [Java] Add Java bindings for memtables and sst format. Summary: Add Java bindings for memtables and sst format. Specifically, add two abstract Java classses --- MemTableConfig and SstFormatConfig. Each MemTable / SST implementation should has its own config class extends MemTableConfig / SstFormatConfig respectively and pass it to Options via setMemTableConfig / setSstConfig. Test Plan: make rocksdbjava make jdb_test make jdb_bench java/jdb_bench.sh \ --benchmarks=fillseq,readrandom,readwhilewriting \ --memtablerep=hash_skiplist \ --use_plain_table=1 \ --key_size=20 \ --prefix_size=12 \ --value_size=100 \ --cache_size=17179869184 \ --disable_wal=0 \ --sync=0 \ Reviewers: haobo, ankgup87, sdong Reviewed By: haobo CC: leveldb, dhruba Differential Revision: https://reviews.facebook.net/D17997 | 21 April 2014, 22:40:46 UTC |
| 8dc3436 | Igor Canadi | 21 April 2014, 20:01:50 UTC | Rename "benchmark" back to "bench". Also, make `benchharness.cc` not compiled into rocksdb library. | 21 April 2014, 20:12:15 UTC |
| 05c1686 | Igor Canadi | 21 April 2014, 19:55:41 UTC | Relax env_test::AllocateTest | 21 April 2014, 19:56:32 UTC |
| ff1b5df | Pratyush Seth | 21 April 2014, 19:29:55 UTC | Added benchmark functionality on the lines of folly/Benchmark.h Summary: Added benchmark functionality on the lines of folly/Benchmark.h Test Plan: Added unit tests Reviewers: igor, haobo, sdong, ljin, yhchiang, dhruba Reviewed By: igor CC: leveldb Differential Revision: https://reviews.facebook.net/D17973 | 21 April 2014, 19:29:55 UTC |
| c7076a7 | Igor Canadi | 21 April 2014, 19:12:02 UTC | Fix Allocate test Summary: For some reason, on a subset of our continuous build machines, preallocation is allocating 8 block more than it should be. Let's relax the test a little bit -- now we require the test to allocate *at least* the number of blocks as we told them to. Test Plan: no Reviewers: ljin, haobo, sdong Reviewed By: ljin CC: leveldb Differential Revision: https://reviews.facebook.net/D18141 | 21 April 2014, 19:12:02 UTC |
| f813279 | Igor Canadi | 21 April 2014, 18:08:30 UTC | Remove TransactionLogIteratorRace when -DNDEBUG | 21 April 2014, 18:08:30 UTC |
| 11e8525 | Igor Canadi | 21 April 2014, 16:59:39 UTC | Merge pull request #124 from ankgup87/master [Java] Add iterator JNI bindings | 21 April 2014, 16:59:39 UTC |
| 0f2d768 | Lei Jin | 21 April 2014, 16:10:12 UTC | hints for narrowing down FindFile range and avoiding checking unrelevant L0 files Summary: The file tree structure in Version is prebuilt and the range of each file is known. On the Get() code path, we do binary search in FindFile() by comparing target key with each file's largest key and also check the range for each L0 file. With some pre-calculated knowledge, each key comparision that has been done can serve as a hint to narrow down further searches: (1) If a key falls within a L0 file's range, we can safely skip the next file if its range does not overlap with the current one. (2) If a key falls within a file's range in level L0 - Ln-1, we should only need to binary search in the next level for files that overlap with the current one. (1) will be able to skip some files depending one the key distribution. (2) can greatly reduce the range of binary search, especially for bottom levels, given that one file most likely only overlaps with N files from the level below (where N is max_bytes_for_level_multiplier). So on level L, we will only look at ~N files instead of N^L files. Some inital results: measured with 500M key DB, when write is light (10k/s = 1.2M/s), this improves QPS ~7% on top of blocked bloom. When write is heavier (80k/s = 9.6M/s), it gives us ~13% improvement. Test Plan: make all check Reviewers: haobo, igor, dhruba, sdong, yhchiang Reviewed By: haobo CC: leveldb Differential Revision: https://reviews.facebook.net/D17205 | 21 April 2014, 16:10:12 UTC |
| bbdd550 | Ankit Gupta | 20 April 2014, 06:17:42 UTC | Remove getIterator function from portal | 20 April 2014, 06:17:42 UTC |
| 1574e0c | Ankit Gupta | 19 April 2014, 20:21:06 UTC | Add doc | 19 April 2014, 20:21:06 UTC |
| 06b590d | Ankit Gupta | 19 April 2014, 20:13:01 UTC | Add doc | 19 April 2014, 20:13:01 UTC |
| dc28a72 | Ankit Gupta | 19 April 2014, 20:05:21 UTC | Add doc + refactor + fix formatting | 19 April 2014, 20:05:21 UTC |
| 1d6c1e0 | Ankit Gupta | 19 April 2014, 19:55:28 UTC | Add more iterator JNI bindings | 19 April 2014, 19:55:28 UTC |
| eda3984 | Ankit Gupta | 19 April 2014, 10:35:01 UTC | Add more iterator functions | 19 April 2014, 10:35:01 UTC |
| 5bbeefa | Ankit Gupta | 19 April 2014, 10:26:22 UTC | Adding iterator JNI binding | 19 April 2014, 10:26:22 UTC |
| 27d3bc1 | sdong | 18 April 2014, 01:00:58 UTC | Use a different approach to make sure BlockBasedTableReader can use hash index on older files Summary: A recent commit https://github.com/facebook/rocksdb/commit/e37dd216f9384bfdabc6760fa296e8ee28c79d30 makes sure hash index can be used when reading existing files. This patch uses another way to achieve the approach: (1) Currently, always writing kBinarySearch to files, despite of BlockBasedTableOptions.IndexType setting. (2) When reading a file, read out the field, and make sure it is kBinarySearch, while always use index type by users. The reason for doing it is, to reserve kHashSearch property on disk to future. If now we write out binary index for both of kHashSearch and kBinarySearch. We have to use a new flag in the future for hash index on disk, otherwise compatibility would break. Also, we want the real index type and type shown in properties block to be consistent. Test Plan: make all check Reviewers: haobo, kailiu Reviewed By: kailiu CC: igor, ljin, yhchiang, xjin, dhruba, leveldb Differential Revision: https://reviews.facebook.net/D18009 | 18 April 2014, 21:09:21 UTC |
| 35c968f | Igor Canadi | 18 April 2014, 20:53:52 UTC | Merge pull request #122 from ankgup87/master [Java] Add statistics JNI bindings | 18 April 2014, 20:53:52 UTC |
| 686fdea | Ankit Gupta | 18 April 2014, 17:48:48 UTC | Fix formatting issues | 18 April 2014, 17:48:48 UTC |
| ebd85e8 | Ankit Gupta | 18 April 2014, 17:47:03 UTC | Fix build | 18 April 2014, 17:47:03 UTC |
| dc291f5 | Ankit Gupta | 18 April 2014, 17:32:14 UTC | Merge branch 'master' of https://github.com/facebook/rocksdb Conflicts: Makefile java/Makefile java/org/rocksdb/Options.java java/rocksjni/portal.h | 18 April 2014, 17:32:14 UTC |
| 1a8abe7 | Igor Canadi | 18 April 2014, 16:45:48 UTC | Merge pull request #120 from jamesgpearce/master Added period | 18 April 2014, 16:45:48 UTC |
| a745089 | James Pearce | 18 April 2014, 16:33:27 UTC | Added period This is a PR to test some tooling; please do not merge without talking to @jamesgpearce :) | 18 April 2014, 16:33:27 UTC |
| 9b2a093 | Yueh-Hsuan Chiang | 18 April 2014, 08:14:29 UTC | [Java] Add Java bindings for 30 options for rocksdb::DBOptions. Summary: 1. Add Java bindings for 30 options for rocksdb::DBOptions. 2. Add org.rocksdb.test.OptionsTest 3. Codes are semi-auto generated, JavaDocs are manually polished. Test Plan: make rocksdbjava make jtest Reviewers: haobo, ankgup87, sdong, dhruba Reviewed By: dhruba CC: leveldb Differential Revision: https://reviews.facebook.net/D18015 | 18 April 2014, 08:14:29 UTC |
| bb6fd15 | Yueh-Hsuan Chiang | 18 April 2014, 00:28:51 UTC | [Java] Add a basic binding and test for BackupableDB and StackableDB. Summary: Add a skeleton binding and test for BackupableDB which shows that BackupableDB and RocksDB can share the same JNI calls. Test Plan: make rocksdbjava make jtest Reviewers: haobo, ankgup87, sdong, dhruba Reviewed By: haobo CC: leveldb Differential Revision: https://reviews.facebook.net/D17793 | 18 April 2014, 00:28:51 UTC |
| 6517922 | sdong | 17 April 2014, 22:14:04 UTC | Fix bugs introduced by D17961 Summary: D17961 has two bugs: (1) two level iterator fails to populate FileMetaData.table_reader, causing performance regression. (2) table cache handle the !status.ok() case in the wrong place, causing seg fault which shouldn't happen. Test Plan: make all check Reviewers: ljin, igor, haobo Reviewed By: ljin CC: yhchiang, dhruba, leveldb Differential Revision: https://reviews.facebook.net/D17991 | 18 April 2014, 00:25:28 UTC |
| ce353c2 | Igor Canadi | 17 April 2014, 21:43:42 UTC | Nuke tools/shell Summary: We don't use or build this code Test Plan: builds Reviewers: dhruba Reviewed By: dhruba CC: leveldb Differential Revision: https://reviews.facebook.net/D17979 | 17 April 2014, 21:43:42 UTC |
| 86ae820 | Igor Canadi | 17 April 2014, 21:29:06 UTC | Fix ifdef NDEBUG | 17 April 2014, 21:29:28 UTC |
| fa430bf | sdong | 17 April 2014, 21:07:05 UTC | Minimize accessing multiple objects in Version::Get() Summary: One of our profilings shows that Version::Get() sometimes is slow when getting pointer of user comparators or other global objects. In this patch: (1) we keep pointers of immutable objects in Version to avoid accesses them though option objects or cfd objects (2) table_reader is directly cached in FileMetaData so that table cache don't have to go through handle first to fetch it (3) If level 0 has less than 3 files, skip the filtering logic based on SST tables' key range. Smallest and largest key are stored in separated memory locations, which has potential cache misses Test Plan: make all check Reviewers: haobo, ljin Reviewed By: haobo CC: igor, yhchiang, nkg-, leveldb Differential Revision: https://reviews.facebook.net/D17739 | 17 April 2014, 21:14:00 UTC |
| e37dd21 | Kai Liu | 11 April 2014, 20:55:26 UTC | Index type doesn't have to be persisted Summary: With the recent changes, there is no need to check the property block about the index block type. If user want to use it, they don't really need any disk format change; everything happens in the fly. Also another team encountered an error while reading the index type from properties. Test Plan: ran all the tests Reviewers: sdong CC: Task ID: # Blame Rev: | 17 April 2014, 18:08:12 UTC |
| 62551b1 | Igor Canadi | 17 April 2014, 17:49:58 UTC | Don't compile sync_point if NDEBUG Summary: We don't really need sync_point.o if we're compiling with NDEBUG. This diff depends on D17823 Test Plan: compiles Reviewers: haobo, ljin, sdong Reviewed By: haobo CC: leveldb Differential Revision: https://reviews.facebook.net/D17829 | 17 April 2014, 17:49:58 UTC |
| 5cef458 | sdong | 17 April 2014, 02:30:33 UTC | RocksDB 2.8 to be able to read files generated by 2.6 Summary: From 2.6 to 2.7, property block name is renamed from rocksdb.stats to rocksdb.properties. Older properties were not able to be loaded. In 2.8, we seem to have added some logic that uses property block without checking null pointers, which create segment faults. In this patch, we fix it by: (1) try rocksdb.stats if rocksdb.properties is not found (2) add some null checking before consuming rep->table_properties Test Plan: make sure a file generated in 2.7 couldn't be opened now can be opened. Reviewers: haobo, igor, yhchiang Reviewed By: igor CC: ljin, xjin, dhruba, kailiu, leveldb Differential Revision: https://reviews.facebook.net/D17961 | 17 April 2014, 16:51:43 UTC |
| 136e4ef | Ankit Gupta | 17 April 2014, 05:02:46 UTC | Add doc | 17 April 2014, 05:02:46 UTC |
| d160595 | Ankit Gupta | 17 April 2014, 05:00:44 UTC | Add doc | 17 April 2014, 05:00:44 UTC |
| d3b44f0 | Ankit Gupta | 17 April 2014, 04:55:15 UTC | Fix white spaces | 17 April 2014, 04:55:15 UTC |
| 6b0cc41 | Ankit Gupta | 17 April 2014, 04:39:44 UTC | Merge branch 'master' of https://github.com/facebook/rocksdb | 17 April 2014, 04:39:44 UTC |
| 5108ed7 | Ankit Gupta | 17 April 2014, 04:39:29 UTC | Add fixed classes | 17 April 2014, 04:39:29 UTC |
| 320ae72 | Ankit Gupta | 17 April 2014, 04:38:33 UTC | Add histogramType for statistics | 17 April 2014, 04:38:33 UTC |
| 161d9e5 | Igor Canadi | 16 April 2014, 22:15:22 UTC | Don't overflow size_t in mac | 16 April 2014, 22:15:22 UTC |
| 5c12f27 | Igor Canadi | 16 April 2014, 16:09:28 UTC | Remove tautological assert | 16 April 2014, 16:09:28 UTC |
| 144066a | Ankit Gupta | 16 April 2014, 01:08:37 UTC | Deleted statisticsType | 16 April 2014, 01:08:37 UTC |
| 495fc80 | Ankit Gupta | 16 April 2014, 00:38:20 UTC | Merge branch 'master' of https://github.com/facebook/rocksdb | 16 April 2014, 00:38:20 UTC |
| b18d914 | Ankit Gupta | 16 April 2014, 00:37:50 UTC | Change statisticsType to tickerType | 16 April 2014, 00:37:50 UTC |
| faf7691 | Igor Canadi | 16 April 2014, 00:12:18 UTC | Close DB at the end of DontRollEmptyLogs test | 16 April 2014, 00:20:56 UTC |
| 1803ed2 | Igor Canadi | 15 April 2014, 23:31:49 UTC | Fix Mac OS compile | 15 April 2014, 23:31:49 UTC |
| 7d83885 | Igor Canadi | 15 April 2014, 22:59:34 UTC | Fix compile issues when doing make release | 15 April 2014, 23:00:10 UTC |
| 0f40fe4 | sdong | 15 April 2014, 16:06:13 UTC | When creating a new DB, fail it when wal_dir contains existing log files Summary: Current behavior of creating new DB is, if there is existing log files, we will go ahead and replay them on top of empty DB. This is a behavior that no user would expect. With this patch, we will fail the creation if a user creates a DB with existing log files. Test Plan: make all check Reviewers: haobo, igor, ljin Reviewed By: haobo CC: nkg-, yhchiang, dhruba, leveldb Differential Revision: https://reviews.facebook.net/D17817 | 15 April 2014, 21:01:57 UTC |
| c166615 | Igor Canadi | 15 April 2014, 20:51:07 UTC | Fix compile issues introduced by RocksDBLite | 15 April 2014, 20:51:07 UTC |
| 588bca2 | Igor Canadi | 15 April 2014, 20:39:26 UTC | RocksDBLite Summary: Introducing RocksDBLite! Removes all the non-essential features and reduces the binary size. This effort should help our adoption on mobile. Binary size when compiling for IOS (`TARGET_OS=IOS m static_lib`) is down to 9MB from 15MB (without stripping) Test Plan: compiles :) Reviewers: dhruba, haobo, ljin, sdong, yhchiang Reviewed By: yhchiang CC: leveldb Differential Revision: https://reviews.facebook.net/D17835 | 15 April 2014, 20:39:26 UTC |
| 23c8f89 | Igor Canadi | 15 April 2014, 18:29:02 UTC | Revert "Don't compile ldb tool into static library" This reverts commit e296577ef64deac036a275a1a4c0d6172cfa42df. | 15 April 2014, 18:29:02 UTC |
| a347ffe | Igor Canadi | 15 April 2014, 18:28:52 UTC | Revert "Fix sst_dump and reduce_levels_test compile errors" This reverts commit d8f00b4109e3df10be56141f3ff3ba9b0d10f585. | 15 April 2014, 18:28:52 UTC |
| d8f00b4 | Igor Canadi | 15 April 2014, 18:08:48 UTC | Fix sst_dump and reduce_levels_test compile errors | 15 April 2014, 18:13:12 UTC |
| e296577 | Igor Canadi | 15 April 2014, 17:52:39 UTC | Don't compile ldb tool into static library Summary: This is first step of my effort to reduce size of librocksdb.a for use in mobile. ldb object files are huge and are ment to be used as a command line tool. I moved them to `tools/` directory and include them only when compiling `ldb` This diff reduced librocksdb.a from 42MB to 39MB on my mac (not stripped). Test Plan: ran ldb Reviewers: dhruba, haobo, sdong, ljin, yhchiang Reviewed By: yhchiang CC: leveldb Differential Revision: https://reviews.facebook.net/D17823 | 15 April 2014, 17:52:39 UTC |
| dbe0f32 | Igor Canadi | 15 April 2014, 17:28:34 UTC | Set log_empty to false even when options.sync is off [fix tests] | 15 April 2014, 17:28:34 UTC |
| e6acb87 | Igor Canadi | 15 April 2014, 16:57:25 UTC | Don't roll empty logs Summary: With multiple column families, especially when manual Flush is executed, we might roll the log file, although the current log file is empty (no data has been written to the log). After the diff, we won't create new log file if current is empty. Next, I will write an algorithm that will flush column families that reference old log files (i.e., that weren't flushed in a while) Test Plan: Added an unit test. Confirmed that unit test failes in master Reviewers: dhruba, haobo, ljin, sdong Reviewed By: ljin CC: leveldb Differential Revision: https://reviews.facebook.net/D17631 | 15 April 2014, 16:57:25 UTC |
| 3723d08 | Ankit Gupta | 15 April 2014, 05:16:10 UTC | Add newline at end of file | 15 April 2014, 05:16:10 UTC |
| 9842177 | Ankit Gupta | 15 April 2014, 04:14:29 UTC | remove unused header | 15 April 2014, 04:14:29 UTC |
| 8756a32 | Ankit Gupta | 15 April 2014, 04:11:03 UTC | Remove unused headers | 15 April 2014, 04:11:03 UTC |
| c199e0e | Ankit Gupta | 15 April 2014, 04:08:04 UTC | Add statistics | 15 April 2014, 04:08:04 UTC |
| a044398 | Ankit Gupta | 15 April 2014, 04:06:13 UTC | Add statistics object | 15 April 2014, 04:06:13 UTC |
| c87ed09 | sdong | 14 April 2014, 22:42:20 UTC | Fix db_bench's multireadrandom Summary: multireadrandom is broken. Fix it Test Plan: run it and see segfault has gone. Reviewers: ljin Reviewed By: ljin CC: leveldb Differential Revision: https://reviews.facebook.net/D17781 | 14 April 2014, 22:43:34 UTC |
| 118f88d | Yueh-Hsuan Chiang | 14 April 2014, 21:05:15 UTC | Fix compile error in tailing_iter.h Summary: Fix the following compile error ./db/tailing_iter.h:17:1: error: class 'SuperVersion' was previously declared as a struct [-Werror,-Wmismatched-tags] class SuperVersion; ^ ./db/column_family.h:77:8: note: previous use is here struct SuperVersion { ^ ./db/tailing_iter.h:17:1: note: did you mean struct here? class SuperVersion; ^~~~~ struct 1 error generated. Test Plan: make Reviewers: ljin, igor, haobo, sdong Reviewed By: ljin CC: leveldb Differential Revision: https://reviews.facebook.net/D17799 | 14 April 2014, 21:05:15 UTC |
| 51f4b50 | Yueh-Hsuan Chiang | 14 April 2014, 21:03:43 UTC | [Java] Add SizeUnit in org.rocksdb.util to store const like KB, GB. Summary: * Add a class SizeUnit to store frequently used consts. Currently it has KB, MB, GB, TB, and PB. * Change the parameter type of Options.writeBufferSize and Options.blockSize from int to long. Test Plan: make rocksdbjava make jtest Reviewers: haobo, ankgup87, sdong, dhruba Reviewed By: haobo CC: leveldb Differential Revision: https://reviews.facebook.net/D17703 | 14 April 2014, 21:03:43 UTC |
| 31e7e7f | Yueh-Hsuan Chiang | 14 April 2014, 20:42:36 UTC | [JAVA] Add java binding for Options.block_cache. Summary: Add java bindings for Options.block_cache and allow DbBenchmark to set cache_size. Test Plan: make rocksdbjava make jtest make jdb_Bench Reviewers: haobo, sdong, ankgup87 Reviewed By: ankgup87 CC: leveldb, dhruba Differential Revision: https://reviews.facebook.net/D17481 | 14 April 2014, 20:42:36 UTC |
| 2885ad9 | Yueh-Hsuan Chiang | 14 April 2014, 19:48:50 UTC | [JNI] Each set function of Options / WriteOptions now returns its option instance. Summary: Make each set function of Options / WriteOptions return its option instance. Java developers can now easier specify each option like the following: options.setCreateIfMissing(true) .setWriteBufferSize(8 * 1024) .setMaxWriteBufferNumber(3) .setDisableSeekCompaction(true) .setBlockSize(64 * 1024) .setMaxBackgroundCompactions(10); Test Plan: make rocksdbjava make jtest Reviewers: haobo, ankgup87, sdong, dhruba Reviewed By: haobo CC: leveldb Differential Revision: https://reviews.facebook.net/D17661 | 14 April 2014, 19:48:50 UTC |
| be01661 | Igor Canadi | 14 April 2014, 19:28:15 UTC | Expose in memory Env to the world Summary: That will help with some iOS testing I'm doing. Test Plan: compiles Reviewers: dhruba, haobo, ljin, yhchiang, sdong Reviewed By: haobo CC: leveldb Differential Revision: https://reviews.facebook.net/D17787 | 14 April 2014, 19:28:15 UTC |
| 327102e | Yueh-Hsuan Chiang | 14 April 2014, 19:06:30 UTC | Fix merge_test failure due to incorrect assert behavior in the release mode. | 14 April 2014, 19:06:49 UTC |
| 82b37a1 | Lei Jin | 14 April 2014, 17:48:01 UTC | thread local for tailing iterator Summary: replace the super version acquisision in tailing itrator with thread local Test Plan: will post results Reviewers: igor, haobo, sdong, yhchiang, dhruba Reviewed By: igor CC: leveldb Differential Revision: https://reviews.facebook.net/D17757 | 14 April 2014, 17:48:01 UTC |
| 539dd20 | Lei Jin | 14 April 2014, 16:34:59 UTC | using thread local SuperVersion for NewIterator Summary: Similar to GetImp(), use SuperVersion from thread local instead of acquriing mutex. I don't expect this change will make a dent on NewIterator() performance because the bottleneck seems to be on the rest part of the API Test Plan: make asan_check will post perf numbers Reviewers: haobo, igor, sdong, dhruba, yhchiang Reviewed By: sdong CC: leveldb Differential Revision: https://reviews.facebook.net/D17643 | 14 April 2014, 16:34:59 UTC |
| d5e087b | sdong | 11 April 2014, 19:15:09 UTC | db_bench: add a mode to operate multiple DBs Summary: This patch introduces a new parameter num_multi_db in db_bench. When this parameter is larger than 1, multiple DBs will be created. In all benchmarks, any operation applies to a random DB among them. This is to benchmark the performance of similar applications. Test Plan: run db_bench on both of num_multi_db=0 and more. Reviewers: haobo, ljin, igor Reviewed By: igor CC: igor, yhchiang, dhruba, nkg-, leveldb Differential Revision: https://reviews.facebook.net/D17769 | 11 April 2014, 23:59:08 UTC |
| 30aff72 | Igor Canadi | 11 April 2014, 21:48:20 UTC | Don't shadow in ColumnFamilyDescriptor | 11 April 2014, 21:48:20 UTC |
| eba3fc6 | Lei Jin | 11 April 2014, 19:48:38 UTC | make corruption_test:CompactionInputErrorParanoid deterministic Summary: it writes ~10M data, default L0 compaction trigger is 4, plus 2 writer buffer, so that can accommodate ~6M data before compaction happens for sure. I guess encoding is doing a good job to shrink the data so that sometime, compaction does not get triggered. I get test failure quite often. Test Plan: ran it multiple times and all got pass Reviewers: igor, sdong Reviewed By: sdong CC: leveldb Differential Revision: https://reviews.facebook.net/D17775 | 11 April 2014, 19:48:38 UTC |
| 9433e35 | Igor Canadi | 11 April 2014, 17:54:47 UTC | Dont build version if compiling for IOS | 11 April 2014, 17:54:47 UTC |
| de41357 | Igor Canadi | 11 April 2014, 17:19:58 UTC | Don't dump rocksdb version on IOS | 11 April 2014, 17:19:58 UTC |
| 0af36d6 | Lei Jin | 11 April 2014, 16:47:20 UTC | SeekRandomWhileWriting Summary: as title Test Plan: ran it Reviewers: igor, haobo, yhchiang Reviewed By: yhchiang CC: leveldb Differential Revision: https://reviews.facebook.net/D17751 | 11 April 2014, 16:47:20 UTC |
| e23e73e | Kai Liu | 11 April 2014, 00:23:49 UTC | Use shorten index key for hash-index Summary: I was wrong about the "index builder", right now since we create index by scanning both whole table and index, there is not need to preserve the whole key as the index key. I switch back to original way index which is both space efficient and able to supprot in-fly construction of hash index. IN this patch, I made minimal change since I'm not sure if we still need the "pluggable index builder", under current circumstance it is of no use and kind of over-engineered. But I'm not sure if we can still exploit its usefulness in the future; otherwise I think I can just burn them with great vengeance. Test Plan: unit tests Reviewers: sdong, haobo CC: leveldb Differential Revision: https://reviews.facebook.net/D17745 | 11 April 2014, 05:45:25 UTC |
