Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,902 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

5308 Commits

Author SHA1 Message Date
zhangduo 47a4e3437b HBASE-17132 Cleanup deprecated code for WAL 2016-11-22 18:27:41 +08:00
Jingcheng Du 92b494f117 HBASE-17157 Increase the default mergeable threshold for mob compaction 2016-11-22 17:39:10 +08:00
zhangduo 6ff19f94fe HBASE-17141 Introduce a more user-friendly implementation of AsyncTable 2016-11-22 14:44:51 +08:00
Jingcheng Du b297f2dae1 HBASE-17095 The ClientSimpleScanner keeps retrying if the hfile is corrupt or cannot found 2016-11-22 11:18:00 +08:00
tedyu 7ff7b88db5 HBASE-17123 Add postBulkLoadHFile variant that notifies the final paths for the hfiles - addendum calls existing BaseRegionObserver#postBulkLoadHFile() 2016-11-21 06:49:18 -08:00
anoopsamjohn 549c8d835a HBASE-17139 Remove sweep tool related configs from hbase-default.xml. 2016-11-21 15:54:31 +05:30
tedyu 768b4119da HBASE-17123 Add postBulkLoadHFile variant that notifies the final paths for the hfiles 2016-11-20 09:26:42 -08:00
tedyu bb645bcfda HBASE-17131 Avoid livelock caused by HRegion#processRowsWithLocks (ChiaPing Tsai) 2016-11-20 07:09:02 -08:00
anoopsamjohn a3a56b6380 HBASE-16989 RowProcess#postBatchMutate doesn’t be executed before the mvcc transaction completion. (ChiaPing Tsai) 2016-11-19 12:32:49 +05:30
Guanghao Zhang fa7ed58e1b HBASE-17088 Refactor RWQueueRpcExecutor/BalancedQueueRpcExecutor/RpcExecutor 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2016-11-19 14:17:45 +08:00
Esteban Gutierrez 7c6e839f6a HBASE-17058 Lower epsilon used for jitter verification from HBASE-15324 2016-11-17 11:11:30 -08:00
Devaraj Das 5753d18c70 HBASE-16956 Refactor FavoredNodePlan to use regionNames as keys (Thiruvel Thirumoolan) 2016-11-17 10:09:48 -08:00
tedyu 4c7eac8977 HBASE-17112 Prevent setting timestamp of delta operations the same as previous value's (Phil Yang) 2016-11-17 09:03:48 -08:00
tedyu f6fc94ede9 HBASE-17118 StoreScanner leaked in KeyValueHeap (binlijin) 2016-11-17 07:52:52 -08:00
tedyu b9319496bc HBASE-17120 TestAssignmentListener#testAssignmentListener fails (ChiaPing Tsai) 2016-11-17 07:48:52 -08:00
zhangduo ab55bad899 HBASE-17085 AsyncFSWAL may issue unnecessary AsyncDFSOutput.sync 2016-11-17 15:10:19 +08:00
thiruvel 80acc2dca5 HBASE-16169: Make RegionSizeCalculator scalable 
Signed-off-by: Michael Stack <stack@apache.org>
 2016-11-16 23:07:14 -08:00
anoopsamjohn 4d1bff9e78 HBASE-17073 Increase the max number of buffers in ByteBufferPool. 2016-11-15 11:23:03 +05:30
tedyu c7bdb3017f HBASE-17092 Both LoadIncrementalHFiles#doBulkLoad() methods should set return value 2016-11-14 17:30:55 -08:00
Andrew Purtell dcf03b32f4 HBASE-17044 Fix merge failed before creating merged region leaves meta inconsistent 2016-11-14 17:23:27 -08:00
anoopsamjohn c3685760f0 HBASE-15788 Use Offheap ByteBuffers from BufferPool to read RPC requests. 2016-11-14 23:05:05 +05:30
tedyu 9250bf8091 HBASE-17037 Enhance LoadIncrementalHFiles API to convey loaded files 2016-11-13 07:02:18 -08:00
tedyu dba7ec1b69 HBASE-17077 Don't copy the replication queue belonging to the peer which has been deleted (Guanghao Zhang) 2016-11-13 06:58:39 -08:00
tedyu 5e91b45b16 HBASE-17062 RegionSplitter throws ClassCastException (Jeongdae Kim) 2016-11-11 07:15:03 -08:00
zhangduo 8a6d6aa239 HBASE-16838 Implement basic scan 2016-11-11 21:01:16 +08:00
anoopsamjohn fa838b020d HBASE-17071 Do not initialize MemstoreChunkPool when use mslab option is turned off. 2016-11-11 16:44:34 +05:30
thiruvel f9c6b66b95 HBASE-16962: Add readPoint to preCompactScannerOpen() and preFlushScannerOpen APIs 
Signed-off-by: anoopsamjohn <anoopsamjohn@gmail.com>
 2016-11-11 11:07:22 +05:30
Apekshit Sharma 62e3b1ece6 HBASE-17063 Cleanup TestHRegion : remove duplicate variables for method name and two unused params in initRegion 
- Replaces local tablename and method names in individual tests with those initialized in setup() function
- Remove unused params from initHRegion().

Change-Id: Id0fe25890c833f7cc9b91277d5015480a007d788
 2016-11-10 17:21:06 -08:00
Guanghao Zhang 12eec5bc5d HBASE-16938 TableCFsUpdater maybe failed due to no write permission on peerNode 
Signed-off-by: Enis Soztutar <enis@apache.org>
 2016-11-10 14:04:28 -08:00
Yu Sun fb4c50966e HBASE-17020 keylen in midkey() dont computed correctly 
Signed-off-by: Yu Li <liyu@apache.org>
 2016-11-10 17:15:34 +08:00
binlijin 7f08cd0e10 HBASE-16570 Compute region locality in parallel at startup (addendum) 
Addendum mainly for:
1. Avoid interfering with block location cache in RegionLocationFinder
2. Avoid refreshing block lcoations during HMaster startup (or else the startup could be really slow)

Signed-off-by: Yu Li <liyu@apache.org>
 2016-11-10 16:53:07 +08:00
zhangduo e5a288e5c0 HBASE-17053 Remove LogRollerExitedChecker 2016-11-10 10:52:49 +08:00
Michael Stack 8192a6b6ee Revert "HBASE-16993 BucketCache throw java.io.IOException: Invalid HFile block magic when DATA_BLOCK_ENCODING set to DIFF" 
Revert of premature push.

This reverts commit de3a51263d.
 2016-11-09 17:08:14 -08:00
Guanghao Zhang 1462cf77ef HBASE-16985 TestClusterId failed due to wrong hbase rootdir 
Signed-off-by: Michael Stack <stack@apache.org>
 2016-11-09 17:06:58 -08:00
Michael Stack de3a51263d HBASE-16993 BucketCache throw java.io.IOException: Invalid HFile block magic when DATA_BLOCK_ENCODING set to DIFF 2016-11-09 17:00:30 -08:00
tedyu 287358ba6c HBASE-17054 Compactor#preCreateCoprocScanner should be passed user 2016-11-09 06:57:43 -08:00
Charlie Qiangeng Xu 3b63f701e6 HBASE-17039 SimpleLoadBalancer schedules large amount of invalid region moves 
Signed-off-by: Yu Li <liyu@apache.org>
 2016-11-09 17:04:16 +08:00
Enis Soztutar 03bc884ea0 HBASE-17017 Remove the current per-region latency histogram metrics 2016-11-08 18:31:53 -08:00
zhangduo 3b629d632a HBASE-17021 Use RingBuffer to reduce the contention in AsyncFSWAL 2016-11-09 09:24:12 +08:00
Michael Stack 0998af01df Revert "Revert "HBASE-16983 TestMultiTableSnapshotInputFormat failing with Unable to create region directory: /tmp/... (Addendum by Guanghao Zhang)"" 
This is a revert of a revert, i.e. puts back the change only I added
HBaseCommonTestingUtility#getRandomDir from branch-1 too since
missing in master branch.

This reverts commit 9afcb4366d.
 2016-11-08 12:55:48 -08:00
Apekshit Sharma 52241c90e4 HBASE-16982 Better integrate Apache CLI in AbstractHBaseTool. 
- processOldArgs() in AbstractHBaseTool will make it possible to change existing tools to use Apache CLI in a backward compatible manner.
- Changes ExportSnapshot tool as a proof-of-concept
- Update version of Apache CLI from 1.2 to 1.3.1

Change-Id: I4bb2e7da4f2ed0e12e28621ab16459309fa36d03
 2016-11-08 12:21:29 -08:00
Michael Stack 9afcb4366d Revert "HBASE-16983 TestMultiTableSnapshotInputFormat failing with Unable to create region directory: /tmp/... (Addendum by Guanghao Zhang)" 
This reverts commit f9c23f5e9d.
 2016-11-08 12:15:36 -08:00
Michael Stack f9c23f5e9d HBASE-16983 TestMultiTableSnapshotInputFormat failing with Unable to create region directory: /tmp/... (Addendum by Guanghao Zhang) 2016-11-08 12:00:51 -08:00
Matteo Bertozzi b143f6e4a3 HBASE-17030 Procedure v2 - A couple of tweaks to the SplitTableRegionProcedure 2016-11-08 10:30:33 -08:00
tedyu 76814e8451 HBASE-17010 Serial replication should handle daughter regions being assigned to another RS (Phil Yang) 2016-11-08 06:25:50 -08:00
Stephen Yuan Jiang 0512b4d015 HBASE-17042 Remove 'public' keyword from MasterObserver interface (Stephen Yuan Jiang) 2016-11-07 17:50:58 -08:00
Enis Soztutar 59d7b47e60 HBASE-17033 LogRoller makes a lot of allocations unnecessarily 2016-11-07 14:18:00 -08:00
anoopsamjohn 2182ca34ac HBASE-16992 The usage of mutation from CP is weird. (ChiaPing Tsai) 2016-11-07 23:24:34 +05:30
Michael Stack e60a7f6e7d HBASE-15513 hbase.hregion.memstore.chunkpool.maxsize is 0.0 by default (Addendum by Anoop Sam John) 2016-11-07 09:33:01 -08:00
Michael Stack 97ce30d47e Revert "Revert "HBASE-15513 hbase.hregion.memstore.chunkpool.maxsize is 0.0 by default (Vladimir Rodionov)"" 
This is a revert of a revert.

This reverts commit fd6b0b3dbf.
 2016-11-07 09:31:44 -08:00
Michael Stack fd6b0b3dbf Revert "HBASE-15513 hbase.hregion.memstore.chunkpool.maxsize is 0.0 by default (Vladimir Rodionov)" 
This reverts commit 8b4bb34ec2.
 2016-11-07 09:07:02 -08:00
tedyu f3bed5b0d9 HBASE-17026 VerifyReplication log should distinguish whether good row key is result of revalidation 2016-11-07 07:38:47 -08:00
binlijin e8e658ed38 HBASE-16840 Reuse cell's timestamp and type in ScanQueryMatcher 
Signed-off-by: Yu Li <liyu@apache.org>
 2016-11-07 22:40:18 +08:00
Yu Li e33fd427e4 Revert "HBASE-16840 Reuse cell's timestamp and type in ScanQueryMatcher" to update author 
This reverts commit 28de528c6e.
 2016-11-07 22:40:02 +08:00
Yu Li 28de528c6e HBASE-16840 Reuse cell's timestamp and type in ScanQueryMatcher 
Signed-off-by: Yu Li <liyu@apache.org>
 2016-11-07 21:33:37 +08:00
Jingcheng Du 4ca668dd11 HBASE-17005 Improve log message in MobFileCache (huaxiang sun) 2016-11-07 16:38:14 +08:00
Mikhail Antonov a34a9adb22 HBASE-17032 CallQueueTooBigException and CallDroppedException should not be triggering PFFE 2016-11-06 21:44:59 -08:00
Michael Stack 8b4bb34ec2 HBASE-15513 hbase.hregion.memstore.chunkpool.maxsize is 0.0 by default (Vladimir Rodionov) 2016-11-06 21:43:02 -08:00
Matteo Bertozzi 7e05d0f161 HBASE-16937 Replace SnapshotType protobuf conversion when we can directly use the pojo object 2016-11-04 13:18:34 -07:00
Matteo Bertozzi 00ea7aeafe HBASE-16892 Use TableName instead of String in SnapshotDescription 2016-11-04 13:18:10 -07:00
Matteo Bertozzi efe0a0eead HBASE-16865 Procedure v2 - Inherit lock from root proc 2016-11-04 13:17:40 -07:00
anoopsamjohn 05ee54f665 HBASE-17013 Add constructor to RowMutations for initializing the capacity of internal list. (ChiaPing Tsai) 2016-11-04 10:34:20 +05:30
Apekshit Sharma bb0fc6b602 HBASE-17006 Give name to existing threads. 
Having thread names in logs and thread dumps greatly improve debugability. This patch is simply adding the names to the threads we spawn.

Change-Id: I6ff22cc3804bb81147dde3a8e9ab671633c6f6ce
 2016-11-03 18:28:19 -07:00
Eddie Elizondo f61ae6f06d HBASE-14329 Report region in transition should check all regions in request 
Signed-off-by: Gary Helmling <garyh@apache.org>
 2016-11-03 11:16:57 -07:00
Umesh Agashe 281bf9a222 HBASE-17014 Added clearly marked log messages for start and shutdown of services HMaster, HRegionServer, ThriftServer, RESTServer. Also changed the log level for RPCServer responder starting log message to debug. 
Signed-off-by: Michael Stack <stack@apache.org>
 2016-11-03 11:09:55 -07:00
Gary Helmling e820e64272 HBASE-16964 Always clear successfully archived files from compacted files list 2016-11-03 09:09:08 -07:00
tedyu c82fc6e0b2 HBASE-16975 Disable two subtests of TestSerialReplication (Phil Yang) 2016-11-03 01:55:26 -07:00
Yu Li b1d1dc8569 HBASE-16972 Log more details for Scan#next request when responseTooSlow 2016-11-02 15:02:07 +08:00
binlijin 6b957b69a7 HBASE-16960 RegionServer hang when aborting 
Signed-off-by: Yu Li <liyu@apache.org>
 2016-11-02 11:59:51 +08:00
Lars Hofhansl b7293bf5ad HBASE-16765 New SteppingRegionSplitPolicy, avoid too aggressive spread of regions for small tables. 2016-11-01 13:12:21 -07:00
Lars Hofhansl 1c07d1d591 Revert "New SteppingRegionSplitPolicy, avoid too aggressive spread of regions for small tables." 
This reverts commit 791052c50a.
 2016-11-01 13:11:31 -07:00
Lars Hofhansl 791052c50a New SteppingRegionSplitPolicy, avoid too aggressive spread of regions for small tables. 2016-11-01 12:21:51 -07:00
Michael Stack 26cbe44337 HBASE-16983 TestMultiTableSnapshotInputFormat failing with Unable to 
create region directory: /tmp/...
 2016-10-31 21:57:48 -07:00
zhangduo 6cf9333e97 HBASE-16945 Implement AsyncRegionLocator 2016-11-01 10:18:55 +08:00
zhangduo 45a2594249 HBASE-16968 Refactor FanOutOneBlockAsyncDFSOutput 2016-11-01 09:19:02 +08:00
Michael Stack d0be36deb7 HBASE-16966 Re-enable TestSimpleRpcScheduler#testCoDelScheduling in master branch 2016-10-31 14:40:51 -07:00
Michael Stack fe47ec81f9 HBASE-16969 RegionCoprocessorServiceExec should override the toString() for debugging (ChiaPing Tsai) 2016-10-31 14:32:59 -07:00
tedyu 861880b86b HBASE-16971 The passed durability of Append/Increment isn't used in wal sync (ChiaPing Tsai) 2016-10-31 09:50:47 -07:00
tedyu c3bb3b35c5 HBASE-16946 Provide Raw scan as an option in VerifyReplication (Sreekar Pallapothu) 2016-10-31 09:08:36 -07:00
anoopsamjohn 79073cd40c HBASE-16747 Track memstore data size and heap overhead separately - Addendum to fix TestIOFencing. 2016-10-31 11:05:36 +05:30
daoye.ch 6ce05d44e5 HBASE-16954 Unify HTable#checkAndDelete with AP (ChiaPing Tsai) 2016-10-31 09:15:29 +08:00
anoopsamjohn ba6d952324 HBASE-16747 Track memstore data size and heap overhead separately. 2016-10-30 12:20:46 +05:30
zhangduo 6127753b65 HBASE-16891 Try copying to the Netty ByteBuf directly from the WALEdit 2016-10-29 23:30:52 +08:00
Mikhail Antonov 17dfa34cfb HBASE-16743 TestSimpleRpcScheduler#testCoDelScheduling is broke 2016-10-28 16:47:10 -07:00
zhangduo 3283bc7c91 HBASE-16835 Revisit the zookeeper usage at client side 2016-10-28 13:27:41 +08:00
Stephen Yuan Jiang e108a4f815 HBASE-14551 Procedure v2 - Reimplement split (Stephen Yuan Jiang) 2016-10-27 21:45:41 -07:00
Guanghao Zhang 7b74dd0374 HBASE-16947 Some improvements for DumpReplicationQueues tool 
Signed-off-by: Michael Stack <stack@apache.org>
 2016-10-27 10:12:26 -07:00
tedyu d35b65883c HBASE-16886 hbase-client: scanner with reversed=true and small=true gets no result (huzheng) 2016-10-27 06:54:13 -07:00
Apekshit Sharma a3f1490601 HBASE-16950 Print raw stats in the end of proc performance tools for parsing results from scripts. 
Change-Id: I45d77e838689dde7ec596de26ae98bd62e1b727e
 2016-10-27 00:04:24 -07:00
Michael Stack 8d9b9dc6b7 HBASE-16948 Fix inconsistency between HRegion and Region javadoc on getRowLock 2016-10-26 16:09:43 -07:00
zhangduo cd3dd6e018 HBASE-16932 Implement small scan 2016-10-26 17:26:58 +08:00
zhangduo 5cee6a39c2 Revert "Implement small scan" due to miss issue number 
This reverts commit c7c45f2c85.
 2016-10-26 17:22:50 +08:00
Ramkrishna 1eae9aeeac HBASE-16783 Use ByteBufferPool for the header and message during Rpc 
response (Ram)
 2016-10-26 14:33:49 +05:30
zhangduo c7c45f2c85 Implement small scan 2016-10-26 15:45:02 +08:00
Michael Stack bbe88d942e HBASE-16944 Fix findbugs warning in hbase-server HRegion UL_UNRELEASED_LOCK 2016-10-25 14:44:11 -07:00
Guanghao Zhang c4be87d050 HBASE-16939 ExportSnapshot: set owner and permission on right directory 
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
 2016-10-25 14:08:44 -07:00
zhangduo caa1a8494a HBASE-15709 Handle large edits for asynchronous WAL 2016-10-25 13:46:01 +08:00
Michael Stack 4533bb63cf Revert "Revert "HBASE-15789 PB related changes to work with offheap"" 
Restore this change but with a clean of the generated dirs first so
that we avoid trying to apply a patch on top of an already patched src.

This reverts commit 0f384158fc.
 2016-10-24 16:51:50 -07:00
anoopsamjohn 988d1f9bc9 HBASE-16608 Introducing the ability to merge ImmutableSegments without copy-compaction or SQM usage. (Anastasia) 2016-10-24 23:09:48 +05:30
tedyu 1b12a60392 HBASE-16930 AssignmentManager#checkWals() function can recur infinitely (Umesh Agashe) 2016-10-24 10:10:03 -07:00