zhangduo
01d3473bf0
HBASE-16984 Implement getScanner
2016-11-25 20:32:35 +08:00
anoopsamjohn
86e17858f7
HBASE-15786 Create DBB backed MSLAB pool.
2016-11-24 20:47:41 +05:30
binlijin
a45b3c3533
HBASE-17144 Possible offheap read ByteBuffers leak
2016-11-24 16:12:20 +08:00
tedyu
9f5b8a83b7
HBASE-17158 Avoid deadlock caused by HRegion#doDelta (ChiaPing Tsai)
2016-11-23 07:05:46 -08:00
Michael Stack
511398f43a
HBASE-17166 ITBLL fails on master unable to find hbase-protocol-shaded content
2016-11-22 19:45:20 -08:00
zhangduo
47a4e3437b
HBASE-17132 Cleanup deprecated code for WAL
2016-11-22 18:27:41 +08:00
Jingcheng Du
92b494f117
HBASE-17157 Increase the default mergeable threshold for mob compaction
2016-11-22 17:39:10 +08:00
zhangduo
6ff19f94fe
HBASE-17141 Introduce a more user-friendly implementation of AsyncTable
2016-11-22 14:44:51 +08:00
Jingcheng Du
b297f2dae1
HBASE-17095 The ClientSimpleScanner keeps retrying if the hfile is corrupt or cannot found
2016-11-22 11:18:00 +08:00
tedyu
7ff7b88db5
HBASE-17123 Add postBulkLoadHFile variant that notifies the final paths for the hfiles - addendum calls existing BaseRegionObserver#postBulkLoadHFile()
2016-11-21 06:49:18 -08:00
anoopsamjohn
549c8d835a
HBASE-17139 Remove sweep tool related configs from hbase-default.xml.
2016-11-21 15:54:31 +05:30
tedyu
768b4119da
HBASE-17123 Add postBulkLoadHFile variant that notifies the final paths for the hfiles
2016-11-20 09:26:42 -08:00
tedyu
bb645bcfda
HBASE-17131 Avoid livelock caused by HRegion#processRowsWithLocks (ChiaPing Tsai)
2016-11-20 07:09:02 -08:00
anoopsamjohn
a3a56b6380
HBASE-16989 RowProcess#postBatchMutate doesn’t be executed before the mvcc transaction completion. (ChiaPing Tsai)
2016-11-19 12:32:49 +05:30
Guanghao Zhang
fa7ed58e1b
HBASE-17088 Refactor RWQueueRpcExecutor/BalancedQueueRpcExecutor/RpcExecutor
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-11-19 14:17:45 +08:00
Esteban Gutierrez
7c6e839f6a
HBASE-17058 Lower epsilon used for jitter verification from HBASE-15324
2016-11-17 11:11:30 -08:00
Devaraj Das
5753d18c70
HBASE-16956 Refactor FavoredNodePlan to use regionNames as keys (Thiruvel Thirumoolan)
2016-11-17 10:09:48 -08:00
tedyu
4c7eac8977
HBASE-17112 Prevent setting timestamp of delta operations the same as previous value's (Phil Yang)
2016-11-17 09:03:48 -08:00
tedyu
f6fc94ede9
HBASE-17118 StoreScanner leaked in KeyValueHeap (binlijin)
2016-11-17 07:52:52 -08:00
tedyu
b9319496bc
HBASE-17120 TestAssignmentListener#testAssignmentListener fails (ChiaPing Tsai)
2016-11-17 07:48:52 -08:00
zhangduo
ab55bad899
HBASE-17085 AsyncFSWAL may issue unnecessary AsyncDFSOutput.sync
2016-11-17 15:10:19 +08:00
thiruvel
80acc2dca5
HBASE-16169: Make RegionSizeCalculator scalable
...
Signed-off-by: Michael Stack <stack@apache.org>
2016-11-16 23:07:14 -08:00
anoopsamjohn
4d1bff9e78
HBASE-17073 Increase the max number of buffers in ByteBufferPool.
2016-11-15 11:23:03 +05:30
tedyu
c7bdb3017f
HBASE-17092 Both LoadIncrementalHFiles#doBulkLoad() methods should set return value
2016-11-14 17:30:55 -08:00
Andrew Purtell
dcf03b32f4
HBASE-17044 Fix merge failed before creating merged region leaves meta inconsistent
2016-11-14 17:23:27 -08:00
anoopsamjohn
c3685760f0
HBASE-15788 Use Offheap ByteBuffers from BufferPool to read RPC requests.
2016-11-14 23:05:05 +05:30
tedyu
9250bf8091
HBASE-17037 Enhance LoadIncrementalHFiles API to convey loaded files
2016-11-13 07:02:18 -08:00
tedyu
dba7ec1b69
HBASE-17077 Don't copy the replication queue belonging to the peer which has been deleted (Guanghao Zhang)
2016-11-13 06:58:39 -08:00
tedyu
5e91b45b16
HBASE-17062 RegionSplitter throws ClassCastException (Jeongdae Kim)
2016-11-11 07:15:03 -08:00
zhangduo
8a6d6aa239
HBASE-16838 Implement basic scan
2016-11-11 21:01:16 +08:00
anoopsamjohn
fa838b020d
HBASE-17071 Do not initialize MemstoreChunkPool when use mslab option is turned off.
2016-11-11 16:44:34 +05:30
thiruvel
f9c6b66b95
HBASE-16962: Add readPoint to preCompactScannerOpen() and preFlushScannerOpen APIs
...
Signed-off-by: anoopsamjohn <anoopsamjohn@gmail.com>
2016-11-11 11:07:22 +05:30
Apekshit Sharma
62e3b1ece6
HBASE-17063 Cleanup TestHRegion : remove duplicate variables for method name and two unused params in initRegion
...
- Replaces local tablename and method names in individual tests with those initialized in setup() function
- Remove unused params from initHRegion().
Change-Id: Id0fe25890c833f7cc9b91277d5015480a007d788
2016-11-10 17:21:06 -08:00
Guanghao Zhang
12eec5bc5d
HBASE-16938 TableCFsUpdater maybe failed due to no write permission on peerNode
...
Signed-off-by: Enis Soztutar <enis@apache.org>
2016-11-10 14:04:28 -08:00
Yu Sun
fb4c50966e
HBASE-17020 keylen in midkey() dont computed correctly
...
Signed-off-by: Yu Li <liyu@apache.org>
2016-11-10 17:15:34 +08:00
binlijin
7f08cd0e10
HBASE-16570 Compute region locality in parallel at startup (addendum)
...
Addendum mainly for:
1. Avoid interfering with block location cache in RegionLocationFinder
2. Avoid refreshing block lcoations during HMaster startup (or else the startup could be really slow)
Signed-off-by: Yu Li <liyu@apache.org>
2016-11-10 16:53:07 +08:00
zhangduo
e5a288e5c0
HBASE-17053 Remove LogRollerExitedChecker
2016-11-10 10:52:49 +08:00
Michael Stack
8192a6b6ee
Revert "HBASE-16993 BucketCache throw java.io.IOException: Invalid HFile block magic when DATA_BLOCK_ENCODING set to DIFF"
...
Revert of premature push.
This reverts commit de3a51263d
.
2016-11-09 17:08:14 -08:00
Guanghao Zhang
1462cf77ef
HBASE-16985 TestClusterId failed due to wrong hbase rootdir
...
Signed-off-by: Michael Stack <stack@apache.org>
2016-11-09 17:06:58 -08:00
Michael Stack
de3a51263d
HBASE-16993 BucketCache throw java.io.IOException: Invalid HFile block magic when DATA_BLOCK_ENCODING set to DIFF
2016-11-09 17:00:30 -08:00
tedyu
287358ba6c
HBASE-17054 Compactor#preCreateCoprocScanner should be passed user
2016-11-09 06:57:43 -08:00
Charlie Qiangeng Xu
3b63f701e6
HBASE-17039 SimpleLoadBalancer schedules large amount of invalid region moves
...
Signed-off-by: Yu Li <liyu@apache.org>
2016-11-09 17:04:16 +08:00
Enis Soztutar
03bc884ea0
HBASE-17017 Remove the current per-region latency histogram metrics
2016-11-08 18:31:53 -08:00
zhangduo
3b629d632a
HBASE-17021 Use RingBuffer to reduce the contention in AsyncFSWAL
2016-11-09 09:24:12 +08:00
Michael Stack
0998af01df
Revert "Revert "HBASE-16983 TestMultiTableSnapshotInputFormat failing with Unable to create region directory: /tmp/... (Addendum by Guanghao Zhang)""
...
This is a revert of a revert, i.e. puts back the change only I added
HBaseCommonTestingUtility#getRandomDir from branch-1 too since
missing in master branch.
This reverts commit 9afcb4366d
.
2016-11-08 12:55:48 -08:00
Apekshit Sharma
52241c90e4
HBASE-16982 Better integrate Apache CLI in AbstractHBaseTool.
...
- processOldArgs() in AbstractHBaseTool will make it possible to change existing tools to use Apache CLI in a backward compatible manner.
- Changes ExportSnapshot tool as a proof-of-concept
- Update version of Apache CLI from 1.2 to 1.3.1
Change-Id: I4bb2e7da4f2ed0e12e28621ab16459309fa36d03
2016-11-08 12:21:29 -08:00
Michael Stack
9afcb4366d
Revert "HBASE-16983 TestMultiTableSnapshotInputFormat failing with Unable to create region directory: /tmp/... (Addendum by Guanghao Zhang)"
...
This reverts commit f9c23f5e9d
.
2016-11-08 12:15:36 -08:00
Michael Stack
f9c23f5e9d
HBASE-16983 TestMultiTableSnapshotInputFormat failing with Unable to create region directory: /tmp/... (Addendum by Guanghao Zhang)
2016-11-08 12:00:51 -08:00
Matteo Bertozzi
b143f6e4a3
HBASE-17030 Procedure v2 - A couple of tweaks to the SplitTableRegionProcedure
2016-11-08 10:30:33 -08:00
tedyu
76814e8451
HBASE-17010 Serial replication should handle daughter regions being assigned to another RS (Phil Yang)
2016-11-08 06:25:50 -08:00
Stephen Yuan Jiang
0512b4d015
HBASE-17042 Remove 'public' keyword from MasterObserver interface (Stephen Yuan Jiang)
2016-11-07 17:50:58 -08:00
Enis Soztutar
59d7b47e60
HBASE-17033 LogRoller makes a lot of allocations unnecessarily
2016-11-07 14:18:00 -08:00
anoopsamjohn
2182ca34ac
HBASE-16992 The usage of mutation from CP is weird. (ChiaPing Tsai)
2016-11-07 23:24:34 +05:30
Michael Stack
e60a7f6e7d
HBASE-15513 hbase.hregion.memstore.chunkpool.maxsize is 0.0 by default (Addendum by Anoop Sam John)
2016-11-07 09:33:01 -08:00
Michael Stack
97ce30d47e
Revert "Revert "HBASE-15513 hbase.hregion.memstore.chunkpool.maxsize is 0.0 by default (Vladimir Rodionov)""
...
This is a revert of a revert.
This reverts commit fd6b0b3dbf
.
2016-11-07 09:31:44 -08:00
Michael Stack
fd6b0b3dbf
Revert "HBASE-15513 hbase.hregion.memstore.chunkpool.maxsize is 0.0 by default (Vladimir Rodionov)"
...
This reverts commit 8b4bb34ec2
.
2016-11-07 09:07:02 -08:00
tedyu
f3bed5b0d9
HBASE-17026 VerifyReplication log should distinguish whether good row key is result of revalidation
2016-11-07 07:38:47 -08:00
binlijin
e8e658ed38
HBASE-16840 Reuse cell's timestamp and type in ScanQueryMatcher
...
Signed-off-by: Yu Li <liyu@apache.org>
2016-11-07 22:40:18 +08:00
Yu Li
e33fd427e4
Revert "HBASE-16840 Reuse cell's timestamp and type in ScanQueryMatcher" to update author
...
This reverts commit 28de528c6e
.
2016-11-07 22:40:02 +08:00
Yu Li
28de528c6e
HBASE-16840 Reuse cell's timestamp and type in ScanQueryMatcher
...
Signed-off-by: Yu Li <liyu@apache.org>
2016-11-07 21:33:37 +08:00
Jingcheng Du
4ca668dd11
HBASE-17005 Improve log message in MobFileCache (huaxiang sun)
2016-11-07 16:38:14 +08:00
Mikhail Antonov
a34a9adb22
HBASE-17032 CallQueueTooBigException and CallDroppedException should not be triggering PFFE
2016-11-06 21:44:59 -08:00
Michael Stack
8b4bb34ec2
HBASE-15513 hbase.hregion.memstore.chunkpool.maxsize is 0.0 by default (Vladimir Rodionov)
2016-11-06 21:43:02 -08:00
Matteo Bertozzi
7e05d0f161
HBASE-16937 Replace SnapshotType protobuf conversion when we can directly use the pojo object
2016-11-04 13:18:34 -07:00
Matteo Bertozzi
00ea7aeafe
HBASE-16892 Use TableName instead of String in SnapshotDescription
2016-11-04 13:18:10 -07:00
Matteo Bertozzi
efe0a0eead
HBASE-16865 Procedure v2 - Inherit lock from root proc
2016-11-04 13:17:40 -07:00
anoopsamjohn
05ee54f665
HBASE-17013 Add constructor to RowMutations for initializing the capacity of internal list. (ChiaPing Tsai)
2016-11-04 10:34:20 +05:30
Apekshit Sharma
bb0fc6b602
HBASE-17006 Give name to existing threads.
...
Having thread names in logs and thread dumps greatly improve debugability. This patch is simply adding the names to the threads we spawn.
Change-Id: I6ff22cc3804bb81147dde3a8e9ab671633c6f6ce
2016-11-03 18:28:19 -07:00
Eddie Elizondo
f61ae6f06d
HBASE-14329 Report region in transition should check all regions in request
...
Signed-off-by: Gary Helmling <garyh@apache.org>
2016-11-03 11:16:57 -07:00
Umesh Agashe
281bf9a222
HBASE-17014 Added clearly marked log messages for start and shutdown of services HMaster, HRegionServer, ThriftServer, RESTServer. Also changed the log level for RPCServer responder starting log message to debug.
...
Signed-off-by: Michael Stack <stack@apache.org>
2016-11-03 11:09:55 -07:00
Gary Helmling
e820e64272
HBASE-16964 Always clear successfully archived files from compacted files list
2016-11-03 09:09:08 -07:00
tedyu
c82fc6e0b2
HBASE-16975 Disable two subtests of TestSerialReplication (Phil Yang)
2016-11-03 01:55:26 -07:00
Yu Li
b1d1dc8569
HBASE-16972 Log more details for Scan#next request when responseTooSlow
2016-11-02 15:02:07 +08:00
binlijin
6b957b69a7
HBASE-16960 RegionServer hang when aborting
...
Signed-off-by: Yu Li <liyu@apache.org>
2016-11-02 11:59:51 +08:00
Lars Hofhansl
b7293bf5ad
HBASE-16765 New SteppingRegionSplitPolicy, avoid too aggressive spread of regions for small tables.
2016-11-01 13:12:21 -07:00
Lars Hofhansl
1c07d1d591
Revert "New SteppingRegionSplitPolicy, avoid too aggressive spread of regions for small tables."
...
This reverts commit 791052c50a
.
2016-11-01 13:11:31 -07:00
Lars Hofhansl
791052c50a
New SteppingRegionSplitPolicy, avoid too aggressive spread of regions for small tables.
2016-11-01 12:21:51 -07:00
Michael Stack
26cbe44337
HBASE-16983 TestMultiTableSnapshotInputFormat failing with Unable to
...
create region directory: /tmp/...
2016-10-31 21:57:48 -07:00
zhangduo
6cf9333e97
HBASE-16945 Implement AsyncRegionLocator
2016-11-01 10:18:55 +08:00
zhangduo
45a2594249
HBASE-16968 Refactor FanOutOneBlockAsyncDFSOutput
2016-11-01 09:19:02 +08:00
Michael Stack
d0be36deb7
HBASE-16966 Re-enable TestSimpleRpcScheduler#testCoDelScheduling in master branch
2016-10-31 14:40:51 -07:00
Michael Stack
fe47ec81f9
HBASE-16969 RegionCoprocessorServiceExec should override the toString() for debugging (ChiaPing Tsai)
2016-10-31 14:32:59 -07:00
tedyu
861880b86b
HBASE-16971 The passed durability of Append/Increment isn't used in wal sync (ChiaPing Tsai)
2016-10-31 09:50:47 -07:00
tedyu
c3bb3b35c5
HBASE-16946 Provide Raw scan as an option in VerifyReplication (Sreekar Pallapothu)
2016-10-31 09:08:36 -07:00
anoopsamjohn
79073cd40c
HBASE-16747 Track memstore data size and heap overhead separately - Addendum to fix TestIOFencing.
2016-10-31 11:05:36 +05:30
daoye.ch
6ce05d44e5
HBASE-16954 Unify HTable#checkAndDelete with AP (ChiaPing Tsai)
2016-10-31 09:15:29 +08:00
anoopsamjohn
ba6d952324
HBASE-16747 Track memstore data size and heap overhead separately.
2016-10-30 12:20:46 +05:30
zhangduo
6127753b65
HBASE-16891 Try copying to the Netty ByteBuf directly from the WALEdit
2016-10-29 23:30:52 +08:00
Mikhail Antonov
17dfa34cfb
HBASE-16743 TestSimpleRpcScheduler#testCoDelScheduling is broke
2016-10-28 16:47:10 -07:00
zhangduo
3283bc7c91
HBASE-16835 Revisit the zookeeper usage at client side
2016-10-28 13:27:41 +08:00
Stephen Yuan Jiang
e108a4f815
HBASE-14551 Procedure v2 - Reimplement split (Stephen Yuan Jiang)
2016-10-27 21:45:41 -07:00
Guanghao Zhang
7b74dd0374
HBASE-16947 Some improvements for DumpReplicationQueues tool
...
Signed-off-by: Michael Stack <stack@apache.org>
2016-10-27 10:12:26 -07:00
tedyu
d35b65883c
HBASE-16886 hbase-client: scanner with reversed=true and small=true gets no result (huzheng)
2016-10-27 06:54:13 -07:00
Apekshit Sharma
a3f1490601
HBASE-16950 Print raw stats in the end of proc performance tools for parsing results from scripts.
...
Change-Id: I45d77e838689dde7ec596de26ae98bd62e1b727e
2016-10-27 00:04:24 -07:00
Michael Stack
8d9b9dc6b7
HBASE-16948 Fix inconsistency between HRegion and Region javadoc on getRowLock
2016-10-26 16:09:43 -07:00
zhangduo
cd3dd6e018
HBASE-16932 Implement small scan
2016-10-26 17:26:58 +08:00
zhangduo
5cee6a39c2
Revert "Implement small scan" due to miss issue number
...
This reverts commit c7c45f2c85
.
2016-10-26 17:22:50 +08:00
Ramkrishna
1eae9aeeac
HBASE-16783 Use ByteBufferPool for the header and message during Rpc
...
response (Ram)
2016-10-26 14:33:49 +05:30
zhangduo
c7c45f2c85
Implement small scan
2016-10-26 15:45:02 +08:00
Michael Stack
bbe88d942e
HBASE-16944 Fix findbugs warning in hbase-server HRegion UL_UNRELEASED_LOCK
2016-10-25 14:44:11 -07:00
Guanghao Zhang
c4be87d050
HBASE-16939 ExportSnapshot: set owner and permission on right directory
...
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2016-10-25 14:08:44 -07:00
zhangduo
caa1a8494a
HBASE-15709 Handle large edits for asynchronous WAL
2016-10-25 13:46:01 +08:00
Michael Stack
4533bb63cf
Revert "Revert "HBASE-15789 PB related changes to work with offheap""
...
Restore this change but with a clean of the generated dirs first so
that we avoid trying to apply a patch on top of an already patched src.
This reverts commit 0f384158fc
.
2016-10-24 16:51:50 -07:00
anoopsamjohn
988d1f9bc9
HBASE-16608 Introducing the ability to merge ImmutableSegments without copy-compaction or SQM usage. (Anastasia)
2016-10-24 23:09:48 +05:30
tedyu
1b12a60392
HBASE-16930 AssignmentManager#checkWals() function can recur infinitely (Umesh Agashe)
2016-10-24 10:10:03 -07:00
binlijin
fa3cbd1d80
HBASE-16931 Setting cell's seqId to zero in compaction flow might cause RS down.
...
Signed-off-by: Yu Li <liyu@apache.org>
2016-10-24 23:32:38 +08:00
Ramkrishna
3584537b07
HBASE-16463 Improve transparent table/CF encryption with Commons Crypto
...
(Dapeng Sun)
2016-10-24 16:22:30 +05:30
tedyu
97cb1d71bc
HBASE-16929 Move default method of shipped to Shipper interface - revert pending finding cause for Phoenix compilation error
2016-10-24 01:39:02 -07:00
zhangduo
2f4c91e41a
HBASE-15684 Fix the broken log file size accounting
2016-10-22 17:42:09 +08:00
tedyu
ac415f85f3
HBASE-16929 Move default method of shipped to Shipper interface
2016-10-21 17:23:07 -07:00
Guanghao Zhang
6415137574
HBASE-16815 Low scan ratio in RPC queue tuning triggers divide by zero exception
...
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2016-10-21 16:59:55 -07:00
tedyu
e223639671
HBASE-16910 Avoid NPE when starting StochasticLoadBalancer (Guanghao Zhang)
2016-10-21 10:25:42 -07:00
Ramkrishna
0ae211eb39
HBASE-16414 Improve performance for RPC encryption with Apache Common
...
Crypto (Colin Ma)
2016-10-21 16:02:39 +05:30
Ashu Pachauri
f1691e3d0d
HBASE-16752 addendum. Do not retry large request for client versions less than 1.3
...
Signed-off-by: Gary Helmling <garyh@apache.org>
2016-10-20 10:34:01 -07:00
Guanghao Zhang
59857a41ea
HBASE-16870 ADDENDUM fix failed TestReplicationSmallTests
2016-10-20 20:02:12 +08:00
zhangduo
b2a7f31a06
Revert "HBASE-16870 ADDENDUM fix failed TestReplicationSmallTests"
...
This reverts commit c02b672e83
.
2016-10-20 16:14:34 +08:00
Guanghao Zhang
c02b672e83
HBASE-16870 ADDENDUM fix failed TestReplicationSmallTests
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-10-20 14:36:23 +08:00
zhangduo
ddc84356dd
HBASE-16872 Implement mutateRow and checkAndMutate
2016-10-20 09:40:05 +08:00
Ashu Pachauri
ee1123b069
HBASE-16752 Return error back to rpc client on exceeding rpc request size limit.
...
Signed-off-by: Gary Helmling <garyh@apache.org>
2016-10-19 15:09:51 -07:00
tedyu
674511875d
HBASE-16870 Add the metrics of replication sources which were transformed from other dead rs to ReplicationLoad (Guanghao Zhang)
2016-10-19 14:54:35 -07:00
Huaxiang Sun
72db953886
HBASE-16345 RpcRetryingCallerWithReadReplicas#call() should catch some RegionServer Exceptions
...
Fix logic for
1). how to handle exception while waiting for reply from the primary replica.
2). handle exception from replicas while waiting for a correct response.
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2016-10-19 13:55:43 -07:00
Matteo Bertozzi
d9ee25e82a
HBASE-16874 Fix TestMasterFailoverWithProcedures and ensure single proc-executor for kill/restart tests
2016-10-19 13:25:17 -07:00
Jingcheng Du
67f1ac1f8e
HBASE-16578 Mob data loss after mob compaction and normal compaction
2016-10-19 13:58:54 +08:00
zhangduo
acc606571b
HBASE-16837 Implement checkAndPut and checkAndDelete
2016-10-19 13:32:24 +08:00
Enis Soztutar
ef8c65e542
HBASE-16824 Writer.flush() can be called on already closed streams in WAL roll
2016-10-18 18:46:02 -07:00
tedyu
bb6cc4d43e
HBASE-16854 Refactor the org.apache.hadoop.hbase.client.Action (ChiaPing Tsai)
2016-10-18 09:47:25 -07:00
Gary Helmling
317136e272
HBASE-16754 All WALSplitter OutputSinks should process compaction events
2016-10-18 09:37:37 -07:00
Esteban Gutierrez
5bc518b387
HBASE-16774 [shell] Add coverage to TestShell when ZooKeeper is not reachable
2016-10-18 09:08:33 -07:00
Michael Stack
0d40a52ee8
Revert "Revert "HBASE-16698 Performance issue: handlers stuck waiting for CountDownLatch inside WALKey#getWriteEntry under high writing workload; ADDENDUM. Fix findbugs""
...
This reverts commit f555b5be9c
.
A revert of a revert
2016-10-18 08:35:45 -07:00
Michael Stack
ec1adb7baa
Revert "Revert "HBASE-16698 Performance issue: handlers stuck waiting for CountDownLatch inside WALKey#getWriteEntry under high writing workload""
...
This reverts commit 13baf4d37a
.
This is a revert of a revert.
2016-10-18 08:34:29 -07:00
zhangduo
b4f6ebde24
HBASE-16836 Implement increment and append
2016-10-18 22:34:14 +08:00
tedyu
10840a51e8
HBASE-16145 MultiRowRangeFilter constructor shouldn't throw IOException (Konstantin Ryakhovskiy)
2016-10-17 16:06:10 -07:00
tedyu
0c304a049b
HBASE-16283 Batch Append/Increment will always fail if set ReturnResults to false (Allan Yang)
2016-10-17 15:42:06 -07:00
Matteo Bertozzi
c6e9dabe62
HBASE-16846 Procedure v2 - executor cleanup
2016-10-17 10:30:59 -07:00
tedyu
2786253120
HBASE-16856 Exception message in SyncRunner.run() should print currentSequence (Allan Yang)
2016-10-17 07:19:49 -07:00
Ramkrishna
1e3d8c8226
HBASE-16792 Reuse KeyValue.KeyOnlyKeyValue in
...
BufferedDataBlockEncoder.SeekerState (Binlijin)
2016-10-17 12:26:36 +05:30
Ramkrishna
bda5fd5a11
HBASE-16792 - reverting to change commit message
2016-10-17 12:25:13 +05:30
zhangduo
3a0dbf71a9
HBASE-16834 Add AsyncConnection support for ConnectionFactory
2016-10-17 13:08:43 +08:00
tedyu
109db38b6a
HBASE-16853 Regions are assigned to Region Servers in /hbase/draining after HBase Master failover (David Pope)
2016-10-16 19:59:38 -07:00
Michael Stack
0f384158fc
Revert "HBASE-15789 PB related changes to work with offheap"
...
This reverts commit fb15e3d4f5
.
Breaks the build
2016-10-15 18:44:00 -07:00
Michael Stack
fb15e3d4f5
HBASE-15789 PB related changes to work with offheap
...
Adds means of patching our shaded protobuf. Does it using
the Anoop patch attached to HBASE-15789 that adds ByteInput
to protobuf. This patch gets applied after protobuf has been
downloaded, relocated, and then unpacked over src/main/java.
Also fixes a few small build WARNINGs because of duplicate
mentions of dependencies.
2016-10-15 10:02:23 -07:00
Stephen Yuan Jiang
b972839ca1
HBASE-16844 Procedure V2: DispatchMergingRegionsProcedure to use base class StateMachineProcedure for abort and rollback (Stephen Yuan Jiang)
2016-10-14 14:09:35 -07:00
Matteo Bertozzi
62c84115ec
HBASE-16839 Procedure v2 - Move all protobuf handling to ProcedureUtil
2016-10-14 11:32:28 -07:00
Michael Stack
13baf4d37a
Revert "HBASE-16698 Performance issue: handlers stuck waiting for CountDownLatch inside WALKey#getWriteEntry under high writing workload"
...
Premature commit. Revert while discussion still ongoing.
This reverts commit 9b13514483
.
2016-10-14 11:27:05 -07:00
Michael Stack
f555b5be9c
Revert "HBASE-16698 Performance issue: handlers stuck waiting for CountDownLatch inside WALKey#getWriteEntry under high writing workload; ADDENDUM. Fix findbugs"
...
Premature commit. Revert while discussion ongoing
This reverts commit e1923b7c0c
.
2016-10-14 11:26:33 -07:00
Ramkrishna
635ea05b9a
HBASE-16729 Define the behavior of (default) empty FilterList(ChiaPing
...
Tsai)
2016-10-14 23:14:33 +05:30
anoopsamjohn
5f75fa0c4f
HBASE-16799 CP exposed Store should not expose unwanted APIs.
2016-10-14 22:16:54 +05:30
tedyu
39d43ab779
HBASE-16821 Enhance LoadIncrementalHFiles API to convey missing hfiles if any
2016-10-14 09:07:38 -07:00
zhangduo
3fe7508295
HBASE-15921 Add first AsyncTable impl and create TableImpl based on it
2016-10-14 22:52:52 +08:00
Ramkrishna
4127fd2a7c
iHBASE-16792 Reuse KeyValue.KeyOnlyKeyValue in
...
BufferedDataBlockEncoder.SeekerState (Binlijin)
2016-10-14 17:52:24 +05:30
Michael Stack
e1923b7c0c
HBASE-16698 Performance issue: handlers stuck waiting for CountDownLatch inside WALKey#getWriteEntry under high writing workload; ADDENDUM. Fix findbugs
2016-10-13 17:16:47 -07:00
Michael Stack
9b13514483
HBASE-16698 Performance issue: handlers stuck waiting for CountDownLatch inside WALKey#getWriteEntry under high writing workload
2016-10-13 09:25:23 -07:00
Pankaj Kumar
c9c67d1a94
HBASE-16724 Snapshot owner can't clone
...
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
2016-10-13 17:20:52 +05:30
Pankaj Kumar
90d83d5b38
HBASE-16807, RegionServer will fail to report new active Hmaster until HMaster/RegionServer failover.
...
Signed-off-by: chenheng <chenheng@apache.org>
2016-10-13 18:00:57 +08:00
Phil Yang
88ff71b91b
HBASE-16664 Timeout logic in AsyncProcess is broken
...
Signed-off-by: chenheng <chenheng@apache.org>
2016-10-13 16:15:43 +08:00
Matteo Bertozzi
92ef234486
HBASE-16813 Procedure v2 - Move ProcedureEvent to hbase-procedure module
2016-10-12 16:33:25 -07:00
Michael Stack
dfb2a800c4
HBASE-16746 The log of “region close” should differ from “region move” (ChiaPing Tsai)
2016-10-12 16:08:25 -07:00
tedyu
f4bdab8bac
HBASE-16810 HBase Balancer throws ArrayIndexOutOfBoundsException when regionservers are in /hbase/draining znode and unloaded (David Pope)
2016-10-12 13:23:06 -07:00
Phil Yang
b8173a548c
HBASE-16505 Pass deadline to HRegion operations
...
Signed-off-by: Michael Stack <stack@apache.org>
2016-10-12 12:16:18 -07:00
Matteo Bertozzi
e868d9586f
HBASE-16735 Procedure v2 - Fix yield while holding locks
2016-10-12 12:14:36 -07:00
Michael Stack
a46134bffc
HBASE-16731 Inconsistent results from the Get/Scan if we use the empty FilterList (ChiaPing Tsai)
2016-10-12 12:13:41 -07:00
tedyu
996d631c62
HBASE-16801 The Append/Increment may return the data from future - addendum (ChiaPing Tsai)
2016-10-12 10:06:51 -07:00
anoopsamjohn
f77ff9f96f
HBASE-16809 Save one cell length calculation in HeapMemStoreLAB#copyCellInto. (binlijin)
2016-10-12 09:57:23 +05:30
Pankaj Kumar
0af10f8942
HBASE-16663 JMX ConnectorServer stopped when unauthorized user try to stop HM/RS/cluster
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2016-10-11 17:54:19 -07:00
Apekshit Sharma
eb52e26822
HBASE-16811 Remove mob sweep job.
...
Change-Id: If849fdcafb8af4a9765be1eb80da77f8b3f29a1a
2016-10-11 16:37:47 -07:00
tedyu
ec87b4bfe2
HBASE-15109 HM/RS failed to start when "fs.hdfs.impl.disable.cache" is set to true (Pankaj Kumar)
2016-10-11 15:37:26 -07:00
tedyu
fef3c908d3
HBASE-16803 Make hbase:acl table unsplittable - revert pending review comments
2016-10-11 12:52:32 -07:00
tedyu
bbc2746267
HBASE-16803 Make hbase:acl table unsplittable
2016-10-11 12:48:14 -07:00
Gary Helmling
bc7e034052
HBASE-16788 addendum Account for HStore archiveLock in heap size
2016-10-11 10:57:13 -07:00
tedyu
4d09116695
HBASE-16716 OfflineMetaRepair leaves empty directory inside /hbase/WALs which remains forever (Pankaj Kumar)
2016-10-11 07:19:54 -07:00
tedyu
0f21c41eda
HBASE-16801 The Append/Increment may return the data from future (Chiaping Tsai)
2016-10-10 18:31:31 -07:00
Gary Helmling
7493e79f15
HBASE-16788 Guard HFile archiving under a separate lock
2016-10-10 15:58:12 -07:00
Dustin Pho
fcef2c02c9
HBASE-16661 Add last major compaction age to per-region metrics
...
Signed-off-by: Gary Helmling <garyh@apache.org>
2016-10-10 15:16:12 -07:00
Huaxiang Sun
341f049e77
HBASE-16699 Overflows in AverageIntervalRateLimiter's refill() and getWaitInterval()
...
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2016-10-10 14:07:00 -07:00
Huaxiang Sun
c930bc92f4
HBASE-16767 Mob compaction needs to clean up temporary files in face of IOExceptions.
...
1). Fix resource leak issue upon exception during mob compaction.
2). Reorg the code in compactMobFilesInBatch() to make it more readable.
Signed-off-by: Jonathan M Hsieh <jmhsieh@apache.org>
2016-10-10 14:48:24 -05:00
Sean Busbey
932a1964bf
Revert "1). Fix resource leak issue upon exception during mob compaction. 2). Reorg the code in compactMobFilesInBatch() to make it more readable."
...
This reverts commit c7cae6be3d
.
Missing JIRA ID
2016-10-10 14:47:46 -05:00
Sean Busbey
6b6a801876
HBASE-16701 rely on test category timeout instead of defining one on a specific test.
...
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Yu Li <liyu@apache.org>
2016-10-10 00:14:38 -05:00
tedyu
ccde439392
HBASE-16771 VerifyReplication should increase GOODROWS counter if re-comparison passes
2016-10-09 20:48:28 -07:00
ChiaPing Tsai
8a8c60889c
HBASE-16794 TestDispatchMergingRegionsProcedure#testMergeRegionsConcurrently is flaky
...
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2016-10-09 16:53:29 -07:00
Matteo Bertozzi
e06c3676f1
HBASE-16791 Fix TestDispatchMergingRegionsProcedure
2016-10-08 15:32:34 -07:00
Matteo Bertozzi
29d701a314
HBASE-16781 Fix flaky TestMasterProcedureWalLease
2016-10-07 18:01:53 -07:00
Huaxiang Sun
c7cae6be3d
1). Fix resource leak issue upon exception during mob compaction. 2). Reorg the code in compactMobFilesInBatch() to make it more readable.
...
Signed-off-by: Jonathan M Hsieh <jmhsieh@apache.org>
2016-10-07 17:49:27 -07:00
Gary Helmling
723d56153f
HBASE-16657 addendum handle null RegionLoad
2016-10-07 13:29:19 -07:00
Dustin Pho
bc9a972451
HBASE-16657 Expose per-region last major compaction time in RegionServer UI
...
Signed-off-by: Gary Helmling <garyh@apache.org>
2016-10-07 09:49:24 -07:00
tedyu
62bc090123
HBASE-16773 AccessController should access local region if possible
2016-10-07 06:22:32 -07:00
tedyu
96d34f2a79
HBASE-16768 Inconsistent results from the Append/Increment (ChiaPing Tsai)
2016-10-07 00:59:27 -07:00
Ashu Pachauri
2c7211ec4b
HBASE-16681: Flaky TestReplicationSourceManagerZkImpl
2016-10-06 16:26:38 -07:00
tedyu
97c1333831
HBASE-16772 Add verbose option to VerifyReplication for logging good rows
2016-10-06 11:16:18 -07:00
Matteo Bertozzi
7a38509782
HBASE-16777 Fix flaky TestMasterProcedureEvents
2016-10-06 07:24:39 -07:00
anoopsamjohn
912ed17286
HBASE-15721 Optimization in cloning cells into MSLAB.
2016-10-06 14:48:03 +05:30
Ramkrishna
58e843dae2
HBASE-16372 References to previous cell in read path should be avoided
...
(Ram)
2016-10-06 14:19:12 +05:30
Matteo Bertozzi
eb33b60a95
HBASE-16778 Move testIllegalTableDescriptor out from TestFromClientSide
2016-10-05 20:04:18 -07:00
Matteo Bertozzi
b548d4978b
HBASE-16776 Remove duplicated versions of countRow() in tests
2016-10-05 19:45:50 -07:00
anoopsamjohn
06758bf630
HBASE-16759 Avoid ByteString.copyFrom usage wherever possible.
2016-10-06 00:27:34 +05:30
zhangduo
3aa4dfa73d
HBASE-16690 Move znode path configs to a separated class
2016-10-05 20:12:44 +08:00
anoopsamjohn
617dfe18cd
HBASE-16758 back HBaseZeroCopyByteStringer stuff.
2016-10-05 12:57:13 +05:30
Mikhail Antonov
5ae516bd63
HBASE-16644 Errors when reading legit HFile Trailer of old (v2.0) format file
2016-10-04 21:10:42 -07:00
Jonathan M Hsieh
0daeb635d0
HBASE-16763 Remove unintentional dependency on net.sf.ehcache.search.Results
2016-10-04 16:40:15 -07:00
tedyu
b952e64751
HBASE-15560 TinyLFU-based BlockCache - revert pending performance verification
2016-10-04 08:37:29 -07:00
tedyu
9e0c2562a9
HBASE-15560 TinyLFU-based BlockCache (Ben Manes)
2016-10-04 05:15:51 -07:00
stack
95c1dc93fb
HBASE-15638 Shade protobuf
...
Which includes
HBASE-16742 Add chapter for devs on how we do protobufs going forward
HBASE-16741 Amend the generate protobufs out-of-band build step
to include shade, pulling in protobuf source and a hook for patching protobuf
Removed ByteStringer from hbase-protocol-shaded. Use the protobuf-3.1.0
trick directly instead. Makes stuff cleaner. All under 'shaded' dir is
now generated.
HBASE-16567 Upgrade to protobuf-3.1.x
Regenerate all protos in this module with protoc3.
Redo ByteStringer to use new pb3.1.0 unsafebytesutil
instead of HBaseZeroCopyByteString
HBASE-16264 Figure how to deal with endpoints and shaded pb Shade our protobufs.
Do it in a manner that makes it so we can still have in our API references to
com.google.protobuf (and in REST). The c.g.p in API is for Coprocessor Endpoints (CPEP)
This patch is Tactic #4 from Shading Doc attached to the referenced issue.
Figuring an appoach took a while because we have Coprocessor Endpoints
mixed in with the core of HBase that are tough to untangle (FIX).
Tactic #4 (the fourth attempt at addressing this issue) is COPY all but
the CPEP .proto files currently in hbase-protocol to a new module named
hbase-protocol-shaded. Generate .protos again in the new location and
then relocate/shade the generated files. Let CPEPs keep on with the
old references at com.google.protobuf.* and
org.apache.hadoop.hbase.protobuf.* but change the hbase core so all
instead refer to the relocated files in their new location at
org.apache.hadoop.hbase.shaded.com.google.protobuf.*.
Let the new module also shade protobufs themselves and change hbase
core to pick up this shaded protobuf rather than directly reference
com.google.protobuf.
This approach allows us to explicitly refer to either the shaded or
non-shaded version of a protobuf class in any particular context (though
usually context dictates one or the other). Core runs on shaded protobuf.
CPEPs continue to use whatever is on the classpath with
com.google.protobuf.* which is pb2.5.0 for the near future at least.
See above cited doc for follow-ons and downsides. In short, IDEs will complain
about not being able to find the shaded protobufs since shading happens at package
time; will fix by checking in all generated classes and relocated protobuf in
a follow-on. Also, CPEPs currently suffer an extra-copy as marshalled from
non-shaded to shaded. To fix. Finally, our .protos are duplicated; once
shaded, and once not. Pain, but how else to reveal our protos to CPEPs or
C++ client that wants to talk with HBase AND shade protobuf.
Details:
Add a new hbase-protocol-shaded module. It is a copy of hbase-protocol
i with all relocated offset from o.a.h.h. to o.a.h.h.shaded. The new module
also includes the relocated pb. It does not include CPEPs. They stay in
their old location.
Add another module hbase-endpoint which has in it all the endpoints
that ship as part of hbase -- at least the ones that are not
entangled with core such as AccessControl and Auth. Move all protos
for these CPEPs here as well as their unit tests (mostly moving a
bunch of stuff out of hbase-server module)
Much of the change looks like this:
-import org.apache.hadoop.hbase.protobuf.ProtobufUtil;
-import org.apache.hadoop.hbase.protobuf.generated.ClusterIdProtos;
+import org.apache.hadoop.hbase.protobuf.shaded.ProtobufUtil;
+import org.apache.hadoop.hbase.shaded.protobuf.generated.ClusterIdProtos;
In HTable and in HBaseAdmin, regularize the way Callables are used and also hide
protobuf usage as much as possible moving it up into Callable super classes or out
to utility classes. Still TODO is adding in of retries, etc., but can wait on
procedure which will redo all this.
Also in HTable and HBaseAdmin as well as in HRegionServer and Server, be explicit
when using non-shaded protobuf. Do the full-path so it is clear. This is around
endpoint coprocessors registration of services and execution of CPEP methods.
Shrunk ProtobufUtil by moving methods used by one CPEP only back to the CPEP either
into Client class or as new Util class; e.g. AccessControlUtil.
There are actually two versions of ProtobufUtil now; a shaded one and a subset
that is used by CPEPs doing non-shaded work.
Made it so hbase-common no longer depends on hbase-protocol (with Matteo's help)
R*Converter classes got moved down under shaded package -- they are for internal
use only. There are no non-shaded versions of these classes.
D hbase-client/src/main/java/org/apache/hadoop/hbase/client/AbstractRegionServerCallable
D RetryingCallableBase
Not used anymore and we have too many tiers of Callables so removed/cleaned-up.
A ClientServicecallable
Had to add this one. RegionServerCallable was made generic so it could be used
for a few Interfaces (Client and Admin). Then added ClientServiceCallable to
implement RegionServerCallable with the Client Interface.
2016-10-03 21:37:32 -07:00
tedyu
b43d1ecf5c
HBASE-16739 Timed out exception message should include encoded region name
2016-10-03 06:46:04 -07:00
tedyu
1c083d9794
HBASE-16739 Timed out exception message should include encoded region name - Revert due to misspelled word in subject
2016-10-03 06:45:44 -07:00
Ramkrishna
7d0a6a82ab
HBASE-15871 Memstore flush doesn't finish because of backwardseek() in
...
memstore scanner. (Ram)
2016-10-03 17:15:24 +05:30
anoopsamjohn
250ad644e4
HBASE-16738 L1 cache caching shared memory HFile block when blocks promoted from L2 to L1.
2016-10-03 16:04:48 +05:30
tedyu
ec0adbd2c0
HBASE-16739) imed out exception message should include encoded region name
2016-10-02 21:09:09 -07:00
Enis Soztutar
b8ad9b17bb
HBASE-16721 Concurrency issue in WAL unflushed seqId tracking - ADDENDUM to change WAL to extend Closeable
2016-10-01 14:50:49 -07:00
Enis Soztutar
c3c82f3558
HBASE-16678 MapReduce jobs do not update counters from ScanMetrics
2016-09-29 15:34:03 -07:00
Enis Soztutar
bf3c928b74
HBASE-16721 Concurrency issue in WAL unflushed seqId tracking
2016-09-29 12:56:22 -07:00
Sean Busbey
76396714e1
HBASE-15984 Handle premature EOF treatment of WALs in replication.
...
In some particular deployments, the Replication code believes it has
reached EOF for a WAL prior to succesfully parsing all bytes known to
exist in a cleanly closed file.
Consistently this failure happens due to an InvalidProtobufException
after some number of seeks during our attempts to tail the in-progress
RegionServer WAL. As a work-around, this patch treats cleanly closed
files differently than other execution paths. If an EOF is detected due
to parsing or other errors while there are still unparsed bytes before
the end-of-file trailer, we now reset the WAL to the very beginning and
attempt a clean read-through.
In current testing, a single such reset is sufficient to work around
observed dataloss. However, the above change will retry a given WAL file
indefinitely. On each such attempt, a log message like the below will
be emitted at the WARN level:
Processing end of WAL file '{}'. At position {}, which is too far away
from reported file length {}. Restarting WAL reading (see HBASE-15983
for details).
Additionally, this patch adds some additional log detail at the TRACE
level about file offsets seen while handling recoverable errors. It also
add metrics that measure the use of this recovery mechanism.
2016-09-29 10:07:14 -05:00
tedyu
63808a224c
HBASE-16725 Don't let flushThread hang in TestHRegion
2016-09-29 06:56:19 -07:00
tedyu
f3270d44c3
HBASE-16723 RMI registry is not destroyed after stopping JMX Connector Server (Pankaj Kumar)
2016-09-29 01:57:54 -07:00
Jonathan M Hsieh
09a31bd1e9
HBASE-16711 Fix hadoop-3.0 profile compile
...
Eliminates use of removed or deprecated hadoop2 api
- MBeanUtil -> MBeans Hadoop2 has both; Hadoop 3 removes MBeanUtil and uses MBeans
- FSDataOutputStream(OutputStream) -> FSDataOutputStream(OutputStream, FileSystem.Statistics)
- MetricsServlet is removed. See HADOOP-12504
2016-09-28 13:11:37 -07:00
Ramkrishna
47e12fb3a0
HBASE-16696 After HBASE-16604 - does not release blocks in case of scanner
...
exception (Ram)
2016-09-28 15:39:08 +05:30
Abhishek Singh Chouhan
d127d64266
HBASE-16660 ArrayIndexOutOfBounds during the majorCompactionCheck in DateTieredCompaction
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2016-09-27 10:58:51 -07:00
anoopsamjohn
b644e0fb8d
HBASE-16134 Introduce Cell extension for server side.
2016-09-27 22:55:45 +05:30
anoopsamjohn
b0fcca6d7b
HBASE-16691 Optimize KeyOnlyFilter by utilizing KeyOnlyCell.(binlijin)
2016-09-27 22:48:04 +05:30
Ramkrishna
f196a8c331
HBASE-16643 - Reverse scanner heap creation may not allow MSLAB closure
...
due to improper ref counting of segments (Ram)
2016-09-27 14:24:19 +05:30
Stephen Yuan Jiang
db394f57de
HBASE-16714 Procedure V2 - use base class to remove duplicate set up test code in table DDL procedures (Stephen Yuan Jiang)
2016-09-26 20:41:43 -07:00
tedyu
219c786457
HBASE-16672 Add option for bulk load to copy hfile(s) instead of renaming
2016-09-26 18:56:38 -07:00
Andrew Purtell
b9ec59ebbe
HBASE-16694 Reduce garbage for onDiskChecksum in HFileBlock (binlijin)
2016-09-26 13:55:35 -07:00
Matteo Bertozzi
f06c0060aa
HBASE-16649 Truncate table with splits preserved can cause both data loss and truncated data appeared again
2016-09-26 12:58:04 -07:00
anoopsamjohn
43f47a8e73
HBASE-16704 Scan will be broken while working with DBE and KeyValueCodecWithTags.
2016-09-26 22:32:24 +05:30
Matteo Bertozzi
8da0500e7d
HBASE-16695 Procedure v2 - Support for parent holding locks
2016-09-26 08:42:48 -07:00
Matteo Bertozzi
e01e05cc0e
HBASE-16587 Procedure v2 - Cleanup suspended proc execution
2016-09-26 08:08:44 -07:00
tedyu
b7e0e15787
HBASE-16645 Wrong range of Cells is caused by CellFlatMap#tailMap, headMap, and SubMap (ChiaPing Tsai)
2016-09-25 06:42:32 -07:00
tedyu
3896d9ed0a
HBASE-16692 Make ByteBufferUtils#equals safer and correct (binlijin)
2016-09-25 06:37:40 -07:00
chenheng
21969f5159
HBASE-16665 Check whether KeyValueUtil.createXXX could be replaced by CellUtil without copy
2016-09-25 14:06:55 +08:00
chenheng
f7bb6fbf21
HBASE-16677 Add table size (total store file size) to table page (Guang Yang)
2016-09-25 10:48:01 +08:00
chenheng
b14fb14886
Revert "HBASE-16677 Add table size (total store file size) to table page"
...
This reverts commit f5351e2dbd
.
2016-09-25 10:47:20 +08:00
chenheng
f5351e2dbd
HBASE-16677 Add table size (total store file size) to table page
2016-09-25 09:49:50 +08:00
Matteo Bertozzi
7ed93f8f79
HBASE-16697 bump TestRegionServerMetrics to LargeTests
2016-09-23 15:45:56 -07:00
Apekshit Sharma
4082424305
HBASE-16679 Flush throughput controller: Minor perf change and fix flaky TestFlushWithThroughputController.
...
Change-Id: I79f4a65a67bfdc46868d68ff8a0c32f3a02b8cb1
2016-09-23 11:43:22 -07:00
Enis Soztutar
eb112783ae
HBASE-16604 Scanner retries on IOException can cause the scans to miss data - RECOMMIT after revert
2016-09-23 11:27:13 -07:00
Enis Soztutar
39db0cac78
Revert "HBASE-16604 Scanner retries on IOException can cause the scans to miss data"
...
This reverts commit 83cf44cd3f
.
Reverting because accidental files are committed with this.
2016-09-23 11:25:23 -07:00
Jerry He
50b051ade1
HBASE-16257 Move staging dir to be under hbase root dir
2016-09-23 10:07:58 -07:00
Matteo Bertozzi
d2ed74cbc6
HBASE-16688 Split TestMasterFailoverWithProcedures
2016-09-23 08:42:21 -07:00
tedyu
946c1ed8f8
HBASE-16423 Add re-compare option to VerifyReplication to avoid occasional inconsistent rows (Jianwei Cui)
2016-09-22 21:01:22 -07:00
binlijin
191afc8eb1
HBASE-16680 Reduce garbage in BufferChain
...
Signed-off-by: Yu Li <liyu@apache.org>
2016-09-23 11:06:23 +08:00
Yu Li
96c5a02217
Revert "HBASE-16880 Reduce garbage in BufferChain (binlijin)" to fix JIRA number
...
This reverts commit ce493642c0
.
2016-09-23 11:03:21 +08:00
Matteo Bertozzi
07ed15598b
HBASE-16671 Split TestExportSnapshot
2016-09-22 15:40:29 -07:00
Ben Lau
4b05f40984
HBASE-16662 Fix open POODLE vulnerabilities
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2016-09-22 14:27:07 -07:00
Enis Soztutar
83cf44cd3f
HBASE-16604 Scanner retries on IOException can cause the scans to miss data
2016-09-22 12:06:11 -07:00
anoopsamjohn
1384c9a08d
HBASE-16650 Wrong usage of BlockCache eviction stat for heap memory tuning.
2016-09-22 21:28:30 +05:30
tedyu
4bb84f7d0c
HBASE-16675 Average region size may be incorrect when there is region whose RegionLoad cannot be retrieved
2016-09-22 07:33:34 -07:00
Ashish Singhi
ce493642c0
HBASE-16880 Reduce garbage in BufferChain (binlijin)
2016-09-22 13:59:18 +05:30
Yu Li
2ff2c0ba6e
HBASE-16670 Make RpcServer#processRequest logic more robust
2016-09-22 15:43:53 +08:00
anoopsamjohn
19bbf44554
HBASE-16651 LRUBlockCache#returnBlock should try return block to Victim Handler L2 cache.
2016-09-22 11:20:11 +05:30
Jonathan M Hsieh
a90d433a2c
HBASE-12088 Remove unused hadoop-1.0, hadoop-1.1 profiles from non-root poms
2016-09-21 20:45:03 -07:00
Jonathan M Hsieh
055dde7dfc
HBASE-16669 Fix flakey TestAdmin1#testMergeRegions
...
Has been failing with incorrect region counts
2016-09-21 20:42:34 -07:00
Apekshit Sharma
593fb75083
HBASE-14734 Prevent BindException when setting up MiniKdc.
...
Port for kdc service gets selected in the constructor, but we bind to it later in MiniKdc.start()-->MiniKdc.initKDCServer() --> KdcServer.start(). In meantime, some other service can capture the port which results in BindException. The solution here is to catch the exception and retry.
Testing methodology:
- Used python and intellij.
- breakpoint on kdc.start(1), in catch block(2) and just after catch block(3).
- used python to bind to the selected port on breakpoint 1 --> run the program --> stops at breakpoint 2 (catch block)
- On breakpoint 1 and after 2 failures, close the port --> run the program --> skips catch block and goes to breakpoint 3.
Change-Id: I4e06e69819d1ec9a0a7fa471bf017f3a72c75cb3
2016-09-21 16:35:43 -07:00
Umesh Agashe
6a4c292a90
HBASE-16294 hbck reporting "No HDFS region dir found" for replicas
...
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2016-09-21 14:40:43 -07:00
Jerry He
b6b01a790f
HBASE-12949 Scanner can be stuck in infinite loop if the HFile is corrupted
2016-09-21 13:25:23 -07:00
chenheng
c67983ebf8
HBASE-16659 Use CellUtil.createFirstOnRow instead of KeyValueUtil.createFirstOnRow in some places (binlijin)
2016-09-21 15:25:36 +08:00
Jerry He
66821206b8
HBASE-16647 hbck should do offline reference repair before online repair
2016-09-20 11:49:09 -07:00
tedyu
22dcce571c
HBASE-16646 Enhance LoadIncrementalHFiles API to accept store file paths as input - addendum populates filesystem for the new doBulkLoad()
2016-09-20 10:52:38 -07:00
Matteo Bertozzi
181fed4450
HBASE-16551 Cleanup SplitLogManager and CatalogJanitor
2016-09-20 10:33:39 -07:00
tedyu
08d9a2b662
HBASE-16646 Enhance LoadIncrementalHFiles API to accept store file paths as input - addendum adheres to original cleanup logic
2016-09-20 09:38:18 -07:00
tedyu
348eb2834a
HBASE-16646 Enhance LoadIncrementalHFiles API to accept store file paths as input
2016-09-20 07:42:01 -07:00
zhangduo
6eb6225456
HBASE-7612 [JDK8] Replace use of high-scale-lib counters with intrinsic facilities
2016-09-19 13:37:24 +08:00
zhangduo
4faa8ea934
HBASE-16165 Decrease RpcServer.callQueueSize before writeResponse causes OOM (Guanghao Zhang)
2016-09-18 10:05:27 +08:00
Apekshit Sharma
da3abbcb35
HBASE-16534 Procedure v2 - Perf Tool for Scheduler.
...
Tool to test performance of locks and queues in procedure scheduler independently from other framework components.
Inserts table and region operations in the scheduler, then polls them and exercises their locks. Number of tables, regions and operations can be set using cli args.
Change-Id: I0fb27e67d3fcab70dd5d0b5197396b117b11eac6
2016-09-17 17:38:51 -07:00
Jerry He
edc0ef3fe4
HBASE-16598 Enable zookeeper useMulti always and clean up in HBase code
2016-09-17 16:51:26 -07:00
Enis Soztutar
1a1003a482
HBASE-16447 Replication by namespaces config in peer (Guanghao Zhang)
2016-09-16 11:47:42 -07:00
chenheng
2cf8907db5
HBASE-16631 Extract AsyncRequestFuture related code from AsyncProcess
2016-09-17 00:35:23 +08:00
Matteo Bertozzi
b6b72361b6
HBASE-16586 Procedure v2 - Cleanup sched wait/lock semantic
2016-09-16 08:50:17 -07:00
tedyu
2597217ae5
HBASE-16349 TestClusterId may hang during cluster shutdown
2016-09-16 02:32:03 -07:00
Matteo Bertozzi
e19632a19a
HBASE-16634 Speedup TestExportSnapshot
2016-09-15 18:29:09 -07:00
Nitin Aggarwal
8c4b09dfba
HBASE-16624 Fix MVCC DeSerialization bug in the HFileScannerImpl
...
Change-Id: Ia970619ac7369d24ed432e827319dfdca16143c2
Signed-off-by: stack <stack@apache.org>
2016-09-15 11:01:51 -07:00
anoopsamjohn
56be3ac7c8
HBASE-16626 User customized RegionScanner from 1.X is incompatible with 2.0.0's off-heap part. (Charlie Qiangeng Xu)
2016-09-15 18:07:43 +05:30
Phil Yang
8ef6c76344
HBASE-16388 Prevent client threads being blocked by only one slow region server
...
Signed-off-by: stack <stack@apache.org>
2016-09-14 09:08:20 -07:00
Matteo Bertozzi
4c6a98bd76
HBASE-16618 Procedure v2 - Add base class for table and ns procedures
2016-09-13 11:37:52 -07:00
zhangduo
a602aaf9ba
HBASE-16615 Fix flaky TestScannerHeartbeatMessages
2016-09-13 17:41:01 +08:00
anoopsamjohn
77b327320a
HBASE-16229 Cleaning up size and heapSize calculation.
2016-09-12 23:23:38 -07:00
chenheng
2566cfeb60
HBASE-16592 Unify Delete request with AP
2016-09-12 23:23:38 -07:00
tedyu
8855670cd7
HBASE-16616 Rpc handlers stuck on ThreadLocalMap.expungeStaleEntry (Tomu Tsuruhara)
2016-09-12 15:49:23 -07:00
chenheng
80d8b2100d
HBASE-16086 TableCfWALEntryFilter and ScopeWALEntryFilter should not redundantly iterate over cells (Vincent Poon)
2016-09-11 09:55:08 +08:00
chenheng
cc2a40a78f
HBASE-16596 Reduce redundant interfaces in AsyncProcess
2016-09-10 11:13:28 +08:00
zhangduo
6c8d1f0ae8
HBASE-16309 TestDefaultCompactSelection.testCompactionRatio is flaky
2016-09-09 14:20:39 +08:00
chenheng
e11aafae95
HBASE-16570 Compute region locality in parallel at startup (binlijin)
2016-09-09 10:54:48 +08:00
Andrew Purtell
46c756a4a7
HBASE-16589 Adjust log level for FATAL messages from HBaseReplicationEndpoint that are not fatal
2016-09-08 13:04:18 -07:00
tedyu
d7e5c6fa8e
HBASE-16505 Add AsyncRegion interface to pass deadline and support async operations - revert due to open questions
2016-09-08 11:55:46 -07:00
tedyu
1574c6ef39
HBASE-16505 Add AsyncRegion interface to pass deadline and support async operations (Phil Yang)
2016-09-08 06:57:03 -07:00
zhangduo
c04b389181
HBASE-16445 Refactor and reimplement RpcClient
2016-09-08 20:32:56 +08:00
binlijin
fc224ed0ed
HBASE-16530 Reduce DBE code duplication
...
Signed-off-by: Yu Li <liyu@apache.org>
2016-09-08 13:48:27 +08:00
tedyu
e9cfbfd107
HBASE-16572 Sync method in RecoverableZooKeeper failed to pass callback function in (Allan Yang)
2016-09-07 11:35:35 -07:00
tedyu
b6ba13c377
HBASE-16460 Can't rebuild the BucketAllocator's data structures when BucketCache uses FileIOEngine (Guanghao Zhang)
2016-09-05 06:50:50 -07:00
zhangduo
91227f8f98
HBASE-16516 Revisit the implementation of PayloadCarryingRpcController
2016-09-04 09:16:15 +08:00
tedyu
592245ff13
HBASE-16556 The read/write timeout are not used in HTable.delete(List), HTable.get(List), and HTable.existsAll(List) (ChiaPing Tsai)
2016-09-03 17:14:57 -07:00
Matteo Bertozzi
008091fe8a
HBASE-16552 MiniHBaseCluster#getServerWith() does not ignore stopped RSs
2016-09-02 16:49:17 -07:00
Andrew Purtell
5e905c02d9
HBASE-16399 Provide an API to get list of failed regions and servername in Canary (Vishal Khandelwal)
2016-09-02 10:13:35 -07:00
Jerry He
0b6eccf4c3
HBASE-16311 Audit log for delete snapshot operation is missing in case of snapshot owner deleting the same (Yi Liang)
2016-09-02 09:47:28 -07:00
Matteo Bertozzi
f6ccae3502
HBASE-16507 Procedure v2 - Force DDL operation to always roll forward
2016-09-01 21:06:32 -07:00
Loknath Priyatham Teja Singamsetty
b839d04d8e
HBASE-16375 Mapreduce mini cluster using HBaseTestingUtility not setting correct resourcemanager and jobhistory webapp address of MapReduceTestingShim
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2016-09-01 15:57:39 -07:00
tedyu
a1cd601ad7
HBASE-16527 IOExceptions from DFS client still can cause CatalogJanitor to delete referenced files (Vladimir Rodionov)
2016-09-01 12:31:20 -07:00
chenheng
3892550484
HBASE-15278 AsyncRPCClient hangs if Connection closes before RPC call response
2016-09-01 10:33:24 +08:00
Matteo Bertozzi
8479554275
HBASE-16519 Procedure v2 - Avoid sync wait on DDLs operation (addendum)
2016-08-31 13:48:25 -07:00
Stephen Yuan Jiang
605af95132
HBASE-16528 Procedure-V2: ServerCrashProcedure misses owner information (Stephen Yuan Jiang)
2016-08-31 09:25:51 -07:00
zhangduo
45af3831fe
HBASE-16526 Add more ipc tests
2016-08-31 20:44:56 +08:00
zhangduo
647a65ce01
HBASE-16531 Move cell block related code out of IPCUtil
2016-08-31 13:09:22 +08:00
tedyu
7b95ac117d
HBASE-16502 Reduce garbage in BufferedDataBlockEncoder - addendum adopts Hiroshi's suggestion (binlijin)
2016-08-30 18:04:34 -07:00
Matteo Bertozzi
af33f94513
HBASE-16522 Procedure v2 - Cache system user and avoid IOException
2016-08-30 15:39:49 -07:00
Matteo Bertozzi
4a4f8e7049
HBASE-16519 Procedure v2 - Avoid sync wait on DDLs operation
2016-08-30 09:45:56 -07:00
Matteo Bertozzi
2acd788dce
HBASE-16082 Procedure v2 - Move out helpers from MasterProcedureScheduler
2016-08-30 09:44:35 -07:00
tedyu
9cb0094bdb
HBASE-16509 Add option to LoadIncrementalHFiles which allows skipping unmatched column families
2016-08-30 03:00:59 -07:00
zhangduo
0d05c75184
HBASE-16510 Reset RpcController before retry
2016-08-30 16:56:28 +08:00
chenheng
c000f29e47
HBASE-16224 Reduce the number of RPCs for the large PUTs (ChiaPing Tsai)
2016-08-30 06:35:33 +08:00
anoopsamjohn
950d547dae
HBASE-16407 Handle MemstoreChunkPool size when HeapMemoryManager tunes memory.
2016-08-29 10:22:27 +05:30
chenheng
7eaba369e7
HBASE016490 Fix race condition between SnapshotManager and SnapshotCleaner
2016-08-27 10:48:21 +08:00
Matteo Bertozzi
1b9af2a2fa
HBASE-16508 Move UnexpectedStateException to common
2016-08-26 16:40:30 -07:00
anoopsamjohn
0d99e827b2
HBASE-16213 A new HFileBlock structure for fast random get. (binlijin)
2016-08-26 10:50:36 +05:30
tedyu
b1ee8a88c3
HBASE-16502 Reduce garbage in BufferedDataBlockEncoder (binlijin)
2016-08-25 20:35:30 -07:00
tedyu
3fd59b0ba9
HBASE-16409 Addendum fixes the case where delimiter is not specified by user
2016-08-25 11:53:49 -07:00
zhangduo
a1f760ff76
HBASE-16433 Remove AsyncRpcChannel related stuffs
2016-08-25 08:15:46 +08:00
Stephen Yuan Jiang
8a692ff189
HBASE-16486 Unify system table creation using the same createSystemTable API (Stephen Yuan Jiang)
2016-08-24 15:21:20 -07:00
tedyu
bf7015d320
HBASE-16304 HRegion#RegionScannerImpl#handleFileNotFoundException may lead to deadlock when trying to obtain write lock on updatesLock
2016-08-24 09:04:47 -07:00
Enis Soztutar
dda8f67b2c
HBASE-16270 Handle duplicate clearing of snapshot in region replicas (Robert Yokota)
2016-08-24 06:33:46 -07:00
Ashish Singhi
31f16d6aec
HBASE-16471 Region Server metrics context will be wrong when machine hostname contain "master" word (Pankaj Kumar)
2016-08-24 18:59:44 +05:30
Enis Soztutar
cbfd6eecbd
HBASE-16474 Remove dfs.support.append related code and documentation
2016-08-24 03:41:54 -07:00
chenheng
3909b7c96f
HBASE-16464 archive folder grows bigger and bigger due to corrupt snapshot under tmp dir
2016-08-24 13:38:32 +08:00
anoopsamjohn
32c21f4594
HBASE-14921 In-Memory MemStore Flush and Compaction : Memory optimizations. (Anastasia)
2016-08-24 09:25:21 +05:30
Geoffrey
cb02be38ab
HBASE-16448 Custom metrics for custom replication endpoints
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2016-08-23 17:17:08 -07:00
Matteo Bertozzi
cb507b8cff
HBASE-16360 TableMapReduceUtil addHBaseDependencyJars has the wrong class name for PrefixTreeCodec (Jing Pu Chen)
2016-08-23 14:22:20 -07:00
anoopsamjohn
897631f8d1
HBASE-16440 MemstoreChunkPool might cross its maxCount of chunks to pool.
2016-08-23 22:28:14 +05:30
Ashish Singhi
77a7394f17
HBASE-16446 append_peer_tableCFs failed when there already have this table's partial cfs in the peer (Guanghao Zhang)
2016-08-23 15:28:33 +05:30
Ramkrishna
ff6182b020
HBASE-16454 Compactor's shipping logic decision should be based on the
...
current store's block size (Ram)
2016-08-23 11:06:02 +05:30
Esteban Gutierrez
abc64fa69f
HBASE-16450 Shell tool to dump replication queues
...
New tool to dump existing replication peers, configurations and
queues when using HBase Replication. The tool provides two flags:
--distributed This flag will poll each RS for information about
the replication queues being processed on this RS.
By default this is not enabled and the information
about the replication queues and configuration will
be obtained from ZooKeeper.
--hdfs When --distributed is used, this flag will attempt
to calculate the total size of the WAL files used
by the replication queues. Since its possible that
multiple peers can be configured this value can be
overestimated.
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2016-08-22 19:50:10 -07:00
Apekshit Sharma
ae42a934d8
HBASE-16467 Move AbstractHBaseTool to hbase-common.
...
Change-Id: I64775f875f6900520e66c22c007704a067e8c2a4
2016-08-22 16:06:17 -07:00
tedyu
f174fec391
HBASE-16455 Provide API for obtaining all the WAL files
2016-08-22 01:34:58 -07:00
tedyu
d077219d3a
HBASE-16409 Row key for bad row should be properly delimited in VerifyReplication
2016-08-20 17:16:39 -07:00
anoopsamjohn
5f61f9cc5c
HBASE-16405 Change read path Bloom check to work with Cells with out any copy.
2016-08-19 11:25:35 +05:30
Yu Li
642d2fe0f8
HBASE-16429 FSHLog: deadlock if rollWriter called when ring buffer filled with appends
2016-08-18 09:59:36 +08:00
Matteo Bertozzi
e637a61e26
HBASE-16378 Procedure v2 - Make ProcedureException extend HBaseException
2016-08-17 14:31:08 -07:00
chenheng
fb4ef53571
HBASE-15635 Mean age of Blocks in cache (seconds) on webUI should be greater than zero
...
Signed-off-by: stack <stack@apache.org>
2016-08-17 10:59:00 -07:00
tedyu
233ca65b8f
HBASE-16419 check REPLICATION_SCOPE's value more stringently (Guangxu Cheng)
2016-08-17 07:58:06 -07:00
stack
907ac1f655
HBASE-16341 Missing bit on "Regression: Random Read/WorkloadC slower in 1.x than 0.98"
2016-08-13 20:16:44 -07:00
Ramkrishna
65c03b058c
HBASE-16404 Make DeleteBloomFilters work with BloomContext (Ram)
2016-08-12 15:09:31 +05:30
Ramkrishna
285e104176
HBASE-15554 - StoreFile$Writer.appendGeneralBloomFilter generates extra KV
...
(Ram)
2016-08-12 10:21:41 +05:30
tedyu
fb668a0d3f
HBASE-16267 Remove commons-httpclient dependency from hbase-rest module
2016-08-10 21:28:45 -07:00
tedyu
9e116e048b
HBASE-16389 Thread leak in CoprocessorHost#getTable(TableName) API (Ankit Singhal)
2016-08-10 19:58:13 -07:00
stack
45bb6180a3
REVERT of revert of "HBASE-16308 Contain protobuf references Gather up the pb references into a few locations only rather than have pb references distributed all about the code base."
...
This is a revert of a revert; i.e. we are adding back the change only adding
back with fixes for the broken unit test; was a real issue on a test that
went in just at same time as this commit; I was getting a new nonce on each
retry rather than getting one for the mutation.
Other changes since revert are more hiding of RpcController. Use
accessor method rather than always pass in a RpcController
Walked back retrying operations that used to be single-shot (though
code comment said need a retry) because it opens a can of worms where
we retry stuff like bad column family when we shouldn't (needs
work adding in DoNotRetryIOEs)
Changed name of class from PayloadCarryingServerCallable to
CancellableRegionServerCallable.
Fix javadoc and findbugs warnings.
Fix case of not initializing the ScannerCallable RpcController.
Below is original commit message:
Remove mention of ServiceException and other protobuf classes from all over the codebase.
Purge TimeLimitedRpcController. Lets just have one override of RpcController.
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/AbstractRegionServerCallable.java
Cleanup. Make it clear this is an odd class for async hbase intro.
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTable.java
Refactor of RegionServerCallable allows me clean up a bunch of
boilerplate in here and remove protobuf references.
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java
Purge protobuf references everywhere except a reference to a throw of a
ServiceException in method checkHBaseAvailable. I deprecated it in favor
of new available method (the SE is not actually needed)
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/PayloadCarryingServerCallable.java
Move the RetryingTimeTracker instance in here from HTable.
Allows me to contain tracker and remove a repeated code in HTable.
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/RegionServerCallable.java
Clean up move set up of rpc in here rather than have it repeat in HTable.
Allows me to remove protobuf references from a bunch of places.
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/FlushRegionCallable.java
Make use of the push of boilerplate up into RegionServerCallable
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/MultiServerCallable.java
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/PayloadCarryingServerCallable.java
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/RegionAdminServiceCallable.java
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/RpcRetryingCallerWithReadReplicas.java
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/ScannerCallable.java
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/SecureBulkLoadClient.java
M hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/LoadIncrementalHFiles.java
Move boilerplate up into superclass.
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/RetryingTimeTracker.java
Cleanup
M hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/PayloadCarryingRpcController.java
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/WALEditsReplaySink.java
M hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/RegionReplicaReplicationEndpoint.java
Factor in TimeLimitedRpcController. Just have one RpcController override.
D hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/TimeLimitedRpcController.java
Removed. Lets have one override of pb rpccontroller only.
M hbase-client/src/main/java/org/apache/hadoop/hbase/protobuf/ProtobufUtil.java
(handleRemoteException) added
(toText) added
2016-08-10 10:12:06 -07:00
Phil Yang
091a17e3c9
HBASE-16368 test*WhenRegionMove in TestPartialResultsFromClientSide is flaky
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-08-10 18:13:12 +08:00
Phil Yang
ede9940a7b
HBASE-16285 Drop RPC requests if it must be considered as timeout at client
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-08-10 16:56:27 +08:00
stack
46defe8e31
HBASE-9899 for idempotent operation dups, return the result instead of throwing conflict exception (Guanghao Zhang): ADDENDUM
2016-08-09 07:09:44 -07:00
Phil Yang
5cadcd59aa
HBASE-9465 Push entries to peer clusters serially
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-08-09 15:25:50 +08:00
tedyu
1ecb0fce34
HBASE-16367 Race between master and region server initialization may lead to premature server abort - addendum shortens the waiting duration
2016-08-08 10:39:35 -07:00
tedyu
50f3c9572c
HBASE-16367 Race between master and region server initialization may lead to premature server abort
2016-08-08 04:07:30 -07:00
Phil Yang
e5f9df1e23
HBASE-12770 Don't transfer all the queued hlogs of a dead server to the same alive server
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-08-08 16:30:23 +08:00
Vivek
30d7eeaefe
HBASE-15866 Split hbase.rpc.timeout into *.read.timeout and *.write.timeout
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2016-08-06 16:55:09 -07:00
zhangduo
977858c9cb
HBASE-16362 Mob compaction does not set cacheBlocks to false when creating StoreScanner
2016-08-06 22:38:26 +08:00
stack
0206dc67d6
Revert "HBASE-16308 Contain protobuf references Gather up the pb references into a few locations only rather than have pb references distributed all about the code base."
...
This reverts commit ed87a81b4b
.
2016-08-05 15:18:48 -07:00
stack
ed87a81b4b
HBASE-16308 Contain protobuf references Gather up the pb references into a few locations only rather than have pb references distributed all about the code base.
...
Purge ServiceException from Callable subclasses by pushing SE handling
up into the parent Callable class (varies by context but this is basic
patten). Allows us remove a bunch of boilerplate.
Do this in the public facing classes in particular (though if
an API has SE in it -- which a few do, this patch leaves these
untouched -- for now.) Make it so HBaseAdmin and HTable have no
direct pb imports (except for endpoint processor API).
Change a few of the HBaseAdmin calls to be retrying where comments
ask that we do retry rather than one time.
Purge TimeLimitedRpcController. Lets just have one override of RpcController.
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/AbstractRegionServerCallable.java
Cleanup. Make it clear this is an odd class for async hbase intro.
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTable.java
Refactor of RegionServerCallable allows me clean up a bunch of
boilerplate in here and remove protobuf references.
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java
Purge protobuf references everywhere except a reference to a throw of a
ServiceException in method checkHBaseAvailable. I deprecated it in favor
of new available method (the SE is not actually needed)
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/PayloadCarryingServerCallable.java
Move the RetryingTimeTracker instance in here from HTable.
Allows me to contain tracker and remove a repeated code in HTable.
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/RegionServerCallable.java
Clean up move set up of rpc in here rather than have it repeat in HTable.
Allows me to remove protobuf references from a bunch of places.
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/FlushRegionCallable.java
Make use of the push of boilerplate up into RegionServerCallable
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/MultiServerCallable.java
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/PayloadCarryingServerCallable.java
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/RegionAdminServiceCallable.java
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/RpcRetryingCallerWithReadReplicas.java
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/ScannerCallable.java
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/SecureBulkLoadClient.java
M hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/LoadIncrementalHFiles.java
Move boilerplate up into superclass.
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/RetryingTimeTracker.java
Cleanup
M hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/PayloadCarryingRpcController.java
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/WALEditsReplaySink.java
M hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/RegionReplicaReplicationEndpoint.java
Factor in TimeLimitedRpcController. Just have one RpcController override.
D hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/TimeLimitedRpcController.java
Removed. Lets have one override of pb rpccontroller only.
M hbase-client/src/main/java/org/apache/hadoop/hbase/protobuf/ProtobufUtil.java
(handleRemoteException) added
(toText) added
Signed-off-by: stack <stack@apache.org>
2016-08-05 10:13:58 -07:00
Sean Busbey
431c8c9ad0
HBASE-8386 deprecate TableMapReduce.addDependencyJars(Configuration, class<?> ...)
...
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2016-08-05 10:35:02 -05:00
Sean Busbey
60b79e2daa
HBASE-16321 ensure no findbugs-jsr305
...
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2016-08-05 10:16:29 -05:00
tedyu
4b3e45fceb
HBASE-16359 Addendum moves null checking as suggested by Heng
2016-08-05 03:18:28 -07:00
Ramkrishna
19c609fa5e
HBASE-16303 FilterList with MUST_PASS_ONE optimization (Ram)
2016-08-05 10:58:02 +05:30
tedyu
5e23b3aad5
HBASE-16359 NullPointerException in RSRpcServices.openRegion()
2016-08-04 20:46:48 -07:00
stack
975f0dd958
HBASE-9899 for idempotent operation dups, return the result instead of throwing conflict exception (Guanghao Zhang)
2016-08-04 12:40:19 -07:00
chenheng
550b937bcf
HBASE-16287 LruBlockCache size should not exceed acceptableSize too many(Yu Sun)
2016-08-04 21:13:42 +08:00
Lim Chee Hau
0eaf3edc3a
HBASE-15574 Fix typo in HRegionServerCommandLine
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-08-03 23:43:33 -05:00
Nick Dimiduk
209b6f74c7
HBASE-16317 revert all ESAPI changes
...
Revert "HBASE-15270 Use appropriate encoding for "filter" field in TaskMonitorTmpl.jamon."
This reverts commit bba4f107c1
.
Revert "HBASE-15122 Servlets generate XSS_REQUEST_PARAMETER_TO_SERVLET_WRITER findbugs warnings (Samir Ahmic)"
This reverts commit 68b300173f
.
Conflicts:
hbase-server/pom.xml
Revert "HBASE-15329 Cross-Site Scripting: Reflected in table.jsp (Samir Ahmic)"
This reverts commit 4b3e38705c
.
Conflicts:
hbase-server/src/main/resources/hbase-webapps/master/table.jsp
Revert "HBASE-15369 Handle NPE in region.jsp (Samir Ahmic)"
This reverts commit 3826894f89
.
2016-08-03 20:47:02 -07:00
Enis Soztutar
81b06b3bdd
HBASE-16350 Undo server abort from HBASE-14968
2016-08-03 19:37:58 -07:00
Enis Soztutar
bcf2738a01
HBASE-16301 Trigger flush without waiting when compaction is disabled on a table (huaxiang sun)
2016-08-02 18:46:07 -07:00
Andrew Purtell
e63fb6c025
HBASE-16319 Fix TestCacheOnWrite after HBASE-16288
2016-08-02 16:53:32 -07:00
Deokwoo Han
eef6a4834a
HBASE-16284 Unauthorized client can shutdown the cluster
2016-08-02 11:21:31 -07:00
zhangduo
b35cf8f93a
HBASE-16225 Refactor ScanQueryMatcher
2016-08-02 14:01:28 +08:00
Andrew Purtell
78361243c8
HBASE-16296 Reverse scan performance degrades when using filter lists (Ted Yu)
2016-08-01 17:41:10 -07:00
Enis Soztutar
aa0235f98c
HBASE-16288 HFile intermediate block level indexes might recurse forever creating multi TB files
2016-08-01 11:08:56 -07:00
chenheng
7e6f562754
HBASE-16234 Expect and handle nulls when assigning replicas(Yi Liang)
2016-08-01 11:21:13 +08:00
Joseph Hwang
3729320099
HBASE-16209 Removed unnecessary method and method calls from AssignmentManager and AssignmentManager UI (addendum)
...
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2016-07-29 16:05:00 -07:00
Joseph Hwang
fe44383619
HBASE-16209 provide an ExponentialBackOffPolicy sleep between failed region open requests
...
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-07-29 09:47:00 -07:00
Yu Sun
2b1cbeb28d
HBASE-16300 LruBlockCache.CACHE_FIXED_OVERHEAD should calculate LruBlockCache size correctly
...
Signed-off-by: Yu Li <liyu@apache.org>
2016-07-29 14:29:01 +08:00
Matteo Bertozzi
66fb697f81
HBASE-16275 Change ServerManager#onlineServers from ConcurrentHashMap to ConcurrentSkipListMap (Huaxiang Sun)
2016-07-28 11:13:58 -07:00
Matteo Bertozzi
64804a0497
HBASE-16293 TestSnapshotFromMaster#testSnapshotHFileArchiving flakey (Huaxiang Sun)
2016-07-28 10:42:30 -07:00
anoopsjohn
00c2a5da7b
HBASE-16286 When TagRewriteCell are not copied to MSLAB, deep clone it while adding to Memstore.
2016-07-27 22:29:26 +05:30
zhangduo
bcf409e11f
HBASE-16280 Use hash based map in SequenceIdAccounting
2016-07-26 11:31:32 +08:00
Phil Yang
0da8119fbc
HBASE-16281 TestMasterReplication is flaky
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-07-26 10:54:46 +08:00
Reid Chan
abfd584fe6
HBASE-14743 Add metrics around HeapMemoryManager. (Reid Chan)
...
Change-Id: I7305f7b7034b216930b5fb5c57de9ba5eabf96d8
Signed-off-by: Apekshit Sharma <appy@apache.org>
2016-07-25 14:32:38 -07:00
Apekshit Sharma
eff38ccf8c
Revert HBASE-14743 because of wrong attribution. Since I added commit message to the raw patch, it's making me as author instead of Reid. I should have used --author flag to set Reid as author.
...
This reverts commit 064271da16
.
2016-07-25 14:32:38 -07:00
Apekshit Sharma
064271da16
HBASE-14743 Add metrics around HeapMemoryManager. (Reid Chan)
...
Change-Id: I60b2435355b3e605e7d91cbf5aca5d2988f26f33
2016-07-25 13:45:50 -07:00
anoopsjohn
2df0ef549a
HBASE-16205 When Cells are not copied to MSLAB, deep clone it while adding to Memstore.
2016-07-25 22:58:32 +05:30
Phil Yang
6dbce2a8cb
HBASE-16266 Do not throw ScannerTimeoutException when catch UnknownScannerException
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-07-25 22:26:19 +08:00
Stephen Yuan Jiang
bdd7782f05
HBASE-16008 A robust way deal with early termination of HBCK (Stephen Yuan Jiang)
2016-07-23 14:47:11 -07:00
Stephen Yuan Jiang
cd0b85e0a8
Revert HBASE-15406: Split / merge switch left disabled after early termination of hbck (HBASE-16008 will address this issue)
2016-07-22 20:09:03 -07:00
Joseph Hwang
744248c131
HBASE-16096 Properly remove the replication queue and peer znodes after calling ReplicationSourceManager.removePeer().
...
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-07-22 18:11:41 -07:00
Joseph Hwang
03fe257a64
HBASE-16221 Have ThriftScanner update the ConnectionCache's last used time overtime getScannerRow() to keep the connection alive for long lived scanners
...
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-07-22 17:58:39 -07:00
Matteo Bertozzi
cc766df28b
HBASE-16272 Overflow in ServerName's compareTo method (Huaxiang Sun)
2016-07-22 15:28:04 -07:00
Jerry He
519f87fc2b
HBASE-15291 Revert due to race condition resulting in closed FileSystem error
2016-07-21 18:51:47 -07:00
Gary Helmling
65834a1ced
HBASE-16217 Pass through the calling user in ObserverContext
2016-07-21 16:45:09 -07:00
stack
9d740f7b8b
HBASE-16263 Move all to do w/ protobuf -- *.proto files and generated classes -- under hbase-protocol
...
Signed-off-by: stack <stack@apache.org>
2016-07-21 10:02:05 -07:00
Jerry He
ce657d5911
HBASE-13701 Consolidate SecureBulkLoadEndpoint into HBase core as default for bulk load -- addendum
2016-07-20 13:28:01 -07:00
Jerry He
70f330dc84
Consolidate SecureBulkLoadEndpoint into HBase core as default for bulk load
2016-07-19 19:53:10 -07:00
Enis Soztutar
5051ab4e70
HBASE-16244 LocalHBaseCluster start timeout should be configurable (Siddharth Wagle)
2016-07-19 14:12:47 -07:00
Stephen Yuan Jiang
638ca24f01
HBASE-14552 (addendum) Procedure V2: Reimplement DispatchMergingRegionHandler (add nonce support) (Stephen Yuan Jiang)
2016-07-19 08:49:23 -07:00
zhangduo
515c499f95
HBASE-16110 AsyncFS WAL doesn't work with Hadoop 2.8+
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-07-18 06:54:20 -05:00
Phil Yang
a1cc2c4bfe
HBASE-16144 Replication queue's lock will live forever if RS acquiring the lock has died prematurely
...
(cherry picked from commit a8dfd8c436
)
2016-07-18 06:48:17 -05:00
Sean Busbey
a0aa017ae9
Revert "Replication queue's lock will live forever if RS acquiring the lock has died prematurely"
...
This reverts commit a8dfd8c436
.
2016-07-18 06:47:56 -05:00
chenheng
cf0f4f72d9
HBASE-16076 Cannot configure split policy in HBase shell
2016-07-18 10:28:05 +08:00
Phil Yang
a8dfd8c436
Replication queue's lock will live forever if RS acquiring the lock has died prematurely
2016-07-18 09:32:36 +08:00
tedyu
9bc7ecfb9d
HBASE-16235 Addendum uses hfile count of 20 (ChiaPing)
2016-07-16 16:07:11 -07:00
Jerry He
60847a2d76
HBASE-3727 MultiHFileOutputFormat (yi liang)
2016-07-15 21:07:12 -07:00
tedyu
66c68f8ea3
HBASE-16235 TestSnapshotFromMaster#testSnapshotHFileArchiving will fail if there are too many hfiles (ChiaPing Tsai)
2016-07-15 15:07:14 -07:00
Stephen Yuan Jiang
3978aa3af0
HBASE-13823 Procedure V2: remove unnecessaery operaions on AssignmentManager#recoverTableInDisablingState() and recoverTableInEnablingState() (Stephen Yuan Jiang)
2016-07-15 12:26:31 -07:00
Stephen Yuan Jiang
f04eeecffc
HBASE-14552 Procedure V2: Reimplement DispatchMergingRegionHandler (Stephen Yuan Jiang)
2016-07-15 07:06:53 -07:00
Stephen Yuan Jiang
28d8609e5d
HBASE-16233 Procedure V2: Support acquire/release shared table lock concurrently (Stephen Yuan Jiang)
2016-07-14 21:32:59 -07:00
zhangduo
243fe287b9
HBASE-16219 addendum move MasterMetaBootstrap to the right place
2016-07-15 09:58:17 +08:00
Matteo Bertozzi
a55af38689
HBASE-16219 Move meta bootstrap out of HMaster
2016-07-14 06:14:53 -07:00
Enis Soztutar
a07892558b
HBASE-16095 Add priority to TableDescriptor and priority region open thread pool
2016-07-13 18:19:59 -07:00
Yu Li
3b3c3dc02d
HBASE-16195 Should not add chunk into chunkQueue if not using chunk pool in HeapMemStoreLAB
2016-07-13 09:33:24 +08:00
Andrew Purtell
911706a873
HBASE-16220 Demote log level for "HRegionFileSystem - No StoreFiles for" messages to TRACE
2016-07-12 15:44:06 -07:00
Joseph Hwang
f292048ffd
HBASE-16208 Check that the row exists before attempting to remove a queue from TableBasedReplicationQueuesImpl
...
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-07-12 14:50:07 -07:00
Joseph Hwang
90ba723dc6
HBASE-16214 Add in a UI description for the Replication Table
...
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-07-12 12:21:55 -07:00
Matteo Bertozzi
2650711e94
HBASE-16207 can't restore snapshot without "Admin" permission
2016-07-12 05:50:06 -07:00
Joseph Hwang
ccf293d7fb
HBASE-16081 Wait for Replication Tasks to complete before killing the ThreadPoolExecutor inside of HBaseInterClusterReplicationEndpoint
...
Signed-off-by: Mikhail Antonov <antonov@apache.org>
2016-07-11 17:34:12 -07:00
Gary Helmling
3b5fbf8d73
HBASE-16160 Support RPC encryption with direct ByteBuffers (Colin Ma via garyh)
2016-07-11 10:33:22 -07:00
Yu Li
356c130702
HBASE-16194 Should count in MSLAB chunk allocation into heap size change when adding duplicate cells, addendum
2016-07-11 22:44:32 +08:00
tedyu
0875c35781
HBASE-16185 TestReplicationSmallTests fails in master branch (Phil Yang)
2016-07-10 23:28:32 -07:00
Yu Li
9cf012cd00
HBASE-16194 Should count in MSLAB chunk allocation into heap size change when adding duplicate cells
2016-07-10 13:45:17 +08:00
stack
496fd9837a
HBASE-16176 Bug fixes/improvements on HBASE-15650 Remove
...
TimeRangeTracker as point of contention when many threads reading a StoreFile
Fixes HBASE-16074 ITBLL fails, reports lost big or tiny families broken
scanning because of a side effect of a clean up in HBASE-15650 to make
TimeRange construction consistent exposed a latent issue in
TimeRange#compare. See HBASE-16074 for more detail.
Also change HFile Writer constructor so we pass in the TimeRangeTracker, if one,
on construction rather than set later (the flag and reference were not volatile
so could have made for issues in concurrent case). And make sure the construction
of a TimeRange from a TimeRangeTracer on open of an HFile Reader never makes a
bad minimum value, one that would preclude us reading any values from a file
(set min to 0)
M hbase-common/src/main/java/org/apache/hadoop/hbase/io/TimeRange.java
Call through to next constructor (if minStamp was 0, we'd skip setting
allTime=true). Add asserts that timestamps are not < 0 cos it messes
us up if they are (we already were checking for < 0 on construction but
assert passed in timestamps are not < 0).
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
Add constructor override that takes a TimeRangeTracker (set when flushing
but not when compacting)
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/Store.java
Add override creating an HFile in tmp that takes a TimeRangeTracker
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFile.java
Add override for HFile Writer that takes a TimeRangeTracker Take it on
construction instead of having it passed by a setter later (flags and
reference set by the setter were not volatile... could have been prob
in concurrent case)
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/TimeRangeTracker.java
Log WARN if bad initial TimeRange value (and then 'fix' it)
M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestTimeRangeTracker.java
A few tests to prove serialization works as expected and that we'll get a bad min if not constructed properly.
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/ScanQueryMatcher.java
Handle OLDEST_TIMESTAMP explictly. Don't expect TimeRange to do it.
M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestQueryMatcher.java
Refactor from junit3 to junit4 and add test for this weird case.
2016-07-08 18:20:31 -07:00
Yu Li
3c39cbd92c
HBASE-16201 NPE in RpcServer causing intermittent UT failure of TestMasterReplication#testHFileCyclicReplication
2016-07-09 02:02:00 +08:00
Yu Li
1578a045b6
Revert "NPE in RpcServer causing intermittent UT failure of TestMasterReplication#testHFileCyclicReplication"
...
This reverts commit a33097e067
.
2016-07-09 02:01:43 +08:00
stack
5e0d97e0e9
HBASE-16171 Fix the potential problems in TestHCM.testConnectionCloseAllowsInterrupt (Colin Ma)
2016-07-08 10:18:36 -07:00
Yu Li
a33097e067
NPE in RpcServer causing intermittent UT failure of TestMasterReplication#testHFileCyclicReplication
2016-07-09 01:05:10 +08:00
anoopsjohn
581d2b7de5
HBASE-16162 Compacting Memstore : unnecessary push of active segments to pipeline.
2016-07-06 18:54:35 +05:30
Elliott Clark
ae92668dd6
HBASE-16087 Replication shouldn't start on a master if if only hosts system tables
2016-07-05 13:50:37 -07:00
tedyu
20a99b4c06
HBASE-16144 Revert - test failure in TestMultiSlaveReplication#testMultiSlaveReplication seems to be related
2016-07-05 13:19:33 -07:00
Andrew Purtell
318751cfd6
HBASE-16091 Canary takes lot more time when there are delete markers in the table (Vishal Khandelwal)
2016-07-05 11:13:48 -07:00
tedyu
d016338e45
HBASE-16157 The incorrect block cache count and size are caused by removing duplicate block key in the LruBlockCache (ChiaPing Tsai)
2016-07-05 10:21:27 -07:00
tedyu
b5cdb38dc7
HBASE-16144 Replication queue's lock will live forever if RS acquiring the lock has died prematurely (Phil Yang)
2016-07-05 07:16:12 -07:00
Yu Li
7f44dfd85f
HBASE-16132 Scan does not return all the result when regionserver is busy (binlijin)
2016-07-04 21:45:04 +08:00
zhangduo
6944a17ad4
HBASE-16135 PeerClusterZnode under rs of removed peer may never be deleted
2016-07-04 19:26:27 +08:00
anoopsjohn
d22c23c396
HBASE-16163 Compacting Memstore : CompactionPipeline#addFirst can use LinkedList#addFirst.
2016-07-03 21:35:29 +05:30
anoopsjohn
97f2294bfd
HBASE-16164 Missing close of new compacted segments in few occasions which might leak MSLAB chunks from pool.
2016-07-02 11:42:08 +05:30
chenheng
561eb82968
HBASE-15844 We should respect hfile.block.index.cacheonwrite when write intermediate index Block
2016-07-02 09:04:15 +08:00
tedyu
fe75edb556
HBASE-16157 Revert - ChiaPing has new fix
2016-07-01 13:00:05 -07:00
tedyu
d92a99da0e
HBASE-16125 RegionMover uses hardcoded, Unix-style tmp folder - breaks Windows (Vladimir Rodionov)
2016-07-01 10:02:25 -07:00
tedyu
5a7c9939cb
HBASE-16157 The incorrect block cache count and size are caused by removing duplicate block key in the LruBlockCache (ChiaPing Tsai)
2016-07-01 09:43:39 -07:00
tedyu
cc73c03118
HBASE-16108 RowCounter should support multiple key ranges (Konstantin Ryakhovskiy)
2016-07-01 03:41:17 -07:00
anoopsjohn
139f0ed53c
HBASE-16155 Compacting Memstore : Few log improvements.
2016-07-01 10:14:07 +05:30
stack
d1d8cc71c9
HBASE-16150 Remove ConcurrentIndex (Hiroshi Ikeda)
2016-06-30 15:03:32 -07:00
Ramkrishna
e2566eb0ee
HBASE-16153 Correct the config name
...
'hbase.memestore.inmemoryflush.threshold.factor' (Ram)
2016-06-30 17:44:08 +05:30
Jonathan M Hsieh
e1d130946b
HBASE-16117 Fix Connection leak in mapred.TableOutputFormat
2016-06-29 17:18:43 -07:00
tedyu
42106b89b1
HBASE-16114 Get regionLocation of required regions only for MR jobs (Thiruvel Thirumoolan)
2016-06-29 16:34:44 -07:00
Ramkrishna
9b1ecb31f0
HBASE-16143 Change MemstoreScanner constructor to accept
...
List<KeyValueScanner> (Ram)
2016-06-29 23:10:55 +05:30
Jonathan M Hsieh
727394c2e9
HBASE-16140 bump owasp.esapi from 2.1.0 to 2.1.0.1
2016-06-29 08:51:00 -07:00
tedyu
6fb0dd07a8
HBASE-16139 Use CellUtil instead of KeyValueUtil in Import (NIDHI GAMBHIR)
2016-06-29 02:45:00 -07:00
Jingcheng Du
432868b038
HBASE-15976 RegionServerMetricsWrapperRunnable will be failure when disable blockcache. - Addendum
2016-06-29 16:31:23 +08:00
tedyu
394e7224a9
HBASE-16122 PerformanceEvaluation should provide user friendly hint when client threads argument is missing (Konstantin Ryakhovskiy)
2016-06-28 17:42:51 -07:00
Matteo Bertozzi
8bc4d4131c
HBASE-16121 Require only MasterServices to the ServerManager constructor
2016-06-28 07:42:40 -07:00
Jingcheng Du
e768c4afac
HBASE-15976 RegionServerMetricsWrapperRunnable will be failure when disable blockcache.
2016-06-28 13:45:41 +08:00
tedyu
13cf4fb3fc
HBASE-16052 Improve HBaseFsck Scalability (Ben Lau)
2016-06-27 13:24:35 -07:00
tedyu
424b789e03
HBASE-14007 Writing to table through MR should fail upfront if table does not exist/is disabled (Thiruvel Thirumoolan)
2016-06-27 06:41:00 -07:00
tedyu
ba9286911f
HBASE-16109 Add Interface audience annotation to a few classes
2016-06-27 06:29:04 -07:00
Elliott Clark
fc4b8aa89d
HBASE-16089 Add on FastPath for CoDel
2016-06-25 12:57:15 -07:00
Matteo Bertozzi
e8599a2921
HBASE-16103 Procedure v2 - TestCloneSnapshotProcedure relies on execution order
2016-06-24 09:09:59 -07:00
Ramkrishna
99dc300d37
HBASE-16055 PutSortReducer loses any Visibility/acl attribute set on the
...
Puts (Ram)
2016-06-24 15:09:53 +05:30
Jingcheng Du
518faa735b
HBASE-15353 Add metric for number of CallQueueTooBigException's
2016-06-24 13:00:06 +08:00
chenheng
68c1b34dbc
HBASE-16040 Remove configuration "hbase.replication"
2016-06-24 10:41:35 +08:00
Gary Helmling
f4cec2e202
HBASE-16085 Add a metric for failed compactions
2016-06-23 15:38:58 -07:00
tedyu
9cd097cfac
HBASE-16090 ResultScanner is not closed in SyncTable#finishRemainingHashRanges()
2016-06-23 07:28:35 -07:00
Matteo Bertozzi
d66316fd80
HBASE-16068 Procedure v2 - use consts for conf properties in tests
2016-06-22 22:48:07 -07:00
Ramkrishna
c1a559a666
HBASE-16070 Mapreduce Serialization classes do not have Interface audience
...
(Ram)
2016-06-23 10:22:24 +05:30
tedyu
d297ecdf3c
HBASE-16083 Addendum fixes config property names in tests (Joseph Hwang)
2016-06-22 17:31:57 -07:00
tedyu
0ea4d2f461
HBASE-16083 revert Addendum - Joseph discovered the mistake first
2016-06-22 17:31:24 -07:00
tedyu
da09fd0781
HBASE-16083 Addendum fixes config property names in tests
2016-06-22 16:35:37 -07:00
Joseph Hwang
f3b3a7c9b5
HBASE-16080 Fix flakey test TestTableBasedReplicationSourceManager.cleanupFailoverQueues().
...
Instead of running the primary test in a separate thread and hoping it finishes in time, just run the test in the primary thread.
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-06-22 12:26:35 -07:00
tedyu
6fc71c5d31
HBASE-16049 TestRowProcessorEndpoint is failing on Apache Builds (Guanghao Zhang)
2016-06-22 12:24:07 -07:00
tedyu
2846113b59
HBASE-16012 Major compaction can't work due to obsolete scanner read point in RegionServer (Guanghao Zhang)
2016-06-22 02:08:45 -07:00
Joseph Hwang
152594560e
HBASE-16036 Made Replication Table creation non-blocking.
...
All ReplicationTableBase method's that need to access the Replication Table will block until it is created though.
Also refactored ReplicationSourceManager so that abandoned queue adoption is run in the background too so that it does not block HRegionServer initialization.
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-06-21 13:05:50 -07:00
tedyu
b006e41a37
HBASE-16051 TestScannerHeartbeatMessages fails on some machines (Phil Yang)
2016-06-21 07:32:30 -07:00
Yu Li
471f942ec8
HBASE-16032 Possible memory leak in StoreScanner
2016-06-21 20:06:33 +08:00
tedyu
3de0c63105
HBASE-16035 Nested AutoCloseables might not all get closed (Sean Mackrory)
2016-06-20 16:25:50 -07:00
Matteo Bertozzi
313a3d23a8
HBASE-14644 Region in transition metric is broken -- addendum (Huaxiang Sun)
2016-06-20 10:46:25 -07:00
tedyu
be56b5ae71
HBASE-16059 Region normalizer fails to trigger merge action where one of the regions is empty
2016-06-20 10:40:50 -07:00
tedyu
095a82584e
HBASE-16062 Improper error handling in WAL Reader/Writer creation (Vladimir Rodionov)
2016-06-20 07:34:26 -07:00
Ramkrishna
71c8cd5b1f
HBASE-16042 Add support in PE tool for InMemory Compaction (Ram)
2016-06-20 16:29:24 +05:30
stack
01684c3417
HBASE-16023 Fastpath for the FIFO rpcscheduler AMENDMENT
2016-06-20 08:34:32 +01:00
Yu Li
4421fdf981
HBASE-16066 Resolve RpC_REPEATED_CONDITIONAL_TEST findbugs warnings in HMaster, addendum to HBASE-15467
2016-06-19 17:25:26 +08:00
Enis Soztutar
6717f0e388
HBASE-16058 TestHRegion fails on 1.4 builds
2016-06-17 18:41:51 -07:00
Enis Soztutar
bdb0cc8808
HBASE-15467 Remove 1.x/2.0 TableDescriptor incompatibility
2016-06-17 17:25:04 -07:00
Enis Soztutar
81a9c1ac31
HBASE-16053 Master code is not setting the table in ENABLING state in create table
2016-06-17 13:29:33 -07:00
Joseph Hwang
61ff6ced5b
HBASE-16018 Refactored the ReplicationPeers interface to clear up what some methods do and move away from a ZooKeeper-specific implementation.
...
Also added some documentation for undocumented methods.
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-06-17 13:04:21 -07:00
tedyu
5147fb12a5
HBASE-16048 Tag InternalScanner with LimitedPrivate(HBaseInterfaceAudience.COPROC)
2016-06-17 07:27:52 -07:00
Ashu Pachauri
3abd52bdc6
HBASE-15429 Add split policy for busy regions
...
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-06-16 17:36:54 -07:00
tedyu
6d0e0e3721
HBASE-5291 Addendum 2 passes correct path to deleteRecursively
2016-06-16 17:00:57 -07:00
tedyu
d8902ba0e6
HBASE-16045 endtime argument for VerifyReplication was incorrectly specified in usage
2016-06-16 15:50:29 -07:00
Mikhail Antonov
62a4a2c029
HBASE-16047 TestFastFail is broken again
2016-06-16 14:09:48 -07:00
Yu Li
6d02f36ac7
HBASE-16033 Add more details in logging of responseTooSlow/TooLarge
2016-06-16 16:42:10 +08:00
Ramkrishna
f19f1d9e99
HBASE-15999 NPE in MemstoreCompactor (Ram)
2016-06-16 10:06:40 +05:30
tedyu
1bad166f67
HBASE-5291 Addendum removes duplicate spnego (Josh Elser)
2016-06-15 14:59:17 -07:00
Enis Soztutar
bff35d6387
HBASE-15950 Fix memstore size estimates to be more tighter
2016-06-15 13:34:39 -07:00
Mikhail Antonov
5f9d1a71c8
HBASE-16026 Master UI should display status of additional ZK switches
2016-06-15 12:59:24 -07:00
Joseph Hwang
2093aadec1
HBASE-15974 Create a ReplicationQueuesClientHBaseImpl
...
Building on HBase-15958.
Provided a ReplicationQueuesClientHBaseImpl that relies on the HBase Replication Table to track WAL queues.
Refactored out a large section of ReplicationQueuesHBaseImpl into a ReplicationTableClient class that handles Replication Table operations.
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-06-15 10:43:14 -07:00
tedyu
ae5fe1e616
HBASE-5291 Add Kerberos HTTP SPNEGO authentication support to HBase web consoles (Josh Elser)
2016-06-15 09:26:44 -07:00
tedyu
6c60bc9f6c
HBASE-16017 HBase TableOutputFormat has connection leak in getRecordWriter (Zhan Zhang)
2016-06-15 06:32:23 -07:00
chenheng
db234bf15d
HBASE-16023 Fastpath for the FIFO rpcscheduler. addendum
2016-06-15 16:20:55 +08:00
stack
ee86e91e7e
HBASE-16023 Fastpath for the FIFO rpcscheduler Adds an executor that does balanced queue and fast path handing off requests directly to waiting handlers if any present. Idea taken from Apace Kudu (incubating). See https://gerrit.cloudera.org/#/c/2938/7/src/kudu/rpc/service_queue.h
...
M hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/RpcExecutor.java
Refactor which makes a Handler type. Put all 'handler' stuff inside this
new type. Also make it so subclass can provide its own Handler type.
M hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/SimpleRpcScheduler.java
Name the handler threads for their type so can tell if configs are
having an effect.
Signed-off-by: stack <stack@apache.org>
2016-06-14 17:42:01 -07:00
stack
fa50d456a8
HBASE-15971 Regression: Random Read/WorkloadC slower in 1.x than 0.98 Restore FIFO as the default in place of 'deadline' that sorted on request priority. The sort costs us throughput. Enable it if you want it rather than have it as default.
...
Name threads to include the scheduler type.
2016-06-14 16:51:24 -07:00
Stephen Yuan Jiang
df24004353
HBASE-15746 Remove extra RegionCoprocessor preClose() in RSRpcServices#closeRegion (Stephen Yuan Jiang)
2016-06-14 13:30:41 -07:00
anoopsjohn
17bcf14fea
HBASE-15525 OutOfMemory could occur when using BoundedByteBufferPool during RPC bursts.
2016-06-14 19:03:54 +05:30
Stephen Yuan Jiang
e486d274c5
HBASE-16016 Fix overflow deadline value in AssignmentManager#waitForAssignment (Stephen Yuan Jiang)
2016-06-13 18:21:41 -07:00
Ramkrishna
56c209c8aa
HBASE-15991 CompactingMemstore#InMemoryFlushRunnable should implement
...
Comparable/Comparator (Ram)
2016-06-13 17:42:35 +05:30
Ramkrishna
2d0448fa84
Revert HBASE-15991 commit
2016-06-13 15:05:50 +05:30
Ramkrishna
2738518d43
HBASE-15991 CompactingMemstore#InMemoryFlushRunnable should implement
...
Comparable/Comparator (Ram)
2016-06-13 12:43:52 +05:30
tedyu
6360cc0307
HBASE-16007 Job's Configuration should be passed to TableMapReduceUtil#addDependencyJars() in WALPlayer
2016-06-11 07:05:27 -07:00
Matteo Bertozzi
4c885f4fdb
HBASE-14644 Region in transition metric is broken (Huaxiang Sun)
2016-06-10 21:52:24 -07:00
Sean Mackrory
6da6babe4f
HBASE-15946. Eliminate possible security concerns in Store File metrics.
...
Invoking 'hbase hfile' inside a servlet raises several concerns. This
patch avoids invoking a separate process, and also adds validation that
the file being read is at least inside the HBase root directory.
Signed-off-by: Mikhail Antonov <antonov@apache.org>
2016-06-09 16:08:19 -07:00
Joseph Hwang
babdedc1b0
HBASE-15958 Implement ClaimQueues on top of HBase
...
Building on HBase-15883.
Now implementing the claim queues procedure within an HBase table.
Also added UnitTests to test claimQueue.
Peer tracking will still be performed by ZooKeeper though.
Also modified the queueId tracking procedure so we no longer have to perform scans over the Replication Table.
This does make our queue naming schema slightly different from ReplicationQueuesZKImpl though.
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-06-09 15:05:54 -07:00
tedyu
55a04b7810
HBASE-15990 The priority value of subsequent coprocessors in the Coprocessor.Priority.SYSTEM list are not incremented by one (ChiaPing Tsai)
2016-06-09 10:26:10 -07:00
Ashish Singhi
9012a0b123
HBASE-15952 Bulk load data replication is not working when RS user does not have permission on hfile-refs node
2016-06-09 18:44:29 +05:30
stack
031b745001
HBASE-15994 Allow selection of RpcSchedulers
...
Adds logging by the RpcExecutors of their run configs
Adds a FifoRpcSchedulerFactory so you can try Fifo scheduler.
2016-06-08 20:23:11 -07:00
stack
407aa4d496
Revert "HBASE-15994 Allow selection of RpcSchedulers Adds logging by the RpcExecutors of their run configs Changes the default RpcSchedulerFactory from SimpleRpcSchedulerFactory.class to RpcSchedulerFactoryImpl.class. RpcSchedulerFactoryImpl.class. defaults to using SimpleRpcSchedulerFactory.class and the SimpleRpcScheduler, as has been default up to this, unless you set "hbase.region.server.rpc.scheduler.class" to org.apache.hadoop.hbase.ipc.FifoRpcScheduler"
...
This reverts commit 3ac4a57fd2
.
2016-06-08 20:22:50 -07:00
stack
3ac4a57fd2
HBASE-15994 Allow selection of RpcSchedulers Adds logging by the RpcExecutors of their run configs Changes the default RpcSchedulerFactory from SimpleRpcSchedulerFactory.class to RpcSchedulerFactoryImpl.class. RpcSchedulerFactoryImpl.class. defaults to using SimpleRpcSchedulerFactory.class and the SimpleRpcScheduler, as has been default up to this, unless you set "hbase.region.server.rpc.scheduler.class" to org.apache.hadoop.hbase.ipc.FifoRpcScheduler
...
Signed-off-by: stack <stack@apache.org>
2016-06-08 20:20:50 -07:00
Jonathan M Hsieh
a7172d5611
HBASE-15959 Fix flaky test TestRegionServerMetrics.testMobMetrics (Huaxiang Sun and Jingcheng Du)
2016-06-08 19:07:13 -07:00
Matteo Bertozzi
d9463bcce0
HBASE-15989 Remove hbase.online.schema.update.enable
2016-06-08 13:09:31 -07:00
Matteo Bertozzi
d5d9b7d500
HBASE-15107 Procedure v2 - Procedure Queue with Region locks
2016-06-08 12:52:58 -07:00
Enis Soztutar
d05a3722c8
HBASE-15600 Add provision for adding mutations to memstore or able to write to same region in batchMutate coprocessor hooks (Rajeshbabu and Enis)
2016-06-07 20:12:51 -07:00
stack
3a95552cfe
HBASE-15948 Port "HADOOP-9956 RPC listener inefficiently assigns connections to readers" Adds HADOOP-9955 RPC idle connection closing is extremely inefficient
...
Changes how we do accounting of Connections to match how it is done in Hadoop.
Adds a ConnectionManager class. Adds new configurations for this new class.
"hbase.ipc.client.idlethreshold" 4000
"hbase.ipc.client.connection.idle-scan-interval.ms" 10000
"hbase.ipc.client.connection.maxidletime" 10000
"hbase.ipc.client.kill.max", 10
"hbase.ipc.server.handler.queue.size", 100
The new scheme does away with synchronization that purportedly would freeze out
reads while we were cleaning up stale connections (according to HADOOP-9955)
Also adds in new mechanism for accepting Connections by pulling in as many
as we can at a time adding them to a Queue instead of doing one at a time.
Can help when bursty traffic according to HADOOP-9956. Removes a blocking
while Reader is busy parsing a request. Adds configuration
"hbase.ipc.server.read.connection-queue.size" with default of 100 for
queue size.
Signed-off-by: stack <stack@apache.org>
2016-06-07 16:42:21 -07:00
stack
e66ecd7db6
Revert "HBASE-15948 Port "HADOOP-9956 RPC listener inefficiently assigns connections to readers""
...
Revert mistaken commit...
This reverts commit e0b70c00e7
.
2016-06-07 16:41:30 -07:00
stack
6d5a25935e
Revert "HBASE-15967 Metric for active ipc Readers and make default fraction of cpu count"
...
Revert mistaken commit
This reverts commit 1125215aad
.
2016-06-07 16:41:01 -07:00
stack
1125215aad
HBASE-15967 Metric for active ipc Readers and make default fraction of cpu count
...
Add new metric hbase.regionserver.ipc.runningReaders
Also make it so Reader count is a factor of processor count
2016-06-07 13:10:14 -07:00
stack
e0b70c00e7
HBASE-15948 Port "HADOOP-9956 RPC listener inefficiently assigns connections to readers"
...
Adds HADOOP-9955 RPC idle connection closing is extremely inefficient
Then removes queue added by HADOOP-9956 at Enis suggestion
Changes how we do accounting of Connections to match how it is done in Hadoop.
Adds a ConnectionManager class. Adds new configurations for this new class.
"hbase.ipc.client.idlethreshold" 4000
"hbase.ipc.client.connection.idle-scan-interval.ms" 10000
"hbase.ipc.client.connection.maxidletime" 10000
"hbase.ipc.client.kill.max", 10
"hbase.ipc.server.handler.queue.size", 100
The new scheme does away with synchronization that purportedly would freeze out
reads while we were cleaning up stale connections (according to HADOOP-9955)
Also adds in new mechanism for accepting Connections by pulling in as many
as we can at a time adding them to a Queue instead of doing one at a time.
Can help when bursty traffic according to HADOOP-9956. Removes a blocking
while Reader is busy parsing a request. Adds configuration
"hbase.ipc.server.read.connection-queue.size" with default of 100 for
queue size.
2016-06-07 13:10:14 -07:00
Andrew Purtell
376ad0d986
HBASE-15698 Increment TimeRange not serialized to server (Ted Yu)
2016-06-06 22:17:00 -07:00
Enis Soztutar
3d7840a173
HBASE-15954 REST server should log requests with TRACE instead of DEBUG
2016-06-06 10:58:37 -07:00
Stephen Yuan Jiang
de1b5ff776
HBASE-15955 Disable action in CatalogJanitor#setEnabled should wait for active cleanup scan to finish (Stephen Yuan Jiang)
2016-06-03 15:49:23 -07:00
Joseph Hwang
21e98271c3
HBASE-15883 Adding WAL files and tracking offsets in HBase.
...
Implemented ReplicationQueuesHBaseImpl that tracks WAL offsets and replication queues in an HBase table.
Only wrote the basic tracking methods, have not implemented claimQueue() or HFileRef methods yet.
Wrote a basic unit test for ReplicationQueueHBaseImpl that tests the implemented functions on a single Region Server
Signed-off-by: Elliott Clark <elliott@fb.com>
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-06-03 15:23:10 -07:00
Apekshit
9a53d8b385
HBASE-15929 There are two tests named TestRegionServerMetrics. This causes slight issues when parsing console output for hanging tests and flaky tests analysis. Moving .../hbase/TestRegionServerMetrics.java to .../hbase/regionserver/TestRegionServerReadRequestMetrics.java. (Apekshit)
...
Change-Id: I379c15fe2c2c01bed53bddf7619d5f2a07c5640e
2016-06-03 15:13:49 -07:00
Apekshit
b557f0bec6
HBASE-15949 Cleanup TestRegionServerMetrics.
...
@Before and @After to setup/teardown tables using @Rule to set table name based on testname.
Refactor out copy-pasted code fragments to single function.
(Apekshit)
Change-Id: Ic22e5027cc3952bab5ec30070ed20e98017db65a
2016-06-03 14:27:24 -07:00
Matteo Bertozzi
f0c159b5fe
HBASE-15927 Remove HMaster.assignRegion()
2016-06-03 12:36:25 -07:00
Ashish Singhi
0cbce07626
HBASE-15888 Extend HBASE-12769 for bulk load data replication
2016-06-03 18:42:00 +05:30
Lars Hofhansl
fc890a2ecb
HBASE-15881 Allow BZIP2 compression.
2016-06-02 12:19:02 -07:00
tedyu
7e5d530870
HBASE-15727 Canary Tool for Zookeeper (churro morales)
2016-06-02 10:15:08 -07:00
tedyu
cd2588001c
HBASE-15933 Addendum - make merge decision when sizes of both regions are known
2016-06-02 09:30:36 -07:00
tedyu
cfe868d56e
HBASE-15933 NullPointerException may be thrown from SimpleRegionNormalizer#getRegionSize()
2016-06-02 01:55:28 -07:00
Apekshit
1a27278624
HBASE-15915 Set timeouts on hanging tests. Tests run: 8, Time elapsed: 94.191 sec - in org.apache.hadoop.hbase.master.procedure.TestMasterFailoverWithProcedures Tests run: 103, Time elapsed: 69.057 sec - in org.apache.hadoop.hbase.regionserver.TestHRegion Tests run: 103, Time elapsed: 67.957 sec - in org.apache.hadoop.hbase.regionserver.TestHRegionWithInMemoryFlush Tests run: 5, Time elapsed: 34.629 sec - in org.apache.hadoop.hbase.regionserver.TestRegionMergeTransactionOnCluster Tests run: 9, Time elapsed: 82.913 sec - in org.apache.hadoop.hbase.snapshot.TestFlushSnapshotFromClient Tests run: 9, Time elapsed: 80.458 sec - in org.apache.hadoop.hbase.snapshot.TestMobFlushSnapshotFromClient (Apekshit)
...
Change-Id: Ia7b986ca6276ff5498f588c0b1b9c570e2a9d798
Signed-off-by: stack <stack@apache.org>
2016-05-30 21:13:55 -07:00
Daniel Vimont
e6d613de70
HBASE-15835 - Prevent HBaseTestingUtility#startMiniCluster from throwing _HMasterAddress already in use_ RuntimeException when another HBase thread is running
...
Signed-off-by: stack <stack@apache.org>
2016-05-30 20:05:19 -07:00
Jurriaan Mous
a1f0c1cbb3
HBASE-15875 Remove HTable references and HTableInterface
...
Signed-off-by: stack <stack@apache.org>
2016-05-30 19:56:54 -07:00
Jurriaan Mous
cdd532da8a
HBASE-15610 Remove deprecated HConnection for 2.0 thus removing all PB references for 2.0
...
Signed-off-by: stack <stack@apache.org>
2016-05-29 07:50:55 -07:00
Sean Mackrory
f4470af95d
HBASE-15891. Closeable resources potentially not getting closed if exception is thrown.
...
Signed-off-by: stack <stack@apache.org>
2016-05-28 21:32:22 -07:00
Sean Mackrory
3b6e6e6c25
HBASE-15889. String case conversions are locale-sensitive, used without locale
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-05-28 10:41:31 -07:00
Mikhail Antonov
60c8f76a9d
HBASE-15908 Checksum verification is broken due to incorrect passing of ByteBuffers in DataChecksum (Mikhail Antonov and Appy)
2016-05-28 03:14:52 -07:00
Gary Helmling
da0d74cd27
HBASE-15830 SASL encryption doesn't work with AsyncRpcChannelImpl (Colin Ma)
2016-05-26 21:58:27 -07:00
Enis Soztutar
43d1a999fe
HBASE-15837 Memstore size accounting is wrong if postBatchMutate() throws exception
2016-05-26 11:12:17 -07:00
Apekshit
94696d4067
HBASE-14635 Fix flaky test TestSnapshotCloneIndependence
...
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2016-05-25 21:14:06 -07:00
Joseph Hwang
b3362ccb0c
HBASE-15471 Added in Priority, General, and Replication queue sizes for RegionServers to the Web UI
...
Changed UI labels so that queue "size" refers to size in bytes and queue "length" refers to number of items in queue.
Signed-off-by: Elliott Clark <elliott@fb.com>
2016-05-25 15:10:48 -07:00
tedyu
fa74baeb40
HBASE-15884 NPE in StoreFileScanner#skipKVsNewerThanReadpoint during reverse scan (Sergey Soldatov)
2016-05-25 08:58:28 -07:00
tedyu
39dc19236e
HBASE-15806 revert due to discussion on security
2016-05-24 02:08:11 -07:00
tedyu
c03ea895c4
HBASE-15806 An endpoint-based export tool (ChiaPing Tsai)
2016-05-23 10:51:25 -07:00
Jurriaan Mous
7130a222ce
HBASE-15876 Remove doBulkLoad(Path hfofDir, final HTable table) though it has not been through a full deprecation cycle
...
Signed-off-by: stack <stack@apache.org>
2016-05-23 10:25:22 -07:00
tedyu
ae42c65cfd
HBASE-15802 ConnectionUtils should use ThreadLocalRandom instead of Random (Matt Warhaftig)
2016-05-21 21:15:10 -07:00
Jerry He
56e4b85d06
HBASE-14818 user_permission does not list namespace permissions (li xiang)
2016-05-21 20:06:05 -07:00
tedyu
0671cba65f
HBASE-15529 Override needBalance in StochasticLoadBalancer (Guanghao Zhang)
2016-05-21 04:03:00 -07:00
anoopsjohn
0e52ac2464
HBASE-15228 Add the methods to RegionObserver to trigger start/complete restoring WALs. (Toshihiro Suzuki)
2016-05-21 09:56:28 +05:30
tedyu
2bb07e209e
HBASE-15529 Revert due to TestRegionRebalancing failing
2016-05-20 12:56:17 -07:00
Gary Helmling
4793988aef
HBASE-15856 Don't cache unresolved addresses for connections
2016-05-20 09:36:11 -07:00
tedyu
58798fc091
HBASE-15529 Override needBalance in StochasticLoadBalancer (Guanghao Zhang)
2016-05-20 07:44:05 -07:00
Matteo Bertozzi
d34f5d4b96
HBASE-15865 Move TestTableDeleteFamilyHandler and TestTableDescriptorModification handler tests to procedure
2016-05-20 07:03:11 -07:00
Matteo Bertozzi
7a84ee262f
HBASE-15864 Reuse the testing helper to wait regions in transition
2016-05-20 06:48:38 -07:00
eshcar
a27504c701
HBASE-14920: Compacting memstore
...
Signed-off-by: stack <stack@apache.org>
2016-05-20 03:41:43 -07:00
Jerry He
af5146ee04
HBASE-15465 userPermission returned by getUserPermission() for the selected namespace does not have namespace set (li xiang)
2016-05-19 20:35:58 -07:00
tedyu
a050e1d9f8
HBASE-15847 VerifyReplication prefix filtering (Geoffrey Jacoby)
2016-05-19 06:38:27 -07:00
Vincent
460b41c800
HBASE-15617 Canary in regionserver mode might not enumerate all regionservers
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2016-05-18 16:25:29 -07:00
Stephen Yuan Jiang
8aa8abfcb6
HBASE-15850 Localize the configuration change in testCheckTableLocks to reduce flakiness of TestHBaseFsck test suite (Stephen Yuan Jiang)
2016-05-18 13:22:41 -07:00
Matteo Bertozzi
5ac54e6abb
HBASE-15843 Replace RegionState.getRegionInTransition() Map with a Set
2016-05-18 12:48:26 -07:00
Jerry He
393bcd69f9
HBASE-15841 Performance Evaluation tool total rows may not be set correctly
2016-05-18 12:09:13 -07:00
Enis Soztutar
c1ada0a373
HBASE-15824 LocalHBaseCluster gets bind exception in master info port - ADDENDUM
2016-05-18 11:36:10 -07:00
Phil Yang
3bd9220f0c
HBASE-15593 Time limit of scanning should be offered by client
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-05-18 19:13:15 +08:00
Ramkrishna
7b5d5394c0
HBASE-15784 Misuse core/maxPoolSize of LinkedBlockingQueue in
...
ThreadPoolExecutor (Jingcheng Du)
2016-05-18 12:40:43 +05:30
zhangduo
b2b3b1fa4d
Revert "HBASE-15593 Time limit of scanning should be offered by client (Phil Yang)"
...
This reverts commit e47bfb9078
.
2016-05-18 13:08:50 +08:00
stack
e47bfb9078
HBASE-15593 Time limit of scanning should be offered by client (Phil Yang)
2016-05-17 12:49:31 -07:00
Elliott Clark
9269b8199e
HBASE-15840 WAL.proto compilation broken for cpp
2016-05-17 12:04:14 -07:00
tedyu
838c306c0a
HBASE-15769 Perform validation on cluster key for add_peer (Matt Warhaftig)
2016-05-17 11:01:26 -07:00
tedyu
00e61d2cfd
HBASE-15842 SnapshotInfo should display ownership information
2016-05-16 20:34:04 -07:00
Enis Soztutar
c3223a59ff
HBASE-15824 LocalHBaseCluster gets bind exception in master info port
2016-05-16 10:32:43 -07:00
Sean Busbey
e0aff10901
HBASE-15780 Make AuthUtil public and rely on it for talking to secure HBase.
...
Signed-off-by: Gary Helmling <garyh@apache.org>
Signed-off-by: Mikhail Antonov <antonov@apache.org>
Signed-off-by: stack <stack@apache.org>
2016-05-16 00:50:14 -05:00
Mikhail Antonov
2482062d34
HBASE-15615 Wrong sleep time when RegionServerCallable need retry (Guanghao Zhang)
2016-05-15 20:37:26 -07:00
Apekshit
60e19f60a9
HBASE-13532 Make UnknownScannerException less scary by giving more information in the exception string. (Apekshit)
...
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2016-05-13 15:00:23 -07:00
Jerry He
acca95fb50
HBASE-15808 Reduce potential bulk load intermediate space usage and waste
2016-05-12 15:43:48 -07:00
zhangduo
1267f76e9a
HBASE-15813 Rename DefaultWALProvider to a more specific name and clean up unnecessary reference to it
2016-05-12 11:27:00 +08:00
tedyu
c867858c44
HBASE-15812 Revert pending investigation on whether metrics dump can be re-implemented
2016-05-11 09:39:20 -07:00
tedyu
f3fee82ac4
HBASE-15812 HttpServer fails to come up against hadoop trunk
2016-05-11 09:00:27 -07:00
Jurriaan Mous
a11091c49c
HBASE-15798 Add Async RpcChannels to all RpcClients
...
Signed-off-by: stack <stack@apache.org>
2016-05-10 07:44:51 -07:00
Matteo Bertozzi
8604f9eebb
HBASE-15415 Improve Master WebUI snapshot information (huaxiang sun)
2016-05-09 20:20:49 -07:00
Apekshit
11740570c1
HBASE-15236 Inconsistent cell reads over multiple bulk-loaded HFiles. In KeyValueHeap, if two cells are same i.e. have same key and timestamp, then instead of directly using seq id to determine newer one, we should use StoreFile.Comparater.SEQ_ID because that's what is used to determine order of hfiles. In this patch, we assign each scanner an order based on it's index in storefiles list, which is then used in KeyValueHeap to disambiguate between same cells. Changes the getSequenceId() in KeyValueScanner class to getScannerOrder(). Testing: Adds unit test to TestKeyValueHeap. Manual testing: Three cases (Tables t, t2, t3 in the jira description), single region, 2 hfiles with same seq id, timestamps and duplicate KVs. Made sure that returned kv was same for get and scan. (Apekshit)
...
Change-Id: I22600c91c0a51fb63eb17db73472839d2f13957c
Signed-off-by: stack <stack@apache.org>
2016-05-09 16:57:06 -07:00
Esteban Gutierrez
a6e29676db
HBASE-15612: Minor improvements to CellCounter and RowCounter documentation
...
Signed-off-by: stack <stack@apache.org>
2016-05-09 14:12:43 -07:00
Enis Soztutar
b75b226804
HBASE-15740 Replication source.shippedKBs metric is undercounting because it is in KB
2016-05-09 10:25:49 -07:00
zhangduo
05378cbf69
HBASE-15609 Addendum fix compilation error
2016-05-09 20:45:04 +08:00
Ramkrishna
97ad33c691
HBASE-15609 Remove PB references from Result, DoubleColumnInterpreter and
...
any such public facing class for 2.0 (Ram)
2016-05-09 14:56:00 +05:30
Apekshit
48b77dbcbc
HBASE-11625 - Verifies data before building HFileBlock. - Adds HFileBlock.Header class which contains information about location of fields. Testing: Adds CorruptedFSReaderImpl to TestChecksum.
...
Change-Id: I107e9636b28abb6b15ec329e885f1e31b1b1b988
Signed-off-by: stack <stack@apache.org>
2016-05-08 17:33:04 -07:00
Matteo Bertozzi
99e2deb86f
HBASE-15778 replace master.am and master.sm direct access with getter calls
2016-05-07 05:19:15 -07:00
Matteo Bertozzi
513ca3483f
HBASE-15776 Replace master.am.getTableStateManager() with the direct master.getTableStateManager()
2016-05-06 19:30:45 -07:00
Gary Helmling
86ca09e0e5
HBASE-15773 Improvements to CellCounter job
2016-05-06 11:08:18 -07:00
Matteo Bertozzi
d90f0571e6
HBASE-15781 Remove unused TableEventHandler and TotesHRegionInfo
2016-05-06 10:05:42 -07:00
Ashish Singhi
34e9a6ff30
HBASE-15669 HFile size is not considered correctly in a replication request
2016-05-06 17:26:17 +05:30
Ramkrishna
bec81b1977
HBASE-15608 Remove PB references from SnapShot related Exceptions (ram)
2016-05-06 17:06:25 +05:30
zhangduo
0d252918f6
HBASE-15743 Add Transparent Data Encryption support for FanOutOneBlockAsyncDFSOutput
2016-05-06 08:55:58 +08:00
tedyu
532b914f08
HBASE-15759 RegionObserver.preStoreScannerOpen() doesn't have acces to current readpoint
2016-05-05 15:20:37 -07:00
tedyu
c716a75416
HBASE-15767 upgrade httpclient to 4.3.6
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-05-05 15:41:26 -05:00
Alex Moundalexis
0bf065a5d5
HBASE-15768 fix capitalization of ZooKeeper usage
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-05-05 15:35:44 -05:00
Stephen Yuan Jiang
b7ce55f001
HBASE-15575 Rename table DDL *Handler methods in MasterObserver to more meaningful names (Stephen Yuan Jiang)
2016-05-05 11:44:22 -07:00