Commit Graph

5096 Commits

Author SHA1 Message Date
Francis Liu 38471229f9 HBASE-20174 Fix TestZKLessMergeOnCluster flakiness 2018-03-12 16:57:59 -07:00
Ashish Singhi e81abb7259 HBASE-20146 Regions are stuck while opening when WAL is disabled
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-03-09 21:27:00 +08:00
Abhishek Singh Chouhan 41ff229a16 HBASE-20139 NPE in RSRpcServices.get() when getRegion throws an exception 2018-03-07 12:09:04 +05:30
Apekshit Sharma c4401b6073 HBASE-19400 Add missing security checks in MasterRpcServices
- Added ADMIN permission check for following rpc calls:
  normalize, setNormalizerRunning, runCatalogScan, enableCatalogJanitor, runCleanerChore,
  setCleanerChoreRunning, execMasterService, execProcedure, execProcedureWithRet
- Moved authorizationEnabled check to start of AccessChecker's functions. Currently, and IDK why,
  we call authManager.authorize() first and then discard its result if authorizationEnabled is false. Weird.

----

HBASE-19401 Add missing security checks in RSRpcServices
2018-02-28 11:52:16 -08:00
Sergey Soldatov cdbf001d26 HBASE-19863 java.lang.IllegalStateException: isDelete failed when SingleColumnValueFilter is used
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
Signed-off-by: ramkrish86 <ramkrishna.s.vasudevan@gmail.com>
2018-02-28 13:35:43 -05:00
Andrew Purtell 1be9a3d641 HBASE-20087 Periodically attempt redeploy of regions in FAILED_OPEN state
Signed-off-by: Josh Elser <elserj@apache.org>
2018-02-27 17:11:44 -08:00
Andrew Purtell 9a7a36750f HBASE-20102 AssignmentManager#shutdown doesn't shut down scheduled executor
Signed-off-by: Josh Elser <elserj@apache.org>
2018-02-27 17:11:28 -08:00
Ben Lau 27f803f320 HBASE-19989 Addendum - temp override for tests to be added later for HBASE-20001
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-02-27 17:06:32 -08:00
Rahul Gidwani 40e0ee331c HBASE-19989 - READY_TO_MERGE and READY_TO_SPLIT do not update region state correctly
Author: Ben Lau <benlau@oath.com>
2018-02-27 12:41:48 -08:00
Thiruvel Thirumoolan ece68d3c65 HBASE-20001 cleanIfNoMetaEntry() uses encoded instead of region name to lookup region
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-02-26 18:01:28 -08:00
Sean Busbey a37c91bb41 HBASE-20061 HStore synchronized member variable filesCompacting should be private
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>

 Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
2018-02-24 10:59:18 -06:00
Pankaj Kumar 343cdda9ae HBASE-19364, Truncate_preserve fails with table when replica region > 1 2018-02-23 14:13:02 -08:00
Sean Busbey ba7a936f74 Revert "HBASE-9465 Push entries to peer clusters serially"
This reverts commit 441bc050b9.

 Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/replication/ReplicationAdmin.java
	hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/WALProtos.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/Replication.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/ReplicationSource.java

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-02-23 14:42:15 +08:00
Sean Busbey 0a284d2b76 Revert "HBASE-17010 Serial replication should handle daughter regions being assigned to another RS (Phil Yang)"
This reverts commit 97276da9a7.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-02-23 14:42:04 +08:00
tedyu 4d9589b165 HBASE-20052 TestRegionOpen#testNonExistentRegionReplica fails due to NPE 2018-02-22 12:41:13 -08:00
Michael Stack cadc2efd12 HBASE-19391 Calling HRegion#initializeRegionInternals from a region replica can still re-create a region directory; ADDEDNDUM to fix TestRegionOpen failure 2018-02-22 09:27:46 -08:00
Chia-Ping Tsai af1f7cf431 HBASE-20016 TestCatalogJanitorInMemoryStates#testInMemoryForReplicaParentCleanup is flaky 2018-02-22 09:44:37 +08:00
Pankaj Kumar a189674b4c HBASE-19553, Old replica regions should be cleared from AM memory after primary region split or merge
Signed-off-by: Ted Yu <tedyu@apache.org>
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
2018-02-21 16:52:40 -08:00
Esteban Gutierrez 9e7e58d551 HBASE-19391 Calling HRegion#initializeRegionInternals from a region replica can still re-create a region directory 2018-02-21 16:25:13 -08:00
Andrew Purtell c5e692c1dc HBASE-20027 Add test TestClusterPortAssignment
LocalHBaseCluster forces random port assignment for sake of concurrent unit test
execution friendliness, but we still need a positive test for RPC and info port
assignment.
2018-02-21 13:12:26 -08:00
Toshihiro Suzuki c0bca137ff HBASE-20008 [backport] NullPointerException when restoring a snapshot after splitting a region
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-02-20 20:29:08 -08:00
Chia-Ping Tsai 21f6830fe1 HBASE-20017 BufferedMutatorImpl submit the same mutation repeatedly
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-02-20 16:59:44 -08:00
Michael Stack fd8189d31d Revert "HBASE-19970 Remove unused functions from TableAuthManager."
This reverts commit e6ce789b6f.
2018-02-20 11:12:36 -08:00
Michael Stack 071281cf52 Revert "HBASE-19970 (addendum for 1.x only) Remove unused functions from TableAuthManager."
This reverts commit 0f79c497c5.
2018-02-20 11:12:33 -08:00
chenheng 7990546efe HBASE-14897 TestTableLockManager.testReapAllTableLocks is flakey
(cherry picked from commit 47082579a8)
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-02-20 08:50:22 -06:00
Ben Lau 28ebd29f0f HBASE-18282 ReplicationLogCleaner can delete WALs not yet replicated in case of a KeeperException
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-02-14 17:23:23 -08:00
Thiruvel Thirumoolan e65004aeea HBASE-19996 Some nonce procs might not be cleaned up (follow up HBASE-19756)
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-02-14 09:17:13 -08:00
tedyu 335b8a8e14 HBASE-19979 ReplicationSyncUp tool may leak Zookeeper connection (Pankaj Kumar) 2018-02-13 08:11:03 -08:00
Chia-Ping Tsai f77b42b2af HBASE-19876 The exception happening in converting pb mutation to hbase.mutation messes up the CellScanner 2018-02-13 21:29:01 +08:00
Apekshit Sharma 0f79c497c5 HBASE-19970 (addendum for 1.x only) Remove unused functions from TableAuthManager. 2018-02-12 16:31:09 -08:00
Apekshit Sharma e6ce789b6f HBASE-19970 Remove unused functions from TableAuthManager.
Functions deleted: setTableUserPermissions, setTableGroupPermissions, setNamespaceUserPermissions,
setNamespaceGroupPermissions, writeTableToZooKeeper, writeNamespaceToZooKeeper
2018-02-12 16:20:36 -08:00
huzheng 7ced28f099 HBASE-19972 Should rethrow the RetriesExhaustedWithDetailsException when failed to apply the batch in ReplicationSink 2018-02-11 14:58:36 +08:00
Chia-Ping Tsai 0cbb19201c HBASE-19900 Region-level exception destroy the result of batch 2018-02-07 08:30:55 +08:00
Balazs Meszaros 5fa64fb72e HBASE-19886 Display maintenance mode in shell, web UI 2018-02-06 15:59:44 -08:00
Toshihiro Suzuki 92f733db4b HBASE-19934 HBaseSnapshotException when read replicas is enabled and online snapshot is taken after region splitting
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-02-06 11:19:22 -08:00
Rahul Gidwani 673e809250
HBASE-19528 - Major Compaction Tool
Signed-off-by: Michael Stack <stack@apache.org>
2018-02-06 05:39:25 -08:00
Ashish Singhi bdeab93196 HBASE-19905 ReplicationSyncUp tool will not exit if a peer replication is disabled
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
2018-02-04 18:24:32 +05:30
Andrew Purtell f35bcd2fe3 HBASE-19858 Backport HBASE-14061 (Support CF-level Storage Policy) to branch-1
HBASE-14061 Support CF-level Storage Policy
HBASE-14061 Support CF-level Storage Policy (addendum)
HBASE-14061 Support CF-level Storage Policy (addendum2)
HBASE-15172 Support setting storage policy in bulkload
HBASE-17538 HDFS.setStoragePolicy() logs errors on local fs
HBASE-18015 Storage class aware block placement for procedure v2 WALs
HBASE-18017 Reduce frequency of setStoragePolicy failure warnings
Default storage policy if not configured cannot be "NONE"
HBASE-19016 Coordinate storage policy property name for table schema and bulkload
Fix checkstyle warnings
Addressed additional review feedback on backport
2018-02-01 17:10:39 -08:00
binlijin e1bcf50b10 HBASE-19728 Add lock to filesCompacting in all place. 2018-01-31 17:01:58 +08:00
Thiruvel Thirumoolan 2c5140e151 HBASE-19756 Master NPE during completed failed proc eviction
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-01-24 16:48:54 -08:00
Rahul Gidwani 73ed127039 HBASE-15321 - Ability to open a HRegion from hdfs snapshot. 2018-01-22 12:22:57 -08:00
huaxiangsun 0f20c5e0fd HBASE-19163 "Maximum lock count exceeded" from region server's batch processing
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Michael Stack <stack@apache.org>
2018-01-19 11:24:19 -08:00
Scott Wilson 779371625b HBASE-19816 Refresh repliation sinks on UnknownHostException
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-01-17 16:26:25 -08:00
Rahul Gidwani 48025cc84b HBASE-11409 - Add more flexibility for input directory structure to LoadIncrementalHFiles 2018-01-12 13:35:26 -08:00
Guangxu Cheng b29a138ecc HBASE-19483 Add proper privilege check for rsgroup commands addendum
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-01-11 11:00:07 -08:00
Chia-Ping Tsai 0ef6530aa1 HBASE-19685 Fix TestFSErrorsExposed#testFullSystemBubblesFSErrors by increasing scanner timeout.
Signed-off-by: Apekshit Sharma <appy@apache.org>
2018-01-11 10:39:42 -08:00
Guangxu Cheng 6f1dd258b1 HBASE-19483 Add proper privilege check for rsgroup commands
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-01-10 02:25:47 -08:00
Toshihiro Suzuki e6453ab84b HBASE-19424 Fix NPE in "/metrics" servlet.
Signed-off-by: Apekshit Sharma <appy@apache.org>
2018-01-08 15:09:27 -08:00
BELUGA BEHR fa07c211ac HBASE-19684 BlockCacheKey toString Performance
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-01-08 17:06:44 +08:00
Andrew Purtell b528cd01b7 HBASE-19708 Avoid NPE when the RPC listener's accept channel is closed 2018-01-05 09:58:03 -08:00