Commit Graph

12344 Commits

Author SHA1 Message Date
Sean Busbey 2735f35b97 HBASE-20075 remove logic for branch-1.1 nightly testing
Signed-off-by: Michael Stack <stack@apache.org>
2018-03-01 15:30:14 -06:00
Sean Busbey 01746c72ab HBASE-15151 ensure findbugs check runs in nightly tests on all branches.
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-03-01 15:30:10 -06:00
Sean Busbey 5102f5316c HBASE-18467 report nightly results to devs via jira
- rely on parallel pipeline to ensure all stages always run
- define non-CPS jira commenting function
- comment on jiras in the changeset with summary and links

Signed-off-by: Mike Drob <mdrob@apache.org>

 Conflicts:
	dev-support/Jenkinsfile
2018-03-01 13:15:35 -06:00
haxiaolin 1fbe4deb01 HBASE-20104 Fix infinite loop of RIT when creating table on a rsgroup that has no online servers
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-03-01 08:35:45 -08:00
Apekshit Sharma c4401b6073 HBASE-19400 Add missing security checks in MasterRpcServices
- Added ADMIN permission check for following rpc calls:
  normalize, setNormalizerRunning, runCatalogScan, enableCatalogJanitor, runCleanerChore,
  setCleanerChoreRunning, execMasterService, execProcedure, execProcedureWithRet
- Moved authorizationEnabled check to start of AccessChecker's functions. Currently, and IDK why,
  we call authManager.authorize() first and then discard its result if authorizationEnabled is false. Weird.

----

HBASE-19401 Add missing security checks in RSRpcServices
2018-02-28 11:52:16 -08:00
Sergey Soldatov cdbf001d26 HBASE-19863 java.lang.IllegalStateException: isDelete failed when SingleColumnValueFilter is used
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
Signed-off-by: ramkrish86 <ramkrishna.s.vasudevan@gmail.com>
2018-02-28 13:35:43 -05:00
Alex Leblang 0cd89ed653 HBASE-20106 [api compliance chacker] Fix Bug Where Branch Isn't Found
While git rev-parse, sometimes the branch cannot be found unless
the remote is specified. This fix tries to use "origin" if the
remote is not specified and the branch is not found.

Signed-off-by: Sean Busbey <busbey@apache.org>
2018-02-28 11:56:51 -06:00
Andrew Purtell 1be9a3d641 HBASE-20087 Periodically attempt redeploy of regions in FAILED_OPEN state
Signed-off-by: Josh Elser <elserj@apache.org>
2018-02-27 17:11:44 -08:00
Andrew Purtell 9a7a36750f HBASE-20102 AssignmentManager#shutdown doesn't shut down scheduled executor
Signed-off-by: Josh Elser <elserj@apache.org>
2018-02-27 17:11:28 -08:00
Ben Lau 27f803f320 HBASE-19989 Addendum - temp override for tests to be added later for HBASE-20001
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-02-27 17:06:32 -08:00
Rahul Gidwani 40e0ee331c HBASE-19989 - READY_TO_MERGE and READY_TO_SPLIT do not update region state correctly
Author: Ben Lau <benlau@oath.com>
2018-02-27 12:41:48 -08:00
Josh Elser f8494ee4e7 HBASE-20088 Update NOTICE.txt year
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-02-27 10:01:20 -05:00
Josh Elser 15a2473b69 HBASE-20089 Use the ASF recommended naming for SHA512 xsum files
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2018-02-27 10:01:19 -05:00
Artem Ervits 8e5b8f22fc HBASE-20091 Fix for 'build.plugins.plugin.version' for org.codehaus.mojo: is missing.
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-02-26 19:29:36 -08:00
Thiruvel Thirumoolan ece68d3c65 HBASE-20001 cleanIfNoMetaEntry() uses encoded instead of region name to lookup region
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-02-26 18:01:28 -08:00
Sean Busbey a37c91bb41 HBASE-20061 HStore synchronized member variable filesCompacting should be private
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>

 Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
2018-02-24 10:59:18 -06:00
Pankaj Kumar 343cdda9ae HBASE-19364, Truncate_preserve fails with table when replica region > 1 2018-02-23 14:13:02 -08:00
Sean Busbey ba7a936f74 Revert "HBASE-9465 Push entries to peer clusters serially"
This reverts commit 441bc050b9.

 Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/replication/ReplicationAdmin.java
	hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/WALProtos.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/Replication.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/ReplicationSource.java

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-02-23 14:42:15 +08:00
Sean Busbey 0a284d2b76 Revert "HBASE-17010 Serial replication should handle daughter regions being assigned to another RS (Phil Yang)"
This reverts commit 97276da9a7.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-02-23 14:42:04 +08:00
tedyu 4d9589b165 HBASE-20052 TestRegionOpen#testNonExistentRegionReplica fails due to NPE 2018-02-22 12:41:13 -08:00
Michael Stack cadc2efd12 HBASE-19391 Calling HRegion#initializeRegionInternals from a region replica can still re-create a region directory; ADDEDNDUM to fix TestRegionOpen failure 2018-02-22 09:27:46 -08:00
Chia-Ping Tsai af1f7cf431 HBASE-20016 TestCatalogJanitorInMemoryStates#testInMemoryForReplicaParentCleanup is flaky 2018-02-22 09:44:37 +08:00
Pankaj Kumar a189674b4c HBASE-19553, Old replica regions should be cleared from AM memory after primary region split or merge
Signed-off-by: Ted Yu <tedyu@apache.org>
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
2018-02-21 16:52:40 -08:00
Esteban Gutierrez 9e7e58d551 HBASE-19391 Calling HRegion#initializeRegionInternals from a region replica can still re-create a region directory 2018-02-21 16:25:13 -08:00
Andrew Purtell c5e692c1dc HBASE-20027 Add test TestClusterPortAssignment
LocalHBaseCluster forces random port assignment for sake of concurrent unit test
execution friendliness, but we still need a positive test for RPC and info port
assignment.
2018-02-21 13:12:26 -08:00
Toshihiro Suzuki c0bca137ff HBASE-20008 [backport] NullPointerException when restoring a snapshot after splitting a region
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-02-20 20:29:08 -08:00
Chia-Ping Tsai 21f6830fe1 HBASE-20017 BufferedMutatorImpl submit the same mutation repeatedly
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-02-20 16:59:44 -08:00
Michael Stack fd8189d31d Revert "HBASE-19970 Remove unused functions from TableAuthManager."
This reverts commit e6ce789b6f.
2018-02-20 11:12:36 -08:00
Michael Stack 071281cf52 Revert "HBASE-19970 (addendum for 1.x only) Remove unused functions from TableAuthManager."
This reverts commit 0f79c497c5.
2018-02-20 11:12:33 -08:00
chenheng 7990546efe HBASE-14897 TestTableLockManager.testReapAllTableLocks is flakey
(cherry picked from commit 47082579a8)
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-02-20 08:50:22 -06:00
Josh Elser 99306bba77 HBASE-19770 Separate command return values from interactive shells
Uses a new option to the shell to specify that return values are
unwanted instead of overloading the interactive option. Enable
return_values when the shell is non-interactive.

Includes addendum "Replace `if not` with `unless`"

Signed-off-by: Apekshit Sharma <appy@apache.org>
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-02-15 14:43:57 -05:00
Ben Lau 28ebd29f0f HBASE-18282 ReplicationLogCleaner can delete WALs not yet replicated in case of a KeeperException
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-02-14 17:23:23 -08:00
Thiruvel Thirumoolan e65004aeea HBASE-19996 Some nonce procs might not be cleaned up (follow up HBASE-19756)
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-02-14 09:17:13 -08:00
tedyu 335b8a8e14 HBASE-19979 ReplicationSyncUp tool may leak Zookeeper connection (Pankaj Kumar) 2018-02-13 08:11:03 -08:00
Chia-Ping Tsai f77b42b2af HBASE-19876 The exception happening in converting pb mutation to hbase.mutation messes up the CellScanner 2018-02-13 21:29:01 +08:00
Apekshit Sharma 0f79c497c5 HBASE-19970 (addendum for 1.x only) Remove unused functions from TableAuthManager. 2018-02-12 16:31:09 -08:00
Apekshit Sharma e6ce789b6f HBASE-19970 Remove unused functions from TableAuthManager.
Functions deleted: setTableUserPermissions, setTableGroupPermissions, setNamespaceUserPermissions,
setNamespaceGroupPermissions, writeTableToZooKeeper, writeNamespaceToZooKeeper
2018-02-12 16:20:36 -08:00
Janos Gub fe5848038d HBASE-19981 Boolean#getBoolean is used to parse value
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-02-12 13:08:04 -08:00
huzheng 7ced28f099 HBASE-19972 Should rethrow the RetriesExhaustedWithDetailsException when failed to apply the batch in ReplicationSink 2018-02-11 14:58:36 +08:00
tedyu d5436d7904 HBASE-19949 TestRSGroupsWithACL fails with ExceptionInInitializerError 2018-02-09 15:22:50 -08:00
haxiaolin 1911461a56 HBASE-19937 Ensure createRSGroupTable be called after ProcedureExecutor and LoadBalancer are initialized
Signed-off-by: tedyu <yuzhihong@gmail.com>
Amending-Author: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupBasedLoadBalancer.java
	hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupInfoManagerImpl.java
2018-02-09 15:14:56 -08:00
Chia-Ping Tsai 0cbb19201c HBASE-19900 Region-level exception destroy the result of batch 2018-02-07 08:30:55 +08:00
Balazs Meszaros 5fa64fb72e HBASE-19886 Display maintenance mode in shell, web UI 2018-02-06 15:59:44 -08:00
Toshihiro Suzuki 92f733db4b HBASE-19934 HBaseSnapshotException when read replicas is enabled and online snapshot is taken after region splitting
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-02-06 11:19:22 -08:00
Rahul Gidwani 673e809250
HBASE-19528 - Major Compaction Tool
Signed-off-by: Michael Stack <stack@apache.org>
2018-02-06 05:39:25 -08:00
tedyu 13cc7f9f50 HBASE-19932 TestSecureIPC in branch-1 fails with NoSuchMethodError against hadoop 3 2018-02-05 04:46:32 -08:00
Xiang LI 3aaafd7dd3 HBASE-19917 Improve RSGroupBasedLoadBalancer#filterServers() to be more efficient
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-02-04 20:04:48 -08:00
Ashish Singhi bdeab93196 HBASE-19905 ReplicationSyncUp tool will not exit if a peer replication is disabled
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
2018-02-04 18:24:32 +05:30
Michael Stack a55f2c759b HBASE-19901 Up yetus proclimit on nightlies; ADDENDUM. Matching master and branch-2 2018-02-02 11:11:45 -08:00
Andrew Purtell f35bcd2fe3 HBASE-19858 Backport HBASE-14061 (Support CF-level Storage Policy) to branch-1
HBASE-14061 Support CF-level Storage Policy
HBASE-14061 Support CF-level Storage Policy (addendum)
HBASE-14061 Support CF-level Storage Policy (addendum2)
HBASE-15172 Support setting storage policy in bulkload
HBASE-17538 HDFS.setStoragePolicy() logs errors on local fs
HBASE-18015 Storage class aware block placement for procedure v2 WALs
HBASE-18017 Reduce frequency of setStoragePolicy failure warnings
Default storage policy if not configured cannot be "NONE"
HBASE-19016 Coordinate storage policy property name for table schema and bulkload
Fix checkstyle warnings
Addressed additional review feedback on backport
2018-02-01 17:10:39 -08:00