5367 Commits

Author SHA1 Message Date
Toshihiro Suzuki
f11cf007a2 HBASE-20229 ConnectionImplementation.locateRegions() returns duplicated entries when region replication is on 2018-04-25 13:36:12 -07:00
Kevin Risden
e60189035e HBASE-20406 HBase Thrift HTTP - Shouldn't handle TRACE/OPTIONS methods
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>

 Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/http/TestHttpServer.java
	hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift/ThriftServerRunner.java
2018-04-20 22:45:49 -05:00
Sean Busbey
eacf3cb296 Revert "HBase Thrift HTTP - Shouldn't handle TRACE/OPTIONS methods"
This reverts commit fe84833ea22c30b68022203132706ebb1e526852.

missing jira key
2018-04-20 22:45:37 -05:00
Kevin Risden
fe84833ea2 HBase Thrift HTTP - Shouldn't handle TRACE/OPTIONS methods
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>

 Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/http/TestHttpServer.java
	hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift/ThriftServerRunner.java
2018-04-20 15:15:31 -05:00
Toshihiro Suzuki
8a244e51d7 HBASE-20006 TestRestoreSnapshotFromClientWithRegionReplicas is flakey
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>

 Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestRestoreSnapshotFromClientWithRegionReplicas.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegionReplayEvents.java
2018-04-20 11:34:45 -05:00
Toshihiro Suzuki
03eb3d24b6 HBASE-19850 The number of Offline Regions is wrong after restoring a snapshot
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-04-17 20:29:50 -07:00
Sean Busbey
ce4c243399 HBASE-20404 Fixes to CleanChore correctness and operability.
* Make CleanerChore less chatty: move WARN message to DEBUG when we expect non-empty dirs
* Make CleanerChore less chatty: move IOE we'll retry to INFO
* CleanerChore should treat IOE for FileStatus as a failure
* Add tests asserting assumptions in above

Signed-off-by: Reid Chan <reidddchan@outlook.com>
Signed-off-by: Mike Drob <mdrob@apache.org>

 Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/cleaner/CleanerChore.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/cleaner/TestCleanerChore.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestFSUtils.java
2018-04-17 13:05:41 -05:00
Ashish Singhi
a817f196a1 HBASE-15291 FileSystem not closed in secure bulkLoad
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
2018-04-11 12:59:52 +05:30
Reid Chan
427c95e2e5 HBASE-20352 [Chore] Backport HBASE-18309 (Support multi threads in CleanerChore) to branch-1
Signed-off-by: Yu Li <liyu@apache.org>
2018-04-11 14:17:51 +08:00
Pankaj Kumar
eacbe002e5 HBASE-19343 Restore snapshot makes split parent region online 2018-04-09 07:48:34 -07:00
Chia-Ping Tsai
2f683cd438 HBASE-20301 Remove the meaningless plus sign from table.jsp
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-04-04 20:10:46 +08:00
Thiruvel Thirumoolan
9ced0c936f Amend HBASE-20322 CME in StoreScanner causes region server crash
memStoreScanners is immutable so create a new list for closing.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-04-03 13:22:43 -07:00
Thiruvel Thirumoolan
875a12de05 HBASE-20322 CME in StoreScanner causes region server crash
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-04-02 19:36:16 -07:00
Jan Hentschel
18c54b02b1 HBASE-17631 Changed Canary interval to 60 seconds 2018-04-01 13:48:28 +02:00
Andrew Purtell
9a6b6524a7 HBASE-20302 CatalogJanitor should log the reason why it is disabled (Vishal Khandelwal) 2018-03-29 10:20:34 -07:00
Zach York
773af3e0ca HBASE-20280 Fix possibility of deadlocking in refreshFileConnections
When prefetch on open is specified, there is a deadlocking case
where if the prefetch is cancelled, the PrefetchExecutor interrupts
the threads if necessary, when that happens in FileIOEngine, it
causes an ClosedByInterruptException which is a subclass of
ClosedChannelException. If we retry all ClosedChannelExceptions,
this will lock as this access is expected to be interrupted.
This change removes calling refreshFileConnections for
ClosedByInterruptExceptions.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-03-27 22:59:58 +00:00
Toshihiro Suzuki
caf4c4b4ee HBASE-20261 Table page (table.jsp) in Master UI does not show replicaIds for hbase meta table
Signed-off-by: Josh Elser <elserj@apache.org>
2018-03-23 13:34:45 -04:00
Andrew Purtell
f976b3a8af HBASE-19024 Provide a configurable option to hsync WAL edits to the disk for better durability (Harshal Jain) 2018-03-20 17:51:59 -07:00
Zach York
009295a3a6 [HBASE-20141] Fix TooManyFiles exception when RefreshingChannels
HBASE-19435 implements a fix for reopening file channels when they are unnexpected closed
to avoid disabling the BucketCache. However, it was missed that the the channels might not
actually be completely closed (the write or read channel might still be open
(see https://docs.oracle.com/javase/7/docs/api/java/nio/channels/ClosedChannelException.html)
This commit closes any open channels before creating a new channel.
2018-03-16 10:58:22 -07:00
Ashish Singhi
a0b2141a95 HBASE-20146 Addendum Regions are stuck while opening when WAL is disabled
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-03-15 10:17:03 +08:00
Sakthi
5aeddb3051 HBASE-18864 (addendum) Fixed unit test failure TestFromClientSide#testIllegalTableDescriptor
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-03-14 13:57:08 -07:00
Francis Liu
38471229f9 HBASE-20174 Fix TestZKLessMergeOnCluster flakiness 2018-03-12 16:57:59 -07:00
Ashish Singhi
e81abb7259 HBASE-20146 Regions are stuck while opening when WAL is disabled
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-03-09 21:27:00 +08:00
Abhishek Singh Chouhan
41ff229a16 HBASE-20139 NPE in RSRpcServices.get() when getRegion throws an exception 2018-03-07 12:09:04 +05:30
Apekshit Sharma
c4401b6073 HBASE-19400 Add missing security checks in MasterRpcServices
- Added ADMIN permission check for following rpc calls:
  normalize, setNormalizerRunning, runCatalogScan, enableCatalogJanitor, runCleanerChore,
  setCleanerChoreRunning, execMasterService, execProcedure, execProcedureWithRet
- Moved authorizationEnabled check to start of AccessChecker's functions. Currently, and IDK why,
  we call authManager.authorize() first and then discard its result if authorizationEnabled is false. Weird.

----

HBASE-19401 Add missing security checks in RSRpcServices
2018-02-28 11:52:16 -08:00
Sergey Soldatov
cdbf001d26 HBASE-19863 java.lang.IllegalStateException: isDelete failed when SingleColumnValueFilter is used
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
Signed-off-by: ramkrish86 <ramkrishna.s.vasudevan@gmail.com>
2018-02-28 13:35:43 -05:00
Andrew Purtell
1be9a3d641 HBASE-20087 Periodically attempt redeploy of regions in FAILED_OPEN state
Signed-off-by: Josh Elser <elserj@apache.org>
2018-02-27 17:11:44 -08:00
Andrew Purtell
9a7a36750f HBASE-20102 AssignmentManager#shutdown doesn't shut down scheduled executor
Signed-off-by: Josh Elser <elserj@apache.org>
2018-02-27 17:11:28 -08:00
Ben Lau
27f803f320 HBASE-19989 Addendum - temp override for tests to be added later for HBASE-20001
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-02-27 17:06:32 -08:00
Rahul Gidwani
40e0ee331c HBASE-19989 - READY_TO_MERGE and READY_TO_SPLIT do not update region state correctly
Author: Ben Lau <benlau@oath.com>
2018-02-27 12:41:48 -08:00
Thiruvel Thirumoolan
ece68d3c65 HBASE-20001 cleanIfNoMetaEntry() uses encoded instead of region name to lookup region
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-02-26 18:01:28 -08:00
Sean Busbey
a37c91bb41 HBASE-20061 HStore synchronized member variable filesCompacting should be private
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>

 Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
2018-02-24 10:59:18 -06:00
Pankaj Kumar
343cdda9ae HBASE-19364, Truncate_preserve fails with table when replica region > 1 2018-02-23 14:13:02 -08:00
Sean Busbey
ba7a936f74 Revert "HBASE-9465 Push entries to peer clusters serially"
This reverts commit 441bc050b991c14c048617bc443b97f46e21b76f.

 Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/replication/ReplicationAdmin.java
	hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/WALProtos.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/Replication.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/ReplicationSource.java

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-02-23 14:42:15 +08:00
Sean Busbey
0a284d2b76 Revert "HBASE-17010 Serial replication should handle daughter regions being assigned to another RS (Phil Yang)"
This reverts commit 97276da9a7cefc0472c487b60e4b6a03dc81610a.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-02-23 14:42:04 +08:00
tedyu
4d9589b165 HBASE-20052 TestRegionOpen#testNonExistentRegionReplica fails due to NPE 2018-02-22 12:41:13 -08:00
Michael Stack
cadc2efd12 HBASE-19391 Calling HRegion#initializeRegionInternals from a region replica can still re-create a region directory; ADDEDNDUM to fix TestRegionOpen failure 2018-02-22 09:27:46 -08:00
Chia-Ping Tsai
af1f7cf431 HBASE-20016 TestCatalogJanitorInMemoryStates#testInMemoryForReplicaParentCleanup is flaky 2018-02-22 09:44:37 +08:00
Pankaj Kumar
a189674b4c HBASE-19553, Old replica regions should be cleared from AM memory after primary region split or merge
Signed-off-by: Ted Yu <tedyu@apache.org>
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
2018-02-21 16:52:40 -08:00
Esteban Gutierrez
9e7e58d551 HBASE-19391 Calling HRegion#initializeRegionInternals from a region replica can still re-create a region directory 2018-02-21 16:25:13 -08:00
Andrew Purtell
c5e692c1dc HBASE-20027 Add test TestClusterPortAssignment
LocalHBaseCluster forces random port assignment for sake of concurrent unit test
execution friendliness, but we still need a positive test for RPC and info port
assignment.
2018-02-21 13:12:26 -08:00
Toshihiro Suzuki
c0bca137ff HBASE-20008 [backport] NullPointerException when restoring a snapshot after splitting a region
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-02-20 20:29:08 -08:00
Chia-Ping Tsai
21f6830fe1 HBASE-20017 BufferedMutatorImpl submit the same mutation repeatedly
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-02-20 16:59:44 -08:00
Michael Stack
fd8189d31d Revert "HBASE-19970 Remove unused functions from TableAuthManager."
This reverts commit e6ce789b6fa44592c3a566703c78de0687154a84.
2018-02-20 11:12:36 -08:00
Michael Stack
071281cf52 Revert "HBASE-19970 (addendum for 1.x only) Remove unused functions from TableAuthManager."
This reverts commit 0f79c497c52fbe78a1f344675579b6eb26d23b70.
2018-02-20 11:12:33 -08:00
chenheng
7990546efe HBASE-14897 TestTableLockManager.testReapAllTableLocks is flakey
(cherry picked from commit 47082579a85fae1b3f7156963609819369b353d8)
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-02-20 08:50:22 -06:00
Ben Lau
28ebd29f0f HBASE-18282 ReplicationLogCleaner can delete WALs not yet replicated in case of a KeeperException
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-02-14 17:23:23 -08:00
Thiruvel Thirumoolan
e65004aeea HBASE-19996 Some nonce procs might not be cleaned up (follow up HBASE-19756)
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-02-14 09:17:13 -08:00
tedyu
335b8a8e14 HBASE-19979 ReplicationSyncUp tool may leak Zookeeper connection (Pankaj Kumar) 2018-02-13 08:11:03 -08:00
Chia-Ping Tsai
f77b42b2af HBASE-19876 The exception happening in converting pb mutation to hbase.mutation messes up the CellScanner 2018-02-13 21:29:01 +08:00