Apache/hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,428 Commits 95 Branches 866 Tags
Commit Graph

5205 Commits

Author SHA1 Message Date
Thiruvel Thirumoolan
875a12de05 HBASE-20322 CME in StoreScanner causes region server crash 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-04-02 19:36:16 -07:00
Jan Hentschel
18c54b02b1 HBASE-17631 Changed Canary interval to 60 seconds 2018-04-01 13:48:28 +02:00
Andrew Purtell
9a6b6524a7 HBASE-20302 CatalogJanitor should log the reason why it is disabled (Vishal Khandelwal) 2018-03-29 10:20:34 -07:00
Zach York
773af3e0ca HBASE-20280 Fix possibility of deadlocking in refreshFileConnections 
When prefetch on open is specified, there is a deadlocking case
where if the prefetch is cancelled, the PrefetchExecutor interrupts
the threads if necessary, when that happens in FileIOEngine, it
causes an ClosedByInterruptException which is a subclass of
ClosedChannelException. If we retry all ClosedChannelExceptions,
this will lock as this access is expected to be interrupted.
This change removes calling refreshFileConnections for
ClosedByInterruptExceptions.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-03-27 22:59:58 +00:00
Toshihiro Suzuki
caf4c4b4ee HBASE-20261 Table page (table.jsp) in Master UI does not show replicaIds for hbase meta table 
Signed-off-by: Josh Elser <elserj@apache.org>
 2018-03-23 13:34:45 -04:00
Andrew Purtell
f976b3a8af HBASE-19024 Provide a configurable option to hsync WAL edits to the disk for better durability (Harshal Jain) 2018-03-20 17:51:59 -07:00
Zach York
009295a3a6 [HBASE-20141] Fix TooManyFiles exception when RefreshingChannels 
HBASE-19435 implements a fix for reopening file channels when they are unnexpected closed
to avoid disabling the BucketCache. However, it was missed that the the channels might not
actually be completely closed (the write or read channel might still be open
(see https://docs.oracle.com/javase/7/docs/api/java/nio/channels/ClosedChannelException.html)
This commit closes any open channels before creating a new channel.
 2018-03-16 10:58:22 -07:00
Ashish Singhi
a0b2141a95 HBASE-20146 Addendum Regions are stuck while opening when WAL is disabled 
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2018-03-15 10:17:03 +08:00
Sakthi
5aeddb3051 HBASE-18864 (addendum) Fixed unit test failure TestFromClientSide#testIllegalTableDescriptor 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-03-14 13:57:08 -07:00
Francis Liu
38471229f9 HBASE-20174 Fix TestZKLessMergeOnCluster flakiness 2018-03-12 16:57:59 -07:00
Ashish Singhi
e81abb7259 HBASE-20146 Regions are stuck while opening when WAL is disabled 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2018-03-09 21:27:00 +08:00
Abhishek Singh Chouhan
41ff229a16 HBASE-20139 NPE in RSRpcServices.get() when getRegion throws an exception 2018-03-07 12:09:04 +05:30
Apekshit Sharma
c4401b6073 HBASE-19400 Add missing security checks in MasterRpcServices 
- Added ADMIN permission check for following rpc calls:
  normalize, setNormalizerRunning, runCatalogScan, enableCatalogJanitor, runCleanerChore,
  setCleanerChoreRunning, execMasterService, execProcedure, execProcedureWithRet
- Moved authorizationEnabled check to start of AccessChecker's functions. Currently, and IDK why,
  we call authManager.authorize() first and then discard its result if authorizationEnabled is false. Weird.

----

HBASE-19401 Add missing security checks in RSRpcServices
 2018-02-28 11:52:16 -08:00
Sergey Soldatov
cdbf001d26 HBASE-19863 java.lang.IllegalStateException: isDelete failed when SingleColumnValueFilter is used 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
Signed-off-by: ramkrish86 <ramkrishna.s.vasudevan@gmail.com>
 2018-02-28 13:35:43 -05:00
Andrew Purtell
1be9a3d641 HBASE-20087 Periodically attempt redeploy of regions in FAILED_OPEN state 
Signed-off-by: Josh Elser <elserj@apache.org>
 2018-02-27 17:11:44 -08:00
Andrew Purtell
9a7a36750f HBASE-20102 AssignmentManager#shutdown doesn't shut down scheduled executor 
Signed-off-by: Josh Elser <elserj@apache.org>
 2018-02-27 17:11:28 -08:00
Ben Lau
27f803f320 HBASE-19989 Addendum - temp override for tests to be added later for HBASE-20001 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-02-27 17:06:32 -08:00
Rahul Gidwani
40e0ee331c HBASE-19989 - READY_TO_MERGE and READY_TO_SPLIT do not update region state correctly 
Author: Ben Lau <benlau@oath.com>
 2018-02-27 12:41:48 -08:00
Thiruvel Thirumoolan
ece68d3c65 HBASE-20001 cleanIfNoMetaEntry() uses encoded instead of region name to lookup region 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-02-26 18:01:28 -08:00
Sean Busbey
a37c91bb41 HBASE-20061 HStore synchronized member variable filesCompacting should be private 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>

 Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
 2018-02-24 10:59:18 -06:00
Pankaj Kumar
343cdda9ae HBASE-19364, Truncate_preserve fails with table when replica region > 1 2018-02-23 14:13:02 -08:00
Sean Busbey
ba7a936f74 Revert "HBASE-9465 Push entries to peer clusters serially" 
This reverts commit 441bc050b991c14c048617bc443b97f46e21b76f.

 Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/replication/ReplicationAdmin.java
	hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/WALProtos.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/Replication.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/ReplicationSource.java

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-02-23 14:42:15 +08:00
Sean Busbey
0a284d2b76 Revert "HBASE-17010 Serial replication should handle daughter regions being assigned to another RS (Phil Yang)" 
This reverts commit 97276da9a7cefc0472c487b60e4b6a03dc81610a.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-02-23 14:42:04 +08:00
tedyu
4d9589b165 HBASE-20052 TestRegionOpen#testNonExistentRegionReplica fails due to NPE 2018-02-22 12:41:13 -08:00
Michael Stack
cadc2efd12 HBASE-19391 Calling HRegion#initializeRegionInternals from a region replica can still re-create a region directory; ADDEDNDUM to fix TestRegionOpen failure 2018-02-22 09:27:46 -08:00
Chia-Ping Tsai
af1f7cf431 HBASE-20016 TestCatalogJanitorInMemoryStates#testInMemoryForReplicaParentCleanup is flaky 2018-02-22 09:44:37 +08:00
Pankaj Kumar
a189674b4c HBASE-19553, Old replica regions should be cleared from AM memory after primary region split or merge 
Signed-off-by: Ted Yu <tedyu@apache.org>
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
 2018-02-21 16:52:40 -08:00
Esteban Gutierrez
9e7e58d551 HBASE-19391 Calling HRegion#initializeRegionInternals from a region replica can still re-create a region directory 2018-02-21 16:25:13 -08:00
Andrew Purtell
c5e692c1dc HBASE-20027 Add test TestClusterPortAssignment 
LocalHBaseCluster forces random port assignment for sake of concurrent unit test
execution friendliness, but we still need a positive test for RPC and info port
assignment.
 2018-02-21 13:12:26 -08:00
Toshihiro Suzuki
c0bca137ff HBASE-20008 [backport] NullPointerException when restoring a snapshot after splitting a region 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-02-20 20:29:08 -08:00
Chia-Ping Tsai
21f6830fe1 HBASE-20017 BufferedMutatorImpl submit the same mutation repeatedly 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-02-20 16:59:44 -08:00
Michael Stack
fd8189d31d Revert "HBASE-19970 Remove unused functions from TableAuthManager." 
This reverts commit e6ce789b6fa44592c3a566703c78de0687154a84.
 2018-02-20 11:12:36 -08:00
Michael Stack
071281cf52 Revert "HBASE-19970 (addendum for 1.x only) Remove unused functions from TableAuthManager." 
This reverts commit 0f79c497c52fbe78a1f344675579b6eb26d23b70.
 2018-02-20 11:12:33 -08:00
chenheng
7990546efe HBASE-14897 TestTableLockManager.testReapAllTableLocks is flakey 
(cherry picked from commit 47082579a85fae1b3f7156963609819369b353d8)
Signed-off-by: Sean Busbey <busbey@apache.org>
 2018-02-20 08:50:22 -06:00
Ben Lau
28ebd29f0f HBASE-18282 ReplicationLogCleaner can delete WALs not yet replicated in case of a KeeperException 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-02-14 17:23:23 -08:00
Thiruvel Thirumoolan
e65004aeea HBASE-19996 Some nonce procs might not be cleaned up (follow up HBASE-19756) 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-02-14 09:17:13 -08:00
tedyu
335b8a8e14 HBASE-19979 ReplicationSyncUp tool may leak Zookeeper connection (Pankaj Kumar) 2018-02-13 08:11:03 -08:00
Chia-Ping Tsai
f77b42b2af HBASE-19876 The exception happening in converting pb mutation to hbase.mutation messes up the CellScanner 2018-02-13 21:29:01 +08:00
Apekshit Sharma
0f79c497c5 HBASE-19970 (addendum for 1.x only) Remove unused functions from TableAuthManager. 2018-02-12 16:31:09 -08:00
Apekshit Sharma
e6ce789b6f HBASE-19970 Remove unused functions from TableAuthManager. 
Functions deleted: setTableUserPermissions, setTableGroupPermissions, setNamespaceUserPermissions,
setNamespaceGroupPermissions, writeTableToZooKeeper, writeNamespaceToZooKeeper
 2018-02-12 16:20:36 -08:00
huzheng
7ced28f099 HBASE-19972 Should rethrow the RetriesExhaustedWithDetailsException when failed to apply the batch in ReplicationSink 2018-02-11 14:58:36 +08:00
Chia-Ping Tsai
0cbb19201c HBASE-19900 Region-level exception destroy the result of batch 2018-02-07 08:30:55 +08:00
Balazs Meszaros
5fa64fb72e HBASE-19886 Display maintenance mode in shell, web UI 2018-02-06 15:59:44 -08:00
Toshihiro Suzuki
92f733db4b HBASE-19934 HBaseSnapshotException when read replicas is enabled and online snapshot is taken after region splitting 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-02-06 11:19:22 -08:00
Rahul Gidwani
673e809250
HBASE-19528 - Major Compaction Tool 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-02-06 05:39:25 -08:00
Ashish Singhi
bdeab93196 HBASE-19905 ReplicationSyncUp tool will not exit if a peer replication is disabled 
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
 2018-02-04 18:24:32 +05:30
Andrew Purtell
f35bcd2fe3 HBASE-19858 Backport HBASE-14061 (Support CF-level Storage Policy) to branch-1 
HBASE-14061 Support CF-level Storage Policy
HBASE-14061 Support CF-level Storage Policy (addendum)
HBASE-14061 Support CF-level Storage Policy (addendum2)
HBASE-15172 Support setting storage policy in bulkload
HBASE-17538 HDFS.setStoragePolicy() logs errors on local fs
HBASE-18015 Storage class aware block placement for procedure v2 WALs
HBASE-18017 Reduce frequency of setStoragePolicy failure warnings
Default storage policy if not configured cannot be "NONE"
HBASE-19016 Coordinate storage policy property name for table schema and bulkload
Fix checkstyle warnings
Addressed additional review feedback on backport
 2018-02-01 17:10:39 -08:00
binlijin
e1bcf50b10 HBASE-19728 Add lock to filesCompacting in all place. 2018-01-31 17:01:58 +08:00
Thiruvel Thirumoolan
2c5140e151 HBASE-19756 Master NPE during completed failed proc eviction 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-01-24 16:48:54 -08:00
Rahul Gidwani
73ed127039 HBASE-15321 - Ability to open a HRegion from hdfs snapshot. 2018-01-22 12:22:57 -08:00