Apache/hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,317 Commits 95 Branches 866 Tags
Commit Graph

5131 Commits

Author SHA1 Message Date
Xu Cang
6d1aa2800b HBASE-20486 Change default throughput controller to PressureAwareThroughputController 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-05-22 12:43:31 -07:00
Balazs Meszaros
2d493556f3 HBASE-20571 JMXJsonServlet generates invalid JSON if it has NaN in metrics 
- CacheStats won't generate NaN metrics.
- JSONBean class will serialize special floating point values as
  "NaN", "Infinity" or "-Infinity"

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-05-16 11:50:31 -07:00
Thiruvel Thirumoolan
2a309d71cc HBASE-20545 Improve performance of BaseLoadBalancer.retainAssignment 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-05-15 18:17:52 -07:00
Zach York
944a221b74 HBASE-20447 Only fail cacheBlock if block collisions aren't related to next block metadata 
When we pread, we don't force the read to read all of the next block header.
However, when we get into a race condition where two opener threads try to
cache the same block and one thread read all of the next block header and
the other one didn't, it will fail the open process. This is especially important
in a splitting case where it will potentially fail the split process.
Instead, in the caches, we should only fail if the required blocks are different.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-05-14 16:09:36 -07:00
Ashish Singhi
ca544a155c HBASE-20004 Client is not able to execute REST queries in a secure cluster 
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
 2018-05-10 22:49:08 +05:30
Andrew Purtell
c191462ac3 HBASE-20554 "WALs outstanding" message from CleanerChore is noisy 2018-05-09 19:13:17 -07:00
Zach York
5406f63332 HBASE-20204 Add locking to RefreshFileConnections in BucketCache 
This is a follow-up to HBASE-20141 where Anoop suggested adding locking
for refreshing channels.
 2018-05-09 14:15:02 -07:00
Andrew Purtell
9d9d5aec0e HBASE-20505 PE should support multi column family read and write cases 2018-05-07 18:39:18 -07:00
Vasudevan
91f3de89ab HBASE-20523 PE tool should support configuring client side buffering sizes 
(Ram)
 2018-05-07 14:41:08 +05:30
Andrew Purtell
23b9054089 HBASE-20513 Collect and emit ScanMetrics in PerformanceEvaluation 2018-05-04 17:59:28 -07:00
Andrew Purtell
fd24083e26 HBASE-20517 Fix PerformanceEvaluation 'column' parameter 2018-05-04 17:24:38 -07:00
Andrew Purtell
e793e7c30c HBASE-20493 Port HBASE-19994 (Create a new class for RPC throttling exception, make it retryable) to branch-1 2018-04-26 15:38:40 -07:00
Andrew Purtell
71c573239b HBASE-20496 TestGlobalThrottler failing on branch-1 since revert of HBASE-9465 
Temporarily disable TestGlobalThrottler on branch-1
 2018-04-26 15:38:40 -07:00
Huaxiang Sun
eb67d4e308 HBASE-19924 hbase rpc throttling does not work for multi() with request count rater. 2018-04-26 10:43:59 -07:00
Toshihiro Suzuki
f11cf007a2 HBASE-20229 ConnectionImplementation.locateRegions() returns duplicated entries when region replication is on 2018-04-25 13:36:12 -07:00
Kevin Risden
e60189035e HBASE-20406 HBase Thrift HTTP - Shouldn't handle TRACE/OPTIONS methods 
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>

 Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/http/TestHttpServer.java
	hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift/ThriftServerRunner.java
 2018-04-20 22:45:49 -05:00
Sean Busbey
eacf3cb296 Revert "HBase Thrift HTTP - Shouldn't handle TRACE/OPTIONS methods" 
This reverts commit fe84833ea22c30b68022203132706ebb1e526852.

missing jira key
 2018-04-20 22:45:37 -05:00
Kevin Risden
fe84833ea2 HBase Thrift HTTP - Shouldn't handle TRACE/OPTIONS methods 
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>

 Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/http/TestHttpServer.java
	hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift/ThriftServerRunner.java
 2018-04-20 15:15:31 -05:00
Toshihiro Suzuki
8a244e51d7 HBASE-20006 TestRestoreSnapshotFromClientWithRegionReplicas is flakey 
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>

 Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestRestoreSnapshotFromClientWithRegionReplicas.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegionReplayEvents.java
 2018-04-20 11:34:45 -05:00
Toshihiro Suzuki
03eb3d24b6 HBASE-19850 The number of Offline Regions is wrong after restoring a snapshot 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-04-17 20:29:50 -07:00
Sean Busbey
ce4c243399 HBASE-20404 Fixes to CleanChore correctness and operability. 
* Make CleanerChore less chatty: move WARN message to DEBUG when we expect non-empty dirs
* Make CleanerChore less chatty: move IOE we'll retry to INFO
* CleanerChore should treat IOE for FileStatus as a failure
* Add tests asserting assumptions in above

Signed-off-by: Reid Chan <reidddchan@outlook.com>
Signed-off-by: Mike Drob <mdrob@apache.org>

 Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/cleaner/CleanerChore.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/cleaner/TestCleanerChore.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestFSUtils.java
 2018-04-17 13:05:41 -05:00
Ashish Singhi
a817f196a1 HBASE-15291 FileSystem not closed in secure bulkLoad 
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
 2018-04-11 12:59:52 +05:30
Reid Chan
427c95e2e5 HBASE-20352 [Chore] Backport HBASE-18309 (Support multi threads in CleanerChore) to branch-1 
Signed-off-by: Yu Li <liyu@apache.org>
 2018-04-11 14:17:51 +08:00
Pankaj Kumar
eacbe002e5 HBASE-19343 Restore snapshot makes split parent region online 2018-04-09 07:48:34 -07:00
Chia-Ping Tsai
2f683cd438 HBASE-20301 Remove the meaningless plus sign from table.jsp 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-04-04 20:10:46 +08:00
Thiruvel Thirumoolan
9ced0c936f Amend HBASE-20322 CME in StoreScanner causes region server crash 
memStoreScanners is immutable so create a new list for closing.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-04-03 13:22:43 -07:00
Thiruvel Thirumoolan
875a12de05 HBASE-20322 CME in StoreScanner causes region server crash 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-04-02 19:36:16 -07:00
Jan Hentschel
18c54b02b1 HBASE-17631 Changed Canary interval to 60 seconds 2018-04-01 13:48:28 +02:00
Andrew Purtell
9a6b6524a7 HBASE-20302 CatalogJanitor should log the reason why it is disabled (Vishal Khandelwal) 2018-03-29 10:20:34 -07:00
Zach York
773af3e0ca HBASE-20280 Fix possibility of deadlocking in refreshFileConnections 
When prefetch on open is specified, there is a deadlocking case
where if the prefetch is cancelled, the PrefetchExecutor interrupts
the threads if necessary, when that happens in FileIOEngine, it
causes an ClosedByInterruptException which is a subclass of
ClosedChannelException. If we retry all ClosedChannelExceptions,
this will lock as this access is expected to be interrupted.
This change removes calling refreshFileConnections for
ClosedByInterruptExceptions.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-03-27 22:59:58 +00:00
Toshihiro Suzuki
caf4c4b4ee HBASE-20261 Table page (table.jsp) in Master UI does not show replicaIds for hbase meta table 
Signed-off-by: Josh Elser <elserj@apache.org>
 2018-03-23 13:34:45 -04:00
Andrew Purtell
f976b3a8af HBASE-19024 Provide a configurable option to hsync WAL edits to the disk for better durability (Harshal Jain) 2018-03-20 17:51:59 -07:00
Zach York
009295a3a6 [HBASE-20141] Fix TooManyFiles exception when RefreshingChannels 
HBASE-19435 implements a fix for reopening file channels when they are unnexpected closed
to avoid disabling the BucketCache. However, it was missed that the the channels might not
actually be completely closed (the write or read channel might still be open
(see https://docs.oracle.com/javase/7/docs/api/java/nio/channels/ClosedChannelException.html)
This commit closes any open channels before creating a new channel.
 2018-03-16 10:58:22 -07:00
Ashish Singhi
a0b2141a95 HBASE-20146 Addendum Regions are stuck while opening when WAL is disabled 
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2018-03-15 10:17:03 +08:00
Sakthi
5aeddb3051 HBASE-18864 (addendum) Fixed unit test failure TestFromClientSide#testIllegalTableDescriptor 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-03-14 13:57:08 -07:00
Francis Liu
38471229f9 HBASE-20174 Fix TestZKLessMergeOnCluster flakiness 2018-03-12 16:57:59 -07:00
Ashish Singhi
e81abb7259 HBASE-20146 Regions are stuck while opening when WAL is disabled 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2018-03-09 21:27:00 +08:00
Abhishek Singh Chouhan
41ff229a16 HBASE-20139 NPE in RSRpcServices.get() when getRegion throws an exception 2018-03-07 12:09:04 +05:30
Apekshit Sharma
c4401b6073 HBASE-19400 Add missing security checks in MasterRpcServices 
- Added ADMIN permission check for following rpc calls:
  normalize, setNormalizerRunning, runCatalogScan, enableCatalogJanitor, runCleanerChore,
  setCleanerChoreRunning, execMasterService, execProcedure, execProcedureWithRet
- Moved authorizationEnabled check to start of AccessChecker's functions. Currently, and IDK why,
  we call authManager.authorize() first and then discard its result if authorizationEnabled is false. Weird.

----

HBASE-19401 Add missing security checks in RSRpcServices
 2018-02-28 11:52:16 -08:00
Sergey Soldatov
cdbf001d26 HBASE-19863 java.lang.IllegalStateException: isDelete failed when SingleColumnValueFilter is used 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
Signed-off-by: ramkrish86 <ramkrishna.s.vasudevan@gmail.com>
 2018-02-28 13:35:43 -05:00
Andrew Purtell
1be9a3d641 HBASE-20087 Periodically attempt redeploy of regions in FAILED_OPEN state 
Signed-off-by: Josh Elser <elserj@apache.org>
 2018-02-27 17:11:44 -08:00
Andrew Purtell
9a7a36750f HBASE-20102 AssignmentManager#shutdown doesn't shut down scheduled executor 
Signed-off-by: Josh Elser <elserj@apache.org>
 2018-02-27 17:11:28 -08:00
Ben Lau
27f803f320 HBASE-19989 Addendum - temp override for tests to be added later for HBASE-20001 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-02-27 17:06:32 -08:00
Rahul Gidwani
40e0ee331c HBASE-19989 - READY_TO_MERGE and READY_TO_SPLIT do not update region state correctly 
Author: Ben Lau <benlau@oath.com>
 2018-02-27 12:41:48 -08:00
Thiruvel Thirumoolan
ece68d3c65 HBASE-20001 cleanIfNoMetaEntry() uses encoded instead of region name to lookup region 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-02-26 18:01:28 -08:00
Sean Busbey
a37c91bb41 HBASE-20061 HStore synchronized member variable filesCompacting should be private 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>

 Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
 2018-02-24 10:59:18 -06:00
Pankaj Kumar
343cdda9ae HBASE-19364, Truncate_preserve fails with table when replica region > 1 2018-02-23 14:13:02 -08:00
Sean Busbey
ba7a936f74 Revert "HBASE-9465 Push entries to peer clusters serially" 
This reverts commit 441bc050b991c14c048617bc443b97f46e21b76f.

 Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/replication/ReplicationAdmin.java
	hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/WALProtos.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/Replication.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/ReplicationSource.java

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-02-23 14:42:15 +08:00
Sean Busbey
0a284d2b76 Revert "HBASE-17010 Serial replication should handle daughter regions being assigned to another RS (Phil Yang)" 
This reverts commit 97276da9a7cefc0472c487b60e4b6a03dc81610a.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-02-23 14:42:04 +08:00
tedyu
4d9589b165 HBASE-20052 TestRegionOpen#testNonExistentRegionReplica fails due to NPE 2018-02-22 12:41:13 -08:00