Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,680 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

5359 Commits

Author SHA1 Message Date
TAK LON WU a52c6bf2f3 HBASE-20557 Backport HBASE-17215 to branch-1 
The second backport of HBASE-20555

Signed-off-by: Zach York <zyork@apache.org>
 2018-07-09 11:32:04 -07:00
Abhishek Singh Chouhan a4db453c6d HBASE-20806 Split style journal for flushes and compactions 2018-07-09 18:44:07 +05:30
Nihal Jain 77e5668ed2 HBASE-20808 Wrong shutdown order between Chores and ChoreService 
Signed-off-by: Reid Chan <reidchan@apache.org>
 2018-07-07 00:32:33 +08:00
Josh Elser 154b77307f HBASE-20826 Truncate really long RpcServer warnings unless TRACE is on 
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Ted Yu <tyu@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
 2018-07-05 17:21:30 -07:00
Yu Li 50f7894cc4 HBASE-20691 Change the default WAL storage policy back to "NONE"" 
This partially reverts HBASE-19858 and adds more doc about why we choose "NONE" as the default.
 2018-07-05 15:26:56 +08:00
huzheng a25cf7bbdb HBASE-20789 TestBucketCache#testCacheBlockNextBlockMetadataMissing is flaky 2018-07-04 09:49:07 +08:00
Nihal Jain f94ad9d78f HBASE-20450 Provide metrics for number of total active, priority and replication rpc handlers 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-07-02 11:19:19 -07:00
jingyuntian cc8e1cc393 HBASE-20769 getSplits() has a out of bounds problem in TableSnapshotInputFormatImpl 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-06-29 15:25:06 -07:00
Xu Cang 2fd69cf93c HBASE-19722 Implement a meta query statistics metrics source 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-06-28 17:17:50 -07:00
Reid Chan c81d0aff95 HBASE-20732 Shutdown scan pool when master is stopped 2018-06-28 12:36:50 +08:00
Michael Stack 03946a389a HBASE-20785 NPE getting metrics in PE testing scans 2018-06-27 12:04:21 -07:00
Michael Stack ccead1264c HBASE-20770 WAL cleaner logs way too much; gets clogged when lots of work to do 
General log cleanup; setting stuff that can flood the log to TRACE.

Amending-Author: Andrew Purtell <apurtell@apache.org>
 2018-06-26 15:54:47 -07:00
Monani Mihir 4936750d3a HBASE-20701 too much logging when balancer runs from BaseLoadBalancer 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-06-25 17:17:31 -07:00
tedyu 6fa9f0bea9 HBASE-20723 Custom hbase.wal.dir results in data loss because we write recovered edits into a different place than where the recovering region server looks for them 2018-06-15 19:51:33 -07:00
Zach York bed3b2bbae HBASE-20556 Backport HBASE-16490 to branch-1 
Backport by: taklonwu@gmail.com

Signed-off-by: Zach York <zyork@apache.org>
 2018-06-12 12:34:05 -07:00
Josh Elser c596fb6c3f HBASE-20605 Excludes Azure's new filesystem from the SecureBulkLoadEndpoint perm check 
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
 2018-06-06 16:23:51 -04:00
Andrew Purtell 409531209e HBASE-20670 NPE in HMaster#isInMaintenanceMode 2018-06-04 13:03:16 -07:00
Andrew Purtell 07487cb0b1 HBASE-20667 Rename TestGlobalThrottler to TestReplicationGlobalThrottler 2018-06-01 16:47:26 -07:00
Xu Cang a25878cf40 HBASE-18116 Replication source in-memory accounting should not include bulk transfer hfiles 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
 2018-06-01 13:34:43 -07:00
Andrew Purtell 08b7ed1656 Revert "HBASE-18116 fix replication source in-memory calculation by excluding bulk load file" 
This reverts commit dcb5b5a012.
 2018-05-31 15:28:50 -07:00
Xu Cang dcb5b5a012 HBASE-18116 fix replication source in-memory calculation by excluding bulk load file 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
 2018-05-31 14:22:07 -07:00
Andrew Purtell f4ac15999a Amend HBASE-20646 TestWALProcedureStoreOnHDFS failing on branch-1 
Suppress error-prone false positive
 2018-05-30 13:46:46 -07:00
Andrew Purtell 011989665e HBASE-20597 Serialize access to a shared reference to ZooKeeperWatcher in HBaseReplicationEndpoint 2018-05-29 11:25:25 -07:00
Andrew Purtell 5a0bb1c6b8 Revert "HBASE-20597 Use a lock to serialize access to a shared reference to ZooKeeperWatcher in HBaseReplicationEndpoint" 
This reverts commit 1b70763b9e.
 2018-05-29 11:25:25 -07:00
Toshihiro Suzuki 289d588af3 HBASE-20647 Backport HBASE-20616 "TruncateTableProcedure is stuck in retry loop in TRUNCATE_TABLE_CREATE_FS_LAYOUT state" to branch-1 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-05-25 06:18:43 -07:00
Andrew Purtell 87d4e4e4e2 HBASE-20646 TestWALProcedureStoreOnHDFS failing on branch-1 2018-05-24 18:06:12 -07:00
Thiruvel Thirumoolan b892be7440 HBASE-20548 Master fails to startup on large clusters, refreshing block distribution 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-05-24 12:27:19 -07:00
Andrew Purtell 1b70763b9e HBASE-20597 Use a lock to serialize access to a shared reference to ZooKeeperWatcher in HBaseReplicationEndpoint 2018-05-23 16:45:55 -07:00
Xu Cang 6d1aa2800b HBASE-20486 Change default throughput controller to PressureAwareThroughputController 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-05-22 12:43:31 -07:00
Balazs Meszaros 2d493556f3 HBASE-20571 JMXJsonServlet generates invalid JSON if it has NaN in metrics 
- CacheStats won't generate NaN metrics.
- JSONBean class will serialize special floating point values as
  "NaN", "Infinity" or "-Infinity"

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-05-16 11:50:31 -07:00
Thiruvel Thirumoolan 2a309d71cc HBASE-20545 Improve performance of BaseLoadBalancer.retainAssignment 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-05-15 18:17:52 -07:00
Zach York 944a221b74 HBASE-20447 Only fail cacheBlock if block collisions aren't related to next block metadata 
When we pread, we don't force the read to read all of the next block header.
However, when we get into a race condition where two opener threads try to
cache the same block and one thread read all of the next block header and
the other one didn't, it will fail the open process. This is especially important
in a splitting case where it will potentially fail the split process.
Instead, in the caches, we should only fail if the required blocks are different.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-05-14 16:09:36 -07:00
Ashish Singhi ca544a155c HBASE-20004 Client is not able to execute REST queries in a secure cluster 
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
 2018-05-10 22:49:08 +05:30
Andrew Purtell c191462ac3 HBASE-20554 "WALs outstanding" message from CleanerChore is noisy 2018-05-09 19:13:17 -07:00
Zach York 5406f63332 HBASE-20204 Add locking to RefreshFileConnections in BucketCache 
This is a follow-up to HBASE-20141 where Anoop suggested adding locking
for refreshing channels.
 2018-05-09 14:15:02 -07:00
Andrew Purtell 9d9d5aec0e HBASE-20505 PE should support multi column family read and write cases 2018-05-07 18:39:18 -07:00
Vasudevan 91f3de89ab HBASE-20523 PE tool should support configuring client side buffering sizes 
(Ram)
 2018-05-07 14:41:08 +05:30
Andrew Purtell 23b9054089 HBASE-20513 Collect and emit ScanMetrics in PerformanceEvaluation 2018-05-04 17:59:28 -07:00
Andrew Purtell fd24083e26 HBASE-20517 Fix PerformanceEvaluation 'column' parameter 2018-05-04 17:24:38 -07:00
Andrew Purtell e793e7c30c HBASE-20493 Port HBASE-19994 (Create a new class for RPC throttling exception, make it retryable) to branch-1 2018-04-26 15:38:40 -07:00
Andrew Purtell 71c573239b HBASE-20496 TestGlobalThrottler failing on branch-1 since revert of HBASE-9465 
Temporarily disable TestGlobalThrottler on branch-1
 2018-04-26 15:38:40 -07:00
Huaxiang Sun eb67d4e308 HBASE-19924 hbase rpc throttling does not work for multi() with request count rater. 2018-04-26 10:43:59 -07:00
Toshihiro Suzuki f11cf007a2 HBASE-20229 ConnectionImplementation.locateRegions() returns duplicated entries when region replication is on 2018-04-25 13:36:12 -07:00
Kevin Risden e60189035e HBASE-20406 HBase Thrift HTTP - Shouldn't handle TRACE/OPTIONS methods 
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>

 Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/http/TestHttpServer.java
	hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift/ThriftServerRunner.java
 2018-04-20 22:45:49 -05:00
Sean Busbey eacf3cb296 Revert "HBase Thrift HTTP - Shouldn't handle TRACE/OPTIONS methods" 
This reverts commit fe84833ea2.

missing jira key
 2018-04-20 22:45:37 -05:00
Kevin Risden fe84833ea2 HBase Thrift HTTP - Shouldn't handle TRACE/OPTIONS methods 
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>

 Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/http/TestHttpServer.java
	hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift/ThriftServerRunner.java
 2018-04-20 15:15:31 -05:00
Toshihiro Suzuki 8a244e51d7 HBASE-20006 TestRestoreSnapshotFromClientWithRegionReplicas is flakey 
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>

 Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestRestoreSnapshotFromClientWithRegionReplicas.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegionReplayEvents.java
 2018-04-20 11:34:45 -05:00
Toshihiro Suzuki 03eb3d24b6 HBASE-19850 The number of Offline Regions is wrong after restoring a snapshot 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-04-17 20:29:50 -07:00
Sean Busbey ce4c243399 HBASE-20404 Fixes to CleanChore correctness and operability. 
* Make CleanerChore less chatty: move WARN message to DEBUG when we expect non-empty dirs
* Make CleanerChore less chatty: move IOE we'll retry to INFO
* CleanerChore should treat IOE for FileStatus as a failure
* Add tests asserting assumptions in above

Signed-off-by: Reid Chan <reidddchan@outlook.com>
Signed-off-by: Mike Drob <mdrob@apache.org>

 Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/cleaner/CleanerChore.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/cleaner/TestCleanerChore.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestFSUtils.java
 2018-04-17 13:05:41 -05:00
Ashish Singhi a817f196a1 HBASE-15291 FileSystem not closed in secure bulkLoad 
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
 2018-04-11 12:59:52 +05:30
Reid Chan 427c95e2e5 HBASE-20352 [Chore] Backport HBASE-18309 (Support multi threads in CleanerChore) to branch-1 
Signed-off-by: Yu Li <liyu@apache.org>
 2018-04-11 14:17:51 +08:00
Pankaj Kumar eacbe002e5 HBASE-19343 Restore snapshot makes split parent region online 2018-04-09 07:48:34 -07:00
Chia-Ping Tsai 2f683cd438 HBASE-20301 Remove the meaningless plus sign from table.jsp 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-04-04 20:10:46 +08:00
Thiruvel Thirumoolan 9ced0c936f Amend HBASE-20322 CME in StoreScanner causes region server crash 
memStoreScanners is immutable so create a new list for closing.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-04-03 13:22:43 -07:00
Thiruvel Thirumoolan 875a12de05 HBASE-20322 CME in StoreScanner causes region server crash 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-04-02 19:36:16 -07:00
Jan Hentschel 18c54b02b1 HBASE-17631 Changed Canary interval to 60 seconds 2018-04-01 13:48:28 +02:00
Andrew Purtell 9a6b6524a7 HBASE-20302 CatalogJanitor should log the reason why it is disabled (Vishal Khandelwal) 2018-03-29 10:20:34 -07:00
Zach York 773af3e0ca HBASE-20280 Fix possibility of deadlocking in refreshFileConnections 
When prefetch on open is specified, there is a deadlocking case
where if the prefetch is cancelled, the PrefetchExecutor interrupts
the threads if necessary, when that happens in FileIOEngine, it
causes an ClosedByInterruptException which is a subclass of
ClosedChannelException. If we retry all ClosedChannelExceptions,
this will lock as this access is expected to be interrupted.
This change removes calling refreshFileConnections for
ClosedByInterruptExceptions.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-03-27 22:59:58 +00:00
Toshihiro Suzuki caf4c4b4ee HBASE-20261 Table page (table.jsp) in Master UI does not show replicaIds for hbase meta table 
Signed-off-by: Josh Elser <elserj@apache.org>
 2018-03-23 13:34:45 -04:00
Andrew Purtell f976b3a8af HBASE-19024 Provide a configurable option to hsync WAL edits to the disk for better durability (Harshal Jain) 2018-03-20 17:51:59 -07:00
Zach York 009295a3a6 [HBASE-20141] Fix TooManyFiles exception when RefreshingChannels 
HBASE-19435 implements a fix for reopening file channels when they are unnexpected closed
to avoid disabling the BucketCache. However, it was missed that the the channels might not
actually be completely closed (the write or read channel might still be open
(see https://docs.oracle.com/javase/7/docs/api/java/nio/channels/ClosedChannelException.html)
This commit closes any open channels before creating a new channel.
 2018-03-16 10:58:22 -07:00
Ashish Singhi a0b2141a95 HBASE-20146 Addendum Regions are stuck while opening when WAL is disabled 
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2018-03-15 10:17:03 +08:00
Sakthi 5aeddb3051 HBASE-18864 (addendum) Fixed unit test failure TestFromClientSide#testIllegalTableDescriptor 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-03-14 13:57:08 -07:00
Francis Liu 38471229f9 HBASE-20174 Fix TestZKLessMergeOnCluster flakiness 2018-03-12 16:57:59 -07:00
Ashish Singhi e81abb7259 HBASE-20146 Regions are stuck while opening when WAL is disabled 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2018-03-09 21:27:00 +08:00
Abhishek Singh Chouhan 41ff229a16 HBASE-20139 NPE in RSRpcServices.get() when getRegion throws an exception 2018-03-07 12:09:04 +05:30
Apekshit Sharma c4401b6073 HBASE-19400 Add missing security checks in MasterRpcServices 
- Added ADMIN permission check for following rpc calls:
  normalize, setNormalizerRunning, runCatalogScan, enableCatalogJanitor, runCleanerChore,
  setCleanerChoreRunning, execMasterService, execProcedure, execProcedureWithRet
- Moved authorizationEnabled check to start of AccessChecker's functions. Currently, and IDK why,
  we call authManager.authorize() first and then discard its result if authorizationEnabled is false. Weird.

----

HBASE-19401 Add missing security checks in RSRpcServices
 2018-02-28 11:52:16 -08:00
Sergey Soldatov cdbf001d26 HBASE-19863 java.lang.IllegalStateException: isDelete failed when SingleColumnValueFilter is used 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
Signed-off-by: ramkrish86 <ramkrishna.s.vasudevan@gmail.com>
 2018-02-28 13:35:43 -05:00
Andrew Purtell 1be9a3d641 HBASE-20087 Periodically attempt redeploy of regions in FAILED_OPEN state 
Signed-off-by: Josh Elser <elserj@apache.org>
 2018-02-27 17:11:44 -08:00
Andrew Purtell 9a7a36750f HBASE-20102 AssignmentManager#shutdown doesn't shut down scheduled executor 
Signed-off-by: Josh Elser <elserj@apache.org>
 2018-02-27 17:11:28 -08:00
Ben Lau 27f803f320 HBASE-19989 Addendum - temp override for tests to be added later for HBASE-20001 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-02-27 17:06:32 -08:00
Rahul Gidwani 40e0ee331c HBASE-19989 - READY_TO_MERGE and READY_TO_SPLIT do not update region state correctly 
Author: Ben Lau <benlau@oath.com>
 2018-02-27 12:41:48 -08:00
Thiruvel Thirumoolan ece68d3c65 HBASE-20001 cleanIfNoMetaEntry() uses encoded instead of region name to lookup region 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-02-26 18:01:28 -08:00
Sean Busbey a37c91bb41 HBASE-20061 HStore synchronized member variable filesCompacting should be private 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>

 Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
 2018-02-24 10:59:18 -06:00
Pankaj Kumar 343cdda9ae HBASE-19364, Truncate_preserve fails with table when replica region > 1 2018-02-23 14:13:02 -08:00
Sean Busbey ba7a936f74 Revert "HBASE-9465 Push entries to peer clusters serially" 
This reverts commit 441bc050b9.

 Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/replication/ReplicationAdmin.java
	hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/WALProtos.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/Replication.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/ReplicationSource.java

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-02-23 14:42:15 +08:00
Sean Busbey 0a284d2b76 Revert "HBASE-17010 Serial replication should handle daughter regions being assigned to another RS (Phil Yang)" 
This reverts commit 97276da9a7.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-02-23 14:42:04 +08:00
tedyu 4d9589b165 HBASE-20052 TestRegionOpen#testNonExistentRegionReplica fails due to NPE 2018-02-22 12:41:13 -08:00
Michael Stack cadc2efd12 HBASE-19391 Calling HRegion#initializeRegionInternals from a region replica can still re-create a region directory; ADDEDNDUM to fix TestRegionOpen failure 2018-02-22 09:27:46 -08:00
Chia-Ping Tsai af1f7cf431 HBASE-20016 TestCatalogJanitorInMemoryStates#testInMemoryForReplicaParentCleanup is flaky 2018-02-22 09:44:37 +08:00
Pankaj Kumar a189674b4c HBASE-19553, Old replica regions should be cleared from AM memory after primary region split or merge 
Signed-off-by: Ted Yu <tedyu@apache.org>
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
 2018-02-21 16:52:40 -08:00
Esteban Gutierrez 9e7e58d551 HBASE-19391 Calling HRegion#initializeRegionInternals from a region replica can still re-create a region directory 2018-02-21 16:25:13 -08:00
Andrew Purtell c5e692c1dc HBASE-20027 Add test TestClusterPortAssignment 
LocalHBaseCluster forces random port assignment for sake of concurrent unit test
execution friendliness, but we still need a positive test for RPC and info port
assignment.
 2018-02-21 13:12:26 -08:00
Toshihiro Suzuki c0bca137ff HBASE-20008 [backport] NullPointerException when restoring a snapshot after splitting a region 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-02-20 20:29:08 -08:00
Chia-Ping Tsai 21f6830fe1 HBASE-20017 BufferedMutatorImpl submit the same mutation repeatedly 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-02-20 16:59:44 -08:00
Michael Stack fd8189d31d Revert "HBASE-19970 Remove unused functions from TableAuthManager." 
This reverts commit e6ce789b6f.
 2018-02-20 11:12:36 -08:00
Michael Stack 071281cf52 Revert "HBASE-19970 (addendum for 1.x only) Remove unused functions from TableAuthManager." 
This reverts commit 0f79c497c5.
 2018-02-20 11:12:33 -08:00
chenheng 7990546efe HBASE-14897 TestTableLockManager.testReapAllTableLocks is flakey 
(cherry picked from commit 47082579a8)
Signed-off-by: Sean Busbey <busbey@apache.org>
 2018-02-20 08:50:22 -06:00
Ben Lau 28ebd29f0f HBASE-18282 ReplicationLogCleaner can delete WALs not yet replicated in case of a KeeperException 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-02-14 17:23:23 -08:00
Thiruvel Thirumoolan e65004aeea HBASE-19996 Some nonce procs might not be cleaned up (follow up HBASE-19756) 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-02-14 09:17:13 -08:00
tedyu 335b8a8e14 HBASE-19979 ReplicationSyncUp tool may leak Zookeeper connection (Pankaj Kumar) 2018-02-13 08:11:03 -08:00
Chia-Ping Tsai f77b42b2af HBASE-19876 The exception happening in converting pb mutation to hbase.mutation messes up the CellScanner 2018-02-13 21:29:01 +08:00
Apekshit Sharma 0f79c497c5 HBASE-19970 (addendum for 1.x only) Remove unused functions from TableAuthManager. 2018-02-12 16:31:09 -08:00
Apekshit Sharma e6ce789b6f HBASE-19970 Remove unused functions from TableAuthManager. 
Functions deleted: setTableUserPermissions, setTableGroupPermissions, setNamespaceUserPermissions,
setNamespaceGroupPermissions, writeTableToZooKeeper, writeNamespaceToZooKeeper
 2018-02-12 16:20:36 -08:00
huzheng 7ced28f099 HBASE-19972 Should rethrow the RetriesExhaustedWithDetailsException when failed to apply the batch in ReplicationSink 2018-02-11 14:58:36 +08:00
Chia-Ping Tsai 0cbb19201c HBASE-19900 Region-level exception destroy the result of batch 2018-02-07 08:30:55 +08:00
Balazs Meszaros 5fa64fb72e HBASE-19886 Display maintenance mode in shell, web UI 2018-02-06 15:59:44 -08:00
Toshihiro Suzuki 92f733db4b HBASE-19934 HBaseSnapshotException when read replicas is enabled and online snapshot is taken after region splitting 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-02-06 11:19:22 -08:00
Rahul Gidwani 673e809250
HBASE-19528 - Major Compaction Tool 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-02-06 05:39:25 -08:00
Ashish Singhi bdeab93196 HBASE-19905 ReplicationSyncUp tool will not exit if a peer replication is disabled 
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
 2018-02-04 18:24:32 +05:30
Andrew Purtell f35bcd2fe3 HBASE-19858 Backport HBASE-14061 (Support CF-level Storage Policy) to branch-1 
HBASE-14061 Support CF-level Storage Policy
HBASE-14061 Support CF-level Storage Policy (addendum)
HBASE-14061 Support CF-level Storage Policy (addendum2)
HBASE-15172 Support setting storage policy in bulkload
HBASE-17538 HDFS.setStoragePolicy() logs errors on local fs
HBASE-18015 Storage class aware block placement for procedure v2 WALs
HBASE-18017 Reduce frequency of setStoragePolicy failure warnings
Default storage policy if not configured cannot be "NONE"
HBASE-19016 Coordinate storage policy property name for table schema and bulkload
Fix checkstyle warnings
Addressed additional review feedback on backport
 2018-02-01 17:10:39 -08:00
binlijin e1bcf50b10 HBASE-19728 Add lock to filesCompacting in all place. 2018-01-31 17:01:58 +08:00
Thiruvel Thirumoolan 2c5140e151 HBASE-19756 Master NPE during completed failed proc eviction 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-01-24 16:48:54 -08:00
Rahul Gidwani 73ed127039 HBASE-15321 - Ability to open a HRegion from hdfs snapshot. 2018-01-22 12:22:57 -08:00
huaxiangsun 0f20c5e0fd HBASE-19163 "Maximum lock count exceeded" from region server's batch processing 
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Michael Stack <stack@apache.org>
 2018-01-19 11:24:19 -08:00
Scott Wilson 779371625b HBASE-19816 Refresh repliation sinks on UnknownHostException 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-01-17 16:26:25 -08:00
Rahul Gidwani 48025cc84b HBASE-11409 - Add more flexibility for input directory structure to LoadIncrementalHFiles 2018-01-12 13:35:26 -08:00
Guangxu Cheng b29a138ecc HBASE-19483 Add proper privilege check for rsgroup commands addendum 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-01-11 11:00:07 -08:00
Chia-Ping Tsai 0ef6530aa1 HBASE-19685 Fix TestFSErrorsExposed#testFullSystemBubblesFSErrors by increasing scanner timeout. 
Signed-off-by: Apekshit Sharma <appy@apache.org>
 2018-01-11 10:39:42 -08:00
Guangxu Cheng 6f1dd258b1 HBASE-19483 Add proper privilege check for rsgroup commands 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-01-10 02:25:47 -08:00
Toshihiro Suzuki e6453ab84b HBASE-19424 Fix NPE in "/metrics" servlet. 
Signed-off-by: Apekshit Sharma <appy@apache.org>
 2018-01-08 15:09:27 -08:00
BELUGA BEHR fa07c211ac HBASE-19684 BlockCacheKey toString Performance 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2018-01-08 17:06:44 +08:00
Andrew Purtell b528cd01b7 HBASE-19708 Avoid NPE when the RPC listener's accept channel is closed 2018-01-05 09:58:03 -08:00
Rajeshbabu Chintaguntla b5ec4d381c HBASE-15580 Tag coprocessor limitedprivate scope to StoreFile.Reader 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2018-01-04 14:15:03 +08:00
Michael Stack 939e016425
HBASE-19588 Additional jar dependencies needed for mapreduce 
PerformanceEvaluation

Signed-off-by: Albert Chu <chu11@llnl.gov>
 2018-01-03 21:33:25 -06:00
Chia-Ping Tsai 2c30c9bbb6 HBASE-19490 Rare failure in TestRateLimiter 2018-01-04 10:33:46 +08:00
Josh Elser 490728ae7f HBASE-19691 Removes Global(A) requirement for getClusterStatus 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2018-01-03 19:15:49 -05:00
huaxiang sun fd33b3589e HBASE-18625 Splitting of region with replica, doesn't update region list in serverHolding. A server crash leads to overlap. 
Signed-off-by: ramkrishna.s.vasudevan<ramkrishna.s.vasudevan@intel.com>
 2018-01-03 12:32:44 -08:00
Jingyun Tian 6faed49ad1 HBASE-19358 Improve the stability of splitting log when do fail over 
Signed-off-by: Yu Li <liyu@apache.org>
 2018-01-02 17:25:49 +08:00
tedyu e866e837fb HBASE-19551 hbck -boundaries doesn't work correctly (Toshihiro Suzuki) 2017-12-30 23:18:12 -08:00
Peter Somogyi 528eb10826 HBASE-19545 Replace getBytes(StandardCharsets.UTF_8) with Bytes.toBytes 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2017-12-27 20:15:01 +08:00
tedyu 64d2ebf9f3 HBASE-19514 TestJMXListener now uses random port 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2017-12-22 18:51:44 +01:00
ramkrish86 d28732fd98 HBASE-19468 FNFE during scans and flushes (Ram) 2017-12-20 17:06:27 +05:30
zhangduo 08e948b188 HBASE-19546 TestMasterReplication.testCyclicReplication2 uses wrong assertion 2017-12-18 19:59:32 +08:00
ramkrish86 ff023bcc4b HBASE-19485 Minor improvement to TestCompactedHFilesDischarger (Ram) 2017-12-14 13:19:55 -08:00
Chia-Ping Tsai 54ca1db6bd HBASE-19502 Make sure we have closed all StoreFileScanner if we fail to open any StoreFileScanners 2017-12-13 21:47:27 +08:00
Jan Hentschel b3167a0e50 Revert "HBASE-17425 Fixed deprecated calls in TestUpdateConfiguration" 
This reverts commit c434cab5d1.
 2017-12-11 22:56:33 +01:00
Jan Hentschel c434cab5d1 HBASE-17425 Fixed deprecated calls in TestUpdateConfiguration 2017-12-09 14:44:50 +01:00
Andrew Purtell bae3b0b966 HBASE-19465 Required httpcore and httpclient jars not included in binary distribution 2017-12-08 15:02:10 -08:00
Zach York 9e34d99c07 HBASE-19435 Reopen Files for ClosedChannelException in BucketCache 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-12-07 15:45:51 -08:00
Andrew Purtell 5398d83bc7 HBASE-19446 Misspelled 'default' in SimpleRpcScheduler 2017-12-06 17:11:15 -08:00
Andrew Purtell 70c7688271 HBASE-19447 INFO level logging of GetClusterStatus from HMaster is too chatty 2017-12-06 17:05:19 -08:00
Pankaj Kumar f88304d162 HBASE-19442 Backport HBASE-19065 to branch-1 (HRegion#bulkLoadHFiles() should wait for concurrent Region#flush() to finish). 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2017-12-06 14:18:44 -08:00
Andrew Purtell 6c2d51132f HBASE-19445 PerformanceEvaluation NPE processing split policy option 2017-12-06 14:10:11 -08:00
Andrew Purtell 1fe75f98d3 HBASE-19421 branch-1 does not compile against Hadoop 3.0.0 2017-12-04 15:48:38 -08:00
Guanghao Zhang 9d481b1c43 HBASE-19239 (addendum) Fix findbugs and error-prone warnings (branch-1) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2017-12-04 10:18:53 -08:00
tedyu cb3bef3574 HBASE-19056 TestCompactionInDeadRegionServer is top of the flakies charts 2017-12-04 06:35:41 -08:00
binlijin 15d16281a1 HBASE-19290 Reduce zk request when doing split log 2017-12-04 18:36:11 +08:00
huzheng 4ec59d018d HBASE-19252 Move the transform logic of FilterList into transformCell() method to avoid extra ref to question cell 2017-12-04 10:19:16 +08:00
Guanghao Zhang 25cc8feeb2 HBASE-19366 Backport to branch-1 HBASE-19035 Miss metrics when coprocessor use region scanner to read data 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2017-12-02 09:54:21 -08:00
Guanghao Zhang 525b2852e8 HBASE-19396 Fix flaky test TestHTableMultiplexerFlushCache 2017-12-02 19:43:32 +08:00
Andrew Purtell d2a54c98ba HBASE-19406 Fix CompactionRequest equals and hashCode 2017-12-01 19:15:05 -08:00
Andrew Purtell ab1d5e05a8 HBASE-19395 [branch-1] TestEndToEndSplitTransaction.testMasterOpsWhileSplitting fails with NPE 2017-12-01 15:31:52 -08:00
Guangxu Cheng 6938720c12 HBASE-19326 Remove decommissioned servers from rsgroup 
Signed-off-by: Michael Stack <stack@apache.org>

Amending-Author: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupAdminClient.java
	hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupAdminEndpoint.java
	hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupAdminServer.java
	hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupInfoManagerImpl.java
	hbase-rsgroup/src/test/java/org/apache/hadoop/hbase/rsgroup/TestRSGroups.java
	hbase-rsgroup/src/test/java/org/apache/hadoop/hbase/rsgroup/TestRSGroupsBase.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/coprocessor/MasterObserver.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterCoprocessorHost.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/security/access/AccessController.java
	hbase-shell/src/main/ruby/hbase/rsgroup_admin.rb
 2017-12-01 12:15:43 -08:00
Michael Stack 2f7a6f21eb HBASE-18233 We shouldn't wait for readlock in doMiniBatchMutation in case of deadlock (Allan Yang) 
This patch plus a sorting of the batch (HBASE-17924) fixes a regression
in Increment/CheckAndPut-style operations.

Signed-off-by: Yu Li <carp84@gmail.com>
Signed-off-by: Allan Yang <allanwin@163.com>
 2017-11-30 17:10:27 -08:00
Sergey Soldatov 143ceb97ba HBASE-19393 HTTP 413 FULL head while accessing HBase UI using SSL. 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2017-11-30 17:03:32 -08:00
Harshal Deepakkumar Jain a4b9ac6050 HBASE-19388 - Incorrect value is being set for Compaction Pressure in RegionLoadStats object inside HRegion class 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-11-30 15:07:45 -08:00
Josh Elser 4846300c8b HBASE-19285 Implements table-level latency histograms 
For a egionserver's view of a table (the regions
that belong to a table hosted on a regionserver),
this change tracks the latencies of operations that
affect the regions for this table.

Tracking at the per-table level avoids the memory bloat
and performance impact that accompanied the previous
per-region latency metrics while still providing important
details for operators to consume.

Signed-Off-By: Andrew Purtell <apurtell@apache.org>
 2017-11-30 17:45:23 -05:00
Michael Stack 1e00673047 HBASE-19385 [1.3] TestReplicator failed 1.3 nightly 2017-11-29 23:12:51 -08:00
Andrew Purtell 4c413e0c50 HBASE-19376 Fix more binary compatibility problems with branch-1.4 / branch-1 2017-11-29 14:07:36 -08:00
Peter Somogyi dce6285c21
HBASE-19188 Build fails on branch-1 using maven-3.5.2 
Changing tomcat:jasper-runtime scope to compile in
hbase-server, hbase-rest and hbase-thrift

Signed-off-by: Michael Stack <stack@apache.org>
 2017-11-29 12:28:09 -08:00
libisthanks 41b4877950
HBASE-18090 Improve TableSnapshotInputFormat to allow more multiple mappers per region 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-11-28 14:56:38 -08:00
Chia-Ping Tsai 24d82195cb HBASE-19348 Fix error-prone errors for branch-1 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2017-11-27 18:29:11 -08:00
tedyu f7f425e53e HBASE-19300 TestMultithreadedTableMapper fails in branch-1.4 2017-11-27 11:41:46 -08:00
Guangxu Cheng de16690b7a HBASE-19325 Pass a list of server name to postClearDeadServers 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2017-11-28 02:39:55 +08:00
Gary Helmling 20d811121f HBASE-19332 DumpReplicationQueues misreports total WAL size 2017-11-22 16:54:13 -08:00
Andrew Purtell d80d3fa454 HBASE-19239 Fix findbugs and error-prone issues 
Fixes for hbase-server
 2017-11-17 17:12:36 -08:00
Michael Stack 1bde8656b1 HBASE-19276 RegionPlan should correctly implement equals and hashCode 
Andrew's patch that adds equals and hash but revamping compare also.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2017-11-16 14:06:46 -08:00
Michael Stack 641e797e02
HBASE-19245 MultiTableInputFormatBase#getSplits creates a Connection per Table 
We make one Connection only instead of a Connection per table (Change is
just moving one line it involves right-shifting body of the function)
 2017-11-14 21:48:45 -08:00
Lars Hofhansl f9833a7802 HBASE-12091 Optionally ignore edits for dropped tables for replication. 2017-11-14 16:33:12 -08:00
zhangduo c0639d271a HBASE-19243 Start mini cluster once before class for TestFIFOCompactionPolicy 2017-11-14 15:55:51 +08:00
Mike Drob dbcda15ae7 HBASE-19240 more error-prone results 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2017-11-13 18:23:10 -08:00
Andrew Purtell 45116c8a52 HBASE-19250 TestClientClusterStatus is flaky 2017-11-13 16:52:36 -08:00
Andrew Purtell 6961526573 HBASE-12350 Backport error-prone build support to branch-1 and branch-2 2017-11-09 15:34:09 -08:00
Mike Drob 027ef60a75 HBASE-19195 error-prone fixes for client, mr, and server 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2017-11-09 11:37:43 -08:00
Andrew Purtell c5e60d16b4 HBASE-19194 TestRSGroupsBase has some always false checks 2017-11-07 17:14:03 -08:00
huzheng 264cf0d473 HBASE-18993 Backport patches in HBASE-18410 to branch-1.x branches 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2017-11-07 14:00:27 -08:00
Michael Stack ca68d77862 HBASE-19198 TestIPv6NIOServerSocketChannel fails; unable to bind 2017-11-06 21:21:34 -08:00
Michael Stack a2ae58f6ee
HBASE-19102 TestZooKeeperMainServer fails with KeeperException 
Reapplication after fixing compile issue.
 2017-11-06 20:40:14 -08:00
Chia-Ping Tsai 56fd75e8e2 HBASE-19131 Add the ClusterStatus hook and cleanup other hooks which can be replaced by ClusterStatus hook 2017-11-05 09:55:10 +08:00
Michael Stack 9ad6e0422f
Revert "HBASE-19102 TestZooKeeperMainServer fails with KeeperException" 
This reverts commit 6547128789.
 2017-11-03 12:16:32 -07:00
Michael Stack 6547128789
HBASE-19102 TestZooKeeperMainServer fails with KeeperException 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-11-03 11:49:18 -07:00
Josh Elser de087931ec HBASE-19156 Remove vestiges of an unused regions-per-server CLI argument 
Signed-off-by: Ted Yu <tedyu@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
 2017-11-02 15:05:44 -04:00
churro 61753bd133 HBASE-19150 TestSnapshotWithAcl is flaky 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2017-11-01 18:17:58 -07:00
Andrew Purtell 0ac5b33747 HBASE-19138 Rare failure in TestLruBlockCache 
Wait for the block count to drop to zero after awaiting shutdown of the executor pool
 2017-10-31 11:36:19 -07:00
Andrew Purtell 826e11a15d HBASE-19125 TestReplicator is flaky 2017-10-30 15:10:26 -07:00
Andrew Purtell 0d26ca7dfb HBASE-19113 Restore dropped constants from TableInputFormatBase for compatability 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2017-10-27 15:27:32 -07:00
tedyu e1a73b9144 HBASE-19072 Missing beak in catch block of InterruptedException in HRegion#waitForFlushes() 2017-10-23 19:38:45 -07:00
Andrew Purtell 64328caef0 HBASE-15631 Backport Regionserver Groups (HBASE-6721) to branch-1 (Francis Liu and Andrew Purtell) 2017-10-23 17:10:33 -07:00
tedyu 795f48c311 HBASE-19052 FixedFileTrailer should recognize CellComparatorImpl class in branch-1.x 2017-10-23 07:43:26 -07:00
Chia-Ping Tsai 11a4eb9af9 HBASE-18690 Replace o.a.h.c.InterfaceAudience by o.a.h.h.c.InterfaceAudience 2017-10-23 10:38:06 +08:00
xiaowen147 ae6a951658 HBASE-19051 Add new split algorithm for num string 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-10-21 08:22:36 -07:00
tedyu 8d6902ae77 HBASE-18998 processor.getRowsToLock() always assumes there is some row being locked 2017-10-13 08:44:00 -07:00
zhangduo ff23e15769 HBASE-18552 Backport the server side change in HBASE-18489 to branch-1 2017-10-12 10:42:21 +08:00
tedyu 2828427219 HBASE-18959 Backport HBASE-18874 (HMaster abort message will be skipped if Throwable is passed null) to branch-1 (Pankaj Kumar) 2017-10-10 08:33:42 -07:00
Sean Busbey aa50971947 Revert "HBASE-17678 FilterList with MUST_PASS_ONE may lead to redundant cells returned" 
This reverts commit 256fc63007.

Backing out filterlist regression, see HBASE-18957. Work continuing branch for HBASE-18410.

Signed-off-by: Peter Somogyi <psomogyi@cloudera.com>
Signed-off-by: Michael Stack <stack@apache.org>
 2017-10-09 17:06:14 -05:00
Sean Busbey c7dc0da849 Revert "HBASE-15410 Utilize the max seek value when all Filters in MUST_PASS_ALL FilterList return SEEK_NEXT_USING_HINT" 
This reverts commit ead1063244.

Backing out filterlist regression, see HBASE-18957. Work continuing branch for HBASE-18410.

Signed-off-by: Peter Somogyi <psomogyi@cloudera.com>
Signed-off-by: Michael Stack <stack@apache.org>
 2017-10-09 17:06:09 -05:00
Peter Somogyi 8d77c1e954 HBASE-18957 add test that confirms 2 FamilyFilters in a FilterList using MUST_PASS_ONE operator will return results that match either of the FamilyFilters 
Amending-Author: Sean Busbey <busbey@apache.org>

Signed-off-by: Michael Stack <stack@apache.org>
 2017-10-09 17:05:39 -05:00
Maytee Chinavanichkit 50ef066c89 HBASE-18921 Fix Result.current ArrayIndexOutOfBoundsException 
Patch ArrayIndexOutOfBoundsException when current() is called after
advance() has already returned false

Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2017-10-08 02:58:01 +08:00
Yi Liang fc783ef045 HBASE-16894 Create more than 1 split per region, generalize HBASE-12590 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2017-10-03 17:24:45 -07:00
libisthanks 1c7321f9d5 HBASE-18814 Make ScanMetrics enabled and add counter <HBase Counters, ROWS_SCANNED> into the MapReduce Job over snapshot 
Signed-off-by: Ashu Pachauri <ashu@apache.org>
 2017-10-02 18:25:52 -07:00
Pankaj Kumar b2943504b8 HBASE-18890, Backport HBASE-14499 (Master coprocessors shutdown will not happen on master abort) to branch-1 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-09-29 16:20:52 -07:00
Andrew Purtell 93ad1aba70 HBASE-18436 Add client-side hedged read metrics (Yun Zhao) 
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/MetricsConnection.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestReplicasClient.java
 2017-09-29 15:43:03 -07:00
shaofengshi aa86657a52 HBASE-18885 HFileOutputFormat2 hardcodes default FileOutputCommitter 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-09-27 06:58:43 -07:00
Andrew Purtell 3abc0458e9 Amend HBASE-18830 TestCanaryTool does not check Canary monitor's error code 
Adjust exception control flow to fix findbugs warning
NP_NULL_ON_SOME_PATH_EXCEPTION, Possible null pointer dereference of
regionSink in org.apache.hadoop.hbase.tool.Canary$RegionMonitor.run()
on exception path
 2017-09-26 10:38:09 -07:00
Michael Stack eeaa9aee66 HBASE-18652 Expose individual cache stats in a CombinedCache through JMX (Biju Nair) 2017-09-25 20:51:11 -07:00
Chinmay Kulkarni 9d68535e8e HBASE-18830 TestCanaryTool does not check Canary monitor's error code 
Added assertion checks to make sure that the error code for the
ToolRunner run() method is used.

Testing Done: Checked that TestCanaryTool unit tests fail when there is
an error code in the current Canary run.

Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/tool/TestCanaryTool.java
 2017-09-25 19:17:22 -07:00
Chinmay Kulkarni 414e0ca292 HBASE-18762 Canary sink type cast error 
Changed the type hierarchy of Canary sinks to reduce confusion and avoid
cast errors.

Testing Done: Ran the TestCanaryTool.java test suite and confirmed that
the working is correct.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
 2017-09-25 19:17:22 -07:00
Andrew Purtell d74bdc3100 Amend HBASE-18786 FileNotFoundException should not be silently handled for primary region replicas 
Remove now invalid unit test TestCorruptedRegionStoreFile
 2017-09-25 17:36:54 -07:00
Andrew Purtell 5a3d9cb225 HBASE-18786 FileNotFoundException should not be silently handled for primary region replicas 2017-09-22 12:41:03 -07:00
Zach York bafc6e523e HBASE-18478 Allow users to remove RegionFinder from LoadBalancer calculations if no locality possible 
This provides significant cluster start time reduction for FileSystems which do not surface locality (S3).

Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/BaseLoadBalancer.java
 2017-09-19 16:30:43 -07:00
Abhishek Singh Chouhan 2845ddaf9e HBASE-18796 Admin#isTableAvailable returns incorrect result before daughter regions are opened 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2017-09-19 13:52:15 -07:00
tedyu ead1063244 HBASE-15410 Utilize the max seek value when all Filters in MUST_PASS_ALL FilterList return SEEK_NEXT_USING_HINT 2017-09-18 14:31:21 -07:00
andrewcheng 815673f7e4 HBASE-18131 Add an hbase shell command to clear deadserver list in ServerManager 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-09-16 09:33:08 -07:00
Biju Nair 7dc0a63c06 HBASE-18641 Include block content verification logic used in lruCache in bucketCache 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-09-16 06:12:43 -07:00
Andrew Purtell e5f80f36e2 Amend HBASE-18813 TestCanaryTool fails on branch-1 / branch-1.4 
Disable units where argument matching is intermittently failing
 2017-09-15 10:42:04 -07:00
Andrew Purtell 469d6bf457 Revert "Amend HBASE-18813 TestCanaryTool fails on branch-1 / branch-1.4" 
This reverts commit aa7c93c659.
 2017-09-15 10:42:04 -07:00
Reid Chan 862a717e37 HBASE-18801 Bulk load cleanup may falsely deem file deletion successful 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-09-15 02:15:06 -07:00
Andrew Purtell aa7c93c659 Amend HBASE-18813 TestCanaryTool fails on branch-1 / branch-1.4 
Skip tests where mocking with custom matchers fails unexpectedly on
older JREs.
 2017-09-14 14:38:56 -07:00
Michael Stack 91422357f2 HBASE-18818 TestConnectionImplemenation fails 2017-09-14 12:31:01 -07:00
Andrew Purtell 0621486620 HBASE-18346 TestRSKilledWhenInitializing failing on branch-1 (branch-1.4) 
Temporarily disabled flaky test TestRSKilledWhenInitializing
 2017-09-13 14:48:36 -07:00
Andrew Purtell 3f785a83b2 Revert "HBASE-16488 Starting namespace and quota services in master startup asynchronizely (Stephen Yuan Jiang)" 
This reverts commit af359d03b5.
 2017-09-13 13:24:58 -07:00
Guangxu Cheng a8ac84f1a6 HBASE-18789 Displays the reporting interval of each RS on the Master page 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-09-13 09:39:09 -07:00
Abhishek Singh Chouhan 432ca7e3fb HBASE-18771 Incorrect StoreFileRefresh leading to split and compaction failures 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2017-09-12 18:08:50 -07:00
tedyu b6a12c843e HBASE-18652 Expose individual cache stats in a CombinedCache through JMX - revert due to test failure 2017-09-08 14:21:30 -07:00
tedyu ab8a667c45 HBASE-18641 Include block content verification logic used in lruCache in bucketCache - revert due to test failure 2017-09-08 12:45:47 -07:00
Biju Nair a6dbeba22a HBASE-18641 Include block content verification logic used in lruCache in bucketCache 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-09-08 12:07:02 -07:00
Biju Nair 5bfe1da984 HBASE-18652 Expose individual cache stats in a CombinedCache through JMX 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-09-06 13:30:44 -07:00
Biju Nair 5de4a7d898 HBASE-18737 Display configured max size of cache on RS UI 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-09-06 11:06:27 -07:00
Zach York 4733aa4655 HBASE-18757 Fix improper bitwise & in bucketcache offset calculation 
This correctly casts the operand to a long to avoid negative offsets created by sign extending the integer operand.

Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-09-05 15:10:08 -07:00
Chun-Hao Tang 8eacd32beb HBASE-18746 Throw exception with job.getStatus().getFailureInfo() when ExportSnapshot fails 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2017-09-05 02:04:09 +08:00
tedyu d5033fd350 HBASE-18743 HFiles in use by a table which has the same name and namespace with a default table cloned from snapshot may be deleted when that snapshot and default table are deleted (wenbang) 2017-09-04 07:52:57 -07:00
Cesar Delgado 8178305d4e HBASE-18675 Making {max,min}SessionTimeout configurable for MiniZooKeeperCluster 
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>
 2017-08-30 14:32:37 -07:00
Sean Mackrory aec4bf6bae HBASE-15947 Classes used only for tests included in main code base 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2017-08-30 10:53:31 +08:00
Vikas Vishwakarma f071e56a9e HBASE-18633 Add more info to understand the source/scenario of large batch requests exceeding threshold 2017-08-28 15:30:40 +05:30
Ajay Jadhav 7d605fe9c2 HBASE-18448 Added refresh HFiles coprocessor endpoint 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-08-24 16:05:04 -07:00
Mike Drob 362a2924d2 HBASE-18628 Fix event pre-emption in ZKPermWatcher 
Instead of using an Atomic Reference to data and aborting when we detect
that new data comes in, use the native cancellation/pre-emption features
of Java Future.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2017-08-23 16:42:33 -07:00
Biju Nair 19a80c8234 HBASE-18532 Improve cache related stats rendered on RS UI 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-08-23 13:26:10 -07:00
Biju Nair ad22437d05 HBASE-18614 Setting BUCKET_CACHE_COMBINED_KEY to false disables stats on RS UI 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-08-23 10:51:27 -07:00
Michael Stack 338232f81f Revert "HBASE-14498 Master stuck in infinite loop when all Zookeeper servers are unreachable" 
Lots of tests timing out. Revert for now.

This reverts commit 7a96682643.
 2017-08-22 08:31:55 -07:00
Michael Stack b8857b0a7b HBASE-16615 Fix flaky TestScannerHeartbeatMessages (Duo Zhang) 2017-08-21 16:01:26 -07:00
Andrew Purtell 19fffacd3a HBASE-18623 Frequent failed to parse at EOF warnings from WALEntryStream 2017-08-21 09:29:20 -07:00
Pankaj Kumar 7a96682643 HBASE-14498 Master stuck in infinite loop when all Zookeeper servers are unreachable 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-08-18 14:23:59 -07:00
Chia-Ping Tsai f61f09cdf2 HBASE-18471 The DeleteFamily cell is skipped when StoreScanner seeks to next column 2017-08-19 02:14:37 +08:00
Chia-Ping Tsai 10d65ee37f HBASE-18572 Delete can't remove the cells which have no visibility label 2017-08-19 01:56:29 +08:00
tedyu 64bef67558 HBASE-18617 FuzzyRowKeyFilter should not modify the filter pairs (vinisha) 2017-08-18 10:02:06 -07:00
Pankaj Kumar deeda60c69 HBASE-17617 Backport HBASE-16731 (Inconsistent results from the Get/Scan if we use the empty FilterList) to branch-1 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2017-08-17 18:31:57 +08:00
Zach York 1f1ab8c873 HBASE-18587 Fix flaky TestFileIOEngine 
This short circuits reads and writes with 0 length and also removes flakiness in TestFileIOEngine

Signed-off-by: Michael Stack <stack@apache.org>
 2017-08-16 14:50:11 -07:00
Andrew Purtell 3feb87b005 HBASE-18431 Mitigate compatibility concerns between branch-1.3 and branch-1.4 
- Refactor TableName into its own proto module and fix up users

- Move SnapshotDescription from Snapshot.proto back to HBase.proto

- Restore FastLongHistogram and TestFastLongHistogram;
  deprecate FastLongHistogram

- Move DeleteQueryTracker back to o.a.h.h.regionserver
 2017-08-16 11:34:18 -07:00
Ramkrishna 6255dc7001 HBASE-18251 Remove unnecessary traversing to the first and last keys in 
the CellSet (Toshihoro Suzuki)
 2017-08-16 10:50:58 -07:00
Ashish Singhi a49d43bfbf HBASE-18437 Revoke access permissions of a user from a table does not work as expected 
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/security/access/AccessControlLists.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/access/TestAccessController.java
 2017-08-15 18:59:21 -07:00
Pankaj Kumar d7c6a0bf43 HBASE-18512, Region Server will abort with IllegalStateException if HDFS umask has limited scope 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-08-15 13:26:28 -07:00
tedyu 3ed765257e HBASE-18526 FIFOCompactionPolicy pre-check uses wrong scope (Vladimir Rodionov) 2017-08-15 11:09:55 -07:00
Zach York d6a781cf08 HBASE-18533 Expose BucketCache values to be configured 
Before this commit, BucketCache always used the default values.
This commit adds the ability to configure these values.

Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-08-14 13:28:42 -07:00
Jerry He 9078a034c4 HBASE-18522 Add RowMutations support to Batch 2017-08-14 09:21:53 -07:00
Esteban Gutierrez 578e29f96b HBASE-18025 CatalogJanitor should collect outdated RegionStates from the AM 2017-08-11 14:39:16 -05:00
Jan Hentschel b181f172ef HBASE-18197 Avoided to call job.waitForCompletion(true) two times 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2017-08-12 02:47:25 +08:00
Yu Li a03c2036e9 HBASE-18469 Correct RegionServer metric of totalRequestCount 2017-08-11 14:53:23 +08:00
Esteban Gutierrez 15bad3c036 HBASE-18024 HRegion#initializeRegionInternals should not re-create .hregioninfo file when the region directory no longer exists 2017-08-10 18:54:01 -05:00
Ashu Pachauri cab492d34f HBASE-18398: Snapshot operation fails with FileNotFoundException 2017-08-10 14:49:59 -07:00