5421 Commits

Author SHA1 Message Date
Xu Cang
06fcaac281
HBASE-22274 Cell size limit check on append considers cell's previous size 2019-05-09 20:27:27 -07:00
z-york
a66fafbad6
HBASE-22389 Revert "HBASE-19275 TestSnapshotFileCache never worked properly" (#229)
This reverts commit e8e4beacb039299a9e56cd355e3ada08784a7acb.
2019-05-09 17:17:28 -07:00
zhangduo
c5859b554d HBASE-22390 Backport HBASE-22190 to branch-1
HBASE-22190 SnapshotFileCache may fail to load the correct snapshot file list when there is an on-going snapshot operation

closes #230

Co-authored-by: Zach York <zyork@amazon.com>
2019-05-09 16:55:30 -07:00
Abhishek Singh Chouhan
190d189fef
Addendum HBASE-22330 Backport HBASE-20724 (Sometimes some compacted storefiles are still opened after region failover) to branch-1 2019-05-09 15:54:00 -07:00
Andrew Purtell
541e942c8d
HBASE-22375 Promote AccessChecker to LimitedPrivate(Coprocessor) 2019-05-08 18:19:17 -07:00
Abhishek Singh Chouhan
f4881dcf1b
HBASE-22330 Backport HBASE-20724 (Sometimes some compacted storefiles are still opened after region failover) to branch-1 2019-05-08 16:27:53 -07:00
Yu Li
e4ab715901 HBASE-21777 Only log compaction pressure throughput when changed or traced (addendum)
Fix the findbugs warning
2019-05-09 01:00:59 +08:00
Tak Lon (Stephen) Wu
fbd53bfefb HBASE-21777 Only log compaction pressure throughput when changed or traced 2019-05-08 02:28:08 +08:00
z-york
13da268169 HBASE-21070 Add Test for SnapshotFileCache for HBase backed by S3 (#209)
SnapshotFileCache depends on getting the last modified time of the
snapshot directory, however, S3 FileSystem's do not update the
last modified time of the top 'folder' when objects are added/removed.
This commit adds a test for the previously fixed SnapshotFileCache.
2019-05-06 12:04:45 -07:00
Andrew Purtell
26b9e76bbf
HBASE-22301 Consider rolling the WAL if the HDFS write pipeline is slow 2019-05-01 17:43:43 -07:00
Thiruvel Thirumoolan
36b4c0fc6f
HBASE-21883 Enhancements to Major Compaction tool
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-04-30 17:29:19 -07:00
Josh Elser
630ac33fb0
HBASE-22215 HBASE-22144 Correct MultiRowRangeFilter to work with reverse scans
Re-application of change with a mind towards binary compatibility.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-04-30 11:17:51 -07:00
Andrew Purtell
d61fcf5848
Revert "HBASE-22215 HBASE-22144 Correct MultiRowRangeFilter to work with reverse scans"
This reverts commit c10ee4d23be40a26070448d48e0608c7be95d4e1.

Reverted due to binary compatibility concerns related to a Public/Evolving interface.
See comments on HBASE-22215 for detail.
2019-04-29 15:32:14 -07:00
Andrew Purtell
8d18a85e30
HBASE-22225 Profiler tab on Master/RS UI not working w/o comprehensive message 2019-04-29 13:24:47 -07:00
chfeng
0aa75dce28
HBASE-21815 Make isTrackingMetrics and getMetrics of ScannerContext public
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-04-29 13:02:41 -07:00
Andrew Purtell
5ea7851352
HBASE-22310 checkAndMutate used an incorrect row to check the condition (Adonis Ling) 2019-04-26 14:22:37 -07:00
Zach York
8563644f89
HBASE-22291 Fix recovery of recovered.edits files under root dir
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-04-25 18:18:55 -07:00
Puleya7
edc30fc950 HBASE-22270. master's jmx.clusterRequests could be negative in branch-1 (#164)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-04-24 14:18:59 -07:00
Xu Cang
e4644c35c1
HBASE-16488 Starting namespace and quota services in master startup asynchronously
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-04-23 18:31:52 -07:00
Josh Elser
c10ee4d23b HBASE-22215 HBASE-22144 Correct MultiRowRangeFilter to work with reverse scans
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
2019-04-23 15:27:27 -04:00
Wellington Chevreuil
539de1cae9
HBASE-21959 - CompactionTool should close the store it uses for compacting files, in order to properly archive compacted files.
Reapply without unit test

Change-Id: If852529e79274a77eb08cac13936f02776232608
Signed-off-by: Xu Cang <xucang@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-04-17 18:54:34 -07:00
Andrew Purtell
46e0e88056
Revert "HBASE-21959 - CompactionTool should close the store it uses for compacting files, in order to properly archive compacted files."
This reverts commit c1a64aaa1a75abd0a89209c317a3fecd81853fe6.
2019-04-17 18:54:34 -07:00
Wei-Chiu Chuang
4af4afc94f HBASE-21048 Get LogLevel is not working from console in secure environment
Signed-off-by: Reid Chan <reidchan@apache.org>
2019-04-17 10:58:39 +08:00
Andrew Purtell
084745de18
HBASE-22235 OperationStatus.{SUCCESS|FAILURE|NOT_RUN} are not visible to 3rd party coprocessors 2019-04-16 13:18:00 -07:00
Gary Helmling
0db4041c55
HBASE-17884 Backport HBASE-16217 to branch-1
HBASE-16217 Pass through the calling user in ObserverContext

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-04-16 13:02:11 -07:00
wellington
d526bae579
HBASE-20586: add support for clusters on different realms (with cross-realm authentication)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-04-15 11:24:12 -07:00
liubangchen
e79e4aefc0
HBASE-19008 Add missing equals or hashCode method(s) to stock Filter implementations
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Ted Yu <yuzhihong@gmail.com>

and

HBASE-21129 Clean up duplicate codes in #equals and #hashCode methods of Filter

Signed-off-by Ted Yu <yuzhihong@gmail.com>

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-04-12 16:06:14 -07:00
Bahram Chechrazy
465b150975 HBASE-22194 Snapshot unittests fail on Windows due to invalid file path uri
Signed-off-by: Sergey Shelukhin <sershe@apache.org>
2019-04-11 11:38:15 -07:00
Josh Elser
677ed9ef89
HBASE-22057 Cap the size of the nodes we delete in one ZK.multi call
If we try to delete too many znodes at once, we'll smack into the
jute.maxbuffer size. Try to prevent that from happening. The dominating
factor of the ZK client request should be the znode side on a delete.

Signed-off-by: Peter Somogyi <psomogyi@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/RecoverableZooKeeper.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/ZKUtil.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/zookeeper/TestZKMulti.java
2019-04-10 18:24:37 -07:00
Ankit Singhal
01f8e1eaa3 HBASE-22106 Better log message when failing to load coprocessor
Signed-off-by: Josh Elser <elserj@apache.org>
2019-04-10 12:59:48 -04:00
huzheng
055a47e5c3 HBASE-22185 RAMQueueEntry#writeToCache should freeBlock if any exception encountered instead of the IOException catch block #130 2019-04-10 14:19:23 +08:00
iamgd67
6df26a1ef9 HBASE-21818 Incorrect list item in javadoc
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-04-08 14:53:01 +02:00
chaiwentao
3aa64b12da HBASE-22070 Checking restoreDir in RestoreSnapshotHelper
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-04-06 16:14:58 +02:00
Xu Cang
6f151269d3
HBASE-22067 Fix log in StochasticLoadBalancer when balancer 2019-03-26 11:45:53 -07:00
Sakthi
1366f5cb6a
HBASE-21991: Fix MetaMetrics issues - [Race condition, Faulty remove logic], few improvements
Signed-off-by: Xu Cang <xucang@apache.org>
2019-03-22 00:20:24 -07:00
Andrew Purtell
953e0f5f77
HBASE-22034 Backport HBASE-21401 and HBASE-22032 to branch-1
HBASE-21401 Sanity check when constructing the KeyValue

HBASE-22032 KeyValue validation should check for null byte array
2019-03-21 17:27:54 -07:00
Wellington Chevreuil
c1a64aaa1a
HBASE-21959 - CompactionTool should close the store it uses for compacting files, in order to properly archive compacted files.
Change-Id: If852529e79274a77eb08cac13936f02776232608
Signed-off-by: Xu Cang <xucang@apache.org>
2019-03-21 14:20:51 -07:00
Sakthi
f4de34a03d
HBASE-21800: RegionServer aborted due to NPE from MetaTableMetrics coprocessor
Have included code refactoring in MetaTableMetrics & LossyCounting

Signed-off-by: Xu Cang <xucang@apache.org>
2019-03-21 14:13:59 -07:00
Sakthi
3d3832ebbc
HBASE-20917 MetaTableMetrics#stop references uninitialized requestsMap for non-meta region - addendum
Signed-off-by: Xu Cang <xucang@apache.org>
2019-03-21 14:09:20 -07:00
Andrew Purtell
301bbe1b8e
HBASE-21926 Profiler servlet 2019-03-17 18:48:41 -07:00
Josh Elser
25defc9293 HBASE-21796 Recover a ZK client from the AUTH_FAILED state
Introduces "hbase.zookeeper.authfailed.retries.number" and
"hbase.zookeeper.authfailed.pause" to control number of retries
from the AUTH_FAILED state (and the pause in millis between
attempts) before giving up and throwing an uncaught exception.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-03-12 22:12:34 -04:00
chenyechao
b3e3085bca HBASE-21810 bulkload support set hfile compression on client
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-12 18:29:14 +08:00
Xu cang
3b1e56ec36
HBASE-21952 Fix unit test: TestClientOperationInterrupt#testInterrupt50Percent 2019-02-28 22:18:43 -08:00
Mingliang Liu
f4af3881c1
HBASE-21164 reportForDuty should do backoff rather than retry
Remove unused methods from Sleeper (its ok, its @Private).
Remove notion of startTime from Sleeper handling (it is is unused).
Allow passing in how long to sleep so can maintain externally.
In HRS, use a RetryCounter to calculate backoff sleep time for when
reportForDuty is failing against a struggling Master.

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerReportForDuty.java
2019-02-20 18:15:30 -08:00
Andrew Purtell
47e42dab75
Revert "HBASE-21164 reportForDuty should do backoff rather than retry"
This reverts commit f3f3798575527df45961f4cbdb6d4c1d04cfb1e3.

This change causes TestMasterShutdown to reproducibly fail in some environments.
2019-02-20 09:25:46 -08:00
Guanghao Zhang
fd74857d24 HBASE-21932 Use Runtime.getRuntime().halt to terminate regionserver when abort timeout 2019-02-20 16:16:36 +08:00
Josh Elser
ff49338d20 HBASE-21915 Make FileLinkInputStream implement CanUnbuffer
Signed-off-by: Wellington Chevreuil <wellington.chevreuil@gmail.com>
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2019-02-19 17:00:26 -05:00
Xiang Li
ed6939f94a
HBASE-21866 Do not move the table to null rsgroup when creating an existing table 2019-02-18 10:56:31 -08:00
lujie
322ea5456f
HBASE-21740 Fix NPE while shutting down RS 2019-02-18 02:53:46 -08:00
Sean Busbey
6296bad9cf HBASE-21884 Fix box/unbox findbugs warning in secure bulk load
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-02-13 07:40:07 -06:00