Commit Graph

12718 Commits

Author SHA1 Message Date
Andrew Purtell 6da696c0a0
Amend HBASE-21135 Build fails on windows as it fails to parse windows path during license check
Fix Maven warning introduced by this change
2019-03-28 10:13:31 -07:00
xuqinya c01f95d2bb HBASE-21781 list_deadservers elapsed time is incorrect 2019-03-28 13:29:10 +01:00
Andrew Purtell 53d825eef8
Update CHANGES.txt for 1.5.0 RC3 2019-03-26 16:19:03 -07:00
Xu Cang 6f151269d3
HBASE-22067 Fix log in StochasticLoadBalancer when balancer 2019-03-26 11:45:53 -07:00
Xiang Li b9feefbff6
HBASE-22009 Improve RSGroupInfoManagerImpl#getDefaultServers()
Signed-off-by: Xu Cang <xucang@apache.org>
2019-03-25 00:24:21 -07:00
Sakthi 1366f5cb6a
HBASE-21991: Fix MetaMetrics issues - [Race condition, Faulty remove logic], few improvements
Signed-off-by: Xu Cang <xucang@apache.org>
2019-03-22 00:20:24 -07:00
Andrew Purtell 953e0f5f77
HBASE-22034 Backport HBASE-21401 and HBASE-22032 to branch-1
HBASE-21401 Sanity check when constructing the KeyValue

HBASE-22032 KeyValue validation should check for null byte array
2019-03-21 17:27:54 -07:00
Wellington Chevreuil c1a64aaa1a
HBASE-21959 - CompactionTool should close the store it uses for compacting files, in order to properly archive compacted files.
Change-Id: If852529e79274a77eb08cac13936f02776232608
Signed-off-by: Xu Cang <xucang@apache.org>
2019-03-21 14:20:51 -07:00
Sakthi f4de34a03d
HBASE-21800: RegionServer aborted due to NPE from MetaTableMetrics coprocessor
Have included code refactoring in MetaTableMetrics & LossyCounting

Signed-off-by: Xu Cang <xucang@apache.org>
2019-03-21 14:13:59 -07:00
Sakthi 3d3832ebbc
HBASE-20917 MetaTableMetrics#stop references uninitialized requestsMap for non-meta region - addendum
Signed-off-by: Xu Cang <xucang@apache.org>
2019-03-21 14:09:20 -07:00
Xiang LI d16058e54a
HBASE-22051 Expect values are hard-coded in the verifications of TestRSGroupsBasics
Signed-off-by: Xu Cang <xucang@apache.org>
2019-03-21 13:49:25 -07:00
Xu Cang 530bd6f570
Revert "HBASE-22009 Improve RSGroupInfoManagerImpl#getDefaultServers()"
This reverts commit 73f138c302.
2019-03-19 15:32:28 -07:00
TAK LON WU ee31b6a80b HBASE-21963 Add a script for building and verifying release candidate 2019-03-18 20:09:55 +01:00
Xiang Li 73f138c302
HBASE-22009 Improve RSGroupInfoManagerImpl#getDefaultServers()
Signed-off-by: Xu Cang <xucang@apache.org>
2019-03-18 11:36:56 -07:00
Andrew Purtell 301bbe1b8e
HBASE-21926 Profiler servlet 2019-03-17 18:48:41 -07:00
Sean Busbey 35308a5d82 HBASE-22044 Addendum for checkstyle. 2019-03-13 13:42:53 -05:00
Sean Busbey 8cab60cd2b HBASE-22044 Restore compat for ByteBufferUtils. Also deprecated because it will be IA.Private in HBase 3.0
(cherry picked from commit f13a897bf7484f0bc512048e7a16f0d8f04cc238)

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-03-13 13:41:17 -05:00
Josh Elser 25defc9293 HBASE-21796 Recover a ZK client from the AUTH_FAILED state
Introduces "hbase.zookeeper.authfailed.retries.number" and
"hbase.zookeeper.authfailed.pause" to control number of retries
from the AUTH_FAILED state (and the pause in millis between
attempts) before giving up and throwing an uncaught exception.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-03-12 22:12:34 -04:00
Abhishek Singh Chouhan 701c29b30b
HBASE-22045 Mutable range histogram reports incorrect outliers 2019-03-12 18:17:30 -07:00
chenyechao b3e3085bca HBASE-21810 bulkload support set hfile compression on client
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-12 18:29:14 +08:00
Xiang Li 6bbf363b6c
HBASE-21987 Simplify RSGroupInfoManagerImpl#flushConfig() for offline mode
Signed-off-by: Xu Cang <xucang@apache.org>
2019-03-11 14:12:05 -07:00
Nihal Jain 6f932ce01f HBASE-21135 Build fails on windows as it fails to parse windows path during license check
Signed-off-by: Mike Drob <mdrob@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 691f1a4c71)
2019-03-09 00:53:01 -06:00
stack 02f6d333a8 HBASE-21990 puppycrawl checkstyle dtds 404... moved to sourceforge 2019-03-04 21:01:14 -08:00
Xu cang 3b1e56ec36
HBASE-21952 Fix unit test: TestClientOperationInterrupt#testInterrupt50Percent 2019-02-28 22:18:43 -08:00
Xiang LI 77a7e707ca
HBASE-21969 Improve the update of destination rsgroup of RSGroupInfoManagerImpl#moveTables() 2019-02-28 22:18:21 -08:00
Andrew Purtell b5c50b506c
Update CHANGES.txt for 1.5.0 RC2 2019-02-21 12:17:15 -08:00
Mingliang Liu f4af3881c1
HBASE-21164 reportForDuty should do backoff rather than retry
Remove unused methods from Sleeper (its ok, its @Private).
Remove notion of startTime from Sleeper handling (it is is unused).
Allow passing in how long to sleep so can maintain externally.
In HRS, use a RetryCounter to calculate backoff sleep time for when
reportForDuty is failing against a struggling Master.

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerReportForDuty.java
2019-02-20 18:15:30 -08:00
Andrew Purtell 47e42dab75
Revert "HBASE-21164 reportForDuty should do backoff rather than retry"
This reverts commit f3f3798575.

This change causes TestMasterShutdown to reproducibly fail in some environments.
2019-02-20 09:25:46 -08:00
Guanghao Zhang fd74857d24 HBASE-21932 Use Runtime.getRuntime().halt to terminate regionserver when abort timeout 2019-02-20 16:16:36 +08:00
Josh Elser ff49338d20 HBASE-21915 Make FileLinkInputStream implement CanUnbuffer
Signed-off-by: Wellington Chevreuil <wellington.chevreuil@gmail.com>
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2019-02-19 17:00:26 -05:00
Xiang Li ed6939f94a
HBASE-21866 Do not move the table to null rsgroup when creating an existing table 2019-02-18 10:56:31 -08:00
lujie 322ea5456f
HBASE-21740 Fix NPE while shutting down RS 2019-02-18 02:53:46 -08:00
Andrew Purtell afba39399a
Update CHANGES.txt for 1.5.0 RC1 2019-02-14 14:39:21 -08:00
Andrew Purtell 493a4cde31
Revert "Update CHANGES.txt for 1.5.0 RC1"
This reverts commit 256c3d9855.

Somehow this commit has incorrect authorship attribution.
2019-02-14 14:38:07 -08:00
Sean Busbey 6296bad9cf HBASE-21884 Fix box/unbox findbugs warning in secure bulk load
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-02-13 07:40:07 -06:00
zhangduo 256c3d9855
Update CHANGES.txt for 1.5.0 RC1 2019-02-12 11:04:03 -08:00
zhangduo 6caf5aa195
HBASE-21838 Create a special ReplicationEndpoint just for verifying the WAL entries are fine
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/VerifyWALEntriesReplicationEndpoint.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestVerifyCellsReplicationEndpoint.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-02-12 10:58:29 -08:00
Sean Busbey 5b9e0df234 HBASE-21853 update copyright notices for contributions in 2019.
Signed-off-by: Amit Virmani <avirmani@cloudera.com>
Signed-off-by: Sakthi <sakthivel.azhaku@gmail.com>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit 1817725083)
2019-02-07 14:12:07 -06:00
Andrew Purtell 1acdec96cb
Revert "HBASE-21775 The BufferedMutator doesn't ever refresh region location cache Fix server location metadata refresh in multi-actions"
This reverts commit 4e89d98d4a.

Several unit tests are failing after this commit.
2019-02-05 14:01:37 -08:00
Peter Somogyi 48e8675728 HBASE-21727 Simplify documentation around client timeout - ADDENDUM
Add back HBaseConfiguration#getInt with deprecation

Signed-off-by: zhangduo <zhangduo@apache.org>
2019-02-05 18:28:03 +01:00
Andrew Purtell ce6a6014da
Update POMs and CHANGES.txt for 1.5.0 RC0 2019-02-01 12:36:10 -08:00
Andrew Purtell 38e2dbc503
Rebase CHANGES.txt on branch-1.4 2019-02-01 11:37:58 -08:00
Andrew Purtell dd9e7a1ce0
HBASE-21791 Upgrade thrift dependency to 0.12.0 2019-01-29 11:04:59 -08:00
Tommy Li 4e89d98d4a HBASE-21775 The BufferedMutator doesn't ever refresh region location cache Fix server location metadata refresh in multi-actions
This is a backport from branch-2 but we do not backport the test because
it uses branch-2-isms.

Signed-off-by: stack <stack@apache.org>
2019-01-26 13:46:26 -08:00
Andrew Purtell ff0e587b8f
HBASE-21735 Port HBASE-18784 (Use of filesystem that requires hflush / hsync / append / etc should query outputstream capabilities) to branch-1
HBASE-18784 if available, query underlying outputstream capabilities where we need hflush/hsync.

* pull things that don't rely on HDFS in hbase-server/FSUtils into hbase-common/CommonFSUtils
* refactor setStoragePolicy so that it can move into hbase-common/CommonFSUtils
* refactor WALProcedureStore so that it handles its own FS interactions
* add a reflection-based lookup of stream capabilities
* call said lookup in places where we make WALs to make sure hflush/hsync is available.

HBASE-19289 Add flag to disable stream capability enforcement

HBASE-19841 Tests against hadoop3 fail with StreamLacksCapabilityException

HBASE-19947 ITU should overwrite HTU local FS

HBASE-20354 better docs for impact of proactively checking hsync support.

* Add to the quickstart guide disabling the hsync check, with a
  big warning about how we'll lose data if the check is disabled.
* Add to troubleshooting section so folks searching can get a pointer.
2019-01-24 09:23:14 -08:00
Andrew Purtell b51c487206
HBASE-21748 Port HBASE-21738 (Remove all the CLSM#size operation in our memstore because it's an quite time consuming) to branch-1 2019-01-23 18:09:11 -08:00
Nihal Jain c1c2bc2f0a
HBASE-21475 Put mutation (having TTL set) added via co-processor is retrieved even after TTL expires
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/coprocessor/TestRegionObserverForAddingMutationsFromCoprocessors.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-23 17:01:20 -08:00
Allan Yang 20759a3c7e
HBASE-20870 Wrong HBase root dir in ITBLL's Search Tool
Conflicts:
	hbase-it/src/test/java/org/apache/hadoop/hbase/IntegrationTestingUtility.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-23 16:12:09 -08:00
Andrew Purtell d3ce26101e
HBASE-21766 TestSimpleRpcScheduler is flaky (branch-1) 2019-01-23 14:55:04 -08:00
Sergey Shelukhin 7cefd8bc25 HBASE-21575 : memstore above high watermark message is logged too much 2019-01-22 16:41:43 -08:00