Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,589 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

5301 Commits

Author SHA1 Message Date
Wellington Chevreuil 539de1cae9
HBASE-21959 - CompactionTool should close the store it uses for compacting files, in order to properly archive compacted files. 
Reapply without unit test

Change-Id: If852529e79274a77eb08cac13936f02776232608
Signed-off-by: Xu Cang <xucang@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
 2019-04-17 18:54:34 -07:00
Andrew Purtell 46e0e88056
Revert "HBASE-21959 - CompactionTool should close the store it uses for compacting files, in order to properly archive compacted files." 
This reverts commit c1a64aaa1a.
 2019-04-17 18:54:34 -07:00
Wei-Chiu Chuang 4af4afc94f HBASE-21048 Get LogLevel is not working from console in secure environment 
Signed-off-by: Reid Chan <reidchan@apache.org>
 2019-04-17 10:58:39 +08:00
Andrew Purtell 084745de18
HBASE-22235 OperationStatus.{SUCCESS|FAILURE|NOT_RUN} are not visible to 3rd party coprocessors 2019-04-16 13:18:00 -07:00
Gary Helmling 0db4041c55
HBASE-17884 Backport HBASE-16217 to branch-1 
HBASE-16217 Pass through the calling user in ObserverContext

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-04-16 13:02:11 -07:00
wellington d526bae579
HBASE-20586: add support for clusters on different realms (with cross-realm authentication) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-04-15 11:24:12 -07:00
liubangchen e79e4aefc0
HBASE-19008 Add missing equals or hashCode method(s) to stock Filter implementations 
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Ted Yu <yuzhihong@gmail.com>

and

HBASE-21129 Clean up duplicate codes in #equals and #hashCode methods of Filter

Signed-off-by Ted Yu <yuzhihong@gmail.com>

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-04-12 16:06:14 -07:00
Bahram Chechrazy 465b150975 HBASE-22194 Snapshot unittests fail on Windows due to invalid file path uri 
Signed-off-by: Sergey Shelukhin <sershe@apache.org>
 2019-04-11 11:38:15 -07:00
Josh Elser 677ed9ef89
HBASE-22057 Cap the size of the nodes we delete in one ZK.multi call 
If we try to delete too many znodes at once, we'll smack into the
jute.maxbuffer size. Try to prevent that from happening. The dominating
factor of the ZK client request should be the znode side on a delete.

Signed-off-by: Peter Somogyi <psomogyi@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/RecoverableZooKeeper.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/ZKUtil.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/zookeeper/TestZKMulti.java
 2019-04-10 18:24:37 -07:00
Ankit Singhal 01f8e1eaa3 HBASE-22106 Better log message when failing to load coprocessor 
Signed-off-by: Josh Elser <elserj@apache.org>
 2019-04-10 12:59:48 -04:00
huzheng 055a47e5c3 HBASE-22185 RAMQueueEntry#writeToCache should freeBlock if any exception encountered instead of the IOException catch block #130 2019-04-10 14:19:23 +08:00
iamgd67 6df26a1ef9 HBASE-21818 Incorrect list item in javadoc 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2019-04-08 14:53:01 +02:00
chaiwentao 3aa64b12da HBASE-22070 Checking restoreDir in RestoreSnapshotHelper 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2019-04-06 16:14:58 +02:00
Xu Cang 6f151269d3
HBASE-22067 Fix log in StochasticLoadBalancer when balancer 2019-03-26 11:45:53 -07:00
Sakthi 1366f5cb6a
HBASE-21991: Fix MetaMetrics issues - [Race condition, Faulty remove logic], few improvements 
Signed-off-by: Xu Cang <xucang@apache.org>
 2019-03-22 00:20:24 -07:00
Andrew Purtell 953e0f5f77
HBASE-22034 Backport HBASE-21401 and HBASE-22032 to branch-1 
HBASE-21401 Sanity check when constructing the KeyValue

HBASE-22032 KeyValue validation should check for null byte array
 2019-03-21 17:27:54 -07:00
Wellington Chevreuil c1a64aaa1a
HBASE-21959 - CompactionTool should close the store it uses for compacting files, in order to properly archive compacted files. 
Change-Id: If852529e79274a77eb08cac13936f02776232608
Signed-off-by: Xu Cang <xucang@apache.org>
 2019-03-21 14:20:51 -07:00
Sakthi f4de34a03d
HBASE-21800: RegionServer aborted due to NPE from MetaTableMetrics coprocessor 
Have included code refactoring in MetaTableMetrics & LossyCounting

Signed-off-by: Xu Cang <xucang@apache.org>
 2019-03-21 14:13:59 -07:00
Sakthi 3d3832ebbc
HBASE-20917 MetaTableMetrics#stop references uninitialized requestsMap for non-meta region - addendum 
Signed-off-by: Xu Cang <xucang@apache.org>
 2019-03-21 14:09:20 -07:00
Andrew Purtell 301bbe1b8e
HBASE-21926 Profiler servlet 2019-03-17 18:48:41 -07:00
Josh Elser 25defc9293 HBASE-21796 Recover a ZK client from the AUTH_FAILED state 
Introduces "hbase.zookeeper.authfailed.retries.number" and
"hbase.zookeeper.authfailed.pause" to control number of retries
from the AUTH_FAILED state (and the pause in millis between
attempts) before giving up and throwing an uncaught exception.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-03-12 22:12:34 -04:00
chenyechao b3e3085bca HBASE-21810 bulkload support set hfile compression on client 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-03-12 18:29:14 +08:00
Xu cang 3b1e56ec36
HBASE-21952 Fix unit test: TestClientOperationInterrupt#testInterrupt50Percent 2019-02-28 22:18:43 -08:00
Mingliang Liu f4af3881c1
HBASE-21164 reportForDuty should do backoff rather than retry 
Remove unused methods from Sleeper (its ok, its @Private).
Remove notion of startTime from Sleeper handling (it is is unused).
Allow passing in how long to sleep so can maintain externally.
In HRS, use a RetryCounter to calculate backoff sleep time for when
reportForDuty is failing against a struggling Master.

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerReportForDuty.java
 2019-02-20 18:15:30 -08:00
Andrew Purtell 47e42dab75
Revert "HBASE-21164 reportForDuty should do backoff rather than retry" 
This reverts commit f3f3798575.

This change causes TestMasterShutdown to reproducibly fail in some environments.
 2019-02-20 09:25:46 -08:00
Guanghao Zhang fd74857d24 HBASE-21932 Use Runtime.getRuntime().halt to terminate regionserver when abort timeout 2019-02-20 16:16:36 +08:00
Josh Elser ff49338d20 HBASE-21915 Make FileLinkInputStream implement CanUnbuffer 
Signed-off-by: Wellington Chevreuil <wellington.chevreuil@gmail.com>
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
 2019-02-19 17:00:26 -05:00
Xiang Li ed6939f94a
HBASE-21866 Do not move the table to null rsgroup when creating an existing table 2019-02-18 10:56:31 -08:00
lujie 322ea5456f
HBASE-21740 Fix NPE while shutting down RS 2019-02-18 02:53:46 -08:00
Sean Busbey 6296bad9cf HBASE-21884 Fix box/unbox findbugs warning in secure bulk load 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2019-02-13 07:40:07 -06:00
zhangduo 6caf5aa195
HBASE-21838 Create a special ReplicationEndpoint just for verifying the WAL entries are fine 
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/VerifyWALEntriesReplicationEndpoint.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestVerifyCellsReplicationEndpoint.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
 2019-02-12 10:58:29 -08:00
Andrew Purtell ce6a6014da
Update POMs and CHANGES.txt for 1.5.0 RC0 2019-02-01 12:36:10 -08:00
Andrew Purtell ff0e587b8f
HBASE-21735 Port HBASE-18784 (Use of filesystem that requires hflush / hsync / append / etc should query outputstream capabilities) to branch-1 
HBASE-18784 if available, query underlying outputstream capabilities where we need hflush/hsync.

* pull things that don't rely on HDFS in hbase-server/FSUtils into hbase-common/CommonFSUtils
* refactor setStoragePolicy so that it can move into hbase-common/CommonFSUtils
* refactor WALProcedureStore so that it handles its own FS interactions
* add a reflection-based lookup of stream capabilities
* call said lookup in places where we make WALs to make sure hflush/hsync is available.

HBASE-19289 Add flag to disable stream capability enforcement

HBASE-19841 Tests against hadoop3 fail with StreamLacksCapabilityException

HBASE-19947 ITU should overwrite HTU local FS

HBASE-20354 better docs for impact of proactively checking hsync support.

* Add to the quickstart guide disabling the hsync check, with a
  big warning about how we'll lose data if the check is disabled.
* Add to troubleshooting section so folks searching can get a pointer.
 2019-01-24 09:23:14 -08:00
Andrew Purtell b51c487206
HBASE-21748 Port HBASE-21738 (Remove all the CLSM#size operation in our memstore because it's an quite time consuming) to branch-1 2019-01-23 18:09:11 -08:00
Nihal Jain c1c2bc2f0a
HBASE-21475 Put mutation (having TTL set) added via co-processor is retrieved even after TTL expires 
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/coprocessor/TestRegionObserverForAddingMutationsFromCoprocessors.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
 2019-01-23 17:01:20 -08:00
Allan Yang 20759a3c7e
HBASE-20870 Wrong HBase root dir in ITBLL's Search Tool 
Conflicts:
	hbase-it/src/test/java/org/apache/hadoop/hbase/IntegrationTestingUtility.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
 2019-01-23 16:12:09 -08:00
Andrew Purtell d3ce26101e
HBASE-21766 TestSimpleRpcScheduler is flaky (branch-1) 2019-01-23 14:55:04 -08:00
Sergey Shelukhin 7cefd8bc25 HBASE-21575 : memstore above high watermark message is logged too much 2019-01-22 16:41:43 -08:00
xcang acdd23ec4c
HBASE-21561 Backport HBASE-21413 (Empty meta log doesn't get split when restart whole cluster) to branch-1 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-01-21 18:06:48 -08:00
Nihal Jain aa1b750899
HBASE-21749 RS UI may throw NPE and make rs-status page inaccessible with multiwal and replication 
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/ReplicationSource.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
 2019-01-21 17:31:13 -08:00
Andrew Purtell 1fd76bd35a
HBASE-21680 Port HBASE-20194 (Basic Replication WebUI - Master) and HBASE-20193 (Basic Replication Web UI - Regionserver) to branch-1 
HBASE-20193 Basic Replication Web UI - Regionserver

HBASE-20194 Basic Replication WebUI - Master
 2019-01-21 17:25:20 -08:00
Nihal Jain 0546b77a31
HBASE-21645 Perform sanity check and disallow table creation/modification with region replication < 1 
Signed-off-by: Guanghao Zhang <zghao@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestFromClientSide.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
 2019-01-17 17:48:53 -08:00
Pankaj 52b8978212
HBASE-21595 Print thread's information and stack traces when RS is aborting forcibly 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-01-17 10:40:55 -08:00
Andrew Purtell 2c0b6f8227
HBASE-21616 Port HBASE-21034 (Add new throttle type: read/write capacity unit) to branch-1 
HBASE-21034 Add new throttle type: read/write capacity unit

HBASE-21578 Fix wrong throttling exception for capacity unit
 2019-01-16 15:59:46 -08:00
Beluga Behr 0315c2d65d HBASE-20209 Do Not Use Both Map containsKey and get Methods in Replication Sink 
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 3e92cd5771)
 2019-01-16 14:50:41 -07:00
openinx cd0645a5f6
HBASE-21675 Port HBASE-21642 (CopyTable by reading snapshot and bulkloading will save a lot of time) to branch-1 
HBASE-21642 CopyTable by reading snapshot and bulkloading will save a lot of time

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-01-16 10:03:43 -08:00
Guanghao Zhang 336de0aed4
HBASE-21659 Avoid to load duplicate coprocessors in system config and table descriptor 
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/coprocessor/TestRegionCoprocessorHost.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
 2019-01-14 16:07:28 -08:00
jingyuntian 18891467fa
HBASE-20986 Separate the config of block size when we do log splitting and write Hlog 
Signed-off-by: Guanghao Zhang <zghao@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/WALUtil.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/wal/FSHLogProvider.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
 2019-01-14 14:22:15 -08:00
Ashish Singhi feb8a57a9a
HBASE-16499 slow replication for small HBase clusters 
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
 2019-01-14 14:10:19 -08:00
Nihal Jain a3e274cf57
HBASE-21196 HTableMultiplexer clears the meta cache after every put operation 
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncRequestFutureImpl.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
 2019-01-14 11:24:08 -08:00