Commit Graph

5459 Commits

Author SHA1 Message Date
Andrew Purtell d61fcf5848
Revert "HBASE-22215 HBASE-22144 Correct MultiRowRangeFilter to work with reverse scans"
This reverts commit c10ee4d23b.

Reverted due to binary compatibility concerns related to a Public/Evolving interface.
See comments on HBASE-22215 for detail.
2019-04-29 15:32:14 -07:00
Andrew Purtell 8d18a85e30
HBASE-22225 Profiler tab on Master/RS UI not working w/o comprehensive message 2019-04-29 13:24:47 -07:00
chfeng 0aa75dce28
HBASE-21815 Make isTrackingMetrics and getMetrics of ScannerContext public
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-04-29 13:02:41 -07:00
Andrew Purtell 5ea7851352
HBASE-22310 checkAndMutate used an incorrect row to check the condition (Adonis Ling) 2019-04-26 14:22:37 -07:00
Zach York 8563644f89
HBASE-22291 Fix recovery of recovered.edits files under root dir
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-04-25 18:18:55 -07:00
Puleya7 edc30fc950 HBASE-22270. master's jmx.clusterRequests could be negative in branch-1 (#164)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-04-24 14:18:59 -07:00
Xu Cang e4644c35c1
HBASE-16488 Starting namespace and quota services in master startup asynchronously
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-04-23 18:31:52 -07:00
Josh Elser c10ee4d23b HBASE-22215 HBASE-22144 Correct MultiRowRangeFilter to work with reverse scans
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
2019-04-23 15:27:27 -04:00
Wellington Chevreuil 539de1cae9
HBASE-21959 - CompactionTool should close the store it uses for compacting files, in order to properly archive compacted files.
Reapply without unit test

Change-Id: If852529e79274a77eb08cac13936f02776232608
Signed-off-by: Xu Cang <xucang@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-04-17 18:54:34 -07:00
Andrew Purtell 46e0e88056
Revert "HBASE-21959 - CompactionTool should close the store it uses for compacting files, in order to properly archive compacted files."
This reverts commit c1a64aaa1a.
2019-04-17 18:54:34 -07:00
Wei-Chiu Chuang 4af4afc94f HBASE-21048 Get LogLevel is not working from console in secure environment
Signed-off-by: Reid Chan <reidchan@apache.org>
2019-04-17 10:58:39 +08:00
Andrew Purtell 084745de18
HBASE-22235 OperationStatus.{SUCCESS|FAILURE|NOT_RUN} are not visible to 3rd party coprocessors 2019-04-16 13:18:00 -07:00
Gary Helmling 0db4041c55
HBASE-17884 Backport HBASE-16217 to branch-1
HBASE-16217 Pass through the calling user in ObserverContext

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-04-16 13:02:11 -07:00
wellington d526bae579
HBASE-20586: add support for clusters on different realms (with cross-realm authentication)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-04-15 11:24:12 -07:00
liubangchen e79e4aefc0
HBASE-19008 Add missing equals or hashCode method(s) to stock Filter implementations
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Ted Yu <yuzhihong@gmail.com>

and

HBASE-21129 Clean up duplicate codes in #equals and #hashCode methods of Filter

Signed-off-by Ted Yu <yuzhihong@gmail.com>

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-04-12 16:06:14 -07:00
Bahram Chechrazy 465b150975 HBASE-22194 Snapshot unittests fail on Windows due to invalid file path uri
Signed-off-by: Sergey Shelukhin <sershe@apache.org>
2019-04-11 11:38:15 -07:00
Josh Elser 677ed9ef89
HBASE-22057 Cap the size of the nodes we delete in one ZK.multi call
If we try to delete too many znodes at once, we'll smack into the
jute.maxbuffer size. Try to prevent that from happening. The dominating
factor of the ZK client request should be the znode side on a delete.

Signed-off-by: Peter Somogyi <psomogyi@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/RecoverableZooKeeper.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/ZKUtil.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/zookeeper/TestZKMulti.java
2019-04-10 18:24:37 -07:00
Ankit Singhal 01f8e1eaa3 HBASE-22106 Better log message when failing to load coprocessor
Signed-off-by: Josh Elser <elserj@apache.org>
2019-04-10 12:59:48 -04:00
huzheng 055a47e5c3 HBASE-22185 RAMQueueEntry#writeToCache should freeBlock if any exception encountered instead of the IOException catch block #130 2019-04-10 14:19:23 +08:00
iamgd67 6df26a1ef9 HBASE-21818 Incorrect list item in javadoc
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-04-08 14:53:01 +02:00
chaiwentao 3aa64b12da HBASE-22070 Checking restoreDir in RestoreSnapshotHelper
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-04-06 16:14:58 +02:00
Xu Cang 6f151269d3
HBASE-22067 Fix log in StochasticLoadBalancer when balancer 2019-03-26 11:45:53 -07:00
Sakthi 1366f5cb6a
HBASE-21991: Fix MetaMetrics issues - [Race condition, Faulty remove logic], few improvements
Signed-off-by: Xu Cang <xucang@apache.org>
2019-03-22 00:20:24 -07:00
Andrew Purtell 953e0f5f77
HBASE-22034 Backport HBASE-21401 and HBASE-22032 to branch-1
HBASE-21401 Sanity check when constructing the KeyValue

HBASE-22032 KeyValue validation should check for null byte array
2019-03-21 17:27:54 -07:00
Wellington Chevreuil c1a64aaa1a
HBASE-21959 - CompactionTool should close the store it uses for compacting files, in order to properly archive compacted files.
Change-Id: If852529e79274a77eb08cac13936f02776232608
Signed-off-by: Xu Cang <xucang@apache.org>
2019-03-21 14:20:51 -07:00
Sakthi f4de34a03d
HBASE-21800: RegionServer aborted due to NPE from MetaTableMetrics coprocessor
Have included code refactoring in MetaTableMetrics & LossyCounting

Signed-off-by: Xu Cang <xucang@apache.org>
2019-03-21 14:13:59 -07:00
Sakthi 3d3832ebbc
HBASE-20917 MetaTableMetrics#stop references uninitialized requestsMap for non-meta region - addendum
Signed-off-by: Xu Cang <xucang@apache.org>
2019-03-21 14:09:20 -07:00
Andrew Purtell 301bbe1b8e
HBASE-21926 Profiler servlet 2019-03-17 18:48:41 -07:00
Josh Elser 25defc9293 HBASE-21796 Recover a ZK client from the AUTH_FAILED state
Introduces "hbase.zookeeper.authfailed.retries.number" and
"hbase.zookeeper.authfailed.pause" to control number of retries
from the AUTH_FAILED state (and the pause in millis between
attempts) before giving up and throwing an uncaught exception.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-03-12 22:12:34 -04:00
chenyechao b3e3085bca HBASE-21810 bulkload support set hfile compression on client
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-12 18:29:14 +08:00
Xu cang 3b1e56ec36
HBASE-21952 Fix unit test: TestClientOperationInterrupt#testInterrupt50Percent 2019-02-28 22:18:43 -08:00
Mingliang Liu f4af3881c1
HBASE-21164 reportForDuty should do backoff rather than retry
Remove unused methods from Sleeper (its ok, its @Private).
Remove notion of startTime from Sleeper handling (it is is unused).
Allow passing in how long to sleep so can maintain externally.
In HRS, use a RetryCounter to calculate backoff sleep time for when
reportForDuty is failing against a struggling Master.

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerReportForDuty.java
2019-02-20 18:15:30 -08:00
Andrew Purtell 47e42dab75
Revert "HBASE-21164 reportForDuty should do backoff rather than retry"
This reverts commit f3f3798575.

This change causes TestMasterShutdown to reproducibly fail in some environments.
2019-02-20 09:25:46 -08:00
Guanghao Zhang fd74857d24 HBASE-21932 Use Runtime.getRuntime().halt to terminate regionserver when abort timeout 2019-02-20 16:16:36 +08:00
Josh Elser ff49338d20 HBASE-21915 Make FileLinkInputStream implement CanUnbuffer
Signed-off-by: Wellington Chevreuil <wellington.chevreuil@gmail.com>
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2019-02-19 17:00:26 -05:00
Xiang Li ed6939f94a
HBASE-21866 Do not move the table to null rsgroup when creating an existing table 2019-02-18 10:56:31 -08:00
lujie 322ea5456f
HBASE-21740 Fix NPE while shutting down RS 2019-02-18 02:53:46 -08:00
Sean Busbey 6296bad9cf HBASE-21884 Fix box/unbox findbugs warning in secure bulk load
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-02-13 07:40:07 -06:00
zhangduo 6caf5aa195
HBASE-21838 Create a special ReplicationEndpoint just for verifying the WAL entries are fine
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/VerifyWALEntriesReplicationEndpoint.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestVerifyCellsReplicationEndpoint.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-02-12 10:58:29 -08:00
Andrew Purtell ce6a6014da
Update POMs and CHANGES.txt for 1.5.0 RC0 2019-02-01 12:36:10 -08:00
Andrew Purtell ff0e587b8f
HBASE-21735 Port HBASE-18784 (Use of filesystem that requires hflush / hsync / append / etc should query outputstream capabilities) to branch-1
HBASE-18784 if available, query underlying outputstream capabilities where we need hflush/hsync.

* pull things that don't rely on HDFS in hbase-server/FSUtils into hbase-common/CommonFSUtils
* refactor setStoragePolicy so that it can move into hbase-common/CommonFSUtils
* refactor WALProcedureStore so that it handles its own FS interactions
* add a reflection-based lookup of stream capabilities
* call said lookup in places where we make WALs to make sure hflush/hsync is available.

HBASE-19289 Add flag to disable stream capability enforcement

HBASE-19841 Tests against hadoop3 fail with StreamLacksCapabilityException

HBASE-19947 ITU should overwrite HTU local FS

HBASE-20354 better docs for impact of proactively checking hsync support.

* Add to the quickstart guide disabling the hsync check, with a
  big warning about how we'll lose data if the check is disabled.
* Add to troubleshooting section so folks searching can get a pointer.
2019-01-24 09:23:14 -08:00
Andrew Purtell b51c487206
HBASE-21748 Port HBASE-21738 (Remove all the CLSM#size operation in our memstore because it's an quite time consuming) to branch-1 2019-01-23 18:09:11 -08:00
Nihal Jain c1c2bc2f0a
HBASE-21475 Put mutation (having TTL set) added via co-processor is retrieved even after TTL expires
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/coprocessor/TestRegionObserverForAddingMutationsFromCoprocessors.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-23 17:01:20 -08:00
Allan Yang 20759a3c7e
HBASE-20870 Wrong HBase root dir in ITBLL's Search Tool
Conflicts:
	hbase-it/src/test/java/org/apache/hadoop/hbase/IntegrationTestingUtility.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-23 16:12:09 -08:00
Andrew Purtell d3ce26101e
HBASE-21766 TestSimpleRpcScheduler is flaky (branch-1) 2019-01-23 14:55:04 -08:00
Sergey Shelukhin 7cefd8bc25 HBASE-21575 : memstore above high watermark message is logged too much 2019-01-22 16:41:43 -08:00
xcang acdd23ec4c
HBASE-21561 Backport HBASE-21413 (Empty meta log doesn't get split when restart whole cluster) to branch-1
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-01-21 18:06:48 -08:00
Nihal Jain aa1b750899
HBASE-21749 RS UI may throw NPE and make rs-status page inaccessible with multiwal and replication
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/ReplicationSource.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-21 17:31:13 -08:00
Andrew Purtell 1fd76bd35a
HBASE-21680 Port HBASE-20194 (Basic Replication WebUI - Master) and HBASE-20193 (Basic Replication Web UI - Regionserver) to branch-1
HBASE-20193 Basic Replication Web UI - Regionserver

HBASE-20194 Basic Replication WebUI - Master
2019-01-21 17:25:20 -08:00
Nihal Jain 0546b77a31
HBASE-21645 Perform sanity check and disallow table creation/modification with region replication < 1
Signed-off-by: Guanghao Zhang <zghao@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestFromClientSide.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-17 17:48:53 -08:00
Pankaj 52b8978212
HBASE-21595 Print thread's information and stack traces when RS is aborting forcibly
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-01-17 10:40:55 -08:00
Andrew Purtell 2c0b6f8227
HBASE-21616 Port HBASE-21034 (Add new throttle type: read/write capacity unit) to branch-1
HBASE-21034 Add new throttle type: read/write capacity unit

HBASE-21578 Fix wrong throttling exception for capacity unit
2019-01-16 15:59:46 -08:00
Beluga Behr 0315c2d65d HBASE-20209 Do Not Use Both Map containsKey and get Methods in Replication Sink
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 3e92cd5771)
2019-01-16 14:50:41 -07:00
openinx cd0645a5f6
HBASE-21675 Port HBASE-21642 (CopyTable by reading snapshot and bulkloading will save a lot of time) to branch-1
HBASE-21642 CopyTable by reading snapshot and bulkloading will save a lot of time

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-01-16 10:03:43 -08:00
Guanghao Zhang 336de0aed4
HBASE-21659 Avoid to load duplicate coprocessors in system config and table descriptor
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/coprocessor/TestRegionCoprocessorHost.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-14 16:07:28 -08:00
jingyuntian 18891467fa
HBASE-20986 Separate the config of block size when we do log splitting and write Hlog
Signed-off-by: Guanghao Zhang <zghao@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/WALUtil.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/wal/FSHLogProvider.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-14 14:22:15 -08:00
Ashish Singhi feb8a57a9a
HBASE-16499 slow replication for small HBase clusters
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
2019-01-14 14:10:19 -08:00
Nihal Jain a3e274cf57
HBASE-21196 HTableMultiplexer clears the meta cache after every put operation
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncRequestFutureImpl.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-14 11:24:08 -08:00
Andrew Purtell d6a3e6b404
HBASE-21679 Port HBASE-6028 (Start/Stop compactions at region server level) to branch-1
HBASE-6028 Start/Stop compactions at region server level

Add switching on/off of compactions.

Switching off compactions will also interrupt any currently ongoing compactions.
Adds a "compaction_switch" to hbase shell. Switching off compactions will
interrupt any currently ongoing compactions. State set from shell will be
lost on restart. To persist the changes across region servers modify
hbase.regionserver.compaction.enabled in hbase-site.xml and restart.
2019-01-11 18:08:27 -08:00
Guanghao Zhang e7ff91f35e
HBASE-21325 Force to terminate regionserver when abort hang in somewhere
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerAbortTimeout.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-11 17:56:48 -08:00
Mingliang Liu f3f3798575
HBASE-21164 reportForDuty should do backoff rather than retry
Remove unused methods from Sleeper (its ok, its @Private).
Remove notion of startTime from Sleeper handling (it is is unused).
Allow passing in how long to sleep so can maintain externally.
In HRS, use a RetryCounter to calculate backoff sleep time for when
reportForDuty is failing against a struggling Master.

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerReportForDuty.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-11 16:50:45 -08:00
Saurabh Singh 231e6d56b5
HBASE-20928 Rewrite calculation of midpoint in binarySearch functions to prevent overflow
HBASE-20928 Rewrite calculation of midpoint - addendum (Xu Cang)

Signed-off-by: tedyu <yuzhihong@gmail.com>

Conflicts:
	hbase-common/src/main/java/org/apache/hadoop/hbase/io/encoding/RowIndexSeekerV1.java
	hbase-common/src/main/java/org/apache/hadoop/hbase/util/Bytes.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-11 14:40:51 -08:00
mazhenlin 582c649783
HBASE-21374 Backport HBASE-21342 to branch-1
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-01-10 15:44:44 -08:00
BELUGA BEHR beeb0796e5
HBASE-21492 CellCodec Written To WAL Before It's Verified
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/AbstractProtobufLogWriter.java
2018-12-31 12:29:04 -08:00
openinx 55a775b8d4 HBASE-21620 Problem in scan query when using more than one column prefix filter in some cases
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Allan Yang <allan163@apache.org>
2018-12-25 09:49:38 +08:00
Guanghao Zhang 98640e4b2c HBASE-21618 Scan with the same startRow(inclusive=true) and stopRow(inclusive=false) returns one result 2018-12-21 14:03:12 +08:00
xuqinya bbf17e6149 HBASE-21592 quota.addGetResult(r) throw NPE
Signed-off-by: huzheng <openinx@gmail.com>
2018-12-18 18:56:22 +08:00
huzheng 049307c9a7 HBASE-21520 TestMultiColumnScanner cost long time when using ROWCOL bloom type 2018-12-15 21:08:09 +08:00
Sean Busbey 5c8c945e34 HBASE-21590 Optimize trySkipToNextColumn in StoreScanner a bit. (addendum)
(cherry picked from commit a284c493b127fbf785fbee401f0854ad1979eb26)
(cherry picked from commit aa36c3f6b6)
2018-12-14 15:56:36 -06:00
Lars Hofhansl 4e7fc18fb6 HBASE-21590 Optimize trySkipToNextColumn in StoreScanner a bit. 2018-12-13 11:55:28 -08:00
huzheng 81dc223ae7 HBASE-21582 If call HBaseAdmin#snapshotAsync but forget call isSnapshotFinished, then SnapshotHFileCleaner will skip to run every time 2018-12-12 21:31:36 +08:00
xcang bd33a1ef96
HBASE-21553 schedLock not released in MasterProcedureScheduler
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-12-10 17:56:53 -08:00
huzheng f1e2f077fa HBASE-21504 If enable FIFOCompactionPolicy, a compaction may write a "empty" hfile whose maxTimeStamp is long max. This kind of hfile will never be archived. 2018-11-30 10:24:09 +08:00
Ted Yu 003cc103aa HBASE-21511 Remove in progress snapshot check in SnapshotFileCache#getUnreferencedFiles 2018-11-25 21:48:55 -08:00
Ted Yu a586b4b0a2 HBASE-21387 Addendum fix TestSnapshotFileCache
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-11-24 17:01:09 +08:00
huzheng fe99ebb0ef HBASE-21387 Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files 2018-11-23 12:07:27 +08:00
huzheng 9cef4e1141 HBASE-21473 RowIndexSeekerV1 may return cell with extra two \x00\x00 bytes which has no tags 2018-11-14 23:29:25 +08:00
huzheng 814c3690dc HBASE-21445 CopyTable by bulkload will write hfile into yarn's HDFS 2018-11-10 10:41:38 +08:00
Ben Lau 68c9396685
HBASE-21439 RegionLoads aren't being used in RegionLoad cost functions
Amend HBASE-21439 Update RSGroup Test too

Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-11-08 14:21:51 -08:00
xcang 36178f7443
HBASE-21373 (backport from HBASE-21338) Warn if balancer is an ill-fit for cluster size
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-11-08 10:58:04 -08:00
Esteban Gutierrez efc203a5a2
HBASE-20604 ProtobufLogReader#readNext can incorrectly loop to the same position in the stream until the the WAL is rolled
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-11-07 18:24:13 -08:00
Toshihiro Suzuki 5fcfdcdc51 HBASE-21347 Backport HBASE-21200 "Memstore flush doesn't finish because of seekToPreviousRow() in memstore scanner." to branch-1
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Ted Yu <tedyu@apache.org>
2018-11-06 14:00:34 -05:00
Allan Yang 5f5f4e82b1 HBASE-21357 RS should abort if OOM in Reader thread 2018-10-24 11:10:20 +08:00
huzheng f73d6193e1 HBASE-21355 (addendum) replace the expensive reload storefiles with reading the merge result of compacted storefiles and current storefiles 2018-10-22 21:26:12 +08:00
huzheng ad79442d8a HBASE-21355 HStore's storeSize is calculated repeatedly which causing the confusing region split 2018-10-22 11:05:56 +08:00
subrat.mishra 0128fed9dd
HBASE-21263 Mention compression algorithm along with other storefile details
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/Compactor.java
2018-10-16 13:39:13 -07:00
Andrew Purtell ea90846268
HBASE-21266 Not running balancer because processing dead regionservers, but empty dead rs list
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-15 14:51:24 -07:00
Tyler Mi d385ba1a5d HBASE-21098 Improve Snapshot Performance with Temporary Snapshot Directory when rootDir on S3
Test fixes by: Taklon Wu <wutaklon@amazon.com>

Signed-off-by: Zach York <zyork@apache.org>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2018-10-12 11:13:16 -07:00
wellington b73aab8bc1 HBASE-21185 - WALPrettyPrinter: Additional useful info to be printed by wal printer tool, for debugability purposes 2018-10-11 14:39:14 -07:00
Xu Cang 6e0ee4efa7
HBASE-18549 Add metrics for failed replication queue recovery
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-10-01 18:39:24 -07:00
Xu Cang e8e4beacb0
HBASE-19275 TestSnapshotFileCache never worked properly
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-10-01 17:15:29 -07:00
Xu Cang baeeaa1b21
HBASE-21117 fix table locking when moveTables, fix HBASE-20666 rsgroups issue
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-10-01 16:58:29 -07:00
Kiran Kumar Maturi 121fad31ce
HBASE-20857 balancer status tag in jmx metrics
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-28 16:04:49 -07:00
Archana Katiyar c5cf80dc87
HBASE-21207 Add client side sorting functionality in master web UI for table and region server details
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-28 15:35:52 -07:00
ramie-raufdeen 3edf1154fe
HBASE-19418 configurable range of delay in PeriodicMemstoreFlusher
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-28 14:34:28 -07:00
xcang f1111e6f97
HBASE-18451 PeriodicMemstoreFlusher should inspect the queue before adding a delayed flush request
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-28 11:50:53 -07:00
Allan Yang 0b6e2907bd HBASE-21228 Memory leak since AbstractFSWAL caches Thread object and never clean later 2018-09-27 16:44:46 +08:00
ffernandez92 04c732e9de HBASE-20766 Typo in VerifyReplication error.
closes #80.

Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 8f8d571779)
2018-09-26 14:56:57 -07:00
Allan Yang 823b790000 HBASE-21212 Wrong flush time when update flush metric 2018-09-26 19:40:43 +08:00
Zach York a00adb0b45 HBASE-20734 Colocate recovered edits directory with hbase.wal.dir
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-09-26 11:54:44 +08:00
Reid Chan c6a1334528 Revert "HBASE-20993. [Auth] IPC client fallback to simple auth allowed doesn't work"
Revert reason: It breaks phoenix client.

This reverts commit 8dbb0b0487.
2018-09-22 10:13:14 +08:00
Francis Liu 5f8de7314c
HBASE-20704 Sometimes some compacted storefiles are not archived on region close, branch-1 backport
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-09-21 16:12:11 -07:00
Andrew Purtell bb529b706f
HBASE-21203 TestZKMainServer#testCommandLineWorks won't pass with default 4lw whitelist
Recent versions of ZooKeeper whitelist the so-called 4-letter word admin
commands, and 'stat' is not in the default whitelist. Set system property
zookeeper.4lw.commands.whitelist=* in MiniZooKeeperCluster#setupTestEnv
as we do not need to whitelist 4-letter commands for unit tests.
2018-09-21 15:37:33 -07:00
openinx bf62e30c18 HBASE-21206 Scan with batch size may return incomplete cells 2018-09-20 22:25:40 +08:00
jackbearden 8dbb0b0487 HBASE-20993. [Auth] IPC client fallback to simple auth allowed doesn't work
Amending-Author: Reid Chan <reidchan@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-09-19 10:53:24 +08:00
Mingliang Liu 0a2ebdce15
HBASE-21168 BloomFilterUtil uses hardcoded randomness (Mike Drob)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-12 13:28:48 -07:00
Nihal Jain 158607bf23
HBASE-21021 Result returned by Append operation should be ordered
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-11 15:04:50 -07:00
Guangxu Cheng 895dac0819 HBASE-21173 Remove the duplicate HRegion#close in TestHRegion
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2018-09-11 17:46:43 +08:00
Guangxu Cheng d4d0a21b55 HBASE-21158 Empty qualifier cell is always returned when using QualifierFilter
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-11 14:12:24 +08:00
Andrew Purtell 0c6226b56c
HBASE-21162 Revert suspicious change to BoundedByteBufferPool and disable use of direct buffers for IPC reservoir by default
Revert suspicious change to BoundedByteBufferPool made on HBASE-19239 (Fix
findbugs and error-prone issues).

In addition the allocation of direct memory for the server RPC reservoir is
problematic in that tracing native memory or direct buffer leaks to a
particular class or compilation unit is difficult, so allocate the reservoir
on the heap by default instead.
2018-09-10 18:25:27 -07:00
Andrew Purtell 6f4cbde103
HBASE-20307 LoadTestTool prints too much zookeeper logging (Colin Garcia)
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/LoadTestTool.java
2018-09-07 16:50:56 -07:00
Lars Hofhansl d236a5fab8 HBASE-21166 Creating a CoprocessorHConnection re-retrieves the cluster id from ZK. 2018-09-07 15:16:54 -07:00
Mingliang Liu e03e4c9f5a HBASE-21138 Close HRegion instance at the end of every test in TestHRegion
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-09-06 17:51:51 -07:00
Sean Busbey 3e45e0202b HBASE-21061 Fix inconsistent synchronization in RpcServer
move variables that we don't need synchronized access to out of the critical block.

Signed-off-by: Mike Drob <mdrob@apache.org>
2018-09-05 23:13:37 -05:00
tedyu d07cab18a6 HBASE-21088 HStoreFile should be closed in HStore#hasReferences
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
2018-09-05 15:13:06 -07:00
Guanghao Zhang dbb634ad1b HBASE-21127 TableRecordReader need to handle cursor result too 2018-09-05 14:46:59 +08:00
Andrew Purtell cf198a65e8 Revert "HBASE-15728 Add Per-Table metrics back"
This reverts commit fb74f215b4.
2018-09-04 13:12:20 -07:00
Andrew Purtell dfb1af4892 Revert "Amend HBASE-15728 Add Per-Table metrics back"
This reverts commit 72f29f48ea.
2018-09-04 13:12:17 -07:00
Andrew Purtell 72f29f48ea Amend HBASE-15728 Add Per-Table metrics back
Fix a NPE surfaced by TestRegionLocationFinder
2018-09-04 12:48:10 -07:00
David Manning 484a1d8049 HBASE-21126 Configurable number of allowed failures for ZooKeeper Canary
Signed-off-by: Josh Elser <elserj@apache.org>
2018-09-03 19:44:17 -07:00
Xu Cang fb74f215b4 HBASE-15728 Add Per-Table metrics back
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-08-29 16:36:45 -07:00
Andrew Purtell 492d69daa5 Amend HBASE-20940 HStore.cansplit should not allow split to happen if it has references (Vishal Khandelwal)
Fix TestHBaseFsck failure
2018-08-28 11:04:08 -07:00
krish.dey 0840427516 HBASE-20942 Fix ArrayIndexOutOfBoundsException for RpcServer TRACE logging
Also makes the trace log message length configurable.

Signed-off-by: Josh Elser <elserj@apache.org>
2018-08-28 11:25:08 -04:00
Vikas Vishwakarma 3c17c8391e HBASE-20890 PE filterScan seems to be stuck forever 2018-08-27 12:51:55 +05:30
Andrew Purtell d1ebc3d2a8 HBASE-21069 NPE in StoreScanner.updateReaders causes RS to crash 2018-08-20 15:50:47 -07:00
tedyu e2974f4b91 HBASE-21042 processor.getRowsToLock() always assumes there is some row being locked in HRegion#processRowsWithLocks 2018-08-18 11:47:23 -07:00
Andrew Purtell 56c59f11e3 HBASE-20940 HStore.cansplit should not allow split to happen if it has references (Vishal Khandelwal) 2018-08-17 15:30:40 -07:00
Andrew Purtell 971d48406e HBASE-21047 Object creation of StoreFileScanner thru constructor and close may leave refCount to -1 (Vishal Khandelwal) 2018-08-16 11:43:24 -07:00
Nihal Jain 5520fa1ab3 HBASE-20469 Directory used for sidelining old recovered edits files should be made configurable
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-08-15 18:01:43 -07:00
Huaxiang Sun 1b50fe5372 HBASE-20997 rebuildUserRegions() does not build ReplicaMapping during master switchover
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Pankaj Kumar <Username: pankaj2461t>
2018-08-06 11:25:02 -07:00
Monani Mihir 0298c06b4f HBASE-19036 Add action in Chaos Monkey to restart Active Namenode
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-08-02 05:04:27 -07:00
Andrew Purtell a15c445743 HBASE-20935 HStore.removeCompactedFiles should log in case it is unable to delete a file (Vishal Khandelwal) 2018-07-31 16:12:50 -07:00
Josh Elser ab3ec9477a HBASE-20930 MetaScanner.metaScan should respect meta table name (Vishal Khandelwal) 2018-07-30 17:12:03 -04:00
Andrew Purtell 9b5a839b99 HBASE-20974 Backport HBASE-20583 (SplitLogWorker should handle FileNotFoundException when split a wal) to branch-1 (Pankaj Kumar) 2018-07-30 12:34:45 -07:00
Andrew Purtell 2d70120eb3 HBASE-20895 NPE in RpcServer#readAndProcess
Synchronize readAndProcess() on the Connection to avoid MT issues with
data buffer management
2018-07-27 18:07:58 -07:00
huzheng 0b7081e67a HBASE-20565 ColumnRangeFilter combined with ColumnPaginationFilter can produce incorrect result 2018-07-24 10:25:43 +08:00
Xu Cang 3a97976eae HBASE-20744 Address FindBugs warnings in branch-1
minor fix

Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-23 16:29:13 -07:00
Xu Cang dfc7ecd9ca HBASE-20230 Incorrrect log message in RSRpcServices
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-07-23 16:01:33 -07:00
Ankit Singhal 56aa9ab8a3 HBASE-20908 Infinite loop on regionserver if region replica are reduced
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-07-23 13:11:39 -07:00
Toshihiro Suzuki 2eaa24a132 HBASE-17885 Backport HBASE-15871 to branch-1
HBASE-15871 Memstore flush doesn't finish because of backwardseek() in memstore scanner (ramkrishna.s.vasudevan)

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-07-23 12:27:52 -07:00
tedyu a7fe71da88 HBASE-20917 MetaTableMetrics#stop references uninitialized requestsMap for non-meta region 2018-07-23 10:04:10 -07:00
TAK LON WU 9db4a4059a HBASE-20401 Make `MAX_WAIT` and `waitIfNotFinished` in CleanerContext configurable
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-07-23 17:16:08 +08:00
TAK LON WU 896b69a0fc HBASE-20559 Backport HBASE-18083 (Make large/small file clean thread number configurable in HFileCleaner) to branch-1
The last port commit of HBASE-20555

Signed-off-by: Yu Li <liyu@apache.org>
2018-07-23 11:36:47 +08:00
TAK LON WU 780724b15a HBASE-20558 Port HBASE-17854 (Use StealJobQueue in HFileCleaner after HBASE-17215) to branch-1
The third port commit of HBASE-20555
2018-07-20 16:11:09 -07:00
Ankit e5618a6674 HBASE-20672 New metrics ReadRequestRate and WriteRequestRate
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-07-19 15:36:01 -07:00
jingyuntian 15ed2e86e1 HBASE-20855 PeerConfigTracker only supporting one listener will cause problem when there is a recovered replication queue
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-19 08:43:23 -07:00
tedyu 7211d13ac8 HBASE-20889 PE scan is failing with NullPointerException 2018-07-16 09:53:47 -07:00
zhaoyuan 6edb27e1e6 HBASE-20697 Can't cache All region locations of the specify table by calling table.getRegionLocator().getAllRegionLocations()
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-07-11 11:33:32 +08:00
Huaxiang Sun f2dc754aa3 HBASE-20651 Master, prevents hbck or shell command to reassign the split parent region
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2018-07-10 16:07:30 -07:00
Xu Cang 99189f284b HBASE-20858 Port HBASE-20695 (Implement table level RegionServer replication metrics) to branch-1
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-07-09 12:19:21 -07:00
TAK LON WU a52c6bf2f3 HBASE-20557 Backport HBASE-17215 to branch-1
The second backport of HBASE-20555

Signed-off-by: Zach York <zyork@apache.org>
2018-07-09 11:32:04 -07:00
Abhishek Singh Chouhan a4db453c6d HBASE-20806 Split style journal for flushes and compactions 2018-07-09 18:44:07 +05:30
Nihal Jain 77e5668ed2 HBASE-20808 Wrong shutdown order between Chores and ChoreService
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-07-07 00:32:33 +08:00
Josh Elser 154b77307f HBASE-20826 Truncate really long RpcServer warnings unless TRACE is on
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Ted Yu <tyu@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2018-07-05 17:21:30 -07:00
Yu Li 50f7894cc4 HBASE-20691 Change the default WAL storage policy back to "NONE""
This partially reverts HBASE-19858 and adds more doc about why we choose "NONE" as the default.
2018-07-05 15:26:56 +08:00
huzheng a25cf7bbdb HBASE-20789 TestBucketCache#testCacheBlockNextBlockMetadataMissing is flaky 2018-07-04 09:49:07 +08:00
Nihal Jain f94ad9d78f HBASE-20450 Provide metrics for number of total active, priority and replication rpc handlers
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-02 11:19:19 -07:00
jingyuntian cc8e1cc393 HBASE-20769 getSplits() has a out of bounds problem in TableSnapshotInputFormatImpl
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-06-29 15:25:06 -07:00
Xu Cang 2fd69cf93c HBASE-19722 Implement a meta query statistics metrics source
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-06-28 17:17:50 -07:00
Reid Chan c81d0aff95 HBASE-20732 Shutdown scan pool when master is stopped 2018-06-28 12:36:50 +08:00
Michael Stack 03946a389a HBASE-20785 NPE getting metrics in PE testing scans 2018-06-27 12:04:21 -07:00
Michael Stack ccead1264c HBASE-20770 WAL cleaner logs way too much; gets clogged when lots of work to do
General log cleanup; setting stuff that can flood the log to TRACE.

Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-06-26 15:54:47 -07:00
Monani Mihir 4936750d3a HBASE-20701 too much logging when balancer runs from BaseLoadBalancer
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-06-25 17:17:31 -07:00
tedyu 6fa9f0bea9 HBASE-20723 Custom hbase.wal.dir results in data loss because we write recovered edits into a different place than where the recovering region server looks for them 2018-06-15 19:51:33 -07:00
Zach York bed3b2bbae HBASE-20556 Backport HBASE-16490 to branch-1
Backport by: taklonwu@gmail.com

Signed-off-by: Zach York <zyork@apache.org>
2018-06-12 12:34:05 -07:00
Josh Elser c596fb6c3f HBASE-20605 Excludes Azure's new filesystem from the SecureBulkLoadEndpoint perm check
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
2018-06-06 16:23:51 -04:00
Andrew Purtell 409531209e HBASE-20670 NPE in HMaster#isInMaintenanceMode 2018-06-04 13:03:16 -07:00
Andrew Purtell 07487cb0b1 HBASE-20667 Rename TestGlobalThrottler to TestReplicationGlobalThrottler 2018-06-01 16:47:26 -07:00
Xu Cang a25878cf40 HBASE-18116 Replication source in-memory accounting should not include bulk transfer hfiles
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-06-01 13:34:43 -07:00
Andrew Purtell 08b7ed1656 Revert "HBASE-18116 fix replication source in-memory calculation by excluding bulk load file"
This reverts commit dcb5b5a012.
2018-05-31 15:28:50 -07:00
Xu Cang dcb5b5a012 HBASE-18116 fix replication source in-memory calculation by excluding bulk load file
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-05-31 14:22:07 -07:00
Andrew Purtell f4ac15999a Amend HBASE-20646 TestWALProcedureStoreOnHDFS failing on branch-1
Suppress error-prone false positive
2018-05-30 13:46:46 -07:00
Andrew Purtell 011989665e HBASE-20597 Serialize access to a shared reference to ZooKeeperWatcher in HBaseReplicationEndpoint 2018-05-29 11:25:25 -07:00
Andrew Purtell 5a0bb1c6b8 Revert "HBASE-20597 Use a lock to serialize access to a shared reference to ZooKeeperWatcher in HBaseReplicationEndpoint"
This reverts commit 1b70763b9e.
2018-05-29 11:25:25 -07:00
Toshihiro Suzuki 289d588af3 HBASE-20647 Backport HBASE-20616 "TruncateTableProcedure is stuck in retry loop in TRUNCATE_TABLE_CREATE_FS_LAYOUT state" to branch-1
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-05-25 06:18:43 -07:00
Andrew Purtell 87d4e4e4e2 HBASE-20646 TestWALProcedureStoreOnHDFS failing on branch-1 2018-05-24 18:06:12 -07:00
Thiruvel Thirumoolan b892be7440 HBASE-20548 Master fails to startup on large clusters, refreshing block distribution
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-05-24 12:27:19 -07:00
Andrew Purtell 1b70763b9e HBASE-20597 Use a lock to serialize access to a shared reference to ZooKeeperWatcher in HBaseReplicationEndpoint 2018-05-23 16:45:55 -07:00
Xu Cang 6d1aa2800b HBASE-20486 Change default throughput controller to PressureAwareThroughputController
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-05-22 12:43:31 -07:00
Balazs Meszaros 2d493556f3 HBASE-20571 JMXJsonServlet generates invalid JSON if it has NaN in metrics
- CacheStats won't generate NaN metrics.
- JSONBean class will serialize special floating point values as
  "NaN", "Infinity" or "-Infinity"

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-05-16 11:50:31 -07:00
Thiruvel Thirumoolan 2a309d71cc HBASE-20545 Improve performance of BaseLoadBalancer.retainAssignment
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-05-15 18:17:52 -07:00
Zach York 944a221b74 HBASE-20447 Only fail cacheBlock if block collisions aren't related to next block metadata
When we pread, we don't force the read to read all of the next block header.
However, when we get into a race condition where two opener threads try to
cache the same block and one thread read all of the next block header and
the other one didn't, it will fail the open process. This is especially important
in a splitting case where it will potentially fail the split process.
Instead, in the caches, we should only fail if the required blocks are different.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-05-14 16:09:36 -07:00
Ashish Singhi ca544a155c HBASE-20004 Client is not able to execute REST queries in a secure cluster
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
2018-05-10 22:49:08 +05:30
Andrew Purtell c191462ac3 HBASE-20554 "WALs outstanding" message from CleanerChore is noisy 2018-05-09 19:13:17 -07:00
Zach York 5406f63332 HBASE-20204 Add locking to RefreshFileConnections in BucketCache
This is a follow-up to HBASE-20141 where Anoop suggested adding locking
for refreshing channels.
2018-05-09 14:15:02 -07:00
Andrew Purtell 9d9d5aec0e HBASE-20505 PE should support multi column family read and write cases 2018-05-07 18:39:18 -07:00
Vasudevan 91f3de89ab HBASE-20523 PE tool should support configuring client side buffering sizes
(Ram)
2018-05-07 14:41:08 +05:30
Andrew Purtell 23b9054089 HBASE-20513 Collect and emit ScanMetrics in PerformanceEvaluation 2018-05-04 17:59:28 -07:00
Andrew Purtell fd24083e26 HBASE-20517 Fix PerformanceEvaluation 'column' parameter 2018-05-04 17:24:38 -07:00
Andrew Purtell e793e7c30c HBASE-20493 Port HBASE-19994 (Create a new class for RPC throttling exception, make it retryable) to branch-1 2018-04-26 15:38:40 -07:00
Andrew Purtell 71c573239b HBASE-20496 TestGlobalThrottler failing on branch-1 since revert of HBASE-9465
Temporarily disable TestGlobalThrottler on branch-1
2018-04-26 15:38:40 -07:00
Huaxiang Sun eb67d4e308 HBASE-19924 hbase rpc throttling does not work for multi() with request count rater. 2018-04-26 10:43:59 -07:00
Toshihiro Suzuki f11cf007a2 HBASE-20229 ConnectionImplementation.locateRegions() returns duplicated entries when region replication is on 2018-04-25 13:36:12 -07:00
Kevin Risden e60189035e HBASE-20406 HBase Thrift HTTP - Shouldn't handle TRACE/OPTIONS methods
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>

 Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/http/TestHttpServer.java
	hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift/ThriftServerRunner.java
2018-04-20 22:45:49 -05:00
Sean Busbey eacf3cb296 Revert "HBase Thrift HTTP - Shouldn't handle TRACE/OPTIONS methods"
This reverts commit fe84833ea2.

missing jira key
2018-04-20 22:45:37 -05:00
Kevin Risden fe84833ea2 HBase Thrift HTTP - Shouldn't handle TRACE/OPTIONS methods
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>

 Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/http/TestHttpServer.java
	hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift/ThriftServerRunner.java
2018-04-20 15:15:31 -05:00
Toshihiro Suzuki 8a244e51d7 HBASE-20006 TestRestoreSnapshotFromClientWithRegionReplicas is flakey
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>

 Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestRestoreSnapshotFromClientWithRegionReplicas.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegionReplayEvents.java
2018-04-20 11:34:45 -05:00
Toshihiro Suzuki 03eb3d24b6 HBASE-19850 The number of Offline Regions is wrong after restoring a snapshot
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-04-17 20:29:50 -07:00
Sean Busbey ce4c243399 HBASE-20404 Fixes to CleanChore correctness and operability.
* Make CleanerChore less chatty: move WARN message to DEBUG when we expect non-empty dirs
* Make CleanerChore less chatty: move IOE we'll retry to INFO
* CleanerChore should treat IOE for FileStatus as a failure
* Add tests asserting assumptions in above

Signed-off-by: Reid Chan <reidddchan@outlook.com>
Signed-off-by: Mike Drob <mdrob@apache.org>

 Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/cleaner/CleanerChore.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/cleaner/TestCleanerChore.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestFSUtils.java
2018-04-17 13:05:41 -05:00
Ashish Singhi a817f196a1 HBASE-15291 FileSystem not closed in secure bulkLoad
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
2018-04-11 12:59:52 +05:30