a09c63ef26
HBASE-22637 fix flaky test in TestMetaTableMetrics
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-07-03 13:57:16 +02:00
a0258b53bb
HBASE-22629 Remove TestReplicationDroppedTables from branch-1
...
Signed-off-by: Xu Cang <xcang@apache.org>
2019-06-25 18:25:22 -07:00
5a06739d04
HBASE-22627 Port HBASE-22617 (Recovered WAL directories not getting cleaned up) to branch-1 ( #339 )
...
HBASE-22617 Recovered WAL directories not getting cleaned up (Duo Zhang)
Signed-off-by: Zach York <zyork@apache.org>
2019-06-25 18:14:01 -07:00
5023690c84
HBASE-22616 responseTooXXX logging for Multi should characterize the component ops
2019-06-24 18:06:19 -07:00
36f4ab0716
HBASE-22492 Wrap RPC responses with SASL after queueing for response (Sébastien Barnoud)
...
Amending-Author: Josh Elser <elserj@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2019-06-21 21:00:21 -04:00
ca7ccb95b0
HBASE-22520 Avoid possible NPE while performing seekBefore in HalfStoreFileReader
...
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/io/HalfStoreFileReader.java
Co-authored-by: Andrew Purtell <apurtell@apache.org>
2019-06-20 15:00:51 -07:00
be9f0dd588
HBASE-22596 [Chore] Separate the execution period between CompactionChecker and PeriodicMemStoreFlusher
...
Signed-off-by: Zach York <zyork@apache.org>
Signed-off-by: Xu Cang <xucang@apache.org>
2019-06-20 10:49:11 +08:00
4895fad5b0
HBASE-22426 Disable region split/merge switch doen't work when 'hbase.assignment.usezk' is set true
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-06-19 12:04:32 -07:00
55e2a36a58
HBASE-22344 Documented the deprecation of public and limited private APIs ( #208 )
...
Signed-off-by: stack <stack@apache.org>
2019-06-17 23:47:15 +02:00
84af2a4610
HBASE-22562 Remove dead code: skipControl
...
Signed-off-by: Reid Chan <reidchan@apache.org>
2019-06-14 19:46:57 +08:00
2ff4e4f096
HBASE-22559 [RPC] set guard against CALL_QUEUE_HANDLER_FACTOR_CONF_KEY
2019-06-14 11:24:55 +08:00
60cea9ee63
HBASE-22545 TestLogLevel broken
...
Signed-off-by: Josh Elser <elserj@apache.org>
2019-06-11 14:56:15 -04:00
0f470e2f92
HBASE-21920 Ignoring 'empty' end_key while calculating end_key for new region in HBCK -fixHdfsOverlaps command can cause data loss
...
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
2019-06-05 18:58:20 +09:00
c950de7834
HBASE-22540 [Memstore] Correct counters in MemStoreChunkPool
...
* First commit: HBASE-22540 [Memstore] Correct counters in MemStoreChunkPool
* Address comment and remove useless parent thread info from Statistics thread
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-06-05 11:55:10 +08:00
749d58fc41
HBASE-22533 TestAccessController3 is flaky (branch-1)
...
Wait for created tables to be online before proceeding in access control tests.
Fix a possible NPE in teardown if secure tests did not properly set up.
2019-06-04 11:28:31 -07:00
5c4708ea73
Revert "HBASE-16488 Starting namespace and quota services in master startup asynchronously"
...
This reverts commit e4644c35c1
2019-06-03 18:24:16 -07:00
b20e248387
Revert "HBASE-22521 TestOfflineMetaRebuildBase#testHMasterStartupOnMetaRebuild failing (branch-1)"
...
This reverts commit db6ad391ee
2019-06-03 18:24:12 -07:00
e1bca19631
HBASE-22396 Backport HBASE-21536 to branch-1
...
Fix completebulkload usage instructions
Signed-off-by: Josh Elser <elserj@apache.org>
2019-06-03 16:43:05 -04:00
eae71261b3
HBASE-22510 Address findbugs/spotbugs complaints (branch-1) ( #278 )
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-06-03 11:33:47 -07:00
db6ad391ee
HBASE-22521 TestOfflineMetaRebuildBase#testHMasterStartupOnMetaRebuild failing (branch-1)
2019-06-02 10:47:15 -07:00
5beba8fd4e
HBASE-22451 TestLoadIncrementalHFiles and TestSecureLoadIncrementalHFiles are flaky ( #250 )
...
Start ZKNamespaceManager as first step in TableNamespaceManager initialization
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-05-30 17:47:06 -07:00
e233cfbe75
HBASE-22459 Expose store reader reference count ( #248 )
2019-05-30 15:09:15 -07:00
1b2f863cdb
HBASE-22487 getMostLoadedRegions is unused
...
Signed-off-by: Wellington Chevreuil <wellington.chevreuil@gmail.com>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-05-30 16:39:36 +02:00
b5d667c345
HBASE-22450 Port TestStoreScannerClosure from HBASE-22072
2019-05-22 17:50:06 -07:00
98dc440462
HBASE-22449 https everywhere in Maven metadata ( #247 )
2019-05-21 12:44:02 -07:00
4ab2e1c094
HBASE-22413 Backport 'HBASE-22399 Change default hadoop-two.version to 2.8.x and remove the 2.7.x hadoop checks' to branch-1
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-05-21 07:58:02 +08:00
e2d48f41c5
Set version on branch back to 1.5.0-SNAPSHOT
2019-05-20 13:02:40 -07:00
ee4fe2dca7
HBASE-22444 Backport HBASE-19954 to branch-1
2019-05-20 10:04:52 +08:00
83983bea18
HBASE-22184 [security] Support get|set LogLevel in HTTPS mode
2019-05-17 23:29:11 +08:00
f66953fa52
HBASE-21991 [Addendum] Mark LossCounting as Private
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-05-17 14:42:27 +08:00
299af7ad77
HBASE-20305 Add option to SyncTable that skip deletes on target cluster
...
Change-Id: Iccbcd4a7e7ed176d8404cb2ab17e3e47663e0441
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-05-14 15:38:51 -07:00
0df3875746
HBASE-22391 Fix flaky tests from TestFromClientSide
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-05-14 15:05:02 -07:00
46eb56a51b
HBASE-21784 Dump replication queue should show list of wal files ordered chronologically
...
Change-Id: I18c372406290e2b1e2b5503e2c87adcb9bf6fe91
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-05-14 14:35:28 -07:00
4d41846246
Amend HBASE-21048 Get LogLevel is not working from console in secure environment
...
Addenum fix for compile error.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-05-14 13:58:22 -07:00
1ad5a08ebb
HBASE-22377 Provide API to check the existence of a namespace which does not require ADMIN permissions ( #225 )
...
Signed-off-by: Xu Cang <xucang@apache.org>
2019-05-14 13:34:15 -07:00
07b31d874f
HBASE-22378. HBase Canary fails with TableNotFoundException when table deleted during Canary run
...
Signed-off-by: Xu Cang <xucang@apache.org>
2019-05-13 12:13:53 -07:00
30c3eaca1d
HBASE-22392. Remove extra/useless +
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2019-05-12 22:00:25 +02:00
06fcaac281
HBASE-22274 Cell size limit check on append considers cell's previous size
2019-05-09 20:27:27 -07:00
a66fafbad6
HBASE-22389 Revert "HBASE-19275 TestSnapshotFileCache never worked properly" ( #229 )
...
This reverts commit e8e4beacb0
2019-05-09 17:17:28 -07:00
c5859b554d
HBASE-22390 Backport HBASE-22190 to branch-1
...
HBASE-22190 SnapshotFileCache may fail to load the correct snapshot file list when there is an on-going snapshot operation
closes #230
Co-authored-by: Zach York <zyork@amazon.com>
2019-05-09 16:55:30 -07:00
190d189fef
Addendum HBASE-22330 Backport HBASE-20724 (Sometimes some compacted storefiles are still opened after region failover) to branch-1
2019-05-09 15:54:00 -07:00
541e942c8d
HBASE-22375 Promote AccessChecker to LimitedPrivate(Coprocessor)
2019-05-08 18:19:17 -07:00
f4881dcf1b
HBASE-22330 Backport HBASE-20724 (Sometimes some compacted storefiles are still opened after region failover) to branch-1
2019-05-08 16:27:53 -07:00
e4ab715901
HBASE-21777 Only log compaction pressure throughput when changed or traced (addendum)
...
Fix the findbugs warning
2019-05-09 01:00:59 +08:00
fbd53bfefb
HBASE-21777 Only log compaction pressure throughput when changed or traced
2019-05-08 02:28:08 +08:00
13da268169
HBASE-21070 Add Test for SnapshotFileCache for HBase backed by S3 ( #209 )
...
SnapshotFileCache depends on getting the last modified time of the
snapshot directory, however, S3 FileSystem's do not update the
last modified time of the top 'folder' when objects are added/removed.
This commit adds a test for the previously fixed SnapshotFileCache.
2019-05-06 12:04:45 -07:00
26b9e76bbf
HBASE-22301 Consider rolling the WAL if the HDFS write pipeline is slow
2019-05-01 17:43:43 -07:00
36b4c0fc6f
HBASE-21883 Enhancements to Major Compaction tool
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-04-30 17:29:19 -07:00
630ac33fb0
HBASE-22215 HBASE-22144 Correct MultiRowRangeFilter to work with reverse scans
...
Re-application of change with a mind towards binary compatibility.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-04-30 11:17:51 -07:00
d61fcf5848
Revert "HBASE-22215 HBASE-22144 Correct MultiRowRangeFilter to work with reverse scans"
...
This reverts commit c10ee4d23b
2019-04-29 15:32:14 -07:00
8d18a85e30
HBASE-22225 Profiler tab on Master/RS UI not working w/o comprehensive message
2019-04-29 13:24:47 -07:00
0aa75dce28
HBASE-21815 Make isTrackingMetrics and getMetrics of ScannerContext public
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-04-29 13:02:41 -07:00
5ea7851352
HBASE-22310 checkAndMutate used an incorrect row to check the condition (Adonis Ling)
2019-04-26 14:22:37 -07:00
8563644f89
HBASE-22291 Fix recovery of recovered.edits files under root dir
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-04-25 18:18:55 -07:00
edc30fc950
HBASE-22270. master's jmx.clusterRequests could be negative in branch-1 ( #164 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-04-24 14:18:59 -07:00
e4644c35c1
HBASE-16488 Starting namespace and quota services in master startup asynchronously
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-04-23 18:31:52 -07:00
c10ee4d23b
HBASE-22215 HBASE-22144 Correct MultiRowRangeFilter to work with reverse scans
...
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
2019-04-23 15:27:27 -04:00
539de1cae9
HBASE-21959 - CompactionTool should close the store it uses for compacting files, in order to properly archive compacted files.
...
Reapply without unit test
Change-Id: If852529e79274a77eb08cac13936f02776232608
Signed-off-by: Xu Cang <xucang@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-04-17 18:54:34 -07:00
46e0e88056
Revert "HBASE-21959 - CompactionTool should close the store it uses for compacting files, in order to properly archive compacted files."
...
This reverts commit c1a64aaa1a
2019-04-17 18:54:34 -07:00
4af4afc94f
HBASE-21048 Get LogLevel is not working from console in secure environment
...
Signed-off-by: Reid Chan <reidchan@apache.org>
2019-04-17 10:58:39 +08:00
084745de18
HBASE-22235 OperationStatus.{SUCCESS|FAILURE|NOT_RUN} are not visible to 3rd party coprocessors
2019-04-16 13:18:00 -07:00
0db4041c55
HBASE-17884 Backport HBASE-16217 to branch-1
...
HBASE-16217 Pass through the calling user in ObserverContext
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-04-16 13:02:11 -07:00
d526bae579
HBASE-20586: add support for clusters on different realms (with cross-realm authentication)
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-04-15 11:24:12 -07:00
e79e4aefc0
HBASE-19008 Add missing equals or hashCode method(s) to stock Filter implementations
...
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
and
HBASE-21129 Clean up duplicate codes in #equals and #hashCode methods of Filter
Signed-off-by Ted Yu <yuzhihong@gmail.com>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-04-12 16:06:14 -07:00
465b150975
HBASE-22194 Snapshot unittests fail on Windows due to invalid file path uri
...
Signed-off-by: Sergey Shelukhin <sershe@apache.org>
2019-04-11 11:38:15 -07:00
677ed9ef89
HBASE-22057 Cap the size of the nodes we delete in one ZK.multi call
...
If we try to delete too many znodes at once, we'll smack into the
jute.maxbuffer size. Try to prevent that from happening. The dominating
factor of the ZK client request should be the znode side on a delete.
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Conflicts:
hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/RecoverableZooKeeper.java
hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/ZKUtil.java
hbase-server/src/test/java/org/apache/hadoop/hbase/zookeeper/TestZKMulti.java
2019-04-10 18:24:37 -07:00
01f8e1eaa3
HBASE-22106 Better log message when failing to load coprocessor
...
Signed-off-by: Josh Elser <elserj@apache.org>
2019-04-10 12:59:48 -04:00
055a47e5c3
HBASE-22185 RAMQueueEntry#writeToCache should freeBlock if any exception encountered instead of the IOException catch block #130
2019-04-10 14:19:23 +08:00
6df26a1ef9
HBASE-21818 Incorrect list item in javadoc
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-04-08 14:53:01 +02:00
3aa64b12da
HBASE-22070 Checking restoreDir in RestoreSnapshotHelper
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-04-06 16:14:58 +02:00
6f151269d3
HBASE-22067 Fix log in StochasticLoadBalancer when balancer
2019-03-26 11:45:53 -07:00
1366f5cb6a
HBASE-21991: Fix MetaMetrics issues - [Race condition, Faulty remove logic], few improvements
...
Signed-off-by: Xu Cang <xucang@apache.org>
2019-03-22 00:20:24 -07:00
953e0f5f77
HBASE-22034 Backport HBASE-21401 and HBASE-22032 to branch-1
...
HBASE-21401 Sanity check when constructing the KeyValue
HBASE-22032 KeyValue validation should check for null byte array
2019-03-21 17:27:54 -07:00
c1a64aaa1a
HBASE-21959 - CompactionTool should close the store it uses for compacting files, in order to properly archive compacted files.
...
Change-Id: If852529e79274a77eb08cac13936f02776232608
Signed-off-by: Xu Cang <xucang@apache.org>
2019-03-21 14:20:51 -07:00
f4de34a03d
HBASE-21800: RegionServer aborted due to NPE from MetaTableMetrics coprocessor
...
Have included code refactoring in MetaTableMetrics & LossyCounting
Signed-off-by: Xu Cang <xucang@apache.org>
2019-03-21 14:13:59 -07:00
3d3832ebbc
HBASE-20917 MetaTableMetrics#stop references uninitialized requestsMap for non-meta region - addendum
...
Signed-off-by: Xu Cang <xucang@apache.org>
2019-03-21 14:09:20 -07:00
301bbe1b8e
HBASE-21926 Profiler servlet
2019-03-17 18:48:41 -07:00
25defc9293
HBASE-21796 Recover a ZK client from the AUTH_FAILED state
...
Introduces "hbase.zookeeper.authfailed.retries.number" and
"hbase.zookeeper.authfailed.pause" to control number of retries
from the AUTH_FAILED state (and the pause in millis between
attempts) before giving up and throwing an uncaught exception.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-03-12 22:12:34 -04:00
b3e3085bca
HBASE-21810 bulkload support set hfile compression on client
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-12 18:29:14 +08:00
3b1e56ec36
HBASE-21952 Fix unit test: TestClientOperationInterrupt#testInterrupt50Percent
2019-02-28 22:18:43 -08:00
f4af3881c1
HBASE-21164 reportForDuty should do backoff rather than retry
...
Remove unused methods from Sleeper (its ok, its @Private).
Remove notion of startTime from Sleeper handling (it is is unused).
Allow passing in how long to sleep so can maintain externally.
In HRS, use a RetryCounter to calculate backoff sleep time for when
reportForDuty is failing against a struggling Master.
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerReportForDuty.java
2019-02-20 18:15:30 -08:00
47e42dab75
Revert "HBASE-21164 reportForDuty should do backoff rather than retry"
...
This reverts commit f3f3798575
2019-02-20 09:25:46 -08:00
fd74857d24
HBASE-21932 Use Runtime.getRuntime().halt to terminate regionserver when abort timeout
2019-02-20 16:16:36 +08:00
ff49338d20
HBASE-21915 Make FileLinkInputStream implement CanUnbuffer
...
Signed-off-by: Wellington Chevreuil <wellington.chevreuil@gmail.com>
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2019-02-19 17:00:26 -05:00
ed6939f94a
HBASE-21866 Do not move the table to null rsgroup when creating an existing table
2019-02-18 10:56:31 -08:00
322ea5456f
HBASE-21740 Fix NPE while shutting down RS
2019-02-18 02:53:46 -08:00
6296bad9cf
HBASE-21884 Fix box/unbox findbugs warning in secure bulk load
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-02-13 07:40:07 -06:00
6caf5aa195
HBASE-21838 Create a special ReplicationEndpoint just for verifying the WAL entries are fine
...
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/replication/VerifyWALEntriesReplicationEndpoint.java
hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestVerifyCellsReplicationEndpoint.java
Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-02-12 10:58:29 -08:00
ce6a6014da
Update POMs and CHANGES.txt for 1.5.0 RC0
2019-02-01 12:36:10 -08:00
ff0e587b8f
HBASE-21735 Port HBASE-18784 (Use of filesystem that requires hflush / hsync / append / etc should query outputstream capabilities) to branch-1
...
HBASE-18784 if available, query underlying outputstream capabilities where we need hflush/hsync.
* pull things that don't rely on HDFS in hbase-server/FSUtils into hbase-common/CommonFSUtils
* refactor setStoragePolicy so that it can move into hbase-common/CommonFSUtils
* refactor WALProcedureStore so that it handles its own FS interactions
* add a reflection-based lookup of stream capabilities
* call said lookup in places where we make WALs to make sure hflush/hsync is available.
HBASE-19289 Add flag to disable stream capability enforcement
HBASE-19841 Tests against hadoop3 fail with StreamLacksCapabilityException
HBASE-19947 ITU should overwrite HTU local FS
HBASE-20354 better docs for impact of proactively checking hsync support.
* Add to the quickstart guide disabling the hsync check, with a
big warning about how we'll lose data if the check is disabled.
* Add to troubleshooting section so folks searching can get a pointer.
2019-01-24 09:23:14 -08:00
b51c487206
HBASE-21748 Port HBASE-21738 (Remove all the CLSM#size operation in our memstore because it's an quite time consuming) to branch-1
2019-01-23 18:09:11 -08:00
c1c2bc2f0a
HBASE-21475 Put mutation (having TTL set) added via co-processor is retrieved even after TTL expires
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
hbase-server/src/test/java/org/apache/hadoop/hbase/coprocessor/TestRegionObserverForAddingMutationsFromCoprocessors.java
Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-23 17:01:20 -08:00
20759a3c7e
HBASE-20870 Wrong HBase root dir in ITBLL's Search Tool
...
Conflicts:
hbase-it/src/test/java/org/apache/hadoop/hbase/IntegrationTestingUtility.java
hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-23 16:12:09 -08:00
d3ce26101e
HBASE-21766 TestSimpleRpcScheduler is flaky (branch-1)
2019-01-23 14:55:04 -08:00
7cefd8bc25
HBASE-21575 : memstore above high watermark message is logged too much
2019-01-22 16:41:43 -08:00
acdd23ec4c
HBASE-21561 Backport HBASE-21413 (Empty meta log doesn't get split when restart whole cluster) to branch-1
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-01-21 18:06:48 -08:00
aa1b750899
HBASE-21749 RS UI may throw NPE and make rs-status page inaccessible with multiwal and replication
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/ReplicationSource.java
Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-21 17:31:13 -08:00
1fd76bd35a
HBASE-21680 Port HBASE-20194 (Basic Replication WebUI - Master) and HBASE-20193 (Basic Replication Web UI - Regionserver) to branch-1
...
HBASE-20193 Basic Replication Web UI - Regionserver
HBASE-20194 Basic Replication WebUI - Master
2019-01-21 17:25:20 -08:00
0546b77a31
HBASE-21645 Perform sanity check and disallow table creation/modification with region replication < 1
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestFromClientSide.java
Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-17 17:48:53 -08:00
52b8978212
HBASE-21595 Print thread's information and stack traces when RS is aborting forcibly
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-01-17 10:40:55 -08:00
2c0b6f8227
HBASE-21616 Port HBASE-21034 (Add new throttle type: read/write capacity unit) to branch-1
...
HBASE-21034 Add new throttle type: read/write capacity unit
HBASE-21578 Fix wrong throttling exception for capacity unit
2019-01-16 15:59:46 -08:00
0315c2d65d
HBASE-20209 Do Not Use Both Map containsKey and get Methods in Replication Sink
...
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 3e92cd5771
2019-01-16 14:50:41 -07:00
cd0645a5f6
HBASE-21675 Port HBASE-21642 (CopyTable by reading snapshot and bulkloading will save a lot of time) to branch-1
...
HBASE-21642 CopyTable by reading snapshot and bulkloading will save a lot of time
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-01-16 10:03:43 -08:00
336de0aed4
HBASE-21659 Avoid to load duplicate coprocessors in system config and table descriptor
...
Conflicts:
hbase-server/src/test/java/org/apache/hadoop/hbase/coprocessor/TestRegionCoprocessorHost.java
Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-14 16:07:28 -08:00
18891467fa
HBASE-20986 Separate the config of block size when we do log splitting and write Hlog
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/WALUtil.java
hbase-server/src/main/java/org/apache/hadoop/hbase/wal/FSHLogProvider.java
Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-14 14:22:15 -08:00
feb8a57a9a
HBASE-16499 slow replication for small HBase clusters
...
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
2019-01-14 14:10:19 -08:00
a3e274cf57
HBASE-21196 HTableMultiplexer clears the meta cache after every put operation
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Conflicts:
hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncRequestFutureImpl.java
Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-14 11:24:08 -08:00
d6a3e6b404
HBASE-21679 Port HBASE-6028 (Start/Stop compactions at region server level) to branch-1
...
HBASE-6028 Start/Stop compactions at region server level
Add switching on/off of compactions.
Switching off compactions will also interrupt any currently ongoing compactions.
Adds a "compaction_switch" to hbase shell. Switching off compactions will
interrupt any currently ongoing compactions. State set from shell will be
lost on restart. To persist the changes across region servers modify
hbase.regionserver.compaction.enabled in hbase-site.xml and restart.
2019-01-11 18:08:27 -08:00
e7ff91f35e
HBASE-21325 Force to terminate regionserver when abort hang in somewhere
...
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerAbortTimeout.java
Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-11 17:56:48 -08:00
f3f3798575
HBASE-21164 reportForDuty should do backoff rather than retry
...
Remove unused methods from Sleeper (its ok, its @Private).
Remove notion of startTime from Sleeper handling (it is is unused).
Allow passing in how long to sleep so can maintain externally.
In HRS, use a RetryCounter to calculate backoff sleep time for when
reportForDuty is failing against a struggling Master.
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerReportForDuty.java
Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-11 16:50:45 -08:00
231e6d56b5
HBASE-20928 Rewrite calculation of midpoint in binarySearch functions to prevent overflow
...
HBASE-20928 Rewrite calculation of midpoint - addendum (Xu Cang)
Signed-off-by: tedyu <yuzhihong@gmail.com>
Conflicts:
hbase-common/src/main/java/org/apache/hadoop/hbase/io/encoding/RowIndexSeekerV1.java
hbase-common/src/main/java/org/apache/hadoop/hbase/util/Bytes.java
Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-11 14:40:51 -08:00
582c649783
HBASE-21374 Backport HBASE-21342 to branch-1
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-01-10 15:44:44 -08:00
beeb0796e5
HBASE-21492 CellCodec Written To WAL Before It's Verified
...
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/AbstractProtobufLogWriter.java
2018-12-31 12:29:04 -08:00
55a775b8d4
HBASE-21620 Problem in scan query when using more than one column prefix filter in some cases
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Allan Yang <allan163@apache.org>
2018-12-25 09:49:38 +08:00
98640e4b2c
HBASE-21618 Scan with the same startRow(inclusive=true) and stopRow(inclusive=false) returns one result
2018-12-21 14:03:12 +08:00
bbf17e6149
HBASE-21592 quota.addGetResult(r) throw NPE
...
Signed-off-by: huzheng <openinx@gmail.com>
2018-12-18 18:56:22 +08:00
049307c9a7
HBASE-21520 TestMultiColumnScanner cost long time when using ROWCOL bloom type
2018-12-15 21:08:09 +08:00
5c8c945e34
HBASE-21590 Optimize trySkipToNextColumn in StoreScanner a bit. (addendum)
...
(cherry picked from commit a284c493b127fbf785fbee401f0854ad1979eb26)
(cherry picked from commit aa36c3f6b6
2018-12-14 15:56:36 -06:00
4e7fc18fb6
HBASE-21590 Optimize trySkipToNextColumn in StoreScanner a bit.
2018-12-13 11:55:28 -08:00
81dc223ae7
HBASE-21582 If call HBaseAdmin#snapshotAsync but forget call isSnapshotFinished, then SnapshotHFileCleaner will skip to run every time
2018-12-12 21:31:36 +08:00
bd33a1ef96
HBASE-21553 schedLock not released in MasterProcedureScheduler
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-12-10 17:56:53 -08:00
f1e2f077fa
HBASE-21504 If enable FIFOCompactionPolicy, a compaction may write a "empty" hfile whose maxTimeStamp is long max. This kind of hfile will never be archived.
2018-11-30 10:24:09 +08:00
003cc103aa
HBASE-21511 Remove in progress snapshot check in SnapshotFileCache#getUnreferencedFiles
2018-11-25 21:48:55 -08:00
a586b4b0a2
HBASE-21387 Addendum fix TestSnapshotFileCache
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-11-24 17:01:09 +08:00
fe99ebb0ef
HBASE-21387 Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files
2018-11-23 12:07:27 +08:00
9cef4e1141
HBASE-21473 RowIndexSeekerV1 may return cell with extra two \x00\x00 bytes which has no tags
2018-11-14 23:29:25 +08:00
814c3690dc
HBASE-21445 CopyTable by bulkload will write hfile into yarn's HDFS
2018-11-10 10:41:38 +08:00
68c9396685
HBASE-21439 RegionLoads aren't being used in RegionLoad cost functions
...
Amend HBASE-21439 Update RSGroup Test too
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-11-08 14:21:51 -08:00
36178f7443
HBASE-21373 (backport from HBASE-21338) Warn if balancer is an ill-fit for cluster size
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-11-08 10:58:04 -08:00
efc203a5a2
HBASE-20604 ProtobufLogReader#readNext can incorrectly loop to the same position in the stream until the the WAL is rolled
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-11-07 18:24:13 -08:00
5fcfdcdc51
HBASE-21347 Backport HBASE-21200 "Memstore flush doesn't finish because of seekToPreviousRow() in memstore scanner." to branch-1
...
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Ted Yu <tedyu@apache.org>
2018-11-06 14:00:34 -05:00
5f5f4e82b1
HBASE-21357 RS should abort if OOM in Reader thread
2018-10-24 11:10:20 +08:00
f73d6193e1
HBASE-21355 (addendum) replace the expensive reload storefiles with reading the merge result of compacted storefiles and current storefiles
2018-10-22 21:26:12 +08:00
ad79442d8a
HBASE-21355 HStore's storeSize is calculated repeatedly which causing the confusing region split
2018-10-22 11:05:56 +08:00
0128fed9dd
HBASE-21263 Mention compression algorithm along with other storefile details
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/Compactor.java
2018-10-16 13:39:13 -07:00
ea90846268
HBASE-21266 Not running balancer because processing dead regionservers, but empty dead rs list
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-15 14:51:24 -07:00
d385ba1a5d
HBASE-21098 Improve Snapshot Performance with Temporary Snapshot Directory when rootDir on S3
...
Test fixes by: Taklon Wu <wutaklon@amazon.com>
Signed-off-by: Zach York <zyork@apache.org>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2018-10-12 11:13:16 -07:00
b73aab8bc1
HBASE-21185 - WALPrettyPrinter: Additional useful info to be printed by wal printer tool, for debugability purposes
2018-10-11 14:39:14 -07:00
6e0ee4efa7
HBASE-18549 Add metrics for failed replication queue recovery
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-10-01 18:39:24 -07:00
e8e4beacb0
HBASE-19275 TestSnapshotFileCache never worked properly
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-10-01 17:15:29 -07:00
baeeaa1b21
HBASE-21117 fix table locking when moveTables, fix HBASE-20666 rsgroups issue
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-10-01 16:58:29 -07:00
121fad31ce
HBASE-20857 balancer status tag in jmx metrics
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-28 16:04:49 -07:00
c5cf80dc87
HBASE-21207 Add client side sorting functionality in master web UI for table and region server details
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-28 15:35:52 -07:00
3edf1154fe
HBASE-19418 configurable range of delay in PeriodicMemstoreFlusher
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-28 14:34:28 -07:00
f1111e6f97
HBASE-18451 PeriodicMemstoreFlusher should inspect the queue before adding a delayed flush request
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-28 11:50:53 -07:00
0b6e2907bd
HBASE-21228 Memory leak since AbstractFSWAL caches Thread object and never clean later
2018-09-27 16:44:46 +08:00
04c732e9de
HBASE-20766 Typo in VerifyReplication error.
...
closes #80 .
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 8f8d571779
2018-09-26 14:56:57 -07:00
823b790000
HBASE-21212 Wrong flush time when update flush metric
2018-09-26 19:40:43 +08:00
a00adb0b45
HBASE-20734 Colocate recovered edits directory with hbase.wal.dir
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-09-26 11:54:44 +08:00
c6a1334528
Revert "HBASE-20993. [Auth] IPC client fallback to simple auth allowed doesn't work"
...
Revert reason: It breaks phoenix client.
This reverts commit 8dbb0b0487
2018-09-22 10:13:14 +08:00
Mate Szalay-Beko
Andrew Purtell
Josh Elser
virajjasani
Reid Chan
Pankaj
Jan Hentschel
Mingliang Liu
Syeda
Artem Ervits
Clay Baenziger
Duo Zhang
Sakthi
wellington
Xu Cang
Wellington Chevreuil
Wei-Chiu Chuang
Caroline Zhou
Puleya7
z-york
Abhishek Singh Chouhan
Yu Li
Tak Lon (Stephen) Wu
Thiruvel Thirumoolan
chfeng
Zach York
Puleya7
Wellington Chevreuil
Gary Helmling
liubangchen
Bahram Chechrazy
Ankit Singhal
huzheng
iamgd67
chaiwentao
chenyechao
Guanghao Zhang
Xiang Li
lujie
Sean Busbey
Nihal Jain
Allan Yang
Sergey Shelukhin
xcang
Beluga Behr
jingyuntian
Ashish Singhi
Saurabh Singh
mazhenlin
xuqinya
Lars Hofhansl
Ted Yu
Ben Lau
Esteban Gutierrez
Toshihiro Suzuki
subrat.mishra
Tyler Mi
Kiran Kumar Maturi
Archana Katiyar
ramie-raufdeen
ffernandez92