4a043126b1
HBASE-21290 No need to instantiate BlockCache for master which not carry table
2018-10-15 17:21:17 +08:00
7d798b3c73
HBASE-21260 The whole balancer plans might be aborted if there are more than one plans to move a same region
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2018-10-15 15:54:13 +08:00
6781918ca8
HBASE-21310 Split TestCloneSnapshotFromClient
2018-10-15 14:00:40 +08:00
dde336f6ef
HBASE-21309 Increase the waiting timeout for TestProcedurePriority
2018-10-14 08:46:18 +08:00
a292ab7c87
HBASE-21299 List counts of actual region states in master UI tables section
2018-10-12 11:02:36 -07:00
fa5fa6ecdd
HBASE-21289 Remove the log "'hbase.regionserver.maxlogs' was deprecated." in AbstractFSWAL
2018-10-12 20:27:10 +08:00
9e9a1e0f0d
HBASE-21254 Need to find a way to limit the number of proc wal files
2018-10-12 11:05:13 +08:00
924d183ba0
HBASE-21247 Allow WAL Provider to be specified by configuration without explicit enum in Providers - revert
2018-10-11 09:00:24 -07:00
8b66dea2ff
HBASE-21281 Upgrade bouncycastle to latest
...
BC 1.47 introduced some incompatible API changes which came in via
a new Maven artifact. We don't use any changed API in HBase. This
also removes some unnecessary dependencies on bcprov in other
modules (presumably, they are vestiges)
Signed-off-by: Mike Drob <mdrob@apache.org>
Signed-off-by: Ted Yu <tedyu@apache.org>
2018-10-11 11:02:32 -04:00
db9a5b7da7
HBASE-21287 Allow configuring test master initialization wait time.
2018-10-11 09:43:04 -05:00
0789f54454
HBASE-21247 Allow WAL Provider to be specified by configuration without explicit enum in Providers
2018-10-10 08:27:16 -07:00
a1f28f3ca7
HBASE-21277 Prevent to add same table to two sync replication peer's config
2018-10-10 15:43:16 +08:00
f122328758
HBASE-21251 Refactor RegionMover
2018-10-10 15:10:57 +08:00
7c755bf06e
HBASE-21280 Add anchors for each heading in UI
...
Signed-off-by: Ted Yu <tedyu@apache.org>
2018-10-09 22:50:19 -07:00
e8df847d4e
HBASE-21250 Addendum remove unused modification in hbase-server module
2018-10-08 14:55:55 +08:00
118b074684
HBASE-21250 Refactor WALProcedureStore and add more comments for better understanding the implementation
2018-10-07 17:09:09 +08:00
4508f670b1
HBASE-21185 - WALPrettyPrinter: Additional useful info to be printed by wal printer tool, for debugability purposes
...
Signed-off-by: Allan Yang <allan163@apache.org>
2018-10-04 03:32:18 -07:00
b9bb14e0fd
HBASE-21221 Ineffective assertion in TestFromClientSide3#testMultiRowMutations - addendum tightens condition for finding exception
2018-10-03 08:22:57 -07:00
42aa3dd463
HBASE-18549 Add metrics for failed replication queue recovery
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-10-01 18:38:55 -07:00
1b7e4fdcfc
HBASE-19275 TestSnapshotFileCache never worked properly
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-10-01 17:12:00 -07:00
f9d51b67e4
HBASE-21245 Add exponential backoff when retrying for sync replication related procedures
2018-09-30 20:05:34 +08:00
fdbaa4c3f0
HBASE-21248 Implement exponential backoff when retrying for ModifyPeerProcedure
2018-09-29 13:19:36 +08:00
ab6ec1f9e4
Revert "HBASE-21248 Implement exponential backoff when retrying for ModifyPeerProcedure"
...
This reverts commit 3baafbed52
2018-09-29 09:27:51 +08:00
56ac4705e9
HBASE-21196 HTableMultiplexer clears the meta cache after every put operation
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-28 16:35:46 -07:00
aa9e1d0511
HBASE-20857 balancer status tag in jmx metrics
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-28 16:12:15 -07:00
801fc05e9c
HBASE-21207 Add client side sorting functionality in master web UI for table and region server details
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-28 15:28:20 -07:00
668a179882
HBASE-19418 configurable range of delay in PeriodicMemstoreFlusher
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-28 14:27:07 -07:00
704f8b81bb
HBASE-18451 PeriodicMemstoreFlusher should inspect the queue before adding a delayed flush request, fix logging
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-28 11:50:08 -07:00
d39ea25d44
HBASE-21244 Skip persistence when retrying for assignment related procedures
2018-09-28 21:22:23 +08:00
3baafbed52
HBASE-21248 Implement exponential backoff when retrying for ModifyPeerProcedure
2018-09-28 20:20:48 +08:00
86cb8e48ad
HBASE-21228 Memory leak since AbstractFSWAL caches Thread object and never clean later
2018-09-27 16:24:17 +08:00
1154f81230
HBASE-21232 Show table state in Tables view on Master home page
2018-09-26 10:58:16 -07:00
d7e08317d2
HBASE-21227 Implement exponential retrying backoff for Assign/UnassignRegionHandler introduced in HBASE-21217
2018-09-26 20:53:56 +08:00
7b2f5950ed
HBASE-21212 Wrong flush time when update flush metric
2018-09-26 19:38:15 +08:00
0e173d38b0
HBASE-20734 Colocate recovered edits directory with hbase.wal.dir
...
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-09-26 11:20:57 +08:00
08c4d70aaf
HBASE-21164 reportForDuty should do backoff rather than retry
...
Remove unused methods from Sleeper (its ok, its @Private).
Remove notion of startTime from Sleeper handling (it is is unused).
Allow passing in how long to sleep so can maintain externally.
In HRS, use a RetryCounter to calculate backoff sleep time for when
reportForDuty is failing against a struggling Master.
2018-09-25 11:32:28 -07:00
b8134fe5b6
HBASE-21221 Ineffective assertion in TestFromClientSide3#testMultiRowMutations
2018-09-25 09:17:26 -07:00
8eaaa63114
HBASE-21217 Revisit the executeProcedure method for open/close region
2018-09-25 17:30:21 +08:00
7ab77518a2
Amend HBASE-20704 Sometimes some compacted storefiles are not archived on region close
...
Forward port small logging improvements from branch-1 version of this change.
2018-09-21 16:12:33 -07:00
3de02d57f6
HBASE-20636 Introduce two bloom filter type : ROWPREFIX and ROWPREFIX_DELIMITED
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-09-21 16:06:39 -07:00
98909f4a9d
HBASE-21214 [hbck2] setTableState just sets hbase:meta state, not in-memory state
2018-09-21 16:04:59 -07:00
ddd30a2241
HBASE-21206 Scan with batch size may return incomplete cells
2018-09-20 22:36:24 +08:00
cd161d976e
HBASE-21204 NPE when scan raw DELETE_FAMILY_VERSION and codec is not set
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-09-20 06:57:50 -07:00
dc767c06d2
HBASE-21023 Added bypassProcedure() API to HbckService
2018-09-19 15:18:16 -07:00
3a0fcd56cf
HBASE-21156 [hbck2] Queue an assign of hbase:meta and bulk assign/unassign
...
Adds 'raw' assigns and unassigns methods to Hbck Service.
Fixes HbckService so it works when cluster is Kerberized.
2018-09-19 10:06:16 -07:00
69431c75c1
HBASE-21102 ServerCrashProcedure should select target server where no other replicas exist for the current region - addendum fixes NPE
2018-09-19 07:17:13 -07:00
cebb725a9f
HBASE-21102 - ServerCrashProcedure should select target server where no
...
other replicas exist for the current region - fix flaky test (Ram)
2018-09-18 11:28:23 +05:30
1cf920db43
HBASE-21160 Assertion in TestVisibilityLabelsWithDeletes#testDeleteColumnsWithoutAndWithVisibilityLabels is ignored (liubangchen)
2018-09-17 08:25:11 -07:00
6d7bc0e98b
HBASE-21191 Add a holding-pattern if no assign for meta or namespace (Can happen if masterprocwals have been cleared).
...
Add a check for hbase:meta being online before we go to read it.
If not online, move into a holding-pattern until rectified, probably
by external operator.
Incorporates bulk of patch made by Allan Yang over on HBASE-21035.
M hbase-common/src/main/java/org/apache/hadoop/hbase/util/RetryCounterFactory.java
Add a Constructor for case where retries are for ever.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
Move stuff around so that the first hbase:meta read is the AM#loadMeta.
Previously, checking table state and/or favored nodes could end up
trying to read a meta that was not onlined holding up master startup.
Do similar for the namespace table. Adds new methods isMeta and
isNamespace which check that the regions/tables are online.. if not,
we wait logging with a back-off that assigns need to be run.
Signed-off-by: Allan Yang <allan163@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2018-09-16 21:44:17 -07:00
cdfe808892
HBASE-20704 Sometimes some compacted storefiles are not archived on region close
2018-09-16 18:26:28 -07:00
9da20a4116
HBASE-21097 Flush pressure assertion may fail in testFlushThroughputTuning
...
Amending-Author: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2018-09-15 18:20:35 +08:00
0075093d21
HBASE-21168 Insecure Randomness in BloomFilterUtil
...
Flagged by Fortify static analysis
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2018-09-12 09:51:45 -05:00
5c1b325b51
HBASE-21098 Improve Snapshot Performance with Temporary Snapshot Directory when rootDir on S3
...
Signed-off-by: Zach York <zyork@apache.org>
2018-09-11 16:23:16 -07:00
c372175da4
HBASE-21021 Result returned by Append operation should be ordered
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-11 14:43:52 -07:00
2ab8122a24
HBASE-21172 Addendum fix comment
2018-09-11 17:32:01 +08:00
c59ecfb961
HBASE-21172 Reimplement the retry backoff logic for ReopenTableRegionsProcedure
2018-09-11 15:13:58 +08:00
bea26e98e6
HBASE-21173 Remove the duplicate HRegion#close in TestHRegion
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2018-09-11 11:06:23 +08:00
2aae247e3f
HBASE-21158 Empty qualifier cell is always returned when using QualifierFilter
2018-09-10 21:32:46 +08:00
b09dbb443e
HBASE-21102 - ServerCrashProcedure should select target server where no
...
other replicas exist for the current region (fix compilation issue)
2018-09-10 13:23:53 +05:30
dc3ada2614
HBASE-21102 ServerCrashProcedure should select target server where no
...
other replicas exist for the current region (Ram)
2018-09-10 13:12:02 +05:30
a51c333856
HBASE-21052 After restoring a snapshot, table.jsp page for the table gets stuck
2018-09-09 10:23:50 +09:00
b04b4b0fd1
HBASE-21144 Addendum fix race when testing whether a procedure is finished
2018-09-08 08:57:56 +08:00
c3419be003
HBASE-21001 ReplicationObserver fails to load in HBase 2.0.0
2018-09-07 23:42:02 +08:00
aab3a8a870
HBASE-21155 Save on a few log strings and some churn in wal splitter by skipping out early if no logs in dir; ADDENDUM
...
Address review comments.
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-09-06 17:25:39 -07:00
3ac3249423
HBASE-21155 Save on a few log strings and some churn in wal splitter by skipping out early if no logs in dir
2018-09-06 16:52:47 -07:00
b3908a26ff
HBASE-21161 Enable the test added in HBASE-20741 that was removed
...
accidentally (Ram)
2018-09-06 16:51:40 +05:30
a37c40faa5
HBASE-21138 Close HRegion instance at the end of every test in TestHRegion
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-09-06 03:59:44 -07:00
bdc168713d
HBASE-21107 add a metrics for netty direct memory
2018-09-05 16:04:25 -07:00
b62ac3cb11
HBASE-20892 [UI] Start / End keys are empty on table.jsp
2018-09-05 09:09:04 +08:00
c6a65ba63f
HBASE-20741 - Split of a region with replicas creates all daughter regions
...
and its replica in same server (Addendum for duo's comments in RB)
2018-09-04 16:38:09 +05:30
f504c4d797
HBASE-21144 AssignmentManager.waitForAssignment is not stable
2018-09-04 17:07:51 +08:00
83131b1ac4
HBASE-20741 Split of a region with replicas creates all daughter regions
...
and its replica in same server (Ram)
Signed-off-by: Huaxiang Sun, Michael Stack
2018-09-04 11:18:51 +05:30
e4c4035ed8
HBASE-20741 Split of a region with replicas creates all daughter regions
...
and its replica in same server (Ram)
Signed-off-by: Huaxiang Sun, Michael Stack
2018-09-04 11:08:03 +05:30
245bb44703
HBASE-21129 Clean up duplicate codes in #equals and #hashCode methods of Filter
...
Signed-off-by Ted Yu <yuzhihong@gmail.com>
2018-09-04 11:09:21 +08:00
5cca61c4d0
HBASE-21126 Configurable number of allowed failures for ZooKeeper Canary
...
Signed-off-by: Josh Elser <elserj@apache.org>
2018-09-03 19:27:23 -07:00
dc79029966
HBASE-21136 NPE in MetricsTableSourceImpl.updateFlushTime
2018-09-02 18:35:45 +08:00
7c1fad4992
HBASE-21083 Introduce a mechanism to bypass the execution of a stuck procedure
2018-08-30 12:23:24 -07:00
98600f1860
HBASE-21128 TestAsyncRegionAdminApi.testAssignRegionAndUnassignRegion is broken
2018-08-30 10:09:44 +08:00
e903ae5d5e
HBASE-15728 Add Per-Table metrics back
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-08-29 15:21:00 -07:00
fcd883b5dd
HBASE-20942 Fix ArrayIndexOutOfBoundsException for RpcServer TRACE logging
...
Also makes the trace log message length configurable.
Signed-off-by: Josh Elser <elserj@apache.org>
2018-08-28 11:01:49 -04:00
3afe9fb7e6
HBASE-21017 Revisit the expected states for open/close
2018-08-28 14:49:22 +08:00
3813f0ac3d
HBASE-20941 Created and implemented HbckService in master
...
Added API setTableStateInMeta() to update table state only in Meta. This will be used by hbck2 tool.
2018-08-27 12:11:52 -07:00
6dd5383033
HBASE-21071 HBaseTestingUtility::startMiniCluster() to use builder pattern
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2018-08-27 10:20:31 -07:00
9e2732edbb
HBASE-21088 HStoreFile should be closed in HStore#hasReferences
2018-08-27 09:36:44 -07:00
993e74b747
HBASE-21072 Addendum do not write lock file when running TestHBaseFsckReplication
2018-08-27 21:03:32 +08:00
f05f116327
HBASE-21084 When cloning a snapshot including a split parent region, the split parent region of the cloned table will be online
2018-08-26 13:57:44 +09:00
409e742ac3
Revert "HBASE-21017 Add debug log for finding out race where we update region state to OPEN accidentally"
...
This reverts commit a452487a9b
2018-08-25 15:21:55 +08:00
86b35b2687
HBASE-21072 Block out HBCK1 in hbase2
...
Write the hbase-1.x hbck1 lock file to block out hbck1 instances writing
state to an hbase-2.x cluster (could do damage).
Set hbase.write.hbck1.lock.file to false to disable this writing.
2018-08-24 09:26:43 -07:00
a452487a9b
HBASE-21017 Add debug log for finding out race where we update region state to OPEN accidentally
2018-08-24 11:48:04 +08:00
aac1a70147
HBASE-21095 The timeout retry logic for several procedures are broken after master restarts
2018-08-24 10:07:31 +08:00
780670ede1
HBASE-21097 Flush pressure assertion may fail in testFlushThroughputTuning
2018-08-23 11:48:27 -07:00
72b36e1d9a
HBASE-19008 Add missing equals or hashCode method(s) to stock Filter implementations
...
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
2018-08-24 00:22:22 +08:00
6a5b4f2a5c
HBASE-21101 Remove the waitUntilAllRegionsAssigned call after split in TestTruncateTableProcedure
2018-08-23 18:06:03 +08:00
2d911fdc2f
HBASE-20943 Add offline/online region count into metrics
2018-08-22 16:27:10 -07:00
91edbf592a
HBASE-20193 Move TestCreateTableProcedure.testMRegions to a separated file
2018-08-23 07:01:05 +08:00
b0af08bf9b
HBASE-21094 Remove the explicit timeout config for TestTruncateTableProcedure
...
(cherry picked from commit 74ea011169
2018-08-22 11:30:05 -05:00
899982c02d
Revert "HBASE-20194 Remove the explicit timeout config for TestTruncateTableProcedure"
...
This reverts commit 74ea011169
2018-08-22 11:30:05 -05:00
77a6bf3b33
HBASE-21041 Memstore's heap size will be decreased to minus zero after flush
2018-08-22 23:19:11 +08:00
4a52ddb75e
HBASE-21031 Memory leak if replay edits failed during region opening
2018-08-22 22:42:01 +08:00
064388b478
Revert "HBASE-21093 Increase the dispatch delay for testing DDL procedures"
...
This reverts commit c01d4d3a35
2018-08-22 21:48:03 +08:00
Guanghao Zhang
haxiaolin
zhangduo
Michael Stack
tedyu
Josh Elser
Mike Drob
Wellington Chevreuil
Xu Cang
Nihal Jain
Kiran Kumar Maturi
Archana Katiyar
ramie-raufdeen
Allan Yang
Zach York
Mingliang Liu
Andrew Purtell
Guangxu Cheng
openinx
tianjingyun
Umesh Agashe
Vasudevan
Francis Liu
Tyler Mi
Toshihiro Suzuki
Huaxiang Sun
Reid Chan
David Manning
krish.dey
liubangchen
Jinghan Xu
Sean Busbey