Guangxu Cheng
3de02d57f6
HBASE-20636 Introduce two bloom filter type : ROWPREFIX and ROWPREFIX_DELIMITED
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-09-21 16:06:39 -07:00
Michael Stack
98909f4a9d
HBASE-21214 [hbck2] setTableState just sets hbase:meta state, not in-memory state
2018-09-21 16:04:59 -07:00
openinx
ddd30a2241
HBASE-21206 Scan with batch size may return incomplete cells
2018-09-20 22:36:24 +08:00
tianjingyun
cd161d976e
HBASE-21204 NPE when scan raw DELETE_FAMILY_VERSION and codec is not set
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-09-20 06:57:50 -07:00
Umesh Agashe
dc767c06d2
HBASE-21023 Added bypassProcedure() API to HbckService
2018-09-19 15:18:16 -07:00
Michael Stack
3a0fcd56cf
HBASE-21156 [hbck2] Queue an assign of hbase:meta and bulk assign/unassign
...
Adds 'raw' assigns and unassigns methods to Hbck Service.
Fixes HbckService so it works when cluster is Kerberized.
2018-09-19 10:06:16 -07:00
tedyu
69431c75c1
HBASE-21102 ServerCrashProcedure should select target server where no other replicas exist for the current region - addendum fixes NPE
2018-09-19 07:17:13 -07:00
Vasudevan
cebb725a9f
HBASE-21102 - ServerCrashProcedure should select target server where no
...
other replicas exist for the current region - fix flaky test (Ram)
2018-09-18 11:28:23 +05:30
tedyu
1cf920db43
HBASE-21160 Assertion in TestVisibilityLabelsWithDeletes#testDeleteColumnsWithoutAndWithVisibilityLabels is ignored (liubangchen)
2018-09-17 08:25:11 -07:00
Michael Stack
6d7bc0e98b
HBASE-21191 Add a holding-pattern if no assign for meta or namespace (Can happen if masterprocwals have been cleared).
...
Add a check for hbase:meta being online before we go to read it.
If not online, move into a holding-pattern until rectified, probably
by external operator.
Incorporates bulk of patch made by Allan Yang over on HBASE-21035.
M hbase-common/src/main/java/org/apache/hadoop/hbase/util/RetryCounterFactory.java
Add a Constructor for case where retries are for ever.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
Move stuff around so that the first hbase:meta read is the AM#loadMeta.
Previously, checking table state and/or favored nodes could end up
trying to read a meta that was not onlined holding up master startup.
Do similar for the namespace table. Adds new methods isMeta and
isNamespace which check that the regions/tables are online.. if not,
we wait logging with a back-off that assigns need to be run.
Signed-off-by: Allan Yang <allan163@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2018-09-16 21:44:17 -07:00
Francis Liu
cdfe808892
HBASE-20704 Sometimes some compacted storefiles are not archived on region close
2018-09-16 18:26:28 -07:00
Ted Yu
9da20a4116
HBASE-21097 Flush pressure assertion may fail in testFlushThroughputTuning
...
Amending-Author: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2018-09-15 18:20:35 +08:00
Mike Drob
0075093d21
HBASE-21168 Insecure Randomness in BloomFilterUtil
...
Flagged by Fortify static analysis
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2018-09-12 09:51:45 -05:00
Tyler Mi
5c1b325b51
HBASE-21098 Improve Snapshot Performance with Temporary Snapshot Directory when rootDir on S3
...
Signed-off-by: Zach York <zyork@apache.org>
2018-09-11 16:23:16 -07:00
Nihal Jain
c372175da4
HBASE-21021 Result returned by Append operation should be ordered
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-11 14:43:52 -07:00
Duo Zhang
2ab8122a24
HBASE-21172 Addendum fix comment
2018-09-11 17:32:01 +08:00
Duo Zhang
c59ecfb961
HBASE-21172 Reimplement the retry backoff logic for ReopenTableRegionsProcedure
2018-09-11 15:13:58 +08:00
Guangxu Cheng
bea26e98e6
HBASE-21173 Remove the duplicate HRegion#close in TestHRegion
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2018-09-11 11:06:23 +08:00
Guangxu Cheng
2aae247e3f
HBASE-21158 Empty qualifier cell is always returned when using QualifierFilter
2018-09-10 21:32:46 +08:00
Vasudevan
b09dbb443e
HBASE-21102 - ServerCrashProcedure should select target server where no
...
other replicas exist for the current region (fix compilation issue)
2018-09-10 13:23:53 +05:30
Vasudevan
dc3ada2614
HBASE-21102 ServerCrashProcedure should select target server where no
...
other replicas exist for the current region (Ram)
2018-09-10 13:12:02 +05:30
Toshihiro Suzuki
a51c333856
HBASE-21052 After restoring a snapshot, table.jsp page for the table gets stuck
2018-09-09 10:23:50 +09:00
zhangduo
b04b4b0fd1
HBASE-21144 Addendum fix race when testing whether a procedure is finished
2018-09-08 08:57:56 +08:00
Guangxu Cheng
c3419be003
HBASE-21001 ReplicationObserver fails to load in HBase 2.0.0
2018-09-07 23:42:02 +08:00
Michael Stack
aab3a8a870
HBASE-21155 Save on a few log strings and some churn in wal splitter by skipping out early if no logs in dir; ADDENDUM
...
Address review comments.
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-09-06 17:25:39 -07:00
Michael Stack
3ac3249423
HBASE-21155 Save on a few log strings and some churn in wal splitter by skipping out early if no logs in dir
2018-09-06 16:52:47 -07:00
Vasudevan
b3908a26ff
HBASE-21161 Enable the test added in HBASE-20741 that was removed
...
accidentally (Ram)
2018-09-06 16:51:40 +05:30
Mingliang Liu
a37c40faa5
HBASE-21138 Close HRegion instance at the end of every test in TestHRegion
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-09-06 03:59:44 -07:00
Huaxiang Sun
bdc168713d
HBASE-21107 add a metrics for netty direct memory
2018-09-05 16:04:25 -07:00
Guangxu Cheng
b62ac3cb11
HBASE-20892 [UI] Start / End keys are empty on table.jsp
2018-09-05 09:09:04 +08:00
Vasudevan
c6a65ba63f
HBASE-20741 - Split of a region with replicas creates all daughter regions
...
and its replica in same server (Addendum for duo's comments in RB)
2018-09-04 16:38:09 +05:30
Duo Zhang
f504c4d797
HBASE-21144 AssignmentManager.waitForAssignment is not stable
2018-09-04 17:07:51 +08:00
Vasudevan
83131b1ac4
HBASE-20741 Split of a region with replicas creates all daughter regions
...
and its replica in same server (Ram)
Signed-off-by: Huaxiang Sun, Michael Stack
2018-09-04 11:18:51 +05:30
Vasudevan
e4c4035ed8
HBASE-20741 Split of a region with replicas creates all daughter regions
...
and its replica in same server (Ram)
Signed-off-by: Huaxiang Sun, Michael Stack
2018-09-04 11:08:03 +05:30
Reid Chan
245bb44703
HBASE-21129 Clean up duplicate codes in #equals and #hashCode methods of Filter
...
Signed-off-by Ted Yu <yuzhihong@gmail.com>
2018-09-04 11:09:21 +08:00
David Manning
5cca61c4d0
HBASE-21126 Configurable number of allowed failures for ZooKeeper Canary
...
Signed-off-by: Josh Elser <elserj@apache.org>
2018-09-03 19:27:23 -07:00
zhangduo
dc79029966
HBASE-21136 NPE in MetricsTableSourceImpl.updateFlushTime
2018-09-02 18:35:45 +08:00
Allan Yang
7c1fad4992
HBASE-21083 Introduce a mechanism to bypass the execution of a stuck procedure
2018-08-30 12:23:24 -07:00
Duo Zhang
98600f1860
HBASE-21128 TestAsyncRegionAdminApi.testAssignRegionAndUnassignRegion is broken
2018-08-30 10:09:44 +08:00
Xu Cang
e903ae5d5e
HBASE-15728 Add Per-Table metrics back
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-08-29 15:21:00 -07:00
krish.dey
fcd883b5dd
HBASE-20942 Fix ArrayIndexOutOfBoundsException for RpcServer TRACE logging
...
Also makes the trace log message length configurable.
Signed-off-by: Josh Elser <elserj@apache.org>
2018-08-28 11:01:49 -04:00
zhangduo
3afe9fb7e6
HBASE-21017 Revisit the expected states for open/close
2018-08-28 14:49:22 +08:00
Umesh Agashe
3813f0ac3d
HBASE-20941 Created and implemented HbckService in master
...
Added API setTableStateInMeta() to update table state only in Meta. This will be used by hbck2 tool.
2018-08-27 12:11:52 -07:00
Mingliang Liu
6dd5383033
HBASE-21071 HBaseTestingUtility::startMiniCluster() to use builder pattern
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2018-08-27 10:20:31 -07:00
tedyu
9e2732edbb
HBASE-21088 HStoreFile should be closed in HStore#hasReferences
2018-08-27 09:36:44 -07:00
zhangduo
993e74b747
HBASE-21072 Addendum do not write lock file when running TestHBaseFsckReplication
2018-08-27 21:03:32 +08:00
Toshihiro Suzuki
f05f116327
HBASE-21084 When cloning a snapshot including a split parent region, the split parent region of the cloned table will be online
2018-08-26 13:57:44 +09:00
zhangduo
409e742ac3
Revert "HBASE-21017 Add debug log for finding out race where we update region state to OPEN accidentally"
...
This reverts commit a452487a9b
.
2018-08-25 15:21:55 +08:00
Michael Stack
86b35b2687
HBASE-21072 Block out HBCK1 in hbase2
...
Write the hbase-1.x hbck1 lock file to block out hbck1 instances writing
state to an hbase-2.x cluster (could do damage).
Set hbase.write.hbck1.lock.file to false to disable this writing.
2018-08-24 09:26:43 -07:00
Duo Zhang
a452487a9b
HBASE-21017 Add debug log for finding out race where we update region state to OPEN accidentally
2018-08-24 11:48:04 +08:00
zhangduo
aac1a70147
HBASE-21095 The timeout retry logic for several procedures are broken after master restarts
2018-08-24 10:07:31 +08:00
tedyu
780670ede1
HBASE-21097 Flush pressure assertion may fail in testFlushThroughputTuning
2018-08-23 11:48:27 -07:00
liubangchen
72b36e1d9a
HBASE-19008 Add missing equals or hashCode method(s) to stock Filter implementations
...
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
2018-08-24 00:22:22 +08:00
Duo Zhang
6a5b4f2a5c
HBASE-21101 Remove the waitUntilAllRegionsAssigned call after split in TestTruncateTableProcedure
2018-08-23 18:06:03 +08:00
Jinghan Xu
2d911fdc2f
HBASE-20943 Add offline/online region count into metrics
2018-08-22 16:27:10 -07:00
zhangduo
91edbf592a
HBASE-20193 Move TestCreateTableProcedure.testMRegions to a separated file
2018-08-23 07:01:05 +08:00
Duo Zhang
b0af08bf9b
HBASE-21094 Remove the explicit timeout config for TestTruncateTableProcedure
...
(cherry picked from commit 74ea011169
)
2018-08-22 11:30:05 -05:00
Sean Busbey
899982c02d
Revert "HBASE-20194 Remove the explicit timeout config for TestTruncateTableProcedure"
...
This reverts commit 74ea011169
.
incorrect jira in commit
2018-08-22 11:30:05 -05:00
Allan Yang
77a6bf3b33
HBASE-21041 Memstore's heap size will be decreased to minus zero after flush
2018-08-22 23:19:11 +08:00
Allan Yang
4a52ddb75e
HBASE-21031 Memory leak if replay edits failed during region opening
2018-08-22 22:42:01 +08:00
zhangduo
064388b478
Revert "HBASE-21093 Increase the dispatch delay for testing DDL procedures"
...
This reverts commit c01d4d3a35
.
2018-08-22 21:48:03 +08:00
Duo Zhang
74ea011169
HBASE-20194 Remove the explicit timeout config for TestTruncateTableProcedure
2018-08-22 14:27:11 +08:00
Duo Zhang
c01d4d3a35
HBASE-21093 Increase the dispatch delay for testing DDL procedures
2018-08-22 14:26:35 +08:00
Xu Cang
50055dbf04
HBASE-20666 Unsuccessful table creation leaves entry in hbase:rsgroup table
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-08-21 18:54:36 -07:00
Andrey Elenskiy
a42556553a
HBASE-21032 ScanResponses contain only one cell each
...
Amending-Author: Duo Zhang <zhangduo@apache.org>
2018-08-21 13:32:05 -07:00
zhangduo
bb3494134e
HBASE-20881 Introduce a region transition procedure to handle all the state transition for a region
2018-08-21 06:12:09 +08:00
tedyu
7db116ae1b
HBASE-20917 MetaTableMetrics#stop references uninitialized requestsMap for non-meta region - addendum
2018-08-19 14:24:06 -07:00
Sean Busbey
d159b1f8bb
HBASE-21056 Findbugs false positive: BucketCache.persistToFile may fail to clean up java.io.OutputStream
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-08-17 21:29:32 -05:00
Andrew Purtell
e8eb366514
HBASE-20940 HStore.cansplit should not allow split to happen if it has references (Vishal Khandelwal)
2018-08-17 15:01:44 -07:00
Andrew Purtell
1dbd6fa993
HBASE-21047 Object creation of StoreFileScanner thru constructor and close may leave refCount to -1 (Vishal Khandelwal)
2018-08-16 11:42:15 -07:00
Sakthi
2cfe1e8aef
HBASE-20705 Having RPC quota on a table now no longer prevents Space Quota to be recreate/removed
...
Just added 2 test cases as the subtasks of this jira solves the issue
Signed-off-by: Josh Elser <elserj@apache.org>
2018-08-16 11:07:37 -04:00
Josh Elser
50a8ea7191
HBASE-21062 Spelling mistake (addendum)
...
Forgot to change in master before pushing.
2018-08-16 10:35:47 -04:00
Josh Elser
4d7ed0f94c
HBASE-21062 Correctly use the defaultProvider value on the Providers enum when constructing a WALProvider
2018-08-16 10:23:03 -04:00
Nihal Jain
092efb4274
HBASE-20469 Directory used for sidelining old recovered edits files should be made configurable
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-08-15 17:58:13 -07:00
subrat.mishra
49ae8549cf
HBASE-21040 Replace call to printStackTrace() with proper logger call
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-08-15 08:29:54 -07:00
Michael Stack
e705cf1447
HBASE-20772 Controlled shutdown fills Master log with the disturbing message 'No matching procedure found for rit=OPEN, location=ZZZZ, table=YYYYY, region=XXXX transition to CLOSED'
...
Look for the particular case where RS does the close of region w/o
involving Master and log special message in this case. Dodgy. But
until we have Master run shutdown of all regions, better than
the message we currently show.
2018-08-13 15:59:54 -07:00
jingyuntian
21e02813fe
HBASE-20985 add two attributes when we do normalization
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-08-13 16:43:54 +08:00
Duo Zhang
911a6ef412
HBASE-21025 Addendum missed a 'succ = true'
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-08-13 10:53:47 +08:00
brandboat
699ea4c7d0
HBASE-21012 Revert the change of serializing TimeRangeTracker
...
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-08-11 22:17:04 +08:00
Wei-Chiu Chuang
a3ab9306a6
HBASE-21018 RS crashed because AsyncFS was unable to update HDFS data encryption key
2018-08-10 19:53:41 -07:00
zhangduo
397388316e
HBASE-21025 Add cache for TableStateManager
2018-08-10 21:11:40 +08:00
brandboat
28635d6101
HBASE-18201 add UT and docs for DataBlockEncodingTool
...
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-08-10 11:15:50 +08:00
Mike Drob
c6ff1de7e2
HBASE-21027 Inconsistent synchronization in CacheableDeserializerIdManager
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-08-09 09:29:21 -05:00
meiyi
e2fcde2d6f
HBASE-20965 Separate region server report requests to new handlers
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-08-09 18:10:08 +08:00
Reid Chan
d921262d38
Revert "HBASE-20965 Separate region server report requests to new handlers"
...
This reverts commit 48d387413f
.
2018-08-08 10:44:50 +08:00
meiyi
48d387413f
HBASE-20965 Separate region server report requests to new handlers
2018-08-08 10:39:11 +08:00
Sakthi
6f25102997
HBASE-20813 Removed RPC quotas when the associated table/Namespace is dropped off
...
Signed-off-by: Josh Elser <elserj@apache.org>
2018-08-07 13:17:54 -04:00
jingyuntian
bd01fa7639
HBASE-20986 Separate the config of block size when we do log splitting and write Hlog
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-08-07 10:37:22 +08:00
Sakthi
bd30ca62ef
HBASE-20885 Removed entry for RPC quota from hbase:quota when RPC quota is removed
...
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-08-03 11:06:50 -04:00
Monani Mihir
b3e41c9525
HBASE-19036 Add action in Chaos Monkey to restart Active Namenode
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-08-02 04:59:51 -07:00
Mike Drob
4bcaf495c2
HBASE-20894 Use proto for BucketCache persistence
2018-08-01 16:54:25 -05:00
TAK LON WU
1d0fca370b
HBASE-20856 PITA having to set WAL provider in two places
...
With this change if hbase.wal.meta_provider is not explicitly set,
it uses whatever set with hbase.wal.provider. this change avoids a use
case of unexpectedly using two different providers when only
hbase.wal.provider is set to non-default but not hbase.wal.meta_provider.
This change also include document (architecture.adoc) update
Signed-off-by: Zach York <zyork@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Duo Zhang <Apache9@apache.org>
2018-08-01 11:29:15 -07:00
Michael Stack
c365c4084e
HBASE-20989 Minor, miscellaneous logging fixes
...
Signed-off-by: Zach York <zyork@amazon.com>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2018-08-01 11:20:59 -07:00
Xu Cang
e7b56c3fa8
HBASE-20794 add INFO level log to createTable operation
2018-08-01 11:04:38 -07:00
Michael Stack
323907f84f
HBASE-20893 Data loss if splitting region while ServerCrashProcedure executing ADDENDUM: Rather than rollback, just do region reopens.
...
In split, reopen the parent if recovered.edits and in merge, reopen the
parent region or regions that happened to have recovered.edits on close.
2018-08-01 00:33:55 -07:00
Andrew Purtell
5a1e02b6dc
HBASE-20935 HStore.removeCompactedFiles should log in case it is unable to delete a file (Vishal Khandelwal)
2018-07-31 15:58:05 -07:00
Wei-Chiu Chuang
7be97980f5
HBASE-20950 Helper method to configure secure DFS cluster for tests
...
Create a helper method HBaseKerberosUtils#setSecuredConfiguration().
TestSecureExport, TestSaslFanOutOneBlockAsyncDFSOutput,
SecureTestCluster and TestThriftSpnegoHttpServer uses this new helper
method.
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-31 13:36:17 -07:00
Reid Chan
a8e184dc77
HBASE-20886 [Auth] Support keytab login in hbase client
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-07-31 11:04:40 +08:00
zhangduo
df256223d6
HBASE-20538 Upgrade our hadoop versions to 2.7.7 and 3.0.3
2018-07-29 20:18:40 +08:00
zhangduo
e8cd3c4b95
Revert "HBASE-20538 Upgrade our hadoop-two.version to 2.7.7 and 3.0.3"
...
This reverts commit 336fd14e26
.
2018-07-29 20:18:23 +08:00
zhangduo
336fd14e26
HBASE-20538 Upgrade our hadoop-two.version to 2.7.7 and 3.0.3
2018-07-29 20:04:57 +08:00
Alex Leblang
e963694259
HBASE-19369 Switch to Builder Pattern In WAL
...
This patch switches to the builder pattern by adding a helper method.
It also checks to ensure that the pattern is available (i.e. that
HBase is running on a hadoop version that supports it).
Amending-Author: Mike Drob <mdrob@apache.org>
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-07-27 23:42:33 -05:00
zhangduo
7178a98258
HBASE-20939 There will be race when we call suspendIfNotReady and then throw ProcedureSuspendedException
2018-07-27 17:27:12 +08:00
Allan Yang
80b40a3b58
HBASE-20921 Possible NPE in ReopenTableRegionsProcedure
2018-07-27 09:36:50 +08:00
zhangduo
d43e28dc82
Revert "HBASE-20949 Add logs for debugging"
...
This reverts commit 8b8de1f8a7
.
2018-07-27 08:40:46 +08:00
zhangduo
8b8de1f8a7
HBASE-20949 Add logs for debugging
2018-07-26 22:43:14 +08:00
Mingliang Liu
a392c017ed
HBASE-20932 Effective MemStoreSize::hashCode()
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-25 14:40:45 -07:00
Peter Somogyi
ba5d1c1f28
HBASE-20649 Validate HFiles do not have PREFIX_TREE DataBlockEncoding
...
Amending-Author: Balazs Meszaros <balazs.meszaros@cloudera.com>
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-07-25 09:00:00 -05:00
Allan Yang
44f6ef1c90
HBASE-20867 RS may get killed while master restarts
2018-07-25 18:16:28 +08:00
zhangduo
f3f17fa111
HBASE-20846 Restore procedure locks when master restarts
2018-07-25 14:37:26 +08:00
Saurabh Singh
3a3855aade
HBASE-20928 Rewrite calculation of midpoint in binarySearch functions to prevent overflow
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-24 08:16:30 -07:00
huzheng
a888af3dc9
HBASE-20565 ColumnRangeFilter combined with ColumnPaginationFilter can produce incorrect result
2018-07-24 10:29:24 +08:00
Allan Yang
b631727bdf
HBASE-20878 Data loss if merging regions while ServerCrashProcedure executing
2018-07-24 10:00:28 +08:00
Allan Yang
4804483f7e
HBASE-20893 Data loss if splitting region while ServerCrashProcedure executing
2018-07-23 14:48:43 +08:00
tedyu
37de961f20
HBASE-20917 MetaTableMetrics#stop references uninitialized requestsMap for non-meta region
2018-07-22 20:50:51 -07:00
Reid Chan
4613f3e8c7
HBASE-20401 Make MAX_WAIT and waitIfNotFinished in CleanerContext configurable (Contributed by Stephen Wu)
2018-07-23 10:30:01 +08:00
Toshihiro Suzuki
682aa69677
HBASE-19893 restore_snapshot is broken in master branch when region splits
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-21 07:37:10 -07:00
Ankit Singhal
eb906e20ee
HBASE-20908 Infinite loop on regionserver if region replica are reduced
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-20 13:05:11 -07:00
Michael Stack
067388bfd9
HBASE-20914 Trim Master memory usage
...
Add (weak reference) interning of ServerNames.
Correct Balancer regions x racks matrix.
Make smaller defaults when creating ArrayDeques.
2018-07-20 10:08:55 -07:00
Allan Yang
03e596c669
HBASE-20870 Wrong HBase root dir in ITBLL's Search Tool
2018-07-20 12:17:21 +08:00
Ankit
e66a6603e3
HBASE-20672 New metrics ReadRequestRate and WriteRequestRate
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-07-19 15:33:09 -07:00
Ankit Singhal
b4eacdabd6
HBASE-20901 Reducing region replica has no effect
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-19 13:38:32 -07:00
Mohit Goel
950d6e6fb0
HBASE-6028 Start/Stop compactions at region server level
...
Add switching on/off of compactions.
Switching off compactions will also interrupt any currently ongoing compactions.
Adds a "compaction_switch" to hbase shell. Switching off compactions will
interrupt any currently ongoing compactions. State set from shell will be
lost on restart. To persist the changes across region servers modify
hbase.regionserver.compaction.enabled in hbase-site.xml and restart.
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Michael Stack <stack@apache.org>
2018-07-19 06:20:44 -07:00
jack-altiscale
7e599428d3
HBASE-20823. Fix wrong param name in javadoc
...
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-07-19 18:26:18 +08:00
Yu Li
619e0fdab8
HBASE-20907 Fix Intermittent failure on TestProcedurePriority
2018-07-19 12:00:55 +08:00
Michael Stack
2bf5e46a33
HBASE-20875 MemStoreLABImp::copyIntoCell uses 7% CPU when writing
...
Make the #copyCellInto method smaller so it inlines; we do it by
checking for the common type early and then taking a code path
that presumes ByteBufferExtendedCell -- avoids checks.
2018-07-18 20:41:19 -07:00
tedyu
2997b6d071
HBASE-20879 Compacting memstore config should handle lower case
2018-07-13 11:19:45 -07:00
Toshihiro Suzuki
ce82fd0f47
HBASE-19572 RegionMover should use the configured default port number and not the one from HConstants
...
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-07-13 10:44:35 +08:00
Toshihiro Suzuki
3fc23fe930
HBASE-20865 CreateTableProcedure is stuck in retry loop in CREATE_TABLE_WRITE_FS_LAYOUT state
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-12 00:15:26 -07:00
Allan Yang
51527f551b
HBASE-20860 Merged region's RIT state may not be cleaned after master restart
2018-07-12 10:12:07 +08:00
zhangduo
4a08135dd8
HBASE-20847 Addendum use addFront instead of addBack to add sub procedure
2018-07-12 08:31:05 +08:00
zhangduo
a838f7631f
HBASE-20847 The parent procedure of RegionTransitionProcedure may not have the table lock
2018-07-11 17:34:35 +08:00
eshcar
1804b6d059
HBASE-20542-ADDENDUM: fix TestHStore
2018-07-11 11:25:49 +03:00
zhaoyuan
1e0650955a
HBASE-20697 Can't cache All region locations of the specify table by calling table.getRegionLocator().getAllRegionLocations()
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-07-11 10:52:06 +08:00
zhangduo
d7561cee50
HBASE-20784 Will lose the SNAPSHOT suffix if we get the version of RS from ServerManager
2018-07-10 09:59:41 +08:00
Balazs Meszaros
ad5b4af2c4
HBASE-20833 Modify pre-upgrade coprocessor validator to support table level coprocessors
...
- -jar parameter now accepts multiple jar files and directories of jar files.
- observer classes can be verified by -class option.
- -table parameter was added to check table level coprocessors.
- -config parameter was added to obtain the coprocessor classes from
HBase cofiguration.
- -scan option was removed.
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-07-09 11:00:36 -05:00
Abhishek Singh Chouhan
59867eeeeb
HBASE-20806 Split style journal for flushes and compactions
2018-07-09 18:25:34 +05:30
zhangduo
b5222f88b2
HBASE-20822 TestAsyncNonMetaRegionLocator is flakey
2018-07-09 14:56:37 +08:00
Guanghao Zhang
3bca01854a
HBASE-20842 Infinite loop when replaying remote wals
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-07-08 09:35:45 +08:00
Nihal Jain
361be53344
HBASE-20808 (Addendum) Remove duplicate calls for cancelling of chores
...
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-07-07 00:17:10 +08:00
Nihal Jain
1ade4d2f44
HBASE-20808 Wrong shutdown order between Chores and ChoreService
...
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-07-06 11:35:03 +08:00
Yu Li
ec8947f226
HBASE-20691 Change the default WAL storage policy back to "NONE""
...
This reverts commit 564c193d61
and added more doc
about why we choose "NONE" as the default.
2018-07-04 13:43:48 +08:00
Guangxu Cheng
ee3990e42c
HBASE-20474 Show non-RPC tasks on master/regionserver Web UI by default
2018-07-04 10:53:02 +08:00
zhangduo
4366720bd1
HBASE-20839 Fallback to FSHLog if we can not instantiated AsyncFSWAL when user does not specify AsyncFSWAL explicitly
2018-07-04 10:29:24 +08:00
Ted Yu
0f23784182
HBASE-20244 NoSuchMethodException when retrieving private method decryptEncryptedDataEncryptionKey from DFSClient
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-07-03 22:15:18 +08:00
huzheng
0454878e71
HBASE-20789 TestBucketCache#testCacheBlockNextBlockMetadataMissing is flaky
2018-07-03 17:56:34 +08:00
jingyuntian
66ad9fdef8
HBASE-20193 Basic Replication Web UI - Regionserver
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-07-03 15:47:14 +08:00
zhangduo
380350d5bc
HBASE-20829 Remove the addFront assertion in MasterProcedureScheduler.doAdd
2018-07-03 15:43:20 +08:00
Josh Elser
13e4578be8
HBASE-20826 Truncate really long RpcServer warnings unless TRACE is on
...
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Ted Yu <tyu@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2018-07-03 10:14:34 +08:00
Ankit Singhal
cfdabe9267
HBASE-20817 Infinite loop when executing ReopenTableRegionsProcedure
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-07-02 21:26:14 +08:00
eshcar
d822ee3a7c
HBASE-20542: Better heap utilization for IMC with MSLABs
2018-07-01 15:31:31 +03:00
zhangduo
112d050609
HBASE-20829 TestSyncReplicationStandbyKillRS is flakey - add error log for debugging
2018-07-01 18:14:10 +08:00
Ankit Singhal
34e23fe425
HBASE-20825 Fix pre and post hooks of CloneSnapshot and RestoreSnapshot for Access checks
...
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Ted Yu <tyu@apache.org>
2018-06-29 16:33:02 -04:00
Pankaj
bb8826ca5f
HBASE-20357 AccessControlClient API Enhancement
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-06-28 22:48:58 -07:00
Josh Elser
fe75f90be2
HBASE-20792 info:servername and info:sn inconsistent for OPEN region
...
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2018-06-29 11:10:40 +08:00
Xu Cang
78e7dd6537
HBASE-19722 Meta query statistics metrics source
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-06-28 17:17:23 -07:00
zhangduo
0789e15b5e
HBASE-20790 Fix the style issues on branch HBASE-19064 before merging back to master
2018-06-28 18:08:43 +08:00
zhangduo
a84cdbd579
HBASE-20783 Addendum fix broken TestSyncReplicationStandBy
2018-06-28 18:08:43 +08:00
Guanghao Zhang
44ca13fe07
HBASE-20569 NPE in RecoverStandbyProcedure.execute
2018-06-28 18:08:43 +08:00
zhangduo
7448b045cc
HBASE-20660 Reopen regions using ReopenTableRegionsProcedure
2018-06-28 18:08:43 +08:00
zhangduo
05295abd5b
HBASE-20637 Polish the WAL switching when transiting from A to S
2018-06-28 18:08:43 +08:00
zhangduo
f67763ffa0
HBASE-20424 Allow writing WAL to local and remote cluster concurrently
2018-06-28 18:08:43 +08:00
zhangduo
603110719d
HBASE-20576 Check remote WAL directory when creating peer and transiting peer to A
2018-06-28 18:08:43 +08:00
zhangduo
8a264dfc00
HBASE-19865 Add UT for sync replication peer in DA state
2018-06-28 18:08:43 +08:00
zhangduo
ae6c90b4ec
HBASE-20426 Give up replicating anything in S state
2018-06-28 18:08:43 +08:00
huzheng
5b6c0d2777
HBASE-20432 Cleanup related resources when remove a sync replication peer
2018-06-28 18:08:43 +08:00
Guanghao Zhang
1bea678ef8
HBASE-20458 Support removing a WAL from LogRoller
2018-06-28 18:08:43 +08:00
zhangduo
2d203c4479
HBASE-20434 Also remove remote wals when peer is in DA state
2018-06-28 18:08:43 +08:00
zhangduo
b281328228
HBASE-20456 Support removing a ReplicationSourceShipper for a special wal group
2018-06-28 18:08:43 +08:00
huzheng
66cced16dc
HBASE-20425 Do not write the cluster id of the current active cluster when writing remote WAL
2018-06-28 18:08:43 +08:00
huzheng
fe339860b5
HBASE-19782 Reject the replication request when peer is DA or A state
2018-06-28 18:08:43 +08:00
zhangduo
d91784e666
HBASE-20370 Also remove the wal file in remote cluster when we finish replicating a file
2018-06-28 18:08:43 +08:00
Guanghao Zhang
d57c80c415
HBASE-20163 Forbid major compaction when standby cluster replay the remote wals
2018-06-28 18:08:43 +08:00
zhangduo
2389c09d75
HBASE-19079 Support setting up two clusters with A and S stat
2018-06-28 18:08:43 +08:00
Guanghao Zhang
c7d1085fa2
HBASE-19999 Remove the SYNC_REPLICATION_ENABLED flag
2018-06-28 18:07:44 +08:00
Guanghao Zhang
183b8d0581
HBASE-19973 Implement a procedure to replay sync replication wal for standby cluster
2018-06-28 18:07:44 +08:00
huzheng
45794d4156
HBASE-19943 Only allow removing sync replication peer which is in DA state
2018-06-28 18:07:44 +08:00
zhangduo
0c97cda2a9
HBASE-19990 Create remote wal directory when transitting to state S
2018-06-28 18:07:44 +08:00
zhangduo
a41c549ca4
HBASE-19082 Reject read/write from client but accept write from replication in state S
2018-06-28 18:07:44 +08:00
zhangduo
39dd81a7c6
HBASE-19957 General framework to transit sync replication state
2018-06-28 18:07:44 +08:00
Guanghao Zhang
00e54aae24
HBASE-19935 Only allow table replication for sync replication for now
2018-06-28 18:07:44 +08:00
Guanghao Zhang
1481bd9481
HBASE-19864 Use protobuf instead of enum.ordinal to store SyncReplicationState
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-06-28 18:07:44 +08:00
zhangduo
d8842dc3d4
HBASE-19857 Complete the procedure for adding a sync replication peer
2018-06-28 18:07:44 +08:00
Guanghao Zhang
2acebac00e
HBASE-19781 Add a new cluster state flag for synchronous replication
2018-06-28 18:07:44 +08:00
zhangduo
274b813e12
HBASE-19747 Introduce a special WALProvider for synchronous replication
2018-06-28 18:07:44 +08:00
Guanghao Zhang
b4a1dbf768
HBASE-19078 Add a remote peer cluster wal directory config for synchronous replication
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-06-28 18:07:44 +08:00
zhangduo
b3dea0378e
HBASE-19083 Introduce a new log writer which can write to two HDFSes
2018-06-28 18:07:44 +08:00
Michael Stack
c23e61f20d
HBASE-20781 Save recalculating families in a WALEdit batch of Cells
...
Pass the Set of families through to the WAL rather than recalculate
a Set already known.
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-06-27 22:04:57 -07:00
Reid Chan
74e5c776b3
HBASE-20732 Shutdown scan pool when master is stopped
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-06-28 11:42:18 +08:00
tedyu
a8b16ac907
HBASE-20798 Duplicate thread names of StoreFileOpenerThread and StoreFileCloserThread (Zephyr Guo)
2018-06-27 17:21:07 -07:00
Sahil Aggarwal
952bb96c8a
HBASE-19164: Remove UUID.randomUUID in tests.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-06-27 10:34:16 -05:00
jingyuntian
6a0c67344a
HBASE-20194 Basic Replication WebUI - Master
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-06-26 18:26:54 +08:00
Michael Stack
4ba6242a62
HBASE-20780 ServerRpcConnection logging cleanup Get rid of one of the logging lines in ServerRpcConnection by amalgamating all into one new-style log line.
2018-06-25 16:43:11 -07:00
Michael Stack
0db2b628d6
HBASE-20770 WAL cleaner logs way too much; gets clogged when lots of work to do
...
General log cleanup; setting stuff that can flood the log to TRACE.
2018-06-25 12:13:04 -07:00
Todd Lipcon
025ddce868
HBASE-20403. Fix race between prefetch task and non-pread HFile reads
...
With prefetch-on-open enabled, the task doing the prefetching was using
non-positional (i.e. streaming) reads. If the main (non-prefetch) thread
was also using non-positional reads, these two would conflict, because
inputstreams are not thread-safe for non-positional reads.
In the case of an encrypted filesystem, this could cause JVM crashes,
etc, as underlying cipher buffers were freed underneath the racing
threads. In the case of a non-encrypted filesystem, less severe errors
would be thrown. The included unit test reproduces the latter case.
2018-06-25 11:54:52 -07:00
zhangduo
9640ebacd4
HBASE-20777 RpcConnection could still remain opened after we shutdown the NettyRpcServer
2018-06-25 14:15:15 +08:00
Michael Stack
daad14428d
HBASE-20778 Make it so WALPE runs on DFS
2018-06-23 23:33:53 -07:00
zhangduo
55147c7eae
HBASE-20775 Addendum disable REGIONS_ON_MASTER for TEstMultiParallel
2018-06-23 17:38:50 +08:00
zhangduo
14087cc919
HBASE-20775 TestMultiParallel is flakey
2018-06-22 21:32:07 +08:00
zhangduo
177458d9d0
HBASE-18569 Add prefetch support for async region locator
2018-06-22 18:25:31 +08:00
tedyu
98245ca6e4
HBASE-20740 StochasticLoadBalancer should consider CoprocessorService request factor when computing cost (chenxu)
2018-06-22 00:26:14 -07:00
zhangduo
7b716c964b
HBASE-20752 Make sure the regions are truly reopened after ReopenTableRegionsProcedure
2018-06-22 14:04:33 +08:00
zhangduo
0d784efc37
HBASE-20767 Always close hbaseAdmin along with connection in HBTU
2018-06-21 21:01:19 +08:00
Ankit Singhal
72784c2d83
HBASE-20642 Clients should re-use the same nonce across DDL operations
...
Also changes modify table operations to help the case where a MTP spans
two master, avoiding the sanity-checks propagating back to the client
unnecessarily.
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2018-06-20 14:56:10 -07:00
Josh Elser
e989a9927e
HBASE-20706 Prevent MTP from trying to reopen non-OPEN regions
...
ModifyTableProcedure is using MoveRegionProcedure in a way
that was unintended from the original implementation. As such,
we have to guard against certain usages of it. We know we can
re-open OPEN regions, but regions in OPENING will similarly
soon be OPEN (thus, we want to reopen those regions too).
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-06-20 14:19:28 -07:00
zhangduo
4cb70ea9f5
HBASE-20739 Add priority for SCP
2018-06-20 15:17:07 +08:00
zhangduo
c08eff67af
HBASE-20742 Always create WAL directory for region server
2018-06-20 14:21:23 +08:00
Michael Stack
21684a32fa
HBASE-20745 Log when master proc wal rolls
2018-06-19 19:53:51 -07:00
zhangduo
6dbbd78aa0
HBASE-20708 Remove the usage of RecoverMetaProcedure in master startup
2018-06-19 15:02:10 +08:00
Allan Yang
b336da925a
HBASE-20727 Persist FlushedSequenceId to speed up WAL split after cluster restart
2018-06-19 09:45:47 +08:00
Sean Busbey
f1b536bad4
HBASE-20332 shaded mapreduce module shouldn't include hadoop
...
* modify the jar checking script to take args; make hadoop stuff optional
* separate out checking the artifacts that have hadoop vs those that don't.
* * Unfortunately means we need two modules for checking things
* * put in a safety check that the support script for checking jar contents is maintained in both modules
* * have to carve out an exception for o.a.hadoop.metrics2. :(
* fix duplicated class warning
* clean up dependencies in hbase-server and some modules that depend on it.
* allow Hadoop to have its own htrace where it needs it
* add a precommit check to make sure we're not using old htrace imports
2018-06-18 11:31:04 -07:00
tedyu
ac5bb8155b
HBASE-20723 Custom hbase.wal.dir results in data loss because we write recovered edits into a different place than where the recovering region server looks for them
2018-06-15 19:40:48 -07:00
taiynlee
0e43abc78a
HBASE-20737 put collection into ArrayList instead of addAll function
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-06-16 03:25:42 +08:00
Xu Cang
86653c708f
HBASE-20695 Implement table level RegionServer replication metrics
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-06-15 10:38:49 +08:00
jingyuntian
0b28155d27
HBASE-20625 refactor some WALCellCodec related code
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-06-14 19:37:01 +08:00
zhangduo
423a0ab71a
HBASE-20722 Make RegionServerTracker only depend on children changed event
2018-06-14 08:36:37 +08:00
Guanghao Zhang
ec66434380
HBASE-20561 The way we stop a ReplicationSource may cause the RS down
2018-06-13 17:58:59 +08:00
tedyu
edf60b965b
HBASE-20672 Adding new Metrics readRequestRate and writeRequestRate - revert pending discussion
2018-06-11 18:47:30 -07:00
Balazs Meszaros
c323e7bfaa
HBASE-20656 Validate pre-2.0 coprocessors against HBase 2.0+
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-06-11 10:26:58 -05:00
Mike Drob
eb13cdd7ed
HBASE-20707 Move MissingSwitchDefault case check
...
Perform this check using error-prone instead of checkstyle because the
former can handle enum switches somewhat more intelligently.
2018-06-11 09:57:50 -05:00
zhangduo
573b57d437
HBASE-20700 Move meta region when server crash can cause the procedure to be stuck
2018-06-11 14:57:31 +08:00
Guanghao Zhang
cc7aefe0bb
HBASE-20698 (addendum) Master don't record right server version until new started region server call regionServerReport method
2018-06-10 08:23:28 +08:00
Guanghao Zhang
5fd16f3853
HBASE-20698 Master don't record right server version until new started region server call regionServerReport method
2018-06-09 14:40:43 +08:00
Ankit
519236b4af
HBASE-20672 Adding new Metrics readRequestRate and writeRequestRate
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-06-08 13:48:33 -07:00
Nihal Jain
30a052b3e5
HBASE-20699 QuotaCache should cancel the QuotaRefresherChore service inside its stop()
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-06-08 04:30:52 -07:00
Michael Stack
cfeb26d27a
HBASE-20702 Processing crash, skip ONLINE'ing empty rows
...
Signed-off-by: Josh Elser <elserj@apache.org>
2018-06-07 09:54:57 -07:00
eric-maynard
9a80907760
HBASE-20665: Changed log level of HBASE-8547 warning to debug
...
Closes #77
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-06-07 11:34:33 -04:00
Peter Somogyi
cfd4b7d564
HBASE-20683 Incorrect return value for PreUpgradeValidator
...
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-06-06 20:03:56 +02:00
Andrew Purtell
a45763df55
HBASE-20670 NPE in HMaster#isInMaintenanceMode
2018-06-04 15:19:47 -07:00
Michael Stack
d99ba62b12
HBASE-20634 Reopen region while server crash can cause the procedure to be stuck; ADDENDUM
2018-06-04 12:39:39 -07:00
Michael Stack
03c0f7fe13
HBASE-20628 SegmentScanner does over-comparing when one flushing
...
Signed-off-by: eshcar <eshcar@oath.com>
Signed-off-by: anoopsjohn <anoopsamjohn@gmail.com>
2018-06-04 09:50:47 -07:00
zhangduo
a472f24d17
HBASE-20634 Reopen region while server crash can cause the procedure to be stuck
...
A reattempt at fixing HBASE-20173 [AMv2] DisableTableProcedure concurrent to ServerCrashProcedure can deadlock
The scenario is a SCP after processing WALs, goes to assign regions that
were on the crashed server but a concurrent Procedure gets in there
first and tries to unassign a region that was on the crashed server
(could be part of a move procedure or a disable table, etc.). The
unassign happens to run AFTER SCP has released all RPCs that
were going against the crashed server. The unassign fails because the
server is crashed. The unassign used to suspend itself only it would
never be woken up because the server it was going against had already
been processed. Worse, the SCP could not make progress because the
unassign was suspended with the lock on a region that it wanted to
assign held making it so it could make no progress.
In here, we add to the unassign recognition of the state where it is
running post SCP cleanup of RPCs. If present, unassign moves to finish
instead of suspending itself.
Includes a nice unit test made by Duo Zhang that reproduces nicely the
hung scenario.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/FailedRemoteDispatchException.java
Moved this class back to hbase-procedure where it belongs.
M hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/NoNodeDispatchException.java
M hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/NoServerDispatchException.java
M hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/NullTargetServerDispatchException.java
Specializiations on FRDE so we can be more particular when we say there
was a problem.
M hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/RemoteProcedureDispatcher.java
Change addOperationToNode so we throw exceptions that give more detail
on issue rather than a mysterious true/false
M hbase-protocol-shaded/src/main/protobuf/MasterProcedure.proto
Undo SERVER_CRASH_HANDLE_RIT2. Bad idea (from HBASE-20173)
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
Have expireServer return true if it actually queued an expiration. Used
later in this patch.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
Hide methods that shouldn't be public. Add a particular check used out
in unassign procedure failure processing.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/MoveRegionProcedure.java
Check that server we're to move from is actually online (might
catch a few silly move requests early).
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/RegionStates.java
Add doc on ServerState. Wasn't being used really. Now we actually stamp
a Server OFFLINE after its WAL has been split. Means its safe to assign
since all WALs have been processed. Add methods to update SPLITTING
and to set it to OFFLINE after splitting done.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/RegionTransitionProcedure.java
Change logging to be new-style and less repetitive of info.
Cater to new way in which .addOperationToNode returns info (exceptions
rather than true/false).
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/UnassignProcedure.java
Add looking for the case where we failed assign AND we should not
suspend because we will never be woken up because SCP is beyond
doing this for all stuck RPCs.
Some cleanup of the failure processing grouping where we can proceed.
TODOs have been handled in this refactor including the TODO that
wonders if it possible that there are concurrent fails coming in
(Yes).
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/ServerCrashProcedure.java
Doc and removing the old HBASE-20173 'fix'.
Also updating ServerStateNode post WAL splitting so it gets marked
OFFLINE.
A hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestServerCrashProcedureStuck.java
Nice test by Duo Zhang.
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Duo Zhang <palomino219@gmail.com>
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-06-04 09:26:56 -07:00
maoling
1b98a96caa
HBASE-19761:Fix Checkstyle errors in hbase-zookeeper
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2018-06-02 10:08:15 +02:00
Andrew Purtell
9d5004894c
HBASE-20667 Rename TestGlobalThrottler to TestReplicationGlobalThrottler
2018-06-01 17:01:16 -07:00
Xu Cang
a11701ecc5
HBASE-18116 Replication source in-memory accounting should not include bulk transfer hfiles
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-06-01 11:15:47 -07:00
Peter Somogyi
0968668283
HBASE-20592 Create a tool to verify tables do not have prefix tree encoding
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-06-01 19:17:49 +02:00
Andrew Purtell
da3ecf1f13
Revert "HBASE-18116 fix replication source in-memory calculation by excluding bulk load file"
...
This reverts commit 6f3f34227e
.
2018-05-31 15:28:28 -07:00
Xu Cang
6f3f34227e
HBASE-18116 fix replication source in-memory calculation by excluding bulk load file
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-05-31 14:22:12 -07:00
Sean Busbey
d909ec55aa
HBASE-20444 Addendum keep folks from looking at raw version component array.
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-05-31 13:29:52 -05:00
Nihal Jain
40a73a5ca7
HBASE-20653 Add missing observer hooks for region server group to MasterObserver
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-05-30 21:29:07 -07:00
Andrew Purtell
b889c8a221
HBASE-20646 TestWALProcedureStoreOnHDFS failing on branch-1
2018-05-30 14:44:30 -07:00
Andrew Purtell
31ae8dc7f3
Revert "TestWALProcedureStoreOnHDFS failing on branch-1"
...
This reverts commit dcfa01448c
.
2018-05-30 14:44:22 -07:00
Andrew Purtell
dcfa01448c
TestWALProcedureStoreOnHDFS failing on branch-1
2018-05-30 13:45:38 -07:00
zhangduo
997747076d
HBASE-20659 Implement a reopen table regions procedure
2018-05-30 20:03:25 +08:00
tedyu
266b251dfa
HBASE-20639 Implement permission checking through AccessController instead of RSGroupAdminEndpoint - revert due to pending discussion
2018-05-29 19:57:51 -07:00
tedyu
fe73fe8def
HBASE-20653 Add missing observer hooks for region server group to MasterObserver - revert due to pending discussion
2018-05-29 19:42:28 -07:00
Nihal Jain
8d19bbd347
HBASE-20653 Add missing observer hooks for region server group to MasterObserver
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-05-29 16:37:19 -07:00
Andrew Purtell
06611256ee
HBASE-20597 Serialize access to a shared reference to ZooKeeperWatcher in HBaseReplicationEndpoint
2018-05-29 11:29:05 -07:00
Andrew Purtell
807c905f90
Revert "HBASE-20597 Use a lock to serialize access to a shared reference to ZooKeeperWatcher in HBaseReplicationEndpoint"
...
This reverts commit 9fbce1668b
.
2018-05-29 11:24:11 -07:00
Nihal Jain
7ff29d8e00
HBASE-20633 Dropping a table containing a disable violation policy fails to remove the quota upon table delete
...
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2018-05-29 11:33:56 -04:00
Mike Drob
a110e1eff5
HBASE-20478 Update checkstyle to v8.2
...
Cannot go to latest (8.9) yet due to
https://github.com/checkstyle/checkstyle/issues/5279
* move hbaseanti import checks to checkstyle
* implment a few missing equals checks, and ignore one
* fix lots of javadoc errors
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-05-29 10:12:31 -05:00
eshcar
42be553433
HBASE-20390 ADDENDUM 2: fix TestHRegionWithInMemoryFlush OOME
2018-05-29 16:27:20 +03:00
Apekshit Sharma
05f57f4c03
HBASE-20652 Remove internal uses of some deprecated MasterObserver hooks
...
Remove internal uses of these hooks:
preModifyNamespace
postModifyNamespace
preModifyTable
postModifyTable
preModifyTableAction
postCompletedModifyTableAction
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-05-28 21:10:52 -07:00
huzheng
81228f72d0
HBASE-20533 Fix the flaky TestAssignmentManagerMetrics
2018-05-29 09:38:47 +08:00
eshcar
1cd2b56802
HBASE-20390-ADDENDUM: fix TestHRegionWithInMemoryFlush OOME
2018-05-28 16:10:53 +03:00
Nihal Jain
9bd4b04ca8
HBASE-20639 Implement permission checking through AccessController instead of RSGroupAdminEndpoint
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-05-27 11:29:26 -07:00
eshcar
1eabbb4295
HBASE-20390: IMC Default Parameters for 2.0.0
2018-05-26 22:57:28 +03:00
Toshihiro Suzuki
b1089e8310
HBASE-20648 HBASE-19364 "Truncate_preserve fails with table when replica region > 1" for master branch
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-05-25 07:52:40 -07:00
meiyi
36f3d9432a
HBASE-20518 Need to serialize the enabled field for UpdatePeerConfigProcedure
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-05-25 14:36:16 +08:00
Thiruvel Thirumoolan
1fbce10ff4
HBASE-20548 Master fails to startup on large clusters, refreshing block distribution
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-05-24 15:47:24 -07:00
Toshihiro Suzuki
554d513f50
HBASE-20616 TruncateTableProcedure is stuck in retry loop in TRUNCATE_TABLE_CREATE_FS_LAYOUT state
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-05-24 15:16:30 -07:00
Nihal Jain
09dac89908
HBASE-20588 Space quota change after quota violation doesn't seem to take in effect
...
Signed-off-by: Josh Elser <elserj@apache.org>
2018-05-24 12:40:55 -04:00
Guanghao Zhang
320a3332e0
HBASE-20589 Don't need to assign meta to a new RS when standby master become active
2018-05-24 11:26:48 +08:00
zhangduo
ee540c9f9e
HBASE-20624 Race in ReplicationSource which causes walEntryFilter being null when creating new shipper
2018-05-24 10:48:29 +08:00
Andrew Purtell
9fbce1668b
HBASE-20597 Use a lock to serialize access to a shared reference to ZooKeeperWatcher in HBaseReplicationEndpoint
2018-05-23 16:46:22 -07:00
Michael Stack
079f168c5c
HBASE-20620 HBASE-20564 Tighter ByteBufferKeyValue Cell Comparator; part 2
...
Adds new stripped-down, faster ByteBufferKeyValue comparator
(BBKV is the base Cell-type in hbase2). Creates an instance
of new Comparator each time we create new memstore rather
than use the universal CellComparator.
Remove unused and unneeded Interfaces from Cell base type.
2018-05-23 13:20:47 -07:00
huzheng
5721150c6d
HBASE-20612 TestReplicationKillSlaveRSWithSeparateOldWALs sometimes fail because it uses an expired cluster conn
2018-05-23 12:07:01 +08:00
tedyu
6c1097e92f
HBASE-20609 SnapshotHFileCleaner#init should check that params is not null
2018-05-21 18:36:38 -07:00
jingyuntian
c9f8c3436f
HBASE-20579 Improve snapshot manifest copy in ExportSnapshot
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-05-18 06:42:12 -07:00
Guanghao Zhang
0836b0719a
HBASE-20583 SplitLogWorker should handle FileNotFoundException when split a wal
2018-05-18 14:29:41 +08:00
Balazs Meszaros
6148b4785d
HBASE-20571 JMXJsonServlet generates invalid JSON if it has NaN in metrics
...
- CacheStats won't generate NaN metrics.
- JSONBean class will serialize special floating point values as
"NaN", "Infinity" or "-Infinity"
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-05-16 12:20:39 -07:00
Apekshit Sharma
8c9825a030
HBASE-20567 Pass both old and new descriptors to pre/post hooks of modify operations for table and namespace.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-05-16 14:03:18 -05:00
Michael Stack
438af9bf74
HBASE-20564 Tighter ByteBufferKeyValue Cell Comparator; ADDENDUM
...
Add method the CellComparator Interface. Add implementation to
meta comparator so we don't fall back to the default comparator.
Includes a nothing change to hbase-server/pom.xml just to provoke
build.
2018-05-16 09:43:16 -07:00
Michael Stack
060b8aca86
HBASE-20520 Failed effort upping default HDFS blocksize, hbase.regionserver.hlog.blocksize
2018-05-16 09:19:24 -07:00
zhangduo
ab53329cb3
HBASE-20585 Need to clear peer map when clearing MasterProcedureScheduler
2018-05-16 08:46:29 +08:00
zhangduo
26babcf013
HBASE-20457 Return immediately for a scan rpc call when we want to switch from pread to stream
2018-05-15 20:56:20 +08:00
Zach York
d2daada970
HBASE-20447 Only fail cacheBlock if block collisions aren't related to next block metadata
...
When we pread, we don't force the read to read all of the next block header.
However, when we get into a race condition where two opener threads try to
cache the same block and one thread read all of the next block header and
the other one didn't, it will fail the open process. This is especially important
in a splitting case where it will potentially fail the split process.
Instead, in the caches, we should only fail if the required blocks are different.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-05-14 17:16:54 -07:00
huzheng
eabe672ebd
HBASE-20560 Revisit the TestReplicationDroppedTables ut
2018-05-14 19:12:43 +08:00
Michael Stack
021f66d11d
HBASE-20411 Ameliorate MutableSegment synchronize
...
Change the MemStore size accounting so we don't synchronize across three
volatiles applying deltas. Instead:
+ Make MemStoreSize, a datastructure of our memstore size longs, immutable.
+ Undo MemStoreSizing being an instance of MemStoreSize; instead it has-a.
+ Make two MemStoreSizing implementations; one thread-safe, the other not.
+ Let all memory sizing longs run independent, untied by
synchronize (Huaxiang and Anoop suggestion) using atomiclongs.
+ Review all use of MemStoreSizing. Many are single-threaded and do
not need to be synchronized; use the non-thread safe counter.
TODO: Use this technique accounting at the global level too.
2018-05-12 02:17:50 +01:00
Sean Busbey
8ba2a7eeb9
HBASE-20544 Make HBTU default to random ports.
...
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Josh Elser <elserj@apache.org>
2018-05-09 23:35:20 -07:00
Thiruvel Thirumoolan
a67909d3d6
HBASE-20545 Improve performance of BaseLoadBalancer.retainAssignment
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-05-09 19:48:27 -07:00
Andrew Purtell
32dd633b98
HBASE-20554 "WALs outstanding" message from CleanerChore is noisy
2018-05-09 19:08:35 -07:00
Zach York
9c046c091c
HBASE-20204 Add locking to RefreshFileConnections in BucketCache
...
This is a follow-up to HBASE-20141 where Anoop suggested adding locking
for refreshing channels.
2018-05-09 14:01:51 -07:00
Michael Stack
4f2dfd3877
HBASE-20539 Disable IMC; part 2
...
Set default for in-memory compaction to NONE. PE was using
this value creating its table. Add test to ensure expected
default.
2018-05-09 06:30:28 -07:00
Nihal Jain
f8281aa208
HBASE-20485 Copy constructor of Scan doesn't copy the readType and replicaId
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-05-09 16:39:57 +08:00
Guanghao Zhang
3a2a76f6f8
HBASE-20536 Make TestRegionServerAccounting stable and it should not use absolute number
2018-05-08 08:20:48 +08:00
Michael Stack
bb1a935636
HBASE-20538 TestSaslFanOutOneBlockAsyncDFSOutput failing: UnrecoverableKeyException: Rejected by the jceks.key.serialFilter or jdk.serialFilter property
...
Disable test TestSaslFanOutOneBlockAsyncDFSOutput for the moment.
Depends on HDFS-13494
2018-05-07 09:54:32 -07:00
huzheng
971f5350e8
HBASE-20531 RS may throw NPE when close meta regions in shutdown procedure.
2018-05-06 11:18:23 +08:00
jingyuntian
87f5b5f341
HBASE-20378 Provide a hbck option to cleanup replication barrier for a table
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-05-04 15:27:33 +08:00
huzheng
6225b4a492
HBASE-20481 Replicate entries from same region serially in ReplicationEndpoint for serial replication
2018-05-04 15:22:02 +08:00
Guanghao Zhang
9b9f851470
HBASE-20524 Need to clear metrics when ReplicationSourceManager refresh replication sources
2018-05-04 14:31:41 +08:00
Michael Stack
09ca619389
HBASE-20507 Do not need to call recoverLease on the broken file when we fail to create a wal writer
2018-05-03 12:30:13 -07:00
Chia-Ping Tsai
4cb444e77b
HBASE-20169 NPE when calling HBTU.shutdownMiniCluster (TestAssignmentManagerMetrics is flakey); AMENDMENT
2018-05-02 16:14:58 -07:00
Umesh Agashe
c4b4023b60
HBASE-20514 On Master restart if table is stuck in DISABLING state, CLOSED regions should not be considered stuck in-transition
...
On startup CLOSED regions of DISABLED and DISABLING tables are treated the same way as not in-transition.
2018-05-02 12:18:24 -07:00
tedyu
2e9b96e4f1
HBASE-20414 TestLockProcedure#testMultipleLocks may fail on slow machine
2018-05-02 06:39:51 -07:00
zhangduo
5bdb52af2f
HBASE-20507 Do not need to call recoverLease on the broken file when we fail to create a wal writer
2018-05-02 10:26:55 +08:00
Michael Stack
5a071dbe2b
HBASE-20492 UnassignProcedure is stuck in retry loop on region stuck in OPENING state
...
Add backoff when stuck in RegionTransitionProcedure, the subclass of
AssignProcedure and UnassignProcedure. Can happen when we go to
transition but the current Region state is not what we expect.
M hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/Procedure.java
Add doc on being able to suspend and wait on a timeout.
M hbase-protocol-shaded/src/main/protobuf/MasterProcedure.proto
Add 'attempt' counter so we can do backoff when we get stuck.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignProcedure.java
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/UnassignProcedure.java
Add persistence of new 'attempt' counter
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/RegionTransitionProcedure.java
Doc data members that are persisted by subclasses given this is 'odd'.
Add a counter for 'attempts' used when 'stuck' to implement backoff.
Add suspend with timeout when 'stuck'. Add callback when timeout is
exhausted which does wakeup of this procedure.
A hbase-server/src/test/java/org/apache/hadoop/hbase/master/assignment/TestUnexpectedStateException.java
Test of backoff.
2018-04-30 20:40:22 -07:00
Nihal Jain
6d080762ef
HBASE-20499 Replication/Priority executors can use specific max queue length as default value instead of general maxQueueLength
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-04-30 07:42:32 -07:00
huzheng
a136303833
HBASE-20497 The getRecoveredQueueStartPos always return 0 in RecoveredReplicationSourceShipper
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-04-28 20:50:30 +08:00
zhangduo
4be96dd8a6
HBASE-20476 Open sequence number could go backwards in AssignProcedure
2018-04-28 06:49:50 +08:00
Balazs Meszaros
650340abb5
HBASE-20487 Sorting table regions by region name does not work on web UI
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-04-27 11:13:00 -07:00
huzheng
e9a278adc6
HBASE-20475 Fix the flaky TestReplicationDroppedTables unit test - addendum
2018-04-27 21:38:15 +08:00
zhangduo
39cf42be9a
HBASE-20476 Add more logs for debugging
2018-04-27 16:02:05 +08:00
zhangduo
96ed407c69
HBASE-20476 Fix the flaky TestReplicationSmallTests unit test
2018-04-27 10:25:52 +08:00
Sakthi
f761689136
HBASE-20040 Fixed: Master UI should include "Cluster Key" needed to use the cluster as a replication sink
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-04-26 06:43:55 -05:00
huzheng
12c45cb2e8
HBASE-20475 Fix the flaky TestReplicationDroppedTables unit test.
2018-04-25 11:21:59 +08:00
Rich Fecher
a8be3bb814
HBASE-20466 Consistently use override mechanism for exempt classes in CoprocessorClassloader
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-04-23 07:47:30 -07:00
Michael Stack
1633d9d61d
HBASE-20470 [2.0.0RC1] has broken unit tests...
...
Fix test that depended upon flush being slow and one family only.
Fix MemStoreSize compare to allow passing alternate implementation
(needed when IMC was no longer default everywhere).
2018-04-22 15:33:25 -07:00
Huaxiang Sun
e22f9e2d97
HBASE-19924 hbase rpc throttling does not work for multi() with request count rater.
2018-04-20 16:54:03 -07:00
Nihal Jain
758f4296a4
HBASE-20450 Provide metrics for number of total active, priority and replication rpc handlers
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-04-20 16:24:32 -07:00
Toshihiro Suzuki
4e183748c7
HBASE-20006 TestRestoreSnapshotFromClientWithRegionReplicas is flakey
...
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-04-20 10:51:11 -05:00
Sean Busbey
914de11416
HBASE-20442 clean up incorrect use of commons-collections 3
...
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Yu Li <liyu@apache.org>
2018-04-20 07:30:34 -05:00
Sean Busbey
09749f1574
HBASE-20440 Clean up incorrect use of commons-lang 2.y
...
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Yu Li <liyu@apache.org>
2018-04-20 07:29:23 -05:00
Sean Busbey
b1fc00e16f
HBASE-20439 Clean up incorrect use of commons-logging in hbase-server
...
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Yu Li <liyu@apache.org>
2018-04-20 07:27:18 -05:00
jingyuntian
556b223744
HBASE-18059 remove scanner order related code
2018-04-18 19:38:08 -07:00
Umesh Agashe
6ca8261fc0
HBASE-18792 Disabled destructive (mostly write) operations in hbck for HBase 2.0+
...
HBase server versioned is checked after connecting to the server and then following operations are not allowed:
-fix, -fixAssignments, -fixMeta, -fixHdfsHoles, -fixHdfsOrphans, -fixTableOrphans, -fixHdfsOverlaps, -maxMerge
-sidelineBigOverlaps, -maxOverlapsToSideline, -fixSplitParents, -removeParents, -fixEmptyMetaCells
-repair, -repairHoles
2018-04-18 15:22:39 -07:00
Nihal Jain
6ce1136eba
HBASE-20452 Master UI: Table merge button should validate required fields before submit
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-04-18 14:55:12 -07:00
wangyu
80cbc0d1fe
HBASE-20449 The minimun number of region should be configurable in Normalizer
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-04-18 08:45:52 -07:00
Sean Busbey
824ee525df
HBASE-20404 Fixes to CleanChore correctness and operability.
...
* Make CleanerChore less chatty: move WARN message to DEBUG when we expect non-empty dirs
* Make CleanerChore less chatty: move IOE we'll retry to INFO
* CleanerChore should treat IOE for FileStatus as a failure
* Add tests asserting assumptions in above
Signed-off-by: Reid Chan <reidddchan@outlook.com>
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-04-17 11:32:44 -05:00
Balazs Meszaros
b926d359b2
HBASE-20398 Redirect doesn't work on web UI
2018-04-17 09:18:52 -07:00
Balazs Meszaros
32764bfb2c
HBASE-20399 Fix merge layout
2018-04-17 09:17:25 -07:00
huzheng
42d5447cfb
HBASE-20128 Add new UTs which extends the old replication UTs but set replication scope to SERIAL
2018-04-17 10:56:21 +08:00
Huaxiang Sun
1fe3d6a0e9
HBASE-19994 Create a new class for RPC throttling exception, make it retryable
2018-04-16 17:27:14 -07:00
Wei-Chiu Chuang
44ebd28093
HBASE-19963 TestFSHDFSUtils assumes wrong default port for Hadoop 3.0.1+
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-04-16 12:00:17 -05:00
zhangduo
773aff90fd
HBASE-20417 Do not read wal entries when peer is disabled
2018-04-16 22:07:33 +08:00
lujie
1339ff9666
HBASE-20419 Fix potential NPE in ZKUtil#listChildrenAndWatchForNewChildren callers
...
Signed-off-by: Yu Li <liyu@apache.org>
2018-04-16 16:06:57 +08:00
Peter Somogyi
125767b44e
HBASE-20409 Set hbase.client.meta.operation.timeout in TestClientOperationTimeout
...
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
2018-04-15 10:12:00 +02:00
zhangduo
edf5049502
HBASE-20294 Also cleanup last pushed sequence id in ReplicationBarrierCleaner
2018-04-14 14:56:18 +08:00
zhangduo
5a633adffe
HBASE-20377 Deal with table in enabling and disabling state when modifying serial replication peer
2018-04-13 20:33:29 +08:00
Guangxu Cheng
5a69465ea0
HBASE-20243 [Shell] Add shell command to create a new table by cloning the existent table
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-04-11 19:33:56 -07:00
Apekshit Sharma
281c29ff60
HBASE-20350 NullPointerException in Scanner during close()
2018-04-11 14:34:57 -07:00
Umesh Agashe
199b392ec8
HBASE-20310 Fixed false inconsistency shown by hbck -metaonly option on HBase 2
...
When -metaonly option is specified then tablesInfo is not populated for all tables from hdfs causing false inconsistency of dangling state in meta.
2018-04-11 12:51:12 -07:00
Toshihiro Suzuki
072c503ec7
HBASE-20219 An error occurs when scanning with reversed=true and loadColumnFamiliesOnDemand=true
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-04-11 09:59:45 -07:00
Balazs Meszaros
35b4adf3ed
HBASE-20382 If RSGroups not enabled, rsgroup.jsp prints stack trace
2018-04-11 09:50:07 -07:00
Michael Stack
ba02a8664b
HBASE-20384 [AMv2] Logging format improvements; use encoded name rather than full region name marking transitions
2018-04-11 08:35:54 -07:00
zhangduo
37e5b0b1b7
HBASE-20367 Write a replication barrier for regions when disabling a table
2018-04-11 20:36:51 +08:00
Ashish Singhi
828a1c76c7
HBASE-15291 FileSystem not closed in secure bulkLoad
...
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
2018-04-11 12:01:28 +05:30
zhangduo
bc35de597d
HBASE-20363 Addendum wait until region is splittable
2018-04-09 09:07:06 +08:00
zhangduo
f66343050f
HBASE-20363 TestNamespaceAuditor.testRegionMerge is flaky
2018-04-08 16:48:25 +08:00
zhangduo
852025dd00
HBASE-20362 TestMasterShutdown.testMasterShutdownBeforeStartingAnyRegionServer is flaky
2018-04-08 16:09:50 +08:00
zhangduo
adc0e85e85
HBASE-20182 Can not locate region after split and merge
2018-04-07 13:37:53 +08:00
tedyu
8f6849ff02
HBASE-20095 Redesign single instance pool in CleanerChore - addendum simplifies onConfigurationChange
2018-04-05 10:24:37 -07:00
BELUGA BEHR
d866e7c658
HBASE-19488 Move to using Apache commons CollectionUtils
...
Signed-off-by: Apekshit Sharma <appy@apache.org>
2018-04-04 14:12:19 -07:00
Ashish Singhi
5937202fd5
HBASE-16499 slow replication for small HBase clusters
...
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
2018-04-04 09:54:41 +05:30
Michael Stack
b1b0db3195
HBASE-20298 Doc change in read/write/total accounting metrics
2018-04-03 17:00:43 -07:00
Michael Stack
c88ca54c16
HBASE-20259 Doc configs for in-memory-compaction and add detail to
...
in-memory-compaction logging
Adds logging of CompactingMemStore configuration on construction.
Add logging of detail about Store on creation including memstore type.
Add chapter to refguide on new in-memory compaction feature.
2018-04-02 09:53:12 -07:00
zhangduo
1e56938757
HBASE-20296 Remove last pushed sequence ids when removing tables from a peer
2018-04-01 21:14:31 +08:00
Jan Hentschel
97b3a04019
HBASE-17631 Changed Canary interval to 60 seconds
2018-04-01 13:03:52 +02:00
Mike Drob
d57001ee2d
HBASE-20282 Clean up tooling docs/help
2018-03-30 08:59:47 -07:00
tedyu
e60f34fdb5
HBASE-20159 Support using separate ZK quorums for client - addendum fixes flaky TestSeparateClientZKCluster
2018-03-30 07:19:47 -07:00