Michael Stack
aadd2bb1a1
HBASE-24574 Procedure V2 - Distributed WAL Splitting => LOGGING ( #1912 )
...
hbase-server/src/main/java/org/apache/hadoop/hbase/master/SplitLogManager.java
Don't register as a chore on construction if no coordination state
manager instance (there is no instance when procv2 WAL splitter).
hbase-server/src/main/java/org/apache/hadoop/hbase/master/SplitWALManager.java
hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
Edit logs.
hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/RegionRemoteProcedureBase.java
hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/RegionTransitionProcedure.java
hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/ServerCrashProcedure.java
hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/SplitWALProcedure.java
hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/SplitWALRemoteProcedure.java
Add proc name rather than rely on default behavior. Add detail to the
toString.
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
Factoring
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/AbstractFSWAL.java
Print the maxLogs... we don't do it any where.
hbase-server/src/main/java/org/apache/hadoop/hbase/wal/WAL.java
Utility method to strip prefix from wal path.
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: tianjingyun <tianjy@apache.org>
2020-06-18 08:38:59 -07:00
BukrosSzabolcs
bd79c4065c
HBASE-24579: Failed SASL authentication does not result in an exception on client side ( #1921 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-18 12:25:43 +01:00
WenFeiYi
f73480febf
HBASE-24550 Passing '-h' or '--help' to bin/hbase doesn't do as expected
...
Closes #1914
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-18 15:42:57 +05:30
Michael Stack
6a576696dc
HBASE-24577 Doc WALSplitter classes ( #1913 )
...
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-06-17 15:03:33 -07:00
Viraj Jasani
192daded61
HBASE-24518 : waitForNamespaceOnline() should return false if any region is offline ( #1869 )
...
Signed-off-by: ramkrish86 <ramkrishna@apache.org>
2020-06-17 19:44:36 +05:30
ramkrish86
b17ba7b81d
HBASE-24205 - Avoid metric collection for flushes and compactions ( #1918 )
...
* HBASE-24205 - Avoid metric collection for flushes and compactions
* Use the existing matcher.isUserScan() to decide the scan type
* Added a comment saying when we track the metrics
2020-06-17 16:47:21 +05:30
ramkrish86
510aad3125
HBASE-24205 Create metric to know the number of reads that happens fr… ( #1552 )
...
* HBASE-24205 Create metric to know the number of reads that happens from memstore
* Fix checkstyles and whitespaces
* Checkstyl, whitespace and javadoc
* Fixed review comments
* Fix unused imports
* Rebase with latest commit
* Adding the table vs store metric by consolidating
* Combine get and scan metrics and make all relevant changes
* Track for full row and then increment either memstore or file read
metric
* TestMetricsStore test fix
* Only increment the memstore metric if all cells are from memstore, if
not treat as mixed reads
* Remove metricsstore and aggregate at region level
* Addresses review comments-metric name updated everywhere
* Metric name change
* Review comment changes
Co-authored-by: Ramkrishna <ramkrishna@apache.org>
Signed-off by:Anoop Sam John<anoopsamjohn@gmail.com>
Signed-off by:Viraj Jasani<virajjasani@apache.org>
2020-06-16 18:30:20 +05:30
xincunSong
3558ee0c3b
HBASE-24478 The regionInfo parameter for MasterProcedureScheduler#wai… ( #1819 )
...
Signed-off-by: Guangxu Cheng <gxcheng@apache.org>
Signed-off-by: clarax <clarax98007@gmail.com>
2020-06-16 17:34:07 +08:00
Wellington Ramos Chevreuil
3ac99ad192
HBASE-21405 [DOC] Add Details about Output of "status 'replication'" ( #1894 )
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-16 10:02:29 +01:00
Sandeep Pal
db4d539190
HBASE-24015: Test for Assign and Unassign of Regions on RegionServer on failure ( #1898 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-16 12:47:52 +05:30
Bharath Vissapragada
2567d15218
HBASE-24564: Make RS abort call idempotent.
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-06-15 22:45:35 -07:00
Viraj Jasani
2ecbaf130e
HBASE-24547 : Thrift support for HBASE-23941 (Operator support for get_slowlog_responses API) ( #1892 )
...
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-06-15 14:14:28 +05:30
Duo Zhang
d0f190bdf0
HBASE-24517 Addendum add more comments ( #1882 )
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-15 10:43:57 +08:00
bsglz
b83d38fb94
HBASE-24038 Add a metric to show the locality of ssd in table.jsp ( #1337 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-14 22:46:18 +05:30
Toshihiro Suzuki
d6e9c3164d
HBASE-8458 Support for batch version of checkAndMutate() (addendum) ( #1899 )
2020-06-14 19:27:00 +09:00
Bharath Vissapragada
fd5002d0da
HBASE-24535: Tweak the master registry docs for branch-2 ( #1890 )
...
Updated to include changes in HBASE-24265 and some rewording
to make it version agnostic.
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2020-06-12 14:59:04 -07:00
zhaoym6
21fe873eba
HBASE-23195 FSDataInputStreamWrapper unbuffer can NOT invoke the classes that NOT implements CanUnbuffer but its parents class implements CanUnbuffer
...
Closes #746
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2020-06-12 13:01:02 -04:00
Michael Stack
9fbf1f30c9
HBASE-24545 Add backoff to SCP check on WAL split completion ( #1891 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-06-12 07:58:34 -07:00
sguggilam
1dac9f69c4
HBASE-24446 Use EnvironmentEdgeManager to compute clock skew in Master ( #1885 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-12 16:17:59 +05:30
Toshihiro Suzuki
6b7a93d10c
HBASE-24529 hbase.rs.evictblocksonclose is not honored when removing compacted files and closing the storefiles ( #1881 )
...
Signed-off-by: Anoop Sam John <anoop.hbase@gmail.com>
2020-06-12 18:59:03 +09:00
Nick Dimiduk
42a82df3af
HBASE-24534 Delete reference off to Hadoop wiki's HBase FAQ
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-06-11 14:20:16 -07:00
Anoop Sam John
4005e42a62
HBASE-24189 WALSplit recreates region dirs for deleted table with recovered edits data.
2020-06-11 21:27:21 +05:30
Viraj Jasani
9b2f961132
HBASE-24532 : Execute region plans with throttle should return succeeded plans ( #1884 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2020-06-11 18:17:59 +05:30
Toshihiro Suzuki
efd5a962e5
HBASE-8458 Support for batch version of checkAndMutate()
...
Closes #1648
Signed-off-by: Josh Elser <elserj@apache.org>
2020-06-10 22:34:36 -04:00
Wellington Ramos Chevreuil
d8247ebae3
HBASE-24524 SyncTable logging improvements ( #1878 )
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-10 09:36:30 +01:00
sguggilam
1eb159b455
HBASE-24511 Ability to configure timeout between RPC retry to RS from master ( #1861 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-10 12:53:08 +05:30
Vico.Wu
7b396e9b8c
HBASE-24403 FsDelegationToken Should Cache Token After Acquired A New One ( #1743 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2020-06-10 08:46:58 +08:00
Nick Dimiduk
9ef17c2784
HBASE-24005 Document maven invocation with JDK11
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2020-06-09 15:34:02 -07:00
Andrew Purtell
474d200daa
HBASE-24367 ScheduledChore log elapsed timespan in a human-friendly format ( #1749 )
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-09 09:55:20 -07:00
xincunSong
15ddded26b
HBASE-24441 CacheConfig details logged at Store open is not really u… ( #1801 )
...
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: binlijin <binlijin@gmail.com>
2020-06-09 14:18:21 +08:00
xincunSong
eee06c2d7e
HBASE-24468 Add region info when log meessages in HStore. ( #1803 )
...
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: binlijin <binlijin@gmail.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-09 14:12:44 +08:00
Sambit Mohapatra
c718fa2365
HBASE-24340 PerformanceEvaluation options should not mandate any specific order
...
Signed-off-by Anoop Sam John <anoopsamjohn@apache.org>
2020-06-09 11:32:39 +05:30
Duo Zhang
3d50e73871
HBASE-24117 Shutdown AssignmentManager before ProcedureExecutor may cause SCP to accidentally skip assigning a region ( #1865 )
...
Signed-off-by: Michael Stack <stack@apache.org>
2020-06-09 11:07:16 +08:00
WenFeiYi
2131456e54
HBASE-24444 Should shutdown mini cluster after class in TestMetaAssignmentWithStopMaster ( #1802 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-06-09 08:16:20 +08:00
Guanghao Zhang
a4aa5384f1
Revert "HBASE-24444 Should shutdown mini cluster after class in TestMetaAssignmentWithStopMaster ( #1802 )"
...
This reverts commit 3b3bba1b64
.
2020-06-09 08:15:51 +08:00
WenFeiYi
3b3bba1b64
HBASE-24444 Should shutdown mini cluster after class in TestMetaAssignmentWithStopMaster ( #1802 )
...
* shutdown mini cluster after class
* fix
Co-authored-by: wen_yi <liu.wenwen@immomo.com>
2020-06-09 08:14:18 +08:00
Duo Zhang
2dd34b3f01
HBASE-24517 AssignmentManager.start should add meta region to ServerStateNode ( #1866 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
2020-06-09 08:14:00 +08:00
huaxiangsun
71fae116c3
HBASE-23202 ExportSnapshot (import) will fail if copying files to root directory takes longer than cleaner TTL ( #1874 )
...
Co-authored-by: Guangxu Cheng <guangxucheng@gmail.com>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Zach York <zyork@apache.org>
2020-06-08 14:57:48 -07:00
huaxiangsun
5042b591f8
Revert "HBASE-23202 ExportSnapshot (import) will fail if copying files to root directory takes longer than cleaner TTL ( #1791 )" ( #1873 )
...
This reverts commit f862f3d9b5
.
2020-06-08 14:51:59 -07:00
huaxiangsun
f862f3d9b5
HBASE-23202 ExportSnapshot (import) will fail if copying files to root directory takes longer than cleaner TTL ( #1791 )
...
Co-authored-by: Huaxiang Sun <huaxiangsun@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Zach York <zyork@apache.org>
2020-06-08 14:48:21 -07:00
stack
05ed4cd133
HBASE-24493 [flakey test] TestExportSnapshot family of tests failing due to timeout in AbstractDelegationTokenSecretManager$ExpiredTokenRemover
...
Disable TestExportSnapshot* tests because they timeout on occasion
staring yarn jobhistoryserver.
2020-06-08 14:20:12 -07:00
gkanade
920d60f43b
HBASE-24208 Remove RS entry from zk draining servers node after RS been stopped ( #1841 )
...
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-08 22:47:00 +05:30
Nick Dimiduk
7c18793a18
HBASE-24519 Add ndimiduk as release manager for 2.3
2020-06-08 10:04:02 -07:00
Nick Dimiduk
f8be95ae20
HBASE-23997 Consider JDK11 in our support matrix
...
* Add a section calling out our categorical lack of support for
non-LTS Java versions.
* Provide clarification as to the meaning of the 'red x' in our
support matrix.
* Transpose the support matrix to have HBase releases along the x-axis
and Java releases along the y-axis, because there are more Java
releases than HBase release categories.
* Update the JDK11 status in the matrix.
* Add a note qualifying our JDK11 support.
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2020-06-08 09:31:44 -07:00
bsglz
9d0baa91b2
HBASE-24483 Add repeated prefix logging for MultipleColumnPrefixFilter ( #1822 )
...
Signed-off-by: clarax
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-08 16:18:33 +05:30
Duo Zhang
fbf033735b
HBASE-24506 Addendum add test category
2020-06-08 09:56:06 +08:00
Duo Zhang
754ac1d06d
HBASE-24506 async client deadlock ( #1858 )
...
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-06-08 09:38:58 +08:00
Toshihiro Suzuki
022dd9687f
HBASE-24515 batch Increment/Append fails when retrying the RPC ( #1864 )
...
Signed-off-by: Viraj Jasani <virajjasani007@gmail.com>
2020-06-08 09:51:21 +09:00
Duo Zhang
f2fde77fc3
HBASE-24513 The default readRpcTimeout and writeRpcTimeout is incorrectly calculated in AsyncConnectionConfiguration ( #1863 )
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-06-07 18:28:43 +08:00
bsglz
66452afc09
HBASE-24496 The tag of Base Stats not actived by default in table.jsp ( #1837 )
...
Signed-off-by: clarax
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-06 19:15:37 +05:30