8f1353b447
Revert "HBASE-24403 FsDelegationToken Should Cache Token After Acquired A New One ( #1743 )"
...
This reverts commit 7b396e9b8c
2020-06-21 23:43:38 +08:00
73ab216414
HBASE-24594 : Separate resource allocation for TestReplicationStatusSink ( #1934 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-06-21 16:11:32 +05:30
dfaba965c9
HBASE-24591 get_table_rsgroup ignored the existence of rsgroup config for namespace ( #1925 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-06-21 17:54:39 +08:00
f22c7a6583
HBASE-23126: Removing the un-used integration test class - IntegrationTestRSGroup
...
Closes #1936
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-20 22:44:03 +05:30
3c31981179
HBASE-24380 : Provide WAL splitting journal logging ( #1860 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2020-06-19 16:25:03 -07:00
6b62c0b6d2
HBASE-24550 Passing '-h' or '--help' to bin/hbase doesn't do as expected (ADDENDUM)
...
Closes #1932
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-19 22:52:18 +05:30
537a3caccd
HBASE-24574 Procedure V2 - Distributed WAL Splitting => LOGGING ( #1912 )
...
Addendum 2 fix compile error.
2020-06-18 08:49:39 -07:00
489f07d945
HBASE-24574 Procedure V2 - Distributed WAL Splitting => LOGGING ( #1912 )
...
Addendum; minor log edits
2020-06-18 08:40:11 -07:00
aadd2bb1a1
HBASE-24574 Procedure V2 - Distributed WAL Splitting => LOGGING ( #1912 )
...
hbase-server/src/main/java/org/apache/hadoop/hbase/master/SplitLogManager.java
Don't register as a chore on construction if no coordination state
manager instance (there is no instance when procv2 WAL splitter).
hbase-server/src/main/java/org/apache/hadoop/hbase/master/SplitWALManager.java
hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
Edit logs.
hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/RegionRemoteProcedureBase.java
hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/RegionTransitionProcedure.java
hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/ServerCrashProcedure.java
hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/SplitWALProcedure.java
hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/SplitWALRemoteProcedure.java
Add proc name rather than rely on default behavior. Add detail to the
toString.
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
Factoring
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/AbstractFSWAL.java
Print the maxLogs... we don't do it any where.
hbase-server/src/main/java/org/apache/hadoop/hbase/wal/WAL.java
Utility method to strip prefix from wal path.
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: tianjingyun <tianjy@apache.org>
2020-06-18 08:38:59 -07:00
bd79c4065c
HBASE-24579: Failed SASL authentication does not result in an exception on client side ( #1921 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-18 12:25:43 +01:00
f73480febf
HBASE-24550 Passing '-h' or '--help' to bin/hbase doesn't do as expected
...
Closes #1914
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-18 15:42:57 +05:30
6a576696dc
HBASE-24577 Doc WALSplitter classes ( #1913 )
...
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-06-17 15:03:33 -07:00
192daded61
HBASE-24518 : waitForNamespaceOnline() should return false if any region is offline ( #1869 )
...
Signed-off-by: ramkrish86 <ramkrishna@apache.org>
2020-06-17 19:44:36 +05:30
b17ba7b81d
HBASE-24205 - Avoid metric collection for flushes and compactions ( #1918 )
...
* HBASE-24205 - Avoid metric collection for flushes and compactions
* Use the existing matcher.isUserScan() to decide the scan type
* Added a comment saying when we track the metrics
2020-06-17 16:47:21 +05:30
510aad3125
HBASE-24205 Create metric to know the number of reads that happens fr… ( #1552 )
...
* HBASE-24205 Create metric to know the number of reads that happens from memstore
* Fix checkstyles and whitespaces
* Checkstyl, whitespace and javadoc
* Fixed review comments
* Fix unused imports
* Rebase with latest commit
* Adding the table vs store metric by consolidating
* Combine get and scan metrics and make all relevant changes
* Track for full row and then increment either memstore or file read
metric
* TestMetricsStore test fix
* Only increment the memstore metric if all cells are from memstore, if
not treat as mixed reads
* Remove metricsstore and aggregate at region level
* Addresses review comments-metric name updated everywhere
* Metric name change
* Review comment changes
Co-authored-by: Ramkrishna <ramkrishna@apache.org>
Signed-off by:Anoop Sam John<anoopsamjohn@gmail.com>
Signed-off by:Viraj Jasani<virajjasani@apache.org>
2020-06-16 18:30:20 +05:30
3558ee0c3b
HBASE-24478 The regionInfo parameter for MasterProcedureScheduler#wai… ( #1819 )
...
Signed-off-by: Guangxu Cheng <gxcheng@apache.org>
Signed-off-by: clarax <clarax98007@gmail.com>
2020-06-16 17:34:07 +08:00
3ac99ad192
HBASE-21405 [DOC] Add Details about Output of "status 'replication'" ( #1894 )
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-16 10:02:29 +01:00
db4d539190
HBASE-24015: Test for Assign and Unassign of Regions on RegionServer on failure ( #1898 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-16 12:47:52 +05:30
2567d15218
HBASE-24564: Make RS abort call idempotent.
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-06-15 22:45:35 -07:00
2ecbaf130e
HBASE-24547 : Thrift support for HBASE-23941 (Operator support for get_slowlog_responses API) ( #1892 )
...
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-06-15 14:14:28 +05:30
d0f190bdf0
HBASE-24517 Addendum add more comments ( #1882 )
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-15 10:43:57 +08:00
b83d38fb94
HBASE-24038 Add a metric to show the locality of ssd in table.jsp ( #1337 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-14 22:46:18 +05:30
d6e9c3164d
HBASE-8458 Support for batch version of checkAndMutate() (addendum) ( #1899 )
2020-06-14 19:27:00 +09:00
fd5002d0da
HBASE-24535: Tweak the master registry docs for branch-2 ( #1890 )
...
Updated to include changes in HBASE-24265 and some rewording
to make it version agnostic.
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2020-06-12 14:59:04 -07:00
21fe873eba
HBASE-23195 FSDataInputStreamWrapper unbuffer can NOT invoke the classes that NOT implements CanUnbuffer but its parents class implements CanUnbuffer
...
Closes #746
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2020-06-12 13:01:02 -04:00
9fbf1f30c9
HBASE-24545 Add backoff to SCP check on WAL split completion ( #1891 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-06-12 07:58:34 -07:00
1dac9f69c4
HBASE-24446 Use EnvironmentEdgeManager to compute clock skew in Master ( #1885 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-12 16:17:59 +05:30
6b7a93d10c
HBASE-24529 hbase.rs.evictblocksonclose is not honored when removing compacted files and closing the storefiles ( #1881 )
...
Signed-off-by: Anoop Sam John <anoop.hbase@gmail.com>
2020-06-12 18:59:03 +09:00
42a82df3af
HBASE-24534 Delete reference off to Hadoop wiki's HBase FAQ
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-06-11 14:20:16 -07:00
4005e42a62
HBASE-24189 WALSplit recreates region dirs for deleted table with recovered edits data.
2020-06-11 21:27:21 +05:30
9b2f961132
HBASE-24532 : Execute region plans with throttle should return succeeded plans ( #1884 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2020-06-11 18:17:59 +05:30
efd5a962e5
HBASE-8458 Support for batch version of checkAndMutate()
...
Closes #1648
Signed-off-by: Josh Elser <elserj@apache.org>
2020-06-10 22:34:36 -04:00
d8247ebae3
HBASE-24524 SyncTable logging improvements ( #1878 )
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-10 09:36:30 +01:00
1eb159b455
HBASE-24511 Ability to configure timeout between RPC retry to RS from master ( #1861 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-10 12:53:08 +05:30
7b396e9b8c
HBASE-24403 FsDelegationToken Should Cache Token After Acquired A New One ( #1743 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2020-06-10 08:46:58 +08:00
9ef17c2784
HBASE-24005 Document maven invocation with JDK11
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2020-06-09 15:34:02 -07:00
474d200daa
HBASE-24367 ScheduledChore log elapsed timespan in a human-friendly format ( #1749 )
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-09 09:55:20 -07:00
15ddded26b
HBASE-24441 CacheConfig details logged at Store open is not really u… ( #1801 )
...
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: binlijin <binlijin@gmail.com>
2020-06-09 14:18:21 +08:00
eee06c2d7e
HBASE-24468 Add region info when log meessages in HStore. ( #1803 )
...
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: binlijin <binlijin@gmail.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-09 14:12:44 +08:00
c718fa2365
HBASE-24340 PerformanceEvaluation options should not mandate any specific order
...
Signed-off-by Anoop Sam John <anoopsamjohn@apache.org>
2020-06-09 11:32:39 +05:30
3d50e73871
HBASE-24117 Shutdown AssignmentManager before ProcedureExecutor may cause SCP to accidentally skip assigning a region ( #1865 )
...
Signed-off-by: Michael Stack <stack@apache.org>
2020-06-09 11:07:16 +08:00
2131456e54
HBASE-24444 Should shutdown mini cluster after class in TestMetaAssignmentWithStopMaster ( #1802 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-06-09 08:16:20 +08:00
a4aa5384f1
Revert "HBASE-24444 Should shutdown mini cluster after class in TestMetaAssignmentWithStopMaster ( #1802 )"
...
This reverts commit 3b3bba1b64
2020-06-09 08:15:51 +08:00
3b3bba1b64
HBASE-24444 Should shutdown mini cluster after class in TestMetaAssignmentWithStopMaster ( #1802 )
...
* shutdown mini cluster after class
* fix
Co-authored-by: wen_yi <liu.wenwen@immomo.com>
2020-06-09 08:14:18 +08:00
2dd34b3f01
HBASE-24517 AssignmentManager.start should add meta region to ServerStateNode ( #1866 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
2020-06-09 08:14:00 +08:00
71fae116c3
HBASE-23202 ExportSnapshot (import) will fail if copying files to root directory takes longer than cleaner TTL ( #1874 )
...
Co-authored-by: Guangxu Cheng <guangxucheng@gmail.com>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Zach York <zyork@apache.org>
2020-06-08 14:57:48 -07:00
5042b591f8
Revert "HBASE-23202 ExportSnapshot (import) will fail if copying files to root directory takes longer than cleaner TTL ( #1791 )" ( #1873 )
...
This reverts commit f862f3d9b5
2020-06-08 14:51:59 -07:00
f862f3d9b5
HBASE-23202 ExportSnapshot (import) will fail if copying files to root directory takes longer than cleaner TTL ( #1791 )
...
Co-authored-by: Huaxiang Sun <huaxiangsun@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Zach York <zyork@apache.org>
2020-06-08 14:48:21 -07:00
05ed4cd133
HBASE-24493 [flakey test] TestExportSnapshot family of tests failing due to timeout in AbstractDelegationTokenSecretManager$ExpiredTokenRemover
...
Disable TestExportSnapshot* tests because they timeout on occasion
staring yarn jobhistoryserver.
2020-06-08 14:20:12 -07:00
920d60f43b
HBASE-24208 Remove RS entry from zk draining servers node after RS been stopped ( #1841 )
...
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-08 22:47:00 +05:30
Duo Zhang
Viraj Jasani
XinSun
Sandeep Pal
WenFeiYi
stack
Michael Stack
BukrosSzabolcs
ramkrish86
xincunSong
Wellington Ramos Chevreuil
Bharath Vissapragada
bsglz
Toshihiro Suzuki
zhaoym6
sguggilam
Nick Dimiduk
Anoop Sam John
Vico.Wu
Andrew Purtell
Sambit Mohapatra
Guanghao Zhang
huaxiangsun
gkanade