8f1353b447
Revert "HBASE-24403 FsDelegationToken Should Cache Token After Acquired A New One ( #1743 )"
...
This reverts commit 7b396e9b8c
2020-06-21 23:43:38 +08:00
73ab216414
HBASE-24594 : Separate resource allocation for TestReplicationStatusSink ( #1934 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-06-21 16:11:32 +05:30
dfaba965c9
HBASE-24591 get_table_rsgroup ignored the existence of rsgroup config for namespace ( #1925 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-06-21 17:54:39 +08:00
3c31981179
HBASE-24380 : Provide WAL splitting journal logging ( #1860 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2020-06-19 16:25:03 -07:00
537a3caccd
HBASE-24574 Procedure V2 - Distributed WAL Splitting => LOGGING ( #1912 )
...
Addendum 2 fix compile error.
2020-06-18 08:49:39 -07:00
489f07d945
HBASE-24574 Procedure V2 - Distributed WAL Splitting => LOGGING ( #1912 )
...
Addendum; minor log edits
2020-06-18 08:40:11 -07:00
aadd2bb1a1
HBASE-24574 Procedure V2 - Distributed WAL Splitting => LOGGING ( #1912 )
...
hbase-server/src/main/java/org/apache/hadoop/hbase/master/SplitLogManager.java
Don't register as a chore on construction if no coordination state
manager instance (there is no instance when procv2 WAL splitter).
hbase-server/src/main/java/org/apache/hadoop/hbase/master/SplitWALManager.java
hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
Edit logs.
hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/RegionRemoteProcedureBase.java
hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/RegionTransitionProcedure.java
hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/ServerCrashProcedure.java
hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/SplitWALProcedure.java
hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/SplitWALRemoteProcedure.java
Add proc name rather than rely on default behavior. Add detail to the
toString.
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
Factoring
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/AbstractFSWAL.java
Print the maxLogs... we don't do it any where.
hbase-server/src/main/java/org/apache/hadoop/hbase/wal/WAL.java
Utility method to strip prefix from wal path.
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: tianjingyun <tianjy@apache.org>
2020-06-18 08:38:59 -07:00
6a576696dc
HBASE-24577 Doc WALSplitter classes ( #1913 )
...
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-06-17 15:03:33 -07:00
192daded61
HBASE-24518 : waitForNamespaceOnline() should return false if any region is offline ( #1869 )
...
Signed-off-by: ramkrish86 <ramkrishna@apache.org>
2020-06-17 19:44:36 +05:30
b17ba7b81d
HBASE-24205 - Avoid metric collection for flushes and compactions ( #1918 )
...
* HBASE-24205 - Avoid metric collection for flushes and compactions
* Use the existing matcher.isUserScan() to decide the scan type
* Added a comment saying when we track the metrics
2020-06-17 16:47:21 +05:30
510aad3125
HBASE-24205 Create metric to know the number of reads that happens fr… ( #1552 )
...
* HBASE-24205 Create metric to know the number of reads that happens from memstore
* Fix checkstyles and whitespaces
* Checkstyl, whitespace and javadoc
* Fixed review comments
* Fix unused imports
* Rebase with latest commit
* Adding the table vs store metric by consolidating
* Combine get and scan metrics and make all relevant changes
* Track for full row and then increment either memstore or file read
metric
* TestMetricsStore test fix
* Only increment the memstore metric if all cells are from memstore, if
not treat as mixed reads
* Remove metricsstore and aggregate at region level
* Addresses review comments-metric name updated everywhere
* Metric name change
* Review comment changes
Co-authored-by: Ramkrishna <ramkrishna@apache.org>
Signed-off by:Anoop Sam John<anoopsamjohn@gmail.com>
Signed-off by:Viraj Jasani<virajjasani@apache.org>
2020-06-16 18:30:20 +05:30
3558ee0c3b
HBASE-24478 The regionInfo parameter for MasterProcedureScheduler#wai… ( #1819 )
...
Signed-off-by: Guangxu Cheng <gxcheng@apache.org>
Signed-off-by: clarax <clarax98007@gmail.com>
2020-06-16 17:34:07 +08:00
db4d539190
HBASE-24015: Test for Assign and Unassign of Regions on RegionServer on failure ( #1898 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-16 12:47:52 +05:30
2567d15218
HBASE-24564: Make RS abort call idempotent.
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-06-15 22:45:35 -07:00
d0f190bdf0
HBASE-24517 Addendum add more comments ( #1882 )
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-15 10:43:57 +08:00
b83d38fb94
HBASE-24038 Add a metric to show the locality of ssd in table.jsp ( #1337 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-14 22:46:18 +05:30
21fe873eba
HBASE-23195 FSDataInputStreamWrapper unbuffer can NOT invoke the classes that NOT implements CanUnbuffer but its parents class implements CanUnbuffer
...
Closes #746
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2020-06-12 13:01:02 -04:00
9fbf1f30c9
HBASE-24545 Add backoff to SCP check on WAL split completion ( #1891 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-06-12 07:58:34 -07:00
1dac9f69c4
HBASE-24446 Use EnvironmentEdgeManager to compute clock skew in Master ( #1885 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-12 16:17:59 +05:30
6b7a93d10c
HBASE-24529 hbase.rs.evictblocksonclose is not honored when removing compacted files and closing the storefiles ( #1881 )
...
Signed-off-by: Anoop Sam John <anoop.hbase@gmail.com>
2020-06-12 18:59:03 +09:00
4005e42a62
HBASE-24189 WALSplit recreates region dirs for deleted table with recovered edits data.
2020-06-11 21:27:21 +05:30
9b2f961132
HBASE-24532 : Execute region plans with throttle should return succeeded plans ( #1884 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2020-06-11 18:17:59 +05:30
efd5a962e5
HBASE-8458 Support for batch version of checkAndMutate()
...
Closes #1648
Signed-off-by: Josh Elser <elserj@apache.org>
2020-06-10 22:34:36 -04:00
1eb159b455
HBASE-24511 Ability to configure timeout between RPC retry to RS from master ( #1861 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-10 12:53:08 +05:30
7b396e9b8c
HBASE-24403 FsDelegationToken Should Cache Token After Acquired A New One ( #1743 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2020-06-10 08:46:58 +08:00
15ddded26b
HBASE-24441 CacheConfig details logged at Store open is not really u… ( #1801 )
...
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: binlijin <binlijin@gmail.com>
2020-06-09 14:18:21 +08:00
eee06c2d7e
HBASE-24468 Add region info when log meessages in HStore. ( #1803 )
...
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: binlijin <binlijin@gmail.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-09 14:12:44 +08:00
3d50e73871
HBASE-24117 Shutdown AssignmentManager before ProcedureExecutor may cause SCP to accidentally skip assigning a region ( #1865 )
...
Signed-off-by: Michael Stack <stack@apache.org>
2020-06-09 11:07:16 +08:00
2131456e54
HBASE-24444 Should shutdown mini cluster after class in TestMetaAssignmentWithStopMaster ( #1802 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-06-09 08:16:20 +08:00
a4aa5384f1
Revert "HBASE-24444 Should shutdown mini cluster after class in TestMetaAssignmentWithStopMaster ( #1802 )"
...
This reverts commit 3b3bba1b64
2020-06-09 08:15:51 +08:00
3b3bba1b64
HBASE-24444 Should shutdown mini cluster after class in TestMetaAssignmentWithStopMaster ( #1802 )
...
* shutdown mini cluster after class
* fix
Co-authored-by: wen_yi <liu.wenwen@immomo.com>
2020-06-09 08:14:18 +08:00
2dd34b3f01
HBASE-24517 AssignmentManager.start should add meta region to ServerStateNode ( #1866 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
2020-06-09 08:14:00 +08:00
71fae116c3
HBASE-23202 ExportSnapshot (import) will fail if copying files to root directory takes longer than cleaner TTL ( #1874 )
...
Co-authored-by: Guangxu Cheng <guangxucheng@gmail.com>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Zach York <zyork@apache.org>
2020-06-08 14:57:48 -07:00
5042b591f8
Revert "HBASE-23202 ExportSnapshot (import) will fail if copying files to root directory takes longer than cleaner TTL ( #1791 )" ( #1873 )
...
This reverts commit f862f3d9b5
2020-06-08 14:51:59 -07:00
f862f3d9b5
HBASE-23202 ExportSnapshot (import) will fail if copying files to root directory takes longer than cleaner TTL ( #1791 )
...
Co-authored-by: Huaxiang Sun <huaxiangsun@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Zach York <zyork@apache.org>
2020-06-08 14:48:21 -07:00
920d60f43b
HBASE-24208 Remove RS entry from zk draining servers node after RS been stopped ( #1841 )
...
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-08 22:47:00 +05:30
754ac1d06d
HBASE-24506 async client deadlock ( #1858 )
...
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-06-08 09:38:58 +08:00
022dd9687f
HBASE-24515 batch Increment/Append fails when retrying the RPC ( #1864 )
...
Signed-off-by: Viraj Jasani <virajjasani007@gmail.com>
2020-06-08 09:51:21 +09:00
66452afc09
HBASE-24496 The tag of Base Stats not actived by default in table.jsp ( #1837 )
...
Signed-off-by: clarax
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-06 19:15:37 +05:30
16116fa35e
HBASE-24510 Remove HBaseTestCase and GenericTestUtils ( #1859 )
...
Signed-off-by: Michael Stack <stack@apache.org>
2020-06-06 19:06:11 +08:00
c91829bb41
HBASE-24491 Remove HRegionInfo ( #1830 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-06-05 22:19:01 +08:00
2c2b1f0174
HBASE-24500 The behavior of RegionInfoBuilder.newBuilder(RegionInfo) is strange ( #1850 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-06-05 15:19:04 +08:00
b2ec4c1ea0
HBASE-24505 Reimplement Hbck.setRegionStateInMeta ( #1852 )
...
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
2020-06-05 08:48:39 +08:00
61a7468df7
HBASE-24456 : Create ImmutableScan and use it for CustomizedScanInfoBuilder ( #1818 )
...
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-06-04 16:25:47 +05:30
59031ab661
HBASE-24359 Optionally ignore edits for deleted CFs for replication ( #1722 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-06-04 17:52:52 +08:00
08c97d3a87
Revert "HBASE-24500 The behavior of RegionInfoBuilder.newBuilder(RegionInfo) is strange ( #1840 )"
...
This reverts commit ee6938abda
2020-06-04 12:17:03 +08:00
ee6938abda
HBASE-24500 The behavior of RegionInfoBuilder.newBuilder(RegionInfo) is strange ( #1840 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2020-06-04 11:06:41 +08:00
60c9ae58fb
HBASE-21905: [FIFOCompaction] Don't compact already inflight store files ( #1829 )
...
This one surfaced as a flake test but turns out to be a legit bug
in FIFOCompaction code. FifoCompaction does not check if an empty
store file is already being compacted by an in-flight compaction
request and still enqueues. It can potentially race with a running
compaction (as in this test case, see jira for the exact exception).
Fixes the edge case and cleans up the test code a bit.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2020-06-03 16:37:22 -07:00
8de8c44029
HBASE-24492 : Remove infinite loop from ProtobufLogReader#readNext ( #1831 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-06-03 13:41:15 +05:30
f71f1cdfa0
HBASE-24412 Canary support check only one column family per RegionTask ( #1817 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-06-03 09:15:10 +08:00
Duo Zhang
Viraj Jasani
XinSun
stack
Michael Stack
ramkrish86
xincunSong
Sandeep Pal
Bharath Vissapragada
bsglz
zhaoym6
sguggilam
Toshihiro Suzuki
Anoop Sam John
Vico.Wu
WenFeiYi
Guanghao Zhang
huaxiangsun
gkanade
niuyulin