Apache/hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,575 Commits 95 Branches 866 Tags
Commit Graph

5287 Commits

Author SHA1 Message Date
Peter Somogyi
af8dc2e4df HBASE-25587 [hbck2] Schedule SCP for all unknown servers (#2978) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-03-11 17:22:08 +01:00
Duo Zhang
d546c8e77c HBASE-25629 Reimplement TestCurrentHourProvider to not depend on unstable TZs (#3013) 
Signed-off-by: XinSun <ddupgs@gmail.com>
 2021-03-10 23:53:59 +08:00
Wellington Ramos Chevreuil
7adc00044c HBASE-25548 Optionally allow snapshots to preserve cluster's max file… (#2923) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
(cherry picked from commit 373dc7788d66ba7f7c49d727373c521c639d613c)
 2021-03-10 10:35:58 +00:00
Anoop Sam John
29d771fab9
HBASE-25582 Support setting scan ReadType to be STREAM at cluster level (#3040) 
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-03-10 13:23:15 +05:30
Bharath Vissapragada
321b5c7979
HBASE-25547: Thread pools should release unused resources (#3037) 
* HBASE-25547: Thread pools should release unused resources (#2922)

Plumbs the configuration needed to enable core thread timeout on non-critical thread pools.
Currently only enabled for thread pools with op-codes RS_LOG_REPLAY_OPS, RS_PARALLEL_SEEK, MASTER_SNAPSHOT_OPERATIONS, MASTER_MERGE_OPERATIONS. Others can be added later as
needed.

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
(cherry picked from commit 618236dd9040625cf38a4d98338ccff8ab35bfec)

* HBASE-25547 (addendum): Roll ExecutorType into ExecutorConfig

Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
(cherry picked from commit 4c822d7463589796472725524be4fa2509c7bcef)
 2021-03-09 09:03:16 -08:00
niuyulin
88b9e98a7d HBASE-25637 Rename method completeCompaction to refreshStoreSizeAndTotalBytes (#3023) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-03-06 18:43:47 +08:00
Rahul Kumar
e57c73a137
HBASE-25460 : Expose drainingServers as cluster metric (#2994) (#2995) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-03-04 12:48:57 +05:30
Andrew Purtell
dce639ae81 HBASE-25385 TestCurrentHourProvider fails if the latest timezone changes are not present (#3012) 
Disable this problematic test for now. May be removed after additional
discussion.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-03-03 18:16:20 -08:00
niuyulin
621edfe1da HBASE-25603 Add switch for compaction after bulkload (#2982) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-03-04 10:11:19 +08:00
Sandeep Pal
80b835927c
HBASE-25596: Fix NPE and avoid permanent unreplicated data due to EOF (#3008) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-03-03 11:38:46 -08:00
Andrew Purtell
0849fae730 Revert "HBASE-25596: Fix NPE and avoid permanent unreplicated data due to EOF (#2990)" 
This reverts commit d724d0576fcafb507b32d3f6636228d559a924fa.
 2021-03-02 12:26:23 -08:00
XinSun
328ff8c05a HBASE-25590 Bulkload replication HFileRefs cannot be cleared in some cases where set exclude-namespace/exclude-table-cfs (#2969) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-02-26 09:58:05 +08:00
Sandeep Pal
d724d0576f
HBASE-25596: Fix NPE and avoid permanent unreplicated data due to EOF (#2990) 
Signed-off-by: Xu Cang <xucang@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-02-25 13:36:31 -08:00
XinSun
e863df383b HBASE-25598 TestFromClientSide5.testScanMetrics is flaky (#2977) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-02-24 14:19:36 +08:00
Toshihiro Suzuki
cfbae4d3a3 HBASE-25575 Should validate Puts in RowMutations 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-02-22 11:02:13 +09:00
shahrs87
6a4c9be967
HBASE-25539: Add age of oldest wal metric (#2962) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2021-02-18 20:59:07 -08:00
Mohammad Arshad
2e31d1d46e
HBASE-25571: Compilation error in branch-2 after HBASE-25364 (#2951) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-02-13 21:41:04 +05:30
pustota2009
2d5a5db80e
HBASE-23887 AdaptiveLRU cache (#2934) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-02-13 19:58:55 +05:30
GeorryHuang
a61f1082de HBASE-25364 Redo the getMidPoint() in HFileWriterImpl to get rid of the double comparison process (#2741) 
Signed-off-by: niuyulin <nyl353@163.com>
Signed-off-by: stack <stack@apache.org>
 2021-02-10 08:31:51 -08:00
XinSun
b05dcac9fd HBASE-25559 Terminate threads of oldsources while RS is closing (#2938) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-02-09 16:40:52 +08:00
Michael Stack
3c29eaed35
HBASE-25542 Add client detail to scan name so when lease expires, we … (#2930) 
* HBASE-25542 Add client detail to scan name so when lease expires, we have clue on who was scanning

When we create a scanner lease, record client ip and port (removed
unnecessary store of scannerName).

Signed-off-by: Clara Xiong <clarax98007@gmail.com>
 2021-02-08 14:33:00 -08:00
XinSun
471f52350a HBASE-25553 It is better for ReplicationTracker.getListOfRegionServers to return ServerName instead of String (#2928) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-02-07 18:54:44 +08:00
Pankaj
3896e10728 HBASE-24900 Make retain assignment configurable during SCP (#2313) 
Retain assignment will be useful in non-cloud scenario where RegionServer and Datanode are deployed in same machine and will avoid remote read.

Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
(cherry picked from commit a04ea7ea4493f5bc583b4d08a2a6a88e7c6b8c54)
 2021-02-01 10:47:19 +05:30
shahrs87
2c72225d13
HBASE-25536 Remove 0 length wal file from logQueue if it belongs to old sources (#2908) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-01-29 17:49:50 +05:30
Duo Zhang
f70229b193 HBASE-25509 ChoreService.cancelChore will not call ScheduledChore.cle… (#2890) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-01-20 23:24:16 +08:00
Christine Feng
854f75982f
HBASE-25478 : Implement retries when enabling tables in TestRegionReplicaReplicationEndpoint (#2896) 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-01-20 11:32:43 +05:30
Anjan Das
fbc44784db
HBASE-25475 : Unset zk based wal splitting explicitly in tests (ADDENDUM) (#2891) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-01-17 16:34:25 +05:30
Anjan Das
24739256aa
HBASE-25475: Improve UT added as part of HBASE-25445 in TestSplitWALManager (#2855) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-01-15 12:29:23 +05:30
Tak Lon (Stephen) Wu
2bb7beb448
Backport "HBASE-25249 Adding StoreContext" to branch-2 (#2869) 
Co-authored-by: Abhishek Khanna <akkhanna@amazon.com>

Signed-off-by: Zach York <zyork@apache.org>
 2021-01-13 20:13:43 -08:00
Bo Cui
1612b9ef85
HBASE-23340 hmaster /hbase/replication/rs session expired (hbase replication default value is true, we don't use ) causes logcleaner can not clean oldWALs, which resulits in oldWALs too large (more than 2TB) (#2779) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
    Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
 2021-01-14 09:06:07 +05:30
Viraj Jasani
b817a156c9 HBASE-25211 : Rack awareness in RegionMover (#2795) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-01-12 15:32:31 -08:00
Wellington Ramos Chevreuil
fdae12d754
HBASE-24813 ReplicationSource should clear buffer usage on Replicatio… (#2546) (#2849) 
Signed-off-by: Ankit Singhal <ankit@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
 2021-01-12 09:40:25 +00:00
xijiawen
6a401d89f8 HBASE-25459 WAL can't be cleaned in some scenes (#2848) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-01-11 10:01:53 +00:00
xijiawen
4705b4752b HBASE-25434 SlowDelete & SlowPut metric value should use updateDelete & updatePut (#2837) 
Signed-off-by: Zheng Wang <wangzheng@apache.org>
(cherry picked from commit 7d70141b90d188d69e259ad5de435dad4eed5bf8)
 2021-01-08 19:04:32 +08:00
Duo Zhang
a573e49d69 HBASE-25471 Move RegionScannerImpl out of HRegion (#2853) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2021-01-08 17:57:24 +08:00
Anjan Das
d93588512a
HBASE-25445: Use WAL FS instead of master FS in SplitWALManager (#2844) 
Signed-off-by: Pankaj <pankajkumar@apache.org>
Signed-off-by: ramkrish86 <ramkrishna@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-01-07 15:33:12 +05:30
Duo Zhang
1719565aa7 HBASE-25458 HRegion methods cleanup (#2838) 
Signed-off-by: meiyi <myimeiyi@gmail.com>
 2021-01-07 10:18:41 +08:00
lujiefsi
d0221083ca
HBASE-25456 : add security check for setRegionStateInMeta (#2834) (#2833) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-01-01 12:18:34 +05:30
Duo Zhang
15d27450c2 HBASE-25451 Upgrade commons-io to 2.8.0 (#2825) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: stack <stack@apache.org>
 2020-12-31 17:11:49 +08:00
Duo Zhang
9325a775fe HBASE-25452 Use MatcherAssert.assertThat instead of org.junit.Assert.assertThat (#2826) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2020-12-30 10:03:39 +08:00
lujiefsi
e5c6467809
HBASE-25432: branch-2 add security checks for setTableStateInMeta and fixMeta (#2818) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-12-28 10:58:56 -08:00
ramkrish86
1c41c9732e HBASE-24850 CellComparator perf improvement (#2776) 
* Using ContiguousCellFormat as a marker alone

* Commit the new file

* Fix the comparator logic that was an oversight

* Fix the sequenceId check order

* Adding few more static methods that helps in scan flow like query
matcher where we have more cols

* Remove ContiguousCellFormat and ensure compare() can be inlined

* applying negation as per review comment

* Fix checkstyle comments

* fix review comments

* Address review comments

Signed-off-by: stack <stack@apache.org>
Signed-off-by: AnoopSamJohn <anoopsamjohn@apache.org>
Signed-off-by: huaxiangsun <huaxiangsun@apache.org>
 2020-12-28 13:08:50 +05:30
scotthunt
befa76f55a HBASE-25084 Add "regexstringnocase" to ParseFilter for case-insensitivity (#2784) 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2020-12-21 08:48:14 +00:00
huaxiangsun
8159fc8dbe
HBASE-25293 Followup jira to address the client handling issue when chaning from meta replica to non-meta-replica at the server side. (#2768) (#2786) 
Signed-off-by: stack <stack@apache.org>
 2020-12-18 09:25:04 -08:00
Sandeep Pal
aa5a477426
HBASE-25383: Ability to update and remove peer base config 
Closes #2778

Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-12-18 14:20:36 +05:30
huaxiangsun
22dd0545b9
HBASE-25356 HBaseAdmin#getRegion() needs to filter out non-regionName and non-encodedRegionName (#2759) 
Signed-off-by: stack <stack@apache.org>
 2020-12-17 15:21:30 -08:00
stack
899a0d8654 HBASE-25400 [Flakey Tests] branch-2 TestRegionMoveAndAbandon 2020-12-16 10:35:34 -08:00
Pankaj
50890acda7 HBASE-25378 Legacy comparator in Hfile trailer will fail to load (#2756) 
Signed-off-by: stack <stack@apache.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 9bdac6cd174bce570a2faf92849931b3e76f240d)
 2020-12-15 23:59:18 +05:30
Michael Stack
aebcb2f192
HBASE-25389 [Flakey Tests] branch-2 TestMetaShutdownHandler (#2773) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2020-12-15 09:49:16 -08:00
Pankaj
6ff02dedf8
HBASE-25277 postScannerFilterRow impacts Scan performance a lot in HBase 2.x (#2751) 
1. Added a check for Object class in RegionCoprocessorHost to avoid wrong initialization of hasCustomPostScannerFilterRow
2. Removed dummy implementation of postScannerFilterRow from AccessController, VisibilityController & ConstraintProcessor (which are not required currently)

Signed-off-by Ramkrishna S Vasudevan <ramkrishna@apache.org>
Signed-off-by Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2020-12-09 10:39:44 +05:30