Apache/hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,418 Commits 95 Branches 866 Tags
Commit Graph

8671 Commits

Author SHA1 Message Date
XinSun
4a3ff98943
HBASE-25559 Terminate threads of oldsources while RS is closing (#2938) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-02-09 16:32:46 +08:00
haxl
0353909bc2
HBASE-25507 Leak of ESTABLISHED sockets when compaction encountered "java.io.IOException: Invalid HFile block magic" (#2882) 
Signed-off-by: Ramkrishna <ramkrishna@apache.org>
Signed-off-by: stack <stack@apache.org>
 2021-02-08 22:14:00 -08:00
Michael Stack
ae063f953e HBASE-25542 Add client detail to scan name so when lease expires, we … (#2930) 
* HBASE-25542 Add client detail to scan name so when lease expires, we have clue on who was scanning

When we create a scanner lease, record client ip and port (removed
unnecessary store of scannerName).

Signed-off-by: Clara Xiong <clarax98007@gmail.com>
 2021-02-08 14:40:31 -08:00
GeorryHuang
ce9c9b453f
HBASE-25550 More readable Competition Time (#2925) 2021-02-08 13:12:24 -08:00
XinSun
355bccbd0b
HBASE-25560 Remove unused parameter named peerId in the constructor method of CatalogReplicationSourcePeer (#2939) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-02-08 12:29:05 -08:00
XinSun
d6aff6cbae
HBASE-25553 It is better for ReplicationTracker.getListOfRegionServers to return ServerName instead of String (#2928) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-02-07 17:13:47 +08:00
Baiqiang Zhao
304379605a
HBASE-25554 NPE when init RegionMover (#2927) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-02-05 14:01:53 +05:30
YutSean
7905749733
HBASE-25543 When configuration hadoop.security.authorization is set to false, the system will still try to authorize an RPC and raise AccessDeniedException (#2919) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
 2021-02-05 15:37:34 +08:00
stack
3a690931f5 HBASE-25546 PerfTestCompactionPolicies is failing because of NPE (addendum2); add class comment 2021-02-04 11:27:06 -08:00
robin7roy
1e8ff16eae
HBASE-25546 PerfTestCompactionPolicies is failing because of NPE (addendum) (#2926) 
Added HBaseClassTestRule for PerfTestCompactionPolicies
 2021-02-04 07:25:40 -08:00
robin7roy
d6d67d1e9f
HBASE-25546 PerfTestCompactionPolicies is failing because of NPE (#2921) 
Adds mock for getRegionInfo which was missing earlier.

Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
 2021-02-03 10:34:34 +05:30
Pankaj
a04ea7ea44
HBASE-24900 Make retain assignment configurable during SCP (#2313) 
Retain assignment will be useful in non-cloud scenario where RegionServer and Datanode are deployed in same machine and will avoid remote read.

Signed-off-by: Guanghao Zhang <zghao@apache.org> 
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
 2021-02-01 10:37:57 +05:30
shahrs87
d234b4dec2
[HBASE-25536] Remove 0 length wal file from logQueue if it belongs to old sources (#2908) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-01-29 17:47:30 +05:30
Bharath Vissapragada
de51a40b53
HBASE-25528: Dedicated merge dispatch threadpool on master (#2904) 
Adds "hbase.master.executor.merge.dispatch.threads" and defaults to 2.

Also adds additional logging that includes the number of split plans
and merge plans computed for each normalizer run.

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-01-28 09:33:35 -08:00
Bo Cui
4aff481318
HBASE-25506 ServerManager#startChore affects MTTR of HMaster (#2889) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-01-28 22:55:05 +08:00
Aman Poonia
4a66f68f9c
HBASE-25523 Region normalizer chore thread is getting killed (#2903) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-01-26 11:55:12 +05:30
Baiqiang Zhao
0b0cdcac53
HBASE-25522 Remove deprecated methods in ReplicationPeerConfig (#2898) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-01-24 21:07:03 +05:30
huaxiangsun
5c13c68494
HBASE-25368 Filter out more invalid encoded name in isEncodedRegionNa… (#2868) 
HBASE-25368 Filter out more invalid encoded name in isEncodedRegionName(byte[] regionName)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-01-20 09:04:50 -08:00
Duo Zhang
a37e727990
HBASE-25509 ChoreService.cancelChore will not call ScheduledChore.cle… (#2890) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-01-20 16:10:36 +08:00
Baiqiang Zhao
871eb09b3d
HBASE-25482 Improve SimpleRegionNormalizer#getAverageRegionSizeMb (#2858) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2021-01-19 11:09:50 -08:00
Baiqiang Zhao
bc4f5c2709
HBASE-25513 When the table is turned on normalize, the first region may not be merged even the size is 0 (#2887) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2021-01-19 07:53:51 -08:00
Anjan Das
d5debe15b5
HBASE-25475 : Unset zk based wal splitting explicitly in tests (ADDENDUM) (#2891) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-01-17 16:31:07 +05:30
Christine Feng
643548f5f5
HBASE-25478 - Implement retries when enabling tables in TestRegionReplicaReplicationEndpoint (#2866) 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-01-16 13:33:13 +05:30
Anjan Das
1474ebcc69
HBASE-25475: Improve UT added as part of HBASE-25445 in TestSplitWALManager (#2855) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-01-15 12:18:12 +05:30
Baiqiang Zhao
9b670a489b
HBASE-25431 MAX_FILESIZE and MEMSTORE_FLUSHSIZE should not be set negative number (#2803) 
Signed-off-by: stack <stack@apache.org>
 2021-01-14 22:00:50 -08:00
caroliney14
dfefff7e59
HBASE-25329 Dump ritsOverThreshold in logs (#2761) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-01-13 12:10:12 +05:30
Viraj Jasani
a3913a39c3
HBASE-25211 : Rack awareness in RegionMover (#2795) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-01-12 15:31:26 -08:00
Tak Lon (Stephen) Wu
686b72c44e
HBASE-25249 Adding StoreContext (#2800) 
Adding StoreContext which contains the metadata about the HStore. This
metadata can be used across the HFileWriter/Readers and other HStore
consumers without the need of passing around the complete store and
exposing its internals.

Co-authored-by: Abhishek Khanna <akkhanna@amazon.com>

Signed-off-by: stack <stack@apache.org>
Signed-off-by: Zach York <zyork@apache.org>
 2021-01-08 20:16:45 -08:00
xijiawen
5c233e9785
HBASE-25459 WAL can't be cleaned in some scenes (#2848) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-01-08 16:00:15 +00:00
Bo Cui
a348204d4a
HBASE-25483 set the loadMeta log level to debug (#2859) 
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
 2021-01-08 19:27:23 +05:30
xijiawen
7d70141b90
HBASE-25434 SlowDelete & SlowPut metric value should use updateDelete & updatePut (#2837) 
Signed-off-by: Zheng Wang <wangzheng@apache.org>
 2021-01-08 18:58:30 +08:00
Duo Zhang
45ef88dc8d
HBASE-25471 Move RegionScannerImpl out of HRegion (#2853) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2021-01-08 17:50:08 +08:00
Anjan Das
4b6215297d
HBASE-25445: Use WAL FS instead of master FS in SplitWALManager (#2844) 
Signed-off-by: Pankaj <pankajkumar@apache.org>
Signed-off-by: ramkrish86 <ramkrishna@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-01-07 15:31:50 +05:30
mokai
a414361ed9
HBASE-24755 [LOG][RSGroup]Error message is confusing while adding a offline RS to rsgroup (#2846) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-01-06 19:57:58 +05:30
Duo Zhang
bedb45d4ac
HBASE-25458 HRegion methods cleanup (#2838) 
Signed-off-by: meiyi <myimeiyi@gmail.com>
 2021-01-06 15:13:10 +08:00
Wellington Ramos Chevreuil
85842634e5
HBASE-24813 ReplicationSource should clear buffer usage on Replicatio… (#2546) 
Signed-off-by: Ankit Singhal <ankit@apache.org>
 2021-01-05 10:21:26 +00:00
Bo Cui
600be60a4b
HBASE-25447 remoteProc is suspended due to OOM ERROR (#2824) 
Some OMME can not cause the JVM to exit, like "java.lang.OutOfMemoryError: Direct buffer memory", "java.lang.OutOfMemoryError: unable to create new native thread", as they dont call vmError#next_OnError_command. So abort HMaster when uncaught exception occurs in TimeoutExecutor, the new active Hmaster will resume the suspended procedure.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: stack <stack@apache.com>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
 2021-01-04 21:04:38 +05:30
申胜利
eef076828a
Shenshengli hbase-25450 The parameter "hbase.bucketcache.size" is misdescribed (#2821) 
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: stack <stack@apache.org>
 2021-01-03 09:27:08 -08:00
GeorryHuang
8b9a074bf7
HBASE-24751 Display Task completion time and/or processing duration on Web UI (#2815) 
Signed-off-by: stack <stack@apache.org>
 2021-01-02 11:22:36 -08:00
lujiefsi
126d01dae3
HBASE-25456 : add security check for setRegionStateInMeta (#2833) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-01-01 12:17:34 +05:30
leyangyueshan
043da5f5ee
HBASE-25435 Slow metric value can be configured (#2823) 
* HBASE-25435 Slow metric value can be configured

* fix  HBASE-25435

* hbase-25435 add blank

* fix hbase-25435-2

Co-authored-by: stevenxi <stevenxi@tencent.com>
 2020-12-31 22:37:31 +08:00
Duo Zhang
fbf00f9c28
HBASE-25451 Upgrade commons-io to 2.8.0 (#2825) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: stack <stack@apache.org>
 2020-12-31 16:57:27 +08:00
lujiefsi
29a9a16de4
HBASE-25441 : add security check for some APIs in RSRpcServices (#2810) 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-12-31 00:22:26 +05:30
Duo Zhang
55a4eca9e6
HBASE-25452 Use MatcherAssert.assertThat instead of org.junit.Assert.assertThat (#2826) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2020-12-30 09:47:56 +08:00
Pankaj
c96fbf0407
HBASE-25379 Make retry pause time configurable for regionserver short operation RPC (reportRegionStateTransition/reportProcedureDone) (#2757) 
* HBASE-25379 Make retry pause time configurable for regionserver short operation RPC (reportRegionStateTransition/reportProcedureDone)
* HBASE-25379 RemoteProcedureResultReporter also should retry after the configured pause time
* Addressed the review comments

Signed-off-by: Yulin Niu <niuyulin@apache.org>
 2020-12-29 22:25:36 +05:30
lujiefsi
d963342f8a
HBASE-25432:add security checks for setTableStateInMeta and fixMeta (#2809) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-12-28 10:57:30 -08:00
ramkrish86
140c7f6ea0
HBASE-24850 CellComparator perf improvement (#2802) 
* Using ContiguousCellFormat as a marker alone

* Commit the new file

* Fix the comparator logic that was an oversight

* Fix the sequenceId check order

* Adding few more static methods that helps in scan flow like query
matcher where we have more cols

* Remove ContiguousCellFormat and ensure compare() can be inlined

* applying negation as per review comment

* Fix checkstyle comments

* fix review comments

* Address review comments

* Fix the checkstyle issues

* Fix javadoc

Signed-off-by: stack <stack@apache.org>
Signed-off-by: AnoopSamJohn <anoopsamjohn@apache.org>
Signed-off-by: huaxiangsun <huaxiangsun@apache.org>
 2020-12-28 13:02:06 +05:30
Huang Zhuoyue
0f868da05d HBASE-25443 Improve the experience of using the Master webpage by change the loading process of snapshot list to asynchronous 2020-12-25 10:09:32 +08:00
Mohammad Arshad
dcb38f47db
HBASE-25371: When openRegion fails during initial verification(before… (#2785) 
Signed-off-by: stack <stack@apache.org>
 2020-12-21 08:11:22 -08:00
scotthunt
904b555edc HBASE-25084 Add "regexstringnocase" to ParseFilter for case-insensitivity (#2784) 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2020-12-21 08:44:33 +00:00