Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,505 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

17505 Commits

Author SHA1 Message Date
Bo Cui 1612b9ef85
HBASE-23340 hmaster /hbase/replication/rs session expired (hbase replication default value is true, we don't use ) causes logcleaner can not clean oldWALs, which resulits in oldWALs too large (more than 2TB) (#2779) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
    Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
 2021-01-14 09:06:07 +05:30
申胜利 478c4e8d6a HBASE-25449 'dfs.client.read.shortcircuit' should not be set in hbase-default.xml 
Revert of the revert -- re-applying HBASE-25449 with a change
of renaming the test hdfs XML configuration file as it was adversely
affecting tests using MiniDFS

This reverts commit c218e576fe.

Co-authored-by: Josh Elser <elserj@apache.org>

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-01-13 21:06:13 -05:00
Pankaj 9a170e2c8b HBASE-25502 IntegrationTestMTTR fails with TableNotFoundException (#2879) 2021-01-13 11:02:41 -08:00
Mohammad Arshad f6e9d5bbd0 HBASE-25503: HBase code download is failing on windows with invalid path error (#2880) 2021-01-13 09:51:03 -08:00
Duo Zhang e0cdaada13 HBASE-25476 Enable error prone check in pre commit (#2860) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2021-01-13 16:17:45 +08:00
caroliney14 f4ad0d0988
HBASE-25329 Dump ritsOverThreshold in logs (#2761) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-01-13 12:13:05 +05:30
Viraj Jasani b817a156c9 HBASE-25211 : Rack awareness in RegionMover (#2795) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-01-12 15:32:31 -08:00
Wellington Ramos Chevreuil fdae12d754
HBASE-24813 ReplicationSource should clear buffer usage on Replicatio… (#2546) (#2849) 
Signed-off-by: Ankit Singhal <ankit@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
 2021-01-12 09:40:25 +00:00
Duo Zhang 51e8cf4d34 Revert "HBASE-25449 'dfs.client.read.shortcircuit' should not be set in hbase-default.xml" 
This reverts commit 661bea9135.
 2021-01-12 16:09:27 +08:00
Viraj Jasani 0788547fea
HBASE-25474 : Bump HBase version on branch-2 (#2871) 
Signed-off-by: stack <stack@apache.org>
 2021-01-12 10:20:22 +05:30
xijiawen 6a401d89f8 HBASE-25459 WAL can't be cleaned in some scenes (#2848) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-01-11 10:01:53 +00:00
Duo Zhang 751431d93e HBASE-25333 Add maven enforcer rule to ban VisibleForTesting imports (#2854) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2021-01-09 08:55:52 +08:00
申胜利 661bea9135 HBASE-25449 'dfs.client.read.shortcircuit' should not be set in hbase-default.xml 
Signed-off-by: Josh Elser <elserj@apache.org>
 2021-01-08 15:20:27 -05:00
Bo Cui bd8ded8d60 HBASE-25483 set the loadMeta log level to debug (#2859) 
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
(cherry picked from commit a348204d4a)
 2021-01-08 19:30:17 +05:30
xijiawen 4705b4752b HBASE-25434 SlowDelete & SlowPut metric value should use updateDelete & updatePut (#2837) 
Signed-off-by: Zheng Wang <wangzheng@apache.org>
(cherry picked from commit 7d70141b90)
 2021-01-08 19:04:32 +08:00
Duo Zhang a573e49d69 HBASE-25471 Move RegionScannerImpl out of HRegion (#2853) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2021-01-08 17:57:24 +08:00
Anjan Das d93588512a
HBASE-25445: Use WAL FS instead of master FS in SplitWALManager (#2844) 
Signed-off-by: Pankaj <pankajkumar@apache.org>
Signed-off-by: ramkrish86 <ramkrishna@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-01-07 15:33:12 +05:30
Duo Zhang 1719565aa7 HBASE-25458 HRegion methods cleanup (#2838) 
Signed-off-by: meiyi <myimeiyi@gmail.com>
 2021-01-07 10:18:41 +08:00
mokai 2b25fca6d8
HBASE-24755 [LOG][RSGroup]Error message is confusing while adding a offline RS to rsgroup (#2847) (#2846) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-01-06 19:58:47 +05:30
Gary Wang cec9f18737
HBASE-25463 fix comment error of append.rb (#2845) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-01-05 20:10:50 +05:30
Mate Szalay-Beko 95dc87be23 HBASE-25318 Config option for IntegrationTestImportTsv where to generate HFiles to bulkload (#2777) 
IntegrationTestImportTsv is generating HFiles under the working directory of the
current hdfs user executing the tool, before bulkloading it into HBase.

Assuming you encrypt the HBase root directory within HDFS (using HDFS
Transparent Encryption), you can bulkload HFiles only if they sit in the same
encryption zone in HDFS as the HBase root directory itself.

When IntegrationTestImportTsv is executed against a real distributed cluster
and the working directory of the current user (e.g. /user/hbase) is not in the
same encryption zone as the HBase root directory (e.g. /hbase/data) then you
will get an exception:

```
ERROR org.apache.hadoop.hbase.regionserver.HRegion: There was a partial failure
due to IO when attempting to load d :
hdfs://mycluster/user/hbase/test-data/22d8460d-04cc-e032-88ca-2cc20a7dd01c/
IntegrationTestImportTsv/hfiles/d/74655e3f8da142cb94bc31b64f0475cc

org.apache.hadoop.ipc.RemoteException(java.io.IOException):
/user/hbase/test-data/22d8460d-04cc-e032-88ca-2cc20a7dd01c/
IntegrationTestImportTsv/hfiles/d/74655e3f8da142cb94bc31b64f0475cc
can't be moved into an encryption zone.
```

In this commit I make it configurable where the IntegrationTestImportTsv
generates the HFiles.

Co-authored-by: Mate Szalay-Beko <symat@apache.com>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2021-01-05 10:27:38 +01:00
Duo Zhang 81d17d063c HBASE-25457 Possible race in AsyncConnectionImpl between getChoreServ… (#2839) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-01-04 23:54:52 +08:00
Bo Cui ae77f81e7e HBASE-25447 remoteProc is suspended due to OOM ERROR (#2824) 
Some OMME can not cause the JVM to exit, like "java.lang.OutOfMemoryError: Direct buffer memory", "java.lang.OutOfMemoryError: unable to create new native thread", as they dont call vmError#next_OnError_command. So abort HMaster when uncaught exception occurs in TimeoutExecutor, the new active Hmaster will resume the suspended procedure.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: stack <stack@apache.com>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
(cherry picked from commit 600be60a4b)
 2021-01-04 21:12:50 +05:30
leyangyueshan e517bf7058 HBASE-25435 Slow metric value can be configured 
Signed-off-by: jediwang <jediwang@tencent.com>
 2021-01-04 13:14:57 +08:00
申胜利 d2c1886bf4 Shenshengli hbase-25450 The parameter "hbase.bucketcache.size" is misdescribed (#2821) 
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: stack <stack@apache.org>
 2021-01-03 09:31:10 -08:00
GeorryHuang 605240f8a9 HBASE-24751 Display Task completion time and/or processing duration on Web UI (#2815) 
Signed-off-by: stack <stack@apache.org>
 2021-01-02 11:25:31 -08:00
lujiefsi d0221083ca
HBASE-25456 : add security check for setRegionStateInMeta (#2834) (#2833) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-01-01 12:18:34 +05:30
Josh Elser 46ea169ea7 HBASE-25279 Make ZKWatcher ExecutorService launch daemon threads 
Closes #2651

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Yulin Niu <niuyulin@apache.org>
 2020-12-31 19:17:31 -05:00
Duo Zhang 15d27450c2 HBASE-25451 Upgrade commons-io to 2.8.0 (#2825) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: stack <stack@apache.org>
 2020-12-31 17:11:49 +08:00
lujiefsi 3166109b91
HBASE-25441 : add security check for some APIs in RSRpcServices (#2831) (#2810) 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-12-31 00:24:34 +05:30
Duo Zhang 9325a775fe HBASE-25452 Use MatcherAssert.assertThat instead of org.junit.Assert.assertThat (#2826) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2020-12-30 10:03:39 +08:00
Pankaj 382ebf3f4e HBASE-25379 Make retry pause time configurable for regionserver short operation RPC (reportRegionStateTransition/reportProcedureDone) (#2757) 
* HBASE-25379 Make retry pause time configurable for regionserver short operation RPC (reportRegionStateTransition/reportProcedureDone)
* HBASE-25379 RemoteProcedureResultReporter also should retry after the configured pause time
* Addressed the review comments

Signed-off-by: Yulin Niu <niuyulin@apache.org>
(cherry picked from commit c96fbf0407)
 2020-12-29 22:33:31 +05:30
lujiefsi e5c6467809
HBASE-25432: branch-2 add security checks for setTableStateInMeta and fixMeta (#2818) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-12-28 10:58:56 -08:00
ramkrish86 1c41c9732e HBASE-24850 CellComparator perf improvement (#2776) 
* Using ContiguousCellFormat as a marker alone

* Commit the new file

* Fix the comparator logic that was an oversight

* Fix the sequenceId check order

* Adding few more static methods that helps in scan flow like query
matcher where we have more cols

* Remove ContiguousCellFormat and ensure compare() can be inlined

* applying negation as per review comment

* Fix checkstyle comments

* fix review comments

* Address review comments

Signed-off-by: stack <stack@apache.org>
Signed-off-by: AnoopSamJohn <anoopsamjohn@apache.org>
Signed-off-by: huaxiangsun <huaxiangsun@apache.org>
 2020-12-28 13:08:50 +05:30
Huang Zhuoyue 73b0e8a216 HBASE-25443 Improve the experience of using the Master webpage by change the loading process of snapshot list to asynchronous (#2811) 
Signed-off-by: Yulin Niu <niuyulin@apache.org>
Signed-off-by: Ramkrishna S Vasudevan <ramkrishna@apache.org>
 2020-12-25 10:21:57 +08:00
stack b07b400b62 HBASE-25425 Some notes on RawCell 2020-12-21 08:13:42 -08:00
Lokesh Khurana 6eee9b1049
HBASE-24620 : Add a ClusterManager which submits command to ZooKeeper and its Agent which picks and execute those Commands (#2299) 
Signed-off-by: Aman Poonia <apoonia@salesforce.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-12-21 15:36:02 +05:30
scotthunt befa76f55a HBASE-25084 Add "regexstringnocase" to ParseFilter for case-insensitivity (#2784) 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2020-12-21 08:48:14 +00:00
Duo Zhang 1385fb3560 HBASE-25420 Some minor improvements in rpc implementation (#2792) 
Signed-off-by: XinSun <ddupgs@gmail.com>
Signed-off-by: stack <stack@apache.com>
 2020-12-20 11:30:16 +08:00
Akshay Sudheer 914b356d15 HBASE-25404 Procedures table Id under master web UI gets word break to single character (#2783) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2020-12-19 12:38:39 -08:00
huaxiangsun 8159fc8dbe
HBASE-25293 Followup jira to address the client handling issue when chaning from meta replica to non-meta-replica at the server side. (#2768) (#2786) 
Signed-off-by: stack <stack@apache.org>
 2020-12-18 09:25:04 -08:00
Sandeep Pal aa5a477426
HBASE-25383: Ability to update and remove peer base config 
Closes #2778

Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-12-18 14:20:36 +05:30
huaxiangsun 22dd0545b9
HBASE-25356 HBaseAdmin#getRegion() needs to filter out non-regionName and non-encodedRegionName (#2759) 
Signed-off-by: stack <stack@apache.org>
 2020-12-17 15:21:30 -08:00
haxl 32c4432b9b
HBASE-25334 TestRSGroupsFallback.testFallback is flaky (#2775) 
Signed-off-by: stack <stack@apache.org>
 2020-12-16 13:21:53 -08:00
stack 899a0d8654 HBASE-25400 [Flakey Tests] branch-2 TestRegionMoveAndAbandon 2020-12-16 10:35:34 -08:00
Baiqiang Zhao b6c03f2027
HBASE-25365 The log in move_servers_rsgroup is incorrect (#2743) 
Signed-off-by: stack <stack@apache.org>
 2020-12-16 09:13:57 -08:00
shahrs87 9b4be47c24
HBASE-25246 Backup/Restore hbase cell tags (#2766) 
Closes #2745

Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-12-16 18:59:19 +05:30
Pankaj 50890acda7 HBASE-25378 Legacy comparator in Hfile trailer will fail to load (#2756) 
Signed-off-by: stack <stack@apache.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 9bdac6cd17)
 2020-12-15 23:59:18 +05:30
Michael Stack aebcb2f192
HBASE-25389 [Flakey Tests] branch-2 TestMetaShutdownHandler (#2773) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2020-12-15 09:49:16 -08:00
Adam 9c2f1f7a2b HBASE-25370 Fix flaky test TestClassFinder#testClassFinderDefaultsToOwnPackage (#2740) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2020-12-11 08:23:49 +08:00