Apache/hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,135 Commits 95 Branches 866 Tags
Commit Graph

17135 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
WenFeiYi
e1d1304cb1
HBASE-24578 [WAL] Add a parameter to config RingBufferEventHandler's SyncFuture count 
Signed-off-by: Reid Chan <reidchan@apache.org>
 2020-07-14 10:39:19 +08:00
Geoffrey Jacoby
a3567037c6
HBASE-23744 - FastPathBalancedQueueRpcExecutor should enforce queue length of 0 
Closes #1094

Signed-off-by: Xu Cang <xucang@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-07-13 12:19:02 +05:30
Zheng Wang
fce1df9a3c
HBASE-24586 Add table level locality in table.jsp 
Closes #2048

Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-07-11 17:20:22 +05:30
chenglei
deff4c88d3
HBASE-24625 AsyncFSWAL.getLogFileSizeIfBeingWritten does not return the expected synced file length.(#2034) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2020-07-11 16:35:10 +08:00
Joseph295
ff2951e672 HBASE-24663 Add procedure process time statistics UI (#2035) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2020-07-10 15:05:57 +08:00
niuyulin
eee467d119 HBASE-24653 Show snapshot owner on Master WebUI (#2016) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2020-07-10 15:05:48 +08:00
XinSun
3a33f642bf
HBASE-22738 Fallback to default group to choose RS when there are no RS in current group (#2039) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2020-07-10 09:59:58 +08:00
XinSun
5fcffae5db
HBASE-24431 RSGroupInfo add configuration map to store something extra (#2031) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2020-07-08 14:39:41 +08:00
Toshihiro Suzuki
f771fd26b4
HBASE-24650 Change the return types of the new checkAndMutate methods introduced in HBASE-8458 (#2033) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2020-07-08 08:00:48 +09:00
Duo Zhang
28602d6fdb Revert "HBASE-24625 AsyncFSWAL.getLogFileSizeIfBeingWritten does not return the expected synced file length. (#1970)" 
This reverts commit f8349199290a642c91908dd13037227f9eaebb35.
 2020-07-07 18:16:58 +08:00
WenFeiYi
5416cef27f HBASE-24546 CloneSnapshotProcedure unlimited retry (#1900) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2020-07-06 13:59:07 +08:00
Baiqiang Zhao
0e74a8c86b
HBASE-24671 Add excludefile and designatedfile options to graceful_stop.sh 
Closes #2013

Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-07-05 19:35:27 +05:30
chenglei
f834919929 HBASE-24625 AsyncFSWAL.getLogFileSizeIfBeingWritten does not return the expected synced file length. (#1970) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2020-07-04 21:12:07 +08:00
David Manning
25e929bdf0
HBASE-24657 add unit test for JSONBean.java 
Closes #2004

Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-07-02 18:51:13 +05:30
Baiqiang Zhao
cb154d50aa
HBASE-24560 Add a new option of designatedfile in RegionMover 
Closes #1901

Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-07-01 20:28:35 +05:30
pengmq1
2a12fd283e HBASE-24289 Heterogeneous Storage for Date Tiered Compaction (#1730) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2020-06-30 15:19:30 +08:00
stack
0dd42f7916 HBASE-24648 Remove the legacy 'forceSplit' related code at region server side (#1990) 
Addendum to fix TestHeapSize
 2020-06-29 14:19:44 -07:00
Michael Stack
91da188d78
HBASE-24656 [Flakey Tests] branch-2 TestMasterNoCluster.testStopDuringStart (#1998) 2020-06-29 11:10:14 -07:00
Nick Dimiduk
5b8afaeacd HBASE-24144 Update docs from master (addendum) 
Bring back documentation from master branch (37b863bd0b), using

```
$ git checkout master -- src/main/asciidoc/
$ git checkout master -- src/site/asciidoc/
```

And then:
 * remove changes from HBASE-23890
   This reverts commit 420e38083f13ebf9ca056d2ee2de2192c23801c7.
 * delete docs re: sync_replication
 * delete docs re: backup
 2020-06-29 08:33:30 -07:00
Duo Zhang
3effd28a75 HBASE-24648 Remove the legacy 'forceSplit' related code at region server side (#1990) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-06-29 23:16:21 +08:00
Duo Zhang
ed6104418c HBASE-24646 Set the log level for ScheduledChore to INFO in HBTU (#1987) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: stack <stack@apache.org>
 2020-06-28 23:27:42 +08:00
Viraj Jasani
0fe85947ec
HBASE-24588 : Submit task for NormalizationPlan (#1933) (#1983) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2020-06-28 01:10:42 +05:30
Duo Zhang
7c78356218 HBASE-24635 Split TestMetaWithReplicas (#1980) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2020-06-27 11:11:36 +08:00
huaxiangsun
2c201cc034
HBASE-24552 Replica region needs to check if primary region directory exists at file system in TransitRegionStateProcedure (#1924) (#1971) 
Signed-off-by:  stack <stack@apache.org>
 2020-06-26 11:27:30 -07:00
Nick Dimiduk
a499eae1aa HBASE-24221 addendum to restore public interface on LoadIncrementalHFiles 
Signed-off-by: niuyulin <nyl353@163.com>
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-06-26 09:06:32 -07:00
BukrosSzabolcs
50d1a79255 HBASE-24562: Stabilize master startup with meta replicas enabled (#1903) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.com>
(cherry picked from commit 8cdb2cca4461d6adad3f44af001055848a205370)
 2020-06-26 16:50:55 +01:00
Bharath Vissapragada
a6c887012e
HBASE-24603: Make Zookeeper sync() call synchronous (#1945) (#1975) 
Writing a test for this is tricky. There is enough coverage for
functional tests. Only concern is performance, but there is enough
logging for it to detect timed out/badly performing sync calls.

Additionally, this patch decouples the ZK event processing into it's
own thread rather than doing it in the EventThread's context. That
avoids deadlocks and stalls of the event thread.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 84e246f9b197bfa4307172db5465214771b78d38)
 2020-06-25 16:41:11 -07:00
Michael Stack
e6639f9d4e
HBASE-24616 Remove BoundedRecoveredHFilesOutputSink dependency on a TableDescriptor (#1955) 
Purge query Master for table descriptors; make do w/ generic options.

Logging cleanup.

hbase-server/src/main/java/org/apache/hadoop/hbase/wal/BoundedRecoveredHFilesOutputSink.java
 Undo fetching Table Descriptor. Not reliably available at recovery time.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2020-06-25 11:45:06 -07:00
Nick Dimiduk
3db4f00f24 HBASE-22504 Addendum: restore findCommonPrefix 
Address incompatibility issue raised in 2.3.0RC0 vote thread.
 2020-06-25 11:17:22 -07:00
Nick Dimiduk
eb16b4a782 HBASE-24631 Loosen Dockerfile pinned package versions of the "debian-revision" (#1965) 
After a bit of research into [0] and [1], and a bit of
experimentation, it seems we can use a partial wild-card expression
for these version strings. Let's try this for now. If it works out, we
should expand this usage to all the version package numbers, pinning
them to their epic:upstream-version components.

[0]: http://manpages.ubuntu.com/manpages/xenial/en/man5/deb-version.5.html
[1]: http://manpages.ubuntu.com/manpages/xenial/man8/apt-get.8.html

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2020-06-25 22:26:06 +08:00
Toshihiro Suzuki
a701f0ef32 HBASE-24600 Empty RegionAction added to MultiRequest in case of RowMutations/CheckAndMutate batch 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2020-06-25 09:58:57 +09:00
Nick Dimiduk
d0422748f1 HBASE-24630 Purge dev javadoc from client bin tarball 
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
 2020-06-24 17:14:02 -07:00
Wellington Ramos Chevreuil
017c374519 HBASE-21773 - Addendum - Bring back "public static Job createSubmitta… (#1953) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>

(cherry picked from commit edf75f2535b6f6853a997525efe3f6f4ef4984b1)
 2020-06-23 15:17:22 +01:00
Michael Stack
c4042f4927
HBASE-23055 Alter hbase:meta (#1956) 
Addendum to fix illegal removal of unused constant w/o
a deprecation cycle.
 2020-06-22 20:20:42 -07:00
xincunSong
a787d2e292 HBASE-24605 Break long region names in the web UI (#1942) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Guangxu Cheng <gxcheng@apache.org>
 2020-06-23 10:06:31 +08:00
Viraj Jasani
4506f8d8ab
HBASE-24102 : Undo visibility change for RegionMover fields (ADDENDUM) 2020-06-22 22:48:54 +05:30
Viraj Jasani
f3d47d3c8e
HBASE-24611 : Fix for ambiguous reference (ADDENDUM) 2020-06-22 15:13:18 +05:30
Viraj Jasani
672525841a
HBASE-24611 : Bring back old constructor of SnapshotDescription as deprecated (#1944) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2020-06-22 12:14:23 +05:30
Viraj Jasani
92b6621fa5
HBASE-24594 : Separate resource allocation for TestReplicationStatusSink (#1934) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2020-06-21 16:15:31 +05:30
Sandeep Pal
0527c2c70d
HBASE-23126: Removing the un-used integration test class - IntegrationTestRSGroup 
Closes #1936

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-06-20 22:51:03 +05:30
Viraj Jasani
48fda91c5b
HBASE-24380 : Provide WAL splitting journal logging (#1860) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/wal/BoundedRecoveredEditsOutputSink.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/wal/BoundedRecoveredHFilesOutputSink.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/wal/RecoveredEditsOutputSink.java
 2020-06-19 16:27:48 -07:00
WenFeiYi
30a6c63827
HBASE-24550 Passing '-h' or '--help' to bin/hbase doesn't do as expected (ADDENDUM) 
Closes #1932

Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-06-19 22:53:28 +05:30
QilinCao
c482ba866c HBASE-24516 Parameter copyFiles should be passed in SecureBulkLoadClient (#1868) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2020-06-19 14:50:20 +08:00
stack
7b171a3c1a HBASE-24574 Procedure V2 - Distributed WAL Splitting => LOGGING (#1912) 
Addendum; minor log edits
 2020-06-18 08:37:19 -07:00
Michael Stack
6eb93287cc
HBASE-24574 Procedure V2 - Distributed WAL Splitting => LOGGING (#1912) 
hbase-server/src/main/java/org/apache/hadoop/hbase/master/SplitLogManager.java
 Don't register as a chore on construction if no coordination state
 manager instance (there is no instance when procv2 WAL splitter).

hbase-server/src/main/java/org/apache/hadoop/hbase/master/SplitWALManager.java
hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
 Edit logs.

hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/RegionRemoteProcedureBase.java
hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/RegionTransitionProcedure.java
hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/ServerCrashProcedure.java
hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/SplitWALProcedure.java
hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/SplitWALRemoteProcedure.java
 Add proc name rather than rely on default behavior. Add detail to the
 toString.

hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
 Factoring

hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/AbstractFSWAL.java
 Print the maxLogs... we don't do it any where.

hbase-server/src/main/java/org/apache/hadoop/hbase/wal/WAL.java
 Utility method to strip prefix from wal path.

Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: tianjingyun <tianjy@apache.org>
 2020-06-18 08:32:48 -07:00
ramkrish86
ef809c198b
HBASE-24205 - Create metric to know the number of reads that happens (#1920) 
* HBASE-24205 - Create metric to know the number of reads that happens
from memstore (branch-2)

* Add the optimization as in master and fix whitestyle and checkstyle

* Fix compilation error that accidently crept in

Authored-by: Ramkrishna <ramkrishna@apache.org>
Signed-off by:Anoop Sam John<anoopsamjohn@gmail.com>
Signed-off by:Viraj Jasani<virajjasani@apache.org>
 2020-06-18 18:59:46 +05:30
BukrosSzabolcs
701d36f88b HBASE-24579: Failed SASL authentication does not result in an exception on client side (#1921) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit bd79c4065ccb13a5e217d844376b3e7b9489d2fe)
 2020-06-18 12:36:09 +01:00
WenFeiYi
0250374aad
HBASE-24550 Passing '-h' or '--help' to bin/hbase doesn't do as expected 
Closes #1914

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-06-18 15:44:51 +05:30
Michael Stack
812d1e2bb5
HBASE-24577 Doc WALSplitter classes (#1913) 
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2020-06-17 14:59:30 -07:00
Viraj Jasani
e202c98fb0
HBASE-24518 : waitForNamespaceOnline() should return false if any region is offline (#1869) 
Signed-off-by: ramkrish86 <ramkrishna@apache.org>
 2020-06-17 20:05:15 +05:30