Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,270 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

17270 Commits

Author SHA1 Message Date
pengmq1 2a12fd283e HBASE-24289 Heterogeneous Storage for Date Tiered Compaction (#1730) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2020-06-30 15:19:30 +08:00
stack 0dd42f7916 HBASE-24648 Remove the legacy 'forceSplit' related code at region server side (#1990) 
Addendum to fix TestHeapSize
 2020-06-29 14:19:44 -07:00
Michael Stack 91da188d78
HBASE-24656 [Flakey Tests] branch-2 TestMasterNoCluster.testStopDuringStart (#1998) 2020-06-29 11:10:14 -07:00
Nick Dimiduk 5b8afaeacd HBASE-24144 Update docs from master (addendum) 
Bring back documentation from master branch (37b863bd0b), using

```
$ git checkout master -- src/main/asciidoc/
$ git checkout master -- src/site/asciidoc/
```

And then:
 * remove changes from HBASE-23890
   This reverts commit 420e38083f.
 * delete docs re: sync_replication
 * delete docs re: backup
 2020-06-29 08:33:30 -07:00
Duo Zhang 3effd28a75 HBASE-24648 Remove the legacy 'forceSplit' related code at region server side (#1990) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-06-29 23:16:21 +08:00
Duo Zhang ed6104418c HBASE-24646 Set the log level for ScheduledChore to INFO in HBTU (#1987) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: stack <stack@apache.org>
 2020-06-28 23:27:42 +08:00
Viraj Jasani 0fe85947ec
HBASE-24588 : Submit task for NormalizationPlan (#1933) (#1983) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2020-06-28 01:10:42 +05:30
Duo Zhang 7c78356218 HBASE-24635 Split TestMetaWithReplicas (#1980) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2020-06-27 11:11:36 +08:00
huaxiangsun 2c201cc034
HBASE-24552 Replica region needs to check if primary region directory exists at file system in TransitRegionStateProcedure (#1924) (#1971) 
Signed-off-by:  stack <stack@apache.org>
 2020-06-26 11:27:30 -07:00
Nick Dimiduk a499eae1aa HBASE-24221 addendum to restore public interface on LoadIncrementalHFiles 
Signed-off-by: niuyulin <nyl353@163.com>
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-06-26 09:06:32 -07:00
BukrosSzabolcs 50d1a79255 HBASE-24562: Stabilize master startup with meta replicas enabled (#1903) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.com>
(cherry picked from commit 8cdb2cca44)
 2020-06-26 16:50:55 +01:00
Bharath Vissapragada a6c887012e
HBASE-24603: Make Zookeeper sync() call synchronous (#1945) (#1975) 
Writing a test for this is tricky. There is enough coverage for
functional tests. Only concern is performance, but there is enough
logging for it to detect timed out/badly performing sync calls.

Additionally, this patch decouples the ZK event processing into it's
own thread rather than doing it in the EventThread's context. That
avoids deadlocks and stalls of the event thread.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 84e246f9b1)
 2020-06-25 16:41:11 -07:00
Michael Stack e6639f9d4e
HBASE-24616 Remove BoundedRecoveredHFilesOutputSink dependency on a TableDescriptor (#1955) 
Purge query Master for table descriptors; make do w/ generic options.

Logging cleanup.

hbase-server/src/main/java/org/apache/hadoop/hbase/wal/BoundedRecoveredHFilesOutputSink.java
 Undo fetching Table Descriptor. Not reliably available at recovery time.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2020-06-25 11:45:06 -07:00
Nick Dimiduk 3db4f00f24 HBASE-22504 Addendum: restore findCommonPrefix 
Address incompatibility issue raised in 2.3.0RC0 vote thread.
 2020-06-25 11:17:22 -07:00
Nick Dimiduk eb16b4a782 HBASE-24631 Loosen Dockerfile pinned package versions of the "debian-revision" (#1965) 
After a bit of research into [0] and [1], and a bit of
experimentation, it seems we can use a partial wild-card expression
for these version strings. Let's try this for now. If it works out, we
should expand this usage to all the version package numbers, pinning
them to their epic:upstream-version components.

[0]: http://manpages.ubuntu.com/manpages/xenial/en/man5/deb-version.5.html
[1]: http://manpages.ubuntu.com/manpages/xenial/man8/apt-get.8.html

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2020-06-25 22:26:06 +08:00
Toshihiro Suzuki a701f0ef32 HBASE-24600 Empty RegionAction added to MultiRequest in case of RowMutations/CheckAndMutate batch 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2020-06-25 09:58:57 +09:00
Nick Dimiduk d0422748f1 HBASE-24630 Purge dev javadoc from client bin tarball 
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
 2020-06-24 17:14:02 -07:00
Wellington Ramos Chevreuil 017c374519 HBASE-21773 - Addendum - Bring back "public static Job createSubmitta… (#1953) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>

(cherry picked from commit edf75f2535)
 2020-06-23 15:17:22 +01:00
Michael Stack c4042f4927
HBASE-23055 Alter hbase:meta (#1956) 
Addendum to fix illegal removal of unused constant w/o
a deprecation cycle.
 2020-06-22 20:20:42 -07:00
xincunSong a787d2e292 HBASE-24605 Break long region names in the web UI (#1942) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Guangxu Cheng <gxcheng@apache.org>
 2020-06-23 10:06:31 +08:00
Viraj Jasani 4506f8d8ab
HBASE-24102 : Undo visibility change for RegionMover fields (ADDENDUM) 2020-06-22 22:48:54 +05:30
Viraj Jasani f3d47d3c8e
HBASE-24611 : Fix for ambiguous reference (ADDENDUM) 2020-06-22 15:13:18 +05:30
Viraj Jasani 672525841a
HBASE-24611 : Bring back old constructor of SnapshotDescription as deprecated (#1944) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2020-06-22 12:14:23 +05:30
Viraj Jasani 92b6621fa5
HBASE-24594 : Separate resource allocation for TestReplicationStatusSink (#1934) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2020-06-21 16:15:31 +05:30
Sandeep Pal 0527c2c70d
HBASE-23126: Removing the un-used integration test class - IntegrationTestRSGroup 
Closes #1936

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-06-20 22:51:03 +05:30
Viraj Jasani 48fda91c5b
HBASE-24380 : Provide WAL splitting journal logging (#1860) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/wal/BoundedRecoveredEditsOutputSink.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/wal/BoundedRecoveredHFilesOutputSink.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/wal/RecoveredEditsOutputSink.java
 2020-06-19 16:27:48 -07:00
WenFeiYi 30a6c63827
HBASE-24550 Passing '-h' or '--help' to bin/hbase doesn't do as expected (ADDENDUM) 
Closes #1932

Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-06-19 22:53:28 +05:30
QilinCao c482ba866c HBASE-24516 Parameter copyFiles should be passed in SecureBulkLoadClient (#1868) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2020-06-19 14:50:20 +08:00
stack 7b171a3c1a HBASE-24574 Procedure V2 - Distributed WAL Splitting => LOGGING (#1912) 
Addendum; minor log edits
 2020-06-18 08:37:19 -07:00
Michael Stack 6eb93287cc
HBASE-24574 Procedure V2 - Distributed WAL Splitting => LOGGING (#1912) 
hbase-server/src/main/java/org/apache/hadoop/hbase/master/SplitLogManager.java
 Don't register as a chore on construction if no coordination state
 manager instance (there is no instance when procv2 WAL splitter).

hbase-server/src/main/java/org/apache/hadoop/hbase/master/SplitWALManager.java
hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
 Edit logs.

hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/RegionRemoteProcedureBase.java
hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/RegionTransitionProcedure.java
hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/ServerCrashProcedure.java
hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/SplitWALProcedure.java
hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/SplitWALRemoteProcedure.java
 Add proc name rather than rely on default behavior. Add detail to the
 toString.

hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
 Factoring

hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/AbstractFSWAL.java
 Print the maxLogs... we don't do it any where.

hbase-server/src/main/java/org/apache/hadoop/hbase/wal/WAL.java
 Utility method to strip prefix from wal path.

Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: tianjingyun <tianjy@apache.org>
 2020-06-18 08:32:48 -07:00
ramkrish86 ef809c198b
HBASE-24205 - Create metric to know the number of reads that happens (#1920) 
* HBASE-24205 - Create metric to know the number of reads that happens
from memstore (branch-2)

* Add the optimization as in master and fix whitestyle and checkstyle

* Fix compilation error that accidently crept in

Authored-by: Ramkrishna <ramkrishna@apache.org>
Signed-off by:Anoop Sam John<anoopsamjohn@gmail.com>
Signed-off by:Viraj Jasani<virajjasani@apache.org>
 2020-06-18 18:59:46 +05:30
BukrosSzabolcs 701d36f88b HBASE-24579: Failed SASL authentication does not result in an exception on client side (#1921) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit bd79c4065c)
 2020-06-18 12:36:09 +01:00
WenFeiYi 0250374aad
HBASE-24550 Passing '-h' or '--help' to bin/hbase doesn't do as expected 
Closes #1914

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-06-18 15:44:51 +05:30
Michael Stack 812d1e2bb5
HBASE-24577 Doc WALSplitter classes (#1913) 
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2020-06-17 14:59:30 -07:00
Viraj Jasani e202c98fb0
HBASE-24518 : waitForNamespaceOnline() should return false if any region is offline (#1869) 
Signed-off-by: ramkrish86 <ramkrishna@apache.org>
 2020-06-17 20:05:15 +05:30
Bharath Vissapragada c49df36e85 HBASE-24564: Make RS abort call idempotent. 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 2567d15218)
 2020-06-16 08:43:06 -07:00
xincunSong 36ee96ca36 HBASE-24478 The regionInfo parameter for MasterProcedureScheduler#wai… (#1819) 
Signed-off-by: Guangxu Cheng <gxcheng@apache.org>
Signed-off-by: clarax <clarax98007@gmail.com>
 2020-06-16 17:35:17 +08:00
Wellington Ramos Chevreuil 3551ddfdad HBASE-21405 [DOC] Add Details about Output of "status 'replication'" (#1894) 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
    Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 3ac99ad192)
 2020-06-16 10:14:21 +01:00
Sandeep Pal cb3d0d7d21
HBASE-24015: Test for Assign and Unassign of Regions on RegionServer on failure (#1898) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-06-16 12:54:02 +05:30
Nick Dimiduk c592b50b7b HBASE-24144 Update docs from master 
Bring back documentation from master branch (2ecbaf130e), using

```
$ git checkout master -- src/main/asciidoc/
$ git checkout master -- src/site/asciidoc/
```

And then:
 * remove changes from HBASE-23890
   This reverts commit 420e38083f.
 * delete docs re: sync_replication
 * delete docs re: backup
 2020-06-15 13:23:31 -07:00
bsglz 035ea516e9
HBASE-24038 Add a metric to show the locality of ssd in table.jsp (#1902) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-06-15 19:28:07 +05:30
Viraj Jasani 8b45b0c787
HBASE-24547 : Thrift support for HBASE-23941 (Operator support for get_slowlog_responses API) (#1892) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2020-06-15 15:47:53 +05:30
Duo Zhang 700c5a7e3b HBASE-24517 Addendum add more comments (#1882) 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-06-15 10:44:30 +08:00
Toshihiro Suzuki 6ff6fe49a3
HBASE-8458 Support for batch version of checkAndMutate() (#1897) 
Signed-off-by: Josh Elser <elserj@apache.org>
 2020-06-14 13:55:06 +09:00
zhaoym6 2d57595f54 HBASE-23195 FSDataInputStreamWrapper unbuffer can NOT invoke the classes that NOT implements CanUnbuffer but its parents class implements CanUnbuffer 
Closes #746

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
 2020-06-12 13:27:53 -04:00
Michael Stack a4e1d073f4 HBASE-24545 Add backoff to SCP check on WAL split completion (#1891) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2020-06-12 07:58:02 -07:00
sguggilam d187ce2029
HBASE-24446 Use EnvironmentEdgeManager to compute clock skew in Master (#1885) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-06-12 16:52:15 +05:30
Toshihiro Suzuki 043a9e862f HBASE-24529 hbase.rs.evictblocksonclose is not honored when removing compacted files and closing the storefiles (#1881) 
Signed-off-by: Anoop Sam John <anoop.hbase@gmail.com>
 2020-06-12 19:02:20 +09:00
Anoop Sam John ed7dc9ed4c HBASE-24189 WALSplit recreates region dirs for deleted table with recovered edits data. 2020-06-11 21:28:32 +05:30
Viraj Jasani 1b1c269911
HBASE-24532 : Execute region plans with throttle should return succeeded plans (#1884) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2020-06-11 18:23:32 +05:30