Commit Graph

15121 Commits

Author SHA1 Message Date
openinx d824bace4f HBASE-20165 Shell command to make a normal peer to be a serial replication peer 2018-03-13 16:23:59 +08:00
Mike Drob 9342e0091d HBASE-20153 Add error prone to precommit 2018-03-12 16:06:57 -05:00
Artem Ervits 774974889d HBASE-20177 Fix warning: Class org.apache.hadoop.minikdc.MiniKdc not found in hbase-spark
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-03-12 11:55:29 -07:00
Artem Ervits c8fba7071e HBASE-20176 Fix warnings about Logging import in hbase-spark test code
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-03-12 09:46:22 -07:00
BELUGA BEHR f30dfc69bb HBASE-19449 Minor logging change in HFileArchiver
Signed-off-by: Apekshit Sharma <appy@apache.org>
2018-03-12 22:01:56 +05:30
Chia-Ping Tsai 1102e1e252
HBASE-20171 Remove o.a.h.h.ProcedureState 2018-03-12 09:28:05 -07:00
maoling ec8aaeded8 HBASE-20058 improper quoting in presplitting command docs
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-03-12 23:33:59 +08:00
tedyu e8ee5c060d HBASE-20124 Make hbase-spark module work with hadoop3 2018-03-12 08:25:13 -07:00
maoling 62fc7fd3ea HBASE-20047 AuthenticationTokenIdentifier should provide a toString
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-03-12 22:06:08 +08:00
zhangduo 6060d3ba56 HBASE-20167 Optimize the implementation of ReplicationSourceWALReader 2018-03-12 15:14:16 +08:00
Vladimir Rodionov d5aaeee88b HBASE-19969: Improve fault tolerance in backup Merge operation
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-03-10 09:37:55 -08:00
Xiang LI 19a396b9c2 HBASE-20133 Calculate correct assignment and build region movement plans for mis-placed regions in one pass
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-03-10 07:09:45 -08:00
Umesh Agashe 45bbee4905 HBASE-20120 Removed unused classes/ java files from hbase-server
deleted:    hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/NoOpHeapMemoryTuner.java
deleted:    hbase-server/src/main/java/org/apache/hadoop/hbase/replication/BaseWALEntryFilter.java
deleted:    hbase-server/src/main/java/org/apache/hadoop/hbase/util/FSMapRUtils.java
deleted:    hbase-server/src/main/java/org/apache/hadoop/hbase/util/ProtoUtil.java
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-03-10 13:08:38 +08:00
Guangxu Cheng 70240f9732 HBASE-20132 Change the "KV" to "Cell" for web UI
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-03-10 12:27:59 +08:00
zhangduo dd6f4525e7 HBASE-20148 Make serial replication as a option for a peer instead of a table 2018-03-10 09:04:44 +08:00
Sean Busbey 15da74ccee HBASE-20162 [nightly] depending on pipeline execution we sometimes refer to the wrong workspace
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-03-09 17:22:00 -06:00
Mike Drob 28279697c2 HBASE-20164 add hadoopcheck link to table footer 2018-03-09 15:40:28 -06:00
Umesh Agashe 974200fca1 HBASE-20024 Fixed flakyness of TestMergeTableRegionsProcedure
We assumed that we can run for loop from 0 to lastStep sequentially. MergeTableRegionProcedure skips step 2. So, when i is 0 the procedure is already at step 3.
Added a method StateMachineProcedure#getCurrentStateId that can be used from test code only.
2018-03-09 12:45:39 -08:00
tedyu ee3a469641 HBASE-16179 Fix compilation errors when building hbase-spark against Spark 2.0
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-03-09 08:00:30 -08:00
Ashish Singhi 06550bc93b HBASE-20146 Regions are stuck while opening when WAL is disabled
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-03-09 21:10:16 +08:00
zhangduo 756cccecff HBASE-19598 Addendum fix typo 2018-03-09 15:37:22 +08:00
zhangduo 04798d6747 HBASE-19598 Addendum increase sync wait time 2018-03-09 15:34:24 +08:00
zhangduo 033485dff3 HBASE-19598 Fix TestAssignmentManagerMetrics flaky test 2018-03-09 11:47:55 +08:00
zhangduo a513678a79 HBASE-20160 TestRestartCluster.testRetainAssignmentOnRestart uses the wrong condition to decide whether the assignment is finished 2018-03-09 11:08:44 +08:00
Vladimir Rodionov 4e821d4916 HBASE-17851: WAL to HFile conversion phase MUST detect and handle missing WAL files
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-03-08 15:28:27 -08:00
zhangduo a03d09abd7 HBASE-20144 The shutdown of master will hang if there are no live region server 2018-03-08 15:05:57 +08:00
Sean Busbey 8e0674a2eb HBASE-18467 addendum parallel steps must account for SCM and marshalling results
* do a scm checkout on the stages that need access to source.
* ensure our install job runs on the ubuntu label
* copy jira comments to main workspace
* simplify the jira comment

Signed-off-by: Michael Stack <stack@apache.org>
2018-03-07 22:12:36 -06:00
Mike Drob 641e870e11 HBASE-19987 error-prone 2.2.0 2018-03-07 13:30:51 -06:00
Michael Stack 37d91cdfbb Revert "HBASE-20137 TestRSGroups is flakey"
Revert. Fix is not right.

This reverts commit 6d1740d498.
2018-03-07 09:26:21 -08:00
zhangduo 6b77786dfc HBASE-20125 Add UT for serial replication after region split and merge 2018-03-07 14:52:23 +08:00
Michael Stack 1bafe4a028 HBASE-8770 deletes and puts with the same ts should be resolved according to mvcc/seqNum 2018-03-06 11:34:08 -08:00
Michael Stack 1f5e93a8f8 HBASE-20137 TestRSGroups is flakey
On failed RPC we expire the server and suspend expecting the
resultant ServerCrashProcedure to wake us back up again. In tests,
TestRSGroup hung because it failed to schedule a server expiration
because the server was already expired undergoing processing (the
test was shutting down). Deal with this case by having expire
servers return false if unable to expire. Callers will then know
where a ServerCrashProcedure has been scheduled or not.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
  Have expireServer return true if successful.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/RegionTransitionProcedure.java
 The log that included an exception whose message was the current
procedure as a String totally baffled me. Make it more obvious what
exception is.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/UnassignProcedure.java
 If failed expire of a server, wake our procedure -- do not suspend --
and presume ok to move region to CLOSED state (because going down or
concurrent crashed server processing ongoing).
2018-03-06 10:55:40 -08:00
Sean Busbey 7889df3711 HBASE-20072 remove 1.1 release line from the prerequisite tables.
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
2018-03-06 12:24:21 -06:00
Sean Busbey ff7f5ecb0f HBASE-20134 dev-support scripts should use mktemp instead of hard-coding /tmp.
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-03-06 12:22:09 -06:00
tedyu b7fb2df154 HBASE-20136 TestKeyValue misses ClassRule and Category annotations 2018-03-06 08:34:49 -08:00
zhangduo 1384da7137 HBASE-20129 Add UT for serial replication checker 2018-03-06 16:43:01 +08:00
tedyu f89a1f7d7a HBASE-20121 Fix findbugs warning for RestoreTablesClient 2018-03-05 19:36:19 -08:00
Josh Elser 4a4c012049 HBASE-18135 Implement mechanism for RegionServers to report file archival for space quotas
This de-couples the snapshot size calculation from the
SpaceQuotaObserverChore into another API which both the periodically
invoked Master chore and the Master service endpoint can invoke. This
allows for multiple sources of snapshot size to reported (from the
multiple sources we have in HBase).

When a file is archived, snapshot sizes can be more quickly realized and
the Master can still perform periodical computations of the total
snapshot size to account for any delayed/missing/lost file archival RPCs.

Signed-off-by: Ted Yu <yuzhihong@gmail.com>
2018-03-05 17:32:42 -05:00
Josh Elser 2402f1fd43 HBASE-20108 Remove jline exclusion from ZooKeeper 2018-03-05 15:33:51 -05:00
zhangduo b7b8683925 HBASE-20115 Reimplement serial replication based on the new replication storage layer 2018-03-05 20:25:25 +08:00
Sean Busbey 485af49e53 HBASE-20070 addendum for missing echo. Website generation is failing. 2018-03-04 09:03:19 +05:30
Csaba Skrabak ff550edabf HBASE-19114 addendum. Split out o.a.h.h.zookeeper from hbase-server and hbase-client. Ruby scripts also used ZooKeeperWatcher.
Signed-off-by: Apekshit Sharma <appy@apache.org>
2018-03-03 21:06:53 +05:30
Michael Stack 2b1b2c8490 HBASE-20122 Up timeout on nightlies to 9 hours from 8 on branch-2 and
master
2018-03-03 07:35:23 -08:00
haxiaolin 1d25b60831 HBASE-20114 Fix IllegalFormatConversionException in rsgroup.jsp
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-03-02 09:00:28 -08:00
Chia-Ping Tsai db131be39a HBASE-19437 Batch operation can't handle the null result for Append/Increment
Signed-off-by: anoopsamjohn <anoopsamjohn@gmail.com>
Signed-off-by: Michael Stack <stack@apache.org>
2018-03-02 23:31:56 +08:00
Sean Busbey 2a65066b35 HBASE-20070 refactor website generation
* rely on git plumbing commands when checking if we've built the site for a particular commit already
* switch to forcing '-e' for bash
* add command line switches for: path to hbase, working directory, and publishing
* only export JAVA/MAVEN HOME if they aren't already set.
* add some docs about assumptions
* Update javadoc plugin to consistently be version 3.0.0
* avoid duplicative site invocations on reactor modules
* update use of cp command so it works both on linux and mac
* manually skip enforcer plugin during build
* still doing install of all jars due to MJAVADOC-490, but then skip rebuilding during aggregate reports.
* avoid the pager on git-diff by teeing to a log file, which also helps later reviewing in the case of big changesets.

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Misty Stanley-Jones <misty@apache.org>
2018-03-02 09:25:10 -06:00
huzheng 99d3edfc82 HBASE-20050 Reimplement updateReplicationPositions logic in serial replication based on the newly introduced replication storage layer
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-03-02 15:53:14 +08:00
Sean Busbey c415ddb38c HBASE-20075 remove logic for branch-1.1 nightly testing
Signed-off-by: Michael Stack <stack@apache.org>
2018-03-01 15:28:30 -06:00
Sean Busbey 383b7cc592 HBASE-15151 ensure findbugs check runs in nightly tests on all branches.
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-03-01 15:21:40 -06:00
Sean Busbey ddc9af9027 HBASE-18467 report nightly results to devs via jira
- rely on parallel pipeline to ensure all stages always run
- define non-CPS jira commenting function
- comment on jiras in the changeset with summary and links

Signed-off-by: Mike Drob <mdrob@apache.org>
2018-03-01 13:11:59 -06:00