Commit Graph

15080 Commits

Author SHA1 Message Date
BELUGA BEHR 000a84cb4a HBASE-20181 Logging and minor logic improvements in BackupLogCleaner
Signed-off-by: Apekshit Sharma <appy@apache.org>
2018-03-14 12:30:04 +05:30
Apekshit Sharma 810567f65a Revert "HBASE-20181 Logging and minor logic improvements in BackupLogCleaner" - missed author
This reverts commit 5bfc5745ab.
2018-03-14 12:29:24 +05:30
anoopsamjohn e83ac38d68 HBASE-20078 MultiByteBuff : bug in reading primitives when individual buffers are too small. 2018-03-14 12:07:57 +05:30
Apekshit Sharma 5bfc5745ab HBASE-20181 Logging and minor logic improvements in BackupLogCleaner 2018-03-14 09:56:46 +05:30
zhangduo b7308ee01c HBASE-20117 Cleanup the unused replication barriers in meta table 2018-03-14 12:08:15 +08:00
Mike Grimes b16e03c130 HBASE-17165 Make use of retry setting in LoadIncrementalHFiles & fix test 2018-03-13 15:00:36 -07:00
Sahil Aggarwal 1b66444846 HBASE-19075: Fix the 'tasks' table on master info page to not scroll up on clicking the tab 2018-03-13 14:26:16 -07:00
Michael Stack 72c3d27bf6 HBASE-20173 [AMv2] DisableTableProcedure concurrent to ServerCrashProcedure can deadlock
Allow that DisableTableProcedue can grab a region lock before
ServerCrashProcedure can. Cater to this cricumstance where SCP
was not unable to make progress by running the search for RIT
against the crashed server a second time, post creation of all
crashed-server assignemnts. The second run will uncover such as
the above DisableTableProcedure unassign and will interrupt its
suspend allowing both procedures to make progress.

M hbase-protocol-shaded/src/main/protobuf/MasterProcedure.proto
 Add new procedure step post-assigns that reruns the RIT finder method.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
 Make this important log more specific as to what is going on.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/UnassignProcedure.java
 Better explanation as to what is going on.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/ServerCrashProcedure.java
 Add extra step and run handleRIT a second time after we've queued up
 all SCP assigns. Also fix a but. SCP was adding an assign of a RIT
 that was actually trying to unassign (made the deadlock more likely).
2018-03-13 06:04:36 -07:00
Peter Somogyi b037db4e87 HBASE-19802 Wrong usage messages on shell commands (grant/revoke namespace syntax) (Csaba Skrabak) 2018-03-13 10:56:34 +01:00
openinx d824bace4f HBASE-20165 Shell command to make a normal peer to be a serial replication peer 2018-03-13 16:23:59 +08:00
Mike Drob 9342e0091d HBASE-20153 Add error prone to precommit 2018-03-12 16:06:57 -05:00
Artem Ervits 774974889d HBASE-20177 Fix warning: Class org.apache.hadoop.minikdc.MiniKdc not found in hbase-spark
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-03-12 11:55:29 -07:00
Artem Ervits c8fba7071e HBASE-20176 Fix warnings about Logging import in hbase-spark test code
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-03-12 09:46:22 -07:00
BELUGA BEHR f30dfc69bb HBASE-19449 Minor logging change in HFileArchiver
Signed-off-by: Apekshit Sharma <appy@apache.org>
2018-03-12 22:01:56 +05:30
Chia-Ping Tsai 1102e1e252
HBASE-20171 Remove o.a.h.h.ProcedureState 2018-03-12 09:28:05 -07:00
maoling ec8aaeded8 HBASE-20058 improper quoting in presplitting command docs
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-03-12 23:33:59 +08:00
tedyu e8ee5c060d HBASE-20124 Make hbase-spark module work with hadoop3 2018-03-12 08:25:13 -07:00
maoling 62fc7fd3ea HBASE-20047 AuthenticationTokenIdentifier should provide a toString
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-03-12 22:06:08 +08:00
zhangduo 6060d3ba56 HBASE-20167 Optimize the implementation of ReplicationSourceWALReader 2018-03-12 15:14:16 +08:00
Vladimir Rodionov d5aaeee88b HBASE-19969: Improve fault tolerance in backup Merge operation
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-03-10 09:37:55 -08:00
Xiang LI 19a396b9c2 HBASE-20133 Calculate correct assignment and build region movement plans for mis-placed regions in one pass
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-03-10 07:09:45 -08:00
Umesh Agashe 45bbee4905 HBASE-20120 Removed unused classes/ java files from hbase-server
deleted:    hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/NoOpHeapMemoryTuner.java
deleted:    hbase-server/src/main/java/org/apache/hadoop/hbase/replication/BaseWALEntryFilter.java
deleted:    hbase-server/src/main/java/org/apache/hadoop/hbase/util/FSMapRUtils.java
deleted:    hbase-server/src/main/java/org/apache/hadoop/hbase/util/ProtoUtil.java
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-03-10 13:08:38 +08:00
Guangxu Cheng 70240f9732 HBASE-20132 Change the "KV" to "Cell" for web UI
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-03-10 12:27:59 +08:00
zhangduo dd6f4525e7 HBASE-20148 Make serial replication as a option for a peer instead of a table 2018-03-10 09:04:44 +08:00
Sean Busbey 15da74ccee HBASE-20162 [nightly] depending on pipeline execution we sometimes refer to the wrong workspace
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-03-09 17:22:00 -06:00
Mike Drob 28279697c2 HBASE-20164 add hadoopcheck link to table footer 2018-03-09 15:40:28 -06:00
Umesh Agashe 974200fca1 HBASE-20024 Fixed flakyness of TestMergeTableRegionsProcedure
We assumed that we can run for loop from 0 to lastStep sequentially. MergeTableRegionProcedure skips step 2. So, when i is 0 the procedure is already at step 3.
Added a method StateMachineProcedure#getCurrentStateId that can be used from test code only.
2018-03-09 12:45:39 -08:00
tedyu ee3a469641 HBASE-16179 Fix compilation errors when building hbase-spark against Spark 2.0
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-03-09 08:00:30 -08:00
Ashish Singhi 06550bc93b HBASE-20146 Regions are stuck while opening when WAL is disabled
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-03-09 21:10:16 +08:00
zhangduo 756cccecff HBASE-19598 Addendum fix typo 2018-03-09 15:37:22 +08:00
zhangduo 04798d6747 HBASE-19598 Addendum increase sync wait time 2018-03-09 15:34:24 +08:00
zhangduo 033485dff3 HBASE-19598 Fix TestAssignmentManagerMetrics flaky test 2018-03-09 11:47:55 +08:00
zhangduo a513678a79 HBASE-20160 TestRestartCluster.testRetainAssignmentOnRestart uses the wrong condition to decide whether the assignment is finished 2018-03-09 11:08:44 +08:00
Vladimir Rodionov 4e821d4916 HBASE-17851: WAL to HFile conversion phase MUST detect and handle missing WAL files
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-03-08 15:28:27 -08:00
zhangduo a03d09abd7 HBASE-20144 The shutdown of master will hang if there are no live region server 2018-03-08 15:05:57 +08:00
Sean Busbey 8e0674a2eb HBASE-18467 addendum parallel steps must account for SCM and marshalling results
* do a scm checkout on the stages that need access to source.
* ensure our install job runs on the ubuntu label
* copy jira comments to main workspace
* simplify the jira comment

Signed-off-by: Michael Stack <stack@apache.org>
2018-03-07 22:12:36 -06:00
Mike Drob 641e870e11 HBASE-19987 error-prone 2.2.0 2018-03-07 13:30:51 -06:00
Michael Stack 37d91cdfbb Revert "HBASE-20137 TestRSGroups is flakey"
Revert. Fix is not right.

This reverts commit 6d1740d498.
2018-03-07 09:26:21 -08:00
zhangduo 6b77786dfc HBASE-20125 Add UT for serial replication after region split and merge 2018-03-07 14:52:23 +08:00
Michael Stack 1bafe4a028 HBASE-8770 deletes and puts with the same ts should be resolved according to mvcc/seqNum 2018-03-06 11:34:08 -08:00
Michael Stack 1f5e93a8f8 HBASE-20137 TestRSGroups is flakey
On failed RPC we expire the server and suspend expecting the
resultant ServerCrashProcedure to wake us back up again. In tests,
TestRSGroup hung because it failed to schedule a server expiration
because the server was already expired undergoing processing (the
test was shutting down). Deal with this case by having expire
servers return false if unable to expire. Callers will then know
where a ServerCrashProcedure has been scheduled or not.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
  Have expireServer return true if successful.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/RegionTransitionProcedure.java
 The log that included an exception whose message was the current
procedure as a String totally baffled me. Make it more obvious what
exception is.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/UnassignProcedure.java
 If failed expire of a server, wake our procedure -- do not suspend --
and presume ok to move region to CLOSED state (because going down or
concurrent crashed server processing ongoing).
2018-03-06 10:55:40 -08:00
Sean Busbey 7889df3711 HBASE-20072 remove 1.1 release line from the prerequisite tables.
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
2018-03-06 12:24:21 -06:00
Sean Busbey ff7f5ecb0f HBASE-20134 dev-support scripts should use mktemp instead of hard-coding /tmp.
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-03-06 12:22:09 -06:00
tedyu b7fb2df154 HBASE-20136 TestKeyValue misses ClassRule and Category annotations 2018-03-06 08:34:49 -08:00
zhangduo 1384da7137 HBASE-20129 Add UT for serial replication checker 2018-03-06 16:43:01 +08:00
tedyu f89a1f7d7a HBASE-20121 Fix findbugs warning for RestoreTablesClient 2018-03-05 19:36:19 -08:00
Josh Elser 4a4c012049 HBASE-18135 Implement mechanism for RegionServers to report file archival for space quotas
This de-couples the snapshot size calculation from the
SpaceQuotaObserverChore into another API which both the periodically
invoked Master chore and the Master service endpoint can invoke. This
allows for multiple sources of snapshot size to reported (from the
multiple sources we have in HBase).

When a file is archived, snapshot sizes can be more quickly realized and
the Master can still perform periodical computations of the total
snapshot size to account for any delayed/missing/lost file archival RPCs.

Signed-off-by: Ted Yu <yuzhihong@gmail.com>
2018-03-05 17:32:42 -05:00
Josh Elser 2402f1fd43 HBASE-20108 Remove jline exclusion from ZooKeeper 2018-03-05 15:33:51 -05:00
zhangduo b7b8683925 HBASE-20115 Reimplement serial replication based on the new replication storage layer 2018-03-05 20:25:25 +08:00
Sean Busbey 485af49e53 HBASE-20070 addendum for missing echo. Website generation is failing. 2018-03-04 09:03:19 +05:30