12331 Commits

Author SHA1 Message Date
Sean Busbey
de0dd9e821 HBASE-15466 test personality should recognize docs-only patch.
* add a new test to build the refguide specifically instead of site
* check for changes to src/main/asciidoc or src/main/xslt and run that test and only that test
* check for changes to the hbase-default.xml file and build the refguide if found (but maybe other tests too)
* fallback to relying on the yetus default for other changes
* fix some missing start_clock entries that cause longer-than-actual reported test time.

Signed-off-by: Mike Drob <mdrob@apache.org>
2018-04-09 10:39:26 -05:00
Pankaj Kumar
eacbe002e5 HBASE-19343 Restore snapshot makes split parent region online 2018-04-09 07:48:34 -07:00
Csaba Skrabak
e84f5dff7b HBASE-20286 Improving shell command compaction_state
Signed-off-by: Apekshit Sharma <appy@apache.org>
2018-04-06 15:37:08 -07:00
Sean Busbey
b9ca1cc152 HBASE-20276 restore original shell REPL functionality where commands can return results
* makes commands always pass any results back to hirb
* print warning if hirb is given the --return-values flag
* add some docs on how to avoid the console clutter that HBASE-15965 sought to address
* add an upgrade section note about this change.
* cleanup where the get_splits command does its printing so there's a building block that doesn't print
* some rubocop suggested tweaks and opt-out for classlength check on table and shell classes.

Signed-off-by: Mike Drob <mdrob@apache.org>

 Conflicts:
	src/main/asciidoc/_chapters/upgrading.adoc

* backport leaves off refguide change about upgrading.

 Conflicts:
	hbase-shell/src/main/ruby/hbase/table.rb
	hbase-shell/src/main/ruby/shell/commands/get_splits.rb
2018-04-06 13:15:56 -05:00
Chia-Ping Tsai
2f683cd438 HBASE-20301 Remove the meaningless plus sign from table.jsp
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-04-04 20:10:46 +08:00
Pankaj Kumar
2eae8104d1 HBASE-20231 Not able to delete column family from a row using RemoteHTable
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
2018-04-04 10:16:11 +05:30
Thiruvel Thirumoolan
9ced0c936f Amend HBASE-20322 CME in StoreScanner causes region server crash
memStoreScanners is immutable so create a new list for closing.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-04-03 13:22:43 -07:00
Thiruvel Thirumoolan
875a12de05 HBASE-20322 CME in StoreScanner causes region server crash
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-04-02 19:36:16 -07:00
Jan Hentschel
18c54b02b1 HBASE-17631 Changed Canary interval to 60 seconds 2018-04-01 13:48:28 +02:00
Andrew Purtell
9a6b6524a7 HBASE-20302 CatalogJanitor should log the reason why it is disabled (Vishal Khandelwal) 2018-03-29 10:20:34 -07:00
Zach York
773af3e0ca HBASE-20280 Fix possibility of deadlocking in refreshFileConnections
When prefetch on open is specified, there is a deadlocking case
where if the prefetch is cancelled, the PrefetchExecutor interrupts
the threads if necessary, when that happens in FileIOEngine, it
causes an ClosedByInterruptException which is a subclass of
ClosedChannelException. If we retry all ClosedChannelExceptions,
this will lock as this access is expected to be interrupted.
This change removes calling refreshFileConnections for
ClosedByInterruptExceptions.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-03-27 22:59:58 +00:00
Toshihiro Suzuki
8018c28c2b HBASE-20292 Wrong URLs in the descriptions for update_all_config and update_config commands in shell 2018-03-27 09:35:13 +02:00
Toshihiro Suzuki
caf4c4b4ee HBASE-20261 Table page (table.jsp) in Master UI does not show replicaIds for hbase meta table
Signed-off-by: Josh Elser <elserj@apache.org>
2018-03-23 13:34:45 -04:00
Peter Somogyi
9224cead86 HBASE-16848 Usage for show_peer_tableCFs command doesn't include peer 2018-03-23 16:27:44 +01:00
maoling
2a8e62f8ee HBASE-20047 AuthenticationTokenIdentifier should provide a toString
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-03-22 09:56:43 -05:00
Andrew Purtell
f976b3a8af HBASE-19024 Provide a configurable option to hsync WAL edits to the disk for better durability (Harshal Jain) 2018-03-20 17:51:59 -07:00
Xiang LI
764798d996 HBASE-20186 Improve RSGroupBasedLoadBalancer#balanceCluster() to be more efficient when calculating cluster state for each rsgroup
Signed-off-by: tedyu <yuzhihong@gmail.com>

Conflicts:
	hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupBasedLoadBalancer.java
2018-03-16 18:00:52 -07:00
Zach York
009295a3a6 [HBASE-20141] Fix TooManyFiles exception when RefreshingChannels
HBASE-19435 implements a fix for reopening file channels when they are unnexpected closed
to avoid disabling the BucketCache. However, it was missed that the the channels might not
actually be completely closed (the write or read channel might still be open
(see https://docs.oracle.com/javase/7/docs/api/java/nio/channels/ClosedChannelException.html)
This commit closes any open channels before creating a new channel.
2018-03-16 10:58:22 -07:00
Ashish Singhi
a0b2141a95 HBASE-20146 Addendum Regions are stuck while opening when WAL is disabled
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-03-15 10:17:03 +08:00
Sakthi
5aeddb3051 HBASE-18864 (addendum) Fixed unit test failure TestFromClientSide#testIllegalTableDescriptor
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-03-14 13:57:08 -07:00
Sakthi
19721046ac HBASE-20189 Fixed typo in Required Java Version error message while building HBase
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
2018-03-14 11:50:38 +01:00
Peter Somogyi
b65231d04d Revert "Fixed typo in Required Java Version error message while building HBase" - missing jira number
This reverts commit 6817a7b131e47a96a354438c2c6ad0fbe6878a28.
2018-03-14 11:50:20 +01:00
Sakthi
6817a7b131 Fixed typo in Required Java Version error message while building HBase
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
2018-03-14 08:25:33 +01:00
dbist13
7b5af225e5 HBASE-20104 Fix infinite loop of RIT when creating table on a rsgroup that has no online servers - revert due to TestRSGroups failing 2018-03-13 14:09:45 -07:00
Sakthi
8da331c4d7
HBASE-18864 Fixed NullPointerException thrown while adding rows to a table from peer cluster, with replication factor other than 0 or 1 2018-03-13 13:19:15 -07:00
Peter Somogyi
91a17baaed HBASE-19802 Wrong usage messages on shell commands (grant/revoke namespace syntax) (Csaba Skrabak) 2018-03-13 11:06:41 +01:00
Francis Liu
38471229f9 HBASE-20174 Fix TestZKLessMergeOnCluster flakiness 2018-03-12 16:57:59 -07:00
Mike Drob
b54a439e50 HBASE-20153 Add error prone to precommit 2018-03-12 17:37:11 -05:00
Sean Busbey
55b3c0c21b HBASE-20162 [nightly] depending on pipeline execution we sometimes refer to the wrong workspace
Signed-off-by: Mike Drob <mdrob@apache.org>

 Conflicts:
	dev-support/Jenkinsfile
2018-03-09 17:24:23 -06:00
Mike Drob
eef6b36540 HBASE-20164 add hadoopcheck link to table footer 2018-03-09 15:41:56 -06:00
Ashish Singhi
e81abb7259 HBASE-20146 Regions are stuck while opening when WAL is disabled
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-03-09 21:27:00 +08:00
Sean Busbey
13519b8d6e HBASE-18467 addendum parallel steps must account for SCM and marshalling results
* do a scm checkout on the stages that need access to source.
* ensure our install job runs on the ubuntu label
* copy jira comments to main workspace
* simplify the jira comment

Signed-off-by: Michael Stack <stack@apache.org>
2018-03-07 22:24:57 -06:00
Abhishek Singh Chouhan
41ff229a16 HBASE-20139 NPE in RSRpcServices.get() when getRegion throws an exception 2018-03-07 12:09:04 +05:30
Sean Busbey
ac6af9f43a HBASE-20134 dev-support scripts should use mktemp instead of hard-coding /tmp.
Signed-off-by: Mike Drob <mdrob@apache.org>

 Conflicts:
	dev-support/jenkins-scripts/generate-hbase-website.sh
2018-03-06 12:41:59 -06:00
dbist13
4bdfa342a5 HBASE-19985 Redundant instanceof check in ProtobufUtil#getServiceException 2018-03-03 02:45:40 -08:00
Andrew Purtell
aae12e8470 HBASE-20109 Add Admin#getMaster API to branch-1
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-03-02 11:39:43 -08:00
Andrew Purtell
c590ebba07 HBASE-19769 IllegalAccessError on package-private Hadoop metrics2 classes in MapReduce jobs
Client-side ZooKeeper metrics cause issues when launching MapReduce
jobs via 'yarn jar' on the command line. This stems from ClassLoader
separation issues that YARN implements. It was chosen that the
easiest solution was to remove these ZooKeeper metrics entirely.

Revert "HBASE-17448 Export metrics from RecoverableZooKeeper"

This reverts commit defc25c6d109c4c8782477cc517d71206e7d3aca.
2018-03-01 15:28:39 -08:00
Sean Busbey
2735f35b97 HBASE-20075 remove logic for branch-1.1 nightly testing
Signed-off-by: Michael Stack <stack@apache.org>
2018-03-01 15:30:14 -06:00
Sean Busbey
01746c72ab HBASE-15151 ensure findbugs check runs in nightly tests on all branches.
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-03-01 15:30:10 -06:00
Sean Busbey
5102f5316c HBASE-18467 report nightly results to devs via jira
- rely on parallel pipeline to ensure all stages always run
- define non-CPS jira commenting function
- comment on jiras in the changeset with summary and links

Signed-off-by: Mike Drob <mdrob@apache.org>

 Conflicts:
	dev-support/Jenkinsfile
2018-03-01 13:15:35 -06:00
haxiaolin
1fbe4deb01 HBASE-20104 Fix infinite loop of RIT when creating table on a rsgroup that has no online servers
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-03-01 08:35:45 -08:00
Apekshit Sharma
c4401b6073 HBASE-19400 Add missing security checks in MasterRpcServices
- Added ADMIN permission check for following rpc calls:
  normalize, setNormalizerRunning, runCatalogScan, enableCatalogJanitor, runCleanerChore,
  setCleanerChoreRunning, execMasterService, execProcedure, execProcedureWithRet
- Moved authorizationEnabled check to start of AccessChecker's functions. Currently, and IDK why,
  we call authManager.authorize() first and then discard its result if authorizationEnabled is false. Weird.

----

HBASE-19401 Add missing security checks in RSRpcServices
2018-02-28 11:52:16 -08:00
Sergey Soldatov
cdbf001d26 HBASE-19863 java.lang.IllegalStateException: isDelete failed when SingleColumnValueFilter is used
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
Signed-off-by: ramkrish86 <ramkrishna.s.vasudevan@gmail.com>
2018-02-28 13:35:43 -05:00
Alex Leblang
0cd89ed653 HBASE-20106 [api compliance chacker] Fix Bug Where Branch Isn't Found
While git rev-parse, sometimes the branch cannot be found unless
the remote is specified. This fix tries to use "origin" if the
remote is not specified and the branch is not found.

Signed-off-by: Sean Busbey <busbey@apache.org>
2018-02-28 11:56:51 -06:00
Andrew Purtell
1be9a3d641 HBASE-20087 Periodically attempt redeploy of regions in FAILED_OPEN state
Signed-off-by: Josh Elser <elserj@apache.org>
2018-02-27 17:11:44 -08:00
Andrew Purtell
9a7a36750f HBASE-20102 AssignmentManager#shutdown doesn't shut down scheduled executor
Signed-off-by: Josh Elser <elserj@apache.org>
2018-02-27 17:11:28 -08:00
Ben Lau
27f803f320 HBASE-19989 Addendum - temp override for tests to be added later for HBASE-20001
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-02-27 17:06:32 -08:00
Rahul Gidwani
40e0ee331c HBASE-19989 - READY_TO_MERGE and READY_TO_SPLIT do not update region state correctly
Author: Ben Lau <benlau@oath.com>
2018-02-27 12:41:48 -08:00
Josh Elser
f8494ee4e7 HBASE-20088 Update NOTICE.txt year
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-02-27 10:01:20 -05:00
Josh Elser
15a2473b69 HBASE-20089 Use the ASF recommended naming for SHA512 xsum files
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2018-02-27 10:01:19 -05:00