Commit Graph

12396 Commits

Author SHA1 Message Date
Kevin Risden fe84833ea2 HBase Thrift HTTP - Shouldn't handle TRACE/OPTIONS methods
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>

 Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/http/TestHttpServer.java
	hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift/ThriftServerRunner.java
2018-04-20 15:15:31 -05:00
Toshihiro Suzuki 59d9e0f407 HBASE-20293 get_splits returns duplicate split points when region replication is on
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: Huaxiang Sun <hsun@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-04-20 12:40:50 -05:00
Sean Busbey af172e0604 HBASE-20463 Ruby 1.8 syntax fixes.
branches-1 specific addendum to HBASE-20276

Signed-off-by: Huaxiang Sun <hsun@apache.org>
2018-04-20 12:38:28 -05:00
Toshihiro Suzuki 8a244e51d7 HBASE-20006 TestRestoreSnapshotFromClientWithRegionReplicas is flakey
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>

 Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestRestoreSnapshotFromClientWithRegionReplicas.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegionReplayEvents.java
2018-04-20 11:34:45 -05:00
Toshihiro Suzuki 03eb3d24b6 HBASE-19850 The number of Offline Regions is wrong after restoring a snapshot
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-04-17 20:29:50 -07:00
Sean Busbey ce4c243399 HBASE-20404 Fixes to CleanChore correctness and operability.
* Make CleanerChore less chatty: move WARN message to DEBUG when we expect non-empty dirs
* Make CleanerChore less chatty: move IOE we'll retry to INFO
* CleanerChore should treat IOE for FileStatus as a failure
* Add tests asserting assumptions in above

Signed-off-by: Reid Chan <reidddchan@outlook.com>
Signed-off-by: Mike Drob <mdrob@apache.org>

 Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/cleaner/CleanerChore.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/cleaner/TestCleanerChore.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestFSUtils.java
2018-04-17 13:05:41 -05:00
Sean Busbey f37916253e HBASE-20364 ensure jira comment from nightly reflects results of run comment comes from.
* in a post-step, build status can either be "null" or "SUCCESS" to indicate success.
* before we do an scm checkout for stages that post to the comment, set a default "we failed ¯\_(ツ)_/¯" comment.

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-04-14 21:34:16 -05:00
Sean Busbey f70f47a032 HBASE-20335 ensure each stage of the nightly job gathers machine information.
* fix archiving for src tarball stage's machine info
* stop nightly wrapper desroying the output dir.

Signed-off-by: Michael Stack <stack@apache.org>
2018-04-13 23:18:50 -05:00
Sean Busbey f6413d5594 HBASE-20379 shadedjars yetus plugin should add a footer link
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-04-13 10:49:35 -05:00
Sean Busbey cad65df87e HBASE-20112 register nightly junit over hadoop3 results with jenkins.
Signed-off-by: Michael Stack <stack@apache.org>
2018-04-13 10:49:30 -05:00
Michael Stack 68726b0ee3 HBASE-20385 Purge md5-making from our little make_rc.sh script 2018-04-11 09:19:40 -07:00
Ashish Singhi a817f196a1 HBASE-15291 FileSystem not closed in secure bulkLoad
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
2018-04-11 12:59:52 +05:30
Sean Busbey ff3e562939 HBASE-20335 nightly job bash cleanup.
* Ensure Jenkins steps that invoke bash inline set -e
* machine stats script should check that passed directory will work

Signed-off-by: Michael Stack <stack@apache.org>
2018-04-11 01:31:05 -05:00
Sean Busbey 358d451d96 HBASE-20068 personality tests for Apache Yetus should use the maven plugin to exec maven.
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Reid Chan <reidddchan@outlook.com>
2018-04-11 01:31:02 -05:00
Reid Chan 427c95e2e5 HBASE-20352 [Chore] Backport HBASE-18309 (Support multi threads in CleanerChore) to branch-1
Signed-off-by: Yu Li <liyu@apache.org>
2018-04-11 14:17:51 +08:00
Sean Busbey de0dd9e821 HBASE-15466 test personality should recognize docs-only patch.
* add a new test to build the refguide specifically instead of site
* check for changes to src/main/asciidoc or src/main/xslt and run that test and only that test
* check for changes to the hbase-default.xml file and build the refguide if found (but maybe other tests too)
* fallback to relying on the yetus default for other changes
* fix some missing start_clock entries that cause longer-than-actual reported test time.

Signed-off-by: Mike Drob <mdrob@apache.org>
2018-04-09 10:39:26 -05:00
Pankaj Kumar eacbe002e5 HBASE-19343 Restore snapshot makes split parent region online 2018-04-09 07:48:34 -07:00
Csaba Skrabak e84f5dff7b HBASE-20286 Improving shell command compaction_state
Signed-off-by: Apekshit Sharma <appy@apache.org>
2018-04-06 15:37:08 -07:00
Sean Busbey b9ca1cc152 HBASE-20276 restore original shell REPL functionality where commands can return results
* makes commands always pass any results back to hirb
* print warning if hirb is given the --return-values flag
* add some docs on how to avoid the console clutter that HBASE-15965 sought to address
* add an upgrade section note about this change.
* cleanup where the get_splits command does its printing so there's a building block that doesn't print
* some rubocop suggested tweaks and opt-out for classlength check on table and shell classes.

Signed-off-by: Mike Drob <mdrob@apache.org>

 Conflicts:
	src/main/asciidoc/_chapters/upgrading.adoc

* backport leaves off refguide change about upgrading.

 Conflicts:
	hbase-shell/src/main/ruby/hbase/table.rb
	hbase-shell/src/main/ruby/shell/commands/get_splits.rb
2018-04-06 13:15:56 -05:00
Chia-Ping Tsai 2f683cd438 HBASE-20301 Remove the meaningless plus sign from table.jsp
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-04-04 20:10:46 +08:00
Pankaj Kumar 2eae8104d1 HBASE-20231 Not able to delete column family from a row using RemoteHTable
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
2018-04-04 10:16:11 +05:30
Thiruvel Thirumoolan 9ced0c936f Amend HBASE-20322 CME in StoreScanner causes region server crash
memStoreScanners is immutable so create a new list for closing.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-04-03 13:22:43 -07:00
Thiruvel Thirumoolan 875a12de05 HBASE-20322 CME in StoreScanner causes region server crash
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-04-02 19:36:16 -07:00
Jan Hentschel 18c54b02b1 HBASE-17631 Changed Canary interval to 60 seconds 2018-04-01 13:48:28 +02:00
Andrew Purtell 9a6b6524a7 HBASE-20302 CatalogJanitor should log the reason why it is disabled (Vishal Khandelwal) 2018-03-29 10:20:34 -07:00
Zach York 773af3e0ca HBASE-20280 Fix possibility of deadlocking in refreshFileConnections
When prefetch on open is specified, there is a deadlocking case
where if the prefetch is cancelled, the PrefetchExecutor interrupts
the threads if necessary, when that happens in FileIOEngine, it
causes an ClosedByInterruptException which is a subclass of
ClosedChannelException. If we retry all ClosedChannelExceptions,
this will lock as this access is expected to be interrupted.
This change removes calling refreshFileConnections for
ClosedByInterruptExceptions.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-03-27 22:59:58 +00:00
Toshihiro Suzuki 8018c28c2b HBASE-20292 Wrong URLs in the descriptions for update_all_config and update_config commands in shell 2018-03-27 09:35:13 +02:00
Toshihiro Suzuki caf4c4b4ee HBASE-20261 Table page (table.jsp) in Master UI does not show replicaIds for hbase meta table
Signed-off-by: Josh Elser <elserj@apache.org>
2018-03-23 13:34:45 -04:00
Peter Somogyi 9224cead86 HBASE-16848 Usage for show_peer_tableCFs command doesn't include peer 2018-03-23 16:27:44 +01:00
maoling 2a8e62f8ee HBASE-20047 AuthenticationTokenIdentifier should provide a toString
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-03-22 09:56:43 -05:00
Andrew Purtell f976b3a8af HBASE-19024 Provide a configurable option to hsync WAL edits to the disk for better durability (Harshal Jain) 2018-03-20 17:51:59 -07:00
Xiang LI 764798d996 HBASE-20186 Improve RSGroupBasedLoadBalancer#balanceCluster() to be more efficient when calculating cluster state for each rsgroup
Signed-off-by: tedyu <yuzhihong@gmail.com>

Conflicts:
	hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupBasedLoadBalancer.java
2018-03-16 18:00:52 -07:00
Zach York 009295a3a6 [HBASE-20141] Fix TooManyFiles exception when RefreshingChannels
HBASE-19435 implements a fix for reopening file channels when they are unnexpected closed
to avoid disabling the BucketCache. However, it was missed that the the channels might not
actually be completely closed (the write or read channel might still be open
(see https://docs.oracle.com/javase/7/docs/api/java/nio/channels/ClosedChannelException.html)
This commit closes any open channels before creating a new channel.
2018-03-16 10:58:22 -07:00
Ashish Singhi a0b2141a95 HBASE-20146 Addendum Regions are stuck while opening when WAL is disabled
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-03-15 10:17:03 +08:00
Sakthi 5aeddb3051 HBASE-18864 (addendum) Fixed unit test failure TestFromClientSide#testIllegalTableDescriptor
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-03-14 13:57:08 -07:00
Sakthi 19721046ac HBASE-20189 Fixed typo in Required Java Version error message while building HBase
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
2018-03-14 11:50:38 +01:00
Peter Somogyi b65231d04d Revert "Fixed typo in Required Java Version error message while building HBase" - missing jira number
This reverts commit 6817a7b131.
2018-03-14 11:50:20 +01:00
Sakthi 6817a7b131 Fixed typo in Required Java Version error message while building HBase
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
2018-03-14 08:25:33 +01:00
dbist13 7b5af225e5 HBASE-20104 Fix infinite loop of RIT when creating table on a rsgroup that has no online servers - revert due to TestRSGroups failing 2018-03-13 14:09:45 -07:00
Sakthi 8da331c4d7
HBASE-18864 Fixed NullPointerException thrown while adding rows to a table from peer cluster, with replication factor other than 0 or 1 2018-03-13 13:19:15 -07:00
Peter Somogyi 91a17baaed HBASE-19802 Wrong usage messages on shell commands (grant/revoke namespace syntax) (Csaba Skrabak) 2018-03-13 11:06:41 +01:00
Francis Liu 38471229f9 HBASE-20174 Fix TestZKLessMergeOnCluster flakiness 2018-03-12 16:57:59 -07:00
Mike Drob b54a439e50 HBASE-20153 Add error prone to precommit 2018-03-12 17:37:11 -05:00
Sean Busbey 55b3c0c21b HBASE-20162 [nightly] depending on pipeline execution we sometimes refer to the wrong workspace
Signed-off-by: Mike Drob <mdrob@apache.org>

 Conflicts:
	dev-support/Jenkinsfile
2018-03-09 17:24:23 -06:00
Mike Drob eef6b36540 HBASE-20164 add hadoopcheck link to table footer 2018-03-09 15:41:56 -06:00
Ashish Singhi e81abb7259 HBASE-20146 Regions are stuck while opening when WAL is disabled
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-03-09 21:27:00 +08:00
Sean Busbey 13519b8d6e HBASE-18467 addendum parallel steps must account for SCM and marshalling results
* do a scm checkout on the stages that need access to source.
* ensure our install job runs on the ubuntu label
* copy jira comments to main workspace
* simplify the jira comment

Signed-off-by: Michael Stack <stack@apache.org>
2018-03-07 22:24:57 -06:00
Abhishek Singh Chouhan 41ff229a16 HBASE-20139 NPE in RSRpcServices.get() when getRegion throws an exception 2018-03-07 12:09:04 +05:30
Sean Busbey ac6af9f43a HBASE-20134 dev-support scripts should use mktemp instead of hard-coding /tmp.
Signed-off-by: Mike Drob <mdrob@apache.org>

 Conflicts:
	dev-support/jenkins-scripts/generate-hbase-website.sh
2018-03-06 12:41:59 -06:00
dbist13 4bdfa342a5 HBASE-19985 Redundant instanceof check in ProtobufUtil#getServiceException 2018-03-03 02:45:40 -08:00