Commit Graph

12526 Commits

Author SHA1 Message Date
Toshihiro Suzuki 289d588af3 HBASE-20647 Backport HBASE-20616 "TruncateTableProcedure is stuck in retry loop in TRUNCATE_TABLE_CREATE_FS_LAYOUT state" to branch-1
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-05-25 06:18:43 -07:00
Andrew Purtell 87d4e4e4e2 HBASE-20646 TestWALProcedureStoreOnHDFS failing on branch-1 2018-05-24 18:06:12 -07:00
Thiruvel Thirumoolan b892be7440 HBASE-20548 Master fails to startup on large clusters, refreshing block distribution
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-05-24 12:27:19 -07:00
Sean Busbey 416f28356c HBASE-20638 nightly source artifact testing should fail the stage if it's going to report an error on jira
Signed-off-by: Michael Stack <stack@apache.org>
2018-05-24 13:13:53 -05:00
tedyu 7553334d28 HBASE-20627 Relocate RS Group pre/post hooks from RSGroupAdminServer to RSGroupAdminEndpoint 2018-05-23 18:39:55 -07:00
Andrew Purtell 1b70763b9e HBASE-20597 Use a lock to serialize access to a shared reference to ZooKeeperWatcher in HBaseReplicationEndpoint 2018-05-23 16:45:55 -07:00
Andrew Purtell 498f3bf953 HBASE-20595 Remove the concept of 'special tables' from rsgroups 2018-05-23 10:50:29 -07:00
Andrew Purtell 45d928e2c6 HBASE-20608 Remove build option of error prone profile for branch-1 after HBASE-12350
Disable our use of the errorProne profile for branch-1 in hbase-personality. It is
too taxing on the precommit builds.
2018-05-22 16:06:21 -07:00
Sean Busbey 9d35a70b15 HBASE-20591 nightly job needs to enable maven build system.
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-05-22 17:43:34 -05:00
Xu Cang 6d1aa2800b HBASE-20486 Change default throughput controller to PressureAwareThroughputController
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-05-22 12:43:31 -07:00
Andrew Purtell 210b90604b HBASE-20619 TestWeakObjectPool occasionally times out
Remove too-stringent timeout already removed from this test in master branch.
2018-05-22 12:24:05 -07:00
Yechao Chen 8e92b3f458 HBASE-20500 [rsgroup] should keep at least one server in default group
Signed-off-by: tedyu <yuzhihong@gmail.com>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-05-16 18:04:51 -07:00
Balazs Meszaros 2d493556f3 HBASE-20571 JMXJsonServlet generates invalid JSON if it has NaN in metrics
- CacheStats won't generate NaN metrics.
- JSONBean class will serialize special floating point values as
  "NaN", "Infinity" or "-Infinity"

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-05-16 11:50:31 -07:00
Thiruvel Thirumoolan 2a309d71cc HBASE-20545 Improve performance of BaseLoadBalancer.retainAssignment
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-05-15 18:17:52 -07:00
Zach York 944a221b74 HBASE-20447 Only fail cacheBlock if block collisions aren't related to next block metadata
When we pread, we don't force the read to read all of the next block header.
However, when we get into a race condition where two opener threads try to
cache the same block and one thread read all of the next block header and
the other one didn't, it will fail the open process. This is especially important
in a splitting case where it will potentially fail the split process.
Instead, in the caches, we should only fail if the required blocks are different.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-05-14 16:09:36 -07:00
Ashish Singhi ca544a155c HBASE-20004 Client is not able to execute REST queries in a secure cluster
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
2018-05-10 22:49:08 +05:30
Andrew Purtell c191462ac3 HBASE-20554 "WALs outstanding" message from CleanerChore is noisy 2018-05-09 19:13:17 -07:00
Zach York 5406f63332 HBASE-20204 Add locking to RefreshFileConnections in BucketCache
This is a follow-up to HBASE-20141 where Anoop suggested adding locking
for refreshing channels.
2018-05-09 14:15:02 -07:00
Andrew Purtell 9d9d5aec0e HBASE-20505 PE should support multi column family read and write cases 2018-05-07 18:39:18 -07:00
Vasudevan 91f3de89ab HBASE-20523 PE tool should support configuring client side buffering sizes
(Ram)
2018-05-07 14:41:08 +05:30
Andrew Purtell 23b9054089 HBASE-20513 Collect and emit ScanMetrics in PerformanceEvaluation 2018-05-04 17:59:28 -07:00
Andrew Purtell fd24083e26 HBASE-20517 Fix PerformanceEvaluation 'column' parameter 2018-05-04 17:24:38 -07:00
Andrew Purtell e793e7c30c HBASE-20493 Port HBASE-19994 (Create a new class for RPC throttling exception, make it retryable) to branch-1 2018-04-26 15:38:40 -07:00
Andrew Purtell 71c573239b HBASE-20496 TestGlobalThrottler failing on branch-1 since revert of HBASE-9465
Temporarily disable TestGlobalThrottler on branch-1
2018-04-26 15:38:40 -07:00
Huaxiang Sun eb67d4e308 HBASE-19924 hbase rpc throttling does not work for multi() with request count rater. 2018-04-26 10:43:59 -07:00
Thoralf Gutierrez ec131784e7 HBASE-18842 Fix unknown namespace message in clone_snapshot
Signed-off-by: Jesse Yates <jyates@apache.org>
(cherry picked from commit 0ff4f5fba9)
2018-04-25 16:13:16 -05:00
Toshihiro Suzuki f11cf007a2 HBASE-20229 ConnectionImplementation.locateRegions() returns duplicated entries when region replication is on 2018-04-25 13:36:12 -07:00
Lars Hofhansl 6685b62abe HBASE-20459 Majority of scan CPU time in HBase-1 spent in size estimation. 2018-04-21 10:02:07 -07:00
Kevin Risden e60189035e HBASE-20406 HBase Thrift HTTP - Shouldn't handle TRACE/OPTIONS methods
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>

 Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/http/TestHttpServer.java
	hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift/ThriftServerRunner.java
2018-04-20 22:45:49 -05:00
Sean Busbey eacf3cb296 Revert "HBase Thrift HTTP - Shouldn't handle TRACE/OPTIONS methods"
This reverts commit fe84833ea2.

missing jira key
2018-04-20 22:45:37 -05:00
Kevin Risden fe84833ea2 HBase Thrift HTTP - Shouldn't handle TRACE/OPTIONS methods
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>

 Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/http/TestHttpServer.java
	hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift/ThriftServerRunner.java
2018-04-20 15:15:31 -05:00
Toshihiro Suzuki 59d9e0f407 HBASE-20293 get_splits returns duplicate split points when region replication is on
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: Huaxiang Sun <hsun@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-04-20 12:40:50 -05:00
Sean Busbey af172e0604 HBASE-20463 Ruby 1.8 syntax fixes.
branches-1 specific addendum to HBASE-20276

Signed-off-by: Huaxiang Sun <hsun@apache.org>
2018-04-20 12:38:28 -05:00
Toshihiro Suzuki 8a244e51d7 HBASE-20006 TestRestoreSnapshotFromClientWithRegionReplicas is flakey
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>

 Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestRestoreSnapshotFromClientWithRegionReplicas.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegionReplayEvents.java
2018-04-20 11:34:45 -05:00
Toshihiro Suzuki 03eb3d24b6 HBASE-19850 The number of Offline Regions is wrong after restoring a snapshot
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-04-17 20:29:50 -07:00
Sean Busbey ce4c243399 HBASE-20404 Fixes to CleanChore correctness and operability.
* Make CleanerChore less chatty: move WARN message to DEBUG when we expect non-empty dirs
* Make CleanerChore less chatty: move IOE we'll retry to INFO
* CleanerChore should treat IOE for FileStatus as a failure
* Add tests asserting assumptions in above

Signed-off-by: Reid Chan <reidddchan@outlook.com>
Signed-off-by: Mike Drob <mdrob@apache.org>

 Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/cleaner/CleanerChore.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/cleaner/TestCleanerChore.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestFSUtils.java
2018-04-17 13:05:41 -05:00
Sean Busbey f37916253e HBASE-20364 ensure jira comment from nightly reflects results of run comment comes from.
* in a post-step, build status can either be "null" or "SUCCESS" to indicate success.
* before we do an scm checkout for stages that post to the comment, set a default "we failed ¯\_(ツ)_/¯" comment.

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-04-14 21:34:16 -05:00
Sean Busbey f70f47a032 HBASE-20335 ensure each stage of the nightly job gathers machine information.
* fix archiving for src tarball stage's machine info
* stop nightly wrapper desroying the output dir.

Signed-off-by: Michael Stack <stack@apache.org>
2018-04-13 23:18:50 -05:00
Sean Busbey f6413d5594 HBASE-20379 shadedjars yetus plugin should add a footer link
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-04-13 10:49:35 -05:00
Sean Busbey cad65df87e HBASE-20112 register nightly junit over hadoop3 results with jenkins.
Signed-off-by: Michael Stack <stack@apache.org>
2018-04-13 10:49:30 -05:00
Michael Stack 68726b0ee3 HBASE-20385 Purge md5-making from our little make_rc.sh script 2018-04-11 09:19:40 -07:00
Ashish Singhi a817f196a1 HBASE-15291 FileSystem not closed in secure bulkLoad
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
2018-04-11 12:59:52 +05:30
Sean Busbey ff3e562939 HBASE-20335 nightly job bash cleanup.
* Ensure Jenkins steps that invoke bash inline set -e
* machine stats script should check that passed directory will work

Signed-off-by: Michael Stack <stack@apache.org>
2018-04-11 01:31:05 -05:00
Sean Busbey 358d451d96 HBASE-20068 personality tests for Apache Yetus should use the maven plugin to exec maven.
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Reid Chan <reidddchan@outlook.com>
2018-04-11 01:31:02 -05:00
Reid Chan 427c95e2e5 HBASE-20352 [Chore] Backport HBASE-18309 (Support multi threads in CleanerChore) to branch-1
Signed-off-by: Yu Li <liyu@apache.org>
2018-04-11 14:17:51 +08:00
Sean Busbey de0dd9e821 HBASE-15466 test personality should recognize docs-only patch.
* add a new test to build the refguide specifically instead of site
* check for changes to src/main/asciidoc or src/main/xslt and run that test and only that test
* check for changes to the hbase-default.xml file and build the refguide if found (but maybe other tests too)
* fallback to relying on the yetus default for other changes
* fix some missing start_clock entries that cause longer-than-actual reported test time.

Signed-off-by: Mike Drob <mdrob@apache.org>
2018-04-09 10:39:26 -05:00
Pankaj Kumar eacbe002e5 HBASE-19343 Restore snapshot makes split parent region online 2018-04-09 07:48:34 -07:00
Csaba Skrabak e84f5dff7b HBASE-20286 Improving shell command compaction_state
Signed-off-by: Apekshit Sharma <appy@apache.org>
2018-04-06 15:37:08 -07:00
Sean Busbey b9ca1cc152 HBASE-20276 restore original shell REPL functionality where commands can return results
* makes commands always pass any results back to hirb
* print warning if hirb is given the --return-values flag
* add some docs on how to avoid the console clutter that HBASE-15965 sought to address
* add an upgrade section note about this change.
* cleanup where the get_splits command does its printing so there's a building block that doesn't print
* some rubocop suggested tweaks and opt-out for classlength check on table and shell classes.

Signed-off-by: Mike Drob <mdrob@apache.org>

 Conflicts:
	src/main/asciidoc/_chapters/upgrading.adoc

* backport leaves off refguide change about upgrading.

 Conflicts:
	hbase-shell/src/main/ruby/hbase/table.rb
	hbase-shell/src/main/ruby/shell/commands/get_splits.rb
2018-04-06 13:15:56 -05:00
Chia-Ping Tsai 2f683cd438 HBASE-20301 Remove the meaningless plus sign from table.jsp
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-04-04 20:10:46 +08:00