Commit Graph

13589 Commits

Author SHA1 Message Date
Kahlil Oppenheimer 8da6f069c3 HBASE-18164 Fast locality computation in balancer - addendum handles NaN
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-06-27 14:57:53 -05:00
Sean Busbey 141482512a Revert "HBASE-18164 Fast locality computation in balancer - addendum handles NaN"
This reverts commit 35693f0583.

early commit missed some review feedback.
2017-06-27 14:57:53 -05:00
tedyu 293cb87d52 HBASE-18161 Incremental Load support for Multiple-Table HFileOutputFormat (Densel Santhmayor) 2017-06-27 12:31:55 -07:00
Peter Somogyi 14957d4a7d HBASE-18259 HBase book link to "beginner" issues includes resolved issues
Change-Id: I17d7aca08bda850187eee69e5f0668fbba720740

Signed-off-by: Sean Busbey <busbey@apache.org>
2017-06-27 10:44:18 -05:00
Mike Drob b3ae7a29b8 HBASE-18230 Remove Velocity vars from LICENSE (Addendum)
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-06-27 10:44:01 -05:00
tedyu c015abe507 HBASE-18274 hbase autorestart will overwrite the gc log (Fangyuan Deng) 2017-06-27 08:03:26 -07:00
tedyu 0f4ea611e1 HBASE-18272 Fix issue about RSGroupBasedLoadBalancer#roundRobinAssignment where BOGUS_SERVER_NAME is involved in two groups (chenxu) 2017-06-27 07:03:10 -07:00
Guanghao Zhang 873b15ee31 HBASE-18234 Revisit the async admin api (addendum) 2017-06-27 10:42:08 +08:00
张世彬10204932 389e142eae HBASE-18265 Correct the link unuseful in regionServer's region state UI
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-06-27 10:38:46 +08:00
Kahlil Oppenheimer 35693f0583 HBASE-18164 Fast locality computation in balancer - addendum handles NaN
-Added new LocalityCostFunction and LocalityCandidateGenerator that
cache localities of every region/rack combination and mappings of every
region to its most local server and to its most local rack.

-Made LocalityCostFunction incremental so that it only computes locality
based on most recent region moves/swaps, rather than recomputing the
locality of every region in the cluster at every iteration of the
balancer

-Changed locality cost function to reflect the ratio of:
(Current locality) / (Best locality possible given current cluster)

Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-26 12:38:43 -07:00
Misty Stanley-Jones ed70f15b1e HBASE-12794 Guidelines for filing JIRA issues
Signed-off-by: Misty Stanley-Jones <misty@apache.org>
2017-06-26 08:27:32 -07:00
Guanghao Zhang 2d781aa15c HBASE-18234 Revisit the async admin api 2017-06-26 17:27:09 +08:00
David Harju 0e8e176ebd HBASE-18023 Log multi-* requests for more than threshold number of rows
Signed-off-by: Josh Elser <elserj@apache.org>
2017-06-24 15:23:51 -04:00
张世彬10204932 96aca6b153 HBASE-18263 Resolve NPE in backup Master UI when accessing procedures.jsp
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-24 05:20:05 -07:00
Ramkrishna d092008766 HBASE-18221 Switch from pread to stream should happen under HStore's
reentrant lock (Ram)
2017-06-23 10:32:29 +05:30
Umesh Agashe 7cc458e129 HBASE-18254 ServerCrashProcedure checks and waits for meta initialized, instead should check and wait for meta loaded
After enabling test hbase.master.procedure.TestServerCrashProcedure#testRecoveryAndDoubleExecutionOnRsWithMeta, this bug is found in ServerCrashProcedure

Signed-off-by: Michael Stack <stack@apache.org>
2017-06-21 21:57:46 -07:00
Michael Stack 9cb5fc9825 HBASE-18258 Take down hbasecon2017 logo from hbase.apache.org and put up hbaseconasia2017 instead 2017-06-21 21:56:49 -07:00
Andrew Purtell 3489a1b821 HBASE-18235 LoadBalancer.BOGUS_SERVER_NAME should not have a bogus hostname
We deliberately use 'localhost' instead of a bogus hostname for
LoadBalancer.BOGUS_SERVER_NAME so the operation will fail fast.
2017-06-21 14:37:47 -07:00
Mike Drob d8e0163fac HBASE-16351 Improve error reporting for license failures
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-06-21 14:12:53 -05:00
QilinCao 00f657fbeb HBASE-18252 Resolve BaseLoadBalancer bad practice warnings
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-21 10:12:23 -07:00
tedyu 83be50c2ab HBASE-18226 Disable reverse DNS lookup at HMaster and use the hostname provided by RegionServer (Duo Xu) 2017-06-20 21:07:45 -07:00
Josh Elser 5b485d14cd HBASE-17752 Shell command to list snapshot sizes WRT quotas 2017-06-20 14:17:00 -04:00
Ashish Singhi af466bf722 HBASE-18212 reduce log level for unbuffer warning.
In Standalone mode with local filesystem HBase logs Warning message:Failed to invoke 'unbuffer' method in class org.apache.hadoop.fs.FSDataInputStream

Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-06-20 01:06:47 -05:00
Chinmay Kulkarni df06294915 HBASE-17988 get-active-master.rb and draining_servers.rb no longer work
Modified jruby scripts to pick up drainingZNode and masterAddressZNode
correctly, from within znodePaths in ZooKeeperWatcher. Modified
get-active-master.rb to retrieve server name using MasterAddressTracker
instead of ZKUtil.

Tested on a standalone HBase deployment to check that the scripts work
as expected.

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-06-20 01:06:47 -05:00
Jan Hentschel 298454e8a7 HBASE-17954 Switched findbugs implementation to spotbugs
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-06-20 01:06:47 -05:00
Kahlil Oppenheimer 5224064d4d HBASE-18164 Fast locality computation in balancer
-Added new LocalityCostFunction and LocalityCandidateGenerator that
cache localities of every region/rack combination and mappings of every
region to its most local server and to its most local rack.

-Made LocalityCostFunction incremental so that it only computes locality
based on most recent region moves/swaps, rather than recomputing the
locality of every region in the cluster at every iteration of the
balancer

-Changed locality cost function to reflect the ratio of:
(Current locality) / (Best locality possible given current cluster)

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-06-20 01:06:47 -05:00
Mike Drob 7e8190ed32 HBASE-18230 Remove Velocity vars from LICENSE
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-06-19 16:36:53 -05:00
Mike Drob 270f317727 HBASE-18176 Enforce no scala outside hbase-spark
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-06-19 16:36:42 -05:00
dskskv 7b6eb90ac9 HBASE-17546 Correct scala syntax to match Apache Spark examples
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-06-19 16:14:21 -05:00
Sean Busbey 2263190361 HBASE-16242 Manually resolve transitive Apache Avro dependency to consistently be ver 1.7.7.
Signed-off-by: Jerry He <jerryjch@apache.org>
2017-06-19 15:50:14 -05:00
Pankaj Kumar ce1ce728c6 HBASE-18180 Possible connection leak while closing BufferedMutator in TableOutputFormat
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-18 19:46:47 -07:00
Guanghao Zhang c6e71f159c HBASE-18170 Refactor ReplicationSourceWALReaderThread 2017-06-19 09:26:45 +08:00
Umesh Agashe d49208b056 HBASE-18104 AMv2: Enabled aggregation of RPCs
Unit test (TestAssignmentManager) uses mock which always aggregates. So added trace level log message and verified manually on a single node cluster.

Signed-off-by: Michael Stack <stack@apache.org>
2017-06-16 23:53:39 -07:00
Umesh Agashe b02d3d9ed5 HBASE-18227 Fixed unit test hbase.coprocessor.TestCoprocessorMetrics#testRegionObserverAfterRegionClosed
Calling closeRegion() directly on remote server is not supported post-AMv2. Calling unassign() on master

Signed-off-by: Michael Stack <stack@apache.org>
2017-06-16 20:19:38 -07:00
Ashu Pachauri cd478d1564 Add Ashu Pachauri to pom.xml 2017-06-16 16:25:30 -07:00
Josh Elser 4dc805145b HBASE-17840 Update hbase book to space quotas on snapshots 2017-06-16 11:24:31 -07:00
Josh Elser c7a64a8313 HBASE-18225 Avoid toString() on an array 2017-06-16 08:45:31 -07:00
Ramkrishna c20d9cb1a2 HBASE-18220 - Addendum as per Duo suggestion for readability (Ram) 2017-06-16 12:34:08 +05:30
zhangduo 8653823ac4 HBASE-18213 Add documentation about the new async client 2017-06-16 14:59:55 +08:00
Ramkrishna 020f520d17 HBASE-18220 Compaction scanners need not reopen storefile scanners while
trying to switch over from pread to stream (Ram)
2017-06-16 11:03:04 +05:30
Michael Stack dd1d81ef5a HBASE-18004 getRegionLocations needs to be called once in
ScannerCallableWithReplicas#call() (Huaxiang Sun)
2017-06-15 13:41:01 -07:00
Balazs Meszaros 479f3edc5c HBASE-17898 Update dependencies
Signed-off-by: Michael Stack <stack@apache.org>
2017-06-15 13:32:42 -07:00
Michael Stack c2eebfdb61 HBASE-18166 [AMv2] We are splitting already-split files v2 Address Stephen Jiang reivew comments; ADDENDUM TO FIX COMPILE 2017-06-15 11:40:13 -07:00
Michael Stack f64512bee1 HBASE-18166 [AMv2] We are splitting already-split files v2 Address Stephen Jiang reivew comments 2017-06-15 10:26:03 -07:00
tedyu 8b36da1108 HBASE-18209 Include httpclient / httpcore jars in build artifacts 2017-06-14 20:09:42 -07:00
Andrew Purtell 50e28d62a6 HBASE-18219 Fix typo in constant HConstants.HBASE_CLIENT_MEAT_REPLICA_SCAN_TIMEOUT 2017-06-14 16:02:38 -07:00
zhangduo 58b377751a HBASE-18179 Add new hadoop releases to the pre commit hadoop check 2017-06-14 14:20:01 +08:00
Michael Stack 550b6c585e HBASE-18216 [AMv2] Workaround for HBASE-18152, corrupt procedure WAL;
ADDENDUM

Forgot this change found testing.
2017-06-13 21:58:48 -07:00
Michael Stack 0b43353bf7 HBASE-18216 [AMv2] Workaround for HBASE-18152, corrupt procedure WAL 2017-06-13 21:48:28 -07:00
zhangduo cb88b64629 HBASE-17008 Examples to make AsyncClient go down easy 2017-06-14 10:24:19 +08:00