12196 Commits

Author SHA1 Message Date
Ashish Singhi
dead08d668 HBASE-18212 reduce log level for unbuffer warning.
In Standalone mode with local filesystem HBase logs Warning message:Failed to invoke 'unbuffer' method in class org.apache.hadoop.fs.FSDataInputStream

Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-06-20 02:18:44 -05:00
Jan Hentschel
13f670057f HBASE-17954 Switched findbugs implementation to spotbugs
Signed-off-by: Sean Busbey <busbey@apache.org>

 Conflicts:
	pom.xml
2017-06-20 02:18:44 -05:00
Kahlil Oppenheimer
4a2f475ed3 HBASE-18164 Fast locality computation in balancer
-Added new LocalityCostFunction and LocalityCandidateGenerator that
cache localities of every region/rack combination and mappings of every
region to its most local server and to its most local rack.

-Made LocalityCostFunction incremental so that it only computes locality
based on most recent region moves/swaps, rather than recomputing the
locality of every region in the cluster at every iteration of the
balancer

-Changed locality cost function to reflect the ratio of:
(Current locality) / (Best locality possible given current cluster)

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>

 Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/StochasticLoadBalancer.java
2017-06-20 02:18:43 -05:00
Mike Drob
6f7b4f5c2c HBASE-18230 Remove Velocity vars from LICENSE
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-06-20 01:41:58 -05:00
Sean Busbey
c6e587c5ac HBASE-16242 Manually resolve transitive Apache Avro dependency to consistently be ver 1.7.7.
Signed-off-by: Jerry He <jerryjch@apache.org>

 Conflicts:
	hbase-common/pom.xml
	hbase-spark/pom.xml
	pom.xml
2017-06-19 15:58:43 -05:00
Pankaj Kumar
d5749bf8ed HBASE-18180 Possible connection leak while closing BufferedMutator in TableOutputFormat
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-19 06:39:27 -07:00
Andrew Purtell
316e02e3d8 HBASE-18219 Fix typo in constant HConstants.HBASE_CLIENT_MEAT_REPLICA_SCAN_TIMEOUT 2017-06-14 16:03:54 -07:00
huzheng
256fc63007 HBASE-17678 FilterList with MUST_PASS_ONE may lead to redundant cells returned
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-06-13 20:28:04 +08:00
zhangduo
d6e85b0511 Revert "FilterList with MUST_PASS_ONE may lead to redundant cells returned" miss issue number
This reverts commit c71da858ada94e1b93065f0b7caf3558942bc4da.
2017-06-13 20:27:28 +08:00
huzheng
c71da858ad FilterList with MUST_PASS_ONE may lead to redundant cells returned
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-12 23:55:25 -07:00
Vincent
650ef5cf59 HBASE-18137 Replication gets stuck for empty WALs
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-06-10 11:29:51 -07:00
zhangduo
6860ddca9f HBASE-18199 Race in NettyRpcConnection may cause call stuck in BufferCallBeforeInitHandler forever 2017-06-10 19:07:23 +08:00
Ashu Pachauri
6e3da5a39a HBASE-18192: Replication drops recovered queues on region server shutdown
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-09 19:54:17 -07:00
Ashu Pachauri
961337aadc HBASE-18092: Removing a peer does not properly clean up the ReplicationSourceManager state and metrics
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-09 11:14:40 -07:00
Gary Helmling
6c4980161b HBASE-18141 Regionserver fails to shutdown when abort triggered during RPC call 2017-06-08 18:33:19 -07:00
Alex Araujo
ba3a816663 HBASE-18184 Add hbase-hadoop2-compat jar as MapReduce dependency
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-06-07 14:26:08 -07:00
Guangxu Cheng
e94245331e HBASE-18149 The setting rules for table-scope attributes and family-scope attributes should keep consistent
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-07 08:32:27 -07:00
Phil Yang
381c89b5cc HBASE-15576 Scanning cursor to prevent blocking long time on ResultScanner.next() 2017-06-07 11:37:22 +08:00
Chia-Ping Tsai
9cb57ae35e HBASE-18145 The flush may cause the corrupt data for reading
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-06-06 18:03:02 -07:00
Andrew Purtell
e0dbafd7cc HBASE-18132 Low replication should be checked in period in case of datanode rolling upgrade (Allan Yang) 2017-06-06 17:21:11 -07:00
huzheng
9c1efc9f9d HBASE-18066: Get with closest_row_before on hbase:meta can return empty Cell during region merge/split
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-06-06 17:13:16 -07:00
Enis Soztutar
ea3075e7fd HBASE-15160 Put back HFile's HDFS op latency sampling code and add metrics for monitoring (Yu Li and Enis Soztutar) 2017-06-06 14:41:02 -07:00
Ashish Singhi
356d4e9187 HBASE-9393 Hbase does not closing a closed socket resulting in many CLOSE_WAIT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-06-06 12:59:19 -07:00
tedyu
39e8e2fb58 HBASE-18005 read replica: handle the case that region server hosting both primary replica and meta region is down (huaxiang sun) 2017-06-06 09:07:17 -07:00
Xiang Li
69d3e332f1 HBASE-18150: Do not call FSUtils.setVersion() and FSUtils.checkVersion() when using checkRootDir() to check hbase.wal.dir
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-06 05:44:29 -07:00
anoopsamjohn
8252fe4fbb HBASE-18030 Per Cell TTL tags may get duplicated with increments/Append causing tags length overflow. 2017-06-06 12:26:21 +05:30
zhangduo
395d9a08e3 HBASE-18159 Use OpenJDK7 instead of Oracle JDK7 in pre commit docker file 2017-06-06 09:43:48 +08:00
Vincent
3cf4433260 HBASE-15995 Separate replication WAL reading from shipping
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-03 09:48:57 -07:00
Guanghao Zhang
b66a478e73 HBASE-18111 Replication stuck when cluster connection is closed
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/HBaseInterClusterReplicationEndpoint.java

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-06-01 15:18:04 -07:00
Chinmay Kulkarni
46ee6e0fcc HBASE 17959 Canary timeout should be configurable on a per-table basis
For branch-1: Added support for configuring read/write timeouts on a per-table basis
when in region mode.
Added unit test for per-table timeout checks.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-05-31 17:58:09 -07:00
Guangxu Cheng
50b201668b HBASE-18129 truncate_preserve fails when the truncate method doesn't exist on the master
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-05-31 02:32:57 -07:00
Phil Yang
e670be690f HBASE-18122 Scanner id should include ServerName of region server 2017-05-31 14:01:58 +08:00
Andrew Purtell
140c559a3a HBASE-18027 HBaseInterClusterReplicationEndpoint should respect RPC limits when batching edits 2017-05-30 14:25:36 -07:00
zhangduo
1a37f3be82 HBASE-18042 Client Compatibility breaks between versions 1.2 and 1.3 2017-05-27 17:56:05 +08:00
huzheng
d8c1e0e004 HBASE-16011 TableSnapshotScanner and TableSnapshotInputFormat can produce duplicate rows if split table.
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-05-26 07:31:05 -07:00
Phil Yang
d5838c78fc HBASE-18113 Handle old client without include_stop_row flag when startRow equals endRow 2017-05-26 13:51:17 +08:00
tedyu
109e0d5485 HBASE-18099 FlushSnapshotSubprocedure should wait for concurrent Region#flush() to finish 2017-05-25 07:56:13 -07:00
Vincent
a3c3f1012d HBASE-18060 Backport to branch-1 HBASE-9774 HBase native metrics and metric collection for coprocessors
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-05-24 13:20:44 -07:00
Balazs Meszaros
f2ba52ac45 HBASE-18096 Limit HFileUtil visibility and add missing annotations
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-05-24 16:34:27 +08:00
Stephen Yuan Jiang
50708d9524 HBASE-18093 Overloading the meaning of 'enabled' in Quota Manager to indicate either quota disabled or quota manager not ready is not good (Stephen Yuan Jiang) 2017-05-23 13:10:07 -07:00
Guangxu Cheng
8c313d5be4 HBASE-18094 Display the return value of the command append
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-05-23 08:59:54 -07:00
Mike Drob
abf03da41d HBASE-18077 Update JUnit licensing to use EPL
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-05-23 10:20:44 -05:00
Guanghao Zhang
4249a1f3d9 HBASE-18069 Fix flaky test TestReplicationAdminWithClusters#testDisableAndEnableReplication 2017-05-22 17:31:01 +08:00
zhangduo
affd6ddf32 HBASE-18081 The way we process connection preamble in SimpleRpcServer is broken 2017-05-21 22:00:27 +08:00
tedyu
c03f003f4f HBASE-18035 Meta replica does not give any primaryOperationTimeout to primary meta region (huaxiang sun) 2017-05-21 06:39:33 -07:00
tedyu
300c5388f2 HBASE-18058 Zookeeper retry sleep time should have an upper limit (Allan Yang) 2017-05-19 10:58:38 -07:00
Mike Drob
f348caf7fe HBASE-17286 Add goal to remote-resources plugin
With Apache parent pom v12 our remote-resources-plugin execution id was
shadowing the parent declaration, and our configuration would get run to
aggregate LICENSE files correctly. When upgrading to v18, apache changed
the execution id, so our configuration no longer gets used.

Add an explicit goal to our usage of the remote-resources-plugin and
change the name to something more descriptive and less likely to
conflict (either intentionally or not).

Signed-off-by: Josh Elser <elserj@apache.org>
2017-05-19 13:29:15 -04:00
huzheng
f9dc4cad63 HBASE-11013 Clone Snapshots on Secure Cluster Should provide option to apply Retained User Permissions
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2017-05-18 17:54:53 +08:00
Junegunn Choi
68d292d83b HBASE-17352 Fix hbase-assembly build with bash 4
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-05-16 08:05:32 -07:00
Vincent
d8ef495063 Amend HBASE-18026 ProtobufUtil seems to do extra array copying
If the ByteString is not a LiteralByteString, just do toByteArray().

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-05-15 18:07:53 -07:00