4566 Commits

Author SHA1 Message Date
Joseph Hwang
7fa311a940 HBASE-16081 Wait for Replication Tasks to complete before killing the ThreadPoolExecutor inside of HBaseInterClusterReplicationEndpoint
Signed-off-by: Mikhail Antonov <antonov@apache.org>
2016-07-11 17:54:24 -07:00
Gary Helmling
3ff6f45851 HBASE-16160 Support RPC encryption with direct ByteBuffers (Colin Ma via garyh) 2016-07-11 10:45:05 -07:00
Yu Li
e03d4fbb0a HBASE-16194 Should count in MSLAB chunk allocation into heap size change when adding duplicate cells 2016-07-11 21:40:30 +08:00
stack
9563ab4ca1 HBASE-16176 Bug fixes/improvements on HBASE-15650 Remove TimeRangeTracker as point of contention when many threads reading a StoreFile Fixes HBASE-16074 ITBLL fails, reports lost big or tiny families broken scanning because of a side effect of a clean up in HBASE-15650 to make TimeRange construction consistent exposed a latent issue in TimeRange#compare. See HBASE-16074 for more detail.
Also change HFile Writer constructor so we pass in the TimeRangeTracker, if one,
on construction rather than set later (the flag and reference were not volatile
so could have made for issues in concurrent case). And make sure the construction
of a TimeRange from a TimeRangeTracer on open of an HFile Reader never makes a
bad minimum value, one that would preclude us reading any values from a file
(set min to 0)

M hbase-common/src/main/java/org/apache/hadoop/hbase/io/TimeRange.java
 Call through to next constructor (if minStamp was 0, we'd skip setting
 allTime=true). Add asserts that timestamps are not < 0 cos it messes
 us up if they are (we already were checking for < 0 on construction but
 assert passed in timestamps are not < 0).

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
 Add constructor override that takes a TimeRangeTracker (set when flushing
 but not when compacting)

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/Store.java
 Add override creating an HFile in tmp that takes a TimeRangeTracker

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFile.java
 Add override for HFile Writer that takes a TimeRangeTracker Take it on
 construction instead of having it passed by a setter later (flags and
 reference set by the setter were not volatile... could have been prob
 in concurrent case)

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/TimeRangeTracker.java
 Log WARN if bad initial TimeRange value (and then 'fix' it)

M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestTimeRangeTracker.java
 A few tests to prove serialization works as expected and that we'll get a bad min if not constructed properly.

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/ScanQueryMatcher.java
 Handle OLDEST_TIMESTAMP explictly. Don't expect TimeRange to do it.

M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestQueryMatcher.java
 Refactor from junit3 to junit4 and add test for this weird case.
2016-07-08 14:23:23 -07:00
Yu Li
09d9dc4b59 HBASE-16201 NPE in RpcServer causing intermittent UT failure of TestMasterReplication#testHFileCyclicReplication 2016-07-09 02:04:54 +08:00
Yu Li
44d2a9bc1c Revert "NPE in RpcServer causing intermittent UT failure of TestMasterReplication#testHFileCyclicReplication"
This reverts commit b6d4fc955fe0fc41f5225f1cc2e3e4b92029251c.
2016-07-09 02:04:01 +08:00
Yu Li
b6d4fc955f NPE in RpcServer causing intermittent UT failure of TestMasterReplication#testHFileCyclicReplication 2016-07-09 01:06:55 +08:00
stack
37040bfc42 HBASE-15775 Canary launches two AuthUtil Chores 2016-07-08 09:36:17 -07:00
stack
2d6cdfb10a HBASE-16180 Fix ST_WRITE_TO_STATIC_FROM_INSTANCE_METHOD findbugs introduced by parent 2016-07-06 09:12:00 -07:00
tedyu
368c32e322 HBASE-16157 The incorrect block cache count and size are caused by removing duplicate block key in the LruBlockCache (ChiaPing Tsai) 2016-07-05 13:54:59 -07:00
Elliott Clark
ff8c2fcac0 HBASE-16087 Replication shouldn't start on a master if if only hosts system tables 2016-07-05 13:47:49 -07:00
Andrew Purtell
8efc6148b9 HBASE-16091 Canary takes lot more time when there are delete markers in the table (Vishal Khandelwal)
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/tool/Canary.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
2016-07-05 10:34:27 -07:00
Yu Li
84dd9cbcb6 HBASE-16132 Scan does not return all the result when regionserver is busy (binlijin) 2016-07-04 21:46:19 +08:00
zhangduo
4807836304 HBASE-16135 addendum format comments 2016-07-04 20:41:06 +08:00
zhangduo
721c5b7128 HBASE-16135 PeerClusterZnode under rs of removed peer may never be deleted 2016-07-04 19:52:28 +08:00
chenheng
f18ac8157b HBASE-15844 We should respect hfile.block.index.cacheonwrite when write intermediate index Block 2016-07-02 09:09:51 +08:00
tedyu
a345aa8707 HBASE-16108 RowCounter should support multiple key ranges (Konstantin Ryakhovskiy) 2016-07-01 09:32:43 -07:00
tedyu
5bc0655529 HBASE-16114 Get regionLocation of required regions only for MR jobs (Thiruvel Thirumoolan) 2016-07-01 03:14:51 -07:00
stack
f4d7cd5f58 HBASE-16150 Remove ConcurrentIndex (Hiroshi Ikeda) 2016-06-30 15:04:36 -07:00
Jonathan M Hsieh
9aa40424fe HBASE-16140 bump owasp.esapi from 2.1.0 to 2.1.0.1 2016-06-29 08:58:25 -07:00
Jingcheng Du
b93c08d358 HBASE-15976 RegionServerMetricsWrapperRunnable will be failure when disable blockcache. - Addendum 2016-06-29 16:37:23 +08:00
tedyu
96a24aede7 HBASE-16122 PerformanceEvaluation should provide user friendly hint when client threads argument is missing (Konstantin Ryakhovskiy) 2016-06-28 20:28:06 -07:00
Jingcheng Du
7a78d871d0 HBASE-15976 RegionServerMetricsWrapperRunnable will be failure when disable blockcache. 2016-06-28 13:52:30 +08:00
tedyu
1a88673f33 HBASE-16052 Improve HBaseFsck Scalability (Ben Lau) 2016-06-27 20:16:34 -07:00
tedyu
34d62ecfae HBASE-14007 Writing to table through MR should fail upfront if table does not exist/is disabled (Thiruvel Thirumoolan) 2016-06-27 14:47:57 -07:00
Ramkrishna
385a6e878f HBASE-16055 TestHFileOutputFormat2 is broken (Ram) 2016-06-27 11:02:03 +05:30
Elliott Clark
f4c1fd1a47 HBASE-16089 Add on FastPath for CoDel 2016-06-25 12:59:18 -07:00
stack
8ef87ce434 Revert "Is this ok... removing synchronizations?"
REVERT MISTAKEN COMMIT

This reverts commit 86242e1f55da7df6a2119389897d11356e6bbc2a.
2016-06-25 10:45:10 +01:00
Ramkrishna
a02c6da4d3 HBASE-16055 PutSortReducer loses any Visibility/acl attribute set on the
Puts (Ram)
2016-06-24 15:26:51 +05:30
Jingcheng Du
83c0cc109e HBASE-15353 Add metric for number of CallQueueTooBigException's 2016-06-24 14:39:53 +08:00
Gary Helmling
198165ef5b HBASE-16085 Add a metric for failed compactions 2016-06-23 16:04:27 -07:00
Elliott Clark
93d82112f0 HBASE-16093 Fix splits failed before creating daughter regions leave meta inconsistent 2016-06-23 12:21:52 -07:00
tedyu
857ec2f448 HBASE-16090 ResultScanner is not closed in SyncTable#finishRemainingHashRanges() 2016-06-23 07:29:34 -07:00
Matteo Bertozzi
339cb81747 HBASE-16068 Procedure v2 - use consts for conf properties in tests 2016-06-22 23:08:13 -07:00
Ramkrishna
7056b66d37 HBASE-16070 Mapreduce Serialization classes do not have Interface audience
(Ram)
2016-06-23 10:55:54 +05:30
tedyu
9e9c243ed0 HBASE-16049 TestRowProcessorEndpoint is failing on Apache Builds (Guanghao Zhang) 2016-06-22 12:24:39 -07:00
tedyu
ba631b4d92 HBASE-16012 Major compaction can't work due to obsolete scanner read point in RegionServer (Guanghao Zhang) 2016-06-22 02:09:35 -07:00
tedyu
6ba67ab8d6 HBASE-16062 Improper error handling in WAL Reader/Writer creation (Vladimir Rodionov) 2016-06-21 20:01:05 -07:00
tedyu
8dea578bcf HBASE-16051 TestScannerHeartbeatMessages fails on some machines (Phil Yang) 2016-06-21 09:28:46 -07:00
Yu Li
c6b8c9bb02 HBASE-16032 Possible memory leak in StoreScanner 2016-06-21 20:07:52 +08:00
tedyu
78f5262896 HBASE-16059 Region normalizer fails to trigger merge action where one of the regions is empty 2016-06-20 11:24:33 -07:00
Matteo Bertozzi
6605f8f683 HBASE-14644 Region in transition metric is broken -- addendum (Huaxiang Sun) 2016-06-20 10:45:23 -07:00
stack
d34e65327e HBASE-16023 Fastpath for the FIFO rpcscheduler AMENDMENT 2016-06-20 08:28:43 +01:00
stack
86242e1f55 Is this ok... removing synchronizations? 2016-06-20 08:23:49 +01:00
Enis Soztutar
1a989a1964 HBASE-16058 TestHRegion fails on 1.4 builds
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegion.java
2016-06-17 19:00:01 -07:00
stack
411e3cdb6d HBASE-16023 Fastpath for the FIFO rpcscheduler Adds an executor that does balanced queue and fast path handing off requests directly to waiting handlers if any present. Idea taken from Apace Kudu (incubating). See https://gerrit.cloudera.org/#/c/2938/7/src/kudu/rpc/service_queue.h
M hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/RpcExecutor.java
 Refactor which makes a Handler type. Put all 'handler' stuff inside this
 new type. Also make it so subclass can provide its own Handler type.

M hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/SimpleRpcScheduler.java
 Name the handler threads for their type so can tell if configs are
 having an effect.

Signed-off-by: stack <stack@apache.org>
2016-06-17 17:07:35 -07:00
stack
76cf0d799f HBASE-15224 Undo "hbase.increment.fast.but.narrow.consistency" option; it is not necessary since HBASE-15213 (stack) 2016-06-17 14:39:45 -07:00
chenheng
3723baefe3 HBASE-14915 Hanging test : org.apache.hadoop.hbase.mapreduce.TestImportExport (Heng Chen) 2016-06-17 12:35:36 -07:00
Matteo Bertozzi
1f37cdfb4b HBASE-14730 region server needs to log warnings when there are attributes configured for cells with hfile v2 (huaxiang sun) 2016-06-17 11:26:53 -07:00
Liu Shaohui
419d15f834 HBASE-14277 TestRegionServerHostname.testRegionServerHostname may fail at host with a case sensitive name 2016-06-17 10:49:21 -07:00