c8903cc20a
HBASE-16296 Reverse scan performance degrades when using filter lists (Ted Yu)
2016-08-01 17:41:06 -07:00
1983126216
HBASE-16288 HFile intermediate block level indexes might recurse forever creating multi TB files
2016-08-01 11:06:27 -07:00
1b303ad75d
HBASE-16209 addendum fix region move delay
2016-08-01 15:57:28 +08:00
51c8c1891a
Revert "HBASE-16209 addendum fix region move delay"
...
This reverts commit c46f56b382
2016-08-01 15:52:25 +08:00
c46f56b382
HBASE-16209 addendum fix region move delay
2016-08-01 11:29:50 +08:00
39153b8824
HBASE-16209 Removed unnecessary method and method calls from AssignmentManager and AssignmentManager UI (addendum)
...
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2016-07-29 15:55:11 -07:00
7c97acf6e3
Back port HBASE-16209 Provide an exponential back off policy in reattempting failed region opens
...
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-07-29 09:47:30 -07:00
08b9e6bee0
HBASE-16300 LruBlockCache.CACHE_FIXED_OVERHEAD should calculate LruBlockCache size correctly
...
Signed-off-by: Yu Li <liyu@apache.org>
2016-07-29 14:29:39 +08:00
d597e29ec5
HBASE-16096 Backport. Cleanly remove replication peers from ZooKeeper.
...
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-07-28 11:30:20 -07:00
7983d2f45b
HBASE-16275 Change ServerManager#onlineServers from ConcurrentHashMap to ConcurrentSkipListMap (Huaxiang Sun)
2016-07-28 11:19:06 -07:00
968e464aed
HBASE-16293 TestSnapshotFromMaster#testSnapshotHFileArchiving flakey (Huaxiang Sun)
2016-07-28 10:42:58 -07:00
d349f642c0
HBASE-16262 Backport HBASE-13839: Fix AssgnmentManagerTmpl.jamon issues (coloring, content …etc). Ignoring UI changes provided by HBASE-11344.
...
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-07-27 13:09:28 -07:00
e06bbe4804
HBASE-16280 Use hash based map in SequenceIdAccounting
2016-07-26 16:36:46 +08:00
7e5b931096
HBASE-16281 TestMasterReplication is flaky
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-07-26 11:00:43 +08:00
f35b2c45d4
HBASE-16266 Do not throw ScannerTimeoutException when catch UnknownScannerException
...
Signed-off-by: zhangduo <zhangduo@apache.org>
Conflicts:
hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestScannerTimeout.java
2016-07-25 22:37:59 +08:00
a8dd359d7e
HBASE-16008 A robust way deal with early termination of HBCK (Stephen Yuan Jiang)
2016-07-23 20:21:32 -07:00
276acdb0b0
HBASE-16221 Have ThriftScanner update the ConnectionCache's last used time overtime getScannerRow() to keep the connection alive for long lived scanners
...
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-07-22 17:58:56 -07:00
24a3d6952c
HBASE-16272 Overflow in ServerName's compareTo method (Huaxiang Sun)
2016-07-22 15:29:19 -07:00
ce651f5c6d
HBASE-16024 Revert HBASE-15406 from branch-1.3
2016-07-22 14:50:32 -07:00
2e537bc4ad
HBASE-15291 Revert due to race condition resulting in closed FileSystem
2016-07-21 03:38:22 -07:00
d86f8a4943
HBASE-16244 LocalHBaseCluster start timeout should be configurable (Siddharth Wagle)
2016-07-19 14:12:54 -07:00
cfc22ec1ec
HBASE-16189 [Rolling Upgrade] 2.0 hfiles cannot be opened by 1.x servers
...
(Ram)
2016-07-18 10:16:23 +05:30
1e3bce943b
HBASE-16144 Replication queue's lock will live forever if RS acquiring the lock has died prematurely
2016-07-18 09:34:45 +08:00
40204eb0c1
HBASE-16235 TestSnapshotFromMaster#testSnapshotHFileArchiving will fail if there are too many hfiles (ChiaPing Tsai)
2016-07-16 16:36:55 -07:00
09c7b1e962
HBASE-16095 Add priority to TableDescriptor and priority region open thread pool
...
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
2016-07-13 18:23:05 -07:00
95d141f382
HBASE-16195 Should not add chunk into chunkQueue if not using chunk pool in HeapMemStoreLAB
2016-07-13 09:34:34 +08:00
7c4c51f2c7
HBASE-16220 Demote log level for "HRegionFileSystem - No StoreFiles for" messages to TRACE
2016-07-12 17:00:09 -07:00
36a48a3cf9
HBASE-16207 can't restore snapshot without "Admin" permission
2016-07-12 05:55:07 -07:00
7fa311a940
HBASE-16081 Wait for Replication Tasks to complete before killing the ThreadPoolExecutor inside of HBaseInterClusterReplicationEndpoint
...
Signed-off-by: Mikhail Antonov <antonov@apache.org>
2016-07-11 17:54:24 -07:00
3ff6f45851
HBASE-16160 Support RPC encryption with direct ByteBuffers (Colin Ma via garyh)
2016-07-11 10:45:05 -07:00
e03d4fbb0a
HBASE-16194 Should count in MSLAB chunk allocation into heap size change when adding duplicate cells
2016-07-11 21:40:30 +08:00
9563ab4ca1
HBASE-16176 Bug fixes/improvements on HBASE-15650 Remove TimeRangeTracker as point of contention when many threads reading a StoreFile Fixes HBASE-16074 ITBLL fails, reports lost big or tiny families broken scanning because of a side effect of a clean up in HBASE-15650 to make TimeRange construction consistent exposed a latent issue in TimeRange#compare. See HBASE-16074 for more detail.
...
Also change HFile Writer constructor so we pass in the TimeRangeTracker, if one,
on construction rather than set later (the flag and reference were not volatile
so could have made for issues in concurrent case). And make sure the construction
of a TimeRange from a TimeRangeTracer on open of an HFile Reader never makes a
bad minimum value, one that would preclude us reading any values from a file
(set min to 0)
M hbase-common/src/main/java/org/apache/hadoop/hbase/io/TimeRange.java
Call through to next constructor (if minStamp was 0, we'd skip setting
allTime=true). Add asserts that timestamps are not < 0 cos it messes
us up if they are (we already were checking for < 0 on construction but
assert passed in timestamps are not < 0).
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
Add constructor override that takes a TimeRangeTracker (set when flushing
but not when compacting)
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/Store.java
Add override creating an HFile in tmp that takes a TimeRangeTracker
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFile.java
Add override for HFile Writer that takes a TimeRangeTracker Take it on
construction instead of having it passed by a setter later (flags and
reference set by the setter were not volatile... could have been prob
in concurrent case)
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/TimeRangeTracker.java
Log WARN if bad initial TimeRange value (and then 'fix' it)
M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestTimeRangeTracker.java
A few tests to prove serialization works as expected and that we'll get a bad min if not constructed properly.
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/ScanQueryMatcher.java
Handle OLDEST_TIMESTAMP explictly. Don't expect TimeRange to do it.
M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestQueryMatcher.java
Refactor from junit3 to junit4 and add test for this weird case.
2016-07-08 14:23:23 -07:00
09d9dc4b59
HBASE-16201 NPE in RpcServer causing intermittent UT failure of TestMasterReplication#testHFileCyclicReplication
2016-07-09 02:04:54 +08:00
44d2a9bc1c
Revert "NPE in RpcServer causing intermittent UT failure of TestMasterReplication#testHFileCyclicReplication"
...
This reverts commit b6d4fc955f
2016-07-09 02:04:01 +08:00
b6d4fc955f
NPE in RpcServer causing intermittent UT failure of TestMasterReplication#testHFileCyclicReplication
2016-07-09 01:06:55 +08:00
37040bfc42
HBASE-15775 Canary launches two AuthUtil Chores
2016-07-08 09:36:17 -07:00
2d6cdfb10a
HBASE-16180 Fix ST_WRITE_TO_STATIC_FROM_INSTANCE_METHOD findbugs introduced by parent
2016-07-06 09:12:00 -07:00
368c32e322
HBASE-16157 The incorrect block cache count and size are caused by removing duplicate block key in the LruBlockCache (ChiaPing Tsai)
2016-07-05 13:54:59 -07:00
ff8c2fcac0
HBASE-16087 Replication shouldn't start on a master if if only hosts system tables
2016-07-05 13:47:49 -07:00
8efc6148b9
HBASE-16091 Canary takes lot more time when there are delete markers in the table (Vishal Khandelwal)
...
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/tool/Canary.java
Amending-Author: Andrew Purtell <apurtell@apache.org>
2016-07-05 10:34:27 -07:00
84dd9cbcb6
HBASE-16132 Scan does not return all the result when regionserver is busy (binlijin)
2016-07-04 21:46:19 +08:00
4807836304
HBASE-16135 addendum format comments
2016-07-04 20:41:06 +08:00
721c5b7128
HBASE-16135 PeerClusterZnode under rs of removed peer may never be deleted
2016-07-04 19:52:28 +08:00
f18ac8157b
HBASE-15844 We should respect hfile.block.index.cacheonwrite when write intermediate index Block
2016-07-02 09:09:51 +08:00
a345aa8707
HBASE-16108 RowCounter should support multiple key ranges (Konstantin Ryakhovskiy)
2016-07-01 09:32:43 -07:00
5bc0655529
HBASE-16114 Get regionLocation of required regions only for MR jobs (Thiruvel Thirumoolan)
2016-07-01 03:14:51 -07:00
f4d7cd5f58
HBASE-16150 Remove ConcurrentIndex (Hiroshi Ikeda)
2016-06-30 15:04:36 -07:00
9aa40424fe
HBASE-16140 bump owasp.esapi from 2.1.0 to 2.1.0.1
2016-06-29 08:58:25 -07:00
b93c08d358
HBASE-15976 RegionServerMetricsWrapperRunnable will be failure when disable blockcache. - Addendum
2016-06-29 16:37:23 +08:00
96a24aede7
HBASE-16122 PerformanceEvaluation should provide user friendly hint when client threads argument is missing (Konstantin Ryakhovskiy)
2016-06-28 20:28:06 -07:00
7a78d871d0
HBASE-15976 RegionServerMetricsWrapperRunnable will be failure when disable blockcache.
2016-06-28 13:52:30 +08:00
1a88673f33
HBASE-16052 Improve HBaseFsck Scalability (Ben Lau)
2016-06-27 20:16:34 -07:00
34d62ecfae
HBASE-14007 Writing to table through MR should fail upfront if table does not exist/is disabled (Thiruvel Thirumoolan)
2016-06-27 14:47:57 -07:00
385a6e878f
HBASE-16055 TestHFileOutputFormat2 is broken (Ram)
2016-06-27 11:02:03 +05:30
f4c1fd1a47
HBASE-16089 Add on FastPath for CoDel
2016-06-25 12:59:18 -07:00
8ef87ce434
Revert "Is this ok... removing synchronizations?"
...
REVERT MISTAKEN COMMIT
This reverts commit 86242e1f55
2016-06-25 10:45:10 +01:00
a02c6da4d3
HBASE-16055 PutSortReducer loses any Visibility/acl attribute set on the
...
Puts (Ram)
2016-06-24 15:26:51 +05:30
83c0cc109e
HBASE-15353 Add metric for number of CallQueueTooBigException's
2016-06-24 14:39:53 +08:00
198165ef5b
HBASE-16085 Add a metric for failed compactions
2016-06-23 16:04:27 -07:00
93d82112f0
HBASE-16093 Fix splits failed before creating daughter regions leave meta inconsistent
2016-06-23 12:21:52 -07:00
857ec2f448
HBASE-16090 ResultScanner is not closed in SyncTable#finishRemainingHashRanges()
2016-06-23 07:29:34 -07:00
339cb81747
HBASE-16068 Procedure v2 - use consts for conf properties in tests
2016-06-22 23:08:13 -07:00
7056b66d37
HBASE-16070 Mapreduce Serialization classes do not have Interface audience
...
(Ram)
2016-06-23 10:55:54 +05:30
9e9c243ed0
HBASE-16049 TestRowProcessorEndpoint is failing on Apache Builds (Guanghao Zhang)
2016-06-22 12:24:39 -07:00
ba631b4d92
HBASE-16012 Major compaction can't work due to obsolete scanner read point in RegionServer (Guanghao Zhang)
2016-06-22 02:09:35 -07:00
6ba67ab8d6
HBASE-16062 Improper error handling in WAL Reader/Writer creation (Vladimir Rodionov)
2016-06-21 20:01:05 -07:00
8dea578bcf
HBASE-16051 TestScannerHeartbeatMessages fails on some machines (Phil Yang)
2016-06-21 09:28:46 -07:00
c6b8c9bb02
HBASE-16032 Possible memory leak in StoreScanner
2016-06-21 20:07:52 +08:00
78f5262896
HBASE-16059 Region normalizer fails to trigger merge action where one of the regions is empty
2016-06-20 11:24:33 -07:00
6605f8f683
HBASE-14644 Region in transition metric is broken -- addendum (Huaxiang Sun)
2016-06-20 10:45:23 -07:00
d34e65327e
HBASE-16023 Fastpath for the FIFO rpcscheduler AMENDMENT
2016-06-20 08:28:43 +01:00
86242e1f55
Is this ok... removing synchronizations?
2016-06-20 08:23:49 +01:00
1a989a1964
HBASE-16058 TestHRegion fails on 1.4 builds
...
Conflicts:
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegion.java
2016-06-17 19:00:01 -07:00
411e3cdb6d
HBASE-16023 Fastpath for the FIFO rpcscheduler Adds an executor that does balanced queue and fast path handing off requests directly to waiting handlers if any present. Idea taken from Apace Kudu (incubating). See https://gerrit.cloudera.org/#/c/2938/7/src/kudu/rpc/service_queue.h
...
M hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/RpcExecutor.java
Refactor which makes a Handler type. Put all 'handler' stuff inside this
new type. Also make it so subclass can provide its own Handler type.
M hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/SimpleRpcScheduler.java
Name the handler threads for their type so can tell if configs are
having an effect.
Signed-off-by: stack <stack@apache.org>
2016-06-17 17:07:35 -07:00
76cf0d799f
HBASE-15224 Undo "hbase.increment.fast.but.narrow.consistency" option; it is not necessary since HBASE-15213 (stack)
2016-06-17 14:39:45 -07:00
3723baefe3
HBASE-14915 Hanging test : org.apache.hadoop.hbase.mapreduce.TestImportExport (Heng Chen)
2016-06-17 12:35:36 -07:00
1f37cdfb4b
HBASE-14730 region server needs to log warnings when there are attributes configured for cells with hfile v2 (huaxiang sun)
2016-06-17 11:26:53 -07:00
419d15f834
HBASE-14277 TestRegionServerHostname.testRegionServerHostname may fail at host with a case sensitive name
2016-06-17 10:49:21 -07:00
755a5de470
HBASE-16048 Tag InternalScanner with LimitedPrivate(HBaseInterfaceAudience.COPROC)
2016-06-17 07:30:43 -07:00
45a0fc531a
HBASE-5291 Addendum 2 passes correct path to deleteRecursively
2016-06-16 17:01:51 -07:00
4c1db3cb03
HBASE-16045 endtime argument for VerifyReplication was incorrectly specified in usage
2016-06-16 15:52:16 -07:00
560bf74884
HBASE-16047 TestFastFail is broken again
2016-06-16 14:10:32 -07:00
66b2788432
HBASE-16033 Add more details in logging of responseTooSlow/TooLarge
2016-06-16 16:40:38 +08:00
0b48adaa30
HBASE-5291 Addendum removes duplicate spnego (Josh Elser)
2016-06-15 14:59:58 -07:00
ff5dbf584e
HBASE-15950 Fix memstore size estimates to be more tighter
2016-06-15 14:19:28 -07:00
b64d5e5f4b
HBASE-16026 Master UI should display status of additional ZK switches
2016-06-15 13:06:52 -07:00
e417cf6b24
HBASE-5291 Add Kerberos HTTP SPNEGO authentication support to HBase web consoles (Josh Elser)
2016-06-15 10:26:18 -07:00
cc50bfcc72
HBASE-16017 HBase TableOutputFormat has connection leak in getRecordWriter (Zhan Zhang)
2016-06-15 09:18:18 -07:00
8a0e135a35
HBASE-15971 Regression: Random Read/WorkloadC slower in 1.x than 0.98 Restore FIFO as the default in place of 'deadline' that sorted on request priority. The sort costs us throughput. Enable it if you want it rather than have it as default.
...
Name threads to include the scheduler type.
2016-06-14 16:13:38 -07:00
e35564ede0
HBASE-15746 Remove extra RegionCoprocessor preClose() in RSRpcServices#closeRegion (Stephen Yuan Jiang)
2016-06-14 13:31:24 -07:00
286934fc40
HBASE-16016 Fix overflow deadline value in AssignmentManager#waitForAssignment (Stephen Yuan Jiang)
2016-06-13 18:22:35 -07:00
cb331507b9
HBASE-16007 Job's Configuration should be passed to TableMapReduceUtil#addDependencyJars() in WALPlayer
2016-06-11 07:07:39 -07:00
d1bec9d0b8
HBASE-14644 Region in transition metric is broken (Huaxiang Sun)
2016-06-10 21:53:14 -07:00
37807b38a3
HBASE-15946 Eliminate possible security concerns in RS web UI's store file metrics (Sean Mackrory)
2016-06-09 18:54:53 -07:00
a4e2b3856e
HBASE-15990 The priority value of subsequent coprocessors in the Coprocessor.Priority.SYSTEM list are not incremented by one (ChiaPing Tsai)
2016-06-09 11:20:33 -07:00
a40ec70da9
HBASE-15952 Bulk load data replication is not working when RS user does not have permission on hfile-refs node
2016-06-09 18:46:07 +05:30
867150333c
HBASE-15994 Allow selection of RpcSchedulers
...
Adds logging by the RpcExecutors of their run configs
Adds a FifoRpcSchedulerFactory so you can try Fifo scheduler.
2016-06-08 20:25:38 -07:00
e90a6db20b
Revert "HBASE-15994 Allow selection of RpcSchedulers Adds logging by the RpcExecutors of their run configs Changes the default RpcSchedulerFactory from SimpleRpcSchedulerFactory.class to RpcSchedulerFactoryImpl.class. RpcSchedulerFactoryImpl.class. defaults to using SimpleRpcSchedulerFactory.class and the SimpleRpcScheduler, as has been default up to this, unless you set "hbase.region.server.rpc.scheduler.class" to org.apache.hadoop.hbase.ipc.FifoRpcScheduler"
...
This reverts commit d49b883825
2016-06-08 20:25:09 -07:00
d49b883825
HBASE-15994 Allow selection of RpcSchedulers Adds logging by the RpcExecutors of their run configs Changes the default RpcSchedulerFactory from SimpleRpcSchedulerFactory.class to RpcSchedulerFactoryImpl.class. RpcSchedulerFactoryImpl.class. defaults to using SimpleRpcSchedulerFactory.class and the SimpleRpcScheduler, as has been default up to this, unless you set "hbase.region.server.rpc.scheduler.class" to org.apache.hadoop.hbase.ipc.FifoRpcScheduler
...
Signed-off-by: stack <stack@apache.org>
2016-06-08 20:06:22 -07:00
602b2839c6
HBASE-15600 Add provision for adding mutations to memstore or able to write to same region in batchMutate coprocessor hooks (Rajeshbabu and Enis)
...
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
2016-06-07 20:32:06 -07:00
Andrew Purtell
Enis Soztutar
zhangduo
Joseph Hwang
Yu Sun
Matteo Bertozzi
Phil Yang
Stephen Yuan Jiang
Mikhail Antonov
tedyu
Ramkrishna
Yu Li
Gary Helmling
stack
Elliott Clark
chenheng
Jonathan M Hsieh
Jingcheng Du
Liu Shaohui
Sean Mackrory
Ashish Singhi