3c39cbd92c
HBASE-16201 NPE in RpcServer causing intermittent UT failure of TestMasterReplication#testHFileCyclicReplication
2016-07-09 02:02:00 +08:00
1578a045b6
Revert "NPE in RpcServer causing intermittent UT failure of TestMasterReplication#testHFileCyclicReplication"
...
This reverts commit a33097e067
2016-07-09 02:01:43 +08:00
5e0d97e0e9
HBASE-16171 Fix the potential problems in TestHCM.testConnectionCloseAllowsInterrupt (Colin Ma)
2016-07-08 10:18:36 -07:00
a33097e067
NPE in RpcServer causing intermittent UT failure of TestMasterReplication#testHFileCyclicReplication
2016-07-09 01:05:10 +08:00
581d2b7de5
HBASE-16162 Compacting Memstore : unnecessary push of active segments to pipeline.
2016-07-06 18:54:35 +05:30
ae92668dd6
HBASE-16087 Replication shouldn't start on a master if if only hosts system tables
2016-07-05 13:50:37 -07:00
20a99b4c06
HBASE-16144 Revert - test failure in TestMultiSlaveReplication#testMultiSlaveReplication seems to be related
2016-07-05 13:19:33 -07:00
318751cfd6
HBASE-16091 Canary takes lot more time when there are delete markers in the table (Vishal Khandelwal)
2016-07-05 11:13:48 -07:00
d016338e45
HBASE-16157 The incorrect block cache count and size are caused by removing duplicate block key in the LruBlockCache (ChiaPing Tsai)
2016-07-05 10:21:27 -07:00
b5cdb38dc7
HBASE-16144 Replication queue's lock will live forever if RS acquiring the lock has died prematurely (Phil Yang)
2016-07-05 07:16:12 -07:00
7f44dfd85f
HBASE-16132 Scan does not return all the result when regionserver is busy (binlijin)
2016-07-04 21:45:04 +08:00
6944a17ad4
HBASE-16135 PeerClusterZnode under rs of removed peer may never be deleted
2016-07-04 19:26:27 +08:00
d22c23c396
HBASE-16163 Compacting Memstore : CompactionPipeline#addFirst can use LinkedList#addFirst.
2016-07-03 21:35:29 +05:30
97f2294bfd
HBASE-16164 Missing close of new compacted segments in few occasions which might leak MSLAB chunks from pool.
2016-07-02 11:42:08 +05:30
561eb82968
HBASE-15844 We should respect hfile.block.index.cacheonwrite when write intermediate index Block
2016-07-02 09:04:15 +08:00
fe75edb556
HBASE-16157 Revert - ChiaPing has new fix
2016-07-01 13:00:05 -07:00
d92a99da0e
HBASE-16125 RegionMover uses hardcoded, Unix-style tmp folder - breaks Windows (Vladimir Rodionov)
2016-07-01 10:02:25 -07:00
5a7c9939cb
HBASE-16157 The incorrect block cache count and size are caused by removing duplicate block key in the LruBlockCache (ChiaPing Tsai)
2016-07-01 09:43:39 -07:00
cc73c03118
HBASE-16108 RowCounter should support multiple key ranges (Konstantin Ryakhovskiy)
2016-07-01 03:41:17 -07:00
139f0ed53c
HBASE-16155 Compacting Memstore : Few log improvements.
2016-07-01 10:14:07 +05:30
d1d8cc71c9
HBASE-16150 Remove ConcurrentIndex (Hiroshi Ikeda)
2016-06-30 15:03:32 -07:00
e2566eb0ee
HBASE-16153 Correct the config name
...
'hbase.memestore.inmemoryflush.threshold.factor' (Ram)
2016-06-30 17:44:08 +05:30
e1d130946b
HBASE-16117 Fix Connection leak in mapred.TableOutputFormat
2016-06-29 17:18:43 -07:00
42106b89b1
HBASE-16114 Get regionLocation of required regions only for MR jobs (Thiruvel Thirumoolan)
2016-06-29 16:34:44 -07:00
9b1ecb31f0
HBASE-16143 Change MemstoreScanner constructor to accept
...
List<KeyValueScanner> (Ram)
2016-06-29 23:10:55 +05:30
727394c2e9
HBASE-16140 bump owasp.esapi from 2.1.0 to 2.1.0.1
2016-06-29 08:51:00 -07:00
6fb0dd07a8
HBASE-16139 Use CellUtil instead of KeyValueUtil in Import (NIDHI GAMBHIR)
2016-06-29 02:45:00 -07:00
432868b038
HBASE-15976 RegionServerMetricsWrapperRunnable will be failure when disable blockcache. - Addendum
2016-06-29 16:31:23 +08:00
394e7224a9
HBASE-16122 PerformanceEvaluation should provide user friendly hint when client threads argument is missing (Konstantin Ryakhovskiy)
2016-06-28 17:42:51 -07:00
8bc4d4131c
HBASE-16121 Require only MasterServices to the ServerManager constructor
2016-06-28 07:42:40 -07:00
e768c4afac
HBASE-15976 RegionServerMetricsWrapperRunnable will be failure when disable blockcache.
2016-06-28 13:45:41 +08:00
13cf4fb3fc
HBASE-16052 Improve HBaseFsck Scalability (Ben Lau)
2016-06-27 13:24:35 -07:00
424b789e03
HBASE-14007 Writing to table through MR should fail upfront if table does not exist/is disabled (Thiruvel Thirumoolan)
2016-06-27 06:41:00 -07:00
ba9286911f
HBASE-16109 Add Interface audience annotation to a few classes
2016-06-27 06:29:04 -07:00
fc4b8aa89d
HBASE-16089 Add on FastPath for CoDel
2016-06-25 12:57:15 -07:00
e8599a2921
HBASE-16103 Procedure v2 - TestCloneSnapshotProcedure relies on execution order
2016-06-24 09:09:59 -07:00
99dc300d37
HBASE-16055 PutSortReducer loses any Visibility/acl attribute set on the
...
Puts (Ram)
2016-06-24 15:09:53 +05:30
518faa735b
HBASE-15353 Add metric for number of CallQueueTooBigException's
2016-06-24 13:00:06 +08:00
68c1b34dbc
HBASE-16040 Remove configuration "hbase.replication"
2016-06-24 10:41:35 +08:00
f4cec2e202
HBASE-16085 Add a metric for failed compactions
2016-06-23 15:38:58 -07:00
9cd097cfac
HBASE-16090 ResultScanner is not closed in SyncTable#finishRemainingHashRanges()
2016-06-23 07:28:35 -07:00
d66316fd80
HBASE-16068 Procedure v2 - use consts for conf properties in tests
2016-06-22 22:48:07 -07:00
c1a559a666
HBASE-16070 Mapreduce Serialization classes do not have Interface audience
...
(Ram)
2016-06-23 10:22:24 +05:30
d297ecdf3c
HBASE-16083 Addendum fixes config property names in tests (Joseph Hwang)
2016-06-22 17:31:57 -07:00
0ea4d2f461
HBASE-16083 revert Addendum - Joseph discovered the mistake first
2016-06-22 17:31:24 -07:00
da09fd0781
HBASE-16083 Addendum fixes config property names in tests
2016-06-22 16:35:37 -07:00
f3b3a7c9b5
HBASE-16080 Fix flakey test TestTableBasedReplicationSourceManager.cleanupFailoverQueues().
...
Instead of running the primary test in a separate thread and hoping it finishes in time, just run the test in the primary thread.
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-06-22 12:26:35 -07:00
6fc71c5d31
HBASE-16049 TestRowProcessorEndpoint is failing on Apache Builds (Guanghao Zhang)
2016-06-22 12:24:07 -07:00
2846113b59
HBASE-16012 Major compaction can't work due to obsolete scanner read point in RegionServer (Guanghao Zhang)
2016-06-22 02:08:45 -07:00
152594560e
HBASE-16036 Made Replication Table creation non-blocking.
...
All ReplicationTableBase method's that need to access the Replication Table will block until it is created though.
Also refactored ReplicationSourceManager so that abandoned queue adoption is run in the background too so that it does not block HRegionServer initialization.
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-06-21 13:05:50 -07:00
b006e41a37
HBASE-16051 TestScannerHeartbeatMessages fails on some machines (Phil Yang)
2016-06-21 07:32:30 -07:00
471f942ec8
HBASE-16032 Possible memory leak in StoreScanner
2016-06-21 20:06:33 +08:00
3de0c63105
HBASE-16035 Nested AutoCloseables might not all get closed (Sean Mackrory)
2016-06-20 16:25:50 -07:00
313a3d23a8
HBASE-14644 Region in transition metric is broken -- addendum (Huaxiang Sun)
2016-06-20 10:46:25 -07:00
be56b5ae71
HBASE-16059 Region normalizer fails to trigger merge action where one of the regions is empty
2016-06-20 10:40:50 -07:00
095a82584e
HBASE-16062 Improper error handling in WAL Reader/Writer creation (Vladimir Rodionov)
2016-06-20 07:34:26 -07:00
71c8cd5b1f
HBASE-16042 Add support in PE tool for InMemory Compaction (Ram)
2016-06-20 16:29:24 +05:30
01684c3417
HBASE-16023 Fastpath for the FIFO rpcscheduler AMENDMENT
2016-06-20 08:34:32 +01:00
4421fdf981
HBASE-16066 Resolve RpC_REPEATED_CONDITIONAL_TEST findbugs warnings in HMaster, addendum to HBASE-15467
2016-06-19 17:25:26 +08:00
6717f0e388
HBASE-16058 TestHRegion fails on 1.4 builds
2016-06-17 18:41:51 -07:00
bdb0cc8808
HBASE-15467 Remove 1.x/2.0 TableDescriptor incompatibility
2016-06-17 17:25:04 -07:00
81a9c1ac31
HBASE-16053 Master code is not setting the table in ENABLING state in create table
2016-06-17 13:29:33 -07:00
61ff6ced5b
HBASE-16018 Refactored the ReplicationPeers interface to clear up what some methods do and move away from a ZooKeeper-specific implementation.
...
Also added some documentation for undocumented methods.
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-06-17 13:04:21 -07:00
5147fb12a5
HBASE-16048 Tag InternalScanner with LimitedPrivate(HBaseInterfaceAudience.COPROC)
2016-06-17 07:27:52 -07:00
3abd52bdc6
HBASE-15429 Add split policy for busy regions
...
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-06-16 17:36:54 -07:00
6d0e0e3721
HBASE-5291 Addendum 2 passes correct path to deleteRecursively
2016-06-16 17:00:57 -07:00
d8902ba0e6
HBASE-16045 endtime argument for VerifyReplication was incorrectly specified in usage
2016-06-16 15:50:29 -07:00
62a4a2c029
HBASE-16047 TestFastFail is broken again
2016-06-16 14:09:48 -07:00
6d02f36ac7
HBASE-16033 Add more details in logging of responseTooSlow/TooLarge
2016-06-16 16:42:10 +08:00
f19f1d9e99
HBASE-15999 NPE in MemstoreCompactor (Ram)
2016-06-16 10:06:40 +05:30
1bad166f67
HBASE-5291 Addendum removes duplicate spnego (Josh Elser)
2016-06-15 14:59:17 -07:00
bff35d6387
HBASE-15950 Fix memstore size estimates to be more tighter
2016-06-15 13:34:39 -07:00
5f9d1a71c8
HBASE-16026 Master UI should display status of additional ZK switches
2016-06-15 12:59:24 -07:00
2093aadec1
HBASE-15974 Create a ReplicationQueuesClientHBaseImpl
...
Building on HBase-15958.
Provided a ReplicationQueuesClientHBaseImpl that relies on the HBase Replication Table to track WAL queues.
Refactored out a large section of ReplicationQueuesHBaseImpl into a ReplicationTableClient class that handles Replication Table operations.
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-06-15 10:43:14 -07:00
ae5fe1e616
HBASE-5291 Add Kerberos HTTP SPNEGO authentication support to HBase web consoles (Josh Elser)
2016-06-15 09:26:44 -07:00
6c60bc9f6c
HBASE-16017 HBase TableOutputFormat has connection leak in getRecordWriter (Zhan Zhang)
2016-06-15 06:32:23 -07:00
db234bf15d
HBASE-16023 Fastpath for the FIFO rpcscheduler. addendum
2016-06-15 16:20:55 +08:00
ee86e91e7e
HBASE-16023 Fastpath for the FIFO rpcscheduler Adds an executor that does balanced queue and fast path handing off requests directly to waiting handlers if any present. Idea taken from Apace Kudu (incubating). See https://gerrit.cloudera.org/#/c/2938/7/src/kudu/rpc/service_queue.h
...
M hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/RpcExecutor.java
Refactor which makes a Handler type. Put all 'handler' stuff inside this
new type. Also make it so subclass can provide its own Handler type.
M hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/SimpleRpcScheduler.java
Name the handler threads for their type so can tell if configs are
having an effect.
Signed-off-by: stack <stack@apache.org>
2016-06-14 17:42:01 -07:00
fa50d456a8
HBASE-15971 Regression: Random Read/WorkloadC slower in 1.x than 0.98 Restore FIFO as the default in place of 'deadline' that sorted on request priority. The sort costs us throughput. Enable it if you want it rather than have it as default.
...
Name threads to include the scheduler type.
2016-06-14 16:51:24 -07:00
df24004353
HBASE-15746 Remove extra RegionCoprocessor preClose() in RSRpcServices#closeRegion (Stephen Yuan Jiang)
2016-06-14 13:30:41 -07:00
17bcf14fea
HBASE-15525 OutOfMemory could occur when using BoundedByteBufferPool during RPC bursts.
2016-06-14 19:03:54 +05:30
e486d274c5
HBASE-16016 Fix overflow deadline value in AssignmentManager#waitForAssignment (Stephen Yuan Jiang)
2016-06-13 18:21:41 -07:00
56c209c8aa
HBASE-15991 CompactingMemstore#InMemoryFlushRunnable should implement
...
Comparable/Comparator (Ram)
2016-06-13 17:42:35 +05:30
2d0448fa84
Revert HBASE-15991 commit
2016-06-13 15:05:50 +05:30
2738518d43
HBASE-15991 CompactingMemstore#InMemoryFlushRunnable should implement
...
Comparable/Comparator (Ram)
2016-06-13 12:43:52 +05:30
6360cc0307
HBASE-16007 Job's Configuration should be passed to TableMapReduceUtil#addDependencyJars() in WALPlayer
2016-06-11 07:05:27 -07:00
4c885f4fdb
HBASE-14644 Region in transition metric is broken (Huaxiang Sun)
2016-06-10 21:52:24 -07:00
6da6babe4f
HBASE-15946. Eliminate possible security concerns in Store File metrics.
...
Invoking 'hbase hfile' inside a servlet raises several concerns. This
patch avoids invoking a separate process, and also adds validation that
the file being read is at least inside the HBase root directory.
Signed-off-by: Mikhail Antonov <antonov@apache.org>
2016-06-09 16:08:19 -07:00
babdedc1b0
HBASE-15958 Implement ClaimQueues on top of HBase
...
Building on HBase-15883.
Now implementing the claim queues procedure within an HBase table.
Also added UnitTests to test claimQueue.
Peer tracking will still be performed by ZooKeeper though.
Also modified the queueId tracking procedure so we no longer have to perform scans over the Replication Table.
This does make our queue naming schema slightly different from ReplicationQueuesZKImpl though.
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-06-09 15:05:54 -07:00
55a04b7810
HBASE-15990 The priority value of subsequent coprocessors in the Coprocessor.Priority.SYSTEM list are not incremented by one (ChiaPing Tsai)
2016-06-09 10:26:10 -07:00
9012a0b123
HBASE-15952 Bulk load data replication is not working when RS user does not have permission on hfile-refs node
2016-06-09 18:44:29 +05:30
031b745001
HBASE-15994 Allow selection of RpcSchedulers
...
Adds logging by the RpcExecutors of their run configs
Adds a FifoRpcSchedulerFactory so you can try Fifo scheduler.
2016-06-08 20:23:11 -07:00
407aa4d496
Revert "HBASE-15994 Allow selection of RpcSchedulers Adds logging by the RpcExecutors of their run configs Changes the default RpcSchedulerFactory from SimpleRpcSchedulerFactory.class to RpcSchedulerFactoryImpl.class. RpcSchedulerFactoryImpl.class. defaults to using SimpleRpcSchedulerFactory.class and the SimpleRpcScheduler, as has been default up to this, unless you set "hbase.region.server.rpc.scheduler.class" to org.apache.hadoop.hbase.ipc.FifoRpcScheduler"
...
This reverts commit 3ac4a57fd2
2016-06-08 20:22:50 -07:00
3ac4a57fd2
HBASE-15994 Allow selection of RpcSchedulers Adds logging by the RpcExecutors of their run configs Changes the default RpcSchedulerFactory from SimpleRpcSchedulerFactory.class to RpcSchedulerFactoryImpl.class. RpcSchedulerFactoryImpl.class. defaults to using SimpleRpcSchedulerFactory.class and the SimpleRpcScheduler, as has been default up to this, unless you set "hbase.region.server.rpc.scheduler.class" to org.apache.hadoop.hbase.ipc.FifoRpcScheduler
...
Signed-off-by: stack <stack@apache.org>
2016-06-08 20:20:50 -07:00
a7172d5611
HBASE-15959 Fix flaky test TestRegionServerMetrics.testMobMetrics (Huaxiang Sun and Jingcheng Du)
2016-06-08 19:07:13 -07:00
d9463bcce0
HBASE-15989 Remove hbase.online.schema.update.enable
2016-06-08 13:09:31 -07:00
d5d9b7d500
HBASE-15107 Procedure v2 - Procedure Queue with Region locks
2016-06-08 12:52:58 -07:00
d05a3722c8
HBASE-15600 Add provision for adding mutations to memstore or able to write to same region in batchMutate coprocessor hooks (Rajeshbabu and Enis)
2016-06-07 20:12:51 -07:00
3a95552cfe
HBASE-15948 Port "HADOOP-9956 RPC listener inefficiently assigns connections to readers" Adds HADOOP-9955 RPC idle connection closing is extremely inefficient
...
Changes how we do accounting of Connections to match how it is done in Hadoop.
Adds a ConnectionManager class. Adds new configurations for this new class.
"hbase.ipc.client.idlethreshold" 4000
"hbase.ipc.client.connection.idle-scan-interval.ms" 10000
"hbase.ipc.client.connection.maxidletime" 10000
"hbase.ipc.client.kill.max", 10
"hbase.ipc.server.handler.queue.size", 100
The new scheme does away with synchronization that purportedly would freeze out
reads while we were cleaning up stale connections (according to HADOOP-9955)
Also adds in new mechanism for accepting Connections by pulling in as many
as we can at a time adding them to a Queue instead of doing one at a time.
Can help when bursty traffic according to HADOOP-9956. Removes a blocking
while Reader is busy parsing a request. Adds configuration
"hbase.ipc.server.read.connection-queue.size" with default of 100 for
queue size.
Signed-off-by: stack <stack@apache.org>
2016-06-07 16:42:21 -07:00
e66ecd7db6
Revert "HBASE-15948 Port "HADOOP-9956 RPC listener inefficiently assigns connections to readers""
...
Revert mistaken commit...
This reverts commit e0b70c00e7
2016-06-07 16:41:30 -07:00
Yu Li
stack
anoopsjohn
Elliott Clark
tedyu
Andrew Purtell
zhangduo
chenheng
Ramkrishna
Jonathan M Hsieh
Jingcheng Du
Matteo Bertozzi
Gary Helmling
Joseph Hwang
Enis Soztutar
Ashu Pachauri
Mikhail Antonov
Stephen Yuan Jiang
Sean Mackrory
Ashish Singhi