Jonathan M Hsieh
a7172d5611
HBASE-15959 Fix flaky test TestRegionServerMetrics.testMobMetrics (Huaxiang Sun and Jingcheng Du)
2016-06-08 19:07:13 -07:00
Matteo Bertozzi
d9463bcce0
HBASE-15989 Remove hbase.online.schema.update.enable
2016-06-08 13:09:31 -07:00
Matteo Bertozzi
d5d9b7d500
HBASE-15107 Procedure v2 - Procedure Queue with Region locks
2016-06-08 12:52:58 -07:00
Enis Soztutar
d05a3722c8
HBASE-15600 Add provision for adding mutations to memstore or able to write to same region in batchMutate coprocessor hooks (Rajeshbabu and Enis)
2016-06-07 20:12:51 -07:00
stack
3a95552cfe
HBASE-15948 Port "HADOOP-9956 RPC listener inefficiently assigns connections to readers" Adds HADOOP-9955 RPC idle connection closing is extremely inefficient
...
Changes how we do accounting of Connections to match how it is done in Hadoop.
Adds a ConnectionManager class. Adds new configurations for this new class.
"hbase.ipc.client.idlethreshold" 4000
"hbase.ipc.client.connection.idle-scan-interval.ms" 10000
"hbase.ipc.client.connection.maxidletime" 10000
"hbase.ipc.client.kill.max", 10
"hbase.ipc.server.handler.queue.size", 100
The new scheme does away with synchronization that purportedly would freeze out
reads while we were cleaning up stale connections (according to HADOOP-9955)
Also adds in new mechanism for accepting Connections by pulling in as many
as we can at a time adding them to a Queue instead of doing one at a time.
Can help when bursty traffic according to HADOOP-9956. Removes a blocking
while Reader is busy parsing a request. Adds configuration
"hbase.ipc.server.read.connection-queue.size" with default of 100 for
queue size.
Signed-off-by: stack <stack@apache.org>
2016-06-07 16:42:21 -07:00
stack
e66ecd7db6
Revert "HBASE-15948 Port "HADOOP-9956 RPC listener inefficiently assigns connections to readers""
...
Revert mistaken commit...
This reverts commit e0b70c00e7
.
2016-06-07 16:41:30 -07:00
stack
6d5a25935e
Revert "HBASE-15967 Metric for active ipc Readers and make default fraction of cpu count"
...
Revert mistaken commit
This reverts commit 1125215aad
.
2016-06-07 16:41:01 -07:00
stack
1125215aad
HBASE-15967 Metric for active ipc Readers and make default fraction of cpu count
...
Add new metric hbase.regionserver.ipc.runningReaders
Also make it so Reader count is a factor of processor count
2016-06-07 13:10:14 -07:00
stack
e0b70c00e7
HBASE-15948 Port "HADOOP-9956 RPC listener inefficiently assigns connections to readers"
...
Adds HADOOP-9955 RPC idle connection closing is extremely inefficient
Then removes queue added by HADOOP-9956 at Enis suggestion
Changes how we do accounting of Connections to match how it is done in Hadoop.
Adds a ConnectionManager class. Adds new configurations for this new class.
"hbase.ipc.client.idlethreshold" 4000
"hbase.ipc.client.connection.idle-scan-interval.ms" 10000
"hbase.ipc.client.connection.maxidletime" 10000
"hbase.ipc.client.kill.max", 10
"hbase.ipc.server.handler.queue.size", 100
The new scheme does away with synchronization that purportedly would freeze out
reads while we were cleaning up stale connections (according to HADOOP-9955)
Also adds in new mechanism for accepting Connections by pulling in as many
as we can at a time adding them to a Queue instead of doing one at a time.
Can help when bursty traffic according to HADOOP-9956. Removes a blocking
while Reader is busy parsing a request. Adds configuration
"hbase.ipc.server.read.connection-queue.size" with default of 100 for
queue size.
2016-06-07 13:10:14 -07:00
Andrew Purtell
376ad0d986
HBASE-15698 Increment TimeRange not serialized to server (Ted Yu)
2016-06-06 22:17:00 -07:00
Enis Soztutar
3d7840a173
HBASE-15954 REST server should log requests with TRACE instead of DEBUG
2016-06-06 10:58:37 -07:00
Stephen Yuan Jiang
de1b5ff776
HBASE-15955 Disable action in CatalogJanitor#setEnabled should wait for active cleanup scan to finish (Stephen Yuan Jiang)
2016-06-03 15:49:23 -07:00
Joseph Hwang
21e98271c3
HBASE-15883 Adding WAL files and tracking offsets in HBase.
...
Implemented ReplicationQueuesHBaseImpl that tracks WAL offsets and replication queues in an HBase table.
Only wrote the basic tracking methods, have not implemented claimQueue() or HFileRef methods yet.
Wrote a basic unit test for ReplicationQueueHBaseImpl that tests the implemented functions on a single Region Server
Signed-off-by: Elliott Clark <elliott@fb.com>
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-06-03 15:23:10 -07:00
Apekshit
9a53d8b385
HBASE-15929 There are two tests named TestRegionServerMetrics. This causes slight issues when parsing console output for hanging tests and flaky tests analysis. Moving .../hbase/TestRegionServerMetrics.java to .../hbase/regionserver/TestRegionServerReadRequestMetrics.java. (Apekshit)
...
Change-Id: I379c15fe2c2c01bed53bddf7619d5f2a07c5640e
2016-06-03 15:13:49 -07:00
Apekshit
b557f0bec6
HBASE-15949 Cleanup TestRegionServerMetrics.
...
@Before and @After to setup/teardown tables using @Rule to set table name based on testname.
Refactor out copy-pasted code fragments to single function.
(Apekshit)
Change-Id: Ic22e5027cc3952bab5ec30070ed20e98017db65a
2016-06-03 14:27:24 -07:00
Matteo Bertozzi
f0c159b5fe
HBASE-15927 Remove HMaster.assignRegion()
2016-06-03 12:36:25 -07:00
Ashish Singhi
0cbce07626
HBASE-15888 Extend HBASE-12769 for bulk load data replication
2016-06-03 18:42:00 +05:30
Lars Hofhansl
fc890a2ecb
HBASE-15881 Allow BZIP2 compression.
2016-06-02 12:19:02 -07:00
tedyu
7e5d530870
HBASE-15727 Canary Tool for Zookeeper (churro morales)
2016-06-02 10:15:08 -07:00
tedyu
cd2588001c
HBASE-15933 Addendum - make merge decision when sizes of both regions are known
2016-06-02 09:30:36 -07:00
tedyu
cfe868d56e
HBASE-15933 NullPointerException may be thrown from SimpleRegionNormalizer#getRegionSize()
2016-06-02 01:55:28 -07:00
Apekshit
1a27278624
HBASE-15915 Set timeouts on hanging tests. Tests run: 8, Time elapsed: 94.191 sec - in org.apache.hadoop.hbase.master.procedure.TestMasterFailoverWithProcedures Tests run: 103, Time elapsed: 69.057 sec - in org.apache.hadoop.hbase.regionserver.TestHRegion Tests run: 103, Time elapsed: 67.957 sec - in org.apache.hadoop.hbase.regionserver.TestHRegionWithInMemoryFlush Tests run: 5, Time elapsed: 34.629 sec - in org.apache.hadoop.hbase.regionserver.TestRegionMergeTransactionOnCluster Tests run: 9, Time elapsed: 82.913 sec - in org.apache.hadoop.hbase.snapshot.TestFlushSnapshotFromClient Tests run: 9, Time elapsed: 80.458 sec - in org.apache.hadoop.hbase.snapshot.TestMobFlushSnapshotFromClient (Apekshit)
...
Change-Id: Ia7b986ca6276ff5498f588c0b1b9c570e2a9d798
Signed-off-by: stack <stack@apache.org>
2016-05-30 21:13:55 -07:00
Daniel Vimont
e6d613de70
HBASE-15835 - Prevent HBaseTestingUtility#startMiniCluster from throwing _HMasterAddress already in use_ RuntimeException when another HBase thread is running
...
Signed-off-by: stack <stack@apache.org>
2016-05-30 20:05:19 -07:00
Jurriaan Mous
a1f0c1cbb3
HBASE-15875 Remove HTable references and HTableInterface
...
Signed-off-by: stack <stack@apache.org>
2016-05-30 19:56:54 -07:00
Jurriaan Mous
cdd532da8a
HBASE-15610 Remove deprecated HConnection for 2.0 thus removing all PB references for 2.0
...
Signed-off-by: stack <stack@apache.org>
2016-05-29 07:50:55 -07:00
Sean Mackrory
f4470af95d
HBASE-15891. Closeable resources potentially not getting closed if exception is thrown.
...
Signed-off-by: stack <stack@apache.org>
2016-05-28 21:32:22 -07:00
Sean Mackrory
3b6e6e6c25
HBASE-15889. String case conversions are locale-sensitive, used without locale
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-05-28 10:41:31 -07:00
Mikhail Antonov
60c8f76a9d
HBASE-15908 Checksum verification is broken due to incorrect passing of ByteBuffers in DataChecksum (Mikhail Antonov and Appy)
2016-05-28 03:14:52 -07:00
Gary Helmling
da0d74cd27
HBASE-15830 SASL encryption doesn't work with AsyncRpcChannelImpl (Colin Ma)
2016-05-26 21:58:27 -07:00
Enis Soztutar
43d1a999fe
HBASE-15837 Memstore size accounting is wrong if postBatchMutate() throws exception
2016-05-26 11:12:17 -07:00
Apekshit
94696d4067
HBASE-14635 Fix flaky test TestSnapshotCloneIndependence
...
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2016-05-25 21:14:06 -07:00
Joseph Hwang
b3362ccb0c
HBASE-15471 Added in Priority, General, and Replication queue sizes for RegionServers to the Web UI
...
Changed UI labels so that queue "size" refers to size in bytes and queue "length" refers to number of items in queue.
Signed-off-by: Elliott Clark <elliott@fb.com>
2016-05-25 15:10:48 -07:00
tedyu
fa74baeb40
HBASE-15884 NPE in StoreFileScanner#skipKVsNewerThanReadpoint during reverse scan (Sergey Soldatov)
2016-05-25 08:58:28 -07:00
tedyu
39dc19236e
HBASE-15806 revert due to discussion on security
2016-05-24 02:08:11 -07:00
tedyu
c03ea895c4
HBASE-15806 An endpoint-based export tool (ChiaPing Tsai)
2016-05-23 10:51:25 -07:00
Jurriaan Mous
7130a222ce
HBASE-15876 Remove doBulkLoad(Path hfofDir, final HTable table) though it has not been through a full deprecation cycle
...
Signed-off-by: stack <stack@apache.org>
2016-05-23 10:25:22 -07:00
tedyu
ae42c65cfd
HBASE-15802 ConnectionUtils should use ThreadLocalRandom instead of Random (Matt Warhaftig)
2016-05-21 21:15:10 -07:00
Jerry He
56e4b85d06
HBASE-14818 user_permission does not list namespace permissions (li xiang)
2016-05-21 20:06:05 -07:00
tedyu
0671cba65f
HBASE-15529 Override needBalance in StochasticLoadBalancer (Guanghao Zhang)
2016-05-21 04:03:00 -07:00
anoopsjohn
0e52ac2464
HBASE-15228 Add the methods to RegionObserver to trigger start/complete restoring WALs. (Toshihiro Suzuki)
2016-05-21 09:56:28 +05:30
tedyu
2bb07e209e
HBASE-15529 Revert due to TestRegionRebalancing failing
2016-05-20 12:56:17 -07:00
Gary Helmling
4793988aef
HBASE-15856 Don't cache unresolved addresses for connections
2016-05-20 09:36:11 -07:00
tedyu
58798fc091
HBASE-15529 Override needBalance in StochasticLoadBalancer (Guanghao Zhang)
2016-05-20 07:44:05 -07:00
Matteo Bertozzi
d34f5d4b96
HBASE-15865 Move TestTableDeleteFamilyHandler and TestTableDescriptorModification handler tests to procedure
2016-05-20 07:03:11 -07:00
Matteo Bertozzi
7a84ee262f
HBASE-15864 Reuse the testing helper to wait regions in transition
2016-05-20 06:48:38 -07:00
eshcar
a27504c701
HBASE-14920: Compacting memstore
...
Signed-off-by: stack <stack@apache.org>
2016-05-20 03:41:43 -07:00
Jerry He
af5146ee04
HBASE-15465 userPermission returned by getUserPermission() for the selected namespace does not have namespace set (li xiang)
2016-05-19 20:35:58 -07:00
tedyu
a050e1d9f8
HBASE-15847 VerifyReplication prefix filtering (Geoffrey Jacoby)
2016-05-19 06:38:27 -07:00
Vincent
460b41c800
HBASE-15617 Canary in regionserver mode might not enumerate all regionservers
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2016-05-18 16:25:29 -07:00
Stephen Yuan Jiang
8aa8abfcb6
HBASE-15850 Localize the configuration change in testCheckTableLocks to reduce flakiness of TestHBaseFsck test suite (Stephen Yuan Jiang)
2016-05-18 13:22:41 -07:00