Commit Graph

4422 Commits

Author SHA1 Message Date
tedyu d65978fceb HBASE-15073 Finer grained control over normalization actions for RegionNormalizer 2016-01-06 17:25:41 -08:00
anoopsjohn a9b671b31f HBASE-12593 Tags to work with ByteBuffer. 2016-01-06 21:28:06 +05:30
Enis Soztutar 893a54c3a4 HBASE-15066 Small improvements to Canary tool 2016-01-06 02:47:19 -08:00
ramkrishna 073e00c005 HBASE-14221 Reduce the number of time row comparison is done in a Scan
(Ram)
2016-01-06 10:38:27 +05:30
Lars Hofhansl e8fbc9b43a HBASE-14468 addendum. 2016-01-05 15:54:34 -08:00
stack 46303dfd75 HBASE-14888 ClusterSchema: Add Namespace Operations 2016-01-05 14:35:27 -08:00
tedyu 00656688f7 HBASE-14987 Compaction marker whose region name doesn't match current region's needs to be handled 2016-01-04 07:10:10 -08:00
Gary Helmling 9589a7d8be HBASE-15038 ExportSnapshot should support separate configs for source and destination 2016-01-04 00:10:19 -08:00
stack a82f7fc94a Revert "HBASE-14888 ClusterSchema: Add Namespace Operations"
This reverts commit c5f3d17ae3.
2016-01-03 07:15:18 -08:00
stack c5f3d17ae3 HBASE-14888 ClusterSchema: Add Namespace Operations 2016-01-02 16:16:56 -08:00
Jonathan M Hsieh 92abf8ac57 HBASE-15060 Cull TestHFileV2 and HFileWriterFactory 2015-12-30 13:21:54 -08:00
tedyu c1b6d47e79 HBASE-15044 Region normalization should be allowed when underlying namespace has quota 2015-12-30 08:04:23 -08:00
ramkrishna 07b6236706 HBASE-15050 Block Ref counting does not work in Region Split cases (Ram) 2015-12-30 14:39:03 +05:30
Ashish Singhi 413d663f92 HBASE-15018 Inconsistent way of handling TimeoutException in the rpc client implementations
Signed-off-by: Sean Busbey <busbey@apache.org>
2015-12-29 20:25:47 -06:00
tedyu 1e4992c6ec HBASE-14867 SimpleRegionNormalizer needs to have better heuristics to trigger merge operation 2015-12-29 06:21:57 -08:00
stack 2fba25b66a HBASE-15023 Reenable TestShell and TestStochasticLoadBalancer 2015-12-28 13:27:17 -08:00
tedyu 449fb81286 HBASE-14030 Revert due to pending review comments 2015-12-28 01:08:02 -08:00
tedyu de69f0df34 HBASE-14030 HBase Backup/Restore Phase 1 (Vladimir Rodionov) 2015-12-27 10:02:09 -08:00
tedyu 1c7e9ec124 HBASE-15039 HMaster and RegionServers should try to refresh token keys from zk when facing InvalidToken (Yong Zhang) 2015-12-25 10:32:51 -08:00
Jonathan M Hsieh 3de0b0417c HBASE-15035 bulkloading hfiles with tags that require splits do not preserve tags 2015-12-25 09:51:34 -08:00
Lars Hofhansl dfada43e90 HBASE-14822; addendum - handle callSeq. 2015-12-24 12:55:39 -08:00
tedyu a1a19d9405 HBASE-14717 enable_table_replication command should only create specified table for a peer cluster (Ashish) 2015-12-24 11:07:49 -08:00
Matteo Bertozzi 8e0854c64b HBASE-15030 Deadlock in master TableNamespaceManager while running IntegrationTestDDLMasterFailover 2015-12-23 09:46:18 -08:00
tedyu 2439f7a688 HBASE-15028 Minor fix on RegionGroupingProvider (Yu Li) 2015-12-22 06:47:33 -08:00
Elliott Clark 6e2c5d216e HBASE-15014 Fix filterCellByStore in WALsplitter is awful for performance 2015-12-21 22:50:38 -08:00
chenheng f018c371b5 HBASE-14654 Reenable TestMultiParallel#testActiveThreadsCount 2015-12-22 11:33:25 +08:00
Pallavi Adusumilli f56abf730f HBASE-14976 fix tests
Signed-off-by: Mikhail Antonov <antonov@apache.org>
2015-12-21 11:35:59 -08:00
Mikhail Antonov 8c921ea94f HBASE-14976 Add RPC call queues to the web ui (Pallavi Adusumilli) 2015-12-19 12:44:30 -08:00
Lars Hofhansl 86a417eead HBASE-14822 Renewing leases of scanners doesn't work. 2015-12-19 09:55:03 -08:00
Ashu Pachauri 48113d7572 HBASE-15001 Fix thread-safety issues with replication
ReplicationSinkManager and HBaseInterClusterReplicationEndpoint
perform certain unsafe operations which might lead to undesirable
behavior with multiwal enabled.

Signed-off-by: Elliott Clark <eclark@apache.org>
2015-12-18 11:48:55 -08:00
Sean Busbey ba04e0372d HBASE-15003 remove BoundedConcurrentLinkedQueue.
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2015-12-18 12:26:38 -06:00
Elliott Clark 4bfeccb87a HBASE-15005 Use value array in computing block length for 1.2 and 1.3 2015-12-18 00:23:02 -08:00
anoopsjohn 408666a06d HBASE-13158 When client supports CellBlock, return the result Cells as controller payload for get(Get) API also. 2015-12-18 09:50:53 +05:30
chenheng 27160950ca HBASE-14990 Tests in BaseTestHBaseFsck are run by its subclasses redundantly 2015-12-18 11:37:58 +08:00
Elliott Clark 217036d816 HBASE-14978 Don't allow Multi to retain too many blocks 2015-12-17 16:13:50 -08:00
anoopsjohn 80fc18d2e1 HBASE-15000 Fix javadoc warn in LoadIncrementalHFiles. (Ashish) 2015-12-17 22:47:48 +05:30
anoopsjohn cf458d3023 HBASE-14999 Remove ref to org.mortbay.log.Log. 2015-12-17 18:01:16 +05:30
tedyu d78eddfdc8 HBASE-14995 Revert according to Ram's feedback 2015-12-16 21:54:48 -08:00
tedyu 546ac1cbb3 HBASE-14995 Optimize setting tagsPresent in DefaultMemStore.java (huaxiang sun) 2015-12-16 18:16:38 -08:00
Enis Soztutar 3dec8582f5 HBASE-14951 Make hbase.regionserver.maxlogs obsolete 2015-12-16 14:57:59 -08:00
Mikhail Antonov e965b614b3 HBASE-14974 Total number of Regions in Transition number on UI incorrect 2015-12-16 14:10:32 -08:00
Josh Elser ca7a82fb57 HBASE-14838 Add clarification docs to SimpleRegionNormalizer.
Signed-off-by: Sean Busbey <busbey@cloudera.com>
2015-12-16 08:58:48 -06:00
Mikhail Antonov abe30b52a8 HBASE-14534 Bump yammer/coda/dropwizard metrics dependency version 2015-12-15 12:11:27 -08:00
Enis Soztutar 3e26063161 HBASE-14968 ConcurrentModificationException in region close resulting in the region staying in closing state 2015-12-15 11:49:34 -08:00
ramkrishna 1822bb5d95 HBASE-14895 Seek only to the newly flushed file on scanner reset on flush
- Addendum (Ram)
2015-12-15 10:34:25 +05:30
Jonathan M Hsieh 10d86c7dae HBASE-14929 There is a space missing from table "foo" is not currently available (Carlos A. Morillo) 2015-12-14 16:07:05 -08:00
chenheng 04622254f7 HBASE-14936 CombinedBlockCache should overwrite CacheStats#rollMetricsPeriod() (Jianwei Cui) 2015-12-14 17:20:50 +08:00
ramkrishna 555d9b70bd HBASE-14895 Seek only to the newly flushed file on scanner reset on flush
(Ram)
2015-12-14 10:13:53 +05:30
stack f34d3e1d26 HBASE-14701 Fix flakey Failed tests: TestMobFlushSnapshotFromClient>TestFlushSnapshotFromClient.testSkipFlushTableSnapshot:199 null (Jingcheng Du) 2015-12-12 19:34:23 -08:00
Ashu Pachauri 453a66c3b9 HBASE-14953 Replication: retry on RejectedExecutionException
In HBaseInterClusterReplicationEndpoint, we fail the whole batch
in case of a RejectedExecutionException on an individual sub-batch.
We should let the submitted sub-batches finish and retry only for
the remaining ones.

Signed-off-by: Elliott Clark <eclark@apache.org>
2015-12-11 13:15:22 -08:00
Enis Soztutar cff664c5e2 HBASE-14960 Fallback to using default RPCControllerFactory if class cannot be loaded 2015-12-10 19:11:57 -08:00
Elliott Clark 48e217a7db HBASE-14946 Don't allow multi's to over run the max result size.
Summary:
* Add VersionInfoUtil to determine if a client has a specified version or better
* Add an exception type to say that the response should be chunked
* Add on client knowledge of retry exceptions
* Add on metrics for how often this happens

Test Plan: Added a unit test

Differential Revision: https://reviews.facebook.net/D51771
2015-12-10 18:10:32 -08:00
stack c15e0af84a HBASE-14906 Improvements on FlushLargeStoresPolicy (Yu Li) 2015-12-10 16:49:23 -08:00
stack bebcc09fb3 HBASE-14769 Remove unused functions and duplicate javadocs from HBaseAdmin 2015-12-10 15:02:21 -08:00
Nate Edel 9511150bd6 HBASE-14901 Remove duplicate code to create/manage encryption keys
Signed-off-by: Gary Helmling <garyh@apache.org>
2015-12-10 14:38:43 -08:00
ramkrishna 26ac60b03f HBASE-13153 Bulk Loaded HFile Replication (Ashish Singhi) 2015-12-10 13:07:46 +05:30
Gary Helmling c1e0fcc26d HBASE-14866 VerifyReplication and ReplicationAdmin should use full peer configuration for peer connection 2015-12-09 15:52:27 -08:00
Elliott Clark ba3aa9a9b1 HBASE-14942 Allow turning off BoundedByteBufferPool 2015-12-09 15:29:25 -08:00
tedyu 0e147a9d6e HBASE-14954 IllegalArgumentException was thrown when doing online configuration change in CompactSplitThread (Victor Xu) 2015-12-09 07:18:08 -08:00
Lars Hofhansl 7bfbb6a3c9 HBASE-14869 Better request latency and size histograms. (Vikas Vishwakarma and Lars Hofhansl) 2015-12-08 17:02:27 -08:00
Mikhail Antonov 2430efc2b2 HBASE-7171 Initial web UI for region/memstore/storefiles details 2015-12-08 13:53:21 -08:00
Vrishal Kulkarni 1f999c1e2b HBASE-14719 Add metrics for master WAL count (numMasterWALs). Metric numMasterWALs appears as follows in metrics dump
{
    "name" : "Hadoop:service=HBase,name=Master,sub=Procedure",
    "modelerType" : "Master,sub=Procedure",
    "tag.Context" : "master",
    "tag.Hostname" : "vrishal-mbp",
    "numMasterWALs" : 1
},

Signed-off-by: Elliott Clark <eclark@apache.org>
2015-12-07 11:14:29 -08:00
Andrew Purtell c9a0148628 HBASE-14923 VerifyReplication should not mask the exception during result comparison (Vishal Khandelwal) 2015-12-04 18:53:05 -08:00
Elliott Clark cd5ddc5fec HBASE-14922 Delayed flush doesn't work causing flush storms. 2015-12-04 16:54:01 -08:00
stack c6b8e6f1ac HBASE-14907 NPE of MobUtils.hasMobColumns in Build failed in Jenkins: HBase-Trunk_matrix » latest1.8,Hadoop #513 (Jingcheng Du)
Put back HBASE-14907 but with right JIRA number (by doing a revert of a revert)

This reverts commit 35a7b56e53.
2015-12-04 16:40:27 -08:00
stack a4a44587b3 Revert "Revert "HBASE-14909 NPE testing for RIT""
Reverted the wrong patch... putting it back (revert of a revert)

This reverts commit 157a60f1b3.
2015-12-04 16:38:33 -08:00
stack 157a60f1b3 Revert "HBASE-14909 NPE testing for RIT"
This reverts commit da0cc598fe.
2015-12-04 16:37:14 -08:00
stack 35a7b56e53 Revert "HBASE-4907 NPE of MobUtils.hasMobColumns in Build failed in Jenkins: HBase-Trunk_matrix » latest1.8,Hadoop #513 (Jingcheng Du)"
Revert because I pitched this against the wrong JIRA number!

This reverts commit 03e4712f0c.
2015-12-04 16:36:46 -08:00
stack 03e4712f0c HBASE-4907 NPE of MobUtils.hasMobColumns in Build failed in Jenkins: HBase-Trunk_matrix » latest1.8,Hadoop #513 (Jingcheng Du) 2015-12-04 10:53:09 -08:00
ramkrishna 8b3d1f1444 HBASE-13082 Coarsen StoreScanner locks to RegionScanner (Ram) 2015-12-04 10:20:46 +05:30
Enis Soztutar b3260423b1 HBASE-14904 Mark Base[En|De]coder LimitedPrivate and fix binary compat issue 2015-12-03 18:18:20 -08:00
stack 51503efcf0 HBASE-13857 Slow WAL Append count in ServerMetricsTmpl.jamon is hardcoded to zero (Vrishal Kulkarni) 2015-12-03 17:00:29 -08:00
tedyu 67ba6598b1 HBASE-14905 VerifyReplication does not honour versions option (Vishal Khandelwal) 2015-12-03 16:09:22 -08:00
Enis Soztutar bbd53b846e Revert "HBASE-14223 Meta WALs are not cleared if meta region was closed and RS aborts"
This reverts commit 756e6de2a0.
2015-12-03 13:28:33 -08:00
stack 91945d7f49 HBASE-14749 Make changes to region_mover.rb to use RegionMover Java tool (Abhishek Singh Chouhan) 2015-12-02 18:14:10 -08:00
stack da0cc598fe HBASE-14909 NPE testing for RIT 2015-12-02 10:37:32 -08:00
stack 08f90f30b3 HBASE-14908 TestRowCounter flakey especially on branch-1 2015-12-02 10:19:13 -08:00
ramkrishna aa41232a87 HBASE-14832 Ensure write paths work with ByteBufferedCells in case of
compaction (Ram)
2015-12-02 10:28:30 +05:30
tedyu d8b30b8925 HBASE-14575 Relax region read lock for compactions (Nick and Ted) 2015-12-01 16:44:59 -08:00
stack 92e178df28 Revert "HBASE-14769 Removing unused functions from HBaseAdmin. Removing redundant javadocs from HBaseAdmin as they will be automatically inhertited from Admin.java. (Apekshit)"
Reverting. The conversation on issues to do with this patch was not done (Appy brought it to my attention).

This reverts commit 6adce67572.
2015-12-01 11:30:39 -08:00
stack a7673ed755 HBASE-14896 Resolve Javadoc warnings in WALKey and RegionMover 2015-12-01 09:35:15 -08:00
Apekshit(Appy) Sharma 6adce67572 HBASE-14769 Removing unused functions from HBaseAdmin. Removing redundant javadocs from HBaseAdmin as they will be automatically inhertited from Admin.java. (Apekshit)
Signed-off-by: stack <stack@apache.org>
2015-11-30 20:44:11 -08:00
chenheng 47082579a8 HBASE-14897 TestTableLockManager.testReapAllTableLocks is flakey 2015-12-01 10:31:00 +08:00
Enis Soztutar 756e6de2a0 HBASE-14223 Meta WALs are not cleared if meta region was closed and RS aborts 2015-11-30 16:48:52 -08:00
chenheng 999ae69155 HBASE-14891 Add log for uncaught exception in RegionServerMetricsWrapperRunnable(Yu Li) 2015-11-30 22:30:09 +08:00
Apekshit 3bac31b2a4 HBASE-14890 Fix broken checkstyle tool. Some javadocs had parsing errors because of wrongly formatted HTML tags. (Apekshit)
Signed-off-by: stack <stack@apache.org>
2015-11-28 21:57:52 -08:00
tedyu 2317ec583d HBASE-14894 Fix misspellings of threshold in log4j.properties files for tests (Youngjoon Kim) 2015-11-28 10:08:38 -08:00
tedyu 001eb0694a HBASE-14893 Race between mutation on region and region closing operation leads to NotServingRegionException 2015-11-27 15:32:05 -08:00
chenheng b280a41ba6 HBASE-14884 TestSplitTransactionOnCluster.testSSHCleanupDaugtherRegionsOfAbortedSplit is flakey 2015-11-27 11:24:15 +08:00
rahulgidwani 0d72849581 HBASE-14355 Scan different TimeRange for each column family - fixing memstore bug
Signed-off-by: stack <stack@apache.org>
2015-11-25 22:01:32 -08:00
Lars Hofhansl 6531b465a7 HBASE-14777 second addendum, better fix using CompletionService. 2015-11-25 21:17:56 -08:00
tedyu e73a9594c2 HBASE-14885 NullPointerException in HMaster#normalizeRegions() due to missing TableDescriptor 2015-11-25 16:06:27 -08:00
Enis Soztutar 90bdb0dc74 HBASE-14689 Addendum and unit test for HBASE-13471 2015-11-24 19:15:09 -08:00
tedyu 1178c4b89b HBASE-14861 HBASE_ZNODE_FILE on master server is overwritten by regionserver process in case of master-rs collocation (Samir Ahmic) 2015-11-24 15:02:47 -08:00
Daniel Vimont 6a493ddff7 Commit for HBASE-14825 -- corrections of typos, misspellings, and mangled links
Commit for HBASE-14825 -- corrections of typos, misspellings, and mangled links - addition commit for line lengths
2015-11-25 07:12:36 +10:00
Gary Helmling 8b67df6948 HBASE-14821 Allow configuration overrides in TableOutputFormat 2015-11-24 12:13:51 -08:00
ramkrishna afc5439be5 HBASE-14826 Small improvement in KVHeap seek() API (Ram) 2015-11-24 10:17:28 +05:30
anoopsjohn daba867734 HBASE-13347 Deprecate FirstKeyValueMatchingQualifiersFilter. (Abhishek) 2015-11-24 09:50:56 +05:30
tedyu 9a91f5ac81 HBASE-14737 Clear cachedMaxVersions when HColumnDescriptor#setValue(VERSIONS, value) is called (Pankaj Kumar) 2015-11-23 20:13:00 -08:00
stack 52edd83baf HBASE-14807 TestWALLockup is flakey Second attempt at stabilizing this test.
Patch includes loosening of the test so we continue when threads
run in not-expected order. Also includes minor clean ups in
FSHLog -- a formatting change, removal of an unused trace logging,
and a check so we don't create a new exception when not needed --
but it also includes a subtle so we check if we need to get to safe
point EVEN IF an outstanding exception. Previous we could by-pass
the safe point check. This should make us even more robust against
lockup (though this is a change that comes of code reading, not of
any issue seen in test).

Here is some detail on how I loosened the test:

The test can run in an unexpected order. Attempts at dictating the
order in which threads fire only had me deadlocking one latch
against another (the test latch vs the WAL zigzag latch) so I
gave up trying and instead, if we happen to go the unusual route of
rolling WALs and failing flush before the scheduled log roll
latch goes into place, just time out the run after a few seconds
and exit the test (but do not fail it); just log a WARN.

This is less than ideal but allows us keep some coverage of the
tricky scenario that was bringing on deadlock (a broken WAL that
is throwing exceptions getting stuck waiting on a sync to clear
out the ring buffer getting overshadowed by a subsequent append
added in by a concurrent flush).
2015-11-20 12:06:48 -08:00