Commit Graph

4113 Commits

Author SHA1 Message Date
chenheng 2d7db89590 HBASE-14891 Add log for uncaught exception in RegionServerMetricsWrapperRunnable(Yu Li) 2015-12-01 17:16:23 +08:00
Enis Soztutar c719e8c456 HBASE-14223 Meta WALs are not cleared if meta region was closed and RS aborts 2015-11-30 17:07:54 -08:00
tedyu 66adeb3048 HBASE-14894 Fix misspellings of threshold in log4j.properties files for tests (Youngjoon Kim) 2015-11-28 10:10:27 -08:00
tedyu 9de4691a0a HBASE-14893 Race between mutation on region and region closing operation leads to NotServingRegionException 2015-11-27 15:32:42 -08:00
rahulgidwani 9a11c025f2 HBASE-14355 Scan different TimeRange for each column family - fixing memstore bug
Signed-off-by: stack <stack@apache.org>
2015-11-25 22:04:02 -08:00
Lars Hofhansl dbbdb7b2e8 HBASE-14777 second addendum, better fix using CompletionService. 2015-11-25 21:18:27 -08:00
tedyu 06c233834f HBASE-14885 NullPointerException in HMaster#normalizeRegions() due to missing TableDescriptor 2015-11-25 16:08:49 -08:00
stack 30604761c4 HBASE-14883 TestSplitTransactionOnCluster#testFailedSplit flakey 2015-11-25 09:45:52 -08:00
Enis Soztutar e80face0e9 HBASE-14689 Addendum and unit test for HBASE-13471 2015-11-24 19:15:13 -08:00
tedyu 1917516ffd HBASE-14875 Forward port HBASE-14207 'Region was hijacked and remained in transition when RS failed to open a region and later regionplan changed to new RS on retry' 2015-11-24 14:30:37 -08:00
Gary Helmling 07b07300b8 HBASE-14821 Allow configuration overrides in TableOutputFormat 2015-11-24 12:15:25 -08:00
tedyu 447a0e7b7e HBASE-14737 Clear cachedMaxVersions when HColumnDescriptor#setValue(VERSIONS, value) is called (Pankaj Kumar) 2015-11-23 20:26:18 -08:00
anoopsjohn 81e7eb2805 HBASE-13347 Deprecate FirstKeyValueMatchingQualifiersFilter. (Abhishek) 2015-11-24 09:52:37 +05:30
stack 085bf60b42 HBASE-14807 TestWALLockup is flakey Second attempt at stabilizing this test.
Patch includes loosening of the test so we continue when threads
run in not-expected order. Also includes minor clean ups in
FSHLog -- a formatting change, removal of an unused trace logging,
and a check so we don't create a new exception when not needed --
but it also includes a subtle so we check if we need to get to safe
point EVEN IF an outstanding exception. Previous we could by-pass
the safe point check. This should make us even more robust against
lockup (though this is a change that comes of code reading, not of
any issue seen in test).

Here is some detail on how I loosened the test:

The test can run in an unexpected order. Attempts at dictating the
order in which threads fire only had me deadlocking one latch
against another (the test latch vs the WAL zigzag latch) so I
gave up trying and instead, if we happen to go the unusual route of
rolling WALs and failing flush before the scheduled log roll
latch goes into place, just time out the run after a few seconds
and exit the test (but do not fail it); just log a WARN.

This is less than ideal but allows us keep some coverage of the
tricky scenario that was bringing on deadlock (a broken WAL that
is throwing exceptions getting stuck waiting on a sync to clear
out the ring buffer getting overshadowed by a subsequent append
added in by a concurrent flush).
2015-11-20 12:07:32 -08:00
ramkrishna 11b2131013 HBASE-14840 Sink cluster reports data replication request as success
though the data is not replicated(Ashish Singhi)
2015-11-20 16:00:15 +05:30
Ashu Pachauri f56c605e73 HBASE-14777 ADDENDUM Fix failing TestReplicationEndpoint test
Signed-off-by: stack <stack@apache.org>
2015-11-20 00:21:33 -06:00
Sean Busbey ccee3d8dd5 Revert "Fix failing TestReplicationEndpoint test"
This reverts commit 5b5ff1d8b2.
2015-11-20 00:21:24 -06:00
Ashu Pachauri 5b5ff1d8b2 Fix failing TestReplicationEndpoint test
Signed-off-by: stack <stack@apache.org>
2015-11-19 13:26:37 -08:00
ramkrishna b06acfbf0b HBASE-14761 Deletes with and without visibility expression do not delete
the matching mutation (Ram)
2015-11-19 11:24:35 +05:30
chenheng 40e01512cf HBASE-14782 FuzzyRowFilter skips valid rows (Vladimir Rodionov) 2015-11-19 11:41:05 +08:00
Enis Soztutar 8a69dd5b08 HBASE-14468 Compaction improvements: FIFO compaction policy (Vladimir Rodionov) 2015-11-18 19:27:15 -08:00
Ashu Pachauri de4f235bf4 HBASE-14777 Fix Inter Cluster Replication Future ordering issues
Signed-off-by: Elliott Clark <eclark@apache.org>
2015-11-18 16:41:52 -08:00
tedyu a6e0ad636a HBASE-14824 HBaseAdmin.mergeRegions should recognize both full region names and encoded region names (Eungsop Yoo) 2015-11-18 14:26:31 -08:00
Enis Soztutar d4d3b1954c Revert "HBASE-14689 Addendum and unit test for HBASE-13471"
This reverts commit ec021a7b25.
2015-11-17 20:37:16 -08:00
tedyu 5362ac0311 HBASE-14771 RpcServer#getRemoteAddress always returns null (Abhishek Kumar) 2015-11-17 18:49:05 -08:00
Elliott Clark 604c9b2cca HBASE-14793 Allow limiting size of block into L1 block cache. 2015-11-17 10:38:02 -08:00
tedyu 47d59288a7 HBASE-14809 Grant / revoke Namespace admin permission to group 2015-11-16 09:32:11 -08:00
stack b7a4c5f5dc HBASE-14802 Replaying server crash recovery procedure after a failover causes incorrect handling of deadservers; ADDENDUM 2015-11-15 15:00:15 -08:00
stack aaa2294126 HBASE-14798 NPE reporting server load causes regionserver abort; causes TestAcidGuarantee to fail 2015-11-14 09:08:07 -08:00
stack 336eb92016 HBASE-14355 Scan different TimeRange for each column family 2015-11-13 22:44:05 -08:00
stack 72fbfb589e HBASE-14807 TestWALLockup is flakey 2015-11-13 22:40:07 -08:00
stack bb9fbdb2d2 HBASE-14802 Replaying server crash recovery procedure after a failover causes incorrect handling of deadservers 2015-11-13 22:10:07 -08:00
Jerry He c725356e4a HBASE-13982 Add info for visibility labels/cell TTLs to ImportTsv (NIDHI GAMBHIR) 2015-11-10 22:11:14 -08:00
stack 7280ec09df HBASE-14794 Cleanup TestAtomicOperation
hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestMetaWithReplicas.java
      Fix a few missing table closes (This suite seems to leave loads of threads
      when test is done but have not figured the how yet).

    hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestImportExport.java
      Fix some missing table closes. We were leaving around client
      resources.

    hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestAtomicOperation.java
      Close up WALs when done.
2015-11-10 18:57:35 -10:00
tedyu 37815cac9e HBASE-14788 Splitting a region does not support the hbase.rs.evictblocksonclose config when closing source region 2015-11-10 18:38:32 -08:00
Matteo Bertozzi 1d29d8c004 HBASE-14786 TestProcedureAdmin hangs 2015-11-10 13:17:58 -08:00
Elliott Clark e8e0e86b49 HBASE-14778 Make block cache hit percentages not integer in the metrics system 2015-11-10 12:28:24 -08:00
Enis Soztutar 3de347f6e0 HBASE-14387 Compaction improvements: Maximum off-peak compaction size (Vladimir Rodionov) 2015-11-09 19:54:35 -08:00
chenheng 7330e11aa4 HBASE-14693 Add client-side metrics for received pushback signals
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestClientPushback.java
2015-11-09 15:32:28 -08:00
tedyu d3e653a261 HBASE-14784 Port conflict is not resolved in HBaseTestingUtility.randomFreePort() (Youngjoon Kim) 2015-11-08 08:51:44 -08:00
tedyu 61e2566c1c HBASE-14463 Severe performance downgrade when parallel reading a single key from BucketCache (Yu Li) 2015-11-06 17:34:14 -08:00
zhangduo 234f31bd4a HBASE-14759 Avoid using Math.abs when selecting SyncRunner in FSHLog 2015-11-07 08:47:56 +08:00
tedyu c1a19dece0 HBASE-14632 Region server aborts due to unguarded dereference of Reader 2015-11-06 13:40:14 -08:00
tedyu c69c74fcbf HBASE-14632 Revert due to over commit 2015-11-06 13:39:24 -08:00
tedyu 0e2e5d3280 HBASE-14632 Region server aborts due to unguarded dereference of Reader 2015-11-06 12:06:58 -08:00
Elliott Clark 2b84c40f01 HBASE-14765 Remove snappy profile 2015-11-05 10:21:14 -08:00
tedyu 6c239f1816 HBASE-14706 RegionLocationFinder should return multiple servernames by top host (Guanghao Zhang) 2015-11-04 14:25:53 -08:00
chenheng fa2d0859f7 HBASE-12986 Compaction pressure based client pushback
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/ClientProtos.java
2015-11-03 18:40:59 -08:00
Elliott Clark b24324cc23 HBASE-14742 Fix TestHeapMemoryManager being flakey 2015-11-02 17:02:41 -08:00
Andrew Purtell 2e1711f209 HBASE-14631 Addendum restores a method in RegionMergeTransactionImpl 2015-11-02 15:54:28 -08:00
Andrew Purtell bd4addcedf HBASE-14605 Addendum restores two methods in SplitTransactionImpl 2015-11-02 15:50:03 -08:00
stack 51f5412a92 Revert "HBASE-14725 Vet categorization of tests so they for sure go into the right small/medium/large buckets"
Reverting. It seems to have destabilized the build.

This reverts commit aaaa813225.
2015-11-02 08:16:59 -08:00
stack aaaa813225 HBASE-14725 Vet categorization of tests so they for sure go into the right small/medium/large buckets 2015-11-01 22:55:59 -08:00
Gary Helmling 85f2aee070 HBASE-14700 Support a permissive mode for secure clusters to allow SIMPLE auth clients 2015-10-30 20:06:23 -07:00
anoopsjohn de89172244 HBASE-14557 MapReduce WALPlayer issue with NoTagsKeyValue. 2015-10-30 21:19:12 +05:30
anoopsjohn a3842caf77 HBASE-14721 Memstore add cells - Avoid many garbage. 2015-10-30 18:41:45 +05:30
Matteo Bertozzi 569fe82acf HBASE-14714 some cleanup to snapshot code 2015-10-29 14:04:48 -07:00
stack 066f3f7545 HBASE-14720 Make TestHCM and TestMetaWithReplicas large tests rather than mediums 2015-10-29 10:36:39 -07:00
stack 45faf38028 HBASE-14678 Experiment: Temporarily disable balancer and a few others to see if root of crashed/timedout JVMs; REMOVED TestWALSplitCompressed and TestWALSplit 2015-10-28 22:00:02 -07:00
stack 4ef38f0c37 HBASE-14710 Add category-based timeouts to MR tests 2015-10-28 17:16:11 -07:00
tedyu 3c8e92019c HBASE-12769 Replication fails to delete all corresponding zk nodes when peer is removed (Jianwei Cui) 2015-10-28 15:43:26 -07:00
ramkrishna e5b566e01c HBASE-14529 - Addendum to avoid SIGHUP call for WINDOWS OS 2015-10-28 11:54:56 +05:30
Enis Soztutar 68f0fff281 HBASE-14674 Rpc handler / task monitoring seems to be broken after 0.98 (Heng Chen)
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/ipc/TestCallRunner.java
2015-10-27 15:06:38 -07:00
Enis Soztutar 87c97c231a HBASE-14680 Two configs for snapshot timeout and better defaults (Heng Chen)
Conflicts:
	hbase-common/src/main/resources/hbase-default.xml
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/snapshot/DisabledTableSnapshotHandler.java
2015-10-27 15:06:37 -07:00
tedyu f6a30d2331 HBASE-14655 Addendum passes User to store#compact() 2015-10-27 11:18:29 -07:00
anoopsjohn 51bfd722c3 HBASE-14257 Periodic flusher only handles hbase:meta, not other system tables. (Abhishek) 2015-10-27 12:22:54 +05:30
stack 6382e975dc Revert "HBASE-14684 Try to remove all MiniMapReduceCluster in unit tests; REAPPLY"
I did not mean to apply this to branch-1 until a branch-1 patch build had passed. Reverting.

This reverts commit ff0bc80374.
2015-10-26 22:45:20 -07:00
stack 50b5465284 HBASE-14702 TestZKProcedureControllers.testZKCoordinatorControllerWithSingleMemberCohort is a flakey 2015-10-26 22:35:50 -07:00
Ben Lau 288a274052 HBASE-14283 Reverse scan doesn’t work with HFile inline index/bloom blocks
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-10-26 15:13:07 -07:00
Andrew Purtell 6fbcd0a2e8 HBASE-13318 RpcServer.getListenerAddress should handle when the accept channel is closed 2015-10-26 15:11:08 -07:00
stack c3d4d0233d HBASE-14661 RegionServer link is not opening, in HBase Table page (Y. SREENIVASULU REDDY) 2015-10-26 14:57:49 -07:00
stack ff0bc80374 HBASE-14684 Try to remove all MiniMapReduceCluster in unit tests; REAPPLY 2015-10-26 14:01:03 -07:00
stack 0c5f4e01f6 HBASE-14698 Set category timeouts on TestScanner and TestNamespaceAuditor 2015-10-26 12:56:14 -07:00
Enis Soztutar ec021a7b25 HBASE-14689 Addendum and unit test for HBASE-13471
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegion.java
2015-10-26 12:08:58 -07:00
stack d76dbb4f84 HBASE-14648 Reenable TestWALProcedureStoreOnHDFS#testWalRollOnLowReplication (Heng Chen) 2015-10-24 20:56:06 -07:00
tedyu 40887c94b7 HBASE-14624 BucketCache.freeBlock is too expensive 2015-10-24 18:48:55 -07:00
stack 4f8387959a HBASE-14266 RegionServers have a lock contention of Configuration.getProps 2015-10-24 15:37:55 -07:00
stack 91bca7323a HBASE-14678 Experiment: Temporarily disable balancer and a few others to see if root of crashed/timedout JVMs; ADD TestDistributedLogSplitting to the mix; ADDENDUM added TestSnapshotCloneIndependence to removed set of dodgy tests 2015-10-24 14:27:38 -07:00
Elliott Clark 1050908ff0 HBASE-14690 Fix css so there's no left/right scroll bar 2015-10-24 10:26:57 -07:00
Elliott Clark a268d151e2 HBASE-14683 Fix Batching in buffered mutator is awful when adding lists of mutations.
Summary: Send the list of mutations to AsyncProcess only after done adding the list otherwise there's a lot of contention

Test Plan: UnitTests.

Differential Revision: https://reviews.facebook.net/D49251
2015-10-24 10:03:03 -07:00
Lars George 6f21cfbf27 HBASE-14343 Fix debug message in SimpleRegionNormalizer for small regions (Lars Francke) 2015-10-24 11:28:02 +02:00
tedyu bc990a3328 HBASE-14655 Narrow the scope of doAs() calls to region observer notifications for compaction 2015-10-23 15:00:04 -07:00
Nicolas Liochon cdf2c01a76 HBASE-14580 Make the HBaseMiniCluster compliant with Kerberos 2015-10-23 11:42:30 -07:00
stack 9e3c381bee HBASE-14657 Remove unneeded API from EncodedSeeker (Heng Chen) 2015-10-22 21:32:51 -07:00
stack 34fe1f5fd7 Revert "more"
Remove overcommit..... made mistakenly.

This reverts commit 1b3557649c.
2015-10-22 17:08:54 -07:00
stack 3f7994b5ab HBASE-14678 Experiment: Temporarily disable balancer and a few others to see if root of crashed/timedout JVMs; ADD TestDistributedLogSplitting to the mix 2015-10-22 17:02:44 -07:00
stack 81d7d7ba7e HBASE-14678 Experiment: Temporarily disable balancer and a few others to see if root of crashed/timedout JVMs 2015-10-22 12:33:36 -07:00
stack 1b3557649c more 2015-10-22 12:31:22 -07:00
Matteo Bertozzi 0f5191dd9a HBASE-14667 HBaseFsck constructors have diverged 2015-10-22 09:39:02 -07:00
stack aed33c9cca HBASE-14663 HStore::close does not honor config hbase.rs.evictblocksonclose (Vladimir Rodionov) 2015-10-21 21:58:09 -07:00
stack 35c34ba84e HBASE-14662 Fix NPE in HFileOutputFormat2 (Heng Chen) 2015-10-21 21:53:00 -07:00
ramkrishna 97fc755013 HBASE-14643 Avoid Splits from once again opening a closed reader for
fetching the first and last key (Heng Chen)
2015-10-21 14:45:21 +05:30
Elliott Clark 118d7b20b0 HBASE-14633 Try fluid width UI 2015-10-20 17:46:00 -07:00
stack ec1f8df523 HBASE-14656 Move TestAssignmentManager from medium to large category 2015-10-20 12:39:16 -07:00
stack 4950db5110 HBASE-14634 Disable flakey TestSnapshotCloneIndependence.testOnlineSnapshotDeleteIndependent; ADDENDUM 2015-10-20 12:19:30 -07:00
tedyu b076d7dbd1 HBASE-14604 Improve MoveCostFunction in StochasticLoadBalancer (Guanghao Zhang) 2015-10-20 02:37:35 -07:00
stack 74ad3947e9 HBASE-14646 Move TestCellACLs from medium to large category; ADDENDUM 2015-10-19 11:20:33 -07:00
stack 8940be0597 HBASE-14647 Disable TestWALProcedureStoreOnHDFS#testWalRollOnLowReplication 2015-10-19 10:42:05 -07:00
stack b921ed4222 HBASE-14646 Move TestCellACLs from medium to large category 2015-10-19 10:41:13 -07:00
Matteo Bertozzi d01063c9a3 HBASE-14541 TestHFileOutputFormat.testMRIncrementalLoadWithSplit failed due to too many splits and few retries 2015-10-19 09:24:47 -07:00