Commit Graph

3471 Commits

Author SHA1 Message Date
rahulgidwani 6a1fcf2b85 HBASE-11195 Potentially improve block locality during major compaction for old regions
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-01-19 17:33:26 -08:00
Andrew Purtell 453f9294b6 HBASE-12878 Incorrect HFile path in TestHFilePerformance print output (Vikas Vishwakarma) 2015-01-19 12:46:54 -08:00
Devaraj Das d0e4fb6ae3 HBASE-12548. Improve debuggability of IntegrationTestTimeBoundedRequestsWithRegionReplicas. 2015-01-16 11:49:49 -08:00
Devaraj Das 37a2774c6f HBASE-11903. Directly invoking split & merge of replica regions should be disallowed 2015-01-16 11:23:48 -08:00
Enis Soztutar 0689098092 HBASE-12862 Uppercase wals in RegionServer webUI 2015-01-16 11:12:47 -08:00
zhangduo 5ee40c5516 HBASE-12863 Master info port on RS UI is always 0
Signed-off-by: Enis Soztutar <enis@apache.org>
2015-01-16 11:00:42 -08:00
Devaraj Das 60e7e6aed5 HBASE-11261. Handle splitting/merging of regions that have region_replication greater than one 2015-01-16 10:54:52 -08:00
Devaraj Das 895e9228a0 HBASE-10674. HBCK should be updated to do replica related checks 2015-01-16 10:28:37 -08:00
Matteo Bertozzi 52b4db8607 HBASE-12773 Add warning message when user is trying to bulkload a large HFile (Srikanth Srungarapu) 2015-01-15 23:14:29 +00:00
tedyu 2e08bb3b47 HBASE-12848 Utilize Flash storage for WAL 2015-01-15 08:53:06 -08:00
Enis Soztutar 8ecba131af HBASE-12844 ServerManager.isServerReacable() should sleep between retries
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestAssignmentManagerOnCluster.java
2015-01-14 15:50:43 -08:00
Rajeshbabu Chintaguntla bc5023018e HBASE-12847 TestZKLessSplitOnCluster frequently times out in 0.98 builds(Rajeshbabu) 2015-01-15 00:14:52 +05:30
Virag Kothari 4ff742742b HBASE-12480 Regions in FAILED_OPEN/FAILED_CLOSE should be processed on master failover 2015-01-13 11:06:24 -08:00
tedyu 908779b887 HBASE-12849 LoadIncrementalHFiles should use unmanaged connection in branch-1 2015-01-13 10:55:07 -08:00
tedyu b79dbedad6 HBASE-11144 Filter to support scanning multiple row key ranges (Jiajia Li) 2015-01-13 07:04:49 -08:00
Enis Soztutar 6e45269f2c HBASE-12835 HBASE-12422 changed new HTable(Configuration) to not use managed Connections anymore - ADDENDUM for test failure 2015-01-12 18:52:49 -08:00
Rajeshbabu Chintaguntla f4e0cbc26c HBASE-12791 HBase does not attempt to clean up an aborted split when the regionserver shutting down(Rajeshbabu) 2015-01-12 07:04:26 +05:30
tedyu 9b8f59cdf9 HBASE-12798 Map Reduce jobs should not create Tables in setConf() (Solomon Duskis) 2015-01-11 09:22:12 -08:00
tedyu b421498ce6 HBASE-12834 Promote ScanType to LimitedPrivate 2015-01-09 15:36:58 -08:00
Nick Dimiduk 2ecb4b1b34 HBASE-12825 CallRunner exception messages should include destination host:port 2015-01-08 18:40:28 -08:00
Enis Soztutar 4581d54cf7 HBASE-12824 CompressionTest fails with org.apache.hadoop.hbase.io.hfile.AbstractHFileReader: Not seeked to a key/value 2015-01-08 15:57:14 -08:00
Nick Dimiduk 240ef12358 HBASE-12071 Separate out thread pool for Master <-> RegionServer communication (Stephen Yuan Jiang) 2015-01-08 14:11:32 -08:00
tedyu e0f706999a HBASE-12811 [AccessController] NPE while scanning a table with user not having READ permission on the namespace (Ashish) 2015-01-08 09:05:55 -08:00
tedyu 165bbb9e8d HBASE-12819 ExportSnapshot doesn't close FileSystem instances 2015-01-08 08:52:13 -08:00
tedyu 29ec882a5e HBASE-12817 Data missing while scanning using PREFIX_TREE data block encoding (Duo Zhang) 2015-01-07 19:32:17 -08:00
tedyu 2c4fe03e6a HBASE-12783 Create efficient RegionLocator implementation (Solomon) 2015-01-07 11:10:24 -08:00
Virag Kothari 46f993b19f HBASE-12694 testTableExistsIfTheSpecifiedTableRegionIsSplitParent in TestSplitTransactionOnCluster class leaves regions in transition (Vandana Ayyalasomayajula) 2015-01-07 10:58:32 -08:00
tedyu c951238304 HBASE-10528 Addendum fixes TestRegionStates compilation 2015-01-06 13:35:12 -08:00
tedyu c5b0a1b8a0 HBASE-10528 DefaultBalancer selects plans to move regions onto draining nodes (Churro Morales) 2015-01-06 12:34:07 -08:00
Sean Busbey 59952c006d HBASE-12339 WALPerformanceEvaluation should have a log roller. 2015-01-06 08:37:16 -06:00
stack 6fcc8d7c3e HBASE-12771 TestFailFast#testFastFail failing (Manukranth Kolloju) 2015-01-05 21:17:51 -08:00
Lars Hofhansl e491f337f1 HBASE-12779 SplitTransaction: Add metrics. 2015-01-05 17:14:20 -08:00
tedyu 0311cc860c HBASE-12802 Remove unnecessary Table.flushCommits() (Solomon Duskis) 2015-01-05 15:55:10 -08:00
tedyu 071c3026f0 HBASE-12793 [hbck] closeRegionSilentlyAndWait() should log cause of IOException and retry until hbase.hbck.close.timeout expires (Esteban) 2015-01-05 15:06:28 -08:00
tedyu f9873622b8 HBASE-12785 Use FutureTask to timeout the attempt to get the lock for hbck 2015-01-05 14:10:48 -08:00
Enis Soztutar e7795007b0 HBASE-12799 ITAG fails with java.lang.RuntimeException if table does not exist 2015-01-05 11:18:58 -08:00
tedyu a14723b435 HBASE-12804 ImportTsv fails to delete partition files created by it (Ashish) 2015-01-05 09:29:36 -08:00
tedyu 173eba815b HBASE-12783 Revert - two tests in TestAssignmentManager fail 2015-01-03 06:57:46 -08:00
tedyu 44f392a0cc HBASE-12783 Addendum removes extraneous import 2015-01-02 21:01:16 -08:00
tedyu 633734a82d HBASE-12783 Create efficient RegionLocator implementation (Solomon Duskis) 2015-01-02 20:00:09 -08:00
Enis Soztutar ecbdc45d3d HBASE-12028 Abort the RegionServer, when it's handler threads die (Alicia Ying Shu) 2015-01-02 13:27:26 -08:00
Sean Busbey 3ddc44b907 HBASE-12719 test provider to remove just the hdfs interactions from fshlog.
* Adds a provider that takes a config to determine if we actually do syncs, appends, and file rolls.
  - required relaxing some members of FSHLog from private to protected.
* Fixes DisabledWALProvider so it can be used as hbase.wal.provider in the wal perf eval tool.
2014-12-31 16:40:46 -06:00
stack 2ff16e532b HBASE-12270 A bug in the bucket cache, with cache blocks on write enabled (Liu Shaohui) 2014-12-30 14:43:54 -08:00
stack ad7d7f5977 HBASE-12740 Improve performance of TestHBaseFsck
Signed-off-by: stack <stack@apache.org>

    Conflicts:

        hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestHBaseFsck.java
2014-12-30 14:32:16 -08:00
stack 1962d39bf6 HBASE-12772 TestPerColumnFamilyFlush failing -- ADDENDUM 2014-12-30 11:38:11 -08:00
tedyu 034b10733d HBASE-12607 TestHBaseFsck#testParallelHbck fails running against hadoop 2.6.0 2014-12-30 09:35:04 -08:00
Lars Hofhansl 6a7c619e1e HBASE-12776 SpliTransaction: Log number of files to be split. 2014-12-29 20:38:33 -08:00
xieliang 619f94f113 HBASE-12767 Fix a StoreFileScanner NPE in reverse scan flow 2014-12-30 11:56:43 +08:00
stack 8ff62d9cee HBASE-12772 TestPerColumnFamilyFlush failing 2014-12-29 15:45:23 -08:00
Elliott Clark 7527227ab9 HBASE-12429 Add port to ClusterManager's actions. 2014-12-29 10:23:01 -08:00
stack 0e39b8b9f7 HBASE-12762 Region with no hfiles will have the highest locality cost in LocalityCostFunction (cuijianwei) 2014-12-29 07:45:39 -08:00
tedyu 882f4c9761 HBASE-12716 A bug in RegionSplitter.UniformSplit algorithm (Weichen Ye) 2014-12-28 07:49:12 -08:00
tedyu 978d90b557 HBASE-12764 TestPerColumnFamilyFlush#testCompareStoreFileCount may fail due to new table not available 2014-12-27 21:11:59 -08:00
stack feb71872a3 HBASE-12763 Make it so there must be WALs for a server to be marked dead 2014-12-27 13:10:13 -08:00
Elliott Clark 3c8ac97c76 HBASE-12697 Don't use RegionLocationFinder if localityCost == 0 2014-12-26 11:13:35 -08:00
Jonathan M Hsieh 5425369327 HBASE-12749 Tighten HFileLink api to enable non-snapshot uses
Conflicts:
	hbase-
server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFileInfo.java

Also a minor change for TestUpgradeTo96 to replace constructor
2014-12-24 05:07:35 -08:00
Jonathan M Hsieh ac7ebdb179 HBASE-12735 Refactor TestAcidGuarantees so it can live as unit test and as an integration test 2014-12-23 17:32:39 -08:00
Jurriaan Mous 611ee0eb72 HBASE-12736 Let MetaScanner recycle a given Connection (Jurriaan Mous)
Signed-off-by: stack <stack@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestRestartCluster.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestEndToEndSplitTransaction.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestHBaseFsck.java
2014-12-23 10:59:18 -08:00
Jurriaan Mous 8eed26fc3c HBASE-12742
Signed-off-by: stack <stack@apache.org>
2014-12-23 10:15:00 -08:00
Devaraj Das 949982fc6e HBASE-12012. Improve cancellation for the scan RPCs (patch from master; had to resolve some conflicts) 2014-12-22 16:45:41 -08:00
stack fd232cc3b5 HBASE-12734 TestPerColumnFamilyFlush.testCompareStoreFileCount is flakey (zhangduo) 2014-12-22 08:57:09 -08:00
tedyu 84d4ad76ab HBASE-12741 AccessController contains a javadoc issue (Jurriaan Mous) 2014-12-22 08:33:51 -08:00
tedyu fbc852b680 HBASE-10201 Addendum fixes typo of putIfAbsent (Duo Zhang) 2014-12-21 07:23:41 -08:00
stack dfa22cc922 HBASE-12732 Log messages in FileLink#tryOpen are reversed (Tobi Vollebregt) 2014-12-19 17:48:15 -08:00
Enis Soztutar 85c386cdbb HBASE-12720 Make InternalScan LimitedPrivate (Vladimir Rodionov) 2014-12-19 13:59:19 -08:00
Enis Soztutar ec64415570 HBASE-12511 namespace permissions - add support from table creation privilege in a namespace 'C' (Huaiyu Zhu) 2014-12-19 13:05:12 -08:00
Andrew Purtell 7fff4b6cf9 HBASE-12724 Upgrade the interface audience of RegionScanner from Private to LimitedPrivate 2014-12-19 09:37:27 -08:00
Virag Kothari 29940c286e Revert "HBASE-12694 testTableExistsIfTheSpecifiedTableRegionIsSplitParent in TestSplitTransactionOnCluster class leaves regions in transition (Vandana Ayyalasomayajula)"
This reverts commit f0e27b2f78.
2014-12-19 08:38:15 -08:00
Sean Busbey 2b94aa8c85 HBASE-5699 Adds multiple WALs per Region Server based on groups of regions. 2014-12-19 10:23:12 -06:00
tedyu 14c821781c HBASE-12715 getLastSequenceId always returns -1 (Duo Zhang) 2014-12-19 07:00:17 -08:00
Jonathan M Hsieh 11d72ff2a4 HBASE-12718 Convert TestAcidGuarantees from a unit test to an integration test 2014-12-18 17:34:43 -08:00
Virag Kothari f0e27b2f78 HBASE-12694 testTableExistsIfTheSpecifiedTableRegionIsSplitParent in TestSplitTransactionOnCluster class leaves regions in transition (Vandana Ayyalasomayajula) 2014-12-18 17:02:10 -08:00
tedyu 5d34d2d02a HBASE-10201 Addendum changes TestPerColumnFamilyFlush to LargeTest 2014-12-18 16:01:48 -08:00
zhangduo e55ef7a663 HBASE-10201 Port 'Make flush decisions per column family' to trunk
Signed-off-by: stack <stack@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MemStoreFlusher.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
2014-12-18 15:58:55 -08:00
Virag Kothari 9895604e96 Revert "HBASE-12694 testTableExistsIfTheSpecifiedTableRegionIsSplitParent in TestSplitTransactionOnCluster class leaves regions in transition (Vandana Ayyalasomayajula)"
This reverts commit 7fbee896f4.
2014-12-18 11:33:16 -08:00
Virag Kothari 7fbee896f4 HBASE-12694 testTableExistsIfTheSpecifiedTableRegionIsSplitParent in TestSplitTransactionOnCluster class leaves regions in transition (Vandana Ayyalasomayajula) 2014-12-18 11:29:02 -08:00
tedyu effbe85888 HBASE-12223 MultiTableInputFormatBase.getSplits is too slow (Yuanbo Peng) 2014-12-18 05:10:12 -08:00
Enis Soztutar d66ae28c07 Update pom.xml version for 1.1.0-SNAPSHOT for branch-1 2014-12-17 23:16:41 -08:00
Enis Soztutar 9c532a0f9f HBASE-12683 Compilation with hadoop-2.7.0-SNAPSHOT is broken - ADDENDUM 2014-12-17 19:43:47 -08:00
Srikanth Srungarapu 85188d5d9d HBASE-12640 Add Thrift-over-HTTPS and doAs support for Thrift Server 2014-12-17 16:28:13 -08:00
stack 476bd40716 HBASE-12652 Allow unmanaged connections in MetaTableAccessor (Solomon Duskis); REAPPLY 2014-12-17 11:11:35 -08:00
stack 5b51218a56 HBASE-12645 HBaseTestingUtility is using ${$HOME} for rootDir (Varun Saxena) -- ADDENDUM 2014-12-17 10:54:30 -08:00
stack e82f048d7b HBASE-12645 HBaseTestingUtility is using ${$HOME} for rootDir (Varun Saxena) 2014-12-16 21:20:32 -08:00
stack 4587a693b0 Revert "HBASE-12652 Allow unmanaged connections in MetaTableAccessor (Solomon Duskis)"
This reverts commit 1c99261f53.
2014-12-16 17:00:37 -08:00
stack 36269b6403 HBASE-9431 Set 'hbase.bulkload.retries.number' to 10 as HBASE-8450 claims 2014-12-16 11:11:51 -08:00
Rajeshbabu Chintaguntla 0a73d41634 HBASE-12696 Possible NPE in HRegionFileSystem#splitStoreFile when skipStoreFileRangeCheck in splitPolicy return true(Rajeshbabu) 2014-12-16 08:57:50 +05:30
Ashish Singhi e4ad5581d9 HBASE-12348 preModifyColumn and preDeleteColumn in AC denies user to perform its operation though it has required rights
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2014-12-15 17:43:28 -08:00
Andrew Purtell 871444cb0a HBASE-12686 Failures in split before PONR not clearing the daughter regions from regions in transition during rollback (Vandana Ayyalasomayajula) 2014-12-15 17:32:05 -08:00
tedyu 677153ad61 HBASE-12651 Backport HBASE-12559 'Provide LoadBalancer with online configuration capability' to branch-1 2014-12-15 12:03:55 -08:00
tedyu 8b85feceb7 HBASE-12685 TestSplitLogManager#testLogFilesAreArchived sometimes times out due to race condition 2014-12-15 11:50:54 -08:00
Jonathan M Hsieh 7cf86b62a7 HBASE-12692 NPE from SnapshotManager#stop (Ashish Singhi) 2014-12-15 11:23:18 -08:00
Enis Soztutar 88d1ddffd7 HBASE-12683 Compilation with hadoop-2.7.0-SNAPSHOT is broken 2014-12-15 11:11:50 -08:00
stack f0afcd2cc2 HBASE-12689 Move version on from 0.99.2 to HBASE-1.0.0-SNAPSHOT 2014-12-14 20:37:59 -08:00
stack b1c95d50cf HBASE-12422 Use ConnectionFactory in HTable constructors Fix method signature in test
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/coprocessor/SecureBulkLoadClient.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestLoadIncrementalHFilesSplitRecovery.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestHBaseFsck.java
2014-12-14 19:56:20 -08:00
Enis Soztutar 4f22143dfa HBASE-12679 Add HBaseInterfaceAudience.TOOLS and move some of the Public classes to LimitedPrivate 2014-12-14 17:52:05 -08:00
tedyu b7bb9d9505 HBASE-12659 Replace the method calls to grant and revoke in shell scripts with AccessControlClient (Srikanth Srungarapu) 2014-12-13 10:19:18 -08:00
tedyu 4d218bb2ed HBASE-12644 Visibility Labels: issue with storing super users in labels table (Jerry He) 2014-12-13 09:13:49 -08:00
Enis Soztutar 778f443b06 HBASE-12678 HBCK should print command line arguments 2014-12-12 13:17:47 -08:00
Jurriaan Mous 54381aab11 HBASE-12668 Adapt PayloadCarryingRpcController so it can also be used in an async way
Signed-off-by: stack <stack@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/TimeLimitedRpcController.java
2014-12-12 07:54:34 -08:00
stack e3e9c96f89 HBASE-12373 Provide a command to list visibility labels (Jerry He)
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/visibility/TestVisibilityLabelsWithDefaultVisLabelService.java
2014-12-11 15:20:40 -08:00
Matteo Bertozzi c4aee2e283 HBASE-12674 Add permission check to getNamespaceDescriptor() 2014-12-11 18:00:58 +00:00
Jeffrey Zhong 75cf81aae5 HBASE-12485 Maintain SeqId monotonically increasing 2014-12-10 17:56:49 -08:00
stack 8ec86932b1 HBASE-12671 HBASE-12652 broke branch-1 builds (TestAssignmentManager fails) 2014-12-10 11:58:22 -08:00
Matteo Bertozzi f763b5d2c4 HBASE-12663 unify getTableDescriptors() and listTableDescriptors 2014-12-10 15:30:35 +00:00
stack 51bbbbaf2b HBASE-12665 When aborting, dump metrics
Add some fixup of checkstyle fails

Conflicts:
	hbase-common/src/main/java/org/apache/hadoop/hbase/CellUtil.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/http/jmx/JMXJsonServlet.java
2014-12-09 21:08:10 -08:00
stack beae9887fa HBASE-12666 TestAssignmentManager hanging; add timeouts 2014-12-09 20:45:02 -08:00
Andrew Purtell 7ebeb89c39 HBASE-12454 Setting didPerformCompaction early in HRegion#compact 2014-12-09 17:07:28 -08:00
Nick Dimiduk 4a1d56a4a5 HBASE-12467 Master joins cluster but never completes initialization
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2014-12-09 16:32:33 -08:00
stack 86c8563209 HBASE-12664 TestDefaultLoadBalancer.testBalanceCluster fails in CachedDNSToSwitchMapping -- ADDENDUM 2014-12-09 13:53:34 -08:00
Andrew Purtell d4c94a409a HBASE-11979 Compaction progress reporting is wrong (Esteban Gutierrez) 2014-12-09 12:46:46 -08:00
Nick Dimiduk 1c99261f53 HBASE-12652 Allow unmanaged connections in MetaTableAccessor (Solomon Duskis) 2014-12-09 11:50:47 -08:00
Nick Dimiduk 84bf8bcd8b HBASE-12664 TestDefaultLoadBalancer.testBalanceCluster fails in CachedDNSToSwitchMapping Addendum 2014-12-09 11:49:08 -08:00
stack d7f2ac796f HBASE-12664 TestDefaultLoadBalancer.testBalanceCluster fails in CachedDNSToSwitchMapping
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/TestDefaultLoadBalancer.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/TestStochasticLoadBalancer.java
2014-12-09 11:15:01 -08:00
Rajeshbabu Chintaguntla 9a128b94d5 HBASE-12583 Allow creating reference files even the split row not lies in the storefile range if required - Addendum(Rajeshbabu) 2014-12-09 23:44:27 +05:30
Sean Busbey d2d6945e89 HBASE-12655 WALPerformanceEvaluation should only add stat gathering listener once per WAL. 2014-12-09 09:53:25 -06:00
tedyu 553c386c8c HBASE-12653 Move TestRegionServerOnlineConfigChange & TestConfigurationManager to Junit4 tests (Ashish) 2014-12-09 07:31:03 -08:00
Rajeshbabu Chintaguntla 08a2559851 HBASE-12583 Allow creating reference files even the split row not lies in the storefile range if required(Rajeshbabu) 2014-12-09 19:00:37 +05:30
Matteo Bertozzi 09617cc2aa HBASE-12564 consolidate the getTableDescriptors() semantic 2014-12-09 12:06:39 +00:00
Andrew Purtell a731ea6304 HBASE-12575 Sanity check table coprocessor classes are loadable 2014-12-08 18:18:50 -08:00
stack 1d880e3f60 HBASE-12597 Add RpcClient interface and enable changing of RpcClient implementation (Jurriaan Mous) 2014-12-08 15:23:38 -08:00
stack 823656bf83 HBASE-12611 Create autoCommit() method and remove clearBufferOnFail (Solomon Duskis)
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTable.java
2014-12-08 11:17:59 -08:00
Elliott Clark cc1a0d7c36 HBASE-12574 Update replication metrics to not do so many map look ups. 2014-12-08 10:58:21 -08:00
Nick Dimiduk 081ce3f8de HBASE-12163 Move test annotation classes to the same package as in master 2014-12-08 10:38:58 -08:00
Enis Soztutar 9ee9a4bd20 HBASE-12647 Truncate table should work with C as well 2014-12-07 20:58:55 -08:00
Andrew Purtell 7b7b398056 HBASE-12606 Sanity check encryption configuration before opening WAL or onlining regions
Also disables IntegrationTestIngestWithEncryption if distributed
cluster configuration is missing prerequisites.
2014-12-06 22:04:26 -08:00
Gary Helmling 6c4863f355 HBASE-12493 Make User and TokenUtil public 2014-12-06 02:10:31 -08:00
tedyu 2306a7fd96 HBASE-12642 LoadIncrementalHFiles does not throw exception after hitting hbase.bulkload.retries.number setting 2014-12-05 18:40:50 -08:00
Andrew Purtell 004e977ba0 HBASE-10560 Per cell TTLs 2014-12-05 11:11:15 -08:00
Keith Winkler 1bd27bfa24 HBASE-12565 Race condition in HRegion.batchMutate() causes partial data to be written when region closes
Signed-off-by: stack <stack@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
2014-12-05 10:22:01 -08:00
Matteo Bertozzi 398e4f7ccf HBASE-12622 user_permission should require global admin to display global and ns permissions 2014-12-05 10:46:40 +00:00
Enis Soztutar 1615a4da62 HBASE-12637 Compilation with Hadoop-2.4- is broken 2014-12-04 18:20:58 -08:00
Andrew Purtell b4299ef845 HBASE-12635 Delete acl notify znode of table after the table is deleted (Liu Shaohui) 2014-12-04 16:43:42 -08:00
tedyu 2e47c37b71 HBASE-12204 Backport HBASE-12016 'Reduce number of versions in Meta table. Make it configurable' to branch-1 2014-12-04 12:18:58 -08:00
Ashish Singhi ffbfe01bbe HBASE-12634 Fix the AccessController#requireGlobalPermission(ns) with NS
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2014-12-04 15:35:53 +00:00
stack fe9e7483a3 Add timeout on TestDefaultLoadBalancer#testBalancerCluster to see if we can stop it hanging as a zombie in precommit builds 2014-12-03 22:35:02 -08:00
Ramkrishna 806716e65d HBASE-11639 [Visibility controller] Replicate the visibility of Cells as
strings : Addendum adding break (Ram)
2014-12-04 08:52:11 +05:30
stack e73e741b5c HBASE-12617 Running IntegrationTestBigLinkedList against cluster getting not an instance of org.apache.hadoop.hbase.MiniHBaseCluster
(cherry picked from commit d6b1d8cbf7)
2014-12-03 10:38:00 -08:00
Enis Soztutar 5f150e49f9 Update pom.xml version for 0.99.2 2014-12-02 20:28:29 -08:00
Enis Soztutar a25194a3e4 HBASE-12398 Region isn't assigned in an extreme race condition (Jeffrey Zhong) 2014-12-02 19:50:34 -08:00
tedyu b189b25ab3 HBASE-12614 Potentially unclosed StoreFile(s) in DefaultCompactor#compact() 2014-12-02 19:33:08 -08:00
stack 23382fe625 HBASE-12616 We lost the linked list commands in recent usage refactoring 2014-12-02 14:15:26 -08:00
stack 2b976c6bd1 HBASE-12490 Replace uses of setAutoFlush(boolean, boolean) (Solomon Duskis) 2014-12-02 09:34:04 -08:00
Elliott Clark 091142f47a HBASE-12576 Add metrics for rolling the HLog if there are too few DN's in the write pipeline 2014-12-02 09:30:29 -08:00
stack be29fb4c02 HBASE-12610 Close connection in TableInputFormatBase (Solomon Duskis) 2014-12-02 09:28:28 -08:00
Sean Busbey 8959828fb5 HBASE-12522 Backport of write-ahead-log refactoring and follow-ons.
Issues incorporated and incompatible changes called out on the jira.

* Cleaned up references to HLog
* Deprecates HLogKey but maintains it for compatibility
  - Moves all Writeable from WALKey to HLogKey
* Adds utility code to CoprocessorHost to help with evolving Coprocessor APIs
* RSRpcServices roll WAL call now requests the non-meta LogRoller roll all logs
  - rolls actually happen asynchronously
  - deprecated old api (and noted incompatible behavior change)
  - modified api in new Admin interface to reflect lack of return values.
* Moved WAL user facing API to "WAL"
  - only 1 sync offered
  - WALTrailer removed from API
* make provider used by the WALFactory configurable.
* Move all WAL requests to use opaque ids instead of paths
* WALProvider provides API details for implementers and handles creation of WALs.
* Refactor WALActionsListener to have a basic implementation.
* turn MetricsWAL into a WALActionsListener.
* tests that needs FSHLog implementation details use them directly, others just reference provider + factory
  - Some tests moved from Large to Medium based on run time.
* pull out wal disabling into its own no-op class
* update region open to delegate to WALFactory
* update performance test tool to allow for multiple regions
* Removed references to meta-specific wals within wal code
  - replaced with generic suffixes
  - WALFactory maintains a dedicated WALProvider for meta (and so knows about the distinction)
* maintain backwards compat on HLogPrettyPrinter and mark it deprecated.
  - made WALPrettyPrinter IA.Private in favor of `bin/hbase wal`
* move WALUtil stuff that's implementation specific to said implementation
  - WALUtil now acts as an integration point between the RegionServer and hte WAL code.

Incorporates contributions from v.himanshu and stack.

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/WALPlayer.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/migration/NamespaceUpgrade.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/protobuf/ReplicationProtbufUtil.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/LogRoller.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RegionServerServices.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/FSHLog.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/RegionReplicaReplicationEndpoint.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/util/HMerge.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/util/MetaUtils.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/wal/WALSplitter.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/TestIOFencing.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestAdmin2.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/coprocessor/TestRegionObserverScannerOpenHook.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/filter/TestFilter.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/filter/TestInvocationRecordFilter.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/fs/TestBlockReorder.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestHLogRecordReader.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestImportExport.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDistributedLogSplitting.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestAtomicOperation.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionMergeTransaction.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestSplitTransaction.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestHLog.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestLogRollAbort.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestLogRollingNoCluster.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestMultiSlaveReplication.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationEndpoint.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationSource.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationWALEntryFilters.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestRegionReplicaReplicationEndpoint.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestRegionReplicaReplicationEndpointNoMaster.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestReplicationSourceManager.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestReplicationWALReaderManager.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestFSVisitor.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestMergeTool.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestSecureWAL.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALFiltering.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALMethods.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALReaderOnSecureWAL.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALSplit.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALSplitCompressed.java
	src/main/docbkx/ops_mgt.xml
2014-12-02 11:05:02 -06:00
Enis Soztutar e2631ce70c HBASE-12537 HBase should log the remote host on replication error (Stack) 2014-12-01 20:10:52 -08:00
stack a5169d422b HBASE-12526 Remove unused imports (Varun Saxena) 2014-12-01 14:30:59 -08:00
Jeffrey Zhong a184620fb3 HBASE-12600: Remove REPLAY tag dependency in Distributed Replay Mode 2014-12-01 11:30:13 -08:00
stack 86dc3cab96 HBASE-12520 Add protected getters on TableInputFormatBase (Solomon Duskis) 2014-12-01 10:20:57 -08:00
stack 53d775f242 HBASE-12514 Cleanup HFileOutputFormat legacy code (Solomon Duskis)
Signed-off-by: stack <stack@apache.org>
2014-12-01 10:16:35 -08:00
Ramkrishna 95de67bd39 HBASE-11639 - [Visibility controller] Replicate the visibility of Cells as
strings (Ram)
2014-12-01 23:24:20 +05:30
stack 84d9f0ec26 HBASE-12491 TableMapReduceUtil.findContainingJar() NPE 2014-11-29 09:34:25 -08:00
stack b12d57783f HBASE-12519 Remove tabs used as whitespace (Varun Saxena) 2014-11-29 09:24:08 -08:00
stack 7eefa36ac2 HBASE-10536 ImportTsv should fail fast if any of the column family passed to the job is not present in the table (denny joesph) 2014-11-28 20:42:55 -08:00
stack f95728ac7d HBASE-12581 TestCellACLWithMultipleVersions failing since task 5 HBASE-12404 (HBASE-12404 addendum) -- SLEEP ADDENDUM 2014-11-27 05:29:23 -08:00
stack c3b99a5406 HBASE-12558 TestHCM.testClusterStatus Unexpected exception, expected<org.apache.hadoop.hbase.regionserver.RegionServerStoppedException> but was<junit.framework.AssertionFailedError> -- DISABLING FAILING TEST 2014-11-26 22:23:14 -08:00
Jeffrey Zhong 643de2df04 HBASE-12533: staging directories are not deleted after secure bulk load 2014-11-26 16:32:59 -08:00
Jeffrey Zhong def45c2185 HBASE-12053: SecurityBulkLoadEndPoint set 777 permission on input data files 2014-11-26 16:32:51 -08:00
Enis Soztutar 898e78661a HBASE-12072 Standardize retry handling for master operations
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Admin.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HConnection.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTable.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/RowTooBigException.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/replication/ReplicationAdmin.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/procedure/flush/MasterFlushTableProcedureManager.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestReplicasClient.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionMergeTransactionOnCluster.java
2014-11-26 13:50:24 -08:00
stack 9036c78cf1 HBASE-12587 TestReplicationTrackerZKImpl.testPeerRemovedEvent timedout 2014-11-26 12:54:27 -08:00
stack f376343a17 Revert "HBASE-12563 After Starting up mini hbase cluster, Real Configuration of Cluster never set to HBaseTestingUtility (Talat UYARER)"
Broke the build. TestZooKeeper doesn't pass.

This reverts commit 2e9597ffb7.
2014-11-26 10:35:03 -08:00
stack daff5e8d96 HBASE-12518 Task 4 polish. Remove CM#{get,delete}Connection
Remove deleteConnection from everywhere except the two tests that ensure
it does the right thing and from HCM and CM themselves.

Undoes deleteConnection from tests and from the web ui
2014-11-26 08:12:13 -08:00
stack 2e9597ffb7 HBASE-12563 After Starting up mini hbase cluster, Real Configuration of Cluster never set to HBaseTestingUtility (Talat UYARER) 2014-11-26 08:00:00 -08:00
stack c55d57461c HBASE-12584 Fix branch-1 failing since task 5 HBASE-12404 (HBASE-12404 addendum) 2014-11-26 01:52:41 -08:00
stack c9376e6d37 HBASE-12581 TestCellACLWithMultipleVersions failing since task 5 HBASE-12404 (HBASE-12404 addendum) 2014-11-25 16:30:23 -08:00
stack c0cdaf8400 HBASE-12404 Task 5 from parent: Replace internal HTable constructor use with
HConnection#getTable (0.98, 0.99)

    Backport

    Replaced HTable under hbase-*/src/main/java. Skipped tests. Would take
    till end of time to do all and some cases are cryptic. Also skipped
    some mapreduce where HTable comes through in API. Can do both of
    these stragglers in another issue.
    Generally, if a utility class or standalone class, tried to pass in a
    Connection rather than have the utility or standalone create its own
    connection on each invocation; e.g. the Quota stuff. Where not possible,
    noted where invocation comes from... if test or hbck, didn't worry about
    it.
    Some classes are just standalone and nothing to be done to avoid
    a Connection setup per invocation (this is probably how it worked
    in the new HTable...days anyways). Some classes are not used:
    AggregationClient, FavoredNodes... we should just purge this stuff.
    Doc on what short circuit connection does (I can just use it...
    I thought it was just for short circuit but no, it switches dependent
    on where you are connecting).
    Changed HConnection to super Interface ClusterConnection where safe (
    internal usage by private classes only).
    Doc cleanup in example usage so we do new mode rather than the old
    fashion.
    Used java7 idiom that allows you avoid writing out finally to call close
    on implementations of Closeable.
    Added a RegistryFactory.. moved it out from being inner class.
    Added a utility createGetClosestRowOrBeforeReverseScan method to Scan
    to create a Scan that can ...
    Renamed getShortCircuitConnection as getConnection – users don't need
    to know what implementation does (that it can short-circuit RPC).
    The old name gave pause. I was frightened to use it thinking it only
    for short-circuit reading – that it would not do remote too.
    Squashed commit of the following:
2014-11-25 12:26:54 -08:00
Elliott Clark 524dcd1323 HBASE-12550 ADDENDUM Make HRegion's api not change. 2014-11-24 16:11:41 -08:00
stack 3cd1d7ab0c HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99) under src/main/java 2014-11-24 10:12:27 -08:00
stack f3c5f11718 HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99) under src/main/java
Move from HConnection to ClusterConnection or Connection
Use unmanaged connections where we use managed previous
(used the jdk7 https://docs.oracle.com/javase/7/docs/technotes/guides/language/try-with-resources.html idiom).

In ZKConfig, synchronize on Configuration rather than make a copy.
Making a copy we were dropping hbase configs in certain test context
(could not find the zk ensemble because default port).

In tests, some move to the new style connection setup but mostly
fixes for premature connection close or adding cleanup where it
was lacking.

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestMultiParallel.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestLoadIncrementalHFilesSplitRecovery.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDistributedLogSplitting.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestMultiSlaveReplication.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationEndpoint.java
2014-11-24 10:12:27 -08:00
Elliott Clark 339fd6bdca HBASE-12550 Check all storefiles are referenced before splitting
Summary: If there are bugs in HDFS move and/or create we should protect against them by making sure that all files referenced end up in split daughters.

Test Plan: Unit tests cover splits pretty well

Subscribers: matteobertozzi

Differential Revision: https://reviews.facebook.net/D29373
2014-11-24 09:51:53 -08:00
Andrew Purtell 9904252615 HBASE-12479 Backport HBASE-11689 (Track meta in transition) (Virag Kothari) 2014-11-22 12:13:09 -08:00
stack 7a3e8b55f8 HBASE-12549 Fix TestAssignmentManagerOnCluster#testAssignRacingWithSSH() flaky test (Virag Kothari) --ADDENDUM 2014-11-21 21:32:55 -08:00
tedyu d5bcf338d6 HBASE-12554 TestBaseLoadBalancer may timeout due to lengthy rack lookup 2014-11-21 16:56:31 -08:00
Enis Soztutar aa343ebcfe HBASE-10671 Add missing InterfaceAudience annotations for classes in hbase-common and hbase-client modules 2014-11-21 14:09:28 -08:00
stack 42cbdea76d HBASE-12541 Add misc debug logging to hanging tests in TestHCM and TestBaseLoadBalancer -- ADDENDUM; add waitForNoRegionInTransition from HTU in master branch 2014-11-21 08:15:38 -08:00
anoopsjohn 3c3e9aef81 HBASE-12346 Scan's default auths behavior under Visibility labels. - Addendum 2014-11-21 18:25:41 +05:30
anoopsjohn 04ee2bc812 HBASE-12346 Scan's default auths behavior under Visibility labels.(Jerry He) 2014-11-21 13:47:22 +05:30
stack bfda57d4f2 HBASE-12541 Add misc debug logging to hanging tests in TestHCM and TestBaseLoadBalancer 2014-11-20 17:55:08 -08:00
Enis Soztutar 49422a9ec4 HBASE-12549 Fix TestAssignmentManagerOnCluster#testAssignRacingWithSSH() flaky test 2014-11-20 16:19:20 -08:00
Sean Busbey f1ae3cc56f HBASE-12516 Clean up QA Bot warnings
Signed-off-by: stack <stack@apache.org>
2014-11-20 15:13:03 -08:00
tedyu 3b4688f9ee HBASE-11099 Two situations where we could open a region with smaller sequence number (Stephen Jiang) 2014-11-20 14:44:08 -08:00
tedyu deacb117f6 HBASE-12464 meta table region assignment stuck in the FAILED_OPEN state due to region server not fully ready to serve (Stephen Jiang) 2014-11-20 12:01:40 -08:00
Nick Dimiduk f1048a148b HBASE-12539 HFileLinkCleaner logs are uselessly noisy 2014-11-19 23:51:19 +01:00
Matteo Bertozzi 865ffebfc6 HBASE-12529 Use ThreadLocalRandom for RandomQueueBalancer 2014-11-19 16:51:26 +00:00
Matteo Bertozzi 6e376b900e Patch up Jetty to disable SSLv3 (CVE-2014-3566) 2014-11-19 16:51:19 +00:00
stack 3a3a4b7b6b Revert "HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99)"
This reverts commit 4f5cde8a69.
2014-11-18 16:32:18 -08:00
Andrew Purtell eb34c956a1 HBASE-12496 A blockedRequestsCount metric (Yi Deng) 2014-11-18 14:24:18 -08:00
Lars Hofhansl 2ed5ac9ca9 HBASE-12411 Optionally enable p-reads and private readers for compactions. 2014-11-18 12:29:31 -08:00
Enis Soztutar bb0a3ce914 HBASE-12449 Use the max timestamp of current or old cell's timestamp in HRegion.append() 2014-11-18 11:35:47 -08:00
stack 4f5cde8a69 HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99)
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/HLogSplitter.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestMultiParallel.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestLoadIncrementalHFilesSplitRecovery.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDistributedLogSplitting.java
2014-11-18 10:19:55 -08:00
tedyu 463198dcdc HBASE-12337 Import tool fails with NullPointerException if clusterIds is not initialized 2014-11-18 09:19:00 -08:00
Nick Dimiduk f38efa79e6 HBASE-12459 Use a non-managed Table in mapred.TableOutputFormat 2014-11-17 08:39:46 +01:00
stack dcba045526 HBASE-12359 MulticastPublisher should specify IPv4/v6 protocol family when creating multicast channel (Qiang Tian) 2014-11-14 21:55:59 -08:00
tedyu 30ecf5ae78 HBASE-12478 HBASE-10141 and MIN_VERSIONS are not compatible 2014-11-14 16:37:19 -08:00
Lars Hofhansl 1861f9ce25 Revert "HBASE-12457 Regions in transition for a long time when CLOSE interleaves with a slow compaction."
This reverts commit 0e795c1cf8.
2014-11-13 09:19:43 -08:00
Lars Hofhansl 880c7c35fc Revert "Amend HBASE-12457 Regions in transition for a long time when CLOSE interleaves with a slow compaction; Test import fix"
This reverts commit 9d2ad55cfa.
2014-11-13 09:19:32 -08:00
Andrew Purtell 9d2ad55cfa Amend HBASE-12457 Regions in transition for a long time when CLOSE interleaves with a slow compaction; Test import fix 2014-11-13 08:09:51 -08:00
Lars Hofhansl 0e795c1cf8 HBASE-12457 Regions in transition for a long time when CLOSE interleaves with a slow compaction. 2014-11-12 22:49:46 -08:00
Enis Soztutar b25e5bb890 HBASE-12445 hbase is removing all remaining cells immediately after the cell marked with marker = KeyValue.Type.DeleteColumn via PUT (Hani Nadra) 2014-11-12 15:50:48 -08:00
Matteo Bertozzi 1f0d960792 HBASE-12366 Add login code to HBase Canary tool (Srikanth Srungarapu) 2014-11-12 20:33:37 +00:00