Commit Graph

3623 Commits

Author SHA1 Message Date
Lars Hofhansl 0513a21dc8 HBASE-12776 SpliTransaction: Log number of files to be split. 2014-12-29 20:38:09 -08:00
xieliang c24810eebe HBASE-12767 Fix a StoreFileScanner NPE in reverse scan flow 2014-12-30 11:55:11 +08:00
stack 02b0332650 HBASE-12772 TestPerColumnFamilyFlush failing 2014-12-29 15:47:20 -08:00
Esteban Gutierrez b2eea8cac6 HBASE-12695 JDK 1.8 compilation broken
Signed-off-by: stack <stack@apache.org>
2014-12-29 11:02:04 -08:00
Elliott Clark e5ca773f78 HBASE-12429 Add port to ClusterManager's actions. 2014-12-29 10:22:52 -08:00
stack 8dac7f9e6c HBASE-12762 Region with no hfiles will have the highest locality cost in LocalityCostFunction (cuijianwei) 2014-12-29 07:44:46 -08:00
tedyu fbdaf62bf8 HBASE-12716 A bug in RegionSplitter.UniformSplit algorithm (Weichen Ye) 2014-12-28 07:48:24 -08:00
tedyu 9abab54d8e HBASE-12764 TestPerColumnFamilyFlush#testCompareStoreFileCount may fail due to new table not available 2014-12-27 21:10:47 -08:00
stack 317d137452 HBASE-12763 Make it so there must be WALs for a server to be marked dead 2014-12-27 13:09:40 -08:00
Elliott Clark 8426f1f53a HBASE-12697 Don't use RegionLocationFinder if localityCost == 0 2014-12-26 11:13:28 -08:00
Jonathan M Hsieh 30424ec73f HBASE-12749 Tighten HFileLink api to enable non-snapshot uses 2014-12-24 04:54:47 -08:00
Jonathan M Hsieh a912a56b38 HBASE-12590 A solution for data skew in HBase-Mapreduce jobs (Weichen Ye) 2014-12-24 04:50:42 -08:00
Jonathan M Hsieh 9a829dc458 HBASE-12735 Refactor TestAcidGuarantees so it can live as unit test and as an integration test 2014-12-23 17:18:58 -08:00
Jurriaan Mous 4880e5d83b HBASE-12736
Signed-off-by: stack <stack@apache.org>
2014-12-23 10:30:25 -08:00
Jurriaan Mous e92a9bf003 HBASE-12742
Signed-off-by: stack <stack@apache.org>
2014-12-23 10:14:16 -08:00
Devaraj Das 1c45d1cd9d HBASE-12012. Improve cancellation for the scan RPCs 2014-12-22 16:22:04 -08:00
stack 4d53fe5dcd HBASE-12734 TestPerColumnFamilyFlush.testCompareStoreFileCount is flakey (zhangduo) 2014-12-22 08:56:33 -08:00
tedyu fbf8b30aa6 HBASE-12741 AccessController contains a javadoc issue (Jurriaan Mous) 2014-12-22 08:32:37 -08:00
tedyu 51334fb951 HBASE-10201 Addendum fixes typo of putIfAbsent (Duo Zhang) 2014-12-21 07:22:41 -08:00
Jesse Yates e267db45ac HBASE-12703 Cleanup TestClientPushback for repeatability 2014-12-19 19:16:43 -08:00
stack feede7abd8 HBASE-12732 Log messages in FileLink#tryOpen are reversed (Tobi Vollebregt) 2014-12-19 17:47:11 -08:00
Enis Soztutar 40fb2e9219 HBASE-12720 Make InternalScan LimitedPrivate (Vladimir Rodionov) 2014-12-19 13:57:51 -08:00
Enis Soztutar d3002c6a8e HBASE-12511 namespace permissions - add support from table creation privilege in a namespace 'C' (Huaiyu Zhu) 2014-12-19 13:04:39 -08:00
Andrew Purtell 9a7adafcdb HBASE-12724 Upgrade the interface audience of RegionScanner from Private to LimitedPrivate 2014-12-19 09:37:03 -08:00
Virag Kothari dceaa2589f Revert "HBASE-12694 testTableExistsIfTheSpecifiedTableRegionIsSplitParent in TestSplitTransactionOnCluster class leaves regions in transition (Vandana Ayyalasomayajula)"
This reverts commit b24991d7a0.
2014-12-19 08:39:52 -08:00
Sean Busbey f1c41e307e HBASE-5699 Adds multiple WALs per Region Server based on groups of regions. 2014-12-19 10:31:41 -06:00
stack 0c7d22439d Fix single javadoc warning in VisibilityController -- removed a '@return' 2014-12-19 08:22:00 -08:00
tedyu cfd7584eef HBASE-12715 getLastSequenceId always returns -1 (Duo Zhang) 2014-12-19 06:58:16 -08:00
Jonathan M Hsieh 33c27f4e03 HBASE-12718 Convert TestAcidGuarantees from a unit test to an integration test 2014-12-18 17:21:23 -08:00
Virag Kothari b24991d7a0 HBASE-12694 testTableExistsIfTheSpecifiedTableRegionIsSplitParent in TestSplitTransactionOnCluster class leaves regions in transition (Vandana Ayyalasomayajula) 2014-12-18 17:00:07 -08:00
Virag Kothari 3caae62390 Revert "HBASE-12694 testTableExistsIfTheSpecifiedTableRegionIsSplitParent in TestSplitTransactionOnCluster class leaves regions in transition (Vandana Ayyalasomayajula)"
This reverts commit 9ae615f82b.
2014-12-18 11:29:39 -08:00
Virag Kothari 9ae615f82b HBASE-12694 testTableExistsIfTheSpecifiedTableRegionIsSplitParent in TestSplitTransactionOnCluster class leaves regions in transition (Vandana Ayyalasomayajula) 2014-12-18 11:24:26 -08:00
tedyu 15cf0a6e7b HBASE-12223 MultiTableInputFormatBase.getSplits is too slow (Yuanbo Peng) 2014-12-18 05:09:01 -08:00
Enis Soztutar 00f4ff420e HBASE-12683 Compilation with hadoop-2.7.0-SNAPSHOT is broken - ADDENDUM 2014-12-17 19:41:56 -08:00
Srikanth Srungarapu 072b2d659c HBASE-12640 Add Thrift-over-HTTPS and doAs support for Thrift Server 2014-12-17 16:12:48 -08:00
Jimmy Xiang d918570c80 Revert "Thrift Http implementation"
This reverts commit 1cf8521191.
2014-12-17 16:11:30 -08:00
Srikanth Srungarapu 1cf8521191 Thrift Http implementation 2014-12-17 16:06:19 -08:00
tedyu 6aa8b3727c HBASE-5162 Addendum to stabilize TestClientPushback 2014-12-17 12:37:40 -08:00
stack 422df8a3f4 HBASE-12645 HBaseTestingUtility is using ${$HOME} for rootDir (Varun Saxena) -- ADDENDUM 2014-12-17 10:53:50 -08:00
Andrew Purtell 99a11390b4 Amend HBASE-5162 Basic client pushback mechanism (Jesse Yates)
Applied hbase-5162-trunk-addendum.patch
2014-12-16 22:15:49 -08:00
Andrew Purtell 6a042c381a Revert "HBASE-5162 Basic client pushback mechanism (Jesse Yates); ADDENDUM"
This reverts commit f7154e1ac9.
2014-12-16 22:14:50 -08:00
stack f7154e1ac9 HBASE-5162 Basic client pushback mechanism (Jesse Yates); ADDENDUM 2014-12-16 21:09:52 -08:00
stack 89006f76f7 HBASE-12645 HBaseTestingUtility is using ${$HOME} for rootDir (Varun Saxena) 2014-12-16 16:41:27 -08:00
tedyu 885b065683 HBASE-10201 Addendum changes TestPerColumnFamilyFlush to LargeTest 2014-12-16 16:02:44 -08:00
zhangduo c7fad665f3 HBASE-10201 Port 'Make flush decisions per column family' to trunk
Signed-off-by: stack <stack@apache.org>
2014-12-16 11:49:17 -08:00
Jesse Yates a411227b0e HBASE-5162 Basic client pushback mechanism
Instead of just blocking the client for 90 seconds when the region gets too
busy, it now sends along region load stats to the client so the client can
know how busy the server is. Currently, its just the load on the memstore, but
it can be extended for other stats (e.g. cpu, general memory, etc.).

It is then up to the client to decide if it wants to listen to these stats.
By default, the client ignores the stats, but it can easily be toggled to the
built-in exponential back-off or users can plug in their own back-off
implementations
2014-12-16 11:14:30 -08:00
stack e5d813c46b HBASE-9431 Set 'hbase.bulkload.retries.number' to 10 as HBASE-8450 claims 2014-12-16 11:11:14 -08:00
Rajeshbabu Chintaguntla 96c6b9815d HBASE-12696 Possible NPE in HRegionFileSystem#splitStoreFile when skipStoreFileRangeCheck in splitPolicy return true(Rajeshbabu) 2014-12-16 08:38:15 +05:30
Ashish Singhi 110c5f5930 HBASE-12348 preModifyColumn and preDeleteColumn in AC denies user to perform its operation though it has required rights
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2014-12-15 17:43:19 -08:00
tedyu 065d03b784 HBASE-12685 TestSplitLogManager#testLogFilesAreArchived sometimes times out due to race condition 2014-12-15 11:49:39 -08:00
Jonathan M Hsieh 3a652ba41c HBASE-12692 NPE from SnapshotManager#stop (Ashish Singhi) 2014-12-15 11:17:59 -08:00
Enis Soztutar afb753ecc3 HBASE-12683 Compilation with hadoop-2.7.0-SNAPSHOT is broken 2014-12-15 11:09:20 -08:00
Misty Stanley-Jones db873f0886 HBASE-12677 Update replication docs to clarify terminology 2014-12-15 15:44:26 +10:00
stack 029768287a HBASE-12422 Use ConnectionFactory in HTable constructors Fix method signature in test 2014-12-14 19:42:15 -08:00
Enis Soztutar 743d16138e HBASE-12679 Add HBaseInterfaceAudience.TOOLS and move some of the Public classes to LimitedPrivate 2014-12-14 17:46:30 -08:00
tedyu 65830b096b HBASE-12659 Replace the method calls to grant and revoke in shell scripts with AccessControlClient (Srikanth Srungarapu) 2014-12-13 10:17:43 -08:00
tedyu b24518562a HBASE-12644 Visibility Labels: issue with storing super users in labels table (Jerry He) 2014-12-13 09:10:50 -08:00
Enis Soztutar a0e473730e HBASE-12678 HBCK should print command line arguments 2014-12-12 13:17:06 -08:00
Jurriaan Mous 3275b964c1 HBASE-12668 Adapt PayloadCarryingRpcController so it can also be used in an async way
Signed-off-by: stack <stack@apache.org>
2014-12-12 07:44:04 -08:00
stack da2b5a9627 HBASE-12373 Provide a command to list visibility labels (Jerry He) 2014-12-11 15:18:03 -08:00
Matteo Bertozzi 7030d2187d HBASE-12674 Add permission check to getNamespaceDescriptor() 2014-12-11 17:43:51 +00:00
Jeffrey Zhong f67162547d HBASE-12485 Maintain SeqId monotonically increasing 2014-12-10 17:30:00 -08:00
Matteo Bertozzi 8ab96c40d8 HBASE-12663 unify getTableDescriptors() and listTableDescriptors 2014-12-10 15:15:53 +00:00
stack df22270756 HBASE-12665 When aborting, dump metrics
Add some fixup of checkstyle fails
2014-12-09 21:01:15 -08:00
tedyu 9b808155e3 HBASE-12553 request value is not consistent for restoreSnapshot in audit logs (Ashish) 2014-12-09 20:40:18 -08:00
Andrew Purtell 011442edda HBASE-12454 Setting didPerformCompaction early in HRegion#compact 2014-12-09 17:06:04 -08:00
Nick Dimiduk cc8bdcb498 HBASE-12467 Master joins cluster but never completes initialization
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2014-12-09 16:32:11 -08:00
stack 1be63539f1 HBASE-12664 TestDefaultLoadBalancer.testBalanceCluster fails in CachedDNSToSwitchMapping -- ADDENDUM 2014-12-09 13:52:46 -08:00
Andrew Purtell 5537fce353 HBASE-11979 Compaction progress reporting is wrong (Esteban Gutierrez) 2014-12-09 12:46:35 -08:00
Nick Dimiduk e720c83557 HBASE-12652 Allow unmanaged connections in MetaTableAccessor (Solomon Duskis) 2014-12-09 11:27:34 -08:00
stack f9df6a2766 HBASE-12664 TestDefaultLoadBalancer.testBalanceCluster fails in CachedDNSToSwitchMapping 2014-12-09 11:06:23 -08:00
Rajeshbabu Chintaguntla 53493ff5db HBASE-12583 Allow creating reference files even the split row not lies in the storefile range if required - Addendum(Rajeshbabu) 2014-12-09 23:36:28 +05:30
Sean Busbey 33d79bb5ec HBASE-12655 WALPerformanceEvaluation should only add stat gathering listener once per WAL. 2014-12-09 09:52:12 -06:00
tedyu c42c36521d HBASE-12653 Move TestRegionServerOnlineConfigChange & TestConfigurationManager to Junit4 tests (Ashish) 2014-12-09 07:25:44 -08:00
Rajeshbabu Chintaguntla 0354128780 HBASE-12583 Allow creating reference files even the split row not lies in the storefile range if required(Rajeshbabu) 2014-12-09 18:59:13 +05:30
Matteo Bertozzi 8a2c84156a HBASE-12564 consolidate the getTableDescriptors() semantic 2014-12-09 12:06:00 +00:00
Andrew Purtell b4371252fe HBASE-12575 Sanity check table coprocessor classes are loadable 2014-12-08 18:18:22 -08:00
Jurriaan Mous a8e6461855 HBASE-12597
Signed-off-by: stack <stack@apache.org>
2014-12-08 15:40:09 -08:00
stack b8ab1b176c Revert "HBASE-12558 TestHCM.testClusterStatus Unexpected exception, expected<org.apache.hadoop.hbase.regionserver.RegionServerStoppedException> but was<junit.framework.AssertionFailedError> -- ADDED DEBUG"
Accidental commit. Reverting.

This reverts commit 2458be08ed.
2014-12-08 15:34:53 -08:00
stack 2458be08ed HBASE-12558 TestHCM.testClusterStatus Unexpected exception, expected<org.apache.hadoop.hbase.regionserver.RegionServerStoppedException> but was<junit.framework.AssertionFailedError> -- ADDED DEBUG 2014-12-08 15:04:59 -08:00
stack 4b1983c89d HBASE-12611 Create autoCommit() method and remove clearBufferOnFail (Solomon Duskis) 2014-12-08 11:01:28 -08:00
Elliott Clark da0e807dd3 HBASE-12574 Update replication metrics to not do so many map look ups. 2014-12-08 10:35:57 -08:00
tedyu 9e9be97af7 HBASE-12650 Move ServerName to hbase-common module - check in changed files 2014-12-08 07:08:44 -08:00
Enis Soztutar 87e4414004 HBASE-12647 Truncate table should work with C as well 2014-12-07 20:57:04 -08:00
Devaraj Das 9fd6db3703 HBASE-11903. Directly invoking split & merge of replica regions should be disallowed 2014-12-07 11:56:53 -08:00
Andrew Purtell bb15fd5fe0 HBASE-12606 Sanity check encryption configuration before opening WAL or onlining regions
Also disables IntegrationTestIngestWithEncryption if distributed
cluster configuration is missing prerequisites.
2014-12-06 21:46:43 -08:00
Devaraj Das ca0c1774c9 HBASE-12548. Improve debuggability of IntegrationTestTimeBoundedRequestsWithRegionReplicas 2014-12-06 18:18:03 -08:00
tedyu 415ad6b686 HBASE-12642 LoadIncrementalHFiles does not throw exception after hitting hbase.bulkload.retries.number setting 2014-12-05 18:39:58 -08:00
Gary Helmling 1ec6609b97 HBASE-12493 Make User and TokenUtil public 2014-12-05 13:04:54 -08:00
Andrew Purtell 09cd3d7bfb HBASE-10560 Per cell TTLs 2014-12-05 11:10:26 -08:00
Keith Winkler f83e25e180 HBASE-12565 Race condition in HRegion.batchMutate() causes partial data to be written when region closes
Signed-off-by: stack <stack@apache.org>
2014-12-05 10:17:34 -08:00
Matteo Bertozzi c8362a7bb2 HBASE-12622 user_permission should require global admin to display global and ns permissions 2014-12-05 10:45:30 +00:00
Enis Soztutar 08754f2c43 HBASE-12637 Compilation with Hadoop-2.4- is broken 2014-12-04 18:14:59 -08:00
Andrew Purtell e690a83d41 HBASE-12635 Delete acl notify znode of table after the table is deleted (Liu Shaohui) 2014-12-04 16:43:33 -08:00
Ashish Singhi 04444299ab HBASE-12634 Fix the AccessController#requireGlobalPermission(ns) with NS
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2014-12-04 14:12:26 +00:00
stack 52e35b4473 Add timeout on TestDefaultLoadBalancer#testBalancerCluster to see if we can stop it hanging as a zombie in precommit builds 2014-12-03 11:13:36 -08:00
Sean Busbey c5c395b68a HBASE-12623 removes unused code to upgrade from pre-0.96 to 0.96.
Removes both insertion of namespaces and migration of zookeeper data to protobufs.
2014-12-03 13:13:12 -06:00
stack d6b1d8cbf7 HBASE-12617 Running IntegrationTestBigLinkedList against cluster getting not an instance of org.apache.hadoop.hbase.MiniHBaseCluster 2014-12-03 10:37:32 -08:00
Ramkrishna 3db5e20834 HBASE-11639 - [Visibility controller] Replicate the visibility of Cells as
strings- Addendum adding break (Ram)
2014-12-03 10:18:27 +05:30
tedyu a8a134374e HBASE-12614 Potentially unclosed StoreFile(s) in DefaultCompactor#compact() 2014-12-02 19:31:21 -08:00
stack 54f438cee4 HBASE-12616 We lost the linked list commands in recent usage refactoring 2014-12-02 14:15:04 -08:00
stack 7a3396f0e1 HBASE-12490 Replace uses of setAutoFlush(boolean, boolean) (Solomon Duskis) 2014-12-02 10:06:21 -08:00
stack 1a9b556474 Revert "HBASE-12558 TestHCM.testClusterStatus Unexpected exception, expected<org.apache.hadoop.hbase.regionserver.RegionServerStoppedException> but was<junit.framework.AssertionFailedError> -- ADDED DEBUG"
This reverts commit 8b8f2026bd.

Overcommit. Added "HBASE-12490 Replace uses of setAutoFlush(boolean,
boolean)" by mistake

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ClusterStatusListener.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTable.java
2014-12-02 09:51:19 -08:00
Elliott Clark 29ee0cb0e1 HBASE-12576 Add metrics for rolling the HLog if there are too few DN's in the write pipeline 2014-12-02 09:30:52 -08:00
stack 7b10847ec8 HBASE-12610 Close connection in TableInputFormatBase (Solomon Duskis) 2014-12-02 09:28:02 -08:00
tedyu 5cc0714840 HBASE-12559 Addendum fixes findbugs warnings 2014-12-02 04:43:34 -08:00
Enis Soztutar 94d57f81dc HBASE-12537 HBase should log the remote host on replication error (Stack) 2014-12-01 20:10:20 -08:00
tedyu a30cca91e0 HBASE-12559 Provide LoadBalancer with online configuration capability 2014-12-01 14:11:01 -08:00
Jeffrey Zhong 2c280e6253 HBASE-12600: Remove REPLAY tag dependency in Distributed Replay Mode 2014-12-01 11:19:47 -08:00
Jeffrey Zhong 0733450473 Revert "Remove Replay Tag"
This reverts commit f723ffde7f.
2014-12-01 11:17:24 -08:00
Jeffrey Zhong f723ffde7f Remove Replay Tag 2014-12-01 10:59:47 -08:00
tedyu 2fbbdfd9a1 HBASE-12559 Revert for addressing review comments 2014-12-01 10:38:05 -08:00
stack 308db3a5c8 HBASE-12520 Add protected getters on TableInputFormatBase (Solomon Duskis) 2014-12-01 10:20:37 -08:00
stack 69a437ac0d HBASE-12514 Cleanup HFileOutputFormat legacy code (Solomon Duskis)
Signed-off-by: stack <stack@apache.org>
2014-12-01 10:15:51 -08:00
stack 56a03d736a HBASE-12603 Remove javadoc warnings introduced due to removal of unused imports (Varun Saxena) 2014-12-01 10:13:16 -08:00
Ramkrishna b6b88edf93 HBASE-11639 [Visibility controller] Replicate the visibility of Cells as
strings (Ram)
2014-12-01 23:03:52 +05:30
tedyu 41041e8d6a HBASE-12559 Provide LoadBalancer with online configuration capability 2014-12-01 07:30:17 -08:00
stack b94b0e9ca7 HBASE-12491 TableMapReduceUtil.findContainingJar() NPE 2014-11-29 09:34:00 -08:00
stack 555e78005d HBASE-12526 Remove unused imports (Varun Saxena) 2014-11-29 09:20:46 -08:00
stack 58b6b24c29 HBASE-12519 Remove tabs used as whitespace (Varun Saxena) 2014-11-28 20:50:02 -08:00
stack eb4c194a87 HBASE-10536 ImportTsv should fail fast if any of the column family passed to the job is not present in the table (denny joesph) 2014-11-28 20:42:24 -08:00
stack 0f8894cd64 HBASE-12581 TestCellACLWithMultipleVersions failing since task 5 HBASE-12404 (HBASE-12404 addendum) -- SLEEP ADDENDUM 2014-11-27 05:28:55 -08:00
stack aa0bd50fd4 HBASE-12558 TestHCM.testClusterStatus Unexpected exception, expected<org.apache.hadoop.hbase.regionserver.RegionServerStoppedException> but was<junit.framework.AssertionFailedError> -- DISABLING FAILING TEST 2014-11-26 22:22:35 -08:00
Jeffrey Zhong f0d95e7f11 HBASE-12533: staging directories are not deleted after secure bulk load 2014-11-26 16:23:11 -08:00
Jeffrey Zhong b2cdeacc8c HBASE-12053: SecurityBulkLoadEndPoint set 777 permission on input data files 2014-11-26 16:19:22 -08:00
stack 595d2a846c HBASE-12589 Forward-port fix for TestFromClientSideWithCoprocessor.testMaxKeyValueSize 2014-11-26 14:43:32 -08:00
stack 1c0a06193e HBASE-12587 TestReplicationTrackerZKImpl.testPeerRemovedEvent timedout 2014-11-26 12:53:54 -08:00
Enis Soztutar 02963b202a HBASE-12072 Standardize retry handling for master operations 2014-11-26 12:09:44 -08:00
stack d1f39d8246 Revert "HBASE-12563 After Starting up mini hbase cluster, Real Configuration of Cluster never set to HBaseTestingUtility (Talat UYARER)"
Causes TestZooKeeper to fail.  Reverting.

This reverts commit 9be143691c.
2014-11-26 10:23:49 -08:00
stack b719e7a8c6 HBASE-12518 Task 4 polish. Remove CM#{get,delete}Connection
Remove deleteConnection from everywhere except the two tests that ensure
it does the right thing and from HCM and CM themselves.

Undoes deleteConnection from tests and from the web ui
2014-11-26 08:11:41 -08:00
stack 9be143691c HBASE-12563 After Starting up mini hbase cluster, Real Configuration of Cluster never set to HBaseTestingUtility (Talat UYARER) 2014-11-26 07:59:26 -08:00
stack 1350055fcd HBASE-12581 TestCellACLWithMultipleVersions failing since task 5 HBASE-12404 (HBASE-12404 addendum) 2014-11-26 07:53:35 -08:00
Matteo Bertozzi c57bc08082 HBASE-12474 Incorrect handling of default namespace in user_permission command (Srikanth Srungarapu) 2014-11-26 12:29:38 +00:00
stack 8b8f2026bd HBASE-12558 TestHCM.testClusterStatus Unexpected exception, expected<org.apache.hadoop.hbase.regionserver.RegionServerStoppedException> but was<junit.framework.AssertionFailedError> -- ADDED DEBUG 2014-11-25 21:21:50 -08:00
stack 24f19328eb HBASE-12581 TestCellACLWithMultipleVersions failing since task 5 HBASE-12404 (HBASE-12404 addendum) 2014-11-25 16:29:53 -08:00
stack e6b4300756 HBASE-12404 Task 5 from parent: Replace internal HTable constructor use with
HConnection#getTable (0.98, 0.99)

Replaced HTable under hbase-*/src/main/java. Skipped tests. Would take
till end of time to do all and some cases are cryptic. Also skipped
some mapreduce where HTable comes through in API. Can do both of
these stragglers in another issue.
Generally, if a utility class or standalone class, tried to pass in a
Connection rather than have the utility or standalone create its own
connection on each invocation; e.g. the Quota stuff. Where not possible,
noted where invocation comes from... if test or hbck, didn't worry about
it.
Some classes are just standalone and nothing to be done to avoid
a Connection setup per invocation (this is probably how it worked
in the new HTable...days anyways). Some classes are not used:
AggregationClient, FavoredNodes... we should just purge this stuff.
Doc on what short circuit connection does (I can just use it...
I thought it was just for short circuit but no, it switches dependent
on where you are connecting).
Changed HConnection to super Interface ClusterConnection where safe (
internal usage by private classes only).
Doc cleanup in example usage so we do new mode rather than the old
fashion.
Used java7 idiom that allows you avoid writing out finally to call close
on implementations of Closeable.
Added a RegistryFactory.. moved it out from being inner class.
Added a utility createGetClosestRowOrBeforeReverseScan method to Scan
to create a Scan that can ...
Renamed getShortCircuitConnection as getConnection – users don't need
to know what implementation does (that it can short-circuit RPC).
The old name gave pause. I was frightened to use it thinking it only
for short-circuit reading – that it would not do remote too.
Squashed commit of the following:
2014-11-25 08:15:20 -08:00
Elliott Clark e83082a888 HBASE-12550 ADDENDUM Make HRegion's api not change. 2014-11-24 16:11:48 -08:00
Elliott Clark 0df5ed2ca6 HBASE-12550 Check all storefiles are referenced before splitting
Summary: If there are bugs in HDFS move and/or create we should protect against them by making sure that all files referenced end up in split daughters.

Test Plan: Unit tests cover splits pretty well

Subscribers: matteobertozzi

Differential Revision: https://reviews.facebook.net/D29373
2014-11-24 09:58:43 -08:00
stack 336c22d581 HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99) under src/main/java
Move from HConnection to ClusterConnection or Connection
Use unmanaged connections where we use managed previous
(used the jdk7 https://docs.oracle.com/javase/7/docs/technotes/guides/language/try-with-resources.html idiom).

In ZKConfig, synchronize on Configuration rather than make a copy.
Making a copy we were dropping hbase configs in certain test context
(could not find the zk ensemble because default port).

In tests, some move to the new style connection setup but mostly
fixes for premature connection close or adding cleanup where it
was lacking.
2014-11-24 09:46:28 -08:00
tedyu 7ee4df600b HBASE-12554 TestBaseLoadBalancer may timeout due to lengthy rack lookup 2014-11-21 16:52:11 -08:00
Enis Soztutar 882324dbcc HBASE-10671 Add missing InterfaceAudience annotations for classes in hbase-common and hbase-client modules 2014-11-21 11:44:46 -08:00
tedyu 890c067b66 HBASE-12552 listSnapshots should list only owned snapshots for non-super user 2014-11-21 10:54:05 -08:00
Matteo Bertozzi 325cdc0987 HBASE-12073 Shell command user_permission fails on the table created by user if he is not global admin (Srikanth Srungarapu) 2014-11-21 10:55:48 +00:00
anoopsjohn 83f9f39e2a HBASE-12346 Scan's default auths behavior under Visibility labels.(Jerry He) 2014-11-21 13:29:42 +05:30
stack c5690b1be3 HBASE-12541 Add misc debug logging to hanging tests in TestHCM and TestBaseLoadBalancer 2014-11-20 17:54:39 -08:00
Enis Soztutar a16b4e0fd5 HBASE-12549 Fix TestAssignmentManagerOnCluster#testAssignRacingWithSSH() flaky test 2014-11-20 16:17:06 -08:00
Sean Busbey cd08f8b2be HBASE-12516 Clean up QA Bot warnings
Signed-off-by: stack <stack@apache.org>
2014-11-20 15:12:30 -08:00
tedyu d2ff1269f9 HBASE-11099 Two situations where we could open a region with smaller sequence number (Stephen Jiang) 2014-11-20 14:43:16 -08:00
tedyu 7eefd0cbed HBASE-12464 meta table region assignment stuck in the FAILED_OPEN state due to region server not fully ready to serve (Stephen Jiang) 2014-11-20 09:58:42 -08:00
Nick Dimiduk b6dd9b441f HBASE-12539 HFileLinkCleaner logs are uselessly noisy 2014-11-19 23:49:48 +01:00
Sean Busbey db2b6421ff HBASE-12535 NPE in WALFactory under contention for getInstance()
Signed-off-by: stack <stack@apache.org>
2014-11-19 14:39:46 -08:00
Matteo Bertozzi 05ced20a34 HBASE-12529 Use ThreadLocalRandom for RandomQueueBalancer 2014-11-19 16:50:29 +00:00
Matteo Bertozzi 3f95fe22e0 Patch up Jetty to disable SSLv3 (CVE-2014-3566) 2014-11-19 16:40:18 +00:00
stack 640274d5e1 HBASE-12532 TestFilter failing occasionally with ExitCodeException doing chmod since HBASE-10378 ADDENDUM 2014-11-18 23:41:35 -08:00
stack d87c550b94 HBASE-12532 TestFilter failing occasionally with ExitCodeException doing chmod since HBASE-10378 2014-11-18 21:54:48 -08:00
stack 1e77dd9f7a Revert "HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99)" ADDENDUM 2014-11-18 21:40:21 -08:00
stack 5f391efda1 Revert "HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99)"
This reverts commit d3e7c3cfa9.
2014-11-18 16:30:52 -08:00
Andrew Purtell 22f29ca8ef HBASE-12496 A blockedRequestsCount metric (Yi Deng) 2014-11-18 14:14:31 -08:00
Lars Hofhansl 822bcce91e HBASE-12411 Optionally enable p-reads and private readers for compactions. 2014-11-18 12:42:49 -08:00
stack b94e6738d9 HBASE-10378 Refactor write-ahead-log implementation -- ADDEDNUM 2014-11-18 12:12:35 -08:00
Sean Busbey f5e05eb836 HBASE-10378 Refactor write-ahead-log implementation
Incompatible changes called out in release notes on jira.

* Cleaned up references to HLog
* Deprecates HLogKey but maintains it for compatibility
  - Moves all Writeable from WALKey to HLogKey
* Adds utility code to CoprocessorHost to help with evolving Coprocessor APIs
* RSRpcServices roll WAL call now requests the non-meta LogRoller roll all logs
  - rolls actually happen asynchronously
  - deprecated old api (and noted incompatible behavior change)
  - modified api in new Admin interface to reflect lack of return values.
* Moved WAL user facing API to "WAL"
  - only 1 sync offered
  - WALTrailer removed from API
* make provider used by the WALFactory configurable.
* Move all WAL requests to use opaque ids instead of paths
* WALProvider provides API details for implementers and handles creation of WALs.
* Refactor WALActionsListener to have a basic implementation.
* turn MetricsWAL into a WALActionsListener.
* tests that needs FSHLog implementation details use them directly, others just reference provider + factory
  - Some tests moved from Large to Medium based on run time.
* pull out wal disabling into its own no-op class
* update region open to delegate to WALFactory
* update performance test tool to allow for multiple regions
* Removed references to meta-specific wals within wal code
  - replaced with generic suffixes
  - WALFactory maintains a dedicated WALProvider for meta (and so knows about the distinction)
* maintain backwards compat on HLogPrettyPrinter and mark it deprecated.
  - made WALPrettyPrinter IA.Private in favor of `bin/hbase wal`
* move WALUtil stuff that's implementation specific to said implementation
  - WALUtil now acts as an integration point between the RegionServer and hte WAL code.

Incorporates contributions from v.himanshu.

Signed-off-by: stack <stack@apache.org>
2014-11-18 12:04:41 -08:00
Enis Soztutar b97c3daf90 HBASE-12449 Use the max timestamp of current or old cell's timestamp in HRegion.append() 2014-11-18 11:34:49 -08:00
stack d3e7c3cfa9 HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99) 2014-11-18 09:48:54 -08:00
tedyu 0eb07609b6 HBASE-12337 Import tool fails with NullPointerException if clusterIds is not initialized 2014-11-18 09:18:25 -08:00
Nick Dimiduk 1276af23d5 HBASE-12459 Use a non-managed Table in mapred.TableOutputFormat 2014-11-17 08:36:08 +01:00
stack 0255fc2bf1 HBASE-12359 MulticastPublisher should specify IPv4/v6 protocol family when creating multicast channel (Qiang Tian) 2014-11-14 21:55:15 -08:00
tedyu 9583d14747 HBASE-12478 HBASE-10141 and MIN_VERSIONS are not compatible 2014-11-14 16:36:56 -08:00
Lars Hofhansl c29318c038 Revert "HBASE-12457 Regions in transition for a long time when CLOSE interleaves with a slow compaction."
This reverts commit 231d3ee2ad.
2014-11-13 09:18:21 -08:00
Lars Hofhansl 9d634772fa Revert "Amend HBASE-12457 Regions in transition for a long time when CLOSE interleaves with a slow compaction; Test import fix"
This reverts commit f6d8cde1e4.
2014-11-13 09:17:56 -08:00
Andrew Purtell f6d8cde1e4 Amend HBASE-12457 Regions in transition for a long time when CLOSE interleaves with a slow compaction; Test import fix 2014-11-13 08:09:41 -08:00
Lars Hofhansl 231d3ee2ad HBASE-12457 Regions in transition for a long time when CLOSE interleaves with a slow compaction. 2014-11-12 22:49:00 -08:00
Enis Soztutar f641aada36 HBASE-12445 hbase is removing all remaining cells immediately after the cell marked with marker = KeyValue.Type.DeleteColumn via PUT (Hani Nadra) 2014-11-12 15:50:10 -08:00
Matteo Bertozzi a376c8da9d HBASE-12366 Add login code to HBase Canary tool (Srikanth Srungarapu) 2014-11-12 20:34:55 +00:00
Andrew Purtell 210f5a3b01 Revert "HBASE-12454 Setting didPerformCompaction early in HRegion#compact"
This reverts commit b0a434a5ce.
2014-11-12 12:30:57 -08:00
Andrew Purtell 05c1663392 HBASE-12461 FSVisitor logging is excessive (Nick Dimiduk) 2014-11-12 10:23:54 -08:00
Andrew Purtell b0a434a5ce HBASE-12454 Setting didPerformCompaction early in HRegion#compact 2014-11-12 09:47:46 -08:00
stack fb6c5c7fe8 HBASE-10483 Provide API for retrieving info port when hbase.master.info.port is set to 0 (Liu Shaohui) 2014-11-12 08:56:42 -08:00
Esteban Gutierrez 8327f145c9 HBASE-12447 Add support for setTimeRange for RowCounter and CellCounter (addendum)
Signed-off-by: stack <stack@apache.org>
2014-11-11 15:44:56 -08:00
stack 804444f892 HBASE-12455 Add 'description' to bean and attribute output when you do /jmx?description=true 2014-11-11 12:59:43 -08:00
Esteban Gutierrez 6c2a299657 HBASE-12447 Add support for setTimeRange for RowCounter and CellCounter
Signed-off-by: stack <stack@apache.org>
2014-11-11 11:17:23 -08:00
Andrew Purtell 7657090ad9 HBASE-12448 Fix rate reporting in compaction progress DEBUG logging 2014-11-07 18:36:43 -08:00
Andrew Purtell 440767ff55 Reduce the effective scope of CREATE and ADMIN permissions 2014-11-07 11:53:25 -08:00
Andrew Purtell 7718390703 HBASE-12424 Finer grained logging and metrics for split transactions 2014-11-07 11:32:01 -08:00
Niels Basjes cc71d35112 Generate Thrift code using a maven profile
Signed-off-by: stack <stack@apache.org>
2014-11-06 10:27:59 -08:00
stack c71244c02d HBASE-12329 Table create with duplicate column family names quietly succeeds (Jingcheng Du) 2014-11-05 17:32:21 -08:00
stack b0eaa92f5b HBASE-8707 Add LongComparator for filter (Liu Shaohui) 2014-11-05 16:56:43 -08:00
Andrew Purtell e1b82fe91f HBASE-12389 Reduce the number of versions configured for the ACL table 2014-11-05 09:28:11 -08:00
Andrew Purtell 9255d6fdc7 HBASE-12420 BucketCache logged startup message is egregiously large 2014-11-05 09:22:00 -08:00
Andrew Purtell 48fd0369e5 HBASE-12344 Split up TestAdmin 2014-11-05 09:18:04 -08:00
Lars Hofhansl ecd708671c HBASE-12363 Improve how KEEP_DELETED_CELLS works with MIN_VERSIONS. 2014-11-04 17:08:39 -08:00
stack 3587fe8324 HBASE-12423 Use a non-managed Table in TableOutputFormat (Solomon Duskis) 2014-11-04 16:25:16 -08:00
Matteo Bertozzi 7442e5bd62 HBASE-12414 Move HFileLink.exists() to base class 2014-11-04 12:33:29 +00:00
tedyu ab927b8e1a HBASE-10780 HFilePrettyPrinter#processFile should return immediately if file does not exist (Ashish Singhi) 2014-11-03 20:31:40 -08:00
Enis Soztutar 71f73fcd0b HBASE-12402 ZKPermissionWatcher race condition in refreshing the cache leaving stale ACLs and causing AccessDenied 2014-11-03 20:09:55 -08:00
Ashish Singhi f7adec0548 HBASE-4625 Convert @deprecated HBaseTestCase tests JUnit4 style tests
Signed-off-by: stack <stack@apache.org>
2014-11-03 15:58:56 -08:00
Nick Dimiduk b5764a8e74 HBASE-12399 Master startup race between metrics and RpcServer 2014-11-01 10:45:45 -07:00
Adrian Muraru a1f59d8e1b Replication gets stuck following a transient zookeeper error to remote peer cluster
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2014-10-31 17:59:29 -07:00
Nick Dimiduk b784f7db99 HBASE-12401 Add some timestamp signposts in IntegrationTestMTTR 2014-10-31 17:21:20 -07:00
Nick Dimiduk f5d6314c87 HBASE-12335 IntegrationTestRegionReplicaPerf is flaky 2014-10-31 17:12:21 -07:00
Andrew Purtell a62f543c65 HBASE-12361 Show data locality of region in table page (Liu Shaohui) 2014-10-31 15:41:57 -07:00
Enis Soztutar 997c1adc2f HBASE-12390 Change revision style from svn to git 2014-10-31 11:10:38 -07:00
Ashish Singhi cacdb89e03 HBASE-10870 Deprecate and replace HCD methods that have a 'should' prefix with a 'is' instead
Signed-off-by: stack <stack@apache.org>
2014-10-31 08:34:00 -07:00
Esteban Gutierrez ba7344f5d1 HBASE-12219 Cache more efficiently getAll() and get() in FSTableDescriptors
Signed-off-by: stack <stack@apache.org>
2014-10-30 21:12:41 -07:00
Nick Dimiduk a71dd16a70 HBASE-9003 TableMapReduceUtil should not rely on org.apache.hadoop.util.JarFinder#getJar (Esteban Gutierrez)
Signed-off-by: stack <stack@apache.org>
2014-10-30 21:03:01 -07:00
Sean Busbey 646f1d5f8f HBASE-12388 Document behavior wrt coprocessors when wal gets empty waledits.
Signed-off-by: stack <stack@apache.org>
2014-10-30 19:32:12 -07:00
stack ff92346f5e HBASE-11819 Unit test for CoprocessorHConnection (Talat Uyarer) -- REVERT. Failed in a test run here: https://builds.apache.org/job/PreCommit-HBASE-Build/11530//testReport/ 2014-10-30 19:28:29 -07:00
stack a404db52ec HBASE-11819 Unit test for CoprocessorHConnection (Talat Uyarer) 2014-10-30 14:33:29 -07:00
Esteban Gutierrez 7886c0b82f TestRegionServerNoMaster#testMultipleOpen is flaky after HBASE-11760 2014-10-30 13:38:56 -07:00
stack 9f4b6ac06c HBASE-11835 Wrong managenement of non expected calls in the client (Nicolas Liochon) 2014-10-30 12:41:54 -07:00
Andrew Purtell f20fac41df HBASE-12384 TestTags can hang on fast test hosts 2014-10-30 10:45:02 -07:00
Ashish Singhi 87939889bb HBASE-12375 LoadIncrementalHFiles fails to load data in table when CF name starts with '_'
Signed-off-by: stack <stack@apache.org>
2014-10-30 09:16:37 -07:00
Matteo Bertozzi 8b84840d5a HBASE-12378 Add a test to verify that the read-replica is able to read after a compaction 2014-10-30 12:06:16 +00:00
stack d170088d98 HBASE-12336 RegionServer failed to shutdown for NodeFailoverWorker thread (Liu Shaohui) 2014-10-29 22:03:26 -07:00
stack 5062edebcf HBASE-12238 A few ugly exceptions on startup 2014-10-29 21:42:29 -07:00
stack fba164a1d1 HBASE-12355 Update maven plugins 2014-10-29 13:11:44 -07:00
stack 889333a6fd HBASE-12313 Redo the hfile index length optimization so cell-based rather than serialized KV key 2014-10-29 11:33:49 -07:00
stack 7cfafe401e HBASE-12354 Update dependencies in time for 1.0 release 2014-10-29 11:16:18 -07:00
stack b240b00f4f HBASE-12285 Builds are failing, possibly because of SUREFIRE-1091 ; ADDENDUM SETTING LOG LEVEL TO DEBUG AGAIN 2014-10-29 11:00:16 -07:00
anoopsjohn cbb334035d HBASE-12297 Support DBB usage in Bloom and HFileIndex area. 2014-10-29 14:39:03 +05:30
manukranthk ece933fa3e Implement Preemptive Fast Fail
Summary: This diff ports the Preemptive Fast Fail feature to OSS. In multi threaded clients, we use a feature developed on 0.89-fb branch called Preemptive Fast Fail. This allows the client threads which would potentially fail, fail fast. The idea behind this feature is that we allow, among the hundreds of client threads, one thread to try and establish connection with the regionserver and if that succeeds, we mark it as a live node again. Meanwhile, other threads which are trying to establish connection to the same server would ideally go into the timeouts which is effectively unfruitful. We can in those cases return appropriate exceptions to those clients instead of letting them retry.

Test Plan: Unit tests

Differential Revision: https://reviews.facebook.net/D24177

Signed-off-by: stack <stack@apache.org>
2014-10-28 22:47:50 -07:00
Dima Spivak 95282f2ea5 HBASE-12312 Another couple of createTable race conditions
Signed-off-by: stack <stack@apache.org>
2014-10-28 22:33:40 -07:00
stack 64b6109ce9 HBASE-11562 CopyTable should provide an option to shuffle the mapper tasks (Jean-Marc Spaggiari) 2014-10-28 11:28:54 -07:00
anoopsjohn f2f21000fb HBASE-12304 CellCounter will throw AIOBE when output directory is not specified. (Ashish Singhi) 2014-10-28 17:27:47 +05:30
stack aea2c67016 HBASE-12353 Turn down logging on some spewing unit tests (Dima Spivak) 2014-10-27 15:12:25 -07:00
Andrew Purtell 70a312e53f HBASE-11912 Catch some bad practices at compile time with error-prone 2014-10-27 09:29:23 -07:00
anoopsjohn 0fb4c4d5f0 HBASE-11870 Optimization : Avoid copy of key and value for tags addition in AC and VC. 2014-10-25 21:12:15 +05:30
Andrew Purtell ff5bc351b2 Revert "HBASE-11912 Catch some bad practices at compile time with error-prone"
This reverts commit 7ed0260eff.
2014-10-25 08:33:43 -07:00
Andrew Purtell 7ed0260eff HBASE-11912 Catch some bad practices at compile time with error-prone 2014-10-24 18:15:12 -07:00
Andrew Purtell 97acb9ef24 HBASE-11964 Improve spreading replication load from failed regionservers 2014-10-24 14:17:46 -07:00
stack 2916d4f356 HBASE-12277 Refactor bulkLoad methods in AccessController to its own interface (Madhan Neethiraj) 2014-10-24 08:47:06 -07:00
stack 31c185aad5 HBASE-12328 Need to separate JvmMetrics for Master and RegionServer (Sanghyun Yun) 2014-10-23 21:49:47 -07:00
stack 96f84594ee HBASE-11915 Document and test 0.94 -> 1.0.0 update -- ADDENDUM 2014-10-22 22:10:52 -07:00
Elliott Clark c623b04122 HBASE-12283 Clean up some checkstyle errors 2014-10-22 11:58:23 -07:00
Ted Yu 19108fb850 HBASE-12306 CellCounter output's wrong value for Total Families Across all Rows in output file (Ashish Singhi) 2014-10-22 14:30:53 +00:00
Matteo Bertozzi 2908c11371 HBASE-12301 user_permission command does not show global permissions 2014-10-22 10:08:31 +01:00
Dima Spivak f6de7efb27 HBASE-12285 Builds are failing, possibly because of SUREFIRE-1091
* Reduce the logging level to WARN

Signed-off-by: stack <stack@apache.org>
2014-10-21 22:02:00 -07:00
Yi Deng e545953c32 HBASE-12243 HBaseFsck should auto set ignorePreCheckPermission to true if no fix option is set (Yi Deng)
Signed-off-by: Jonathan M Hsieh <jmhsieh@apache.org>
2014-10-21 13:20:23 -07:00
Ted Yu 6c70f4f7f7 HBASE-12302 VisibilityClient getAuths does not propagate remote service exception correctly (Jerry He) 2014-10-21 20:09:46 +00:00
anoopsjohn c01d9981d8 HBASE-12202 Support DirectByteBuffer usage in HFileBlock. 2014-10-21 17:57:55 +05:30
stack c7f51db135 HBASE-12226 TestAccessController#testPermissionList failing on master (Srikranth Srungarapu) 2014-10-20 20:35:23 -07:00
stack 0ee33094ed HBASE-12278 Race condition in TestSecureLoadIncrementalHFilesSplitRecovery (Dima Spivak) 2014-10-20 11:08:45 -04:00
Ryan Rawson 451798cefb HBASE-12192 Remove EventHandlerListener 2014-10-18 14:27:04 -07:00
Matteo Bertozzi 49056295ef HBASE-12161 Add support for grant/revoke on namespaces in AccessControlClient (Srikanth Srungarapu) 2014-10-18 21:18:42 +01:00
manukranthk 5c92bded9d Add admin endpoint for updating the configuration on the regionserver
Summary: This is a follow up diff for the jira to add the functionality to update configs in an online fashion.

Test Plan: Unit test. This adds an end point on the regionserver. It just tries to call the end point and make sure the call succeeds.

Differential Revision: https://reviews.facebook.net/D24861

Signed-off-by: stack <stack@apache.org>
2014-10-18 16:16:21 -04:00
Dima Spivak 7e995b6496 HBASE-12229 NullPointerException in SnapshotTestingUtils
* Implemented the waitUntilAllRegionsOnline in HBaseTestingUtility#createTable
* Add waitFor around #isTableAvailable call that previously didn't do anything
* Remove unused byte[] hex

Signed-off-by: stack <stack@apache.org>
2014-10-17 22:50:10 -04:00
Ted Yu 349a56ae2c HBASE-12263 RegionServer listens on localhost in distributed cluster when DNS is unavailable (Shaohui) 2014-10-17 20:52:55 +00:00
Ted Yu 728fc543ea HBASE-12264 ImportTsv should fail fast if output is not specified and table does not exist (Ashish) 2014-10-17 20:45:44 +00:00
Ted Yu 686e77108a HBASE-12274 Race between RegionScannerImpl#nextInternal() and RegionScannerImpl#close() may produce null pointer exception 2014-10-17 16:05:31 +00:00
Patrick White ba20d4df8c HBASE-12271 Add counters for files skipped during snapshot export
Add counters for skipped files

Signed-off-by: Elliott Clark <eclark@apache.org>
2014-10-15 10:41:48 -07:00
manukranthk f9c534bac3 HBASE-12258 TestHbaseFsck is flaky and has some multithreading issues
Signed-off-by: Elliott Clark <eclark@apache.org>
2014-10-14 17:36:31 -07:00
stack 3544f4e98b HBASE-12247 Replace setHTable() with initializeTable() in TableInputFormat. (Solomon Duskis) 2014-10-14 14:11:21 -07:00
manukranthk 962065de72 Online config change
Summary: This diff is intended to forward port HBASE-8805 and HBASE-8544 implemented by Gaurav Menghani in 89-fb. This improves operational efficiency in managing clusters that are serving production traffic. The idea is to have a central configuration which can manage notifying the configuration observers. The observers in turn should update their local state from the latest config. Minor caveats where configuration variables are corelated should be taken care of with additional care.

Test Plan: Unit tests

Differential Revision: https://reviews.facebook.net/D24681

Signed-off-by: stack <stack@apache.org>
2014-10-13 21:23:12 -07:00
Rajeshbabu Chintaguntla 6dea02b260 HBASE-10200 Better error message when HttpServer fails to start due to java.net.BindException(Kiran Kumar M R) 2014-10-14 02:24:21 +00:00
stack 9a893a9c6a HBASE-12029 Use Table and RegionLocator in HTable.getRegionLocations() (Solomon Duskis) 2014-10-13 12:24:27 -07:00
stack b30d2f315d HBASE-12242 Fix new javadoc warnings in Admin, etc. 2014-10-13 12:07:50 -07:00
stack 8e9a8b002f HBASE-8361 Bulk load and other utilities should not create tables for user (Ashish Singhi) 2014-10-12 21:52:01 -07:00
Elliott Clark ab42b9ffe6 HBASE-12234 Make TestMultithreadedTableMapper a little more stable.
Signed-off-by: stack <stack@apache.org>
2014-10-12 18:37:47 -07:00
Enis Soztutar e3f9957830 HBASE-12176 WALCellCodec Encoders support for non-KeyValue Cells (Anoop Sam John) 2014-10-11 15:32:18 -07:00
Andrew Purtell 8ee55fb339 HBASE-12126 Region server coprocessor endpoint (Virag Kothari) 2014-10-10 12:00:51 -07:00
stack 65ae2e5126 HBASE-11394 Replication can have data loss if peer id contains hyphen "-" 2014-10-10 10:28:16 -07:00
Ramkrishna 3f2e599a99 HBASE-12210 Avoid KeyValue in Prefix Tree (Ram) 2014-10-10 22:45:26 +05:30
Elliott Clark 6ddb2f1965 HBASE-12197 Move rest to it's on module
Summary:
Move hbase-rest to it's own module.
copy test resources from hbase-server into hbase-rest's test resources.

Test Plan: Unit tests pass of hbase-rest module.

Differential Revision: https://reviews.facebook.net/D24657
2014-10-10 09:51:09 -07:00
stack 06a8bb5bd1 HBASE-12189 Fix new issues found by coverity static analysis 2014-10-09 20:51:04 -07:00
stack 8915130dd7 HBASE-12212 HBaseTestingUtility#waitUntilAllRegionsAssigned should wait for RegionStates
Signed-off-by: stack <stack@apache.org>
2014-10-09 20:34:58 -07:00
Nick Dimiduk 712dad814c HBASE-12183 FuzzyRowFilter doesn't support reverse scans 2014-10-09 18:27:22 -07:00
stack 5420b4c78b HBASE-12142 Truncate command does not preserve ACLs table (Vandana Ayyalasomayajula) 2014-10-09 15:35:36 -07:00
stack d5be58dfd2 Add hedgedReads and hedgedReadWins count metrics 2014-10-09 15:00:25 -07:00
Jimmy Xiang 72c8c62aa1 HBASE-12216 Lower closed region logging level 2014-10-09 14:00:24 -07:00
stack 0eb0721fef HBASE-11990 Make setting the start and stop row for a specific prefix easier (Niels Basjes) 2014-10-09 11:13:52 -07:00
Ted Yu 3d84ccbf9c HBASE-12109 user_permission command for namespace does not return correct result (Vandana Ayyalasomayajula) 2014-10-09 17:45:02 +00:00
Yi Deng 3c1fbd2ddf HBASE-12198 Fix the bug of not updating location cache
Summary:  # Clear the cache of the server when failed

Test Plan: Add testcase `TestHTableMultiplexerFlushCache` to reproduce the bug.

Differential Revision: https://reviews.facebook.net/D24603

Signed-off-by: Elliott Clark <elliott@fb.com>
Signed-off-by: Elliott Clark <eclark@apache.org>
2014-10-09 10:09:03 -07:00
Jimmy Xiang 2c07372c2f HBASE-12209 NPE in HRegionServer#getLastSequenceId 2014-10-08 20:40:45 -07:00
Enis Soztutar 922ced0d08 HBASE-12200 When a Rpc server handler thread dies, throws exception (Alicia Ying Shu) 2014-10-08 17:49:01 -07:00
Jimmy Xiang 7aa3a2d890 HBASE-12206 NPE in RSRpcServices 2014-10-08 17:45:43 -07:00
stack 652b81ab1e HBASE-12181 Some tests create a table and try to use it before regions get assigned (Dima Spivak) 2014-10-08 17:24:09 -07:00
manukranthk e31286bf62 Fix failures caused by Jacoco syncthetic methods
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2014-10-08 12:05:14 -07:00
manukranthk e952e73624 HBASE-12199 Make TestAtomicOperation and TestEncodedSeekers faster
Signed-off-by: Elliott Clark <eclark@apache.org>
2014-10-08 08:46:29 -07:00
Jimmy Xiang f2fc311b19 HBASE-12196 SSH should retry in case failed to assign regions 2014-10-07 20:23:32 -07:00
Ted Yu a8be606145 HBASE-12016 Reduce number of versions in Meta table. Make it configurable (Andrey Stepachev) 2014-10-07 21:07:52 +00:00
stack 7546f9a4d9 HBASE-12191 Make TestCacheOnWrite faster. 2014-10-07 13:14:23 -07:00
Ted Yu e1b69bd548 HBASE-11997 CopyTable with bulkload (Yi Deng) 2014-10-07 19:34:31 +00:00
Andrew Purtell 3557a32352 HBASE-12106 Move test annotations to test artifact (Enis Soztutar) 2014-10-06 23:16:22 -07:00
Ramkrishna eb6f196395 HBASE-11815 Flush and compaction could just close the tmp writer if there
is an exception
2014-10-07 09:40:34 +05:30
Jimmy Xiang 8c3697b0d8 HBASE-12184 ServerShutdownHandler throws NPE 2014-10-06 17:28:39 -07:00
stack 062adcc188 HBASE-11890 HBase REST Client is hard coded to http protocol 2014-10-06 13:44:43 -07:00
stack 5f6a055bb6 HBASE-12172 Disable flakey TestRegionReplicaReplicationEndpoint and make fixing it a blocker on 1.0 2014-10-06 10:20:44 -07:00
Ted Yu 8a50a0cce7 HBASE-12011 Add namespace column during display of user tables (Srikanth Srungarapu) 2014-10-06 16:45:33 +00:00
stack 202bc2934a HBASE-12148 RegionServerTracker should escape data in log messages 2014-10-03 19:24:46 -07:00
Ted Yu 7972ae764b HBASE-12137 Alter table add cf doesn't do compression test (Virag Kothari) 2014-10-04 00:40:22 +00:00
Jimmy Xiang ef35182f1f HBASE-12166 TestDistributedLogSplitting.testMasterStartsUpWithLogReplayWork 2014-10-03 17:18:12 -07:00
stack 3acdf06827 HBASE-12170 TestReplicaWithCluster.testReplicaAndReplication timeouts 2014-10-03 17:06:49 -07:00
Andrew Purtell 0c0d7eb241 Amend HBASE-12156 TableName cache isn't used for one of valueOf methods; make TestTableName a medium test 2014-10-03 16:58:19 -07:00
Jimmy Xiang dbef2bdafe HBASE-12167 addendum; fix TestMasterObserver 2014-10-03 15:02:41 -07:00
Jimmy Xiang 5375ff07bc HBASE-12167 NPE in AssignmentManager 2014-10-03 11:41:18 -07:00
Andrew Purtell d8a7b67d79 HBASE-11907 Use the joni byte[] regex engine in place of j.u.regex 2014-10-02 23:06:32 -07:00
stack da9f2434b2 HBASE-12165 TestEndToEndSplitTransaction.testFromClientSideWhileSplitting fails -- DEBUGGING STRINGS 2014-10-02 21:10:45 -07:00
Ted Yu a17614d5b2 HBASE-12164 Check for presence of user Id in SecureBulkLoadEndpoint#secureBulkLoadHFiles() is inaccurate 2014-10-03 03:53:58 +00:00
Ted Yu 8dbf7b2238 HBASE-10153 improve VerifyReplication to compute BADROWS more accurately (Jianwei) 2014-10-03 03:29:45 +00:00
Jimmy Xiang a463aef8bc HBASE-12122 Try not to assign user regions to master all the time 2014-10-02 13:30:55 -07:00
stack 546f436a41 HBASE-12152 TestLoadIncrementalHFiles shows up as zombie test; ADD TIMEOUT ON TESTS -- Up timeout from 120 to 120000 2014-10-02 13:18:08 -07:00
stack 8ac42d4b40 HBASE-12148 Remove TimeRangeTracker as point of contention when many threads writing a Store 2014-10-02 12:39:33 -07:00
stack 129b93bc0e HBASE-12148 Remove TimeRangeTracker as point of contention when many threads writing a Store 2014-10-02 12:30:31 -07:00
stack 630a66f1d3 HBASE-12149 TestRegionPlacement is failing undeterministically (Manukranth Kolloju) 2014-10-02 11:29:44 -07:00
stack 6f104e3ac6 HBASE-12158 TestHttpServerLifecycle.testStartedServerWithRequestLog goes zombie on occasion 2014-10-02 11:03:45 -07:00
stack e92036cd54 HBASE-12152 TestLoadIncrementalHFiles shows up as zombie test; ADD TIMEOUT ON TESTS 2014-10-02 09:58:03 -07:00
stack ff847978ad HBASE-12156 TableName cache doesn't used for once of valueOf methods (Andrey Stepachev) 2014-10-02 09:45:57 -07:00
stack 2c8f6b66cf HBASE-12153 Fixing TestReplicaWithCluster (Manukranth Kolloju) 2014-10-02 09:22:48 -07:00
stack 43301167db HBASE-12145 Fix javadoc and findbugs so new folks aren't freaked when they see them
Fix javadoc warnings.

Fixup findbugs warnings mostly by adding annotations saying 'working as expected'.

In RpcRetryingCallerWithReadReplicas made following change which findbugs spotted:

-        if (completed == null) tasks.wait();
+        while (completed == null) tasks.wait();

In RecoverableZooKeeper, made all zk accesses synchronized -- we were doing it
half-ways previously.

In RatioBasedCompactionPolicy we were making an instance of Random on
each invocation of getNextMajorCompactionTime
2014-10-01 16:37:13 -07:00
Andrew Purtell c88a6c93ad HBASE-12065 Import tool is not restoring multiple DeleteFamily markers of a row (Maddineni Sukumar) 2014-10-01 14:53:03 -07:00
stack 0d45272e40 HBASE-12130 HBASE-11980 calls hflush and hsync doing near double the syncing work 2014-10-01 14:11:48 -07:00
Elliott Clark eb385abfae HBASE-12139 StochasticLoadBalancer doesn't work on large lightly loaded clusters
Summary:
Currently the move cost overshadows the skew cost on a large cluster. This can render the split policy worse than useless
and it can trap meta on the most loaded server in the cluster.

Test Plan:
Unit tests everywhere
likeaboss

Reviewers: stack, manukranthk

Subscribers: tedyu

Differential Revision: https://reviews.facebook.net/D24285
2014-10-01 13:01:09 -07:00
Ted Yu 1587068a2c HBASE-12095 SecureWALCellCodec should handle the case where encryption is disabled 2014-10-01 14:22:18 +00:00
anoopsjohn 4fac4c1ba6 HBASE-12112 Avoid KeyValueUtil#ensureKeyValue some more simple cases. 2014-10-01 14:05:57 +05:30
stack ff31691c84 HBASE-11879 Change TableInputFormatBase to take interface arguments (Solomon Duskis) 2014-09-30 21:25:04 -07:00
Nick Dimiduk 7a064f96ba HBASE-12123 Failed assertion in BucketCache after 11331 2014-09-30 17:00:52 -07:00
stack b5783795cd HBASE-12038 Replace internal uses of signatures with byte[] and String tableNames to use the TableName equivalents (Solomon Duskis) 2014-09-30 16:35:55 -07:00
Jimmy Xiang c4107d5307 HBASE-12119 Master regionserver web UI NOT_FOUND 2014-09-30 14:42:32 -07:00
manukranthk 0075528615 HBASE-12115 Fix TableInputFormatBase.reverseDNS for ipv6 addresses
Summary: Hadoop's DNS.reverDns function cannot handle Inet6Address properly and throws Runtime Exceptions.

Test Plan: Added Unit test to test the particular case.

Differential Revision: https://reviews.facebook.net/D24225

Signed-off-by: Elliott Clark <eclark@apache.org>
2014-09-30 13:27:34 -07:00
Enis Soztutar e241d9dd81 HBASE-12099 TestScannerModel fails if using jackson 1.9.13 (Esteban Gutierrez) 2014-09-30 11:33:58 -07:00
Nick Dimiduk 26dcd96b60 HBASE-11178 Remove deprecation annotations from mapred namespace
Our parent project is not dropping its legacy API, so neither shall we. Remove
the deprecation annotations from that implementation.
2014-09-30 11:21:10 -07:00
Matteo Bertozzi 321a6085fb HBASE-12098 User granted namespace table create permissions can't create a table (Srikanth Srungarapu) 2014-09-30 19:10:00 +01:00
stack 8d1a87fabc HBASE-12096 In ZKSplitLog Coordination and AggregateImplementation replace enhaced for statements with basic for statement to avoid unnecessary object allocation 2014-09-30 08:10:42 -07:00
stack aa432fd68f HBASE-11980 Change sync to hsync, remove unused InfoServer, and reference our httpserver instead of hadoops 2014-09-29 22:28:28 -07:00
Enis Soztutar 6189b52fb0 HBASE-12042 Replace internal uses of HTable(Configuration, String) with HTable(Configuration, TableName) (Solomon Duskis) 2014-09-29 18:39:44 -07:00
Jimmy Xiang 683f3b3d50 HBASE-12034 If I kill single RS in branch-1, all regions end up on Master! 2014-09-29 13:50:59 -07:00
Nick Dimiduk 8ed4ee2225 HBASE-12003 Fix SecureBulkLoadEndpoint class javadoc formatting 2014-09-29 13:14:09 -07:00
anoopsjohn df2ce0c389 HBASE-12082 Find a way to set timestamp on Cells on the server. 2014-09-29 11:22:12 +05:30
Jeffrey Zhong 4e56a19cf1 HBASE-12052: BulkLoad Failed due to no write permission on input files - Addendum 2014-09-26 17:51:29 -07:00
Jeffrey Zhong 8ee39f1971 HBASE-12052: BulkLoad Failed due to no write permission on input files 2014-09-26 14:48:51 -07:00
Enis Soztutar 3beb168b4f HBASE-11995 Use Connection and ConnectionFactory where possible (Solomon Duskis) 2014-09-26 11:49:37 -07:00
David Deng 78d532e5f3 HBASE-12086 Fix bug of HTableMultipliexer
Signed-off-by: Elliott Clark <eclark@apache.org>
2014-09-25 11:30:29 -07:00
stack 31ed817447 HBASE-12069 Finish making HFile.Writer Cell-centric; undo APIs that expect KV serializations 2014-09-25 10:49:09 -07:00
Ramkrishna 44a27c5cd7 HBASE-11920 Add CP hooks for ReplicationEndPoint 2014-09-25 22:11:28 +05:30
anoopsjohn a2e05b9f8f HBASE-12050 Avoid KeyValueUtil#ensureKeyValue from DefaultMemStore. 2014-09-25 17:41:19 +05:30
anoopsjohn 1b5e6daef2 HBASE-12084 Remove deprecated APIs from Result. 2014-09-25 07:36:15 +05:30
Andrew Purtell 011bc04416 HBASE-11796 Add client support for atomic checkAndMutate (Srikanth Srungarapu) 2014-09-24 15:07:38 -07:00
Matteo Bertozzi 9152d8677e HBASE-12054 bad state after NamespaceUpgrade with reserved table names 2014-09-24 19:39:52 +01:00
Elliott Clark 46eada6e02 HBASE-12076 Move InterfaceAudience imports to hbase-annotations 2014-09-24 04:10:19 -07:00
Elliott Clark 0a28af366b HBASE-12076 Move InterfaceAudience imports to hbase-annotations 2014-09-24 03:57:55 -07:00
Enis Soztutar c316257671 HBASE-12056 RPC logging too much in DEBUG mode 2014-09-23 19:53:57 -07:00
Elliott Clark a5bd931682 HBASE-12059 Create hbase-annotations module 2014-09-23 16:44:14 -07:00
Andrew Purtell 83c2de2575 Amend HBASE-12023 HRegion.applyFamilyMapToMemstore creates too many iterator objects; More cases (Vladimir Rodionov) 2014-09-23 13:14:16 -07:00
Andrew Purtell e06b4bcf35 HBASE-12064 hbase.master.balancer.stochastic.numRegionLoadsToRemember is not used (Junegunn Choi) 2014-09-23 12:36:34 -07:00
Elliott Clark d94f24b901 HBASE-12067 Remove deprecated metrics classes. 2014-09-23 11:40:16 -07:00
anoopsjohn 564b3d8bc2 HBASE-12048 Remove deprecated APIs from Filter. 2014-09-23 23:07:38 +05:30
Elliott Clark 2635791027 HBASE-12062 Fix usage of Collections.toArray 2014-09-23 09:58:24 -07:00
anoopsjohn 791a03b40f HBASE-12047 Avoid usage of KeyValueUtil#ensureKeyValue in simple cases. 2014-09-23 16:42:01 +05:30
Andrew Purtell 411991cf1d HBASE-12045 REST proxy users configuration in hbase-site.xml is ignored (Aditya Kishore) 2014-09-22 17:37:19 -07:00
Andrew Purtell 0153a353b2 HBASE-12044 REST delete operation should not retry disableTable for DoNotRetryIOException (Aditya Kishore) 2014-09-22 17:37:19 -07:00
Andrew Purtell e925348979 HBASE-12043 REST server should respond with FORBIDDEN(403) code on AccessDeniedException (Aditya Kishore) 2014-09-22 17:37:19 -07:00