Commit Graph

3290 Commits

Author SHA1 Message Date
Enis Soztutar 87e4414004 HBASE-12647 Truncate table should work with C as well 2014-12-07 20:57:04 -08:00
Devaraj Das 9fd6db3703 HBASE-11903. Directly invoking split & merge of replica regions should be disallowed 2014-12-07 11:56:53 -08:00
Andrew Purtell bb15fd5fe0 HBASE-12606 Sanity check encryption configuration before opening WAL or onlining regions
Also disables IntegrationTestIngestWithEncryption if distributed
cluster configuration is missing prerequisites.
2014-12-06 21:46:43 -08:00
Devaraj Das ca0c1774c9 HBASE-12548. Improve debuggability of IntegrationTestTimeBoundedRequestsWithRegionReplicas 2014-12-06 18:18:03 -08:00
tedyu 415ad6b686 HBASE-12642 LoadIncrementalHFiles does not throw exception after hitting hbase.bulkload.retries.number setting 2014-12-05 18:39:58 -08:00
Gary Helmling 1ec6609b97 HBASE-12493 Make User and TokenUtil public 2014-12-05 13:04:54 -08:00
Andrew Purtell 09cd3d7bfb HBASE-10560 Per cell TTLs 2014-12-05 11:10:26 -08:00
Keith Winkler f83e25e180 HBASE-12565 Race condition in HRegion.batchMutate() causes partial data to be written when region closes
Signed-off-by: stack <stack@apache.org>
2014-12-05 10:17:34 -08:00
Matteo Bertozzi c8362a7bb2 HBASE-12622 user_permission should require global admin to display global and ns permissions 2014-12-05 10:45:30 +00:00
Enis Soztutar 08754f2c43 HBASE-12637 Compilation with Hadoop-2.4- is broken 2014-12-04 18:14:59 -08:00
Andrew Purtell e690a83d41 HBASE-12635 Delete acl notify znode of table after the table is deleted (Liu Shaohui) 2014-12-04 16:43:33 -08:00
Ashish Singhi 04444299ab HBASE-12634 Fix the AccessController#requireGlobalPermission(ns) with NS
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2014-12-04 14:12:26 +00:00
stack 52e35b4473 Add timeout on TestDefaultLoadBalancer#testBalancerCluster to see if we can stop it hanging as a zombie in precommit builds 2014-12-03 11:13:36 -08:00
Sean Busbey c5c395b68a HBASE-12623 removes unused code to upgrade from pre-0.96 to 0.96.
Removes both insertion of namespaces and migration of zookeeper data to protobufs.
2014-12-03 13:13:12 -06:00
stack d6b1d8cbf7 HBASE-12617 Running IntegrationTestBigLinkedList against cluster getting not an instance of org.apache.hadoop.hbase.MiniHBaseCluster 2014-12-03 10:37:32 -08:00
Ramkrishna 3db5e20834 HBASE-11639 - [Visibility controller] Replicate the visibility of Cells as
strings- Addendum adding break (Ram)
2014-12-03 10:18:27 +05:30
tedyu a8a134374e HBASE-12614 Potentially unclosed StoreFile(s) in DefaultCompactor#compact() 2014-12-02 19:31:21 -08:00
stack 54f438cee4 HBASE-12616 We lost the linked list commands in recent usage refactoring 2014-12-02 14:15:04 -08:00
stack 7a3396f0e1 HBASE-12490 Replace uses of setAutoFlush(boolean, boolean) (Solomon Duskis) 2014-12-02 10:06:21 -08:00
stack 1a9b556474 Revert "HBASE-12558 TestHCM.testClusterStatus Unexpected exception, expected<org.apache.hadoop.hbase.regionserver.RegionServerStoppedException> but was<junit.framework.AssertionFailedError> -- ADDED DEBUG"
This reverts commit 8b8f2026bd.

Overcommit. Added "HBASE-12490 Replace uses of setAutoFlush(boolean,
boolean)" by mistake

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ClusterStatusListener.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTable.java
2014-12-02 09:51:19 -08:00
Elliott Clark 29ee0cb0e1 HBASE-12576 Add metrics for rolling the HLog if there are too few DN's in the write pipeline 2014-12-02 09:30:52 -08:00
stack 7b10847ec8 HBASE-12610 Close connection in TableInputFormatBase (Solomon Duskis) 2014-12-02 09:28:02 -08:00
tedyu 5cc0714840 HBASE-12559 Addendum fixes findbugs warnings 2014-12-02 04:43:34 -08:00
Enis Soztutar 94d57f81dc HBASE-12537 HBase should log the remote host on replication error (Stack) 2014-12-01 20:10:20 -08:00
tedyu a30cca91e0 HBASE-12559 Provide LoadBalancer with online configuration capability 2014-12-01 14:11:01 -08:00
Jeffrey Zhong 2c280e6253 HBASE-12600: Remove REPLAY tag dependency in Distributed Replay Mode 2014-12-01 11:19:47 -08:00
Jeffrey Zhong 0733450473 Revert "Remove Replay Tag"
This reverts commit f723ffde7f.
2014-12-01 11:17:24 -08:00
Jeffrey Zhong f723ffde7f Remove Replay Tag 2014-12-01 10:59:47 -08:00
tedyu 2fbbdfd9a1 HBASE-12559 Revert for addressing review comments 2014-12-01 10:38:05 -08:00
stack 308db3a5c8 HBASE-12520 Add protected getters on TableInputFormatBase (Solomon Duskis) 2014-12-01 10:20:37 -08:00
stack 69a437ac0d HBASE-12514 Cleanup HFileOutputFormat legacy code (Solomon Duskis)
Signed-off-by: stack <stack@apache.org>
2014-12-01 10:15:51 -08:00
stack 56a03d736a HBASE-12603 Remove javadoc warnings introduced due to removal of unused imports (Varun Saxena) 2014-12-01 10:13:16 -08:00
Ramkrishna b6b88edf93 HBASE-11639 [Visibility controller] Replicate the visibility of Cells as
strings (Ram)
2014-12-01 23:03:52 +05:30
tedyu 41041e8d6a HBASE-12559 Provide LoadBalancer with online configuration capability 2014-12-01 07:30:17 -08:00
stack b94b0e9ca7 HBASE-12491 TableMapReduceUtil.findContainingJar() NPE 2014-11-29 09:34:00 -08:00
stack 555e78005d HBASE-12526 Remove unused imports (Varun Saxena) 2014-11-29 09:20:46 -08:00
stack 58b6b24c29 HBASE-12519 Remove tabs used as whitespace (Varun Saxena) 2014-11-28 20:50:02 -08:00
stack eb4c194a87 HBASE-10536 ImportTsv should fail fast if any of the column family passed to the job is not present in the table (denny joesph) 2014-11-28 20:42:24 -08:00
stack 0f8894cd64 HBASE-12581 TestCellACLWithMultipleVersions failing since task 5 HBASE-12404 (HBASE-12404 addendum) -- SLEEP ADDENDUM 2014-11-27 05:28:55 -08:00
stack aa0bd50fd4 HBASE-12558 TestHCM.testClusterStatus Unexpected exception, expected<org.apache.hadoop.hbase.regionserver.RegionServerStoppedException> but was<junit.framework.AssertionFailedError> -- DISABLING FAILING TEST 2014-11-26 22:22:35 -08:00
Jeffrey Zhong f0d95e7f11 HBASE-12533: staging directories are not deleted after secure bulk load 2014-11-26 16:23:11 -08:00
Jeffrey Zhong b2cdeacc8c HBASE-12053: SecurityBulkLoadEndPoint set 777 permission on input data files 2014-11-26 16:19:22 -08:00
stack 595d2a846c HBASE-12589 Forward-port fix for TestFromClientSideWithCoprocessor.testMaxKeyValueSize 2014-11-26 14:43:32 -08:00
stack 1c0a06193e HBASE-12587 TestReplicationTrackerZKImpl.testPeerRemovedEvent timedout 2014-11-26 12:53:54 -08:00
Enis Soztutar 02963b202a HBASE-12072 Standardize retry handling for master operations 2014-11-26 12:09:44 -08:00
stack d1f39d8246 Revert "HBASE-12563 After Starting up mini hbase cluster, Real Configuration of Cluster never set to HBaseTestingUtility (Talat UYARER)"
Causes TestZooKeeper to fail.  Reverting.

This reverts commit 9be143691c.
2014-11-26 10:23:49 -08:00
stack b719e7a8c6 HBASE-12518 Task 4 polish. Remove CM#{get,delete}Connection
Remove deleteConnection from everywhere except the two tests that ensure
it does the right thing and from HCM and CM themselves.

Undoes deleteConnection from tests and from the web ui
2014-11-26 08:11:41 -08:00
stack 9be143691c HBASE-12563 After Starting up mini hbase cluster, Real Configuration of Cluster never set to HBaseTestingUtility (Talat UYARER) 2014-11-26 07:59:26 -08:00
stack 1350055fcd HBASE-12581 TestCellACLWithMultipleVersions failing since task 5 HBASE-12404 (HBASE-12404 addendum) 2014-11-26 07:53:35 -08:00
Matteo Bertozzi c57bc08082 HBASE-12474 Incorrect handling of default namespace in user_permission command (Srikanth Srungarapu) 2014-11-26 12:29:38 +00:00
stack 8b8f2026bd HBASE-12558 TestHCM.testClusterStatus Unexpected exception, expected<org.apache.hadoop.hbase.regionserver.RegionServerStoppedException> but was<junit.framework.AssertionFailedError> -- ADDED DEBUG 2014-11-25 21:21:50 -08:00
stack 24f19328eb HBASE-12581 TestCellACLWithMultipleVersions failing since task 5 HBASE-12404 (HBASE-12404 addendum) 2014-11-25 16:29:53 -08:00
stack e6b4300756 HBASE-12404 Task 5 from parent: Replace internal HTable constructor use with
HConnection#getTable (0.98, 0.99)

Replaced HTable under hbase-*/src/main/java. Skipped tests. Would take
till end of time to do all and some cases are cryptic. Also skipped
some mapreduce where HTable comes through in API. Can do both of
these stragglers in another issue.
Generally, if a utility class or standalone class, tried to pass in a
Connection rather than have the utility or standalone create its own
connection on each invocation; e.g. the Quota stuff. Where not possible,
noted where invocation comes from... if test or hbck, didn't worry about
it.
Some classes are just standalone and nothing to be done to avoid
a Connection setup per invocation (this is probably how it worked
in the new HTable...days anyways). Some classes are not used:
AggregationClient, FavoredNodes... we should just purge this stuff.
Doc on what short circuit connection does (I can just use it...
I thought it was just for short circuit but no, it switches dependent
on where you are connecting).
Changed HConnection to super Interface ClusterConnection where safe (
internal usage by private classes only).
Doc cleanup in example usage so we do new mode rather than the old
fashion.
Used java7 idiom that allows you avoid writing out finally to call close
on implementations of Closeable.
Added a RegistryFactory.. moved it out from being inner class.
Added a utility createGetClosestRowOrBeforeReverseScan method to Scan
to create a Scan that can ...
Renamed getShortCircuitConnection as getConnection – users don't need
to know what implementation does (that it can short-circuit RPC).
The old name gave pause. I was frightened to use it thinking it only
for short-circuit reading – that it would not do remote too.
Squashed commit of the following:
2014-11-25 08:15:20 -08:00
Elliott Clark e83082a888 HBASE-12550 ADDENDUM Make HRegion's api not change. 2014-11-24 16:11:48 -08:00
Elliott Clark 0df5ed2ca6 HBASE-12550 Check all storefiles are referenced before splitting
Summary: If there are bugs in HDFS move and/or create we should protect against them by making sure that all files referenced end up in split daughters.

Test Plan: Unit tests cover splits pretty well

Subscribers: matteobertozzi

Differential Revision: https://reviews.facebook.net/D29373
2014-11-24 09:58:43 -08:00
stack 336c22d581 HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99) under src/main/java
Move from HConnection to ClusterConnection or Connection
Use unmanaged connections where we use managed previous
(used the jdk7 https://docs.oracle.com/javase/7/docs/technotes/guides/language/try-with-resources.html idiom).

In ZKConfig, synchronize on Configuration rather than make a copy.
Making a copy we were dropping hbase configs in certain test context
(could not find the zk ensemble because default port).

In tests, some move to the new style connection setup but mostly
fixes for premature connection close or adding cleanup where it
was lacking.
2014-11-24 09:46:28 -08:00
tedyu 7ee4df600b HBASE-12554 TestBaseLoadBalancer may timeout due to lengthy rack lookup 2014-11-21 16:52:11 -08:00
Enis Soztutar 882324dbcc HBASE-10671 Add missing InterfaceAudience annotations for classes in hbase-common and hbase-client modules 2014-11-21 11:44:46 -08:00
tedyu 890c067b66 HBASE-12552 listSnapshots should list only owned snapshots for non-super user 2014-11-21 10:54:05 -08:00
Matteo Bertozzi 325cdc0987 HBASE-12073 Shell command user_permission fails on the table created by user if he is not global admin (Srikanth Srungarapu) 2014-11-21 10:55:48 +00:00
anoopsjohn 83f9f39e2a HBASE-12346 Scan's default auths behavior under Visibility labels.(Jerry He) 2014-11-21 13:29:42 +05:30
stack c5690b1be3 HBASE-12541 Add misc debug logging to hanging tests in TestHCM and TestBaseLoadBalancer 2014-11-20 17:54:39 -08:00
Enis Soztutar a16b4e0fd5 HBASE-12549 Fix TestAssignmentManagerOnCluster#testAssignRacingWithSSH() flaky test 2014-11-20 16:17:06 -08:00
Sean Busbey cd08f8b2be HBASE-12516 Clean up QA Bot warnings
Signed-off-by: stack <stack@apache.org>
2014-11-20 15:12:30 -08:00
tedyu d2ff1269f9 HBASE-11099 Two situations where we could open a region with smaller sequence number (Stephen Jiang) 2014-11-20 14:43:16 -08:00
tedyu 7eefd0cbed HBASE-12464 meta table region assignment stuck in the FAILED_OPEN state due to region server not fully ready to serve (Stephen Jiang) 2014-11-20 09:58:42 -08:00
Nick Dimiduk b6dd9b441f HBASE-12539 HFileLinkCleaner logs are uselessly noisy 2014-11-19 23:49:48 +01:00
Sean Busbey db2b6421ff HBASE-12535 NPE in WALFactory under contention for getInstance()
Signed-off-by: stack <stack@apache.org>
2014-11-19 14:39:46 -08:00
Matteo Bertozzi 05ced20a34 HBASE-12529 Use ThreadLocalRandom for RandomQueueBalancer 2014-11-19 16:50:29 +00:00
Matteo Bertozzi 3f95fe22e0 Patch up Jetty to disable SSLv3 (CVE-2014-3566) 2014-11-19 16:40:18 +00:00
stack 640274d5e1 HBASE-12532 TestFilter failing occasionally with ExitCodeException doing chmod since HBASE-10378 ADDENDUM 2014-11-18 23:41:35 -08:00
stack d87c550b94 HBASE-12532 TestFilter failing occasionally with ExitCodeException doing chmod since HBASE-10378 2014-11-18 21:54:48 -08:00
stack 1e77dd9f7a Revert "HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99)" ADDENDUM 2014-11-18 21:40:21 -08:00
stack 5f391efda1 Revert "HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99)"
This reverts commit d3e7c3cfa9.
2014-11-18 16:30:52 -08:00
Andrew Purtell 22f29ca8ef HBASE-12496 A blockedRequestsCount metric (Yi Deng) 2014-11-18 14:14:31 -08:00
Lars Hofhansl 822bcce91e HBASE-12411 Optionally enable p-reads and private readers for compactions. 2014-11-18 12:42:49 -08:00
stack b94e6738d9 HBASE-10378 Refactor write-ahead-log implementation -- ADDEDNUM 2014-11-18 12:12:35 -08:00
Sean Busbey f5e05eb836 HBASE-10378 Refactor write-ahead-log implementation
Incompatible changes called out in release notes on jira.

* Cleaned up references to HLog
* Deprecates HLogKey but maintains it for compatibility
  - Moves all Writeable from WALKey to HLogKey
* Adds utility code to CoprocessorHost to help with evolving Coprocessor APIs
* RSRpcServices roll WAL call now requests the non-meta LogRoller roll all logs
  - rolls actually happen asynchronously
  - deprecated old api (and noted incompatible behavior change)
  - modified api in new Admin interface to reflect lack of return values.
* Moved WAL user facing API to "WAL"
  - only 1 sync offered
  - WALTrailer removed from API
* make provider used by the WALFactory configurable.
* Move all WAL requests to use opaque ids instead of paths
* WALProvider provides API details for implementers and handles creation of WALs.
* Refactor WALActionsListener to have a basic implementation.
* turn MetricsWAL into a WALActionsListener.
* tests that needs FSHLog implementation details use them directly, others just reference provider + factory
  - Some tests moved from Large to Medium based on run time.
* pull out wal disabling into its own no-op class
* update region open to delegate to WALFactory
* update performance test tool to allow for multiple regions
* Removed references to meta-specific wals within wal code
  - replaced with generic suffixes
  - WALFactory maintains a dedicated WALProvider for meta (and so knows about the distinction)
* maintain backwards compat on HLogPrettyPrinter and mark it deprecated.
  - made WALPrettyPrinter IA.Private in favor of `bin/hbase wal`
* move WALUtil stuff that's implementation specific to said implementation
  - WALUtil now acts as an integration point between the RegionServer and hte WAL code.

Incorporates contributions from v.himanshu.

Signed-off-by: stack <stack@apache.org>
2014-11-18 12:04:41 -08:00
Enis Soztutar b97c3daf90 HBASE-12449 Use the max timestamp of current or old cell's timestamp in HRegion.append() 2014-11-18 11:34:49 -08:00
stack d3e7c3cfa9 HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99) 2014-11-18 09:48:54 -08:00
tedyu 0eb07609b6 HBASE-12337 Import tool fails with NullPointerException if clusterIds is not initialized 2014-11-18 09:18:25 -08:00
Nick Dimiduk 1276af23d5 HBASE-12459 Use a non-managed Table in mapred.TableOutputFormat 2014-11-17 08:36:08 +01:00
stack 0255fc2bf1 HBASE-12359 MulticastPublisher should specify IPv4/v6 protocol family when creating multicast channel (Qiang Tian) 2014-11-14 21:55:15 -08:00
tedyu 9583d14747 HBASE-12478 HBASE-10141 and MIN_VERSIONS are not compatible 2014-11-14 16:36:56 -08:00
Lars Hofhansl c29318c038 Revert "HBASE-12457 Regions in transition for a long time when CLOSE interleaves with a slow compaction."
This reverts commit 231d3ee2ad.
2014-11-13 09:18:21 -08:00
Lars Hofhansl 9d634772fa Revert "Amend HBASE-12457 Regions in transition for a long time when CLOSE interleaves with a slow compaction; Test import fix"
This reverts commit f6d8cde1e4.
2014-11-13 09:17:56 -08:00
Andrew Purtell f6d8cde1e4 Amend HBASE-12457 Regions in transition for a long time when CLOSE interleaves with a slow compaction; Test import fix 2014-11-13 08:09:41 -08:00
Lars Hofhansl 231d3ee2ad HBASE-12457 Regions in transition for a long time when CLOSE interleaves with a slow compaction. 2014-11-12 22:49:00 -08:00
Enis Soztutar f641aada36 HBASE-12445 hbase is removing all remaining cells immediately after the cell marked with marker = KeyValue.Type.DeleteColumn via PUT (Hani Nadra) 2014-11-12 15:50:10 -08:00
Matteo Bertozzi a376c8da9d HBASE-12366 Add login code to HBase Canary tool (Srikanth Srungarapu) 2014-11-12 20:34:55 +00:00
Andrew Purtell 210f5a3b01 Revert "HBASE-12454 Setting didPerformCompaction early in HRegion#compact"
This reverts commit b0a434a5ce.
2014-11-12 12:30:57 -08:00
Andrew Purtell 05c1663392 HBASE-12461 FSVisitor logging is excessive (Nick Dimiduk) 2014-11-12 10:23:54 -08:00
Andrew Purtell b0a434a5ce HBASE-12454 Setting didPerformCompaction early in HRegion#compact 2014-11-12 09:47:46 -08:00
stack fb6c5c7fe8 HBASE-10483 Provide API for retrieving info port when hbase.master.info.port is set to 0 (Liu Shaohui) 2014-11-12 08:56:42 -08:00
Esteban Gutierrez 8327f145c9 HBASE-12447 Add support for setTimeRange for RowCounter and CellCounter (addendum)
Signed-off-by: stack <stack@apache.org>
2014-11-11 15:44:56 -08:00
stack 804444f892 HBASE-12455 Add 'description' to bean and attribute output when you do /jmx?description=true 2014-11-11 12:59:43 -08:00
Esteban Gutierrez 6c2a299657 HBASE-12447 Add support for setTimeRange for RowCounter and CellCounter
Signed-off-by: stack <stack@apache.org>
2014-11-11 11:17:23 -08:00
Andrew Purtell 7657090ad9 HBASE-12448 Fix rate reporting in compaction progress DEBUG logging 2014-11-07 18:36:43 -08:00
Andrew Purtell 440767ff55 Reduce the effective scope of CREATE and ADMIN permissions 2014-11-07 11:53:25 -08:00
Andrew Purtell 7718390703 HBASE-12424 Finer grained logging and metrics for split transactions 2014-11-07 11:32:01 -08:00