Commit Graph

3219 Commits

Author SHA1 Message Date
stack d87c550b94 HBASE-12532 TestFilter failing occasionally with ExitCodeException doing chmod since HBASE-10378 2014-11-18 21:54:48 -08:00
stack 1e77dd9f7a Revert "HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99)" ADDENDUM 2014-11-18 21:40:21 -08:00
stack 5f391efda1 Revert "HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99)"
This reverts commit d3e7c3cfa9.
2014-11-18 16:30:52 -08:00
Andrew Purtell 22f29ca8ef HBASE-12496 A blockedRequestsCount metric (Yi Deng) 2014-11-18 14:14:31 -08:00
Lars Hofhansl 822bcce91e HBASE-12411 Optionally enable p-reads and private readers for compactions. 2014-11-18 12:42:49 -08:00
stack b94e6738d9 HBASE-10378 Refactor write-ahead-log implementation -- ADDEDNUM 2014-11-18 12:12:35 -08:00
Sean Busbey f5e05eb836 HBASE-10378 Refactor write-ahead-log implementation
Incompatible changes called out in release notes on jira.

* Cleaned up references to HLog
* Deprecates HLogKey but maintains it for compatibility
  - Moves all Writeable from WALKey to HLogKey
* Adds utility code to CoprocessorHost to help with evolving Coprocessor APIs
* RSRpcServices roll WAL call now requests the non-meta LogRoller roll all logs
  - rolls actually happen asynchronously
  - deprecated old api (and noted incompatible behavior change)
  - modified api in new Admin interface to reflect lack of return values.
* Moved WAL user facing API to "WAL"
  - only 1 sync offered
  - WALTrailer removed from API
* make provider used by the WALFactory configurable.
* Move all WAL requests to use opaque ids instead of paths
* WALProvider provides API details for implementers and handles creation of WALs.
* Refactor WALActionsListener to have a basic implementation.
* turn MetricsWAL into a WALActionsListener.
* tests that needs FSHLog implementation details use them directly, others just reference provider + factory
  - Some tests moved from Large to Medium based on run time.
* pull out wal disabling into its own no-op class
* update region open to delegate to WALFactory
* update performance test tool to allow for multiple regions
* Removed references to meta-specific wals within wal code
  - replaced with generic suffixes
  - WALFactory maintains a dedicated WALProvider for meta (and so knows about the distinction)
* maintain backwards compat on HLogPrettyPrinter and mark it deprecated.
  - made WALPrettyPrinter IA.Private in favor of `bin/hbase wal`
* move WALUtil stuff that's implementation specific to said implementation
  - WALUtil now acts as an integration point between the RegionServer and hte WAL code.

Incorporates contributions from v.himanshu.

Signed-off-by: stack <stack@apache.org>
2014-11-18 12:04:41 -08:00
Enis Soztutar b97c3daf90 HBASE-12449 Use the max timestamp of current or old cell's timestamp in HRegion.append() 2014-11-18 11:34:49 -08:00
stack d3e7c3cfa9 HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99) 2014-11-18 09:48:54 -08:00
tedyu 0eb07609b6 HBASE-12337 Import tool fails with NullPointerException if clusterIds is not initialized 2014-11-18 09:18:25 -08:00
Nick Dimiduk 1276af23d5 HBASE-12459 Use a non-managed Table in mapred.TableOutputFormat 2014-11-17 08:36:08 +01:00
stack 0255fc2bf1 HBASE-12359 MulticastPublisher should specify IPv4/v6 protocol family when creating multicast channel (Qiang Tian) 2014-11-14 21:55:15 -08:00
tedyu 9583d14747 HBASE-12478 HBASE-10141 and MIN_VERSIONS are not compatible 2014-11-14 16:36:56 -08:00
Lars Hofhansl c29318c038 Revert "HBASE-12457 Regions in transition for a long time when CLOSE interleaves with a slow compaction."
This reverts commit 231d3ee2ad.
2014-11-13 09:18:21 -08:00
Lars Hofhansl 9d634772fa Revert "Amend HBASE-12457 Regions in transition for a long time when CLOSE interleaves with a slow compaction; Test import fix"
This reverts commit f6d8cde1e4.
2014-11-13 09:17:56 -08:00
Andrew Purtell f6d8cde1e4 Amend HBASE-12457 Regions in transition for a long time when CLOSE interleaves with a slow compaction; Test import fix 2014-11-13 08:09:41 -08:00
Lars Hofhansl 231d3ee2ad HBASE-12457 Regions in transition for a long time when CLOSE interleaves with a slow compaction. 2014-11-12 22:49:00 -08:00
Enis Soztutar f641aada36 HBASE-12445 hbase is removing all remaining cells immediately after the cell marked with marker = KeyValue.Type.DeleteColumn via PUT (Hani Nadra) 2014-11-12 15:50:10 -08:00
Matteo Bertozzi a376c8da9d HBASE-12366 Add login code to HBase Canary tool (Srikanth Srungarapu) 2014-11-12 20:34:55 +00:00
Andrew Purtell 210f5a3b01 Revert "HBASE-12454 Setting didPerformCompaction early in HRegion#compact"
This reverts commit b0a434a5ce.
2014-11-12 12:30:57 -08:00
Andrew Purtell 05c1663392 HBASE-12461 FSVisitor logging is excessive (Nick Dimiduk) 2014-11-12 10:23:54 -08:00
Andrew Purtell b0a434a5ce HBASE-12454 Setting didPerformCompaction early in HRegion#compact 2014-11-12 09:47:46 -08:00
stack fb6c5c7fe8 HBASE-10483 Provide API for retrieving info port when hbase.master.info.port is set to 0 (Liu Shaohui) 2014-11-12 08:56:42 -08:00
Esteban Gutierrez 8327f145c9 HBASE-12447 Add support for setTimeRange for RowCounter and CellCounter (addendum)
Signed-off-by: stack <stack@apache.org>
2014-11-11 15:44:56 -08:00
stack 804444f892 HBASE-12455 Add 'description' to bean and attribute output when you do /jmx?description=true 2014-11-11 12:59:43 -08:00
Esteban Gutierrez 6c2a299657 HBASE-12447 Add support for setTimeRange for RowCounter and CellCounter
Signed-off-by: stack <stack@apache.org>
2014-11-11 11:17:23 -08:00
Andrew Purtell 7657090ad9 HBASE-12448 Fix rate reporting in compaction progress DEBUG logging 2014-11-07 18:36:43 -08:00
Andrew Purtell 440767ff55 Reduce the effective scope of CREATE and ADMIN permissions 2014-11-07 11:53:25 -08:00
Andrew Purtell 7718390703 HBASE-12424 Finer grained logging and metrics for split transactions 2014-11-07 11:32:01 -08:00
Niels Basjes cc71d35112 Generate Thrift code using a maven profile
Signed-off-by: stack <stack@apache.org>
2014-11-06 10:27:59 -08:00
stack c71244c02d HBASE-12329 Table create with duplicate column family names quietly succeeds (Jingcheng Du) 2014-11-05 17:32:21 -08:00
stack b0eaa92f5b HBASE-8707 Add LongComparator for filter (Liu Shaohui) 2014-11-05 16:56:43 -08:00
Andrew Purtell e1b82fe91f HBASE-12389 Reduce the number of versions configured for the ACL table 2014-11-05 09:28:11 -08:00
Andrew Purtell 9255d6fdc7 HBASE-12420 BucketCache logged startup message is egregiously large 2014-11-05 09:22:00 -08:00
Andrew Purtell 48fd0369e5 HBASE-12344 Split up TestAdmin 2014-11-05 09:18:04 -08:00
Lars Hofhansl ecd708671c HBASE-12363 Improve how KEEP_DELETED_CELLS works with MIN_VERSIONS. 2014-11-04 17:08:39 -08:00
stack 3587fe8324 HBASE-12423 Use a non-managed Table in TableOutputFormat (Solomon Duskis) 2014-11-04 16:25:16 -08:00
Matteo Bertozzi 7442e5bd62 HBASE-12414 Move HFileLink.exists() to base class 2014-11-04 12:33:29 +00:00
tedyu ab927b8e1a HBASE-10780 HFilePrettyPrinter#processFile should return immediately if file does not exist (Ashish Singhi) 2014-11-03 20:31:40 -08:00
Enis Soztutar 71f73fcd0b HBASE-12402 ZKPermissionWatcher race condition in refreshing the cache leaving stale ACLs and causing AccessDenied 2014-11-03 20:09:55 -08:00
Ashish Singhi f7adec0548 HBASE-4625 Convert @deprecated HBaseTestCase tests JUnit4 style tests
Signed-off-by: stack <stack@apache.org>
2014-11-03 15:58:56 -08:00
Nick Dimiduk b5764a8e74 HBASE-12399 Master startup race between metrics and RpcServer 2014-11-01 10:45:45 -07:00
Adrian Muraru a1f59d8e1b Replication gets stuck following a transient zookeeper error to remote peer cluster
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2014-10-31 17:59:29 -07:00
Nick Dimiduk b784f7db99 HBASE-12401 Add some timestamp signposts in IntegrationTestMTTR 2014-10-31 17:21:20 -07:00
Nick Dimiduk f5d6314c87 HBASE-12335 IntegrationTestRegionReplicaPerf is flaky 2014-10-31 17:12:21 -07:00
Andrew Purtell a62f543c65 HBASE-12361 Show data locality of region in table page (Liu Shaohui) 2014-10-31 15:41:57 -07:00
Enis Soztutar 997c1adc2f HBASE-12390 Change revision style from svn to git 2014-10-31 11:10:38 -07:00
Ashish Singhi cacdb89e03 HBASE-10870 Deprecate and replace HCD methods that have a 'should' prefix with a 'is' instead
Signed-off-by: stack <stack@apache.org>
2014-10-31 08:34:00 -07:00
Esteban Gutierrez ba7344f5d1 HBASE-12219 Cache more efficiently getAll() and get() in FSTableDescriptors
Signed-off-by: stack <stack@apache.org>
2014-10-30 21:12:41 -07:00
Nick Dimiduk a71dd16a70 HBASE-9003 TableMapReduceUtil should not rely on org.apache.hadoop.util.JarFinder#getJar (Esteban Gutierrez)
Signed-off-by: stack <stack@apache.org>
2014-10-30 21:03:01 -07:00
Sean Busbey 646f1d5f8f HBASE-12388 Document behavior wrt coprocessors when wal gets empty waledits.
Signed-off-by: stack <stack@apache.org>
2014-10-30 19:32:12 -07:00
stack ff92346f5e HBASE-11819 Unit test for CoprocessorHConnection (Talat Uyarer) -- REVERT. Failed in a test run here: https://builds.apache.org/job/PreCommit-HBASE-Build/11530//testReport/ 2014-10-30 19:28:29 -07:00
stack a404db52ec HBASE-11819 Unit test for CoprocessorHConnection (Talat Uyarer) 2014-10-30 14:33:29 -07:00
Esteban Gutierrez 7886c0b82f TestRegionServerNoMaster#testMultipleOpen is flaky after HBASE-11760 2014-10-30 13:38:56 -07:00
stack 9f4b6ac06c HBASE-11835 Wrong managenement of non expected calls in the client (Nicolas Liochon) 2014-10-30 12:41:54 -07:00
Andrew Purtell f20fac41df HBASE-12384 TestTags can hang on fast test hosts 2014-10-30 10:45:02 -07:00
Ashish Singhi 87939889bb HBASE-12375 LoadIncrementalHFiles fails to load data in table when CF name starts with '_'
Signed-off-by: stack <stack@apache.org>
2014-10-30 09:16:37 -07:00
Matteo Bertozzi 8b84840d5a HBASE-12378 Add a test to verify that the read-replica is able to read after a compaction 2014-10-30 12:06:16 +00:00
stack d170088d98 HBASE-12336 RegionServer failed to shutdown for NodeFailoverWorker thread (Liu Shaohui) 2014-10-29 22:03:26 -07:00
stack 5062edebcf HBASE-12238 A few ugly exceptions on startup 2014-10-29 21:42:29 -07:00
stack fba164a1d1 HBASE-12355 Update maven plugins 2014-10-29 13:11:44 -07:00
stack 889333a6fd HBASE-12313 Redo the hfile index length optimization so cell-based rather than serialized KV key 2014-10-29 11:33:49 -07:00
stack 7cfafe401e HBASE-12354 Update dependencies in time for 1.0 release 2014-10-29 11:16:18 -07:00
stack b240b00f4f HBASE-12285 Builds are failing, possibly because of SUREFIRE-1091 ; ADDENDUM SETTING LOG LEVEL TO DEBUG AGAIN 2014-10-29 11:00:16 -07:00
anoopsjohn cbb334035d HBASE-12297 Support DBB usage in Bloom and HFileIndex area. 2014-10-29 14:39:03 +05:30
manukranthk ece933fa3e Implement Preemptive Fast Fail
Summary: This diff ports the Preemptive Fast Fail feature to OSS. In multi threaded clients, we use a feature developed on 0.89-fb branch called Preemptive Fast Fail. This allows the client threads which would potentially fail, fail fast. The idea behind this feature is that we allow, among the hundreds of client threads, one thread to try and establish connection with the regionserver and if that succeeds, we mark it as a live node again. Meanwhile, other threads which are trying to establish connection to the same server would ideally go into the timeouts which is effectively unfruitful. We can in those cases return appropriate exceptions to those clients instead of letting them retry.

Test Plan: Unit tests

Differential Revision: https://reviews.facebook.net/D24177

Signed-off-by: stack <stack@apache.org>
2014-10-28 22:47:50 -07:00
Dima Spivak 95282f2ea5 HBASE-12312 Another couple of createTable race conditions
Signed-off-by: stack <stack@apache.org>
2014-10-28 22:33:40 -07:00
stack 64b6109ce9 HBASE-11562 CopyTable should provide an option to shuffle the mapper tasks (Jean-Marc Spaggiari) 2014-10-28 11:28:54 -07:00
anoopsjohn f2f21000fb HBASE-12304 CellCounter will throw AIOBE when output directory is not specified. (Ashish Singhi) 2014-10-28 17:27:47 +05:30
stack aea2c67016 HBASE-12353 Turn down logging on some spewing unit tests (Dima Spivak) 2014-10-27 15:12:25 -07:00
Andrew Purtell 70a312e53f HBASE-11912 Catch some bad practices at compile time with error-prone 2014-10-27 09:29:23 -07:00
anoopsjohn 0fb4c4d5f0 HBASE-11870 Optimization : Avoid copy of key and value for tags addition in AC and VC. 2014-10-25 21:12:15 +05:30
Andrew Purtell ff5bc351b2 Revert "HBASE-11912 Catch some bad practices at compile time with error-prone"
This reverts commit 7ed0260eff.
2014-10-25 08:33:43 -07:00
Andrew Purtell 7ed0260eff HBASE-11912 Catch some bad practices at compile time with error-prone 2014-10-24 18:15:12 -07:00
Andrew Purtell 97acb9ef24 HBASE-11964 Improve spreading replication load from failed regionservers 2014-10-24 14:17:46 -07:00
stack 2916d4f356 HBASE-12277 Refactor bulkLoad methods in AccessController to its own interface (Madhan Neethiraj) 2014-10-24 08:47:06 -07:00
stack 31c185aad5 HBASE-12328 Need to separate JvmMetrics for Master and RegionServer (Sanghyun Yun) 2014-10-23 21:49:47 -07:00
stack 96f84594ee HBASE-11915 Document and test 0.94 -> 1.0.0 update -- ADDENDUM 2014-10-22 22:10:52 -07:00
Elliott Clark c623b04122 HBASE-12283 Clean up some checkstyle errors 2014-10-22 11:58:23 -07:00
Ted Yu 19108fb850 HBASE-12306 CellCounter output's wrong value for Total Families Across all Rows in output file (Ashish Singhi) 2014-10-22 14:30:53 +00:00
Matteo Bertozzi 2908c11371 HBASE-12301 user_permission command does not show global permissions 2014-10-22 10:08:31 +01:00
Dima Spivak f6de7efb27 HBASE-12285 Builds are failing, possibly because of SUREFIRE-1091
* Reduce the logging level to WARN

Signed-off-by: stack <stack@apache.org>
2014-10-21 22:02:00 -07:00
Yi Deng e545953c32 HBASE-12243 HBaseFsck should auto set ignorePreCheckPermission to true if no fix option is set (Yi Deng)
Signed-off-by: Jonathan M Hsieh <jmhsieh@apache.org>
2014-10-21 13:20:23 -07:00
Ted Yu 6c70f4f7f7 HBASE-12302 VisibilityClient getAuths does not propagate remote service exception correctly (Jerry He) 2014-10-21 20:09:46 +00:00
anoopsjohn c01d9981d8 HBASE-12202 Support DirectByteBuffer usage in HFileBlock. 2014-10-21 17:57:55 +05:30
stack c7f51db135 HBASE-12226 TestAccessController#testPermissionList failing on master (Srikranth Srungarapu) 2014-10-20 20:35:23 -07:00
stack 0ee33094ed HBASE-12278 Race condition in TestSecureLoadIncrementalHFilesSplitRecovery (Dima Spivak) 2014-10-20 11:08:45 -04:00
Ryan Rawson 451798cefb HBASE-12192 Remove EventHandlerListener 2014-10-18 14:27:04 -07:00
Matteo Bertozzi 49056295ef HBASE-12161 Add support for grant/revoke on namespaces in AccessControlClient (Srikanth Srungarapu) 2014-10-18 21:18:42 +01:00
manukranthk 5c92bded9d Add admin endpoint for updating the configuration on the regionserver
Summary: This is a follow up diff for the jira to add the functionality to update configs in an online fashion.

Test Plan: Unit test. This adds an end point on the regionserver. It just tries to call the end point and make sure the call succeeds.

Differential Revision: https://reviews.facebook.net/D24861

Signed-off-by: stack <stack@apache.org>
2014-10-18 16:16:21 -04:00
Dima Spivak 7e995b6496 HBASE-12229 NullPointerException in SnapshotTestingUtils
* Implemented the waitUntilAllRegionsOnline in HBaseTestingUtility#createTable
* Add waitFor around #isTableAvailable call that previously didn't do anything
* Remove unused byte[] hex

Signed-off-by: stack <stack@apache.org>
2014-10-17 22:50:10 -04:00
Ted Yu 349a56ae2c HBASE-12263 RegionServer listens on localhost in distributed cluster when DNS is unavailable (Shaohui) 2014-10-17 20:52:55 +00:00
Ted Yu 728fc543ea HBASE-12264 ImportTsv should fail fast if output is not specified and table does not exist (Ashish) 2014-10-17 20:45:44 +00:00
Ted Yu 686e77108a HBASE-12274 Race between RegionScannerImpl#nextInternal() and RegionScannerImpl#close() may produce null pointer exception 2014-10-17 16:05:31 +00:00
Patrick White ba20d4df8c HBASE-12271 Add counters for files skipped during snapshot export
Add counters for skipped files

Signed-off-by: Elliott Clark <eclark@apache.org>
2014-10-15 10:41:48 -07:00
manukranthk f9c534bac3 HBASE-12258 TestHbaseFsck is flaky and has some multithreading issues
Signed-off-by: Elliott Clark <eclark@apache.org>
2014-10-14 17:36:31 -07:00
stack 3544f4e98b HBASE-12247 Replace setHTable() with initializeTable() in TableInputFormat. (Solomon Duskis) 2014-10-14 14:11:21 -07:00
manukranthk 962065de72 Online config change
Summary: This diff is intended to forward port HBASE-8805 and HBASE-8544 implemented by Gaurav Menghani in 89-fb. This improves operational efficiency in managing clusters that are serving production traffic. The idea is to have a central configuration which can manage notifying the configuration observers. The observers in turn should update their local state from the latest config. Minor caveats where configuration variables are corelated should be taken care of with additional care.

Test Plan: Unit tests

Differential Revision: https://reviews.facebook.net/D24681

Signed-off-by: stack <stack@apache.org>
2014-10-13 21:23:12 -07:00
Rajeshbabu Chintaguntla 6dea02b260 HBASE-10200 Better error message when HttpServer fails to start due to java.net.BindException(Kiran Kumar M R) 2014-10-14 02:24:21 +00:00
stack 9a893a9c6a HBASE-12029 Use Table and RegionLocator in HTable.getRegionLocations() (Solomon Duskis) 2014-10-13 12:24:27 -07:00