Commit Graph

3162 Commits

Author SHA1 Message Date
Andrew Purtell 87fb974765 HBASE-12440 Region may remain offline on clean startup under certain race condition (Virag Kothari) 2014-11-07 14:11:56 -08:00
Andrew Purtell 5a16c15d7f Reduce the effective scope of CREATE and ADMIN permissions 2014-11-07 11:53:01 -08:00
Andrew Purtell 3eed03268f HBASE-12424 Finer grained logging and metrics for split transactions
Conflicts:
	hbase-hadoop-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerSource.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/SplitRequest.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/SplitTransaction.java
2014-11-07 11:44:49 -08:00
Niels Basjes de21812ad5 HBASE-12272 Generate Thrift code using a maven profile
Signed-off-by: stack <stack@apache.org>

Conflicts:
	pom.xml
	src/main/docbkx/developer.xml
2014-11-06 10:32:41 -08:00
stack c99d89fd63 HBASE-12427 Change branch-1 version from 0.99.2-SNAPSHOT to 0.99.3-SNAPSHOT --REVERT 2014-11-05 19:15:24 -08:00
stack 15f96c7a00 HBASE-12329 Table create with duplicate column family names quietly succeeds (Jingcheng Du) 2014-11-05 17:33:54 -08:00
stack 625a1ea065 HBASE-8707 Add LongComparator for filter (Liu Shaohui) 2014-11-05 16:57:21 -08:00
Andrew Purtell 41611547b3 HBASE-12389 Reduce the number of versions configured for the ACL table 2014-11-05 09:28:19 -08:00
Andrew Purtell 2e826a4ad1 HBASE-12420 BucketCache logged startup message is egregiously large 2014-11-05 09:22:04 -08:00
Andrew Purtell 64fd02fcbd HBASE-12344 Split up TestAdmin 2014-11-05 09:18:51 -08:00
Lars Hofhansl 8427d67ff6 HBASE-12363 Improve how KEEP_DELETED_CELLS works with MIN_VERSIONS. 2014-11-04 17:12:39 -08:00
stack e36c59d4f2 HBASE-12423 Use a non-managed Table in TableOutputFormat (Solomon Duskis)
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RegionServerServices.java
2014-11-04 16:29:18 -08:00
Esteban Gutierrez 431b8a5383 Cache more efficiently getAll() and get() in FSTableDescriptors
Signed-off-by: stack <stack@apache.org>
2014-11-04 15:10:08 -08:00
stack c66a6b02a5 HBASE-12427 Change branch-1 version from 0.99.2-SNAPSHOT to 0.99.3-SNAPSHOT 2014-11-04 12:41:38 -08:00
stack a347d32cc5 HBASE-12319: Inconsistencies during region recovery due to close/open of a region during recovery; REVERT -- UNSTABLE BUILD 2014-11-04 09:26:13 -08:00
Matteo Bertozzi b827b6d02e HBASE-12414 Move HFileLink.exists() to base class 2014-11-04 12:31:21 +00:00
Jeffrey Zhong c84b13514e HBASE-12319: Inconsistencies during region recovery due to close/open of a region during recovery 2014-11-03 21:31:12 -08:00
tedyu 481c6829db HBASE-10780 HFilePrettyPrinter#processFile should return immediately if file does not exist (Ashish Singhi) 2014-11-03 20:30:47 -08:00
Enis Soztutar 65e7de39c7 HBASE-12402 ZKPermissionWatcher race condition in refreshing the cache leaving stale ACLs and causing AccessDenied 2014-11-03 20:12:12 -08:00
stack 0aca51e89c HBASE-12219 Cache more efficiently getAll() and get() in FSTableDescriptors; REVERTgit log! branch-1 patch AND addendum 2014-11-01 16:03:08 -07:00
Nick Dimiduk c3a7f2f3bb HBASE-12399 Master startup race between metrics and RpcServer 2014-11-01 10:47:00 -07:00
Adrian Muraru 0505072c51 Replication gets stuck following a transient zookeeper error to remote peer cluster
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2014-10-31 17:59:43 -07:00
Nick Dimiduk e15a803b59 HBASE-12401 Add some timestamp signposts in IntegrationTestMTTR 2014-10-31 17:22:47 -07:00
Nick Dimiduk 4a803e79e1 HBASE-12335 IntegrationTestRegionReplicaPerf is flaky 2014-10-31 17:17:05 -07:00
Andrew Purtell 4649646fc8 HBASE-12361 Show data locality of region in table page (Liu Shaohui)
Conflicts:
	hbase-server/src/main/resources/hbase-webapps/master/table.jsp
2014-10-31 15:43:01 -07:00
Esteban Gutierrez 1f18d706a8 HBASE-12219 Cache more efficiently getAll() and get() in FSTableDescriptors (addendum)
Signed-off-by: stack <stack@apache.org>
2014-10-31 11:33:33 -07:00
Enis Soztutar a46425b2a9 HBASE-12390 Change revision style from svn to git 2014-10-31 11:11:12 -07:00
Esteban Gutierrez 233fb8bf18 HBASE-12219 Cache more efficiently getAll() and get() in FSTableDescriptors
Signed-off-by: stack <stack@apache.org>
2014-10-31 10:40:57 -07:00
Ashish Singhi ae8462b3a2 HBASE-10870 Deprecate and replace HCD methods that have a 'should' prefix with a 'is' instead
Signed-off-by: stack <stack@apache.org>
2014-10-31 08:34:40 -07:00
Nick Dimiduk b2d1b154bb HBASE-9003 TableMapReduceUtil should not rely on org.apache.hadoop.util.JarFinder#getJar (Esteban Gutierrez)
Signed-off-by: stack <stack@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestJarFinder.java
2014-10-30 21:07:55 -07:00
stack a1162960c2 HBASE-11819 Unit test for CoprocessorHConnection (Talat Uyarer) -- ADDENDUM testannoations fixup -- REALLY REMOVE IT 2014-10-30 20:08:51 -07:00
Sean Busbey f5e3b30058 HBASE-12388 Document behavior wrt coprocessors when wal gets empty waledits.
Signed-off-by: stack <stack@apache.org>
2014-10-30 19:32:44 -07:00
stack c1ec92adc9 HBASE-11819 Unit test for CoprocessorHConnection (Talat Uyarer) -- REVERT. Failed in a test run here: https://builds.apache.org/job/PreCommit-HBASE-Build/11530//testReport/ 2014-10-30 19:26:23 -07:00
stack 49fb89f151 HBASE-11819 Unit test for CoprocessorHConnection (Talat Uyarer) -- ADDENDUM testannoations fixup 2014-10-30 14:51:15 -07:00
stack d719ea1db7 HBASE-11819 Unit test for CoprocessorHConnection (Talat Uyarer) 2014-10-30 14:34:02 -07:00
stack 29d486ff4e HBASE-11835 Wrong managenement of non expected calls in the client (Nicolas Liochon) 2014-10-30 12:42:26 -07:00
Andrew Purtell f0091a9031 HBASE-12384 TestTags can hang on fast test hosts 2014-10-30 10:45:08 -07:00
Ashish Singhi d8874fbc21 HBASE-12375 LoadIncrementalHFiles fails to load data in table when CF name starts with '_'
Signed-off-by: stack <stack@apache.org>
2014-10-30 09:17:02 -07:00
Matteo Bertozzi c466c61976 HBASE-12378 Add a test to verify that the read-replica is able to read after a compaction 2014-10-30 12:18:52 +00:00
stack 9e0ca78439 HBASE-12336 RegionServer failed to shutdown for NodeFailoverWorker thread (Liu Shaohui) 2014-10-29 22:04:02 -07:00
stack b069c10af4 HBASE-12238 A few ugly exceptions on startup
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/MetaTableLocator.java
2014-10-29 21:53:55 -07:00
stack 6f4ae948ac HBASE-12355 Update maven plugins
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/quotas/QuotaCache.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/HLogSplitter.java
2014-10-29 13:18:25 -07:00
stack 6c39d36b32 HBASE-12313 Redo the hfile index length optimization so cell-based rather than serialized KV key
Conflicts:
	hbase-common/src/main/java/org/apache/hadoop/hbase/CellComparator.java
	hbase-common/src/main/java/org/apache/hadoop/hbase/CellKey.java
	hbase-common/src/test/java/org/apache/hadoop/hbase/TestCellUtil.java
2014-10-29 11:36:47 -07:00
stack 7aed6de9c8 HBASE-12354 Update dependencies in time for 1.0 release 2014-10-29 11:16:44 -07:00
stack 752c546099 HBASE-12285 Builds are failing, possibly because of SUREFIRE-1091 ; ADDENDUM SETTING LOG LEVEL TO DEBUG AGAIN
Conflicts:
	hbase-server/src/test/resources/log4j.properties
2014-10-29 11:01:19 -07:00
anoopsjohn e1d1ba564b HBASE-12297 Support DBB usage in Bloom and HFileIndex area. 2014-10-29 14:40:08 +05:30
manukranthk 69c99da70a Implement Preemptive Fast Fail
Summary: This diff ports the Preemptive Fast Fail feature to OSS. In multi threaded clients, we use a feature developed on 0.89-fb branch called Preemptive Fast Fail. This allows the client threads which would potentially fail, fail fast. The idea behind this feature is that we allow, among the hundreds of client threads, one thread to try and establish connection with the regionserver and if that succeeds, we mark it as a live node again. Meanwhile, other threads which are trying to establish connection to the same server would ideally go into the timeouts which is effectively unfruitful. We can in those cases return appropriate exceptions to those clients instead of letting them retry.

Test Plan: Unit tests

Differential Revision: https://reviews.facebook.net/D24177

Signed-off-by: stack <stack@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ClusterConnection.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionManager.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/RpcRetryingCaller.java
2014-10-28 22:59:20 -07:00
Dima Spivak a973fd514f HBASE-12312 Another couple of createTable race conditions
Signed-off-by: stack <stack@apache.org>
2014-10-28 22:36:41 -07:00
stack a26bcdd4d9 HBASE-11562 CopyTable should provide an option to shuffle the mapper tasks (Jean-Marc Spaggiari) 2014-10-28 11:29:22 -07:00
Andrew Purtell 81c4caf1f1 HBASE-12142 Truncate command does not preserve ACLs table (Vandana Ayyalasomayajula)
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/access/TestAccessController.java
2014-10-28 09:59:45 -07:00
anoopsjohn f9fce4caf0 HBASE-12304 CellCounter will throw AIOBE when output directory is not specified. (Ashish Singhi) 2014-10-28 17:56:09 +05:30
stack bf8c34734b HBASE-12353 Turn down logging on some spewing unit tests (Dima Spivak) 2014-10-27 15:13:04 -07:00
stack 862faca7a4 HBASE-12285 Builds are failing, possibly because of SUREFIRE-1091 -- Setting log level back to DEBUG TO WARN -- second time 2014-10-26 20:49:03 -07:00
stack 65c60ce873 HBASE-12285 Builds are failing, possibly because of SUREFIRE-1091 -- Setting log level back to DEBUG from WARN 2014-10-26 16:19:23 -07:00
anoopsjohn 4d385d1509 HBASE-11870 Optimization : Avoid copy of key and value for tags addition in AC and VC. 2014-10-25 21:13:49 +05:30
Andrew Purtell 54fdd96516 HBASE-11964 Improve spreading replication load from failed regionservers 2014-10-24 14:17:55 -07:00
stack b8ed37b88e HBASE-12285 Builds are failing, possibly because of SUREFIRE-1091 -- trying WARN level to see if it makes any difference 2014-10-24 09:24:25 -07:00
stack ceffa3c48d HBASE-12277 Refactor bulkLoad methods in AccessController to its own interface (Madhan Neethiraj)
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/security/access/AccessController.java
2014-10-24 08:48:15 -07:00
stack bca92603e0 HBASE-12328 Need to separate JvmMetrics for Master and RegionServer (Sanghyun Yun) 2014-10-23 21:50:09 -07:00
stack 46e4bffc2c HBASE-11915 Document and test 0.94 -> 1.0.0 update -- ADDENDUM 2014-10-22 22:11:43 -07:00
Ted Yu d0c1019963 HBASE-12306 CellCounter output's wrong value for Total Families Across all Rows in output file (Ashish Singhi) 2014-10-22 14:30:22 +00:00
Matteo Bertozzi 4f32987de7 HBASE-12301 user_permission command does not show global permissions 2014-10-22 10:13:46 +01:00
Dima Spivak a5bb441d45 HBASE-12285 Builds are failing, possibly because of SUREFIRE-1091
* Reduce the logging level to WARN

Signed-off-by: stack <stack@apache.org>
2014-10-21 22:02:40 -07:00
Yi Deng 58e9d89c44 HBASE-12243 HBaseFsck should auto set ignorePreCheckPermission to true if no fix option is set (Yi Deng)
Signed-off-by: Jonathan M Hsieh <jmhsieh@apache.org>
2014-10-21 13:35:49 -07:00
Ted Yu 89191230ea HBASE-12302 VisibilityClient getAuths does not propagate remote service exception correctly (Jerry He) 2014-10-21 20:09:14 +00:00
anoopsjohn 67d1cee2d8 HBASE-12202 Support DirectByteBuffer usage in HFileBlock. 2014-10-21 17:59:10 +05:30
stack b416b5988b HBASE-12226 TestAccessController#testPermissionList failing on master (Srikranth Srungarapu) 2014-10-20 20:35:52 -07:00
stack 4485ba1eae HBASE-12278 Race condition in TestSecureLoadIncrementalHFilesSplitRecovery (Dima Spivak) 2014-10-20 11:09:23 -04:00
manukranthk c9f506a297 Add admin endpoint for updating the configuration on the regionserver
Summary: This is a follow up diff for the jira to add the functionality to update configs in an online fashion.

Test Plan: Unit test. This adds an end point on the regionserver. It just tries to call the end point and make sure the call succeeds.

Differential Revision: https://reviews.facebook.net/D24861

Signed-off-by: stack <stack@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerOnlineConfigChange.java
2014-10-18 16:25:03 -04:00
Matteo Bertozzi 0dee72466d HBASE-12161 Add support for grant/revoke on namespaces in AccessControlClient (Srikanth Srungarapu) 2014-10-18 21:16:58 +01:00
Dima Spivak 5e9360d80c HBASE-12229 NullPointerException in SnapshotTestingUtils
* Implemented the waitUntilAllRegionsOnline in HBaseTestingUtility#createTable
* Add waitFor around #isTableAvailable call that previously didn't do anything
* Remove unused byte[] hex

Signed-off-by: stack <stack@apache.org>
2014-10-17 22:51:34 -04:00
Ted Yu cad86cca00 HBASE-12263 RegionServer listens on localhost in distributed cluster when DNS is unavailable 2014-10-17 20:52:15 +00:00
Ted Yu 3feec77421 HBASE-12264 ImportTsv should fail fast if output is not specified and table does not exist (Ashish) 2014-10-17 20:45:05 +00:00
Enis Soztutar 10ebc49130 Update pom.xml version to 0.99.2-SNAPSHOT 2014-10-17 11:32:59 -07:00
Ted Yu be820f3b9b HBASE-12274 Race between RegionScannerImpl#nextInternal() and RegionScannerImpl#close() may produce null pointer exception 2014-10-17 16:04:02 +00:00
Patrick White c68c17ffec HBASE-12271 Add counters for files skipped during snapshot export
Add counters for skipped files

Signed-off-by: Elliott Clark <eclark@apache.org>
2014-10-15 10:42:42 -07:00
manukranthk 5ca2e4c716 HBASE-12258 TestHbaseFsck is flaky and has some multithreading issues
Signed-off-by: Elliott Clark <eclark@apache.org>
2014-10-14 17:44:00 -07:00
stack dc998bf787 HBASE-12247 Replace setHTable() with initializeTable() in TableInputFormat. (Solomon Duskis) 2014-10-14 14:12:23 -07:00
Matteo Bertozzi 711302e18b HBASE-12257 TestAssignmentManager unsynchronized access to regionPlans 2014-10-14 22:07:34 +01:00
stack dbd0ba36f5 HBASE-12147 Porting Online Config Change from 89-fb -- REAPPLY 2014-10-14 12:51:49 -07:00
Nicolas Liochon 921d331fa3 HBASE-4955 Use the official versions of surefire (Alex Newman)
Conflicts:
	pom.xml
2014-10-14 11:40:41 -07:00
stack 2822a289f9 HBASE-12147 Porting Online Config Change from 89-fb -- REVERT 2014-10-14 08:51:37 -07:00
manukranthk 0057cd8ca7 Online config change
Summary: This diff is intended to forward port HBASE-8805 and HBASE-8544 implemented by Gaurav Menghani in 89-fb. This improves operational efficiency in managing clusters that are serving production traffic. The idea is to have a central configuration which can manage notifying the configuration observers. The observers in turn should update their local state from the latest config. Minor caveats where configuration variables are corelated should be taken care of with additional care.

Test Plan: Unit tests

Differential Revision: https://reviews.facebook.net/D24681

Signed-off-by: stack <stack@apache.org>
2014-10-13 21:27:39 -07:00
Rajeshbabu Chintaguntla a6dbddacfb HBASE-10200 Better error message when HttpServer fails to start due to java.net.BindException(Kiran Kumar M R) 2014-10-14 02:26:13 +00:00
stack 8828e0a680 HBASE-12246 Compilation with hadoop-2.3.x and 2.2.x is broken -> HBASE-12220 Add hedgedReads and hedgedReadWins metrics -- REVERT 2014-10-13 15:04:34 -07:00
stack 12ac08ce44 HBASE-12029 Use Table and RegionLocator in HTable.getRegionLocations() (Solomon Duskis)
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestHBaseFsck.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestRegionSizeCalculator.java
2014-10-13 14:52:37 -07:00
stack 9feb31056a HBASE-12242 Fix new javadoc warnings in Admin, etc. 2014-10-13 12:10:19 -07:00
stack a33c78872a HBASE-8361 Bulk load and other utilities should not create tables for user (Ashish Singhi)
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestLoadIncrementalHFiles.java
2014-10-12 21:55:05 -07:00
Elliott Clark e0085d85ae HBASE-12234 Make TestMultithreadedTableMapper a little more stable.
Signed-off-by: stack <stack@apache.org>
2014-10-12 18:39:10 -07:00
Enis Soztutar 7d0be32b1d Update pom.xml version for 0.99.1 2014-10-11 21:56:30 -07:00
Enis Soztutar 8938dc9630 HBASE-12176 WALCellCodec Encoders support for non-KeyValue Cells (Anoop Sam John) 2014-10-11 15:33:31 -07:00
Andrew Purtell 6a37c169fc HBASE-12126 Region server coprocessor endpoint (Virag Kothari) 2014-10-10 12:07:07 -07:00
stack 8c125a40bf HBASE-11394 Replication can have data loss if peer id contains hyphen "-" 2014-10-10 10:28:44 -07:00
Ramkrishna a5b3864121 HBASE-12210 Avoid KeyValue in Prefix Tree 2014-10-10 22:47:37 +05:30
Elliott Clark 052a6f0702 HBASE-12197 Move rest to it's on module 2014-10-10 09:51:20 -07:00
stack 608bb9e308 HBASE-12189 Fix new issues found by coverity static analysis
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/quotas/QuotaState.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/quotas/UserQuotaState.java
2014-10-09 20:51:52 -07:00
stack ab48c0413b HBASE-12212 HBaseTestingUtility#waitUntilAllRegionsAssigned should wait for RegionStates
Signed-off-by: stack <stack@apache.org>
2014-10-09 20:35:36 -07:00
Nick Dimiduk 2918a84070 HBASE-12183 FuzzyRowFilter doesn't support reverse scans 2014-10-09 18:29:57 -07:00
stack 71ed703367 Add hedgedReads and hedgedReadWins count metrics
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestFSUtils.java
2014-10-09 15:02:50 -07:00
stack b19db79968 HBASE-11990 Make setting the start and stop row for a specific prefix easier (Niels Basjes)
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/filter/TestFilterWithScanLimits.java
	src/main/docbkx/book.xml
2014-10-09 11:22:40 -07:00