Commit Graph

14282 Commits

Author SHA1 Message Date
Andrew Purtell e3bd475317 HBASE-19203 Update Hadoop version used for build to 2.7.4 (from 2.5.1) 2017-11-07 12:37:53 -08:00
Umesh Agashe fa3cc6c3bc
HBASE-18961 doMiniBatchMutate() is split into smaller member methods of BatchOperation and it's sub-classes
There is no functionality change except for below:
* Variable lastIndexExclusive was getting incremented while locking rows corresponding to input
  operations. As a result when getRowLockInternal() method throws TimeoutIOException only operations
  in range [nextIndexToProcess, lastIndexExclusive) was getting marked as FAILED before raising
  exception up the call stack. With these changes all operations are getting marked as FAILED.
* Cluster Ids of first mutation is used consistently for entire batch. Previous behavior was to use
  cluster ids of first mutation in a mini-batch

Signed-off-by: Michael Stack <stack@apache.org>
2017-11-07 10:01:28 -08:00
QilinCao 1110910b3a HBASE-19103 Add BigDecimalComparator for filter
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-11-07 03:30:43 -08:00
Michael Stack 57c0fb2561 HBASE-19198 TestIPv6NIOServerSocketChannel fails; unable to bind 2017-11-06 21:21:06 -08:00
Michael Stack f13cf56f1c
HBASE-19197 Move version on branch-2 from 2.0.0-alpha4 to 2.0.0-beta-1.SNAPSHOT 2017-11-06 20:46:38 -08:00
Guanghao Zhang 40dac699bd HBASE-19186 Unify to use bytes to show size in master/rs ui 2017-11-07 10:07:52 +08:00
Josh Elser f4a4144f35 HBASE-19111 Add CellUtil#isPut and deprecate methods returning/expecting non public-api data
KeyValue.Type, and its corresponding byte value, are not public API. We
shouldn't have methods that are expecting them. Added a basic sanity
test for isPut and isDelete.

Signed-off-by: Ramkrishna <ramkrishna.s.vasudevan@intel.com>
2017-11-06 15:37:16 -05:00
Chia-Ping Tsai 43b4aab648 HBASE-19131 (Addendum) Use the emptyList() to replace EMPTY_LIST 2017-11-07 04:06:29 +08:00
tedyu 50f30668b8 HBASE-19160 expose CellComparator as IA.Public - addendum fixes compilation for branch-2 2017-11-06 11:32:26 -08:00
Mike Drob cfddfcf23c HBASE-19160 expose CellComparator as IA.Public 2017-11-06 10:15:55 -06:00
Guanghao Zhang 47c614c706 HBASE-18950 Remove Optional parameters in AsyncAdmin interface 2017-11-06 20:41:20 +08:00
Chia-Ping Tsai 061a73db6d HBASE-19185 ClassNotFoundException: com.fasterxml.jackson.* 2017-11-05 23:31:05 +08:00
anastas 80a9bf0eb6 HBASE-18232 Jumbo Chunks support for the future CellChunkMap index usage 2017-11-05 15:29:48 +02:00
zhangduo 143e4949fe HBASE-19095 Add CP hooks in RegionObserver for in memory compaction 2017-11-05 20:28:11 +08:00
Mike Drob 33ae6dce42 HBASE-18983 fixes from update error-prone to 2.1.1 2017-11-04 21:29:48 -05:00
Chia-Ping Tsai d592b29619 HBASE-19131 Add the ClusterStatus hook and cleanup other hooks which can be replaced by ClusterStatus hook 2017-11-05 09:56:04 +08:00
Guanghao Zhang 1a93fe89cd HBASE-19178 table.rb use undefined method 'getType' for Cell interface 2017-11-05 08:08:46 +08:00
Chia-Ping Tsai b464c1eb35 HBASE-19027 Honor the CellComparator of ScanInfo in scanning over a store 2017-11-05 01:17:55 +08:00
Michael Stack f8c58930aa
HBASE-19179 Remove hbase-prefix-tree 2017-11-04 10:09:46 -07:00
Chia-Ping Tsai cdff80d976 HBASE-19117 Avoid NPE occurring while active master dies 2017-11-04 21:49:15 +08:00
Andrew Purtell 65f620a856 HBASE-19173 Configure IntegrationTestRSGroup automatically for minicluster mode 2017-11-03 23:30:54 -07:00
Michael Stack 3a8e3704cd
HBASE-19716 Remove hbase-native-client from branch-2
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-11-03 23:18:24 -07:00
Sean Busbey 2485da1a60 HBASE-13622 document upgrade rollback.
Signed-off-by: Michael Stack <stack@apache.org>
2017-11-03 19:49:42 -05:00
Andrew Purtell 5df9651581 HBASE-19144 [RSgroups] Retry assignments in FAILED_OPEN state when servers (re)join the cluster 2017-11-03 15:08:19 -07:00
Sean Busbey b9b0f15cdb HBASE-19097 update nightly tests to use Apache Yetus 0.6.0
Signed-off-by: Michael Stack <stack@apache.org>
2017-11-03 15:33:11 -05:00
Michael Stack 0fb3bd2e3c
HBASE-19102 TestZooKeeperMainServer fails with KeeperException
Signed-off-by: Michael Stack <stack@apache.org>
2017-11-03 11:48:53 -07:00
Michael Stack 9dc9d0394d
HBASE-19152 Update refguide 'how to build an RC' and the make_rc.sh script; AMENDMENT adding generation of hashes 2017-11-03 10:06:20 -07:00
Michael Stack 9026d92f59
HBASE-19152 Update refguide 'how to build an RC' and the make_rc.sh script
Removes src.xml used building src tgz via hbase-assembly.
Use git archive instead going forward. Updates developer release candidate
documentation and the make_rc.sh script.

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@cloudera.com>
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-11-03 09:58:18 -07:00
Sean Busbey a9f0c5d4e2 HBASE-18784 if available, query underlying outputstream capabilities where we need hflush/hsync.
* pull things that don't rely on HDFS in hbase-server/FSUtils into hbase-common/CommonFSUtils
* refactor setStoragePolicy so that it can move into hbase-common/CommonFSUtils, as a side effect update it for Hadoop 2.8,3.0+
* refactor WALProcedureStore so that it handles its own FS interactions
* add a reflection-based lookup of stream capabilities
* call said lookup in places where we make WALs to make sure hflush/hsync is available.
* javadoc / checkstyle cleanup on changes as flagged by yetus

Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-11-02 21:54:16 -05:00
Sean Busbey 20cc11e167 HBASE-19124 Move nightly test of source artifact creation from Jenkinsfile to a script.
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-11-02 15:32:35 -05:00
Josh Elser 99cb148150 HBASE-19156 Remove vestiges of an unused regions-per-server CLI argument
Signed-off-by: Ted Yu <tedyu@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2017-11-02 15:00:25 -04:00
Balazs Meszaros 28185c5171
HBASE-18705 bin/hbase does not find cached_classpath.txt
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Michael Stack <stack@apache.org>
2017-11-02 10:08:44 -07:00
zhangduo 547d46cfac HBASE-18972 Use Builder pattern to remove nullable parameters for coprocessor methods in RawAsyncTable interface 2017-11-02 13:58:33 +08:00
Reid Chan e61606231f HBASE-19118 Use SaslUtil to set Sasl.QOP in 'Thrift'
Signed-off-by: Josh Elser <elserj@apache.org>
2017-11-02 00:13:46 -04:00
churro 663f3c7b50 HBASE-19150 TestSnapshotWithAcl is flaky
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-11-01 18:17:50 -07:00
Apekshit Sharma d69570a485 HBASE-18925 Update mockito dependency from mockito-all:1.10.19 to mockito-core:2.1.0 for JDK8 support.
Last mockito-all release was in Dec'14. Mockito-core has had many releases since then.

From mockito's site:
- "Mockito does not produce the mockito-all artifact anymore ; this one was primarily
aimed at ant users, and contained other dependencies. We felt it was time to move on
and remove such artifacts as they cause problems in dependency management system like
maven or gradle."
- anyX() and any(SomeType.class) matchers now reject nulls and check type.
2017-11-01 14:38:50 -07:00
Artem Ervits d407e37cf4 HBASE-19140 hbase-cleanup.sh uses deprecated call to remove files in hdfs
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-11-01 19:17:31 +01:00
Reid Chan 8a3db6eaaf HBASE-17065 Perform more effective sorting for RPC Handler Tasks
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-11-01 10:07:34 -07:00
Chia-Ping Tsai 261cb8a7e4 HBASE-19141 [compat 1-2] getClusterStatus always return empty ClusterStatus
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-11-02 00:47:19 +08:00
tedyu 39e8c16fa8 HBASE-19120 IllegalArgumentException from ZNodeClearer when master shuts down 2017-11-01 09:38:41 -07:00
tedyu f66afa5227 HBASE-19065 HRegion#bulkLoadHFiles() should wait for concurrent Region#flush() to finish 2017-11-01 09:26:26 -07:00
tedyu fc4110a7a9 HBASE-19100 Missing break in catch block of InterruptedException in HRegion#waitForFlushesAndCompactions 2017-11-01 09:11:42 -07:00
Sean Busbey 5a941d8f80 HBASE-19137 Nightly test should make junit reports optional rather than attempt archive after reporting.
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-11-01 09:57:33 -05:00
eshcar 526d2826f5 HBASE-16417: In-memory MemStore Policy for Flattening and Compactions 2017-11-01 16:48:40 +02:00
Michael Stack 426ab1e931 HBASE-19135 TestWeakObjectPool time out 2017-10-31 16:16:56 -07:00
Andrew Purtell 314759652f HBASE-19138 Rare failure in TestLruBlockCache
Wait for the block count to drop to zero after awaiting shutdown of the executor pool
2017-10-31 13:40:55 -07:00
Michael Stack 16012f93a6 HBASE-18770 Remove bypass method in ObserverContext and implement the
'bypass' logic case by case

Changes Coprocessor ObserverContext 'bypass' semantic. We flip the
default so bypass is NOT supported on Observer invocations; only a
couple of preXXX methods in RegionObserver allow it: e.g.  preGet
and prePut but not preFlush, etc. Everywhere else, we throw
a DoesNotSupportBypassException if a Coprocessor Observer
tries to invoke bypass. Master Observers can no longer stop
or change move, split, assign, create table, etc.

Ditto on complete, the mechanism that allowed a Coprocessor
rule that all subsequent Coprocessors are skipped in an
invocation chain; now, complete is only available to
bypassable methods (and Coprocessors will get an exception if
they try to 'complete' when it is not allowed).

See javadoc for whether a Coprocessor Observer method supports
'bypass'. If no mention, 'bypass' is NOT supported.

M hbase-server/src/main/java/org/apache/hadoop/hbase/coprocessor/CoprocessorHost.java
 Added passing of 'bypassable' (and 'completable') and default 'result' argument to
 the Operation constructors rather than pass the excecution engine as parameters.
 Makes it so can clean up RegionObserverHost and make the calling
 clearer regards what is going on.
 Methods that support 'bypass' must set this flag on the Observer.

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
 Refactoring in here is minor. A few methods that used support bypass
 no longer do so removed the check and the need of an if/else meant a
 left-shift in some code.

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
 Ditto

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RegionCoprocessorHost.java
 In here label explicitly those methods that are bypassable.
 Some changes to make sure we call the corresponding execOperation.

TestMasterObserver had a bunch of test of bypass method. All removed or
disabled.

TODO: What to do w/ the Scanner methods.
2017-10-31 12:49:51 -07:00
zhangduo 9dfd77595f HBASE-19130 Typo in HStore.initializeRegionInternals for replaying wal 2017-10-31 21:21:57 +08:00
tedyu 20b7120afb HBASE-18870 Hbase Backup should set the details to MR job name (Vishal Khandelwal) 2017-10-30 19:57:58 -07:00
Guangxu Cheng 83f6f54424 HBASE-19087 Logs should have Optional's value/null instead of Optional[value]/Optional.empty.
Change-Id: I436d02ee91710442d199e63956186a9364852c4e
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-10-30 18:37:55 -07:00