Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
14,660 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

6423 Commits

Author SHA1 Message Date
Apekshit Sharma 31fe5dbf6b Revert due to missing author. "HBASE-19685 Fix TestFSErrorsExposed#testFullSystemBubblesFSErrors by increasing scanner timeout." 
This reverts commit 0b9dc14dbc.
 2018-01-11 10:35:32 -08:00
Apekshit Sharma bf3c207785 HBASE-19685 Fix TestFSErrorsExposed#testFullSystemBubblesFSErrors by increasing scanner timeout. 2018-01-11 10:32:26 -08:00
zhangduo 814d08a2d6 HBASE-19751 Use RegionInfo directly instead of an identifier and a namespace when getting WAL 2018-01-11 15:48:33 +08:00
huzheng 98e56ae4c6 HBASE-19749 Revisit logic of UserScanQueryMatcher#mergeFilterResponse method 2018-01-11 12:06:12 +08:00
tedyu 47326729fe HBASE-19740 Repeated error message for NamespaceExistException 2018-01-10 18:26:23 -08:00
Rahul Gidwani d524768528 Add more flexibility for input directory structure to LoadIncrementalHFiles 2018-01-10 13:42:34 -08:00
Michael Stack 345b8ba9a1 HBASE-19743 Disable TestMemstoreLABWithoutPool 
This is a revert of a revert, i.e., a reapplication only this time
I'm pushing w/ the right JIRA number
 2018-01-09 18:22:36 -08:00
Michael Stack 950ecd2764 Revert "HBASE-19742 Disable TestMemstoreLABWithoutPool" 
Revert because have wrong JIRA number.

This reverts commit 1454c44bcb.
 2018-01-09 18:20:37 -08:00
Michael Stack 1454c44bcb HBASE-19742 Disable TestMemstoreLABWithoutPool 2018-01-09 14:32:58 -08:00
Guangxu Cheng 3fa3dcd9f9 HBASE-19483 Add proper privilege check for rsgroup commands 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-01-09 08:11:07 -08:00
Guanghao Zhang 895267d09c HBASE-19139 Create Async Admin methods for Clear Block Cache 2018-01-09 14:55:21 +08:00
huzheng d9ca212d55 HBASE-19729 UserScanQueryMatcher#mergeFilterResponse should return INCLUDE_AND_SEEK_NEXT_ROW when filterResponse is INCLUDE_AND_SEEK_NEXT_ROW 2018-01-09 07:22:09 +08:00
zhangduo 4c31374a90
HBASE-19731 TestFromClientSide#testCheckAndDeleteWithCompareOp and testNullQualifier are flakey 2018-01-08 10:34:57 -08:00
BELUGA BEHR c8e8f7008d HBASE-19684 BlockCacheKey toString Performance 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2018-01-08 17:06:34 +08:00
Jingyun Tian 1e352f6247 HBASE-19358 Improve the stability of splitting log when do fail over 
Signed-off-by: Yu Li <liyu@apache.org>
 2018-01-08 10:57:46 +08:00
Chia-Ping Tsai a66e923106 HBASE-19712 Fix TestSnapshotQuotaObserverChore#testSnapshotSize 2018-01-08 08:52:28 +08:00
tedyu 0168c1e6cb HBASE-19696 Filter returning INCLUDE_AND_NEXT_COL doesn't skip remaining versions when scan has explicit columns (Ankit Singhal) 2018-01-07 07:50:33 -08:00
Josh Elser 443b27b707 HBASE-19709 Ensure that we don't set a poolSize of 0 
In some situations, Runtime.getRuntime().getAvailableProcessors()
may return 0 which would result in calculatePoolSize returning 0
which will trigger an exception. Guard against this case.

Signed-off-by: Reid Chan <reidddchan@outlook.com>
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
 2018-01-05 18:36:50 -05:00
Michael Stack ce80e8e38f
HBASE-19651 Remove LimitInputStream; AMENDMENT: fix compile 2018-01-05 17:28:40 -06:00
Beluga Behr 88c7493948
HBASE-19651 Remove LimitInputStream 2018-01-05 17:01:50 -06:00
Michael Stack e7da907c3c
Revert "HBASE-19651 Remove LimitInputStream" 
Revert to fix author.

This reverts commit 4c19e1f4e3.
 2018-01-05 16:59:59 -06:00
Michael Stack 4c19e1f4e3
HBASE-19651 Remove LimitInputStream 
Signed-off-by: Beluga Behr <dam6923@gmail.com>
 2018-01-05 08:38:12 -06:00
Reid Chan e35fec284d HBASE-19688 TimeToLiveProcedureWALCleaner should extends BaseLogCleanerDelegate 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-01-04 10:26:51 -08:00
Chia-Ping Tsai 654edc5fa5 HBASE-19596 RegionMetrics/ServerMetrics/ClusterMetrics should apply to all public classes 2018-01-04 13:05:21 +08:00
Chia-Ping Tsai f993425f01 HBASE-19490 Rare failure in TestRateLimiter 2018-01-04 10:43:26 +08:00
BELUGA BEHR 59558f020f HBASE-19613 Miscellaneous changes to WALSplitter. 
* Use ArrayList instead LinkedList
* Use Apache Commons where appropriate
* Parameterize and improve logging
 2018-01-03 18:39:14 -08:00
huzheng 16e8422855 HBASE-18806 VerifyRep by snapshot need not to restore snapshot for each mapper 2018-01-04 10:12:53 +08:00
Josh Elser f0011ebfe0 HBASE-19691 Removes Global(A) requirement for getClusterStatus 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2018-01-03 19:02:26 -05:00
Reid Chan 97dc7d87cd HBASE-19654 Remove misleading and chatty debug message in ReplicationLogCleaner 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-01-03 06:58:57 -08:00
zhangduo 47a264a6aa HBASE-19620 Add UT to confirm the race in MasterRpcServices.getProcedureResult 2018-01-03 20:29:02 +08:00
Balazs Meszaros 37f846dc0c HBASE-19666 TestDefaultCompactSelection test failed 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2018-01-03 19:12:17 +08:00
BELUGA BEHR 76580fa991 HBASE-19675 Miscellaneous HStore Class Improvements. 
* Use HashSet instead of List for a variable which is only used for lookups
* Remove logging code guards in favor of slf4j parameters
* Use CollectionsUtils.isEmpty() consistently
* Small check-style fixes
 2018-01-02 15:21:15 -08:00
Chia-Ping Tsai 97c770a1d3 HBASE-19667 Get rid of MasterEnvironment#supportGroupCPs 2018-01-03 05:03:57 +08:00
tedyu 69e161cf64 HBASE-19676 CleanerChore logging improvements (BELUGA BEHR) 2018-01-02 06:27:41 -08:00
anastas 488797f4bb HBASE-19658: Fixing small problem and enabling test 2018-01-02 12:54:05 +02:00
Chia-Ping Tsai 99399cdeef HBASE-19671 Fix TestMultiParallel#testActiveThreadsCount 2018-01-02 17:05:47 +08:00
tedyu 3f1cfc8f08 HBASE-19679 Superusers Logging and Data Structures (BELUGA BEHR) 2018-01-01 14:19:04 -08:00
tedyu c394f3919e HBASE-19678 HBase Admin security capabilities should be represented as a Set - revert due to wrong issue 2018-01-01 14:16:46 -08:00
tedyu c2ca90f0fb HBASE-19678 HBase Admin security capabilities should be represented as a Set (BELUGA BEHR) 2017-12-31 11:32:14 -08:00
tedyu 2f5ca9010b HBASE-19677 Miscellaneous HFileCleaner Improvements (BELUGA BEHR) 2017-12-31 09:47:53 -08:00
Xiang Li 5b3513a5ee HBASE-19672 Correct comments for default values of major compaction in SortedCompactionPolicy#getNextMajorCompactTime() 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-12-30 16:28:09 -08:00
BELUGA BEHR 24b7fc92f0 HBASE-19649 Use singleton feature for ImmutableSegment 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2017-12-30 06:42:24 +08:00
brandboat 9e141d12a4 HBASE-8518 Get rid of hbase.hstore.compaction.complete setting 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2017-12-30 04:32:12 +08:00
Chia-Ping Tsai 5612f2f692 HBASE-19428 Deprecate the compareTo(Row) 2017-12-29 20:07:21 +08:00
anastas 0907563eb7 HBASE-19282: Making CellChunkMap the default index (CellSet delegatee) for ImmutableSegments, when MSLAB is used. 
In order to avoid additional user settings. If no MSLAB is requested the index is going to be CellArrayMap

Signed-off-by: Anastasia Braginsky <anastas@yahoo-inc.com>
Signed-off-by: Michael Stack <stack@apache.org>
 2017-12-28 16:49:56 -08:00
Michael Stack b4e3798bb9 HBASE-19660 Up default retries from 10 to 15 and blocking store files limit from 10 to 16 2017-12-28 15:02:23 -08:00
Michael Stack a8ef734ddd HBASE-19651 Remove LimitInputStream 
Signed-off-by: Beluga Behr <dam6923@gmail.com>
 2017-12-28 13:08:46 -08:00
Michael Stack d8775d08ae HBASE-19656 Disable TestAssignmentManagerMetrics for beta-1 2017-12-28 12:15:00 -08:00
gsheffi f96f89157d HBASE-19133 Transfer big cells or upserted/appended cells into 
MSLAB upon flattening to CellChunkMap

Signed-off-by: Gali Sheffi <gsheffi@oath.com>
 2017-12-28 10:53:06 -08:00
Mike Drob 64cb777a8a HBASE-19552 find-and-replace thirdparty offset 2017-12-28 12:01:25 -06:00
Mike Drob 968b938fde HBASE-19552 Update hbase-thirdparty version 
Some manual cleanup of changing package names in pom files and getting
rid of the no-longer-needed netty system property.

This commit will break compilation, package renames in source code are
done in follow-on commits using straightforward find and replace.

's/org.apache.hadoop.hbase.shaded.com.google/org.apache.hbase.thirdparty.com.google/'
's/org.apache.hadoop.hbase.shaded.io.netty/org.apache.hbase.thirdparty.io.netty/'
 2017-12-28 11:58:49 -06:00
Guanghao Zhang 33ce14cb29 HBASE-19643 Need to update cache location when get error in AsyncBatchRpcRetryingCaller 2017-12-28 14:44:17 +08:00
Chia-Ping Tsai 97f0aad66e HBASE-19626 Rename Cell.DataType to Cell.Type 2017-12-28 12:59:28 +08:00
Michael Stack 50348cc1a4 HBASE-19652 Turn down CleanerChore logging; too chatty 2017-12-27 20:50:46 -08:00
Michael Stack d6d8369655
HBASE-19648 Move branch-2 version from 2.0.0-beta-1-SNAPSHOT to 2.0.0-beta-1 2017-12-27 14:41:19 -08:00
Michael Stack e4ab29ada2 HBASE-19647 Logging cleanups; emit regionname when RegionTooBusyException inside RetriesExhausted... make netty connect/disconnect TRACE-level; ADDENDUM 2017-12-27 14:14:37 -08:00
Chia-Ping Tsai 7dee1bcd31 HBASE-19644 add the checkstyle rule to reject the illegal imports 2017-12-28 04:17:45 +08:00
Michael Stack cc8b37f847 HBASE-19647 Logging cleanups; emit regionname when RegionTooBusyException inside RetriesExhausted... make netty connect/disconnect TRACE-level 2017-12-27 11:56:40 -08:00
Chia-Ping Tsai 2468f30029 HBASE-19628 ByteBufferCell should extend ExtendedCell 2017-12-27 23:02:18 +08:00
Vasudevan 0454a389a3 HBASE-19629 RawCell#getTags should return the Iterator<Tag> in order to avoid iterating through whole tag array at once 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2017-12-27 21:30:08 +08:00
BELUGA BEHR 9c9beb79ef HBASE-19615 CompositeImmutableSegment ArrayList Instead of LinkedList 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2017-12-27 10:00:51 +08:00
Chia-Ping Tsai f0781d49e4 HBASE-19624 TestIOFencing hangs 2017-12-27 09:38:17 +08:00
Chia-Ping Tsai 8362b0dba5 HBASE-19550 Wrap the cell passed via Mutation#add(Cell) to be of ExtendedCell 2017-12-26 16:43:01 +08:00
Guanghao Zhang 2abf7b508c HBASE-19621 Revisit the methods in ReplicationPeerConfigBuilder 2017-12-26 14:44:07 +08:00
Guanghao Zhang 65159dc256 HBASE-19618 Remove replicationQueuesClient.class/replicationQueues.class config and remove table based ReplicationQueuesClient/ReplicationQueues implementation 2017-12-26 14:44:02 +08:00
zhangduo 33f2e6535c HBASE-19608 Race in MasterRpcServices.getProcedureResult 2017-12-25 11:52:38 +08:00
Guanghao Zhang 1e490dcc11 HBASE-19602 Cleanup the usage of ReplicationAdmin from document 2017-12-23 19:05:04 +08:00
Guanghao Zhang b552eb2ff9 HBASE-19576 Introduce builder for ReplicationPeerConfig and make it immutable 2017-12-23 19:04:58 +08:00
tedyu 96ae9add68 HBASE-19514 TestJMXListener now uses random port 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2017-12-22 18:46:52 +01:00
Rajeshbabu Chintaguntla 79d4f6c11c HBASE-19593 Possible NPE if wal is closed during waledit append.(Rajeshabbu) 2017-12-22 17:21:30 +05:30
Chia-Ping Tsai d4af099e9e HBASE-19496 Reusing the ByteBuffer in rpc layer corrupt the ServerLoad and RegionLoad 2017-12-22 18:58:08 +08:00
Guanghao Zhang 3a210d514c HBASE-19590 Remove the duplicate code in deprecated ReplicationAdmin 2017-12-22 18:36:28 +08:00
Apekshit Sharma 11ea19a101 HBASE-19589 New regions should always be added with state CLOSED (followup of HBASE-19530) 2017-12-21 22:58:28 -08:00
Daisuke c89cfd3406 HBASE--17248 fix javadoc in SimpleRegionNormalizer 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-12-21 21:35:50 -08:00
Michael Stack a150062bfb
HBASE-19148 Reevaluate default values of configurations; minor ADDENDUM 2017-12-21 14:13:23 -08:00
Michael Stack 18987ed867
HBASE-19148 Reevaluate default values of configurations 
Removed unused:
    <name>hbase.fs.tmp.dir</name>
Added hbase.master.loadbalance.bytable

Edit of description text. Moved stuff around  to put configs beside each
other.

M hbase-server/src/main/java/org/apache/hadoop/hbase/util/ServerCommandLine.java

 Emit some hbase configs in log on startup.

Signed-off-by: Michael Stack <stack@apache.org>
 2017-12-21 14:07:47 -08:00
Chia-Ping Tsai 4aec7a491a HBASE-19575 add copy constructor to Mutation 2017-12-22 03:19:47 +08:00
Peter Somogyi bf998077b9 HBASE-19578 MasterProcWALs cleaning is incorrect 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-12-21 09:39:31 -08:00
zhangduo a82f89bd3c HBASE-10092 Addendum fix TestAssignProcedure and TestWALEntrySinkFilter 2017-12-21 21:45:09 +08:00
zhangduo 69ea6928bc HBASE-19559 Fix TestLogRolling.testLogRollOnDatanodeDeath 2017-12-21 15:20:31 +08:00
Balazs Meszaros 992b5d8630 HBASE-10092 Move up on to log4j2 
Changes:
- replaced commons-logging to slf4j everywhere
- log.XXX(Throwable) calls were replaced with log.XXX(t.toString(), t)
- log.XXX(Object) calls were replaced with log.XXX(Objects.toString(obj))
- log.fatal() calls were replaced with log.error(HBaseMarkers.FATAL, ...)
- programmatic log4j configuration was removed from the unit test

This commit does not affect the current logging configurations, because log4j
is still on the classpath. slf4j-log4j12 binds log4j to slf4j.

Signed-off-by: Michael Stack <stack@apache.org>
 2017-12-20 22:58:12 -08:00
Michael Stack 13d9e8088c HBASE-19218 Master stuck thinking hbase:namespace is assigned after restart preventing intialization 
Signed-off-by: Li Xiang <easyliangjob@gmail.com>
 2017-12-20 21:47:50 -08:00
Chia-Ping Tsai 0a5ef1ed88 HBASE-19542 fix TestSafemodeBringsDownMaster 2017-12-21 10:28:19 +08:00
Michael Stack 0887cdf1da
HBASE-19567 ClassNotFoundException: 
org.apache.hadoop.hbase.KeyValue$RawBytesComparator starting 2.0.0 over
a 0.98.25 data.
 2017-12-20 11:21:56 -08:00
zhangduo 4fad3d96c9
HBASE-19554 For debug: Modify HTU.waitUntilAllRegionsAssigned to handle the case where we do not have entries for the given table 2017-12-20 10:22:08 -08:00
Guangxu Cheng 728d5ec041 HBASE-19561 maxCacheSize in CacheEvictionStats can't be accumulated repeatedly When dealing with each region 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-12-20 07:05:30 -08:00
Guanghao Zhang c63cc68c01 HBASE-19492 (addendum) Add EXCLUDE_NAMESPACE and EXCLUDE_TABLECFS support to replication peer config 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2017-12-20 20:49:16 +08:00
Vasudevan 5be25bcf6b HBASE-19468 FNFE during scans and flushes (Ram) 2017-12-20 11:11:06 +05:30
Michael Stack f80d2e9c8e
HBASE-19558 TestRegionsOnMasterOptions hack so it works reliably 2017-12-19 15:59:30 -08:00
Yi Liang 1d7b0a9958
HBASE-19556: Remove TestAssignmentManager#testGoodSplit, which no longer make sense 2017-12-19 13:53:37 -08:00
Michael Stack 31ebd24b7d
HBASE-19494 Create simple WALKey filter that can be plugged in on the Replication Sink 
Implement new WALEntrySinkFilter (as opposed to WALEntryFilter) and
specify the implmentation (with a no-param constructor) in config
using property hbase.replication.sink.walentrysinkfilter

Signed-off-by: wolfgang hoschek whoscheck@cloudera.com
 2017-12-19 13:50:09 -08:00
Peter Somogyi ef509f2ac7 HBASE-19555 TestSplitTransactionOnCluster is flaky 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-12-19 09:26:42 -08:00
Guanghao Zhang 60cd494d1c HBASE-19492 Add EXCLUDE_NAMESPACE and EXCLUDE_TABLECFS support to replication peer config 2017-12-19 16:57:38 +08:00
tedyu 1fd22a7b0f HBASE-19532 AssignProcedure#COMPARATOR may produce incorrect sort order 2017-12-18 18:33:27 -08:00
Michael Stack 495bedea35
HBASE-19122 Suspect methods on Cell to be deprecated 2017-12-18 15:23:03 -08:00
Yun Chi-Shih 5895719420 HBASE-19531 Remove needless volatile declaration 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2017-12-19 00:40:37 +08:00
QilinCao 07d20b2d18 HBASE-19521 HBase mob compaction needs to check hfile version 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-12-18 08:32:51 -08:00
zhangduo c0740b84ef HBASE-19546 TestMasterReplication.testCyclicReplication2 uses wrong assertion 2017-12-18 19:59:19 +08:00
Chia-Ping Tsai 1ca2d10299 HBASE-18309 (addendum) fix NPE in LogCleaner 2017-12-17 17:30:33 +08:00
Guanghao Zhang 8fa08b56f3 HBASE-19522 The complete order may be wrong in AsyncBufferedMutatorImpl 2017-12-16 14:09:35 +08:00