e014e5f8ef
HBASE-19797 Operator priority leads to wrong logic in ReplicationSourceWALReader
2018-01-15 18:10:56 +08:00
204a4539c4
HBASE-19793 Minor improvements on Master/RS startup
2018-01-15 17:54:01 +08:00
8dd4bf8e54
HBASE-19795 Move the tests which only need zookeeper in TestZooKeeper to hbase-zookeeper module
2018-01-15 10:58:03 +08:00
ffa28502c4
HBASE-19768 RegionServer startup failing when DN is dead
2018-01-14 17:31:23 +08:00
026f535a77
HBASE-19787 Fix or disable tests broken in branch-2 so can cut beta-1
...
M dev-support/make_rc.sh
Disable checkstyle building site. Its an issue being fixed over in HBASE-19780
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
The clusterid was being set into the process only after the
regionserver registers with the Master. That can be too late for some
test clients in particular. e.g. TestZKAsyncRegistry needs it as soon
as it goes to run which could be before Master had called its run
method which is regionserver run method which then calls back to the
master to register itself... and only then do we set the clusterid.
HBASE-19694 changed start order which made it so this test failed.
Setting the clusterid right after we set it in zk makes the test pass.
Another change was that backup masters were not going down on stop.
Backup masters were sleeping for the default zk period which is 90
seconds. They were not being woken up to check for stop. On stop
master now tells active master manager.
M hbase-server/src/test/java/org/apache/hadoop/hbase/TestJMXConnectorServer.java
Prevent creation of acl table. Messes up our being able to go down
promptly.
M hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/TestRegionsOnMasterOptions.java
M hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestMultiParallel.java
M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerReadRequestMetrics.java
Disabled for now because it wants to run with regions on the Master...
currently broke!
M hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestZKAsyncRegistry.java
Add a bit of debugging.
M hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDLSAsyncFSWAL.java
Disabled. Fails 40% of the time.
M hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDLSFSHLog.java
Disabled. Fails 33% of the time.
Disabled stochastic load balancer for favored nodes because it fails on
occasion and we are not doing favored nodes in branch-2.
2018-01-12 14:09:23 -08:00
d8271b0361
HBASE-19694 The initialization order for a fresh cluster is incorrect Addendum. Adds in a missing line that helps debugging.
2018-01-12 13:08:27 -08:00
72702eeb70
HBASE-19783 Change replication peer cluster key/endpoint from a not-null value to null is not allowed
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-01-12 21:41:57 +08:00
3e6f80dcd5
HBASE-19746 Add default impl to Cell#getType
2018-01-11 15:04:25 -08:00
1a11fc92b1
HBASE-19694 The initialization order for a fresh cluster is incorrect
...
Become active Master before calling the super class's run method. Have
the wait-on-becoming-active-Master be in-line rather than off in a
background thread (i.e. undo running thread in startActiveMasterManager)
Purge the fragile HBASE-16367 hackery that attempted to fix this issue
previously by adding a latch to try and hold up superclass RegionServer
until cluster id set by subclass Master.
2018-01-11 14:25:25 -08:00
0dacdde0f9
HBASE-19758 Split TestHCM to several smaller tests
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-01-11 11:40:48 -08:00
3849db8f1d
HBASE-11409 - Add more flexibility for input directory structure to LoadIncrementalHFiles
2018-01-11 11:07:47 -08:00
482d413e0a
Revert due to missing jira ticket "Add more flexibility for input directory structure to LoadIncrementalHFiles"
...
This reverts commit d524768528
2018-01-11 11:07:10 -08:00
5d4140e09d
HBASE-19685 Fix TestFSErrorsExposed#testFullSystemBubblesFSErrors by increasing scanner timeout.
...
Signed-off-by: Apekshit Sharma <appy@apache.org>
2018-01-11 10:35:36 -08:00
31fe5dbf6b
Revert due to missing author. "HBASE-19685 Fix TestFSErrorsExposed#testFullSystemBubblesFSErrors by increasing scanner timeout."
...
This reverts commit 0b9dc14dbc
2018-01-11 10:35:32 -08:00
bf3c207785
HBASE-19685 Fix TestFSErrorsExposed#testFullSystemBubblesFSErrors by increasing scanner timeout.
2018-01-11 10:32:26 -08:00
814d08a2d6
HBASE-19751 Use RegionInfo directly instead of an identifier and a namespace when getting WAL
2018-01-11 15:48:33 +08:00
98e56ae4c6
HBASE-19749 Revisit logic of UserScanQueryMatcher#mergeFilterResponse method
2018-01-11 12:06:12 +08:00
47326729fe
HBASE-19740 Repeated error message for NamespaceExistException
2018-01-10 18:26:23 -08:00
d524768528
Add more flexibility for input directory structure to LoadIncrementalHFiles
2018-01-10 13:42:34 -08:00
345b8ba9a1
HBASE-19743 Disable TestMemstoreLABWithoutPool
...
This is a revert of a revert, i.e., a reapplication only this time
I'm pushing w/ the right JIRA number
2018-01-09 18:22:36 -08:00
950ecd2764
Revert "HBASE-19742 Disable TestMemstoreLABWithoutPool"
...
Revert because have wrong JIRA number.
This reverts commit 1454c44bcb
2018-01-09 18:20:37 -08:00
1454c44bcb
HBASE-19742 Disable TestMemstoreLABWithoutPool
2018-01-09 14:32:58 -08:00
3fa3dcd9f9
HBASE-19483 Add proper privilege check for rsgroup commands
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-01-09 08:11:07 -08:00
895267d09c
HBASE-19139 Create Async Admin methods for Clear Block Cache
2018-01-09 14:55:21 +08:00
d9ca212d55
HBASE-19729 UserScanQueryMatcher#mergeFilterResponse should return INCLUDE_AND_SEEK_NEXT_ROW when filterResponse is INCLUDE_AND_SEEK_NEXT_ROW
2018-01-09 07:22:09 +08:00
4c31374a90
HBASE-19731 TestFromClientSide#testCheckAndDeleteWithCompareOp and testNullQualifier are flakey
2018-01-08 10:34:57 -08:00
c8e8f7008d
HBASE-19684 BlockCacheKey toString Performance
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-01-08 17:06:34 +08:00
1e352f6247
HBASE-19358 Improve the stability of splitting log when do fail over
...
Signed-off-by: Yu Li <liyu@apache.org>
2018-01-08 10:57:46 +08:00
a66e923106
HBASE-19712 Fix TestSnapshotQuotaObserverChore#testSnapshotSize
2018-01-08 08:52:28 +08:00
0168c1e6cb
HBASE-19696 Filter returning INCLUDE_AND_NEXT_COL doesn't skip remaining versions when scan has explicit columns (Ankit Singhal)
2018-01-07 07:50:33 -08:00
443b27b707
HBASE-19709 Ensure that we don't set a poolSize of 0
...
In some situations, Runtime.getRuntime().getAvailableProcessors()
may return 0 which would result in calculatePoolSize returning 0
which will trigger an exception. Guard against this case.
Signed-off-by: Reid Chan <reidddchan@outlook.com>
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
2018-01-05 18:36:50 -05:00
ce80e8e38f
HBASE-19651 Remove LimitInputStream; AMENDMENT: fix compile
2018-01-05 17:28:40 -06:00
88c7493948
HBASE-19651 Remove LimitInputStream
2018-01-05 17:01:50 -06:00
e7da907c3c
Revert "HBASE-19651 Remove LimitInputStream"
...
Revert to fix author.
This reverts commit 4c19e1f4e3
2018-01-05 16:59:59 -06:00
4c19e1f4e3
HBASE-19651 Remove LimitInputStream
...
Signed-off-by: Beluga Behr <dam6923@gmail.com>
2018-01-05 08:38:12 -06:00
e35fec284d
HBASE-19688 TimeToLiveProcedureWALCleaner should extends BaseLogCleanerDelegate
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-01-04 10:26:51 -08:00
654edc5fa5
HBASE-19596 RegionMetrics/ServerMetrics/ClusterMetrics should apply to all public classes
2018-01-04 13:05:21 +08:00
f993425f01
HBASE-19490 Rare failure in TestRateLimiter
2018-01-04 10:43:26 +08:00
59558f020f
HBASE-19613 Miscellaneous changes to WALSplitter.
...
* Use ArrayList instead LinkedList
* Use Apache Commons where appropriate
* Parameterize and improve logging
2018-01-03 18:39:14 -08:00
16e8422855
HBASE-18806 VerifyRep by snapshot need not to restore snapshot for each mapper
2018-01-04 10:12:53 +08:00
f0011ebfe0
HBASE-19691 Removes Global(A) requirement for getClusterStatus
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-01-03 19:02:26 -05:00
97dc7d87cd
HBASE-19654 Remove misleading and chatty debug message in ReplicationLogCleaner
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-01-03 06:58:57 -08:00
47a264a6aa
HBASE-19620 Add UT to confirm the race in MasterRpcServices.getProcedureResult
2018-01-03 20:29:02 +08:00
37f846dc0c
HBASE-19666 TestDefaultCompactSelection test failed
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-01-03 19:12:17 +08:00
76580fa991
HBASE-19675 Miscellaneous HStore Class Improvements.
...
* Use HashSet instead of List for a variable which is only used for lookups
* Remove logging code guards in favor of slf4j parameters
* Use CollectionsUtils.isEmpty() consistently
* Small check-style fixes
2018-01-02 15:21:15 -08:00
97c770a1d3
HBASE-19667 Get rid of MasterEnvironment#supportGroupCPs
2018-01-03 05:03:57 +08:00
69e161cf64
HBASE-19676 CleanerChore logging improvements (BELUGA BEHR)
2018-01-02 06:27:41 -08:00
488797f4bb
HBASE-19658: Fixing small problem and enabling test
2018-01-02 12:54:05 +02:00
99399cdeef
HBASE-19671 Fix TestMultiParallel#testActiveThreadsCount
2018-01-02 17:05:47 +08:00
3f1cfc8f08
HBASE-19679 Superusers Logging and Data Structures (BELUGA BEHR)
2018-01-01 14:19:04 -08:00
c394f3919e
HBASE-19678 HBase Admin security capabilities should be represented as a Set - revert due to wrong issue
2018-01-01 14:16:46 -08:00
c2ca90f0fb
HBASE-19678 HBase Admin security capabilities should be represented as a Set (BELUGA BEHR)
2017-12-31 11:32:14 -08:00
2f5ca9010b
HBASE-19677 Miscellaneous HFileCleaner Improvements (BELUGA BEHR)
2017-12-31 09:47:53 -08:00
5b3513a5ee
HBASE-19672 Correct comments for default values of major compaction in SortedCompactionPolicy#getNextMajorCompactTime()
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-12-30 16:28:09 -08:00
24b7fc92f0
HBASE-19649 Use singleton feature for ImmutableSegment
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-12-30 06:42:24 +08:00
9e141d12a4
HBASE-8518 Get rid of hbase.hstore.compaction.complete setting
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-12-30 04:32:12 +08:00
5612f2f692
HBASE-19428 Deprecate the compareTo(Row)
2017-12-29 20:07:21 +08:00
0907563eb7
HBASE-19282: Making CellChunkMap the default index (CellSet delegatee) for ImmutableSegments, when MSLAB is used.
...
In order to avoid additional user settings. If no MSLAB is requested the index is going to be CellArrayMap
Signed-off-by: Anastasia Braginsky <anastas@yahoo-inc.com>
Signed-off-by: Michael Stack <stack@apache.org>
2017-12-28 16:49:56 -08:00
b4e3798bb9
HBASE-19660 Up default retries from 10 to 15 and blocking store files limit from 10 to 16
2017-12-28 15:02:23 -08:00
a8ef734ddd
HBASE-19651 Remove LimitInputStream
...
Signed-off-by: Beluga Behr <dam6923@gmail.com>
2017-12-28 13:08:46 -08:00
d8775d08ae
HBASE-19656 Disable TestAssignmentManagerMetrics for beta-1
2017-12-28 12:15:00 -08:00
f96f89157d
HBASE-19133 Transfer big cells or upserted/appended cells into
...
MSLAB upon flattening to CellChunkMap
Signed-off-by: Gali Sheffi <gsheffi@oath.com>
2017-12-28 10:53:06 -08:00
64cb777a8a
HBASE-19552 find-and-replace thirdparty offset
2017-12-28 12:01:25 -06:00
968b938fde
HBASE-19552 Update hbase-thirdparty version
...
Some manual cleanup of changing package names in pom files and getting
rid of the no-longer-needed netty system property.
This commit will break compilation, package renames in source code are
done in follow-on commits using straightforward find and replace.
's/org.apache.hadoop.hbase.shaded.com.google/org.apache.hbase.thirdparty.com.google/'
's/org.apache.hadoop.hbase.shaded.io.netty/org.apache.hbase.thirdparty.io.netty/'
2017-12-28 11:58:49 -06:00
33ce14cb29
HBASE-19643 Need to update cache location when get error in AsyncBatchRpcRetryingCaller
2017-12-28 14:44:17 +08:00
97f0aad66e
HBASE-19626 Rename Cell.DataType to Cell.Type
2017-12-28 12:59:28 +08:00
50348cc1a4
HBASE-19652 Turn down CleanerChore logging; too chatty
2017-12-27 20:50:46 -08:00
d6d8369655
HBASE-19648 Move branch-2 version from 2.0.0-beta-1-SNAPSHOT to 2.0.0-beta-1
2017-12-27 14:41:19 -08:00
e4ab29ada2
HBASE-19647 Logging cleanups; emit regionname when RegionTooBusyException inside RetriesExhausted... make netty connect/disconnect TRACE-level; ADDENDUM
2017-12-27 14:14:37 -08:00
7dee1bcd31
HBASE-19644 add the checkstyle rule to reject the illegal imports
2017-12-28 04:17:45 +08:00
cc8b37f847
HBASE-19647 Logging cleanups; emit regionname when RegionTooBusyException inside RetriesExhausted... make netty connect/disconnect TRACE-level
2017-12-27 11:56:40 -08:00
2468f30029
HBASE-19628 ByteBufferCell should extend ExtendedCell
2017-12-27 23:02:18 +08:00
0454a389a3
HBASE-19629 RawCell#getTags should return the Iterator<Tag> in order to avoid iterating through whole tag array at once
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-12-27 21:30:08 +08:00
9c9beb79ef
HBASE-19615 CompositeImmutableSegment ArrayList Instead of LinkedList
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-12-27 10:00:51 +08:00
f0781d49e4
HBASE-19624 TestIOFencing hangs
2017-12-27 09:38:17 +08:00
8362b0dba5
HBASE-19550 Wrap the cell passed via Mutation#add(Cell) to be of ExtendedCell
2017-12-26 16:43:01 +08:00
2abf7b508c
HBASE-19621 Revisit the methods in ReplicationPeerConfigBuilder
2017-12-26 14:44:07 +08:00
65159dc256
HBASE-19618 Remove replicationQueuesClient.class/replicationQueues.class config and remove table based ReplicationQueuesClient/ReplicationQueues implementation
2017-12-26 14:44:02 +08:00
33f2e6535c
HBASE-19608 Race in MasterRpcServices.getProcedureResult
2017-12-25 11:52:38 +08:00
1e490dcc11
HBASE-19602 Cleanup the usage of ReplicationAdmin from document
2017-12-23 19:05:04 +08:00
b552eb2ff9
HBASE-19576 Introduce builder for ReplicationPeerConfig and make it immutable
2017-12-23 19:04:58 +08:00
96ae9add68
HBASE-19514 TestJMXListener now uses random port
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2017-12-22 18:46:52 +01:00
79d4f6c11c
HBASE-19593 Possible NPE if wal is closed during waledit append.(Rajeshabbu)
2017-12-22 17:21:30 +05:30
d4af099e9e
HBASE-19496 Reusing the ByteBuffer in rpc layer corrupt the ServerLoad and RegionLoad
2017-12-22 18:58:08 +08:00
3a210d514c
HBASE-19590 Remove the duplicate code in deprecated ReplicationAdmin
2017-12-22 18:36:28 +08:00
11ea19a101
HBASE-19589 New regions should always be added with state CLOSED (followup of HBASE-19530)
2017-12-21 22:58:28 -08:00
c89cfd3406
HBASE--17248 fix javadoc in SimpleRegionNormalizer
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-12-21 21:35:50 -08:00
a150062bfb
HBASE-19148 Reevaluate default values of configurations; minor ADDENDUM
2017-12-21 14:13:23 -08:00
18987ed867
HBASE-19148 Reevaluate default values of configurations
...
Removed unused:
<name>hbase.fs.tmp.dir</name>
Added hbase.master.loadbalance.bytable
Edit of description text. Moved stuff around to put configs beside each
other.
M hbase-server/src/main/java/org/apache/hadoop/hbase/util/ServerCommandLine.java
Emit some hbase configs in log on startup.
Signed-off-by: Michael Stack <stack@apache.org>
2017-12-21 14:07:47 -08:00
4aec7a491a
HBASE-19575 add copy constructor to Mutation
2017-12-22 03:19:47 +08:00
bf998077b9
HBASE-19578 MasterProcWALs cleaning is incorrect
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-12-21 09:39:31 -08:00
a82f89bd3c
HBASE-10092 Addendum fix TestAssignProcedure and TestWALEntrySinkFilter
2017-12-21 21:45:09 +08:00
69ea6928bc
HBASE-19559 Fix TestLogRolling.testLogRollOnDatanodeDeath
2017-12-21 15:20:31 +08:00
992b5d8630
HBASE-10092 Move up on to log4j2
...
Changes:
- replaced commons-logging to slf4j everywhere
- log.XXX(Throwable) calls were replaced with log.XXX(t.toString(), t)
- log.XXX(Object) calls were replaced with log.XXX(Objects.toString(obj))
- log.fatal() calls were replaced with log.error(HBaseMarkers.FATAL, ...)
- programmatic log4j configuration was removed from the unit test
This commit does not affect the current logging configurations, because log4j
is still on the classpath. slf4j-log4j12 binds log4j to slf4j.
Signed-off-by: Michael Stack <stack@apache.org>
2017-12-20 22:58:12 -08:00
13d9e8088c
HBASE-19218 Master stuck thinking hbase:namespace is assigned after restart preventing intialization
...
Signed-off-by: Li Xiang <easyliangjob@gmail.com>
2017-12-20 21:47:50 -08:00
0a5ef1ed88
HBASE-19542 fix TestSafemodeBringsDownMaster
2017-12-21 10:28:19 +08:00
0887cdf1da
HBASE-19567 ClassNotFoundException:
...
org.apache.hadoop.hbase.KeyValue$RawBytesComparator starting 2.0.0 over
a 0.98.25 data.
2017-12-20 11:21:56 -08:00
4fad3d96c9
HBASE-19554 For debug: Modify HTU.waitUntilAllRegionsAssigned to handle the case where we do not have entries for the given table
2017-12-20 10:22:08 -08:00
728d5ec041
HBASE-19561 maxCacheSize in CacheEvictionStats can't be accumulated repeatedly When dealing with each region
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-12-20 07:05:30 -08:00
c63cc68c01
HBASE-19492 (addendum) Add EXCLUDE_NAMESPACE and EXCLUDE_TABLECFS support to replication peer config
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-12-20 20:49:16 +08:00
zhangduo
Michael Stack
Guanghao Zhang
Chia-Ping Tsai
Rahul Gidwani
Apekshit Sharma
huzheng
tedyu
Rahul Gidwani
Guangxu Cheng
BELUGA BEHR
Jingyun Tian
Josh Elser
Reid Chan
Balazs Meszaros
anastas
Xiang Li
brandboat
gsheffi
Mike Drob
Vasudevan
Rajeshbabu Chintaguntla
Daisuke
Peter Somogyi