huzheng
48aca4db30
HBASE-21957 Unify refCount of BucketEntry and refCount of hbase.nio.ByteBuff into one
2019-06-24 10:25:32 +08:00
huzheng
773c0d6635
HBASE-22159 ByteBufferIOEngine should support write off-heap ByteBuff to the bufferArray
2019-06-24 10:25:32 +08:00
huzheng
d1eb6171f9
HBASE-22127 Ensure that the block cached in the LRUBlockCache offheap is allocated from heap
2019-06-24 10:25:32 +08:00
huzheng
35b818606f
HBASE-22005 Use ByteBuff's refcnt to track the life cycle of data block
2019-06-24 10:25:31 +08:00
huzheng
532ebfb7a5
HBASE-21916 Abstract an ByteBuffAllocator to allocate/free ByteBuffer in ByteBufferPool
2019-06-24 10:25:31 +08:00
Sean Busbey
9aee88e03a
HBASE-22615 Make TestChoreService more robust to timing
...
* phrase fudge factor "deltas" in terms of the original period
* increase the delta allowed for chore timing from 5% to 20%
* improve some assertions
Closes #328
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Sakthi <sakthivel.azhaku@gmail.com>
2019-06-22 00:07:10 -05:00
Mingliang Liu
6d08ffcfc6
HBASE-21284 Default limits for PressureAwareCompactionThroughputController are too low
...
This is a forward port HBASE-21000 from branch-1.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-06-20 12:44:01 -07:00
zhangduo
5d872d3422
HBASE-21526 Use AsyncClusterConnection in ServerManager for getRsAdmin
2019-06-18 08:35:58 +08:00
zhangduo
30c131b5f7
HBASE-21515 Also initialize an AsyncClusterConnection in HRegionServer
2019-06-18 08:35:58 +08:00
Jan Hentschel
5da5deb59d
HBASE-22344 Documented the deprecation of public and limited private APIs ( #208 )
...
Signed-off-by: stack <stack@apache.org>
2019-06-17 22:02:23 +02:00
Murtaza Hassan
9ba7651889
HBASE-22565 Javadoc Warnings: @see cannot be used in inline documentation
2019-06-13 23:09:42 +02:00
Sakthi
0445186f1a
HBASE-22458: TestClassFinder fails when run on JDK11
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-06-13 08:31:08 -05:00
Sakthi
9b23e1d00c
HBASE-22534 TestCellUtil fails when run on JDK11
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-06-04 14:10:37 -05:00
Sean Busbey
51c49a1784
HBASE-22497 Mark HBase 1.2 line as EOM
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-06-03 06:55:58 -05:00
Duo Zhang
1be93fcaec
HBASE-22316 Record the stack trace for current thread in FutureUtils.get
2019-05-30 11:10:06 +08:00
Wellington Chevreuil
25c6cd3a4f
HBASE-22496 UnsafeAccess.unsafeCopy should not copy more than UNSAFE_COPY_THRESHOLD on each iteration
...
Change-Id: I259bc54a0a5b3474d3c455639c3e9cb1e95c8438
Signed-off-by: huzheng <openinx@gmail.com>
2019-05-30 10:07:39 +08:00
Artem Ervits
3a3857690a
HBASE-22469 replace md5 checksum in saveVersion script with sha512
...
Signed-off-by: Josh Elser <elserj@apache.org>
2019-05-28 14:53:56 -04:00
Sean Busbey
6ddf893a34
HBASE-22148 Provide a LimitedPrivate(COPROC) API for setting Cell timestamp without copying.
...
Signed-off-by: Josh Elser <elserj@apache.org>
2019-05-28 12:18:30 -05:00
Andrew Purtell
a30b186568
HBASE-22449 https everywhere in Maven metadata ( #247 )
2019-05-21 12:34:25 -07:00
Peter Somogyi
94122f6a74
HBASE-22340 Corrupt KeyValue is silently ignored ( #207 )
2019-05-02 11:17:28 +02:00
Sakthi
e44fe4964a
HBASE-22054: Space Quota: Compaction is not working for super user in case of NO_WRITES_COMPACTIONS
...
Signed-off-by: Josh Elser <elserj@apache.org>
2019-04-30 12:18:21 -04:00
Sean Busbey
bf140acd20
HBASE-22083 move eclipse settings into a profile.
...
Signed-off-by: stack <stack@apache.org>
2019-04-25 14:17:18 -05:00
Duo Zhang
184568cadd
HBASE-22307 Deprecated Preemptive Fail Fast
2019-04-25 14:19:58 +08:00
李小保
7617b71f00
HBASE-22250 The same constants used in many places should be placed in constant classes
...
Signed-off-by: stack <stack@apache.org>
2019-04-23 21:24:14 -07:00
zouxiangwen
6855143ba9
HBASE-22292 PreemptiveFastFailInterceptor clean repeatedFailuresMap issue
...
Signed-off-by: stack <stack@apache.org>
2019-04-23 07:56:59 -07:00
Michael Stack
1584d24a33
Merge pull request #100 from OrDTesters/fix-flaky-testCleanupOldJars
...
HBASE-21467 Fix flaky test TestCoprocessorClassLoader.testCleanupOldJars
2019-04-22 21:56:21 -07:00
Jan Hentschel
f30d6c958a
HBASE-22231 Removed unused and '*' imports
2019-04-20 22:03:32 +02:00
Ben Manes
8ec93ea193
HBASE-15560 W-TinyLFU based BlockCache
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-04-17 11:10:36 -07:00
Sayed Anisul Hoque
409523b110
HBASE-22248 Removed deprecated CollectionUtils
2019-04-17 10:07:21 +02:00
Andrew Purtell
cc9d401015
HBASE-22235 OperationStatus.{SUCCESS|FAILURE|NOT_RUN} are not visible to 3rd party coprocessors
2019-04-16 13:19:59 -07:00
subrat.mishra
f22b8ade63
HBASE-22053 Addendum changed zookeeper version from 3.3.3 to 3.4.10.
2019-03-28 08:09:47 -07:00
subrat.mishra
53f449c47e
HBASE-22053 Changed zookeeper URL from http://hadoop.apache.org to https://zookeeper.apache.org Replaced version 3.1.1 with 3.3.3 as 3.1.1 is deprecated.
...
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
2019-03-28 00:30:54 +09:00
Geoffrey Jacoby
d4c37778ee
HBASE-22032 KeyValue validation should check for null byte array
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-03-15 12:34:26 -07:00
Duo Zhang
3c5761e365
HBASE-22002 Remove the deprecated methods in Admin interface
...
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-03-14 21:42:23 +08:00
Sean Busbey
3f1498ddb4
HBASE-22044 ByteBufferUtils should not be IA.Public API
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-03-13 13:39:22 -05:00
zhangduo
10ca598004
HBASE-22001 Polish the Admin interface
...
Signed-off-by: stack <stack@apache.org>
2019-03-11 14:38:31 +08:00
Sean Busbey
a7bbff170a
HBASE-21999 ADDENDUM unknown revisions are okay; make sure we indicate them.
2019-03-07 11:51:40 -06:00
ramkrishna
fd6bc5d900
HBASE-21874 Bucket cache on Persistent memory
...
Signed-off-by: Anoop John <anoop.hbase@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 763202d48e
)
2019-03-07 08:50:08 -06:00
Sean Busbey
d9793c311c
Revert "HBASE-21874 Bucket cache on Persistent memory"
...
This reverts commit 763202d48e
.
bad signed-off-by line
2019-03-07 08:49:41 -06:00
stack
0d69f84bd2
HBASE-21999 [DEBUG] Exit if git returns empty revision!
2019-03-06 16:46:23 -08:00
ramkrishna
763202d48e
HBASE-21874 Bucket cache on Persistent memory
...
Signed-off-by: Anoop John <anoop.hbase@gmail.com>, Sean Busbey
<busbey@apache.org>
2019-03-06 22:37:54 +05:30
Reid Chan
f748e489c5
HBASE-21481 [acl] Superuser's permissions should not be granted or revoked by any non-su global admin
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-01 23:37:28 +08:00
Duo Zhang
f0032c9255
HBASE-20587 Replace Jackson with shaded thirdparty gson
...
Signed-off-by: Michael Stack <stack@apache.org>
2019-02-22 16:24:51 +08:00
zhangduo
e984515b74
HBASE-21928 Deprecated HConstants.META_QOS
...
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-02-20 14:16:40 +08:00
Duo Zhang
8bed65fa01
HBASE-21900 Infinite loop in AsyncMetaRegionLocator if we can not get the location for meta
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-14 19:50:02 +08:00
zhangduo
2b1b79f08b
HBASE-21829 Use FutureUtils.addListener instead of calling whenComplete directly
2019-02-03 15:24:54 +08:00
Wellington Chevreuil
54093b0d1f
HBASE-20215 - Rename CollectionUtils to ConcurrentMapUtils
2019-01-24 20:55:15 -08:00
zhangduo
416b70f461
HBASE-21761 Align the methods in RegionLocator and AsyncTableRegionLocator
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-24 15:21:11 +08:00
Allan Yang
b5619a2a26
HBASE-21754 ReportRegionStateTransitionRequest should be executed in priority executor
2019-01-23 20:55:00 +08:00
huzheng
35ed5d6c39
HBASE-21750 Most of KeyValueUtil#length can be replaced by cell#getSerializedSize for better performance because the latter one has been optimized
2019-01-22 19:58:03 +08:00
Duo Zhang
882bd564f4
HBASE-21726 Add getAllRegionLocations method to AsyncTableRegionLocator
2019-01-19 11:14:35 +08:00
Peter Somogyi
51c58e083c
HBASE-21727 Simplify documentation around client timeout
...
Signed-off-by: Michael Stack <stack@apache.org>
2019-01-16 11:32:46 +01:00
huzheng
15031c5bd5
HBASE-21657 PrivateCellUtil#estimatedSerializedSizeOf has been the bottleneck in 100% scan case
2019-01-16 09:41:02 +08:00
tianjingyun
281d6429e5
HBASE-21588 Procedure v2 wal splitting implementation
2019-01-07 15:58:15 +08:00
zhangduo
db66e6cc9e
HBASE-17356 Add replica get support
2019-01-03 08:38:20 +08:00
huzheng
12786f80c1
HBASE-21401 Sanity check when constructing the KeyValue
2018-12-21 18:01:35 +08:00
zhangduo
1acbd36c90
HBASE-21154 Remove hbase:namespace table; fold it into hbase:meta
2018-11-26 14:51:56 +08:00
Reid Chan
130057f137
HBASE-21255 [acl] Refactor TablePermission into three classes (Global, Namespace, Table)
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-11-15 11:34:16 +08:00
huzheng
a8b642067d
HBASE-21473 RowIndexSeekerV1 may return cell with extra two \x00\x00 bytes which has no tags
2018-11-14 23:00:12 +08:00
huzheng
362b5dd259
Revert "HBASE-21401 Sanity check in BaseDecoder#parseCell"
...
This reverts commit f17382792f
.
2018-11-12 11:37:46 +08:00
OrDTesters
3af7d02d1d
HBASE-21467 Fix flaky test TestCoprocessorClassLoader.testCleanupOldJars
2018-11-11 13:13:44 -06:00
maoling
5e84997f2f
HBASE-13468 hbase.zookeeper.quorum supports ipv6 address
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-11-10 06:09:29 -08:00
huzheng
f17382792f
HBASE-21401 Sanity check in BaseDecoder#parseCell
2018-11-08 20:07:04 +08:00
zhangduo
62fe365934
HBASE-21351 The force update thread may have race with PE worker when the procedure is rolling back
2018-11-03 08:24:11 +08:00
Allan Yang
05d22ed960
HBASE-21292 IdLock.getLockEntry() may hang if interrupted
2018-10-18 14:42:10 -07:00
Sahil Aggarwal
e520399201
HBASE-20716: Changes the bytes[] conversion done in Bytes and ByteBufferUtils. Instead of doing check unsafe_aligned available everytime, choose the best converter at startup.
2018-10-17 21:04:27 -07:00
Michael Stack
8cc56bd18c
HBASE-21320 [canary] Cleanup of usage and add commentary
...
Signed-off-by: Peter Somogyi <psomogyi@cloudera.com>
2018-10-16 22:20:00 -07:00
Zephyr Guo
da63ebb2c0
HBASE-21256 Improve IntegrationTestBigLinkedList for testing huge data
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-10-12 10:59:35 +08:00
Mike Drob
c9213f752e
HBASE-20764 build broken when latest commit is gpg signed
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-10-08 19:49:36 -05:00
zhangduo
71be251ef2
Revert "HBASE-21188 Print heap and gc informations in our junit ResourceChecker"
...
This reverts commit dc1dedb073
.
2018-09-28 21:03:24 +08:00
zhangduo
d7e08317d2
HBASE-21227 Implement exponential retrying backoff for Assign/UnassignRegionHandler introduced in HBASE-21217
2018-09-26 20:53:56 +08:00
Zach York
0e173d38b0
HBASE-20734 Colocate recovered edits directory with hbase.wal.dir
...
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-09-26 11:20:57 +08:00
Mingliang Liu
08c4d70aaf
HBASE-21164 reportForDuty should do backoff rather than retry
...
Remove unused methods from Sleeper (its ok, its @Private).
Remove notion of startTime from Sleeper handling (it is is unused).
Allow passing in how long to sleep so can maintain externally.
In HRS, use a RetryCounter to calculate backoff sleep time for when
reportForDuty is failing against a struggling Master.
2018-09-25 11:32:28 -07:00
Chia-Ping Tsai
c686b535c2
HBASE-21208 Bytes#toShort doesn't work without unsafe
...
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: anoopsamjohn <anoopsamjohn@gmail.com>
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-09-25 10:19:36 +08:00
Michael Stack
6d7bc0e98b
HBASE-21191 Add a holding-pattern if no assign for meta or namespace (Can happen if masterprocwals have been cleared).
...
Add a check for hbase:meta being online before we go to read it.
If not online, move into a holding-pattern until rectified, probably
by external operator.
Incorporates bulk of patch made by Allan Yang over on HBASE-21035.
M hbase-common/src/main/java/org/apache/hadoop/hbase/util/RetryCounterFactory.java
Add a Constructor for case where retries are for ever.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
Move stuff around so that the first hbase:meta read is the AM#loadMeta.
Previously, checking table state and/or favored nodes could end up
trying to read a meta that was not onlined holding up master startup.
Do similar for the namespace table. Adds new methods isMeta and
isNamespace which check that the regions/tables are online.. if not,
we wait logging with a back-off that assigns need to be run.
Signed-off-by: Allan Yang <allan163@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2018-09-16 21:44:17 -07:00
zhangduo
dc1dedb073
HBASE-21188 Print heap and gc informations in our junit ResourceChecker
2018-09-13 09:58:34 +08:00
Tyler Mi
5c1b325b51
HBASE-21098 Improve Snapshot Performance with Temporary Snapshot Directory when rootDir on S3
...
Signed-off-by: Zach York <zyork@apache.org>
2018-09-11 16:23:16 -07:00
Allan Yang
7c1fad4992
HBASE-21083 Introduce a mechanism to bypass the execution of a stuck procedure
2018-08-30 12:23:24 -07:00
Umesh Agashe
3813f0ac3d
HBASE-20941 Created and implemented HbckService in master
...
Added API setTableStateInMeta() to update table state only in Meta. This will be used by hbck2 tool.
2018-08-27 12:11:52 -07:00
brandboat
28635d6101
HBASE-18201 add UT and docs for DataBlockEncodingTool
...
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-08-10 11:15:50 +08:00
Reid Chan
d921262d38
Revert "HBASE-20965 Separate region server report requests to new handlers"
...
This reverts commit 48d387413f
.
2018-08-08 10:44:50 +08:00
meiyi
48d387413f
HBASE-20965 Separate region server report requests to new handlers
2018-08-08 10:39:11 +08:00
Reid Chan
a8e184dc77
HBASE-20886 [Auth] Support keytab login in hbase client
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-07-31 11:04:40 +08:00
Alex Leblang
e963694259
HBASE-19369 Switch to Builder Pattern In WAL
...
This patch switches to the builder pattern by adding a helper method.
It also checks to ensure that the pattern is available (i.e. that
HBase is running on a hadoop version that supports it).
Amending-Author: Mike Drob <mdrob@apache.org>
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-07-27 23:42:33 -05:00
zhangduo
7178a98258
HBASE-20939 There will be race when we call suspendIfNotReady and then throw ProcedureSuspendedException
2018-07-27 17:27:12 +08:00
Xu Cang
1913164970
HBASE-20928 Rewrite calculation of midpoint - addemdum
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-25 10:00:58 -07:00
Saurabh Singh
3a3855aade
HBASE-20928 Rewrite calculation of midpoint in binarySearch functions to prevent overflow
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-24 08:16:30 -07:00
Michael Stack
067388bfd9
HBASE-20914 Trim Master memory usage
...
Add (weak reference) interning of ServerNames.
Correct Balancer regions x racks matrix.
Make smaller defaults when creating ArrayDeques.
2018-07-20 10:08:55 -07:00
Mohit Goel
950d6e6fb0
HBASE-6028 Start/Stop compactions at region server level
...
Add switching on/off of compactions.
Switching off compactions will also interrupt any currently ongoing compactions.
Adds a "compaction_switch" to hbase shell. Switching off compactions will
interrupt any currently ongoing compactions. State set from shell will be
lost on restart. To persist the changes across region servers modify
hbase.regionserver.compaction.enabled in hbase-site.xml and restart.
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Michael Stack <stack@apache.org>
2018-07-19 06:20:44 -07:00
Reid Chan
8c85763327
HBASE-20876 Improve docs style in HConstants (Contributed by Wei-Chiu Chuang)
2018-07-18 11:42:26 +08:00
Mike Drob
dbcc80c9e7
HBASE-20884 Replace Base64 with j.u.Base64
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-13 12:59:36 -05:00
Yu Li
c55acb0b03
HBASE-20838 Include hbase-server in precommit test if CommonFSUtils is changed
2018-07-12 10:16:11 +08:00
Wei-Chiu Chuang
6ee0fedb3d
HBASE-20859 Backup and incremental load could fail in secure clusters.
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-11 16:56:39 -07:00
Yu Li
ec8947f226
HBASE-20691 Change the default WAL storage policy back to "NONE""
...
This reverts commit 564c193d61
and added more doc
about why we choose "NONE" as the default.
2018-07-04 13:43:48 +08:00
Pankaj
bb8826ca5f
HBASE-20357 AccessControlClient API Enhancement
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-06-28 22:48:58 -07:00
Xu Cang
78e7dd6537
HBASE-19722 Meta query statistics metrics source
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-06-28 17:17:23 -07:00
zhangduo
a41c549ca4
HBASE-19082 Reject read/write from client but accept write from replication in state S
2018-06-28 18:07:44 +08:00
zhangduo
39dd81a7c6
HBASE-19957 General framework to transit sync replication state
2018-06-28 18:07:44 +08:00
Sahil Aggarwal
952bb96c8a
HBASE-19164: Remove UUID.randomUUID in tests.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-06-27 10:34:16 -05:00
Ankit Singhal
99d54246ee
HBASE-20795 Allow option in BBKVComparator.compare to do comparison without sequence id
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-06-26 16:47:12 -07:00
Sean Busbey
f1b536bad4
HBASE-20332 shaded mapreduce module shouldn't include hadoop
...
* modify the jar checking script to take args; make hadoop stuff optional
* separate out checking the artifacts that have hadoop vs those that don't.
* * Unfortunately means we need two modules for checking things
* * put in a safety check that the support script for checking jar contents is maintained in both modules
* * have to carve out an exception for o.a.hadoop.metrics2. :(
* fix duplicated class warning
* clean up dependencies in hbase-server and some modules that depend on it.
* allow Hadoop to have its own htrace where it needs it
* add a precommit check to make sure we're not using old htrace imports
2018-06-18 11:31:04 -07:00
Balazs Meszaros
c323e7bfaa
HBASE-20656 Validate pre-2.0 coprocessors against HBase 2.0+
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-06-11 10:26:58 -05:00
Mike Drob
eb13cdd7ed
HBASE-20707 Move MissingSwitchDefault case check
...
Perform this check using error-prone instead of checkstyle because the
former can handle enum switches somewhat more intelligently.
2018-06-11 09:57:50 -05:00
Sean Busbey
d909ec55aa
HBASE-20444 Addendum keep folks from looking at raw version component array.
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-05-31 13:29:52 -05:00
maoling
b77fb77b32
HBASE-20444 Improve comparison logic for HBase version strings
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-05-30 09:18:53 -05:00
Mike Drob
a110e1eff5
HBASE-20478 Update checkstyle to v8.2
...
Cannot go to latest (8.9) yet due to
https://github.com/checkstyle/checkstyle/issues/5279
* move hbaseanti import checks to checkstyle
* implment a few missing equals checks, and ignore one
* fix lots of javadoc errors
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-05-29 10:12:31 -05:00
Guanghao Zhang
320a3332e0
HBASE-20589 Don't need to assign meta to a new RS when standby master become active
2018-05-24 11:26:48 +08:00
Michael Stack
079f168c5c
HBASE-20620 HBASE-20564 Tighter ByteBufferKeyValue Cell Comparator; part 2
...
Adds new stripped-down, faster ByteBufferKeyValue comparator
(BBKV is the base Cell-type in hbase2). Creates an instance
of new Comparator each time we create new memstore rather
than use the universal CellComparator.
Remove unused and unneeded Interfaces from Cell base type.
2018-05-23 13:20:47 -07:00
Michael Stack
f4006b5039
HBASE-20564 Tighter ByteBufferKeyValue Cell Comparator; ADDENDUM2 Add a Test
...
Run meta tests but using our new basis, the ByteBufferKeyValue
instead of the old byte array-backed KeyValue so we catch any
oddness in the Type processing or in the Comparator.
2018-05-16 12:56:08 -07:00
Balazs Meszaros
6148b4785d
HBASE-20571 JMXJsonServlet generates invalid JSON if it has NaN in metrics
...
- CacheStats won't generate NaN metrics.
- JSONBean class will serialize special floating point values as
"NaN", "Infinity" or "-Infinity"
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-05-16 12:20:39 -07:00
Michael Stack
438af9bf74
HBASE-20564 Tighter ByteBufferKeyValue Cell Comparator; ADDENDUM
...
Add method the CellComparator Interface. Add implementation to
meta comparator so we don't fall back to the default comparator.
Includes a nothing change to hbase-server/pom.xml just to provoke
build.
2018-05-16 09:43:16 -07:00
Michael Stack
db04a9f9d9
HBASE-20564 Tighter ByteBufferKeyValue Cell Comparator
...
Make a purposed comparator for the new ByteBufferKeyValue
base type. Cache deserialized sizes rather than recalc each time.
2018-05-14 15:18:26 +01:00
Michael Stack
7790ab156e
HBASE-20506 Add doc and test for unused RetryCounter, useful-looking utility
2018-05-01 07:01:16 -07:00
Lars Hofhansl
00fca5a4c9
HBASE-20459 Majority of scan CPU time in HBase-1 spent in size estimation.
2018-04-21 10:12:24 -07:00
Sean Busbey
914de11416
HBASE-20442 clean up incorrect use of commons-collections 3
...
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Yu Li <liyu@apache.org>
2018-04-20 07:30:34 -05:00
Sean Busbey
09749f1574
HBASE-20440 Clean up incorrect use of commons-lang 2.y
...
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Yu Li <liyu@apache.org>
2018-04-20 07:29:23 -05:00
Umesh Agashe
6ca8261fc0
HBASE-18792 Disabled destructive (mostly write) operations in hbck for HBase 2.0+
...
HBase server versioned is checked after connecting to the server and then following operations are not allowed:
-fix, -fixAssignments, -fixMeta, -fixHdfsHoles, -fixHdfsOrphans, -fixTableOrphans, -fixHdfsOverlaps, -maxMerge
-sidelineBigOverlaps, -maxOverlapsToSideline, -fixSplitParents, -removeParents, -fixEmptyMetaCells
-repair, -repairHoles
2018-04-18 15:22:39 -07:00
wangyu
80cbc0d1fe
HBASE-20449 The minimun number of region should be configurable in Normalizer
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-04-18 08:45:52 -07:00
tedyu
73275f1774
HBASE-20291 Fix The POM for net.minidev:json-smart:jar:2.3-SNAPSHOT missing with hadoop 3 profile - revert since it is marked invalid
2018-04-13 13:39:04 -07:00
BELUGA BEHR
d866e7c658
HBASE-19488 Move to using Apache commons CollectionUtils
...
Signed-off-by: Apekshit Sharma <appy@apache.org>
2018-04-04 14:12:19 -07:00
Mike Drob
d57001ee2d
HBASE-20282 Clean up tooling docs/help
2018-03-30 08:59:47 -07:00
Vasudevan
cbd8b15e6b
HBASE-20197 Review of ByteBufferWriterOutputStream.java (BELUGA BEHR)
...
Signed-off-by: Vasudevan <ramkrishna.s.vasudevan@gmail.com>
2018-03-30 12:13:41 +05:30
Yu Li
061a31fad1
HBASE-20159 Support using separate ZK quorums for client
2018-03-29 02:37:26 +08:00
Artem Ervits
a7609bb3cd
HBASE-20291 Fix The POM for net.minidev:json-smart:jar:2.3-SNAPSHOT missing with hadoop 3 profile
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-03-27 08:33:17 -07:00
Josh Elser
15c398f7d2
HBASE-20223 Update to hbase-thirdparty 2.1.0
...
Remove commons-cli and commons-collections4 use. Account
for the newer internal protobuf version of 3.5.1.
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-03-26 22:05:19 -04:00
anoopsamjohn
3f7222df36
HBASE-17819 Reduce the heap overhead for BucketCache.
2018-03-25 16:36:30 +05:30
Chia-Ping Tsai
ad47c2daf4
HBASE-19504 Add TimeRange support into checkAndMutate
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-03-24 00:12:38 +08:00
Chia-Ping Tsai
a6eeb26cc0
HBASE-20212 Make all Public classes have InterfaceAudience category
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Michael Stack <stack@apache.org>
2018-03-22 18:10:23 +08:00
Chia-Ping Tsai
4f2133ee32
HBASE-20119 Introduce a pojo class to carry coprocessor information in order to make TableDescriptorBuilder accept multiple cp at once
...
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: Michael Stack <stack@apache.org>
2018-03-16 01:21:38 +08:00
Chance Li
4f54a66782
HBASE-19389 Limit concurrency of put with dense (hundreds) columns to prevent write handler exhausted
...
Signed-off-by: Yu Li <liyu@apache.org>
2018-03-14 18:38:33 +08:00
Yu Li
9a26af37b9
Revert "HBASE-19389 Limit concurrency of put with dense (hundreds) columns to prevent write handler exhausted"
...
This reverts commit 98ac4f12b5
.
2018-03-14 18:38:07 +08:00
Yu Li
98ac4f12b5
HBASE-19389 Limit concurrency of put with dense (hundreds) columns to prevent write handler exhausted
...
Signed-off-by: Yu Li <liyu@apache.org>
2018-03-14 18:25:17 +08:00
anoopsamjohn
e83ac38d68
HBASE-20078 MultiByteBuff : bug in reading primitives when individual buffers are too small.
2018-03-14 12:07:57 +05:30
Chia-Ping Tsai
1102e1e252
HBASE-20171 Remove o.a.h.h.ProcedureState
2018-03-12 09:28:05 -07:00
zhangduo
dd6f4525e7
HBASE-20148 Make serial replication as a option for a peer instead of a table
2018-03-10 09:04:44 +08:00
Mike Drob
641e870e11
HBASE-19987 error-prone 2.2.0
2018-03-07 13:30:51 -06:00
tedyu
b7fb2df154
HBASE-20136 TestKeyValue misses ClassRule and Category annotations
2018-03-06 08:34:49 -08:00
zhangduo
b7b8683925
HBASE-20115 Reimplement serial replication based on the new replication storage layer
2018-03-05 20:25:25 +08:00
Sean Busbey
2a65066b35
HBASE-20070 refactor website generation
...
* rely on git plumbing commands when checking if we've built the site for a particular commit already
* switch to forcing '-e' for bash
* add command line switches for: path to hbase, working directory, and publishing
* only export JAVA/MAVEN HOME if they aren't already set.
* add some docs about assumptions
* Update javadoc plugin to consistently be version 3.0.0
* avoid duplicative site invocations on reactor modules
* update use of cp command so it works both on linux and mac
* manually skip enforcer plugin during build
* still doing install of all jars due to MJAVADOC-490, but then skip rebuilding during aggregate reports.
* avoid the pager on git-diff by teeing to a log file, which also helps later reviewing in the case of big changesets.
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Misty Stanley-Jones <misty@apache.org>
2018-03-02 09:25:10 -06:00
Michael Stack
b11e506664
HBASE-20069 fix existing findbugs errors in hbase-server
2018-02-26 16:01:31 -08:00
Michael Stack
549a6d93d4
HBASE-20043 ITBLL fails against hadoop3
...
Fix MoveRandomRegionOfTableAction. It depended on old AM behavior.
Make it do explicit move as is required in AMv3; w/o it, it was just
closing region causing test to fail.
Fix pom so hadoop3 profile specifies a different netty3 version.
Bunch of logging format change that came of trying trying to read
the spew from this test.
2018-02-24 17:29:54 -08:00
Sean Busbey
216d2d4648
Revert "HBASE-19835 Use explicit casting to avoid side effects"
...
This reverts commit f1a81618fd
.
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/Segment.java
patch reverted changes that happened in parallel without explanation. see jira.
2018-02-23 16:50:15 -06:00
zhangduo
ad5cd50dfc
HBASE-20048 Revert serial replication feature
2018-02-23 13:58:31 +08:00
tedyu
401227ba6a
HBASE-20031 Unable to run integration test using mvn due to missing HBaseClassTestRule
2018-02-21 12:03:32 -08:00
eshcar
f3bb9b9613
HBASE-18294 Reduce global heap pressure: flush based on heap occupancy
2018-02-18 09:55:44 +02:00
Michael Stack
969895105c
HBASE-20014 TestAdmin1 Times out
2018-02-16 20:57:10 -08:00
zhangduo
c18e7a963d
HBASE-20000 Remove the quantum logic in FairQueue, always put high priority queue in front
2018-02-15 13:49:54 +08:00
Michael Stack
24bed6b3fb
HBASE-19986 If HBaseTestClassRule timesout a test, thread dump; ADDENDUM; white-space, checkstyle, and rb feedback by Duo
2018-02-12 18:12:24 -08:00
Michael Stack
c2ee82c909
HBASE-19986 If HBaseTestClassRule timesout a test, thread dump
2018-02-12 15:28:40 -08:00
Michael Stack
0593dda663
HBASE-19951 Cleanup the explicit timeout value for test method
2018-02-10 09:24:31 -08:00
Aman Poonia
f1a81618fd
HBASE-19835 Use explicit casting to avoid side effects
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-02-08 12:32:36 -08:00
Michael Stack
277ce3d8a3
HBASE-19956 Remove category as a consideration timing out tests; set all test to timeout at 10minutes regardless
2018-02-07 23:10:12 -08:00
zhangduo
dcbb331792
HBASE-19929 Call RS.stop on a session expired RS may hang
2018-02-07 15:52:04 +08:00
Michael Stack
06dec20582
HBASE-19919 Tidying up logging
2018-02-03 08:42:02 -08:00
zhangduo
6519b98ac3
Revert "HBASE-19919 Tidying up logging"
...
This reverts commit 40250f8c5f
.
Wrong patch. Revert to fix compile error.
2018-02-03 18:18:09 +08:00
Michael Stack
40250f8c5f
HBASE-19919 Tidying up logging
2018-02-02 22:52:41 -08:00
Mike Drob
99b9fff07b
HBASE-19841 Every HTU should be local until DFS starts
2018-02-01 20:24:11 -06:00
Michael Stack
52cb9aaf6e
HBASE-19911 Convert some tests from small to medium because they are timing out: TestNettyRpcServer, TestClientClusterStatus; ADDENDUM2 Up timeout for smalltests from 30 seconds to 60 seconds -- a pause on jenkins can mess up smalltests
2018-02-01 08:25:44 -08:00
zhangduo
7c318cead9
HBASE-19887 Do not overwrite the surefire junit listener property in the pom of sub modules
2018-01-31 20:49:18 +08:00
Michael Stack
4f547b3817
HBASE-19840 Flakey TestMetaWithReplicas
...
Fix two issues:
# Meta Replicas can all be assigned to the same server. This
will call the test to hang when we do our kill of the server
hosting meta because there'll be no replicas to read from
as test intends. Check is to look for this condition on
startup and adjust if we come across it. Replicas cross-cut
assignment. They need work.
# Other issue was shutdown. The master started toward the
end of the test may not have come up fully by the time
shutdown is called. We could be stuck assigning the
meta replicas. Have shutdown shutdown the procedure
executor engine.
There is other cleanup and notes in the below.
M HMaster
Remove the silly stops in startup now we have real
means of shutting down Master during init.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterMetaBootstrap.java
This replica stuff was doing stuff it shouldn't be doing
like setting core Master state flags. It may have made
sense once but now meta is assigned by a Pv2 Procedure
so the flag setting in here is meddlesome. Clear out
methods no longer needed.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
Remove unused methods.
Changes local variable names so they align w/ our naming elsewhere in
code base.
M hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestMetaWithReplicas.java
Check for all replicas on the one server.
2018-01-29 09:21:30 -08:00
Chia-Ping Tsai
fcbcfaa120
HBASE-19877 hbase-common and hbase-zookeeper don't add the log4j.properties to the resource path for testing
2018-01-29 16:52:19 +08:00
zhangduo
918599ef12
HBASE-19873 Add a CategoryBasedTimeout ClassRule for all UTs
2018-01-29 08:43:56 +08:00
Michael Stack
a5a8c4f3f2
Revert "HBASE-19841 LocalHTU to not enforce stream capabilities"
...
At Mike Drobs' request!
2018-01-26 15:11:50 -08:00
Mike Drob
9ea152d235
HBASE-19841 LocalHTU to not enforce stream capabilities
2018-01-26 10:50:16 -06:00
Michael Stack
27d00f5861
HBASE-19794 TestZooKeeper hangs
...
Kill backup master first
Add some cleanup around NamespaceManager
Shorten the timeout waiting on namespace manager as workaround
until we have better soln for interrupting ongoing client rpcs.
Do it in general for all tests.
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-01-21 20:59:16 +08:00
Apekshit Sharma
4bfdcaa3f3
HBASE-19823 Make RawCellBuilderFactory LimitedPrivate.UNITTEST
2018-01-19 14:53:01 -08:00
Chia-Ping Tsai
4bd6ac3e10
HBASE-19746 Add default impl to Cell#getType
2018-01-11 15:03:20 -08:00
Apekshit Sharma
09ae5abbe7
HBASE-19773 Documenting how to get instance of type RawCellBuilder
2018-01-11 13:17:03 -08:00
zhangduo
5e6c303528
HBASE-19543 Abstract a replication storage interface to extract the zk specific code
2018-01-09 13:11:01 +08:00
Xiang Li
ee4f0c506a
HBASE-19702 Improve RSGroupInfo constructors
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-01-09 12:55:14 +08:00
zhangduo
2509a150c0
HBASE-19731 TestFromClientSide#testCheckAndDeleteWithCompareOp and testNullQualifier are flakey
2018-01-08 10:35:36 -08:00
Beluga Behr
a30d9fe8d9
HBASE-19651 Remove LimitInputStream
2018-01-05 16:59:29 -06:00
Michael Stack
2bf2b5b2c1
Revert "Revert "Revert "HBASE-19651 Remove LimitInputStream"""
...
This reverts commit 032701c96c
.
2018-01-05 16:58:26 -06:00
Michael Stack
032701c96c
Revert "Revert "HBASE-19651 Remove LimitInputStream""
...
This reverts commit e5f7030ded
.
2018-01-05 16:55:59 -06:00
Beluga Behr
e5f7030ded
Revert "HBASE-19651 Remove LimitInputStream"
...
Revert to put Beluga in place as author.
This reverts commit 032fdc53de
.
2018-01-05 16:55:01 -06:00
Michael Stack
032fdc53de
HBASE-19651 Remove LimitInputStream
...
Signed-off-by: Beluga Behr <dam6923@gmail.com>
2018-01-05 08:31:11 -06:00
BELUGA BEHR
4e9f4abb14
HBASE-19683 Remove Superfluous Methods From String Class (BELUGA BEHR).
...
* Remove isEmpty method
* Remove repeat
Use the Apache Commons implementations instead.
2018-01-02 11:12:38 -08:00
tedyu
6708d54478
HBASE-19679 Superusers Logging and Data Structures (BELUGA BEHR)
2018-01-01 14:18:21 -08:00
tedyu
73ab51e946
HBASE-19678 HBase Admin security capabilities should be represented as a Set - revert due to wrong issue
2018-01-01 14:16:01 -08:00
tedyu
6c2aa4c9cc
HBASE-19678 HBase Admin security capabilities should be represented as a Set (BELUGA BEHR)
2017-12-31 11:31:44 -08:00
Xiang Li
0cd6050d09
HBASE-19672 Correct comments for default values of major compaction in SortedCompactionPolicy#getNextMajorCompactTime()
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-12-30 16:27:20 -08:00
Michael Stack
b3a4fca48f
HBASE-19660 Up default retries from 10 to 15 and blocking store files limit from 10 to 16
2017-12-28 14:59:40 -08:00
Michael Stack
2dae9d16e2
Revert "HBASE-19651 Remove LimitInputStream"
...
This reverts commit 28eaf715e8
.
2017-12-28 14:31:44 -08:00
Michael Stack
28eaf715e8
HBASE-19651 Remove LimitInputStream
...
Signed-off-by: Beluga Behr <dam6923@gmail.com>
2017-12-28 13:04:41 -08:00
Mike Drob
c3b4f788b1
HBASE-19552 find-and-replace thirdparty offset
2017-12-28 11:52:32 -06:00
Chia-Ping Tsai
53233be5a9
HBASE-19626 Rename Cell.DataType to Cell.Type
2017-12-28 13:04:29 +08:00
Chia-Ping Tsai
01b1f48ccd
HBASE-19644 add the checkstyle rule to reject the illegal imports
2017-12-28 04:10:42 +08:00
Chia-Ping Tsai
6b39062e86
HBASE-19628 ByteBufferCell should extend ExtendedCell
2017-12-27 22:26:40 +08:00
Vasudevan
467a4667d8
HBASE-19629 RawCell#getTags should return the Iterator<Tag> in order to avoid iterating through whole tag array at once
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-12-27 21:33:42 +08:00
Peter Somogyi
7145d98182
HBASE-19545 Replace getBytes(StandardCharsets.UTF_8) with Bytes.toBytes
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-12-27 20:07:25 +08:00
BELUGA BEHR
38472e1c07
HBASE-19487 Remove IterablesUtil Class
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-12-25 16:12:22 +08:00
Guanghao Zhang
2f25589422
HBASE-19602 Cleanup the usage of ReplicationAdmin from document
2017-12-23 18:55:54 +08:00
Michael Stack
8ed3d4b9cb
HBASE-19148 Reevaluate default values of configurations; minor ADDENDUM2
...
Fix a description.
2017-12-22 08:37:39 -08:00
Michael Stack
4d6b928682
HBASE-19148 Reevaluate default values of configurations
...
Removed unused:
<name>hbase.fs.tmp.dir</name>
Added hbase.master.loadbalance.bytable
Edit of description text. Moved stuff around to put configs beside each
other.
M hbase-server/src/main/java/org/apache/hadoop/hbase/util/ServerCommandLine.java
Emit some hbase configs in log on startup.
Signed-off-by: Michael Stack <stack@apache.org>
2017-12-21 14:07:16 -08:00
Balazs Meszaros
f572c4b80e
HBASE-10092 Move up on to log4j2
...
Changes:
- replaced commons-logging to slf4j everywhere
- log.XXX(Throwable) calls were replaced with log.XXX(t.toString(), t)
- log.XXX(Object) calls were replaced with log.XXX(Objects.toString(obj))
- log.fatal() calls were replaced with log.error(HBaseMarkers.FATAL, ...)
- programmatic log4j configuration was removed from the unit test
This commit does not affect the current logging configurations, because log4j
is still on the classpath. slf4j-log4j12 binds log4j to slf4j.
Signed-off-by: Michael Stack <stack@apache.org>
2017-12-20 22:21:33 -08:00
Jan Hentschel
0f8ea39a5b
HBASE-19539 Removed unnecessary semicolons in hbase-common
2017-12-19 20:22:05 +01:00
Michael Stack
e343b0c3e3
HBASE-19122 Suspect methods on Cell to be deprecated; ADDENDUM2 to fix
...
more compile error
2017-12-18 16:12:21 -08:00
Peter Somogyi
abae90787f
HBASE-19549 Change path comparison in CommonFSUtils
...
Also change makeQualified(FileSystem fs)
to makeQualified(URI defaultUri, Path workingDir)
Signed-off-by: Michael Stack <stack@apache.org>
2017-12-18 15:27:39 -08:00
Michael Stack
b4056d267a
HBASE-19122 Suspect methods on Cell to be deprecated
2017-12-18 15:20:44 -08:00
Peter Somogyi
f9f869f60a
HBASE-19497 Fix findbugs and error-prone warnings in hbase-common (branch-2)
...
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-12-15 16:16:34 -08:00