531d2902cb
HBASE-22612 Address the final overview reviewing comments of HBASE-21879 ( #331 )
2019-06-24 18:04:40 +08:00
2e414360bd
HBASE-22547 Align the config keys and add document for offheap read in HBase Book. ( #301 )
2019-06-24 10:25:34 +08:00
686847cb79
HBASE-22598 Deprecated the hbase.ipc.server.reservoir.initial.buffer.size & hbase.ipc.server.reservoir.initial.max for HBase2.x compatibility ( #318 )
2019-06-24 10:25:34 +08:00
d64c3a2611
HBASE-22491 Separate the heap HFileBlock and offheap HFileBlock because the heap block won't need refCnt and save into prevBlocks list before shipping ( #268 )
2019-06-24 10:25:33 +08:00
97c1158421
HBASE-22504 Optimize the MultiByteBuff#get(ByteBuffer, offset, len)
2019-06-24 10:25:33 +08:00
f83c919587
HBASE-22483 It's better to use 65KB as the default buffer size in ByteBuffAllocator ( #279 )
2019-06-24 10:25:33 +08:00
b1fee0ebdd
HBASE-22435 Add a UT to address the HFileBlock#heapSize() in TestHeapSize
2019-06-24 10:25:33 +08:00
7188a3bd3d
HBASE-22412 Improve the metrics in ByteBuffAllocator
2019-06-24 10:25:33 +08:00
97476ed2e0
HBASE-21921 Notify users if the ByteBufAllocator is always allocating ByteBuffers from heap which means the increacing GC pressure
2019-06-24 10:25:33 +08:00
7dedb5625a
HBASE-21937 Make the Compression#decompress can accept ByteBuff as input
2019-06-24 10:25:32 +08:00
48aca4db30
HBASE-21957 Unify refCount of BucketEntry and refCount of hbase.nio.ByteBuff into one
2019-06-24 10:25:32 +08:00
773c0d6635
HBASE-22159 ByteBufferIOEngine should support write off-heap ByteBuff to the bufferArray
2019-06-24 10:25:32 +08:00
d1eb6171f9
HBASE-22127 Ensure that the block cached in the LRUBlockCache offheap is allocated from heap
2019-06-24 10:25:32 +08:00
35b818606f
HBASE-22005 Use ByteBuff's refcnt to track the life cycle of data block
2019-06-24 10:25:31 +08:00
532ebfb7a5
HBASE-21916 Abstract an ByteBuffAllocator to allocate/free ByteBuffer in ByteBufferPool
2019-06-24 10:25:31 +08:00
9aee88e03a
HBASE-22615 Make TestChoreService more robust to timing
...
* phrase fudge factor "deltas" in terms of the original period
* increase the delta allowed for chore timing from 5% to 20%
* improve some assertions
Closes #328
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Sakthi <sakthivel.azhaku@gmail.com>
2019-06-22 00:07:10 -05:00
6d08ffcfc6
HBASE-21284 Default limits for PressureAwareCompactionThroughputController are too low
...
This is a forward port HBASE-21000 from branch-1.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-06-20 12:44:01 -07:00
5d872d3422
HBASE-21526 Use AsyncClusterConnection in ServerManager for getRsAdmin
2019-06-18 08:35:58 +08:00
30c131b5f7
HBASE-21515 Also initialize an AsyncClusterConnection in HRegionServer
2019-06-18 08:35:58 +08:00
5da5deb59d
HBASE-22344 Documented the deprecation of public and limited private APIs ( #208 )
...
Signed-off-by: stack <stack@apache.org>
2019-06-17 22:02:23 +02:00
9ba7651889
HBASE-22565 Javadoc Warnings: @see cannot be used in inline documentation
2019-06-13 23:09:42 +02:00
0445186f1a
HBASE-22458: TestClassFinder fails when run on JDK11
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-06-13 08:31:08 -05:00
9b23e1d00c
HBASE-22534 TestCellUtil fails when run on JDK11
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-06-04 14:10:37 -05:00
51c49a1784
HBASE-22497 Mark HBase 1.2 line as EOM
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-06-03 06:55:58 -05:00
1be93fcaec
HBASE-22316 Record the stack trace for current thread in FutureUtils.get
2019-05-30 11:10:06 +08:00
25c6cd3a4f
HBASE-22496 UnsafeAccess.unsafeCopy should not copy more than UNSAFE_COPY_THRESHOLD on each iteration
...
Change-Id: I259bc54a0a5b3474d3c455639c3e9cb1e95c8438
Signed-off-by: huzheng <openinx@gmail.com>
2019-05-30 10:07:39 +08:00
3a3857690a
HBASE-22469 replace md5 checksum in saveVersion script with sha512
...
Signed-off-by: Josh Elser <elserj@apache.org>
2019-05-28 14:53:56 -04:00
6ddf893a34
HBASE-22148 Provide a LimitedPrivate(COPROC) API for setting Cell timestamp without copying.
...
Signed-off-by: Josh Elser <elserj@apache.org>
2019-05-28 12:18:30 -05:00
a30b186568
HBASE-22449 https everywhere in Maven metadata ( #247 )
2019-05-21 12:34:25 -07:00
94122f6a74
HBASE-22340 Corrupt KeyValue is silently ignored ( #207 )
2019-05-02 11:17:28 +02:00
e44fe4964a
HBASE-22054: Space Quota: Compaction is not working for super user in case of NO_WRITES_COMPACTIONS
...
Signed-off-by: Josh Elser <elserj@apache.org>
2019-04-30 12:18:21 -04:00
bf140acd20
HBASE-22083 move eclipse settings into a profile.
...
Signed-off-by: stack <stack@apache.org>
2019-04-25 14:17:18 -05:00
184568cadd
HBASE-22307 Deprecated Preemptive Fail Fast
2019-04-25 14:19:58 +08:00
7617b71f00
HBASE-22250 The same constants used in many places should be placed in constant classes
...
Signed-off-by: stack <stack@apache.org>
2019-04-23 21:24:14 -07:00
6855143ba9
HBASE-22292 PreemptiveFastFailInterceptor clean repeatedFailuresMap issue
...
Signed-off-by: stack <stack@apache.org>
2019-04-23 07:56:59 -07:00
1584d24a33
Merge pull request #100 from OrDTesters/fix-flaky-testCleanupOldJars
...
HBASE-21467 Fix flaky test TestCoprocessorClassLoader.testCleanupOldJars
2019-04-22 21:56:21 -07:00
f30d6c958a
HBASE-22231 Removed unused and '*' imports
2019-04-20 22:03:32 +02:00
8ec93ea193
HBASE-15560 W-TinyLFU based BlockCache
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-04-17 11:10:36 -07:00
409523b110
HBASE-22248 Removed deprecated CollectionUtils
2019-04-17 10:07:21 +02:00
cc9d401015
HBASE-22235 OperationStatus.{SUCCESS|FAILURE|NOT_RUN} are not visible to 3rd party coprocessors
2019-04-16 13:19:59 -07:00
f22b8ade63
HBASE-22053 Addendum changed zookeeper version from 3.3.3 to 3.4.10.
2019-03-28 08:09:47 -07:00
53f449c47e
HBASE-22053 Changed zookeeper URL from http://hadoop.apache.org to https://zookeeper.apache.org Replaced version 3.1.1 with 3.3.3 as 3.1.1 is deprecated.
...
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
2019-03-28 00:30:54 +09:00
d4c37778ee
HBASE-22032 KeyValue validation should check for null byte array
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-03-15 12:34:26 -07:00
3c5761e365
HBASE-22002 Remove the deprecated methods in Admin interface
...
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-03-14 21:42:23 +08:00
3f1498ddb4
HBASE-22044 ByteBufferUtils should not be IA.Public API
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-03-13 13:39:22 -05:00
10ca598004
HBASE-22001 Polish the Admin interface
...
Signed-off-by: stack <stack@apache.org>
2019-03-11 14:38:31 +08:00
a7bbff170a
HBASE-21999 ADDENDUM unknown revisions are okay; make sure we indicate them.
2019-03-07 11:51:40 -06:00
fd6bc5d900
HBASE-21874 Bucket cache on Persistent memory
...
Signed-off-by: Anoop John <anoop.hbase@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 763202d48e
2019-03-07 08:50:08 -06:00
d9793c311c
Revert "HBASE-21874 Bucket cache on Persistent memory"
...
This reverts commit 763202d48e
2019-03-07 08:49:41 -06:00
0d69f84bd2
HBASE-21999 [DEBUG] Exit if git returns empty revision!
2019-03-06 16:46:23 -08:00
763202d48e
HBASE-21874 Bucket cache on Persistent memory
...
Signed-off-by: Anoop John <anoop.hbase@gmail.com>, Sean Busbey
<busbey@apache.org>
2019-03-06 22:37:54 +05:30
f748e489c5
HBASE-21481 [acl] Superuser's permissions should not be granted or revoked by any non-su global admin
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-01 23:37:28 +08:00
f0032c9255
HBASE-20587 Replace Jackson with shaded thirdparty gson
...
Signed-off-by: Michael Stack <stack@apache.org>
2019-02-22 16:24:51 +08:00
e984515b74
HBASE-21928 Deprecated HConstants.META_QOS
...
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-02-20 14:16:40 +08:00
8bed65fa01
HBASE-21900 Infinite loop in AsyncMetaRegionLocator if we can not get the location for meta
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-14 19:50:02 +08:00
2b1b79f08b
HBASE-21829 Use FutureUtils.addListener instead of calling whenComplete directly
2019-02-03 15:24:54 +08:00
54093b0d1f
HBASE-20215 - Rename CollectionUtils to ConcurrentMapUtils
2019-01-24 20:55:15 -08:00
416b70f461
HBASE-21761 Align the methods in RegionLocator and AsyncTableRegionLocator
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-24 15:21:11 +08:00
b5619a2a26
HBASE-21754 ReportRegionStateTransitionRequest should be executed in priority executor
2019-01-23 20:55:00 +08:00
35ed5d6c39
HBASE-21750 Most of KeyValueUtil#length can be replaced by cell#getSerializedSize for better performance because the latter one has been optimized
2019-01-22 19:58:03 +08:00
882bd564f4
HBASE-21726 Add getAllRegionLocations method to AsyncTableRegionLocator
2019-01-19 11:14:35 +08:00
51c58e083c
HBASE-21727 Simplify documentation around client timeout
...
Signed-off-by: Michael Stack <stack@apache.org>
2019-01-16 11:32:46 +01:00
15031c5bd5
HBASE-21657 PrivateCellUtil#estimatedSerializedSizeOf has been the bottleneck in 100% scan case
2019-01-16 09:41:02 +08:00
281d6429e5
HBASE-21588 Procedure v2 wal splitting implementation
2019-01-07 15:58:15 +08:00
db66e6cc9e
HBASE-17356 Add replica get support
2019-01-03 08:38:20 +08:00
12786f80c1
HBASE-21401 Sanity check when constructing the KeyValue
2018-12-21 18:01:35 +08:00
1acbd36c90
HBASE-21154 Remove hbase:namespace table; fold it into hbase:meta
2018-11-26 14:51:56 +08:00
130057f137
HBASE-21255 [acl] Refactor TablePermission into three classes (Global, Namespace, Table)
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-11-15 11:34:16 +08:00
a8b642067d
HBASE-21473 RowIndexSeekerV1 may return cell with extra two \x00\x00 bytes which has no tags
2018-11-14 23:00:12 +08:00
362b5dd259
Revert "HBASE-21401 Sanity check in BaseDecoder#parseCell"
...
This reverts commit f17382792f
2018-11-12 11:37:46 +08:00
3af7d02d1d
HBASE-21467 Fix flaky test TestCoprocessorClassLoader.testCleanupOldJars
2018-11-11 13:13:44 -06:00
5e84997f2f
HBASE-13468 hbase.zookeeper.quorum supports ipv6 address
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-11-10 06:09:29 -08:00
f17382792f
HBASE-21401 Sanity check in BaseDecoder#parseCell
2018-11-08 20:07:04 +08:00
62fe365934
HBASE-21351 The force update thread may have race with PE worker when the procedure is rolling back
2018-11-03 08:24:11 +08:00
05d22ed960
HBASE-21292 IdLock.getLockEntry() may hang if interrupted
2018-10-18 14:42:10 -07:00
e520399201
HBASE-20716: Changes the bytes[] conversion done in Bytes and ByteBufferUtils. Instead of doing check unsafe_aligned available everytime, choose the best converter at startup.
2018-10-17 21:04:27 -07:00
8cc56bd18c
HBASE-21320 [canary] Cleanup of usage and add commentary
...
Signed-off-by: Peter Somogyi <psomogyi@cloudera.com>
2018-10-16 22:20:00 -07:00
da63ebb2c0
HBASE-21256 Improve IntegrationTestBigLinkedList for testing huge data
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-10-12 10:59:35 +08:00
c9213f752e
HBASE-20764 build broken when latest commit is gpg signed
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-10-08 19:49:36 -05:00
71be251ef2
Revert "HBASE-21188 Print heap and gc informations in our junit ResourceChecker"
...
This reverts commit dc1dedb073
2018-09-28 21:03:24 +08:00
d7e08317d2
HBASE-21227 Implement exponential retrying backoff for Assign/UnassignRegionHandler introduced in HBASE-21217
2018-09-26 20:53:56 +08:00
0e173d38b0
HBASE-20734 Colocate recovered edits directory with hbase.wal.dir
...
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-09-26 11:20:57 +08:00
08c4d70aaf
HBASE-21164 reportForDuty should do backoff rather than retry
...
Remove unused methods from Sleeper (its ok, its @Private).
Remove notion of startTime from Sleeper handling (it is is unused).
Allow passing in how long to sleep so can maintain externally.
In HRS, use a RetryCounter to calculate backoff sleep time for when
reportForDuty is failing against a struggling Master.
2018-09-25 11:32:28 -07:00
c686b535c2
HBASE-21208 Bytes#toShort doesn't work without unsafe
...
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: anoopsamjohn <anoopsamjohn@gmail.com>
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-09-25 10:19:36 +08:00
6d7bc0e98b
HBASE-21191 Add a holding-pattern if no assign for meta or namespace (Can happen if masterprocwals have been cleared).
...
Add a check for hbase:meta being online before we go to read it.
If not online, move into a holding-pattern until rectified, probably
by external operator.
Incorporates bulk of patch made by Allan Yang over on HBASE-21035.
M hbase-common/src/main/java/org/apache/hadoop/hbase/util/RetryCounterFactory.java
Add a Constructor for case where retries are for ever.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
Move stuff around so that the first hbase:meta read is the AM#loadMeta.
Previously, checking table state and/or favored nodes could end up
trying to read a meta that was not onlined holding up master startup.
Do similar for the namespace table. Adds new methods isMeta and
isNamespace which check that the regions/tables are online.. if not,
we wait logging with a back-off that assigns need to be run.
Signed-off-by: Allan Yang <allan163@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2018-09-16 21:44:17 -07:00
dc1dedb073
HBASE-21188 Print heap and gc informations in our junit ResourceChecker
2018-09-13 09:58:34 +08:00
5c1b325b51
HBASE-21098 Improve Snapshot Performance with Temporary Snapshot Directory when rootDir on S3
...
Signed-off-by: Zach York <zyork@apache.org>
2018-09-11 16:23:16 -07:00
7c1fad4992
HBASE-21083 Introduce a mechanism to bypass the execution of a stuck procedure
2018-08-30 12:23:24 -07:00
3813f0ac3d
HBASE-20941 Created and implemented HbckService in master
...
Added API setTableStateInMeta() to update table state only in Meta. This will be used by hbck2 tool.
2018-08-27 12:11:52 -07:00
28635d6101
HBASE-18201 add UT and docs for DataBlockEncodingTool
...
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-08-10 11:15:50 +08:00
d921262d38
Revert "HBASE-20965 Separate region server report requests to new handlers"
...
This reverts commit 48d387413f
2018-08-08 10:44:50 +08:00
48d387413f
HBASE-20965 Separate region server report requests to new handlers
2018-08-08 10:39:11 +08:00
a8e184dc77
HBASE-20886 [Auth] Support keytab login in hbase client
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-07-31 11:04:40 +08:00
e963694259
HBASE-19369 Switch to Builder Pattern In WAL
...
This patch switches to the builder pattern by adding a helper method.
It also checks to ensure that the pattern is available (i.e. that
HBase is running on a hadoop version that supports it).
Amending-Author: Mike Drob <mdrob@apache.org>
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-07-27 23:42:33 -05:00
7178a98258
HBASE-20939 There will be race when we call suspendIfNotReady and then throw ProcedureSuspendedException
2018-07-27 17:27:12 +08:00
1913164970
HBASE-20928 Rewrite calculation of midpoint - addemdum
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-25 10:00:58 -07:00
3a3855aade
HBASE-20928 Rewrite calculation of midpoint in binarySearch functions to prevent overflow
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-24 08:16:30 -07:00
067388bfd9
HBASE-20914 Trim Master memory usage
...
Add (weak reference) interning of ServerNames.
Correct Balancer regions x racks matrix.
Make smaller defaults when creating ArrayDeques.
2018-07-20 10:08:55 -07:00
950d6e6fb0
HBASE-6028 Start/Stop compactions at region server level
...
Add switching on/off of compactions.
Switching off compactions will also interrupt any currently ongoing compactions.
Adds a "compaction_switch" to hbase shell. Switching off compactions will
interrupt any currently ongoing compactions. State set from shell will be
lost on restart. To persist the changes across region servers modify
hbase.regionserver.compaction.enabled in hbase-site.xml and restart.
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Michael Stack <stack@apache.org>
2018-07-19 06:20:44 -07:00
8c85763327
HBASE-20876 Improve docs style in HConstants (Contributed by Wei-Chiu Chuang)
2018-07-18 11:42:26 +08:00
openinx
Sean Busbey
Mingliang Liu
zhangduo
Jan Hentschel
Murtaza Hassan
Sakthi
Wellington Chevreuil
Artem Ervits
Andrew Purtell
Peter Somogyi
李小保
zouxiangwen
Michael Stack
Ben Manes
Sayed Anisul Hoque
subrat.mishra
Geoffrey Jacoby
ramkrishna
stack
Reid Chan
Allan Yang
Peter Somogyi
tianjingyun
OrDTesters
maoling
Sahil Aggarwal
Zephyr Guo
Mike Drob
Zach York
Chia-Ping Tsai
Tyler Mi
Umesh Agashe
brandboat
meiyi
Alex Leblang
Xu Cang
Saurabh Singh
Mohit Goel