Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,109 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

1499 Commits

Author SHA1 Message Date
Wellington Chevreuil 3708198817 HBASE-21773 rowcounter utility should respond to pleas for help 
Signed-off-by: stack <stack@apache.org>
 2019-07-26 21:19:17 +01:00
syedmurtazahassan d9493c539f HBASE-22603 Javadoc Warnings related to @link tag 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2019-07-23 14:14:12 +02:00
Viraj Jasani 9615c644f5 HBASE-22648 Snapshot TTL (#371) 
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-07-22 15:03:44 -07:00
Viraj Jasani aa9679ddbc HBASE-22718 Removal of org.apache.hadoop.hbase.util.Counter (#396) 
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-07-22 13:56:08 +02:00
openinx 00075ea4fc
HBASE-22663 The HeapAllocationRatio in WebUI is not accurate because all of the heap allocation will happen in another separated allocator named HEAP (#365) 2019-07-20 23:30:08 +08:00
毛蛤丝 54b514d62a HBASE-22700:incorrect timeout in recommended ZooKeeper configuration 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-07-17 22:08:52 +08:00
syedmurtazahassan 8defea9561 HBASE-22586 Javadoc Warnings related to @param tag 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2019-07-13 16:46:18 +02:00
Braavos 53a8c2675f HBASE-22669 Add unit tests for org.apache.hadoop.hbase.util.Strings (#363) 
These tests were written using Diffblue Cover.
 2019-07-10 10:07:55 +02:00
Peter Somogyi b22459c37c
HBASE-22651 ErrorProne issue in TestByteBufferArray 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-07-02 16:37:05 +02:00
syedmurtazahassan fabf2b8282 HBASE-22572 Javadoc Warnings: @link reference not found (#306) 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: stack <stack@apache.org>
 2019-07-01 21:15:00 -07:00
openinx 0198868531
HBASE-20060 Add details of off heap memstore into book. (#334) 2019-06-26 14:58:34 +08:00
Duo Zhang b42614295e
HBASE-22617 Recovered WAL directories not getting cleaned up (#330) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-06-25 16:21:24 +08:00
yuliangwan 841b319e4d HBASE-22611 Close the DataOutputStream object #325 2019-06-24 14:14:05 -07:00
Jan Hentschel 10032a11ba
HBASE-16002 Made constructors of DataType subclasses public 
Signed-off-by: stack <stack@apache.org>
 2019-06-24 22:32:18 +02:00
openinx 531d2902cb
HBASE-22612 Address the final overview reviewing comments of HBASE-21879 (#331) 2019-06-24 18:04:40 +08:00
openinx 2e414360bd HBASE-22547 Align the config keys and add document for offheap read in HBase Book. (#301) 2019-06-24 10:25:34 +08:00
openinx 686847cb79 HBASE-22598 Deprecated the hbase.ipc.server.reservoir.initial.buffer.size & hbase.ipc.server.reservoir.initial.max for HBase2.x compatibility (#318) 2019-06-24 10:25:34 +08:00
openinx d64c3a2611 HBASE-22491 Separate the heap HFileBlock and offheap HFileBlock because the heap block won't need refCnt and save into prevBlocks list before shipping (#268) 2019-06-24 10:25:33 +08:00
huzheng 97c1158421 HBASE-22504 Optimize the MultiByteBuff#get(ByteBuffer, offset, len) 2019-06-24 10:25:33 +08:00
openinx f83c919587 HBASE-22483 It's better to use 65KB as the default buffer size in ByteBuffAllocator (#279) 2019-06-24 10:25:33 +08:00
huzheng b1fee0ebdd HBASE-22435 Add a UT to address the HFileBlock#heapSize() in TestHeapSize 2019-06-24 10:25:33 +08:00
huzheng 7188a3bd3d HBASE-22412 Improve the metrics in ByteBuffAllocator 2019-06-24 10:25:33 +08:00
huzheng 97476ed2e0 HBASE-21921 Notify users if the ByteBufAllocator is always allocating ByteBuffers from heap which means the increacing GC pressure 2019-06-24 10:25:33 +08:00
huzheng 7dedb5625a HBASE-21937 Make the Compression#decompress can accept ByteBuff as input 2019-06-24 10:25:32 +08:00
huzheng 48aca4db30 HBASE-21957 Unify refCount of BucketEntry and refCount of hbase.nio.ByteBuff into one 2019-06-24 10:25:32 +08:00
huzheng 773c0d6635 HBASE-22159 ByteBufferIOEngine should support write off-heap ByteBuff to the bufferArray 2019-06-24 10:25:32 +08:00
huzheng d1eb6171f9 HBASE-22127 Ensure that the block cached in the LRUBlockCache offheap is allocated from heap 2019-06-24 10:25:32 +08:00
huzheng 35b818606f HBASE-22005 Use ByteBuff's refcnt to track the life cycle of data block 2019-06-24 10:25:31 +08:00
huzheng 532ebfb7a5 HBASE-21916 Abstract an ByteBuffAllocator to allocate/free ByteBuffer in ByteBufferPool 2019-06-24 10:25:31 +08:00
Sean Busbey 9aee88e03a HBASE-22615 Make TestChoreService more robust to timing 
* phrase fudge factor "deltas" in terms of the original period
* increase the delta allowed for chore timing from 5% to 20%
* improve some assertions

Closes #328

Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Sakthi <sakthivel.azhaku@gmail.com>
 2019-06-22 00:07:10 -05:00
Mingliang Liu 6d08ffcfc6
HBASE-21284 Default limits for PressureAwareCompactionThroughputController are too low 
This is a forward port HBASE-21000 from branch-1.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-06-20 12:44:01 -07:00
zhangduo 5d872d3422 HBASE-21526 Use AsyncClusterConnection in ServerManager for getRsAdmin 2019-06-18 08:35:58 +08:00
zhangduo 30c131b5f7 HBASE-21515 Also initialize an AsyncClusterConnection in HRegionServer 2019-06-18 08:35:58 +08:00
Jan Hentschel 5da5deb59d
HBASE-22344 Documented the deprecation of public and limited private APIs (#208) 
Signed-off-by: stack <stack@apache.org>
 2019-06-17 22:02:23 +02:00
Murtaza Hassan 9ba7651889 HBASE-22565 Javadoc Warnings: @see cannot be used in inline documentation 2019-06-13 23:09:42 +02:00
Sakthi 0445186f1a HBASE-22458: TestClassFinder fails when run on JDK11 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-06-13 08:31:08 -05:00
Sakthi 9b23e1d00c HBASE-22534 TestCellUtil fails when run on JDK11 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-06-04 14:10:37 -05:00
Sean Busbey 51c49a1784 HBASE-22497 Mark HBase 1.2 line as EOM 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-06-03 06:55:58 -05:00
Duo Zhang 1be93fcaec HBASE-22316 Record the stack trace for current thread in FutureUtils.get 2019-05-30 11:10:06 +08:00
Wellington Chevreuil 25c6cd3a4f HBASE-22496 UnsafeAccess.unsafeCopy should not copy more than UNSAFE_COPY_THRESHOLD on each iteration 
Change-Id: I259bc54a0a5b3474d3c455639c3e9cb1e95c8438

Signed-off-by: huzheng <openinx@gmail.com>
 2019-05-30 10:07:39 +08:00
Artem Ervits 3a3857690a HBASE-22469 replace md5 checksum in saveVersion script with sha512 
Signed-off-by: Josh Elser <elserj@apache.org>
 2019-05-28 14:53:56 -04:00
Sean Busbey 6ddf893a34 HBASE-22148 Provide a LimitedPrivate(COPROC) API for setting Cell timestamp without copying. 
Signed-off-by: Josh Elser <elserj@apache.org>
 2019-05-28 12:18:30 -05:00
Andrew Purtell a30b186568
HBASE-22449 https everywhere in Maven metadata (#247) 2019-05-21 12:34:25 -07:00
Peter Somogyi 94122f6a74
HBASE-22340 Corrupt KeyValue is silently ignored (#207) 2019-05-02 11:17:28 +02:00
Sakthi e44fe4964a HBASE-22054: Space Quota: Compaction is not working for super user in case of NO_WRITES_COMPACTIONS 
Signed-off-by: Josh Elser <elserj@apache.org>
 2019-04-30 12:18:21 -04:00
Sean Busbey bf140acd20 HBASE-22083 move eclipse settings into a profile. 
Signed-off-by: stack <stack@apache.org>
 2019-04-25 14:17:18 -05:00
Duo Zhang 184568cadd HBASE-22307 Deprecated Preemptive Fail Fast 2019-04-25 14:19:58 +08:00
李小保 7617b71f00 HBASE-22250 The same constants used in many places should be placed in constant classes 
Signed-off-by: stack <stack@apache.org>
 2019-04-23 21:24:14 -07:00
zouxiangwen 6855143ba9 HBASE-22292 PreemptiveFastFailInterceptor clean repeatedFailuresMap issue 
Signed-off-by: stack <stack@apache.org>
 2019-04-23 07:56:59 -07:00
Michael Stack 1584d24a33
Merge pull request #100 from OrDTesters/fix-flaky-testCleanupOldJars 
HBASE-21467 Fix flaky test TestCoprocessorClassLoader.testCleanupOldJars
 2019-04-22 21:56:21 -07:00
Jan Hentschel f30d6c958a HBASE-22231 Removed unused and '*' imports 2019-04-20 22:03:32 +02:00
Ben Manes 8ec93ea193
HBASE-15560 W-TinyLFU based BlockCache 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-04-17 11:10:36 -07:00
Sayed Anisul Hoque 409523b110 HBASE-22248 Removed deprecated CollectionUtils 2019-04-17 10:07:21 +02:00
Andrew Purtell cc9d401015
HBASE-22235 OperationStatus.{SUCCESS|FAILURE|NOT_RUN} are not visible to 3rd party coprocessors 2019-04-16 13:19:59 -07:00
subrat.mishra f22b8ade63 HBASE-22053 Addendum changed zookeeper version from 3.3.3 to 3.4.10. 2019-03-28 08:09:47 -07:00
subrat.mishra 53f449c47e HBASE-22053 Changed zookeeper URL from http://hadoop.apache.org to https://zookeeper.apache.org Replaced version 3.1.1 with 3.3.3 as 3.1.1 is deprecated. 
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
 2019-03-28 00:30:54 +09:00
Geoffrey Jacoby d4c37778ee
HBASE-22032 KeyValue validation should check for null byte array 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-03-15 12:34:26 -07:00
Duo Zhang 3c5761e365 HBASE-22002 Remove the deprecated methods in Admin interface 
Signed-off-by: Zheng Hu <openinx@gmail.com>
 2019-03-14 21:42:23 +08:00
Sean Busbey 3f1498ddb4 HBASE-22044 ByteBufferUtils should not be IA.Public API 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-03-13 13:39:22 -05:00
zhangduo 10ca598004 HBASE-22001 Polish the Admin interface 
Signed-off-by: stack <stack@apache.org>
 2019-03-11 14:38:31 +08:00
Sean Busbey a7bbff170a HBASE-21999 ADDENDUM unknown revisions are okay; make sure we indicate them. 2019-03-07 11:51:40 -06:00
ramkrishna fd6bc5d900 HBASE-21874 Bucket cache on Persistent memory 
Signed-off-by: Anoop John <anoop.hbase@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 763202d48e)
 2019-03-07 08:50:08 -06:00
Sean Busbey d9793c311c Revert "HBASE-21874 Bucket cache on Persistent memory" 
This reverts commit 763202d48e.

bad signed-off-by line
 2019-03-07 08:49:41 -06:00
stack 0d69f84bd2 HBASE-21999 [DEBUG] Exit if git returns empty revision! 2019-03-06 16:46:23 -08:00
ramkrishna 763202d48e HBASE-21874 Bucket cache on Persistent memory 
Signed-off-by: Anoop John <anoop.hbase@gmail.com>, Sean Busbey
<busbey@apache.org>
 2019-03-06 22:37:54 +05:30
Reid Chan f748e489c5 HBASE-21481 [acl] Superuser's permissions should not be granted or revoked by any non-su global admin 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-03-01 23:37:28 +08:00
Duo Zhang f0032c9255 HBASE-20587 Replace Jackson with shaded thirdparty gson 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-02-22 16:24:51 +08:00
zhangduo e984515b74 HBASE-21928 Deprecated HConstants.META_QOS 
Signed-off-by: Zheng Hu <openinx@gmail.com>
 2019-02-20 14:16:40 +08:00
Duo Zhang 8bed65fa01 HBASE-21900 Infinite loop in AsyncMetaRegionLocator if we can not get the location for meta 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-14 19:50:02 +08:00
zhangduo 2b1b79f08b HBASE-21829 Use FutureUtils.addListener instead of calling whenComplete directly 2019-02-03 15:24:54 +08:00
Wellington Chevreuil 54093b0d1f HBASE-20215 - Rename CollectionUtils to ConcurrentMapUtils 2019-01-24 20:55:15 -08:00
zhangduo 416b70f461 HBASE-21761 Align the methods in RegionLocator and AsyncTableRegionLocator 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-01-24 15:21:11 +08:00
Allan Yang b5619a2a26 HBASE-21754 ReportRegionStateTransitionRequest should be executed in priority executor 2019-01-23 20:55:00 +08:00
huzheng 35ed5d6c39 HBASE-21750 Most of KeyValueUtil#length can be replaced by cell#getSerializedSize for better performance because the latter one has been optimized 2019-01-22 19:58:03 +08:00
Duo Zhang 882bd564f4 HBASE-21726 Add getAllRegionLocations method to AsyncTableRegionLocator 2019-01-19 11:14:35 +08:00
Peter Somogyi 51c58e083c HBASE-21727 Simplify documentation around client timeout 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-01-16 11:32:46 +01:00
huzheng 15031c5bd5 HBASE-21657 PrivateCellUtil#estimatedSerializedSizeOf has been the bottleneck in 100% scan case 2019-01-16 09:41:02 +08:00
tianjingyun 281d6429e5 HBASE-21588 Procedure v2 wal splitting implementation 2019-01-07 15:58:15 +08:00
zhangduo db66e6cc9e HBASE-17356 Add replica get support 2019-01-03 08:38:20 +08:00
huzheng 12786f80c1 HBASE-21401 Sanity check when constructing the KeyValue 2018-12-21 18:01:35 +08:00
zhangduo 1acbd36c90 HBASE-21154 Remove hbase:namespace table; fold it into hbase:meta 2018-11-26 14:51:56 +08:00
Reid Chan 130057f137 HBASE-21255 [acl] Refactor TablePermission into three classes (Global, Namespace, Table) 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-11-15 11:34:16 +08:00
huzheng a8b642067d HBASE-21473 RowIndexSeekerV1 may return cell with extra two \x00\x00 bytes which has no tags 2018-11-14 23:00:12 +08:00
huzheng 362b5dd259 Revert "HBASE-21401 Sanity check in BaseDecoder#parseCell" 
This reverts commit f17382792f.
 2018-11-12 11:37:46 +08:00
OrDTesters 3af7d02d1d HBASE-21467 Fix flaky test TestCoprocessorClassLoader.testCleanupOldJars 2018-11-11 13:13:44 -06:00
maoling 5e84997f2f HBASE-13468 hbase.zookeeper.quorum supports ipv6 address 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-11-10 06:09:29 -08:00
huzheng f17382792f HBASE-21401 Sanity check in BaseDecoder#parseCell 2018-11-08 20:07:04 +08:00
zhangduo 62fe365934 HBASE-21351 The force update thread may have race with PE worker when the procedure is rolling back 2018-11-03 08:24:11 +08:00
Allan Yang 05d22ed960
HBASE-21292 IdLock.getLockEntry() may hang if interrupted 2018-10-18 14:42:10 -07:00
Sahil Aggarwal e520399201
HBASE-20716: Changes the bytes[] conversion done in Bytes and ByteBufferUtils. Instead of doing check unsafe_aligned available everytime, choose the best converter at startup. 2018-10-17 21:04:27 -07:00
Michael Stack 8cc56bd18c
HBASE-21320 [canary] Cleanup of usage and add commentary 
Signed-off-by: Peter Somogyi <psomogyi@cloudera.com>
 2018-10-16 22:20:00 -07:00
Zephyr Guo da63ebb2c0 HBASE-21256 Improve IntegrationTestBigLinkedList for testing huge data 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-10-12 10:59:35 +08:00
Mike Drob c9213f752e
HBASE-20764 build broken when latest commit is gpg signed 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-10-08 19:49:36 -05:00
zhangduo 71be251ef2 Revert "HBASE-21188 Print heap and gc informations in our junit ResourceChecker" 
This reverts commit dc1dedb073.
 2018-09-28 21:03:24 +08:00
zhangduo d7e08317d2 HBASE-21227 Implement exponential retrying backoff for Assign/UnassignRegionHandler introduced in HBASE-21217 2018-09-26 20:53:56 +08:00
Zach York 0e173d38b0 HBASE-20734 Colocate recovered edits directory with hbase.wal.dir 
Signed-off-by: Reid Chan <reidchan@apache.org>
 2018-09-26 11:20:57 +08:00
Mingliang Liu 08c4d70aaf
HBASE-21164 reportForDuty should do backoff rather than retry 
Remove unused methods from Sleeper (its ok, its @Private).
Remove notion of startTime from Sleeper handling (it is is unused).
Allow passing in how long to sleep so can maintain externally.
In HRS, use a RetryCounter to calculate backoff sleep time for when
reportForDuty is failing against a struggling Master.
 2018-09-25 11:32:28 -07:00
Chia-Ping Tsai c686b535c2 HBASE-21208 Bytes#toShort doesn't work without unsafe 
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: anoopsamjohn <anoopsamjohn@gmail.com>
Signed-off-by: Reid Chan <reidchan@apache.org>
 2018-09-25 10:19:36 +08:00
Michael Stack 6d7bc0e98b HBASE-21191 Add a holding-pattern if no assign for meta or namespace (Can happen if masterprocwals have been cleared). 
Add a check for hbase:meta being online before we go to read it.
If not online, move into a holding-pattern until rectified, probably
by external operator.

Incorporates bulk of patch made by Allan Yang over on HBASE-21035.

M hbase-common/src/main/java/org/apache/hadoop/hbase/util/RetryCounterFactory.java

 Add a Constructor for case where retries are for ever.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
 Move stuff around so that the first hbase:meta read is the AM#loadMeta.
 Previously, checking table state and/or favored nodes could end up
 trying to read a meta that was not onlined holding up master startup.
 Do similar for the namespace table. Adds new methods isMeta and
 isNamespace which check that the regions/tables are online.. if not,
 we wait logging with a back-off that assigns need to be run.

Signed-off-by: Allan Yang <allan163@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2018-09-16 21:44:17 -07:00
zhangduo dc1dedb073 HBASE-21188 Print heap and gc informations in our junit ResourceChecker 2018-09-13 09:58:34 +08:00
Tyler Mi 5c1b325b51 HBASE-21098 Improve Snapshot Performance with Temporary Snapshot Directory when rootDir on S3 
Signed-off-by: Zach York <zyork@apache.org>
 2018-09-11 16:23:16 -07:00
Allan Yang 7c1fad4992
HBASE-21083 Introduce a mechanism to bypass the execution of a stuck procedure 2018-08-30 12:23:24 -07:00
Umesh Agashe 3813f0ac3d HBASE-20941 Created and implemented HbckService in master 
Added API setTableStateInMeta() to update table state only in Meta. This will be used by hbck2 tool.
 2018-08-27 12:11:52 -07:00
brandboat 28635d6101 HBASE-18201 add UT and docs for DataBlockEncodingTool 
Signed-off-by: Reid Chan <reidchan@apache.org>
 2018-08-10 11:15:50 +08:00
Reid Chan d921262d38 Revert "HBASE-20965 Separate region server report requests to new handlers" 
This reverts commit 48d387413f.
 2018-08-08 10:44:50 +08:00
meiyi 48d387413f HBASE-20965 Separate region server report requests to new handlers 2018-08-08 10:39:11 +08:00
Reid Chan a8e184dc77 HBASE-20886 [Auth] Support keytab login in hbase client 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2018-07-31 11:04:40 +08:00
Alex Leblang e963694259
HBASE-19369 Switch to Builder Pattern In WAL 
This patch switches to the builder pattern by adding a helper method.
It also checks to ensure that the pattern is available (i.e. that
HBase is running on a hadoop version that supports it).

Amending-Author: Mike Drob <mdrob@apache.org>
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: zhangduo <zhangduo@apache.org>
 2018-07-27 23:42:33 -05:00
zhangduo 7178a98258 HBASE-20939 There will be race when we call suspendIfNotReady and then throw ProcedureSuspendedException 2018-07-27 17:27:12 +08:00
Xu Cang 1913164970 HBASE-20928 Rewrite calculation of midpoint - addemdum 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-07-25 10:00:58 -07:00
Saurabh Singh 3a3855aade HBASE-20928 Rewrite calculation of midpoint in binarySearch functions to prevent overflow 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-07-24 08:16:30 -07:00
Michael Stack 067388bfd9 HBASE-20914 Trim Master memory usage 
Add (weak reference) interning of ServerNames.

Correct Balancer regions x racks matrix.

Make smaller defaults when creating ArrayDeques.
 2018-07-20 10:08:55 -07:00
Mohit Goel 950d6e6fb0 HBASE-6028 Start/Stop compactions at region server level 
Add switching on/off of compactions.

Switching off compactions will also interrupt any currently ongoing compactions.
Adds a "compaction_switch" to hbase shell. Switching off compactions will
interrupt any currently ongoing compactions. State set from shell will be
lost on restart. To persist the changes across region servers modify
hbase.regionserver.compaction.enabled in hbase-site.xml and restart.

Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Michael Stack <stack@apache.org>
 2018-07-19 06:20:44 -07:00
Reid Chan 8c85763327 HBASE-20876 Improve docs style in HConstants (Contributed by Wei-Chiu Chuang) 2018-07-18 11:42:26 +08:00
Mike Drob dbcc80c9e7
HBASE-20884 Replace Base64 with j.u.Base64 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-07-13 12:59:36 -05:00
Yu Li c55acb0b03 HBASE-20838 Include hbase-server in precommit test if CommonFSUtils is changed 2018-07-12 10:16:11 +08:00
Wei-Chiu Chuang 6ee0fedb3d HBASE-20859 Backup and incremental load could fail in secure clusters. 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-07-11 16:56:39 -07:00
Yu Li ec8947f226 HBASE-20691 Change the default WAL storage policy back to "NONE"" 
This reverts commit 564c193d61 and added more doc
about why we choose "NONE" as the default.
 2018-07-04 13:43:48 +08:00
Pankaj bb8826ca5f HBASE-20357 AccessControlClient API Enhancement 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-06-28 22:48:58 -07:00
Xu Cang 78e7dd6537 HBASE-19722 Meta query statistics metrics source 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-06-28 17:17:23 -07:00
zhangduo a41c549ca4 HBASE-19082 Reject read/write from client but accept write from replication in state S 2018-06-28 18:07:44 +08:00
zhangduo 39dd81a7c6 HBASE-19957 General framework to transit sync replication state 2018-06-28 18:07:44 +08:00
Sahil Aggarwal 952bb96c8a
HBASE-19164: Remove UUID.randomUUID in tests. 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-06-27 10:34:16 -05:00
Ankit Singhal 99d54246ee HBASE-20795 Allow option in BBKVComparator.compare to do comparison without sequence id 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-06-26 16:47:12 -07:00
Sean Busbey f1b536bad4 HBASE-20332 shaded mapreduce module shouldn't include hadoop 
* modify the jar checking script to take args; make hadoop stuff optional
* separate out checking the artifacts that have hadoop vs those that don't.
* * Unfortunately means we need two modules for checking things
* * put in a safety check that the support script for checking jar contents is maintained in both modules
* * have to carve out an exception for o.a.hadoop.metrics2. :(
* fix duplicated class warning
* clean up dependencies in hbase-server and some modules that depend on it.
* allow Hadoop to have its own htrace where it needs it
* add a precommit check to make sure we're not using old htrace imports
 2018-06-18 11:31:04 -07:00
Balazs Meszaros c323e7bfaa
HBASE-20656 Validate pre-2.0 coprocessors against HBase 2.0+ 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-06-11 10:26:58 -05:00
Mike Drob eb13cdd7ed HBASE-20707 Move MissingSwitchDefault case check 
Perform this check using error-prone instead of checkstyle because the
former can handle enum switches somewhat more intelligently.
 2018-06-11 09:57:50 -05:00
Sean Busbey d909ec55aa HBASE-20444 Addendum keep folks from looking at raw version component array. 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-05-31 13:29:52 -05:00
maoling b77fb77b32 HBASE-20444 Improve comparison logic for HBase version strings 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2018-05-30 09:18:53 -05:00
Mike Drob a110e1eff5 HBASE-20478 Update checkstyle to v8.2 
Cannot go to latest (8.9) yet due to
  https://github.com/checkstyle/checkstyle/issues/5279

* move hbaseanti import checks to checkstyle
* implment a few missing equals checks, and ignore one
* fix lots of javadoc errors

Signed-off-by: Sean Busbey <busbey@apache.org>
 2018-05-29 10:12:31 -05:00
Guanghao Zhang 320a3332e0 HBASE-20589 Don't need to assign meta to a new RS when standby master become active 2018-05-24 11:26:48 +08:00
Michael Stack 079f168c5c HBASE-20620 HBASE-20564 Tighter ByteBufferKeyValue Cell Comparator; part 2 
Adds new stripped-down, faster ByteBufferKeyValue comparator
(BBKV is the base Cell-type in hbase2). Creates an instance
of new Comparator each time we create new memstore rather
than use the universal CellComparator.

Remove unused and unneeded Interfaces from Cell base type.
 2018-05-23 13:20:47 -07:00
Michael Stack f4006b5039 HBASE-20564 Tighter ByteBufferKeyValue Cell Comparator; ADDENDUM2 Add a Test 
Run meta tests but using our new basis, the ByteBufferKeyValue
instead of the old byte array-backed KeyValue so we catch any
oddness in the Type processing or in the Comparator.
 2018-05-16 12:56:08 -07:00
Balazs Meszaros 6148b4785d HBASE-20571 JMXJsonServlet generates invalid JSON if it has NaN in metrics 
- CacheStats won't generate NaN metrics.
- JSONBean class will serialize special floating point values as
  "NaN", "Infinity" or "-Infinity"

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-05-16 12:20:39 -07:00
Michael Stack 438af9bf74
HBASE-20564 Tighter ByteBufferKeyValue Cell Comparator; ADDENDUM 
Add method the CellComparator Interface. Add implementation to
meta comparator so we don't fall back to the default comparator.

Includes a nothing change to hbase-server/pom.xml just to provoke
build.
 2018-05-16 09:43:16 -07:00
Michael Stack db04a9f9d9 HBASE-20564 Tighter ByteBufferKeyValue Cell Comparator 
Make a purposed comparator for the new ByteBufferKeyValue
base type. Cache deserialized sizes rather than recalc each time.
 2018-05-14 15:18:26 +01:00
Michael Stack 7790ab156e HBASE-20506 Add doc and test for unused RetryCounter, useful-looking utility 2018-05-01 07:01:16 -07:00
Lars Hofhansl 00fca5a4c9 HBASE-20459 Majority of scan CPU time in HBase-1 spent in size estimation. 2018-04-21 10:12:24 -07:00
Sean Busbey 914de11416 HBASE-20442 clean up incorrect use of commons-collections 3 
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Yu Li <liyu@apache.org>
 2018-04-20 07:30:34 -05:00
Sean Busbey 09749f1574 HBASE-20440 Clean up incorrect use of commons-lang 2.y 
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Yu Li <liyu@apache.org>
 2018-04-20 07:29:23 -05:00
Umesh Agashe 6ca8261fc0 HBASE-18792 Disabled destructive (mostly write) operations in hbck for HBase 2.0+ 
HBase server versioned is checked after connecting to the server and then following operations are not allowed:
-fix, -fixAssignments, -fixMeta, -fixHdfsHoles, -fixHdfsOrphans, -fixTableOrphans, -fixHdfsOverlaps, -maxMerge
-sidelineBigOverlaps, -maxOverlapsToSideline, -fixSplitParents, -removeParents, -fixEmptyMetaCells
-repair, -repairHoles
 2018-04-18 15:22:39 -07:00
wangyu 80cbc0d1fe HBASE-20449 The minimun number of region should be configurable in Normalizer 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-04-18 08:45:52 -07:00
tedyu 73275f1774 HBASE-20291 Fix The POM for net.minidev:json-smart:jar:2.3-SNAPSHOT missing with hadoop 3 profile - revert since it is marked invalid 2018-04-13 13:39:04 -07:00
BELUGA BEHR d866e7c658 HBASE-19488 Move to using Apache commons CollectionUtils 
Signed-off-by: Apekshit Sharma <appy@apache.org>
 2018-04-04 14:12:19 -07:00
Mike Drob d57001ee2d HBASE-20282 Clean up tooling docs/help 2018-03-30 08:59:47 -07:00
Vasudevan cbd8b15e6b HBASE-20197 Review of ByteBufferWriterOutputStream.java (BELUGA BEHR) 
Signed-off-by: Vasudevan <ramkrishna.s.vasudevan@gmail.com>
 2018-03-30 12:13:41 +05:30
Yu Li 061a31fad1 HBASE-20159 Support using separate ZK quorums for client 2018-03-29 02:37:26 +08:00
Artem Ervits a7609bb3cd HBASE-20291 Fix The POM for net.minidev:json-smart:jar:2.3-SNAPSHOT missing with hadoop 3 profile 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-03-27 08:33:17 -07:00
Josh Elser 15c398f7d2 HBASE-20223 Update to hbase-thirdparty 2.1.0 
Remove commons-cli and commons-collections4 use. Account
for the newer internal protobuf version of 3.5.1.

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-03-26 22:05:19 -04:00
anoopsamjohn 3f7222df36 HBASE-17819 Reduce the heap overhead for BucketCache. 2018-03-25 16:36:30 +05:30
Chia-Ping Tsai ad47c2daf4 HBASE-19504 Add TimeRange support into checkAndMutate 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-03-24 00:12:38 +08:00
Chia-Ping Tsai a6eeb26cc0 HBASE-20212 Make all Public classes have InterfaceAudience category 
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Michael Stack <stack@apache.org>
 2018-03-22 18:10:23 +08:00
Chia-Ping Tsai 4f2133ee32 HBASE-20119 Introduce a pojo class to carry coprocessor information in order to make TableDescriptorBuilder accept multiple cp at once 
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: Michael Stack <stack@apache.org>
 2018-03-16 01:21:38 +08:00
Chance Li 4f54a66782 HBASE-19389 Limit concurrency of put with dense (hundreds) columns to prevent write handler exhausted 
Signed-off-by: Yu Li <liyu@apache.org>
 2018-03-14 18:38:33 +08:00
Yu Li 9a26af37b9 Revert "HBASE-19389 Limit concurrency of put with dense (hundreds) columns to prevent write handler exhausted" 
This reverts commit 98ac4f12b5.
 2018-03-14 18:38:07 +08:00
Yu Li 98ac4f12b5 HBASE-19389 Limit concurrency of put with dense (hundreds) columns to prevent write handler exhausted 
Signed-off-by: Yu Li <liyu@apache.org>
 2018-03-14 18:25:17 +08:00
anoopsamjohn e83ac38d68 HBASE-20078 MultiByteBuff : bug in reading primitives when individual buffers are too small. 2018-03-14 12:07:57 +05:30
Chia-Ping Tsai 1102e1e252
HBASE-20171 Remove o.a.h.h.ProcedureState 2018-03-12 09:28:05 -07:00
zhangduo dd6f4525e7 HBASE-20148 Make serial replication as a option for a peer instead of a table 2018-03-10 09:04:44 +08:00
Mike Drob 641e870e11 HBASE-19987 error-prone 2.2.0 2018-03-07 13:30:51 -06:00
tedyu b7fb2df154 HBASE-20136 TestKeyValue misses ClassRule and Category annotations 2018-03-06 08:34:49 -08:00
zhangduo b7b8683925 HBASE-20115 Reimplement serial replication based on the new replication storage layer 2018-03-05 20:25:25 +08:00
Sean Busbey 2a65066b35 HBASE-20070 refactor website generation 
* rely on git plumbing commands when checking if we've built the site for a particular commit already
* switch to forcing '-e' for bash
* add command line switches for: path to hbase, working directory, and publishing
* only export JAVA/MAVEN HOME if they aren't already set.
* add some docs about assumptions
* Update javadoc plugin to consistently be version 3.0.0
* avoid duplicative site invocations on reactor modules
* update use of cp command so it works both on linux and mac
* manually skip enforcer plugin during build
* still doing install of all jars due to MJAVADOC-490, but then skip rebuilding during aggregate reports.
* avoid the pager on git-diff by teeing to a log file, which also helps later reviewing in the case of big changesets.

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Misty Stanley-Jones <misty@apache.org>
 2018-03-02 09:25:10 -06:00
Michael Stack b11e506664 HBASE-20069 fix existing findbugs errors in hbase-server 2018-02-26 16:01:31 -08:00
Michael Stack 549a6d93d4 HBASE-20043 ITBLL fails against hadoop3 
Fix MoveRandomRegionOfTableAction. It depended on old AM behavior.
Make it do explicit move as is required in AMv3; w/o it, it was just
closing region causing test to fail.

Fix pom so hadoop3 profile specifies a different netty3 version.

Bunch of logging format change that came of trying trying to read
the spew from this test.
 2018-02-24 17:29:54 -08:00
Sean Busbey 216d2d4648 Revert "HBASE-19835 Use explicit casting to avoid side effects" 
This reverts commit f1a81618fd.

 Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/Segment.java

patch reverted changes that happened in parallel without explanation. see jira.
 2018-02-23 16:50:15 -06:00
zhangduo ad5cd50dfc HBASE-20048 Revert serial replication feature 2018-02-23 13:58:31 +08:00
tedyu 401227ba6a HBASE-20031 Unable to run integration test using mvn due to missing HBaseClassTestRule 2018-02-21 12:03:32 -08:00
eshcar f3bb9b9613 HBASE-18294 Reduce global heap pressure: flush based on heap occupancy 2018-02-18 09:55:44 +02:00
Michael Stack 969895105c HBASE-20014 TestAdmin1 Times out 2018-02-16 20:57:10 -08:00
zhangduo c18e7a963d HBASE-20000 Remove the quantum logic in FairQueue, always put high priority queue in front 2018-02-15 13:49:54 +08:00
Michael Stack 24bed6b3fb HBASE-19986 If HBaseTestClassRule timesout a test, thread dump; ADDENDUM; white-space, checkstyle, and rb feedback by Duo 2018-02-12 18:12:24 -08:00
Michael Stack c2ee82c909 HBASE-19986 If HBaseTestClassRule timesout a test, thread dump 2018-02-12 15:28:40 -08:00
Michael Stack 0593dda663 HBASE-19951 Cleanup the explicit timeout value for test method 2018-02-10 09:24:31 -08:00
Aman Poonia f1a81618fd HBASE-19835 Use explicit casting to avoid side effects 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-02-08 12:32:36 -08:00
Michael Stack 277ce3d8a3
HBASE-19956 Remove category as a consideration timing out tests; set all test to timeout at 10minutes regardless 2018-02-07 23:10:12 -08:00
zhangduo dcbb331792 HBASE-19929 Call RS.stop on a session expired RS may hang 2018-02-07 15:52:04 +08:00
Michael Stack 06dec20582
HBASE-19919 Tidying up logging 2018-02-03 08:42:02 -08:00
zhangduo 6519b98ac3 Revert "HBASE-19919 Tidying up logging" 
This reverts commit 40250f8c5f.

Wrong patch. Revert to fix compile error.
 2018-02-03 18:18:09 +08:00
Michael Stack 40250f8c5f HBASE-19919 Tidying up logging 2018-02-02 22:52:41 -08:00
Mike Drob 99b9fff07b HBASE-19841 Every HTU should be local until DFS starts 2018-02-01 20:24:11 -06:00
Michael Stack 52cb9aaf6e HBASE-19911 Convert some tests from small to medium because they are timing out: TestNettyRpcServer, TestClientClusterStatus; ADDENDUM2 Up timeout for smalltests from 30 seconds to 60 seconds -- a pause on jenkins can mess up smalltests 2018-02-01 08:25:44 -08:00
zhangduo 7c318cead9 HBASE-19887 Do not overwrite the surefire junit listener property in the pom of sub modules 2018-01-31 20:49:18 +08:00
Michael Stack 4f547b3817
HBASE-19840 Flakey TestMetaWithReplicas 
Fix two issues:

 # Meta Replicas can all be assigned to the same server. This
 will call the test to hang when we do our kill of the server
 hosting meta because there'll be no replicas to read from
 as test intends. Check is to look for this condition on
 startup and adjust if we come across it. Replicas cross-cut
 assignment. They need work.
 # Other issue was shutdown. The master started toward the
 end of the test may not have come up fully by the time
 shutdown is called. We could be stuck assigning the
 meta replicas. Have shutdown shutdown the procedure
 executor engine.

There is other cleanup and notes in the below.

M HMaster
 Remove the silly stops in startup now we have real
 means of shutting down Master during init.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterMetaBootstrap.java
 This replica stuff was doing stuff it shouldn't be doing
 like setting core Master state flags. It may have made
 sense once but now meta is assigned by a Pv2 Procedure
 so the flag setting in here is meddlesome. Clear out
 methods no longer needed.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
 Remove unused methods.
 Changes local variable names so they align w/ our naming elsewhere in
 code base.

M hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestMetaWithReplicas.java
 Check for all replicas on the one server.
 2018-01-29 09:21:30 -08:00
Chia-Ping Tsai fcbcfaa120 HBASE-19877 hbase-common and hbase-zookeeper don't add the log4j.properties to the resource path for testing 2018-01-29 16:52:19 +08:00
zhangduo 918599ef12 HBASE-19873 Add a CategoryBasedTimeout ClassRule for all UTs 2018-01-29 08:43:56 +08:00
Michael Stack a5a8c4f3f2
Revert "HBASE-19841 LocalHTU to not enforce stream capabilities" 
At Mike Drobs' request!
 2018-01-26 15:11:50 -08:00
Mike Drob 9ea152d235 HBASE-19841 LocalHTU to not enforce stream capabilities 2018-01-26 10:50:16 -06:00
Michael Stack 27d00f5861 HBASE-19794 TestZooKeeper hangs 
Kill backup master first

Add some cleanup around NamespaceManager

Shorten the timeout waiting on namespace manager as workaround
until we have better soln for interrupting ongoing client rpcs.
Do it in general for all tests.

Signed-off-by: zhangduo <zhangduo@apache.org>
 2018-01-21 20:59:16 +08:00
Apekshit Sharma 4bfdcaa3f3 HBASE-19823 Make RawCellBuilderFactory LimitedPrivate.UNITTEST 2018-01-19 14:53:01 -08:00
Chia-Ping Tsai 4bd6ac3e10
HBASE-19746 Add default impl to Cell#getType 2018-01-11 15:03:20 -08:00
Apekshit Sharma 09ae5abbe7 HBASE-19773 Documenting how to get instance of type RawCellBuilder 2018-01-11 13:17:03 -08:00
zhangduo 5e6c303528 HBASE-19543 Abstract a replication storage interface to extract the zk specific code 2018-01-09 13:11:01 +08:00
Xiang Li ee4f0c506a HBASE-19702 Improve RSGroupInfo constructors 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2018-01-09 12:55:14 +08:00
zhangduo 2509a150c0
HBASE-19731 TestFromClientSide#testCheckAndDeleteWithCompareOp and testNullQualifier are flakey 2018-01-08 10:35:36 -08:00
Beluga Behr a30d9fe8d9
HBASE-19651 Remove LimitInputStream 2018-01-05 16:59:29 -06:00
Michael Stack 2bf2b5b2c1
Revert "Revert "Revert "HBASE-19651 Remove LimitInputStream""" 
This reverts commit 032701c96c.
 2018-01-05 16:58:26 -06:00
Michael Stack 032701c96c
Revert "Revert "HBASE-19651 Remove LimitInputStream"" 
This reverts commit e5f7030ded.
 2018-01-05 16:55:59 -06:00
Beluga Behr e5f7030ded
Revert "HBASE-19651 Remove LimitInputStream" 
Revert to put Beluga in place as author.

This reverts commit 032fdc53de.
 2018-01-05 16:55:01 -06:00
Michael Stack 032fdc53de
HBASE-19651 Remove LimitInputStream 
Signed-off-by: Beluga Behr <dam6923@gmail.com>
 2018-01-05 08:31:11 -06:00