chenxu14
17468efb88
HBASE-23293 [REPLICATION] make ship edits timeout configurable ( #825 )
...
Signed-off-by: Guangxu Cheng <gxcheng@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2019-11-26 19:05:53 +08:00
Bharath Vissapragada
834ccb4bf6
HBASE-23259: Populate master address end points in cluster/rs configs ( #807 )
...
All the clients need to know the master RPC end points while using master
based registry for creating cluster connections. This patch amends the
test cluster utility to populate these configs in the base configuration
object used to spin up the cluster.
The config key added here ("hbase.master.addrs") is used in the subsequent
patches for HBASE-18095.
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2019-11-20 10:15:43 -08:00
belugabehr
33bedf8d4d
HBASE-23308: Review of NullPointerExceptions ( #836 )
...
Signed-off-by: stack <stack@apache.org>
2019-11-19 13:51:11 -08:00
Sean Busbey
b292ffd14d
HBASE-19450 Addendum Limit logging of chore execution time at INFO to once per 5 minutes.
...
* Ensure MovingAverage related classes are IA.Private
* Move trace logging into MovingAverage class
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-11-16 09:38:44 -06:00
Reid Chan
67f9afc722
HBASE-19450 Add log about average execution time for ScheduledChore
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-11-14 21:50:08 -06:00
Mingliang Liu
73f3e1d4a4
HBASE-23283 Provide clear and consistent logging about the period of enabled chores
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-11-14 20:32:10 -06:00
Geoffrey Jacoby
77490f815a
HBASE-23251 - Add Column Family and Table Names to HFileContext and use in HFileWriterImpl logging ( #796 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Xu Cang <xucang@apache.org>
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-11-11 16:18:43 +08:00
Viraj Jasani
10cc64a7d6
HBASE-23212 : Dynamically reload configs for Region Recovery chore ( #773 )
...
* HBASE-23212 : Dynamically reload configs for Region Recovery chore
* remove redundant volatile
2019-11-04 11:36:38 -08:00
Michael Stack
e1b4a2a895
HBASE-23221 Polish the WAL interface after HBASE-23181 ( #774 )
...
Removes the closeRegion flag added by HBASE-23181 and instead
relies on reading meta WALEdit content. Modified how qualifier is
written when the meta WALEdit is for a RegionEventDescriptor
so the 'type' is added to the qualifer so can figure type
w/o having to deserialize protobuf value content: e.g.
HBASE::REGION_EVENT::REGION_CLOSE
Added doc on WALEdit and tried to formalize the 'meta' WALEdit
type and how it works. Needs complete redo in part as suggested
by HBASE-8457. Meantime, some doc and cleanup.
Also changed the LogRoller constructor to remove redundant param.
Because of constructor change, need to change also
TestFailedAppendAndSync, TestWALLockup, TestAsyncFSWAL &
WALPerformanceEvaluation.java
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Lijin Bin <binlijin@apache.org>
2019-10-31 18:52:04 +08:00
chenxu14
255be63e1d
HBASE-23184 The HeapAllocation in WebUI is not accurate ( #730 )
...
Signed-off-by: stack <stack@apache.org>
2019-10-31 17:53:24 +08:00
Duo Zhang
7b5cd0152f
HBASE-23181 Blocked WAL archive: "LogRoller: Failed to schedule flush of XXXX, because it is not online on us" ( #753 )
...
Signed-off-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: stack <stack@apache.org>
2019-10-26 20:37:37 +08:00
Viraj Jasani
14dcf1d0c6
HBASE-22460 : Reopen regions with very high Store Ref Counts ( #600 )
...
Signed-off-by Anoop Sam John <anoopsamjohn@apache.org>
2019-10-23 21:16:47 +05:30
Viraj Jasani
2ad62b0162
HBASE-22679 : Revamping CellUtil ( #735 )
...
* HBASE-22679 : Revamping CellUtil
* checkstyle fix
* incorporating review
* minor indentation
2019-10-21 23:04:21 -07:00
chenxu14
0043dfebc5
HBASE-23107 Avoid temp byte array creation when doing cacheDataOnWrite ( #678 )
...
Signed-off-by: huzheng <openinx@gmail.com>
Signed-off-by: stack <stack@apache.org>
2019-10-17 09:44:40 +08:00
chenxu14
1aee5f0552
HBASE-23083 Collect Executor status info periodically and report to ( #664 )
...
metrics system
Signed-off-by: stack <stack@apache.org>
2019-10-11 12:05:53 -07:00
Michael Stack
abc38d80e4
HBASE-23129 Move core to use hbase-thirdparty-3.1.1 ( #695 )
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-10-11 14:30:28 +02:00
haxiaolin
92bf07a98d
HBASE-22767 System table RIT STUCK if their RSGroup has no highest version RSes
...
Signed-off-by: stack <stack@apache.org>
2019-10-08 16:31:22 -07:00
Istvan Toth
800c35a30e
HBASE-23119 ArrayIndexOutOfBoundsException in PrivateCellUtil#qualifierStartsWith ( #688 )
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Viraj Jasani <virajjasani007@gmail.com>
2019-10-04 15:13:03 +02:00
stack
2ebdcbc3b0
Revert " HBASE-23055 Alter hbase:meta ( #667 )"
...
Revert because new feedback and requested survey of master usage
figuring table state.
This reverts commit 52176184df
.
2019-10-01 09:24:10 -07:00
Michael Stack
52176184df
HBASE-23055 Alter hbase:meta ( #667 )
...
Make it so hbase:meta can be altered. TableState for hbase:meta
is kept in Master. State is in-memory transient so if Master
fails, hbase:meta is ENABLED again. hbase:meta schema will be
bootstrapped from the filesystem. Changes to filesystem schema
are atomic so we should be ok if Master fails mid-edit (TBD)
Undoes a bunch of guards that prevented our being able to edit
hbase:meta. At minimmum, need to add in a bunch of WARNING.
TODO: Tests, more clarity around hbase:meta table state, and undoing
references to hard-coded hbase:meta regioninfo.
M hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
Throw illegal access exception if you try to use MetaTableAccessor
getting state of the hbase:meta table.
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
For table state, go to master rather than go to meta direct. Going
to meta won't work for hbase;meta state. Puts load on Master.
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java
Change isTableDisabled/Enabled implementation to ask the Master instead.
This will give the Master's TableStateManager's opinion rather than
client figuring it for themselves reading meta table direct.
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/RawAsyncHBaseAdmin.java
TODO: Cleanup in here. Go to master for state, not to meta.
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/ZKAsyncRegistry.java
Logging cleanup.
M hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/ZNodePaths.java
Shutdown access.
M hbase-server/src/main/java/org/apache/hadoop/hbase/TableDescriptors.java
Just cleanup.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/TableStateManager.java
Add state holder for hbase:meta.
Removed unused methods.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/RegionStateStore.java
Shut down access.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/DisableTableProcedure.java
Allow hbase:meta to be disabled.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/EnableTableProcedure.java
Allow hbase:meta to be enabled.
Signed-off-by: Ramkrishna <ramkrishna.s.vasudevan@intel.com>
2019-09-30 09:29:51 -07:00
chenxu14
ce0fbc2af9
HBASE-22965 RS Crash due to DBE reference to an reused ByteBuff ( #603 )
...
Signed-off-by: huzheng <openinx@gmail.com>
2019-09-30 09:17:07 +08:00
Sanjeet Nishad
b45c0d0efa
HBASE-23038 Provide consistent and clear logging about disabling chores
...
Signed-off-by: Viraj Jasani <virajjasani007@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-09-27 15:01:15 -05:00
Viraj Jasani
0dbae8f0e1
HBASE-23024 Replace initcause with Constructor arg ( #627 )
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-09-17 13:39:26 +02:00
Viraj Jasani
1dcc8ee50c
HBASE-22760 : Pause/Resume/Query Snapshot Auto Cleanup Activity ( #617 )
2019-09-13 10:34:01 +05:30
Duo Zhang
936bb82908
Revert "HBASE-22695 Store the rsgroup of a table in table configuration ( #426 )"
...
This reverts commit eab7d3d502
.
2019-09-10 11:14:17 +08:00
Duo Zhang
64581fa33b
Revert "HBASE-22819 Automatically migrate the rs group config for table after HBASE-22695 ( #498 )"
...
This reverts commit 9196a15de9
.
2019-09-10 11:13:58 +08:00
Duo Zhang
9196a15de9
HBASE-22819 Automatically migrate the rs group config for table after HBASE-22695 ( #498 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-09-10 10:47:44 +08:00
Duo Zhang
eab7d3d502
HBASE-22695 Store the rsgroup of a table in table configuration ( #426 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-09-10 10:47:44 +08:00
chenxu14
fb7230c3f1
HBASE-22802 Avoid temp ByteBuffer allocation in FileIOEngine#read ( #583 )
2019-09-09 17:38:33 +08:00
Josh Elser
fbd5b5e327
HBASE-22701 Disable the DynamicClassLoader when it fails to initialize
...
Signed-off-by: Ankit Singhal <ankitsinghal59@gmail.com>
2019-09-04 13:34:41 -04:00
康智冬
97fbaa658e
HBASE-22962 Fix typo in javadoc description ( #569 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-09-01 20:14:31 +08:00
linkaline
3e2cfc1140
HBASE-22883 Duplacate codes of method Threads.newDaemonThreadFactory() and class DaemonThreadFactory ( #537 )
...
Signed-off-by: stack <stack@apache.org>
2019-08-27 15:27:22 -07:00
ravowlga123
ec68bf30ba
HBASE-22893 Change the comment in HBaseClassTestRule to reflect change in default test timeouts ( #545 )
...
Signed-off-by: Sakthi <sakthi@apache.org>
2019-08-27 01:34:01 -07:00
linkaline
ee9d98611b
HBASE-22881 Fix non-daemon threads in hbase server implementation ( #512 )
...
* address checkstyle issue
* change threadPool threads to daemon in server implementation
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: stack <stack@apache.org>
2019-08-23 17:36:58 -07:00
openinx
84ee378df1
HBASE-22810 Initialize an separate ThreadPoolExecutor for taking/restoring snapshot (addendum - use the old config key) ( #517 )
2019-08-22 11:33:51 +08:00
Huon Wilson
43a0ec80fa
HBASE-22841 Add more factory functions to TimeRange
...
These functions make it easier to possible to use
`org.apache.hadoop.hbase.client.Table.CheckAndMutateBuilder#timeRange`
with more interesting ranges, without being forced to use the
deprecated constructors.
Signed-off-by: huzheng <openinx@gmail.com>
2019-08-17 09:41:34 +08:00
openinx
8ffc45ab8b
HBASE-22810 Initialize an separate ThreadPoolExecutor for taking/restoring snapshot ( #486 )
2019-08-15 10:57:42 +08:00
stack
1b168cd6de
HBASE-22777 Add a multi-region merge (for fixing overlaps)
...
Makes MergeTableRegionsProcedure do more than just two regions at a
time. Compatible as MTRP was done considering one day it'd do more than
two at a time.
Changes hardcoded assumption that merge parent regions are named
mergeA and mergeB in a column on the resultant region. Instead
can have N columns on the merged region, one for each parent
merged. Column qualifiers all being with 'merge'.
Most of code below is undoing the assumption that there are two
parents on a merge only.
2019-08-07 15:22:07 -07:00
Jan Hentschel
3f524abdeb
HBASE-22789 Removed deprecated method from ImmutableBytesWritable
...
Signed-off-by: stack <stack@apache.org>
2019-08-05 17:57:46 +02:00
Jan Hentschel
32434d1200
HBASE-22788 Removed deprecated methods from Bytes
...
Signed-off-by: stack <stack@apache.org>
2019-08-05 11:12:30 +02:00
Jan Hentschel
f6ece8d8e3
HBASE-22790 Added deprecation versions for fields in ByteBuffAllocator
...
Signed-off-by: stack <stack@apache.org>
2019-08-05 08:59:46 +02:00
Reid Chan
a62fdccd3b
HBASE-22609 [Docs] More detail documentation about 'hbase.server.thread.wakefrequency'
...
Signed-off-by: stack <stack@apache.org>
2019-08-05 14:51:00 +08:00
Braavos
d0e5ea1b87
HBASE-22677 Add unit tests for org.apache.hadoop.hbase.util.ByteRangeUtils and Classes
...
Co-authored-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2019-08-05 03:29:51 +02:00
stack
0c80d5b42b
HBASE-22723 Have CatalogJanitor report holes and overlaps; i.e. problems it sees when doing its regular scan of hbase:meta
...
Refactor of CatalogJanitor so it generates a
Report on the state of hbase:meta when it runs. Also
refactor so CJ runs even if RIT (previous it would
punt on running if RIT) so it can generate a 'Report'
on the interval regardless. If RIT, it just doesn't
go on to do the merge/split GC as it used to.
If report finds an issue, dump as a WARN message
to the master log.
Follow-on is to make the Report actionable/available
for the Master to pull when it goes to draw the hbck
UI page (could also consider shipping the Report as
part of ClusterMetrics?)
Adds new, fatter Visitor to CJ, one that generates
Report on each run keeping around more findings as
it runs.
Moved some methods around so class reads better;
previous methods were randomly ordered in the class.
M hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
Make a few handy methods public.
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/RegionInfo.java
Add utility as defaults on the Inteface; i.e. is this the first region
in table, is it last, does a passed region come next, or does passed
region overlap this region (added tests for this new stuff).
M hbase-common/src/main/java/org/apache/hadoop/hbase/util/Bytes.java
Bugfix... handle case where buffer passed is null.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/CatalogJanitor.java
Lots of change, reorg., but mostly adding consistency checking
to the visitor used scanning hbase:meta on a period and the
generation of a Report on what the scan has found traversing
hbase:meta. Added a main so could try the CatalogJanitor against
a running cluster.
A hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestCatalogJanitorCluster.java
Fat ugly test for CatalogJanitor consistency checking.
M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegionInfo.java
Add tests for new functionality in RI.
M hbase-shell/src/main/ruby/hbase/table.rb
Bug fix for case where meta has a null regioninfo; scan was aborting.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2019-07-29 16:00:57 -07:00
Wellington Chevreuil
3708198817
HBASE-21773 rowcounter utility should respond to pleas for help
...
Signed-off-by: stack <stack@apache.org>
2019-07-26 21:19:17 +01:00
syedmurtazahassan
d9493c539f
HBASE-22603 Javadoc Warnings related to @link tag
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2019-07-23 14:14:12 +02:00
Viraj Jasani
9615c644f5
HBASE-22648 Snapshot TTL ( #371 )
...
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-07-22 15:03:44 -07:00
Viraj Jasani
aa9679ddbc
HBASE-22718 Removal of org.apache.hadoop.hbase.util.Counter ( #396 )
...
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-07-22 13:56:08 +02:00
openinx
00075ea4fc
HBASE-22663 The HeapAllocationRatio in WebUI is not accurate because all of the heap allocation will happen in another separated allocator named HEAP ( #365 )
2019-07-20 23:30:08 +08:00
毛蛤丝
54b514d62a
HBASE-22700:incorrect timeout in recommended ZooKeeper configuration
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-07-17 22:08:52 +08:00
syedmurtazahassan
8defea9561
HBASE-22586 Javadoc Warnings related to @param tag
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2019-07-13 16:46:18 +02:00
Braavos
53a8c2675f
HBASE-22669 Add unit tests for org.apache.hadoop.hbase.util.Strings ( #363 )
...
These tests were written using Diffblue Cover.
2019-07-10 10:07:55 +02:00
Peter Somogyi
b22459c37c
HBASE-22651 ErrorProne issue in TestByteBufferArray
...
Signed-off-by: Michael Stack <stack@apache.org>
2019-07-02 16:37:05 +02:00
syedmurtazahassan
fabf2b8282
HBASE-22572 Javadoc Warnings: @link reference not found ( #306 )
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: stack <stack@apache.org>
2019-07-01 21:15:00 -07:00
openinx
0198868531
HBASE-20060 Add details of off heap memstore into book. ( #334 )
2019-06-26 14:58:34 +08:00
Duo Zhang
b42614295e
HBASE-22617 Recovered WAL directories not getting cleaned up ( #330 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-06-25 16:21:24 +08:00
yuliangwan
841b319e4d
HBASE-22611 Close the DataOutputStream object #325
2019-06-24 14:14:05 -07:00
Jan Hentschel
10032a11ba
HBASE-16002 Made constructors of DataType subclasses public
...
Signed-off-by: stack <stack@apache.org>
2019-06-24 22:32:18 +02:00
openinx
531d2902cb
HBASE-22612 Address the final overview reviewing comments of HBASE-21879 ( #331 )
2019-06-24 18:04:40 +08:00
openinx
2e414360bd
HBASE-22547 Align the config keys and add document for offheap read in HBase Book. ( #301 )
2019-06-24 10:25:34 +08:00
openinx
686847cb79
HBASE-22598 Deprecated the hbase.ipc.server.reservoir.initial.buffer.size & hbase.ipc.server.reservoir.initial.max for HBase2.x compatibility ( #318 )
2019-06-24 10:25:34 +08:00
openinx
d64c3a2611
HBASE-22491 Separate the heap HFileBlock and offheap HFileBlock because the heap block won't need refCnt and save into prevBlocks list before shipping ( #268 )
2019-06-24 10:25:33 +08:00
huzheng
97c1158421
HBASE-22504 Optimize the MultiByteBuff#get(ByteBuffer, offset, len)
2019-06-24 10:25:33 +08:00
openinx
f83c919587
HBASE-22483 It's better to use 65KB as the default buffer size in ByteBuffAllocator ( #279 )
2019-06-24 10:25:33 +08:00
huzheng
b1fee0ebdd
HBASE-22435 Add a UT to address the HFileBlock#heapSize() in TestHeapSize
2019-06-24 10:25:33 +08:00
huzheng
7188a3bd3d
HBASE-22412 Improve the metrics in ByteBuffAllocator
2019-06-24 10:25:33 +08:00
huzheng
97476ed2e0
HBASE-21921 Notify users if the ByteBufAllocator is always allocating ByteBuffers from heap which means the increacing GC pressure
2019-06-24 10:25:33 +08:00
huzheng
7dedb5625a
HBASE-21937 Make the Compression#decompress can accept ByteBuff as input
2019-06-24 10:25:32 +08:00
huzheng
48aca4db30
HBASE-21957 Unify refCount of BucketEntry and refCount of hbase.nio.ByteBuff into one
2019-06-24 10:25:32 +08:00
huzheng
773c0d6635
HBASE-22159 ByteBufferIOEngine should support write off-heap ByteBuff to the bufferArray
2019-06-24 10:25:32 +08:00
huzheng
d1eb6171f9
HBASE-22127 Ensure that the block cached in the LRUBlockCache offheap is allocated from heap
2019-06-24 10:25:32 +08:00
huzheng
35b818606f
HBASE-22005 Use ByteBuff's refcnt to track the life cycle of data block
2019-06-24 10:25:31 +08:00
huzheng
532ebfb7a5
HBASE-21916 Abstract an ByteBuffAllocator to allocate/free ByteBuffer in ByteBufferPool
2019-06-24 10:25:31 +08:00
Sean Busbey
9aee88e03a
HBASE-22615 Make TestChoreService more robust to timing
...
* phrase fudge factor "deltas" in terms of the original period
* increase the delta allowed for chore timing from 5% to 20%
* improve some assertions
Closes #328
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Sakthi <sakthivel.azhaku@gmail.com>
2019-06-22 00:07:10 -05:00
Mingliang Liu
6d08ffcfc6
HBASE-21284 Default limits for PressureAwareCompactionThroughputController are too low
...
This is a forward port HBASE-21000 from branch-1.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-06-20 12:44:01 -07:00
zhangduo
5d872d3422
HBASE-21526 Use AsyncClusterConnection in ServerManager for getRsAdmin
2019-06-18 08:35:58 +08:00
zhangduo
30c131b5f7
HBASE-21515 Also initialize an AsyncClusterConnection in HRegionServer
2019-06-18 08:35:58 +08:00
Jan Hentschel
5da5deb59d
HBASE-22344 Documented the deprecation of public and limited private APIs ( #208 )
...
Signed-off-by: stack <stack@apache.org>
2019-06-17 22:02:23 +02:00
Murtaza Hassan
9ba7651889
HBASE-22565 Javadoc Warnings: @see cannot be used in inline documentation
2019-06-13 23:09:42 +02:00
Sakthi
0445186f1a
HBASE-22458: TestClassFinder fails when run on JDK11
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-06-13 08:31:08 -05:00
Sakthi
9b23e1d00c
HBASE-22534 TestCellUtil fails when run on JDK11
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-06-04 14:10:37 -05:00
Sean Busbey
51c49a1784
HBASE-22497 Mark HBase 1.2 line as EOM
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-06-03 06:55:58 -05:00
Duo Zhang
1be93fcaec
HBASE-22316 Record the stack trace for current thread in FutureUtils.get
2019-05-30 11:10:06 +08:00
Wellington Chevreuil
25c6cd3a4f
HBASE-22496 UnsafeAccess.unsafeCopy should not copy more than UNSAFE_COPY_THRESHOLD on each iteration
...
Change-Id: I259bc54a0a5b3474d3c455639c3e9cb1e95c8438
Signed-off-by: huzheng <openinx@gmail.com>
2019-05-30 10:07:39 +08:00
Artem Ervits
3a3857690a
HBASE-22469 replace md5 checksum in saveVersion script with sha512
...
Signed-off-by: Josh Elser <elserj@apache.org>
2019-05-28 14:53:56 -04:00
Sean Busbey
6ddf893a34
HBASE-22148 Provide a LimitedPrivate(COPROC) API for setting Cell timestamp without copying.
...
Signed-off-by: Josh Elser <elserj@apache.org>
2019-05-28 12:18:30 -05:00
Andrew Purtell
a30b186568
HBASE-22449 https everywhere in Maven metadata ( #247 )
2019-05-21 12:34:25 -07:00
Peter Somogyi
94122f6a74
HBASE-22340 Corrupt KeyValue is silently ignored ( #207 )
2019-05-02 11:17:28 +02:00
Sakthi
e44fe4964a
HBASE-22054: Space Quota: Compaction is not working for super user in case of NO_WRITES_COMPACTIONS
...
Signed-off-by: Josh Elser <elserj@apache.org>
2019-04-30 12:18:21 -04:00
Sean Busbey
bf140acd20
HBASE-22083 move eclipse settings into a profile.
...
Signed-off-by: stack <stack@apache.org>
2019-04-25 14:17:18 -05:00
Duo Zhang
184568cadd
HBASE-22307 Deprecated Preemptive Fail Fast
2019-04-25 14:19:58 +08:00
李小保
7617b71f00
HBASE-22250 The same constants used in many places should be placed in constant classes
...
Signed-off-by: stack <stack@apache.org>
2019-04-23 21:24:14 -07:00
zouxiangwen
6855143ba9
HBASE-22292 PreemptiveFastFailInterceptor clean repeatedFailuresMap issue
...
Signed-off-by: stack <stack@apache.org>
2019-04-23 07:56:59 -07:00
Michael Stack
1584d24a33
Merge pull request #100 from OrDTesters/fix-flaky-testCleanupOldJars
...
HBASE-21467 Fix flaky test TestCoprocessorClassLoader.testCleanupOldJars
2019-04-22 21:56:21 -07:00
Jan Hentschel
f30d6c958a
HBASE-22231 Removed unused and '*' imports
2019-04-20 22:03:32 +02:00
Ben Manes
8ec93ea193
HBASE-15560 W-TinyLFU based BlockCache
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-04-17 11:10:36 -07:00
Sayed Anisul Hoque
409523b110
HBASE-22248 Removed deprecated CollectionUtils
2019-04-17 10:07:21 +02:00
Andrew Purtell
cc9d401015
HBASE-22235 OperationStatus.{SUCCESS|FAILURE|NOT_RUN} are not visible to 3rd party coprocessors
2019-04-16 13:19:59 -07:00
subrat.mishra
f22b8ade63
HBASE-22053 Addendum changed zookeeper version from 3.3.3 to 3.4.10.
2019-03-28 08:09:47 -07:00
subrat.mishra
53f449c47e
HBASE-22053 Changed zookeeper URL from http://hadoop.apache.org to https://zookeeper.apache.org Replaced version 3.1.1 with 3.3.3 as 3.1.1 is deprecated.
...
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
2019-03-28 00:30:54 +09:00
Geoffrey Jacoby
d4c37778ee
HBASE-22032 KeyValue validation should check for null byte array
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-03-15 12:34:26 -07:00
Duo Zhang
3c5761e365
HBASE-22002 Remove the deprecated methods in Admin interface
...
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-03-14 21:42:23 +08:00
Sean Busbey
3f1498ddb4
HBASE-22044 ByteBufferUtils should not be IA.Public API
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-03-13 13:39:22 -05:00
zhangduo
10ca598004
HBASE-22001 Polish the Admin interface
...
Signed-off-by: stack <stack@apache.org>
2019-03-11 14:38:31 +08:00
Sean Busbey
a7bbff170a
HBASE-21999 ADDENDUM unknown revisions are okay; make sure we indicate them.
2019-03-07 11:51:40 -06:00
ramkrishna
fd6bc5d900
HBASE-21874 Bucket cache on Persistent memory
...
Signed-off-by: Anoop John <anoop.hbase@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 763202d48e
)
2019-03-07 08:50:08 -06:00
Sean Busbey
d9793c311c
Revert "HBASE-21874 Bucket cache on Persistent memory"
...
This reverts commit 763202d48e
.
bad signed-off-by line
2019-03-07 08:49:41 -06:00
stack
0d69f84bd2
HBASE-21999 [DEBUG] Exit if git returns empty revision!
2019-03-06 16:46:23 -08:00
ramkrishna
763202d48e
HBASE-21874 Bucket cache on Persistent memory
...
Signed-off-by: Anoop John <anoop.hbase@gmail.com>, Sean Busbey
<busbey@apache.org>
2019-03-06 22:37:54 +05:30
Reid Chan
f748e489c5
HBASE-21481 [acl] Superuser's permissions should not be granted or revoked by any non-su global admin
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-01 23:37:28 +08:00
Duo Zhang
f0032c9255
HBASE-20587 Replace Jackson with shaded thirdparty gson
...
Signed-off-by: Michael Stack <stack@apache.org>
2019-02-22 16:24:51 +08:00
zhangduo
e984515b74
HBASE-21928 Deprecated HConstants.META_QOS
...
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-02-20 14:16:40 +08:00
Duo Zhang
8bed65fa01
HBASE-21900 Infinite loop in AsyncMetaRegionLocator if we can not get the location for meta
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-14 19:50:02 +08:00
zhangduo
2b1b79f08b
HBASE-21829 Use FutureUtils.addListener instead of calling whenComplete directly
2019-02-03 15:24:54 +08:00
Wellington Chevreuil
54093b0d1f
HBASE-20215 - Rename CollectionUtils to ConcurrentMapUtils
2019-01-24 20:55:15 -08:00
zhangduo
416b70f461
HBASE-21761 Align the methods in RegionLocator and AsyncTableRegionLocator
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-24 15:21:11 +08:00
Allan Yang
b5619a2a26
HBASE-21754 ReportRegionStateTransitionRequest should be executed in priority executor
2019-01-23 20:55:00 +08:00
huzheng
35ed5d6c39
HBASE-21750 Most of KeyValueUtil#length can be replaced by cell#getSerializedSize for better performance because the latter one has been optimized
2019-01-22 19:58:03 +08:00
Duo Zhang
882bd564f4
HBASE-21726 Add getAllRegionLocations method to AsyncTableRegionLocator
2019-01-19 11:14:35 +08:00
Peter Somogyi
51c58e083c
HBASE-21727 Simplify documentation around client timeout
...
Signed-off-by: Michael Stack <stack@apache.org>
2019-01-16 11:32:46 +01:00
huzheng
15031c5bd5
HBASE-21657 PrivateCellUtil#estimatedSerializedSizeOf has been the bottleneck in 100% scan case
2019-01-16 09:41:02 +08:00
tianjingyun
281d6429e5
HBASE-21588 Procedure v2 wal splitting implementation
2019-01-07 15:58:15 +08:00
zhangduo
db66e6cc9e
HBASE-17356 Add replica get support
2019-01-03 08:38:20 +08:00
huzheng
12786f80c1
HBASE-21401 Sanity check when constructing the KeyValue
2018-12-21 18:01:35 +08:00
zhangduo
1acbd36c90
HBASE-21154 Remove hbase:namespace table; fold it into hbase:meta
2018-11-26 14:51:56 +08:00
Reid Chan
130057f137
HBASE-21255 [acl] Refactor TablePermission into three classes (Global, Namespace, Table)
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-11-15 11:34:16 +08:00
huzheng
a8b642067d
HBASE-21473 RowIndexSeekerV1 may return cell with extra two \x00\x00 bytes which has no tags
2018-11-14 23:00:12 +08:00
huzheng
362b5dd259
Revert "HBASE-21401 Sanity check in BaseDecoder#parseCell"
...
This reverts commit f17382792f
.
2018-11-12 11:37:46 +08:00
OrDTesters
3af7d02d1d
HBASE-21467 Fix flaky test TestCoprocessorClassLoader.testCleanupOldJars
2018-11-11 13:13:44 -06:00
maoling
5e84997f2f
HBASE-13468 hbase.zookeeper.quorum supports ipv6 address
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-11-10 06:09:29 -08:00
huzheng
f17382792f
HBASE-21401 Sanity check in BaseDecoder#parseCell
2018-11-08 20:07:04 +08:00
zhangduo
62fe365934
HBASE-21351 The force update thread may have race with PE worker when the procedure is rolling back
2018-11-03 08:24:11 +08:00
Allan Yang
05d22ed960
HBASE-21292 IdLock.getLockEntry() may hang if interrupted
2018-10-18 14:42:10 -07:00
Sahil Aggarwal
e520399201
HBASE-20716: Changes the bytes[] conversion done in Bytes and ByteBufferUtils. Instead of doing check unsafe_aligned available everytime, choose the best converter at startup.
2018-10-17 21:04:27 -07:00
Michael Stack
8cc56bd18c
HBASE-21320 [canary] Cleanup of usage and add commentary
...
Signed-off-by: Peter Somogyi <psomogyi@cloudera.com>
2018-10-16 22:20:00 -07:00
Zephyr Guo
da63ebb2c0
HBASE-21256 Improve IntegrationTestBigLinkedList for testing huge data
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-10-12 10:59:35 +08:00
Mike Drob
c9213f752e
HBASE-20764 build broken when latest commit is gpg signed
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-10-08 19:49:36 -05:00
zhangduo
71be251ef2
Revert "HBASE-21188 Print heap and gc informations in our junit ResourceChecker"
...
This reverts commit dc1dedb073
.
2018-09-28 21:03:24 +08:00
zhangduo
d7e08317d2
HBASE-21227 Implement exponential retrying backoff for Assign/UnassignRegionHandler introduced in HBASE-21217
2018-09-26 20:53:56 +08:00
Zach York
0e173d38b0
HBASE-20734 Colocate recovered edits directory with hbase.wal.dir
...
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-09-26 11:20:57 +08:00
Mingliang Liu
08c4d70aaf
HBASE-21164 reportForDuty should do backoff rather than retry
...
Remove unused methods from Sleeper (its ok, its @Private).
Remove notion of startTime from Sleeper handling (it is is unused).
Allow passing in how long to sleep so can maintain externally.
In HRS, use a RetryCounter to calculate backoff sleep time for when
reportForDuty is failing against a struggling Master.
2018-09-25 11:32:28 -07:00
Chia-Ping Tsai
c686b535c2
HBASE-21208 Bytes#toShort doesn't work without unsafe
...
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: anoopsamjohn <anoopsamjohn@gmail.com>
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-09-25 10:19:36 +08:00
Michael Stack
6d7bc0e98b
HBASE-21191 Add a holding-pattern if no assign for meta or namespace (Can happen if masterprocwals have been cleared).
...
Add a check for hbase:meta being online before we go to read it.
If not online, move into a holding-pattern until rectified, probably
by external operator.
Incorporates bulk of patch made by Allan Yang over on HBASE-21035.
M hbase-common/src/main/java/org/apache/hadoop/hbase/util/RetryCounterFactory.java
Add a Constructor for case where retries are for ever.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
Move stuff around so that the first hbase:meta read is the AM#loadMeta.
Previously, checking table state and/or favored nodes could end up
trying to read a meta that was not onlined holding up master startup.
Do similar for the namespace table. Adds new methods isMeta and
isNamespace which check that the regions/tables are online.. if not,
we wait logging with a back-off that assigns need to be run.
Signed-off-by: Allan Yang <allan163@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2018-09-16 21:44:17 -07:00
zhangduo
dc1dedb073
HBASE-21188 Print heap and gc informations in our junit ResourceChecker
2018-09-13 09:58:34 +08:00
Tyler Mi
5c1b325b51
HBASE-21098 Improve Snapshot Performance with Temporary Snapshot Directory when rootDir on S3
...
Signed-off-by: Zach York <zyork@apache.org>
2018-09-11 16:23:16 -07:00
Allan Yang
7c1fad4992
HBASE-21083 Introduce a mechanism to bypass the execution of a stuck procedure
2018-08-30 12:23:24 -07:00
Umesh Agashe
3813f0ac3d
HBASE-20941 Created and implemented HbckService in master
...
Added API setTableStateInMeta() to update table state only in Meta. This will be used by hbck2 tool.
2018-08-27 12:11:52 -07:00
brandboat
28635d6101
HBASE-18201 add UT and docs for DataBlockEncodingTool
...
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-08-10 11:15:50 +08:00
Reid Chan
d921262d38
Revert "HBASE-20965 Separate region server report requests to new handlers"
...
This reverts commit 48d387413f
.
2018-08-08 10:44:50 +08:00
meiyi
48d387413f
HBASE-20965 Separate region server report requests to new handlers
2018-08-08 10:39:11 +08:00