7664 Commits

Author SHA1 Message Date
Tai-Ying Lee
f4ff480387
HBASE-20509 putting List in HashSet directly without using addAll function to improve performance
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2019-08-24 00:02:27 +02:00
Jan Hentschel
808f051b8a
HBASE-22755 Removed deprecated methods from Mutation
Signed-off-by: stack <stack@apache.org>
2019-08-23 20:56:19 +02:00
openinx
4268774de1
HBASE-22867 The ForkJoinPool in CleanerChore will spawn thousands of threads in our cluster with thousands table (#513)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
2019-08-22 19:42:01 +08:00
Sakthi
b329bf0a57 Revert "HBASE-22013 SpaceQuotas - getNumRegions() returning wrong number of regions due to region replicas"
This reverts commit 7af5b30eca89591e6c03319d356c690e72f531ce.
2019-08-21 23:54:25 -07:00
openinx
84ee378df1
HBASE-22810 Initialize an separate ThreadPoolExecutor for taking/restoring snapshot (addendum - use the old config key) (#517) 2019-08-22 11:33:51 +08:00
Viraj Jasani
b8857ec010 HBASE-22863 Cleanup transitive Jackson1 vulnerable dependencies(forward-port HBASE-22728) (#505)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
2019-08-21 22:06:05 +08:00
shahrs87
61a3a9ffbb HBASE-22601 Misconfigured addition of peers leads to cluster shutdown. (#499)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-08-21 21:52:50 +08:00
shardul-cr7
7af5b30eca HBASE-22013 SpaceQuotas - getNumRegions() returning wrong number of regions due to region replicas
Signed-off-by: Sakthi <sakthi@apache.org>
2019-08-21 00:44:16 -07:00
Andrew Purtell
ab28f9d8c7
Revert "HBASE-22823 Mark Canary as Public/Evolving"
This reverts commit edf6f68cb2d0c10c9ecd2977c5f9c6f3b3579000.

See HBASE-22874
2019-08-20 09:46:37 -07:00
stack
67382809d3 HBASE-22882 TestFlushSnapshotFromClient#testConcurrentSnapshottingAttempts is flakey (was written flakey)
Addendum; just remove the test altogether

 Signed-off-by:  Nick Dimiduk <ndimiduk@apache.org>
2019-08-19 14:28:30 -07:00
stack
8e488ce9ef HBASE-22882 TestFlushSnapshotFromClient#testConcurrentSnapshottingAttempts is flakey (was written flakey) 2019-08-19 12:59:04 -07:00
Guanghao Zhang
0b3db5099c HBASE-22857 Fix the failed ut TestHRegion and TestHRegionWithInMemoryFlush (#495)
Signed-off-by: Peter Somogyi psomogyi@apache.org
Signed-off-by: stack stack@apache.org
2019-08-19 12:59:00 -07:00
satanson
7697d48cd7 HBASE-22870 reflection fails to access a private nested class
Signed-off-by Reid Chan <reidchan@apache.org>
2019-08-18 09:47:06 +08:00
Pierre Zemb
836f26976e HBASE-22618 added the possibility to load custom cost functions
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2019-08-17 15:25:52 -03:00
Duo Zhang
8cb531f207
HBASE-22871 Move the DirScanPool out and do not use static field (#504)
Signed-off-by: Zheng Hu <openinx@gmail.com>
Signed-off-by: Reid Chan <reidchan@apache.org>
2019-08-17 23:35:04 +08:00
Huon Wilson
43a0ec80fa HBASE-22841 Add more factory functions to TimeRange
These functions make it easier to possible to use
`org.apache.hadoop.hbase.client.Table.CheckAndMutateBuilder#timeRange`
with more interesting ranges, without being forced to use the
deprecated constructors.

Signed-off-by: huzheng <openinx@gmail.com>
2019-08-17 09:41:34 +08:00
Daisuke Kobayashi
3eb602c7f7 HBASE-22860 Master's webui returns NPE/HTTP 500 under maintenance mode
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2019-08-16 10:33:38 +01:00
Guanghao Zhang
94af65163b
HBASE-22858 Add HBCK Report to master's header.jsp (#497)
Signed-off-by: Stack <stack@apache.org>
Signed-off-by: Sakthi <sakthi@apache.org>
2019-08-16 01:34:40 -05:00
Itsuki Toyota
78f5d8ebb2 HBASE-22833 MultiRowRangeFilter should provide a method for creating… (#493)
* HBASE-22833: MultiRowRangeFilter should provide a method for creating a filter which is functionally equivalent to multiple prefix filters

* Delete superfluous comments

* Add description for MultiRowRangeFilter constructor

* Add null check for rowKeyPrefixes

* Fix checkstyle

Signed-off-by: huzheng <openinx@gmail.com>
2019-08-16 09:59:01 +08:00
meiyi
60971bee66
HBASE-22842 Tmp directory should not be deleted when master restart used for user scan snapshot feature (#485) 2019-08-16 09:38:39 +08:00
Caroline Zhou
edf6f68cb2
HBASE-22823 Mark Canary as Public/Evolving
Signed-off-by: Xu Cang <xucang@apache.org>
2019-08-15 14:09:06 -07:00
openinx
8ffc45ab8b
HBASE-22810 Initialize an separate ThreadPoolExecutor for taking/restoring snapshot (#486) 2019-08-15 10:57:42 +08:00
Andrew Purtell
27ed2ac071
HBASE-22828 Log a region close journal (#471)
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
2019-08-13 15:42:41 -07:00
Jan Hentschel
3867fae04d
HBASE-22829 Removed deprecated methods from SnapshotDescription
Signed-off-by: stack <stack@apache.org>
2019-08-12 08:41:05 +02:00
Jan Hentschel
e9382154f3
HBASE-22830 Removed deprecated method from StoreFile
Signed-off-by: stack <stack@apache.org>
2019-08-12 01:06:15 +02:00
syedmurtazahassan
15c903b3f8 HBASE-22725 Remove all remaining Javadoc warnings
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2019-08-11 21:48:08 +02:00
Geoffrey Jacoby
c8f57bf678 HBASE-22623 - Add RegionObserver coprocessor hook for preWALAppend (#390)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-08-09 14:27:32 -07:00
Daisuke Kobayashi
0136b9873f HBASE-22543 Revisit HBASE-21207 to make all values fully sortable
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2019-08-09 14:29:30 +01:00
Guanghao Zhang
989e09a2d5
HBASE-22824 Show filesystem path for the orphans regions on filesystem (#469)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-08-09 02:07:14 -05:00
Sakthi
eb92b25652
HBASE-22803 Modify config value range to enable turning off of the hbck chore (#466)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-08-08 17:33:42 -07:00
Guanghao Zhang
9250977681
HBASE-22808 HBCK Report showed the offline regions which belong to disabled table (#465)
Signed-off-by: Stack <stack@apache.org>
2019-08-08 03:57:17 -05:00
meiyi
0e5dc6d7ce
HBASE-22776 Rename config names in user scan snapshot feature (#440) 2019-08-08 16:01:02 +08:00
Guanghao Zhang
547cec4078
HBASE-22807 HBCK Report showed wrong orphans regions on FileSystem (#461)
Signed-off-by: Sakthi <sakthi@apache.org>
2019-08-07 19:17:26 -05:00
stack
1b168cd6de HBASE-22777 Add a multi-region merge (for fixing overlaps)
Makes MergeTableRegionsProcedure do more than just two regions at a
time. Compatible as MTRP was done considering one day it'd do more than
two at a time.

Changes hardcoded assumption that merge parent regions are named
mergeA and mergeB in a column on the resultant region. Instead
can have N columns on the merged region, one for each parent
merged. Column qualifiers all being with 'merge'.

Most of code below is undoing the assumption that there are two
parents on a merge only.
2019-08-07 15:22:07 -07:00
syedmurtazahassan
49839e4075 HBASE-22812 InterfaceAudience annotation in CatalogJanitor uses fully… (#462)
Signed-off-by: Stack <stack@apache.org>
Signed-off-by: Sakthi <sakthi@apache.org>
2019-08-07 10:38:09 -07:00
Wellington Chevreuil
a9773ec5e8 HBASE-22417 DeleteTableProcedure.deleteFromMeta method should remove table from Master's table descriptors cache
Signed-off-by: stack <stack@apache.org>
2019-08-07 12:06:12 +01:00
Andor Molnár
07c6bb16e7 HBASE-22759 Add user info to AUDITLOG events when doing grant/revoke 2019-08-07 11:06:30 +02:00
Wellington Chevreuil
3b0013ded9 HBASE-22731 ReplicationSource and HBaseInterClusterReplicationEndpoint log messages should include a target Peer identifier
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-08-06 16:08:04 +01:00
sreenivasulureddy
eef8e140c5 HBASE-22793 RPC server connection is logging user as NULL principal
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Pankaj Kumar <pankaj.kr@huawei.com>
2019-08-06 14:40:21 +02:00
stack
08677143e8 HBASE-22771 [HBCK2] fixMeta method and server-side support
This is a first cut at this patch. Implements hold fixing only
currently.

Add a fixMeta method to Hbck Interface.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/CatalogJanitor.java
 Bug fix. If hole is on end of last table, I wasn't seeing it.

A hbase-server/src/main/java/org/apache/hadoop/hbase/master/MetaFixer.java
 Add a general meta fixer class. Explains up top why this stuff doesn't
 belong inside MetaTableAccessor.

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
 Break out the filesystem messing so don't have to copy it nor do more
 than is needed doing fixup for Region holes.

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionFileSystem.java
 Change behavious slightly. If directory exists, don't fail as we did
 but try and keep going and create .regioninfo file if missing (or
 overwrite if in place). This should make it idempotent. Can rerun
 command. Lets see if any repercussions in test suite.

A hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestMetaFixer.java
 Add test.

Signed-off-by: Zheng Hu <openinx@gmail.com>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-08-05 22:20:29 -07:00
stack
30805be078 HBASE-22771 [HBCK2] fixMeta method and server-side support
This is a first cut at this patch. Implements hold fixing only
currently.

Add a fixMeta method to Hbck Interface.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/CatalogJanitor.java
 Bug fix. If hole is on end of last table, I wasn't seeing it.

A hbase-server/src/main/java/org/apache/hadoop/hbase/master/MetaFixer.java
 Add a general meta fixer class. Explains up top why this stuff doesn't
 belong inside MetaTableAccessor.

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
 Break out the filesystem messing so don't have to copy it nor do more
 than is needed doing fixup for Region holes.

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionFileSystem.java
 Change behavious slightly. If directory exists, don't fail as we did
 but try and keep going and create .regioninfo file if missing (or
 overwrite if in place). This should make it idempotent. Can rerun
 command. Lets see if any repercussions in test suite.

A hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestMetaFixer.java
 Add test.

Signed-off-by: Zheng Hu <openinx@gmail.com>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-08-05 22:08:31 -07:00
Duo Zhang
66a2fc5d25
HBASE-22539 WAL corruption due to early DBBs re-use when Durability.ASYNC_WAL is used (#437)
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-08-05 16:19:05 +08:00
Wellington Chevreuil
237229cade HBASE-22707 [HBCK2] MasterRpcServices assigns method should try to reload regions from meta if the passed regions isn't found under AssignmentManager RegionsStateStore
Signed-off-by: stack <stack@apache.org>
2019-08-01 16:49:57 +01:00
Guanghao Zhang
35acf3cb78
HBASE-22737 Add a new admin method and shell cmd to trigger the hbck chore to run (#425)
Signed-off-by: stack <stack@apache.org>
2019-08-01 08:54:47 +08:00
Jan Hentschel
24b970ec51
Revert "HBASE-22744 Removed deprecated status and load classes in client module"
This reverts commit 4a61c8b10a912b10ba516b34f1c94aa4aa849aa8.
2019-07-31 12:29:19 +02:00
Biju Nair
9a4a8ef274 HBASE-22363 Remove hardcoded number of read cache block buckets
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-07-31 09:13:17 +02:00
Jan Hentschel
586e177ded HBASE-22753 Removed deprecated ImmutableHRegionInfo (#420)
Signed-off-by: stack <stack@apache.org>
2019-07-31 08:07:31 +02:00
stack
373c2dc13f HBASE-22741 Show catalogjanitor consistency complaints in new 'HBCK Report' page
Signed-off-by: huzheng <openinx@gmail.com>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-07-30 11:16:45 -07:00
Jan Hentschel
4a61c8b10a
HBASE-22744 Removed deprecated status and load classes in client module
Signed-off-by: stack <stack@apache.org>
2019-07-30 12:40:42 +02:00
Jan Hentschel
f9fd5b65fa HBASE-22752 Removed the deprecated ImmutableHColumnDescriptor and ImmutableHTableDescriptor (#419)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: stack <stack@apache.org>
2019-07-30 12:32:10 +02:00