5657 Commits

Author SHA1 Message Date
YutSean
edd6ea9311
HBASE-26083 L1 miss metric is always 0 when using CombinedBlockCache (#3474)
Signed-off-by Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by Reid Chan <reidchan@apache.org>
2021-07-16 12:55:47 +08:00
Rushabh Shah
3b3ec323e4
HBASE-26075: Replication is stuck due to zero length wal file in oldWALs dir (#3467)
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-07-09 15:24:20 -07:00
Bharath Vissapragada
b7fbfdd078
HBASE-26074: Fix testLogLevelByHttps/testLogLevelByHttpsWithSpnego (#3466)
Signed-off-by: Reid Chan <reidchan@apache.org>
2021-07-08 22:46:50 -07:00
Bharath Vissapragada
5ece9cefea
HBASE-26070: Rewrite 1.7.0 faulty table descriptors at bootstrap (#3463)
This patch rewrites incorrectly serialized table descriptors and states
from HBASE-26021 into PBs prior to the incompatible change. The patch
does this as a part of the active HMaster bootstrap.

This approach is _not_ fool proof as it does not handle all the edge cases
and may break certain rolling upgrade semantics. However it does provide a way
out for tables created with 1.7.0 PB definitions and an upgrade path for 1.7.1.
Easiest way is to shutdown the 1.7.0 cluster, reboot with 1.7.1 binaries and
everything should work cleanly. However, rolling upgrade could potentially be
broken as 1.7.0 client may not be compatible with 1.7.1 server.

As noted in the jira, it is not possible that any one upgraded to 1.7.0 yet
because they will run into HBASE-26021, however new clusters may have been
created with 1.7.0 and hence they need an upgrade path.

Tested locally:

- Created a mix of enabled/disabled tables created with 1.7.0
- Upgraded the cluster without this patch, noticed deserialization errors
- Upgraded the cluster with patch and table metadata has been re-serialized
  in correct format and table states are preserved.

Signed-off-by: Reid Chan <reidchan@apache.org>
2021-07-07 21:19:31 -07:00
Viraj Jasani
cad219d844
HBASE-22923 Consider minVersionToMoveSysTables while moving region and creating regionPlan (ADDENDUM) (#3456) (#3455)
Signed-off-by: David Manning <david.manning@salesforce.com>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-07-03 22:47:19 +05:30
Viraj Jasani
7d0a72be14
HBASE-22923 min version of RegionServer to move system table regions (#3438)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-07-01 16:21:16 +05:30
Bharath Vissapragada
28f36f4619
HBASE-26021: Undo the incompatible serialization change in HBASE-7767 (#3435)
Revert "HBASE-7767 Get rid of ZKTable, and table enable/disable state in ZK (Andrey Stepachev)"

Fixes the ConnectionRegistry and dependencies due to the revert.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-06-29 19:32:13 -07:00
Victor
395eb0c8e0
HBASE-25130 - Fix master in-memory server holding map after: (#3402)
HBASE-25130 [branch-1] Masters in-memory serverHoldings map is not cleared during hbck repair

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-06-28 10:00:46 -07:00
YutSean
fd2f8a581f
HBASE-26013 Get operations readRows metrics becomes zero after HBASE-25677 (#3410)
Signed-off-by: Reid Chan <reidchan@apache.org>
2021-06-22 16:14:55 +08:00
YutSean
5263b8cf40
HBASE-26004: port HBASE-26001 (cell level tags invisible in atomic operations when access control is on)to branch-1 (#3387)
Signed-off-by: Reid Chan <reidchan@apache.org>
2021-06-21 15:34:24 +08:00
Bharath Vissapragada
2e24bad826
HBASE-25984: Avoid premature reuse of sync futures in FSHLog (#3371) (#3398)
Signed-off-by: Viraj Jasani vjasani@apache.org
(cherry picked from commit 5a19bcf)
2021-06-18 17:42:15 -07:00
Reid Chan
a40f4583e3 Set version on branch-1 to 1.7.1-SNAPSHOT 2021-06-12 15:31:29 +08:00
Victor
0fd6eeb012
HBASE-25910 - Fix port assignment test (#3308)
Signed-off-by: David Manning <david.manning@salesforce.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-06-02 14:38:57 +05:30
Rushabh Shah
782e24bd9b
HBASE-25924 Re-compute size of WAL file while removing from WALEntryStream (#3316)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-05-26 10:42:52 -07:00
Anoop Sam John
3f8aa4c7e8
HBASE-25898 RS getting aborted due to NPE in Replication WALEntryStream (#3300)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Rushabh Shah <shahrs87@gmail.com>
Signed-off-by: Aman Poonia <aman.poonia.29@gmail.com>
2021-05-26 14:31:17 +05:30
Rushabh Shah
130d6a1f15
HBASE-25887 Wait for appendExecutor to shutdown running tasks (#3264)
Co-authored-by: Rushabh <rushabh.shah@salesforce.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-05-26 11:03:23 +08:00
Sandeep Pal
3cff107a5f
HBASE-25848: Add flexibility to backup replication in case replication filter throws an exception (#3291) 2021-05-21 17:22:13 -07:00
Rushabh Shah
1f04fac6d1
HBASE-25860 Add metric for successful wal roll requests. (#3241)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-05-08 13:12:07 +05:30
Andrew Purtell
39fdeae838 HBASE-25774 ServerManager.getOnlineServer may miss some region servers when refreshing state in some procedure implementations
Revert "HBASE-25032 Wait for region server to become online before adding it to online servers in Master (#2770)"

This reverts commit 7652bef985b52624f0903a44a6b6d08759b97cd7.
2021-05-07 17:56:22 -07:00
Rushabh Shah
e2b5c20dc9
HBASE-25612 [branch-1] HMaster should abort if ReplicationLogCleaner is not able to delete oldWALs. (#3222)
Signed-off-by Reid Chan <reidchan@apache.org>
2021-05-06 23:29:19 +08:00
Sandeep Pal
a0dd384691
HBASE-25741: Deadlock during peer cleanup with NoNodeException (#3204)
Introduced due to commit from  HBASE-25583. Fix is to issue the cleanup asynchronously.

Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-05-05 17:21:25 -07:00
Andrew Purtell
3c87447810
HBASE-25808 [branch-1] Backport improvements to FSHLog from branch-2 (#3197)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
2021-04-24 10:29:29 +08:00
Andrew Purtell
38b21f44ea
HBASE-25809 [branch-1] TestAtomicOperation.testMultiRowMutationMultiThreads deadlock (#3198)
Signed-off-by: Reid Chan <reidchan@apache.org>
2021-04-24 09:57:02 +08:00
Reid Chan
16304aa260 Update POMs and CHANGES.txt for 1.7.0RC0 2021-04-13 00:13:15 +08:00
Reid Chan
c6ea62bbf3
HBASE-25748 [Addendum] use existed admin in testCreateTableRPCTimeOut (#3151) 2021-04-12 22:20:45 +08:00
Reid Chan
2bb22b58c9
HBASE-25753 [Flake Test][branch-1] TestSnapshotCloneIndependence's te… (#3138)
* HBASE-25753 [Flake Test][branch-1] TestSnapshotCloneIndependence's teardown() is always timeout

* Remove unused imports
2021-04-10 12:33:07 +08:00
Reid Chan
ee69635fde
HBASE-25748 [Flake Test][branch-1] TestAdmin2 (#3134)
Signed-off-by: Michael Stack <stack@apache.org>
2021-04-09 11:16:34 +08:00
Geoffrey Jacoby
c9d03c446d
HBASE-25740 - Backport HBASE-25629 to branch-1 (#3130)
Signed-off-by Reid Chan <reidchan@apache.org>
2021-04-07 15:47:47 +08:00
Geoffrey Jacoby
b231dd620f
HBASE-25731 - TestConnectionImplementation BadHostname tests fail in branch-1 (#3120)
Signed-off-by Reid Chan <reidchan@apache.org>
2021-04-06 12:30:40 +08:00
Josh Elser
7851df7927 HBASE-25712 Backport of HBASE-25692 to branch-1
HBASE-25692 ensures that we do not leak any InputStream (Socket)
which would otherwise remain as CLOSE_WAIT until the java process
exits. These orphaned sockets would eventually saturate Linux network
and file limits.

Closes #3104

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2021-04-02 14:01:35 -04:00
d-c-manning
616c5bbec5 HBASE-25726 MoveCostFunction is not included in the list of cost functions for StochasticLoadBalancer (#3116)
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/TestStochasticLoadBalancer.java
2021-04-02 10:32:32 -07:00
bitterfox
d07ef8fbcb
HBASE-25670 Backport HBASE-25665 to branch-1 (#3059)
Signed-off-by: stack <stack@apache.org>
2021-03-29 13:02:52 -07:00
Baiqiang Zhao
060e9e7cb1
HBASE-25687 Backport "HBASE-25681 Add a switch for server/table queryMeter" to branch-2 and branch-1 (#3082)
Signed-off-by: stack <stack@apache.org>
2021-03-29 12:25:45 -07:00
caroliney14
7652bef985
HBASE-25032 Wait for region server to become online before adding it to online servers in Master (#2770)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2021-03-25 17:11:22 -07:00
Aman Poonia
35bb776f55
HBASE-25593 Backport changes from HBASE-24418 to branch-1 (#2991)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-03-25 01:07:42 +05:30
YutSean
74bb6a7a3a
HBASE-25677 Server+table counters on each scan #nextRaw invocation becomes a bottleneck when heavy load (#3066)
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
2021-03-24 14:12:51 +08:00
Sandeep Pal
97c152ea7a
HBASE-25627: HBase replication should have a metric to represent if the source is stuck getting initialized (#3009)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-03-22 22:55:04 -07:00
bitterfox
716c685497
HBASE-25672 Backport HBASE-25608 to branch-1 (#3068)
Signed-off-by: stack <stack@apache.org>
2021-03-22 08:57:11 -07:00
shahrs87
bea87b30ec
HBASE-25679 Size of log queue metric is incorrect (#3072)
Co-authored-by: Rushabh <rushabh.shah@salesforce.com>
Signed-off-by: stack <stack@apache.org>
2021-03-19 16:17:35 -07:00
shahrs87
2a979e8bb0
HBASE-25622 Result#compareResults should compare tags. (#3004)
Signed-off-by Anoop Sam John <anoopsamjohn@apache.org>
2021-03-18 12:27:16 -07:00
Bo Cui
9534a1b150
HBASE-24395 Backport HBASE-20589 to branch-1 (#2690)
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
Signed-off-by: stack <stack@apache.org>
2021-03-15 16:55:41 -07:00
d-c-manning
ba80103a8c
HBASE-25648 Fix normalizer and TestSimpleRegionNormalizerOnCluster in branch-1 (#3038)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-03-09 11:43:10 +05:30
Narges Shadab
4546163d90
HBASE-25626 Possible Resource Leak in HeterogeneousRegionCountCostFunction
Signed-off-by Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by shahrs87 <shahrs87@gmail.com>
2021-03-05 15:14:49 +05:30
Rahul Kumar
c90d122653
HBASE-25460 : Expose drainingServers as cluster metric (#2994) (#2995)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-03-04 12:59:07 +05:30
Sandeep Pal
4cfbf19791
HBASE-25583: NoNodeException of the peer should call the remove peer workflow (#2970)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-02-26 16:00:37 -08:00
Sandeep Pal
19fe18e466
HBASE-25596: Fix NPE and avoid permanent unreplicated data due to EOF (#2975)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-02-23 13:20:00 -08:00
Aman Poonia
d37f734299
HBASE-25592 Improve normalizer code in line with HBASE-23932 (#2972)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-02-23 10:41:34 +05:30
shahrs87
9e9301a242
[HBASE-25539] Add age of oldest wal metric (#2963)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-02-22 15:00:41 -08:00
Sandeep Pal
f9a91488b2
HBASE-25583: Handle the running replication source gracefully with replication nodes deleted (#2960)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-02-19 10:15:45 -08:00
Sandeep Pal
2d26c94ef0
HBASE-25541 : Setting the path to null when we dequeue the current log (#2959)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-02-18 11:58:33 +05:30