Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
13,173 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

5668 Commits

Author SHA1 Message Date
Duo Zhang 57dbad11da
HBASE-26393 The dockerfile for running pre commit and nightly jobs can not be built on branch-1 (#3790) 
Signed-off-by: Zhuoyue Huang <huangzhuoyue@apache.org>
 2021-10-23 20:35:12 +08:00
Rushabh Shah d309276121
HBASE-26195 Abort RS if wal sync fails or times out 2021-09-08 15:15:56 -04:00
caroliney14 ecac266633
HBASE-25849 Backport HBASE-22738, HBASE-24760 & HBASE-25298 to branch-1 (#3581) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-08-17 19:25:47 +05:30
Rushabh Shah 75844c8c39
HBASE-26185 Return mutable list in AssignmentManager#getExcludedServersForSystemTable (#3577) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-08-12 13:55:28 +05:30
Viraj Jasani 0ff6a75b48
HBASE-26185 Fix TestMaster#testMoveRegionWhenNotInitialized in the presence of hbase.min.version.move.system.tables (#3573) 
Signed-off-by: Michael Stack <stack@apache.org>
 2021-08-10 11:03:16 +05:30
caroliney14 8c18563cad
HBASE-25469 Add detailed RIT info in JSON format for consumption as metrics (#3557) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-08-04 18:05:39 -07:00
Duo Zhang 8f82cbfbcb HBASE-26120 New replication gets stuck or data loss when multiwal groups more than 10 (#3528) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/ReplicationSourceManager.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestReplicationSourceManager.java
 2021-07-27 08:54:28 -07:00
YutSean dbeabbac97
HBASE-26094 L2 BC should not be the victimhandler of L1 BC when using combined BC (#3498) 
Signed-off-by: Reid Chan <reidchan@apache.org>
 2021-07-23 10:38:11 +08:00
Bharath Vissapragada acebb2edff
HBASE-26109: Update version to 1.7.2-SNAPSHOT (#3513) 
Merge 1.7.1 CHANGES.txt

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-07-22 08:59:45 -07:00
Aman Poonia b2d329b5d8
HBASE-25986 set default value of normalization enabled from hbase site (#3492) (#3372) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-07-19 15:30:56 +05:30
Xiaolin Ha ed1a75905c
HBASE-25923 Region state stuck in PENDING_OPEN (#3312) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-07-19 14:15:39 +08:00
YutSean edd6ea9311
HBASE-26083 L1 miss metric is always 0 when using CombinedBlockCache (#3474) 
Signed-off-by Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by Reid Chan <reidchan@apache.org>
 2021-07-16 12:55:47 +08:00
Rushabh Shah 3b3ec323e4
HBASE-26075: Replication is stuck due to zero length wal file in oldWALs dir (#3467) 
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2021-07-09 15:24:20 -07:00
Bharath Vissapragada b7fbfdd078
HBASE-26074: Fix testLogLevelByHttps/testLogLevelByHttpsWithSpnego (#3466) 
Signed-off-by: Reid Chan <reidchan@apache.org>
 2021-07-08 22:46:50 -07:00
Bharath Vissapragada 5ece9cefea
HBASE-26070: Rewrite 1.7.0 faulty table descriptors at bootstrap (#3463) 
This patch rewrites incorrectly serialized table descriptors and states
from HBASE-26021 into PBs prior to the incompatible change. The patch
does this as a part of the active HMaster bootstrap.

This approach is _not_ fool proof as it does not handle all the edge cases
and may break certain rolling upgrade semantics. However it does provide a way
out for tables created with 1.7.0 PB definitions and an upgrade path for 1.7.1.
Easiest way is to shutdown the 1.7.0 cluster, reboot with 1.7.1 binaries and
everything should work cleanly. However, rolling upgrade could potentially be
broken as 1.7.0 client may not be compatible with 1.7.1 server.

As noted in the jira, it is not possible that any one upgraded to 1.7.0 yet
because they will run into HBASE-26021, however new clusters may have been
created with 1.7.0 and hence they need an upgrade path.

Tested locally:

- Created a mix of enabled/disabled tables created with 1.7.0
- Upgraded the cluster without this patch, noticed deserialization errors
- Upgraded the cluster with patch and table metadata has been re-serialized
  in correct format and table states are preserved.

Signed-off-by: Reid Chan <reidchan@apache.org>
 2021-07-07 21:19:31 -07:00
Viraj Jasani cad219d844
HBASE-22923 Consider minVersionToMoveSysTables while moving region and creating regionPlan (ADDENDUM) (#3456) (#3455) 
Signed-off-by: David Manning <david.manning@salesforce.com>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2021-07-03 22:47:19 +05:30
Viraj Jasani 7d0a72be14
HBASE-22923 min version of RegionServer to move system table regions (#3438) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2021-07-01 16:21:16 +05:30
Bharath Vissapragada 28f36f4619
HBASE-26021: Undo the incompatible serialization change in HBASE-7767 (#3435) 
Revert "HBASE-7767 Get rid of ZKTable, and table enable/disable state in ZK (Andrey Stepachev)"

Fixes the ConnectionRegistry and dependencies due to the revert.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-06-29 19:32:13 -07:00
Victor 395eb0c8e0
HBASE-25130 - Fix master in-memory server holding map after: (#3402) 
HBASE-25130 [branch-1] Masters in-memory serverHoldings map is not cleared during hbck repair

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-06-28 10:00:46 -07:00
YutSean fd2f8a581f
HBASE-26013 Get operations readRows metrics becomes zero after HBASE-25677 (#3410) 
Signed-off-by: Reid Chan <reidchan@apache.org>
 2021-06-22 16:14:55 +08:00
YutSean 5263b8cf40
HBASE-26004: port HBASE-26001 (cell level tags invisible in atomic operations when access control is on)to branch-1 (#3387) 
Signed-off-by: Reid Chan <reidchan@apache.org>
 2021-06-21 15:34:24 +08:00
Bharath Vissapragada 2e24bad826
HBASE-25984: Avoid premature reuse of sync futures in FSHLog (#3371) (#3398) 
Signed-off-by: Viraj Jasani vjasani@apache.org
(cherry picked from commit 5a19bcf)
 2021-06-18 17:42:15 -07:00
Reid Chan a40f4583e3 Set version on branch-1 to 1.7.1-SNAPSHOT 2021-06-12 15:31:29 +08:00
Victor 0fd6eeb012
HBASE-25910 - Fix port assignment test (#3308) 
Signed-off-by: David Manning <david.manning@salesforce.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-06-02 14:38:57 +05:30
Rushabh Shah 782e24bd9b
HBASE-25924 Re-compute size of WAL file while removing from WALEntryStream (#3316) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-05-26 10:42:52 -07:00
Anoop Sam John 3f8aa4c7e8
HBASE-25898 RS getting aborted due to NPE in Replication WALEntryStream (#3300) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Rushabh Shah <shahrs87@gmail.com>
Signed-off-by: Aman Poonia <aman.poonia.29@gmail.com>
 2021-05-26 14:31:17 +05:30
Rushabh Shah 130d6a1f15
HBASE-25887 Wait for appendExecutor to shutdown running tasks (#3264) 
Co-authored-by: Rushabh <rushabh.shah@salesforce.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2021-05-26 11:03:23 +08:00
Sandeep Pal 3cff107a5f
HBASE-25848: Add flexibility to backup replication in case replication filter throws an exception (#3291) 2021-05-21 17:22:13 -07:00
Rushabh Shah 1f04fac6d1
HBASE-25860 Add metric for successful wal roll requests. (#3241) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-05-08 13:12:07 +05:30
Andrew Purtell 39fdeae838 HBASE-25774 ServerManager.getOnlineServer may miss some region servers when refreshing state in some procedure implementations 
Revert "HBASE-25032 Wait for region server to become online before adding it to online servers in Master (#2770)"

This reverts commit 7652bef985.
 2021-05-07 17:56:22 -07:00
Rushabh Shah e2b5c20dc9
HBASE-25612 [branch-1] HMaster should abort if ReplicationLogCleaner is not able to delete oldWALs. (#3222) 
Signed-off-by Reid Chan <reidchan@apache.org>
 2021-05-06 23:29:19 +08:00
Sandeep Pal a0dd384691
HBASE-25741: Deadlock during peer cleanup with NoNodeException (#3204) 
Introduced due to commit from  HBASE-25583. Fix is to issue the cleanup asynchronously.

Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2021-05-05 17:21:25 -07:00
Andrew Purtell 3c87447810
HBASE-25808 [branch-1] Backport improvements to FSHLog from branch-2 (#3197) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
 2021-04-24 10:29:29 +08:00
Andrew Purtell 38b21f44ea
HBASE-25809 [branch-1] TestAtomicOperation.testMultiRowMutationMultiThreads deadlock (#3198) 
Signed-off-by: Reid Chan <reidchan@apache.org>
 2021-04-24 09:57:02 +08:00
Reid Chan 16304aa260 Update POMs and CHANGES.txt for 1.7.0RC0 2021-04-13 00:13:15 +08:00
Reid Chan c6ea62bbf3
HBASE-25748 [Addendum] use existed admin in testCreateTableRPCTimeOut (#3151) 2021-04-12 22:20:45 +08:00
Reid Chan 2bb22b58c9
HBASE-25753 [Flake Test][branch-1] TestSnapshotCloneIndependence's te… (#3138) 
* HBASE-25753 [Flake Test][branch-1] TestSnapshotCloneIndependence's teardown() is always timeout

* Remove unused imports
 2021-04-10 12:33:07 +08:00
Reid Chan ee69635fde
HBASE-25748 [Flake Test][branch-1] TestAdmin2 (#3134) 
Signed-off-by: Michael Stack <stack@apache.org>
 2021-04-09 11:16:34 +08:00
Geoffrey Jacoby c9d03c446d
HBASE-25740 - Backport HBASE-25629 to branch-1 (#3130) 
Signed-off-by Reid Chan <reidchan@apache.org>
 2021-04-07 15:47:47 +08:00
Geoffrey Jacoby b231dd620f
HBASE-25731 - TestConnectionImplementation BadHostname tests fail in branch-1 (#3120) 
Signed-off-by Reid Chan <reidchan@apache.org>
 2021-04-06 12:30:40 +08:00
Josh Elser 7851df7927 HBASE-25712 Backport of HBASE-25692 to branch-1 
HBASE-25692 ensures that we do not leak any InputStream (Socket)
which would otherwise remain as CLOSE_WAIT until the java process
exits. These orphaned sockets would eventually saturate Linux network
and file limits.

Closes #3104

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-04-02 14:01:35 -04:00
d-c-manning 616c5bbec5 HBASE-25726 MoveCostFunction is not included in the list of cost functions for StochasticLoadBalancer (#3116) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/TestStochasticLoadBalancer.java
 2021-04-02 10:32:32 -07:00
bitterfox d07ef8fbcb
HBASE-25670 Backport HBASE-25665 to branch-1 (#3059) 
Signed-off-by: stack <stack@apache.org>
 2021-03-29 13:02:52 -07:00
Baiqiang Zhao 060e9e7cb1
HBASE-25687 Backport "HBASE-25681 Add a switch for server/table queryMeter" to branch-2 and branch-1 (#3082) 
Signed-off-by: stack <stack@apache.org>
 2021-03-29 12:25:45 -07:00
caroliney14 7652bef985
HBASE-25032 Wait for region server to become online before adding it to online servers in Master (#2770) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
 2021-03-25 17:11:22 -07:00
Aman Poonia 35bb776f55
HBASE-25593 Backport changes from HBASE-24418 to branch-1 (#2991) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-03-25 01:07:42 +05:30
YutSean 74bb6a7a3a
HBASE-25677 Server+table counters on each scan #nextRaw invocation becomes a bottleneck when heavy load (#3066) 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
 2021-03-24 14:12:51 +08:00
Sandeep Pal 97c152ea7a
HBASE-25627: HBase replication should have a metric to represent if the source is stuck getting initialized (#3009) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2021-03-22 22:55:04 -07:00
bitterfox 716c685497
HBASE-25672 Backport HBASE-25608 to branch-1 (#3068) 
Signed-off-by: stack <stack@apache.org>
 2021-03-22 08:57:11 -07:00
shahrs87 bea87b30ec
HBASE-25679 Size of log queue metric is incorrect (#3072) 
Co-authored-by: Rushabh <rushabh.shah@salesforce.com>
Signed-off-by: stack <stack@apache.org>
 2021-03-19 16:17:35 -07:00