Commit Graph

13164 Commits

Author SHA1 Message Date
Duo Zhang ae68083e7a HBASE-26313 Publish the test logs for our nightly jobs to nightlies.apache.org (#3713)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-10-07 23:41:48 +08:00
Duo Zhang 97b3eca80a HBASE-26318 Publish test logs for flaky jobs to nightlies (#3717)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-10-07 23:34:58 +08:00
Rushabh Shah d309276121
HBASE-26195 Abort RS if wal sync fails or times out 2021-09-08 15:15:56 -04:00
chenglei 08ff55df71 HBASE-26244 Avoid trim the error stack trace when running UT with maven (#3654)
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-01 15:21:44 +08:00
caroliney14 ecac266633
HBASE-25849 Backport HBASE-22738, HBASE-24760 & HBASE-25298 to branch-1 (#3581)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-08-17 19:25:47 +05:30
Rushabh Shah 75844c8c39
HBASE-26185 Return mutable list in AssignmentManager#getExcludedServersForSystemTable (#3577)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-08-12 13:55:28 +05:30
Viraj Jasani 0ff6a75b48
HBASE-26185 Fix TestMaster#testMoveRegionWhenNotInitialized in the presence of hbase.min.version.move.system.tables (#3573)
Signed-off-by: Michael Stack <stack@apache.org>
2021-08-10 11:03:16 +05:30
caroliney14 8c18563cad
HBASE-25469 Add detailed RIT info in JSON format for consumption as metrics (#3557)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-08-04 18:05:39 -07:00
Duo Zhang 8f82cbfbcb HBASE-26120 New replication gets stuck or data loss when multiwal groups more than 10 (#3528)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/ReplicationSourceManager.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestReplicationSourceManager.java
2021-07-27 08:54:28 -07:00
YutSean dbeabbac97
HBASE-26094 L2 BC should not be the victimhandler of L1 BC when using combined BC (#3498)
Signed-off-by: Reid Chan <reidchan@apache.org>
2021-07-23 10:38:11 +08:00
Bharath Vissapragada acebb2edff
HBASE-26109: Update version to 1.7.2-SNAPSHOT (#3513)
Merge 1.7.1 CHANGES.txt

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-07-22 08:59:45 -07:00
Aman Poonia b2d329b5d8
HBASE-25986 set default value of normalization enabled from hbase site (#3492) (#3372)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-07-19 15:30:56 +05:30
Xiaolin Ha ed1a75905c
HBASE-25923 Region state stuck in PENDING_OPEN (#3312)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-07-19 14:15:39 +08:00
YutSean edd6ea9311
HBASE-26083 L1 miss metric is always 0 when using CombinedBlockCache (#3474)
Signed-off-by Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by Reid Chan <reidchan@apache.org>
2021-07-16 12:55:47 +08:00
Rushabh Shah 3b3ec323e4
HBASE-26075: Replication is stuck due to zero length wal file in oldWALs dir (#3467)
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-07-09 15:24:20 -07:00
Bharath Vissapragada b7fbfdd078
HBASE-26074: Fix testLogLevelByHttps/testLogLevelByHttpsWithSpnego (#3466)
Signed-off-by: Reid Chan <reidchan@apache.org>
2021-07-08 22:46:50 -07:00
Bharath Vissapragada 5ece9cefea
HBASE-26070: Rewrite 1.7.0 faulty table descriptors at bootstrap (#3463)
This patch rewrites incorrectly serialized table descriptors and states
from HBASE-26021 into PBs prior to the incompatible change. The patch
does this as a part of the active HMaster bootstrap.

This approach is _not_ fool proof as it does not handle all the edge cases
and may break certain rolling upgrade semantics. However it does provide a way
out for tables created with 1.7.0 PB definitions and an upgrade path for 1.7.1.
Easiest way is to shutdown the 1.7.0 cluster, reboot with 1.7.1 binaries and
everything should work cleanly. However, rolling upgrade could potentially be
broken as 1.7.0 client may not be compatible with 1.7.1 server.

As noted in the jira, it is not possible that any one upgraded to 1.7.0 yet
because they will run into HBASE-26021, however new clusters may have been
created with 1.7.0 and hence they need an upgrade path.

Tested locally:

- Created a mix of enabled/disabled tables created with 1.7.0
- Upgraded the cluster without this patch, noticed deserialization errors
- Upgraded the cluster with patch and table metadata has been re-serialized
  in correct format and table states are preserved.

Signed-off-by: Reid Chan <reidchan@apache.org>
2021-07-07 21:19:31 -07:00
YutSean 67b26c2760
HBASE-26033 complement the admin operations in thrift2 after HBASE-21674 (#3428)
Signed-off-by: Reid Chan <reidchan@apache.org>
2021-07-05 12:12:59 +08:00
Viraj Jasani cad219d844
HBASE-22923 Consider minVersionToMoveSysTables while moving region and creating regionPlan (ADDENDUM) (#3456) (#3455)
Signed-off-by: David Manning <david.manning@salesforce.com>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-07-03 22:47:19 +05:30
Viraj Jasani 7d0a72be14
HBASE-22923 min version of RegionServer to move system table regions (#3438)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-07-01 16:21:16 +05:30
Bharath Vissapragada 28f36f4619
HBASE-26021: Undo the incompatible serialization change in HBASE-7767 (#3435)
Revert "HBASE-7767 Get rid of ZKTable, and table enable/disable state in ZK (Andrey Stepachev)"

Fixes the ConnectionRegistry and dependencies due to the revert.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-06-29 19:32:13 -07:00
Victor 395eb0c8e0
HBASE-25130 - Fix master in-memory server holding map after: (#3402)
HBASE-25130 [branch-1] Masters in-memory serverHoldings map is not cleared during hbck repair

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-06-28 10:00:46 -07:00
YutSean b2f8ec993e
HBASE-26025 Add a flag to mark if the IOError can be solved by retry in thrift IOError (#3429)
Signed-off-by: Reid Chan <reidchan@apache.org>
2021-06-28 10:25:42 +08:00
YutSean fd2f8a581f
HBASE-26013 Get operations readRows metrics becomes zero after HBASE-25677 (#3410)
Signed-off-by: Reid Chan <reidchan@apache.org>
2021-06-22 16:14:55 +08:00
YutSean 7e57fecda8
HBASE-21674:Port HBASE-21652 (Refactor ThriftServer making thrift2 server inherited from thrift1 server) to branch-1 (#2941)
Signed-off-by: Reid Chan <reidchan@apache.org>
2021-06-22 11:26:12 +08:00
YutSean 5263b8cf40
HBASE-26004: port HBASE-26001 (cell level tags invisible in atomic operations when access control is on)to branch-1 (#3387)
Signed-off-by: Reid Chan <reidchan@apache.org>
2021-06-21 15:34:24 +08:00
Bharath Vissapragada 2e24bad826
HBASE-25984: Avoid premature reuse of sync futures in FSHLog (#3371) (#3398)
Signed-off-by: Viraj Jasani vjasani@apache.org
(cherry picked from commit 5a19bcf)
2021-06-18 17:42:15 -07:00
Reid Chan a40f4583e3 Set version on branch-1 to 1.7.1-SNAPSHOT 2021-06-12 15:31:29 +08:00
Victor 0fd6eeb012
HBASE-25910 - Fix port assignment test (#3308)
Signed-off-by: David Manning <david.manning@salesforce.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-06-02 14:38:57 +05:30
Rushabh Shah 782e24bd9b
HBASE-25924 Re-compute size of WAL file while removing from WALEntryStream (#3316)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-05-26 10:42:52 -07:00
Reid Chan 4bcec1776b Update CHANGES.txt 2021-05-26 23:04:42 +08:00
Anoop Sam John 3f8aa4c7e8
HBASE-25898 RS getting aborted due to NPE in Replication WALEntryStream (#3300)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Rushabh Shah <shahrs87@gmail.com>
Signed-off-by: Aman Poonia <aman.poonia.29@gmail.com>
2021-05-26 14:31:17 +05:30
Rushabh Shah 130d6a1f15
HBASE-25887 Wait for appendExecutor to shutdown running tasks (#3264)
Co-authored-by: Rushabh <rushabh.shah@salesforce.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-05-26 11:03:23 +08:00
Reid Chan c0ee153c90
HBASE-25890 [Addendum] create profiles for different jdk version (#3295) 2021-05-25 23:19:32 +08:00
Sandeep Pal 3cff107a5f
HBASE-25848: Add flexibility to backup replication in case replication filter throws an exception (#3291) 2021-05-21 17:22:13 -07:00
Reid Chan ddac801260
HBASE-25890 [branch-1] add -U for maven build to force a check for updated releases and snapshots on remote repositories (#3265) 2021-05-14 17:48:15 +08:00
Reid Chan 84044700cc
HBASE-25879 [branch-1] Update CHANGES.txt and tag 1.7.0RC0 to the most recent commit (#3254)
Signed-off-by: stack <stack@apache.org>
2021-05-13 23:03:30 +08:00
Reid Chan f312cfecdf
HBASE-25858 [branch-1] make hbase-thrift optional in hbase-assembly module (#3237) 2021-05-11 14:37:31 +08:00
Rushabh Shah 1f04fac6d1
HBASE-25860 Add metric for successful wal roll requests. (#3241)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-05-08 13:12:07 +05:30
Andrew Purtell 39fdeae838 HBASE-25774 ServerManager.getOnlineServer may miss some region servers when refreshing state in some procedure implementations
Revert "HBASE-25032 Wait for region server to become online before adding it to online servers in Master (#2770)"

This reverts commit 7652bef985.
2021-05-07 17:56:22 -07:00
Rushabh Shah e2b5c20dc9
HBASE-25612 [branch-1] HMaster should abort if ReplicationLogCleaner is not able to delete oldWALs. (#3222)
Signed-off-by Reid Chan <reidchan@apache.org>
2021-05-06 23:29:19 +08:00
Reid Chan c364443e5c
HBASE-25831 [branch-1] remove thrift examples out of hbase-examples module for bypassing the thrift version check (#3212) 2021-05-06 11:39:33 +08:00
Sandeep Pal a0dd384691
HBASE-25741: Deadlock during peer cleanup with NoNodeException (#3204)
Introduced due to commit from  HBASE-25583. Fix is to issue the cleanup asynchronously.

Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-05-05 17:21:25 -07:00
caroliney14 852b1b0826
HBASE-25846 Backport 'HBASE-25825 RSGroupBasedLoadBalancer.onConfigurationChange should chain the request to internal balancer' to branch-1 (#3231)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
2021-05-05 15:15:49 +08:00
Reid Chan 633d966bfe
HBASE-25845 [branch-1] Precommit fails to build docker due to python-dateutil (#3227) 2021-05-04 14:54:03 +08:00
Reid Chan 0fe1c9cca5
HBASE-25804 [branch-1] Make hbase-thrift module build with jdk8 (#3193)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-04-29 22:45:49 +08:00
Andrew Purtell 3c87447810
HBASE-25808 [branch-1] Backport improvements to FSHLog from branch-2 (#3197)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
2021-04-24 10:29:29 +08:00
Andrew Purtell 38b21f44ea
HBASE-25809 [branch-1] TestAtomicOperation.testMultiRowMutationMultiThreads deadlock (#3198)
Signed-off-by: Reid Chan <reidchan@apache.org>
2021-04-24 09:57:02 +08:00
Andrew Purtell c1aff55388
HBASE-25805 Upgrade com.lmax.disruptor to 3.4.2 (#3194)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Aman Poonia <aman.poonia.29@gmail.com>
2021-04-23 15:42:15 -07:00
Reid Chan 16304aa260 Update POMs and CHANGES.txt for 1.7.0RC0 2021-04-13 00:13:15 +08:00