hbase/CHANGES.md

HBASE Changelog

Release 2.4.14 - Unreleased (as of 2022-08-22)

NEW FEATURES:

JIRA	Summary	Priority	Component
HBASE-27129	Add a config that allows us to configure region-level storage policies	Major	regionserver

IMPROVEMENTS:

JIRA	Summary	Priority	Component
HBASE-27089	Add “commons.crypto.stream.buffer.size” configuration	Minor	io
HBASE-27268	In trace log mode, the client does not print callId/startTime and the server does not print receiveTime	Minor	logging
HBASE-27296	Some Cell's implementation of toString() such as IndividualBytesFieldCell prints out value and tags which is too verbose	Minor	logging
HBASE-27273	Should stop autoRead and skip all the bytes when rpc request too big	Major	IPC/RPC
HBASE-27257	Remove unnecessary usage of CachedBlocksByFile from RS UI	Major	.
HBASE-27225	Add BucketAllocator bucket size statistic logging	Major	.
HBASE-27208	Use spotless to purge the missing summary warnings from error prone	Major	pom
HBASE-27048	Server side scanner time limit should account for time in queue	Major	.
HBASE-27188	Report maxStoreFileCount in jmx	Minor	.
HBASE-27186	Report block cache size metrics separately for L1 and L2	Minor	.
HBASE-26218	Better logging in CanaryTool	Minor	canary
HBASE-27060	Allow sharing connections between AggregationClient instances	Major	.
HBASE-27146	Avoid CellUtil.cloneRow in MetaCellComparator	Major	meta, Offheaping, Performance
HBASE-26945	Quotas causes too much load on meta for large clusters	Minor	.
HBASE-27125	The batch size of cleaning expired mob files should have an upper bound	Minor	mob

BUG FIXES:

JIRA	Summary	Priority	Component
HBASE-27292	Fix build failure against Hadoop 3.3.4 due to added dependency on okhttp	Major	build, hadoop3, pom
HBASE-27244	bin/hbase still use slf4j-log4j while reload4j in place	Major	shell
HBASE-27275	graceful_stop.sh unable to restore the balance state	Blocker	regionserver
HBASE-27282	CME in AuthManager causes region server crash	Major	acl
HBASE-26775	TestProcedureSchedulerConcurrency fails in pre commit	Major	proc-v2, test
HBASE-27269	The implementation of TestReplicationStatus.waitOnMetricsReport is incorrect	Major	Replication, test
HBASE-27271	BufferCallBeforeInitHandler should ignore the flush request	Major	IPC/RPC
HBASE-27251	Rolling back from 2.5.0-SNAPSHOT to 2.4.13 fails due to `File does not exist: /hbase/MasterData/data/master/store/.initialized/.regioninfo`	Critical	master
HBASE-27087	TestQuotaThrottle times out	Major	test
HBASE-27239	Upgrade reload4j due to XXE vulnerability	Major	.
HBASE-27204	BlockingRpcClient will hang for 20 seconds when SASL is enabled after finishing negotiation	Critical	rpc, sasl, security
HBASE-27219	Change JONI encoding in RegexStringComparator	Minor	Filters
HBASE-27205	Fix tests that rely on EnvironmentEdgeManager in branch-2.4	Minor	.
HBASE-27211	Data race in MonitoredTaskImpl could cause split wal failure	Critical	monitoring, wal
HBASE-27053	IOException during caching of uncompressed block to the block cache.	Major	BlockCache
HBASE-27192	The retry number for TestSeparateClientZKCluster is too small	Major	test, Zookeeper
HBASE-27193	TestZooKeeper is flaky	Major	test, Zookeeper
HBASE-27097	SimpleRpcServer is broken	Blocker	rpc
HBASE-27189	NettyServerRpcConnection is not properly closed when the netty channel is closed	Blocker	netty, rpc
HBASE-27169	TestSeparateClientZKCluster is flaky	Major	test
HBASE-27180	Multiple possible buffer leaks	Major	netty, regionserver
HBASE-26708	Netty "leak detected" and OutOfDirectMemoryError due to direct memory buffering with SASL implementation	Blocker	netty, rpc, sasl
HBASE-27171	Fix Annotation Error in HRegionFileSystem	Trivial	.
HBASE-27170	ByteBuffAllocator leak when decompressing blocks near minSizeForReservoirUse	Major	.
HBASE-27160	ClientZKSyncer.deleteDataForClientZkUntilSuccess should break from the loop when deletion is succeeded	Major	Client, Zookeeper
HBASE-26790	getAllRegionLocations can cache locations with null hostname	Major	.

TESTS:

JIRA	Summary	Priority	Component
HBASE-27161	Improve TestMultiRespectsLimits	Minor	test

SUB-TASKS:

JIRA	Summary	Priority	Component
HBASE-27293	Remove jenkins and personality scripts support for 1.x	Major	scripts
HBASE-27220	Apply the spotless format change in HBASE-27208 to our code base	Major	.
HBASE-23330	Expose cluster ID for clients using it for delegation token based auth	Major	Client, master

OTHER:

JIRA	Summary	Priority	Component
HBASE-27294	Add new hadoop releases in our hadoop checks	Major	scripts
HBASE-27221	Bump spotless version to 2.24.1	Major	build, pom
HBASE-27281	Add default implementation for Connection$getClusterId	Critical	Client
HBASE-27175	Failure to cleanup WAL split dir log should be at INFO level	Minor	.

Release 2.4.13 - Unreleased (as of 2022-06-23)

NEW FEATURES:

JIRA	Summary	Priority	Component
HBASE-27018	Add a tool command list_liveservers	Major	.
HBASE-26617	Use spotless to reduce the pain on fixing checkstyle issues	Major	build, community

IMPROVEMENTS:

JIRA	Summary	Priority	Component
HBASE-26923	PerformanceEvaluation support encryption option	Minor	PE
HBASE-27095	HbckChore should produce a report	Major	hbck2, master
HBASE-27046	The filenum in AbstractFSWAL should be monotone increasing	Major	.
HBASE-27093	AsyncNonMetaRegionLocator：put Complete CompletableFuture outside lock block	Major	asyncclient, Client
HBASE-27080	Optimize debug output log of ConstantSizeRegionSplitPolicy class.	Minor	logging
HBASE-26649	Support meta replica LoadBalance mode for RegionLocator#getAllRegionLocations()	Major	meta replicas
HBASE-25465	Use javac --release option for supporting cross version compilation	Minor	create-release
HBASE-27003	Optimize log format for PerformanceEvaluation	Minor	.
HBASE-26990	Add default implementation for BufferedMutator interface setters	Minor	.

BUG FIXES:

JIRA	Summary	Priority	Component
HBASE-27151	TestMultiRespectsLimits.testBlockMultiLimits repeatable failure	Major	.
HBASE-27143	Add hbase-unsafe as a dependency for a MR job triggered by hbase shell	Major	integration tests, mapreduce
HBASE-27099	In the HFileBlock class, the log printing fspread/fsread cost time unit should be milliseconds	Minor	HFile
HBASE-27128	when open archiveRetries totalLogSize calculation mistake	Minor	wal
HBASE-27117	Update the method comments for RegionServerAccounting	Minor	.
HBASE-27038	CellComparator should extend Serializable	Minor	.
HBASE-26985	SecureBulkLoadManager will set wrong permission if umask too strict	Major	regionserver
HBASE-27079	Lower some DEBUG level logs in ReplicationSourceWALReader to TRACE	Minor	.
HBASE-27030	Fix undefined local variable error in draining_servers.rb	Major	jruby, shell
HBASE-27047	Fix typo for metric drainingRegionServers	Minor	metrics
HBASE-27027	Deprecated jetty SslContextFactory cause HMaster startup failure due to multiple certificates in KeyStores	Major	security
HBASE-27032	The draining region servers metric description is incorrect	Minor	.
HBASE-26994	MasterFileSystem create directory without permission check	Major	master
HBASE-26963	ReplicationSource#removePeer hangs if we try to remove bad peer.	Major	regionserver, Replication
HBASE-27000	Block cache stats (Misses Caching) display error in RS web UI	Major	.

TESTS:

JIRA	Summary	Priority	Component
HBASE-27051	TestReplicationSource.testReplicationSourceInitializingMetric is flaky	Minor	test
HBASE-27039	Some methods of MasterRegion should be annotated for testing only	Minor	master
HBASE-27054	TestStochasticLoadBalancerRegionReplicaLargeCluster.testRegionReplicasOnLargeCluster is flaky	Major	test
HBASE-27050	Support unit test pattern matching again	Minor	test

SUB-TASKS:

JIRA	Summary	Priority	Component
HBASE-26933	Remove all ref guide stuff on branch other than master	Major	documentation
HBASE-27006	cordon off large ci worker nodes	Major	.
HBASE-26855	Delete unnecessary dependency on jaxb-runtime jar	Major	.
HBASE-27024	The User API and Developer API links are broken on hbase.apache.org	Major	website
HBASE-27045	Disable TestClusterScopeQuotaThrottle	Major	test
HBASE-26995	Remove ref guide check in pre commit and nightly for branches other than master	Major	build, scripts
HBASE-26899	Run spotless:apply	Major	.

OTHER:

JIRA	Summary	Priority	Component
HBASE-27141	Upgrade hbase-thirdparty dependency to 4.1.1	Critical	dependencies, security, thirdparty
HBASE-27108	Revert HBASE-25709	Blocker	.
HBASE-27102	Vacate the .idea folder in order to simplify spotless configuration	Major	build
HBASE-27023	Add protobuf to NOTICE file	Major	.
HBASE-26912	Bump checkstyle from 8.28 to 8.29	Minor	test
HBASE-26523	Upgrade hbase-thirdparty dependency to 4.0.1	Blocker	thirdparty
HBASE-27033	Backport "HBASE-27013 Introduce read all bytes when using pread for prefetch" to branch-2.4	Major	.
HBASE-26892	Add spotless:check in our pre commit general check	Major	jenkins

Release 2.4.12 - Unreleased (as of 2022-04-30)

IMPROVEMENTS:

JIRA	Summary	Priority	Component
HBASE-26961	cache region locations when getAllRegionLocations() for branch-2.4+	Minor	Client
HBASE-26860	Backport "HBASE-25681 Add a switch for server/table queryMeter" to branch-2.4	Major	.
HBASE-26980	Update javadoc of BucketCache.java	Trivial	documentation
HBASE-26581	Add metrics around failed replication edits	Minor	metrics, Replication
HBASE-26971	SnapshotInfo --snapshot param is marked as required even when trying to list all snapshots	Minor	.
HBASE-26618	Involving primary meta region in meta scan with CatalogReplicaLoadBalanceSimpleSelector	Minor	meta replicas
HBASE-26885	The TRSP should not go on when it get a bogus server name from AM	Major	proc-v2
HBASE-26872	Load rate calculator for cost functions should be more precise	Major	Balancer
HBASE-26832	Avoid repeated releasing of flushed wal entries in AsyncFSWAL#syncCompleted	Major	wal
HBASE-26878	TableInputFormatBase should cache RegionSizeCalculator	Minor	.
HBASE-26175	MetricsHBaseServer should record all kinds of Exceptions	Minor	metrics
HBASE-26858	Refactor TestMasterRegionOnTwoFileSystems to avoid dead loop	Major	test
HBASE-26848	Set java.io.tmpdir on mvn command when running jenkins job	Major	jenkins, test
HBASE-26680	Close and do not write trailer for the broken WAL writer	Major	wal
HBASE-26720	ExportSnapshot should validate the source snapshot before copying files	Major	snapshots
HBASE-26275	update error message when executing deleteall with ROWPREFIXFILTER in meta table	Minor	shell

BUG FIXES:

JIRA	Summary	Priority	Component
HBASE-26917	Do not add --threads when running 'mvn site'	Major	build, scripts
HBASE-26941	LocalHBaseCluster.waitOnRegionServer should not call join while interrupted	Critical	test
HBASE-26944	Possible resource leak while creating new region scanner	Major	.
HBASE-26895	on hbase shell, 'delete/deleteall' for a columnfamily is not working	Major	shell
HBASE-26901	delete with null columnQualifier occurs NullPointerException when NewVersionBehavior is on	Major	Deletes, Scanners
HBASE-26880	Misspelling commands in hbase shell will crash the shell	Minor	shell
HBASE-26924	[Documentation] Fix log parameter error and spelling error	Trivial	logging
HBASE-26811	Secondary replica may be disabled for read incorrectly forever	Major	read replicas
HBASE-26812	ShortCircuitingClusterConnection fails to close RegionScanners when making short-circuited calls	Critical	.
HBASE-26838	Junit jar is not included in the hbase tar ball, causing issues for some hbase tools that do rely on it	Major	integration tests, tooling
HBASE-26871	shaded mapreduce and shaded byo-hadoop client artifacts contains no classes	Blocker	integration tests, jenkins, mapreduce
HBASE-26896	list_quota_snapshots fails with ‘ERROR NameError: uninitialized constant Shell::Commands::ListQuotaSnapshots::TABLE’	Major	shell
HBASE-26718	HFileArchiver can remove referenced StoreFiles from the archive	Major	Compaction, HFile, snapshots
HBASE-26864	SplitTableRegionProcedure calls openParentRegions() at a wrong state during rollback.	Major	Region Assignment
HBASE-26876	Use toStringBinary for rowkey in RegionServerCallable error string	Minor	.
HBASE-26875	RpcRetryingCallerImpl translateException ignores return value of recursive call	Minor	.
HBASE-26869	RSRpcServices.scan should deep clone cells when RpcCallContext is null	Major	regionserver

SUB-TASKS:

JIRA	Summary	Priority	Component
HBASE-26932	Skip generating ref guide when running 'mvn site' on branch other than master	Major	build, pom
HBASE-26928	Fix several indentation problems	Major	.
HBASE-26922	Fix LineLength warnings as much as possible if it can not be fixed by spotless	Major	.
HBASE-26929	Upgrade surefire plugin to 3.0.0-M6	Major	pom, test
HBASE-26916	Fix missing braces warnings in DefaultVisibilityExpressionResolver	Major	.
HBASE-26919	Rewrite the counting rows part in TestFromClientSide4	Major	test
HBASE-26920	Fix missing braces warnings in TestProcedureMember	Major	test
HBASE-26921	Rewrite the counting cells part in TestMultiVersions	Major	test

OTHER:

JIRA	Summary	Priority	Component
HBASE-26882	Backport "HBASE-26810 Add dynamic configuration support for system coprocessors" to branch-2	Major	Coprocessors, master, regionserver
HBASE-26903	Bump httpclient from 4.5.3 to 4.5.13	Minor	.
HBASE-26902	Bump bcprov-jdk15on from 1.60 to 1.67	Minor	.
HBASE-26834	Adapt ConnectionRule for both sync and async connections	Major	test
HBASE-26861	Fix flaky TestSnapshotFromMaster.testSnapshotHFileArchiving	Major	snapshots, test

Release 2.4.11 - 2022-03-21

IMPROVEMENTS:

JIRA	Summary	Priority	Component
HBASE-26828	Increase the concurrency when running UTs in pre commit job	Major	jenkins, test
HBASE-26833	Avoid waiting to clear buffer usage of ReplicationSourceShipper when aborting the RS	Major	regionserver, Replication
HBASE-26835	Rewrite TestLruAdaptiveBlockCache to make it more stable	Major	test
HBASE-26830	Rewrite TestLruBlockCache to make it more stable	Major	test
HBASE-26552	Introduce retry to logroller to avoid abort	Major	wal
HBASE-26792	Implement ScanInfo#toString	Minor	regionserver
HBASE-26789	Automatically add default security headers to http/rest if SSL enabled	Major	REST, UI
HBASE-23303	Add security headers to REST server/info page	Major	REST

BUG FIXES:

JIRA	Summary	Priority	Component
HBASE-26840	Fix NPE in the retry of logroller	Minor	wal
HBASE-26670	HFileLinkCleaner should be added even if snapshot is disabled	Critical	snapshots
HBASE-26761	TestMobStoreScanner (testGetMassive) can OOME	Minor	mob, test
HBASE-26816	Fix CME in ReplicationSourceManager	Minor	Replication
HBASE-26715	Blocked on SyncFuture in AsyncProtobufLogWriter#write	Major	.
HBASE-26815	TestFanOutOneBlockAsyncDFSOutput is flakey	Major	test
HBASE-26783	ScannerCallable doubly clears meta cache on retries	Major	.
HBASE-25709	Close region may stuck when region is compacting and skipped most cells read	Major	Compaction
HBASE-26777	BufferedDataBlockEncoder$OffheapDecodedExtendedCell.deepClone throws UnsupportedOperationException	Major	regionserver
HBASE-26745	MetricsStochasticBalancerSource metrics don't render in /jmx endpoint	Minor	.
HBASE-26776	RpcServer failure to SASL handshake always logs user "unknown" to audit log	Major	security
HBASE-26772	Shell suspended in background	Minor	shell

SUB-TASKS:

JIRA	Summary	Priority	Component
HBASE-26603	Cherry pick HBASE-26537 to branch-2.4	Major	.
HBASE-26824	TestHBaseTestingUtil.testResolvePortConflict failing after HBASE-26582	Major	.
HBASE-26582	Prune use of Random and SecureRandom objects	Minor	.

OTHER:

JIRA	Summary	Priority	Component
HBASE-26839	Fix compatibility issues in 2.4.11RC0	Minor	.
HBASE-26817	Mark RpcExecutor as IA.LimitedPrivate COPROC and PHOENIX	Major	compatibility
HBASE-26760	LICENSE handling should not allow non-aggregated "apache-2.0"	Minor	community
HBASE-26691	Replacing log4j with reload4j for branch-2.x	Critical	logging
HBASE-26788	Disable Checks API callback from test results in PRs	Major	build
HBASE-26622	Update to error-prone 2.10	Major	.

Release 2.4.10 - 2022-03-04

NEW FEATURES:

JIRA	Summary	Priority	Component
HBASE-26576	Allow Pluggable Queue to belong to FastPath or normal Balanced Executor	Minor	regionserver, rpc

IMPROVEMENTS:

JIRA	Summary	Priority	Component
HBASE-26702	Make ageOfLastShip, ageOfLastApplied extend TimeHistogram instead of plain histogram.	Minor	metrics, Replication
HBASE-26657	ProfileServlet should move the output location to hbase specific directory	Minor	.
HBASE-26590	Hbase-client Meta lookup performance regression between hbase-1 and hbase-2	Major	meta
HBASE-26629	Add expiration for long time vacant scanners in Thrift2	Major	Performance, Thrift
HBASE-26609	Round the size to MB or KB at the end of calculation in HRegionServer.createRegionLoad	Major	regionserver
HBASE-26598	Fix excessive connections in MajorCompactor	Major	Compaction, tooling
HBASE-26579	Set storage policy of recovered edits when wal storage type is configured	Major	Recovery

BUG FIXES:

JIRA	Summary	Priority	Component
HBASE-26767	Rest server should not use a large Header Cache.	Major	REST
HBASE-26546	hbase-shaded-client missing required thirdparty classes under hadoop 3.3.1	Major	Client, hadoop3, shading
HBASE-26712	Balancer encounters NPE in rare case	Major	.
HBASE-26742	Comparator of NOT_EQUAL NULL is invalid for checkAndMutate	Major	.
HBASE-26688	Threads shared EMPTY_RESULT may lead to unexpected client job down.	Major	Client
HBASE-26741	Incorrect exception handling in shell	Critical	shell
HBASE-26729	Backport "HBASE-26714 Introduce path configuration for system coprocessors" to branch-2	Major	Coprocessors
HBASE-26713	Increments submitted by 1.x clients will be stored with timestamp 0 on 2.x+ clusters	Major	.
HBASE-26679	Wait on the future returned by FanOutOneBlockAsyncDFSOutput.flush would stuck	Critical	wal
HBASE-26662	User.createUserForTesting should not reset UserProvider.groups every time if hbase.group.service.for.test.only is true	Major	.
HBASE-26671	Misspellings of hbck usage	Minor	hbck
HBASE-26469	correct HBase shell exit behavior to match code passed to exit	Critical	shell
HBASE-26643	LoadBalancer should not return empty map	Critical	proc-v2, Region Assignment, test
HBASE-26646	WALPlayer should obtain token from filesystem	Minor	.
HBASE-26625	ExportSnapshot tool failed to copy data files for tables with merge region	Minor	.
HBASE-26615	Snapshot referenced data files are deleted when delete a table with merge regions	Major	.
HBASE-26613	The logic of the method incrementIV in Encryption class has problem	Major	Performance, security
HBASE-26488	Memory leak when MemStore retry flushing	Major	regionserver
HBASE-26340	TableSplit returns false size under 1MB	Major	mapreduce, regionserver

TESTS:

JIRA	Summary	Priority	Component
HBASE-26689	Backport HBASE-24443 Refactor TestCustomSaslAuthenticationProvider	Minor	test

SUB-TASKS:

JIRA	Summary	Priority	Component
HBASE-26434	Compact L0 files for cold regions using StripeCompactionPolicy	Major	.
HBASE-26749	Migrate HBase main pre commit job to ci-hbase	Major	.
HBASE-26697	Migrate HBase Nightly HBase-Flaky-Tests and HBase-Find-Flaky-Tests to ci-hbase	Major	jenkins
HBASE-26747	Use python2 instead of python in our python scripts	Major	jenkins

OTHER:

JIRA	Summary	Priority	Component
HBASE-26616	Refactor code related to ZooKeeper authentication	Major	Zookeeper
HBASE-26631	Upgrade junit to 4.13.2	Major	security, test
HBASE-26580	The message of StoreTooBusy is confused	Trivial	logging, regionserver

Release 2.4.9 - 2021-12-23

IMPROVEMENTS:

JIRA	Summary	Priority	Component
HBASE-26601	maven-gpg-plugin failing with "Inappropriate ioctl for device"	Major	build
HBASE-26556	IT and Chaos Monkey improvements	Minor	integration tests
HBASE-26525	Use unique thread name for group WALs	Major	wal
HBASE-26517	Add auth method information to AccessChecker audit log	Trivial	security
HBASE-26512	Make timestamp format configurable in HBase shell scan output	Major	shell
HBASE-26485	Introduce a method to clean restore directory after Snapshot Scan	Minor	snapshots
HBASE-26475	The flush and compact methods in HTU should skip processing secondary replicas	Major	test
HBASE-26267	Master initialization fails if Master Region WAL dir is missing	Major	master
HBASE-26337	Optimization for weighted random generators	Major	Balancer
HBASE-26309	Balancer tends to move regions to the server at the end of list	Major	Balancer

BUG FIXES:

JIRA	Summary	Priority	Component
HBASE-26541	hbase-protocol-shaded not buildable on M1 MacOSX	Major	.
HBASE-26527	ArrayIndexOutOfBoundsException in KeyValueUtil.copyToNewKeyValue()	Major	wal
HBASE-26462	Should persist restoreAcl flag in the procedure state for CloneSnapshotProcedure and RestoreSnapshotProcedure	Critical	proc-v2, snapshots
HBASE-26533	KeyValueScanner might not be properly closed when using InternalScan.checkOnlyMemStore()	Minor	.
HBASE-26482	HMaster may clean wals that is replicating in rare cases	Critical	Replication
HBASE-26468	Region Server doesn't exit cleanly incase it crashes.	Major	regionserver
HBASE-25905	Shutdown of WAL stuck at waitForSafePoint	Blocker	regionserver, wal
HBASE-26450	Server configuration will overwrite HStore configuration after using shell command 'update_config'	Minor	Compaction, conf, regionserver
HBASE-26476	Make DefaultMemStore extensible for HStore.memstore	Major	regionserver
HBASE-26465	MemStoreLAB may be released early when its SegmentScanner is scanning	Critical	regionserver
HBASE-26467	Wrong Cell Generated by MemStoreLABImpl.forceCopyOfBigCellInto when Cell size bigger than data chunk size	Critical	in-memory-compaction
HBASE-26463	Unreadable table names after HBASE-24605	Trivial	UI
HBASE-26438	Fix flaky test TestHStore.testCompactingMemStoreCellExceedInmemoryFlushSize	Major	test
HBASE-26311	Balancer gets stuck in cohosted replica distribution	Major	Balancer
HBASE-26384	Segment already flushed to hfile may still be remained in CompactingMemStore	Major	in-memory-compaction
HBASE-26410	Fix HBase TestCanaryTool for Java17	Major	java
HBASE-26429	HeapMemoryManager fails memstore flushes with NPE if enabled	Major	Operability, regionserver
HBASE-25322	Redundant Reference file in bottom region of split	Minor	.
HBASE-26406	Can not add peer replicating to non-HBase	Major	Replication
HBASE-26404	Update javadoc for CellUtil#createCell with tags methods.	Major	.
HBASE-26398	CellCounter fails for large tables filling up local disk	Minor	mapreduce

TESTS:

JIRA	Summary	Priority	Component
HBASE-26542	Apply a `package` to test protobuf files	Minor	Protobufs, test

SUB-TASKS:

JIRA	Summary	Priority	Component
HBASE-24870	Ignore TestAsyncTableRSCrashPublish	Major	.
HBASE-26470	Use openlabtesting protoc on linux arm64 in HBASE 2.x	Major	build
HBASE-26327	Replicas cohosted on a rack shouldn't keep triggering Balancer	Major	Balancer
HBASE-26308	Sum of multiplier of cost functions is not populated properly when we have a shortcut for trigger	Critical	Balancer
HBASE-26319	Make flaky find job track more builds	Major	flakies, jenkins

OTHER:

JIRA	Summary	Priority	Component
HBASE-26549	hbaseprotoc plugin should initialize maven	Major	jenkins
HBASE-26444	BucketCacheWriter should log only the BucketAllocatorException message, not the full stack trace	Major	logging, Operability
HBASE-26443	Some BaseLoadBalancer log lines should be at DEBUG level	Major	logging, Operability

Release 2.4.8 - 2021-11-05

NEW FEATURES:

JIRA	Summary	Priority	Component
HBASE-26284	Add HBase Thrift API to get all table names along with whether it is enabled or not	Major	Thrift

IMPROVEMENTS:

JIRA	Summary	Priority	Component
HBASE-25773	TestSnapshotScannerHDFSAclController.setupBeforeClass is flaky	Major	.

BUG FIXES:

JIRA	Summary	Priority	Component
HBASE-26190	High rate logging of BucketAllocatorException: Allocation too big	Major	BucketCache, Operability
HBASE-26392	Update ClassSize.BYTE_BUFFER for JDK17	Major	java, util
HBASE-26394	Cache in RSRpcServices.executeProcedures does not take effect	Major	.
HBASE-26385	Clear CellScanner when replay	Major	regionserver, rpc
HBASE-26383	HBCK incorrectly reports inconsistencies for recently split regions following a master failover	Critical	master
HBASE-26371	Prioritize meta region move over other region moves in region_mover	Major	.
HBASE-26364	TestThriftServer is failing 100% in our flaky test job	Major	test, Thrift
HBASE-26350	Missing server side debugging on failed SASL handshake	Minor	.
HBASE-26344	Fix Bug for MultiByteBuff.put(int, byte)	Major	.
HBASE-26312	Shell scan fails with timestamp	Major	shell, test

SUB-TASKS:

JIRA	Summary	Priority	Component
HBASE-26390	Upload src tarball to nightlies for nightly jobs	Major	jenkins, scripts
HBASE-26382	Use gen_redirect_html for linking flaky test logs	Major	jenkins, scripts, test
HBASE-26362	Upload mvn site artifacts for nightly build to nightlies	Major	jenkins, scripts
HBASE-26360	Use gen_redirect_html for linking test logs	Major	jenkins, scripts
HBASE-26341	Upload dashboard html for flaky find job to nightlies	Major	flakies, jenkins, scripts
HBASE-26339	SshPublisher will skip uploading artifacts if the build is failure	Major	jenkins, scripts

OTHER:

JIRA	Summary	Priority	Component
HBASE-26329	Upgrade commons-io to 2.11.0	Major	dependencies
HBASE-26186	jenkins script for caching artifacts should verify cached file before relying on it	Major	build, integration tests

Release 2.4.7 - 2021-10-15

IMPROVEMENTS:

JIRA	Summary	Priority	Component
HBASE-26270	Provide getConfiguration method for Region and Store interface	Minor	.
HBASE-26273	TableSnapshotInputFormat/TableSnapshotInputFormatImpl should use ReadType.STREAM for scanning HFiles	Major	mapreduce
HBASE-26276	Allow HashTable/SyncTable to perform rawScan when comparing cells	Major	.
HBASE-26255	Add an option to use region location from meta table in TableSnapshotInputFormat	Major	mapreduce
HBASE-26243	Fix typo for file 'hbase-server/src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.java'	Trivial	.

BUG FIXES:

JIRA	Summary	Priority	Component
HBASE-26295	BucketCache could not free BucketEntry which restored from persistence file	Major	BucketCache
HBASE-26289	Hbase scan setMaxResultsPerColumnFamily not giving right results	Major	regionserver
HBASE-26238	OOME in VerifyReplication for the table contains rows with 10M+ cells	Major	Client, Replication
HBASE-26297	Balancer run is improperly triggered by accuracy error of double comparison	Major	Balancer
HBASE-26274	Create an option to reintroduce BlockCache to mapreduce job	Major	BlockCache, HFile, mapreduce
HBASE-26261	Store configuration loss when use update_config	Minor	.
HBASE-26281	DBB got from BucketCache would be freed unexpectedly before RPC completed	Critical	BucketCache
HBASE-26197	Fix some obvious bugs in MultiByteBuff.put	Major	.

TESTS:

JIRA	Summary	Priority	Component
HBASE-26272	TestTableMapReduceUtil failure in branch-2	Major	test

SUB-TASKS:

JIRA	Summary	Priority	Component
HBASE-26317	Publish the test logs for pre commit jenkins job to nightlies	Major	jenkins, scripts
HBASE-26313	Publish the test logs for our nightly jobs to nightlies.apache.org	Major	jenkins, scripts
HBASE-26318	Publish test logs for flaky jobs to nightlies	Major	flakies, jenkins

Release 2.4.6 - 2021-09-10

NEW FEATURES:

JIRA	Summary	Priority	Component
HBASE-6908	Pluggable Call BlockingQueue for HBaseServer	Major	IPC/RPC

IMPROVEMENTS:

JIRA	Summary	Priority	Component
HBASE-25642	Fix or stop warning about already cached block	Major	BlockCache, Operability, regionserver
HBASE-24652	master-status UI make date type fields sortable	Minor	master, Operability, UI, Usability
HBASE-25680	Non-idempotent test in TestReplicationHFileCleaner	Minor	test
HBASE-26179	TestRequestTooBigException spends too much time to finish	Major	test
HBASE-26160	Configurable disallowlist for live editing of loglevels	Minor	.
HBASE-25469	Add detailed RIT info in JSON format for consumption as metrics	Minor	master
HBASE-26154	Provide exception metric for quota exceeded and throttling	Minor	.
HBASE-26105	Rectify the expired TODO comment in CombinedBC	Trivial	BlockCache
HBASE-26146	Allow custom opts for hbck in hbase bin	Minor	.

BUG FIXES:

JIRA	Summary	Priority	Component
HBASE-26106	AbstractFSWALProvider#getArchivedLogPath doesn't look for wal file in all oldWALs directory.	Critical	wal
HBASE-26205	TableMRUtil#initCredentialsForCluster should use specified conf for UserProvider	Major	mapreduce
HBASE-26210	HBase Write should be doomed to hang when cell size exceeds InmemoryFlushSize for CompactingMemStore	Critical	in-memory-compaction
HBASE-26244	Avoid trim the error stack trace when running UT with maven	Major	.
HBASE-25588	Excessive logging of "hbase.zookeeper.useMulti is deprecated. Default to true always."	Minor	logging, Operability, Replication
HBASE-26232	SEEK_NEXT_USING_HINT is ignored on reversed Scans	Critical	Filters, scan
HBASE-26204	VerifyReplication should obtain token for peerQuorumAddress too	Major	.
HBASE-26219	Negative time is logged while waiting on regionservers	Trivial	.
HBASE-26087	JVM crash when displaying RPC params by MonitoredRPCHandler	Major	UI
HBASE-24570	connection#close throws NPE	Minor	Client
HBASE-26200	Undo 'HBASE-25165 Change 'State time' in UI so sorts (#2508)' in favor of HBASE-24652	Major	UI
HBASE-26196	Support configuration override for remote cluster of HFileOutputFormat locality sensitive	Major	mapreduce
HBASE-26026	HBase Write may be stuck forever when using CompactingMemStore	Critical	in-memory-compaction
HBASE-26155	JVM crash when scan	Major	Scanners
HBASE-26176	Correct regex in hbase-personality.sh	Minor	build
HBASE-26170	handleTooBigRequest in NettyRpcServer didn't skip enough bytes	Major	.
HBASE-26142	NullPointerException when set 'hbase.hregion.memstore.mslab.indexchunksize.percent' to zero	Critical	.
HBASE-26166	table list in master ui has a minor bug	Minor	UI

TESTS:

JIRA	Summary	Priority	Component
HBASE-26185	Fix TestMaster#testMoveRegionWhenNotInitialized with hbase.min.version.move.system.tables	Minor	.

SUB-TASKS:

JIRA	Summary	Priority	Component
HBASE-26189	Reduce log level of CompactionProgress notice to DEBUG	Minor	Compaction
HBASE-26227	Forward port HBASE-26223 test code to branch-2.4+	Major	test

OTHER:

JIRA	Summary	Priority	Component
HBASE-26152	Exclude javax.servlet:servlet-api in hbase-shaded-testing-util	Major	.

Release 2.4.5 - 2021-07-31

IMPROVEMENTS:

JIRA	Summary	Priority	Component
HBASE-26108	add option to disable scanMetrics in TableSnapshotInputFormat	Major	.
HBASE-26025	Add a flag to mark if the IOError can be solved by retry in thrift IOError	Major	Thrift
HBASE-25986	Expose the NORMALIZARION_ENABLED table descriptor through a property in hbase-site	Minor	Normalizer
HBASE-26012	Improve logging and dequeue logic in DelayQueue	Minor	.
HBASE-26020	Split TestWALEntryStream.testDifferentCounts out	Major	Replication, test
HBASE-25937	Clarify UnknownRegionException	Minor	Client
HBASE-25998	Revisit synchronization in SyncFuture	Major	Performance, regionserver, wal
HBASE-26000	Optimize the display of ZK dump in the master web UI	Minor	.
HBASE-25995	Change the method name for DoubleArrayCost.setCosts	Major	Balancer
HBASE-26002	MultiRowMutationEndpoint should return the result of the conditional update	Major	Coprocessors
HBASE-25993	Make excluded SSL cipher suites configurable for all Web UIs	Major	.
HBASE-25987	Make SSL keystore type configurable for HBase ThriftServer	Major	Thrift

BUG FIXES:

JIRA	Summary	Priority	Component
HBASE-26120	New replication gets stuck or data loss when multiwal groups more than 10	Critical	Replication
HBASE-26001	When turn on access control, the cell level TTL of Increment and Append operations is invalid.	Minor	Coprocessors
HBASE-24984	WAL corruption due to early DBBs re-use when Durability.ASYNC_WAL is used with multi operation	Critical	rpc, wal
HBASE-26088	conn.getBufferedMutator(tableName) leaks thread executors and other problems	Critical	Client
HBASE-25973	Balancer should explain progress in a better way in log	Major	Balancer
HBASE-26083	L1 miss metric is incorrect when using CombinedBlockCache	Minor	BlockCache
HBASE-26086	TestHRegionReplayEvents do not pass in branch-2 and throws NullPointerException	Minor	.
HBASE-26036	DBB released too early and dirty data for some operations	Critical	rpc
HBASE-26068	The last assertion in TestHStore.testRefreshStoreFilesNotChanged is wrong	Major	test
HBASE-22923	hbase:meta is assigned to localhost when we downgrade the hbase version	Major	.
HBASE-26030	hbase-cleanup.sh did not clean the wal dir if hbase.wal.dir configured individually	Major	scripts
HBASE-26035	Redundant null check in the compareTo function	Minor	metrics, Performance
HBASE-25902	Add missing CFs in meta during HBase 1 to 2.3+ Upgrade	Critical	meta, Operability
HBASE-26028	The view as json page shows exception when using TinyLfuBlockCache	Major	UI
HBASE-26039	TestReplicationKillRS is useless after HBASE-23956	Major	Replication, test
HBASE-25980	Master table.jsp pointed at meta throws 500 when no all replicas are online	Major	master, meta replicas, UI
HBASE-26013	Get operations readRows metrics becomes zero after HBASE-25677	Minor	metrics
HBASE-25877	Add access check for compactionSwitch	Major	security
HBASE-25698	Persistent IllegalReferenceCountException at scanner open when using TinyLfuBlockCache	Major	BucketCache, HFile, Scanners
HBASE-25984	FSHLog WAL lockup with sync future reuse [RS deadlock]	Critical	regionserver, wal
HBASE-25997	NettyRpcFrameDecoder decode request header wrong when handleTooBigRequest	Major	rpc
HBASE-25967	The readRequestsCount does not calculate when the outResults is empty	Major	metrics
HBASE-25981	JVM crash when displaying regionserver UI	Major	rpc, UI

SUB-TASKS:

JIRA	Summary	Priority	Component
HBASE-26093	Replication is stuck due to zero length wal file in oldWALs directory [master/branch-2]	Major	.
HBASE-24734	RegionInfo#containsRange should support check meta table	Major	HFile, MTTR
HBASE-25739	TableSkewCostFunction need to use aggregated deviation	Major	Balancer, master
HBASE-25992	Polish the ReplicationSourceWALReader code for 2.x after HBASE-25596	Major	Replication
HBASE-25989	FanOutOneBlockAsyncDFSOutput using shaded protobuf in hdfs 3.3+	Major	.
HBASE-25947	Backport 'HBASE-25894 Improve the performance for region load and region count related cost functions' to branch-2.4 and branch-2.3	Major	Balancer, Performance
HBASE-25969	Cleanup netty-all transitive includes	Major	.

OTHER:

JIRA	Summary	Priority	Component
HBASE-25934	Add username for RegionScannerHolder	Minor	.
HBASE-26123	Restore fields dropped by HBASE-25986 to public interfaces	Major	.
HBASE-25521	Change ChoreService and ScheduledChore to IA.Private	Major	util
HBASE-26015	Should implement getRegionServers(boolean) method in AsyncAdmin	Major	Admin, Client
HBASE-25918	Upgrade hbase-thirdparty dependency to 3.5.1	Critical	dependencies

Release 2.4.4 - 2021-06-14

IMPROVEMENTS:

JIRA	Summary	Priority	Component
HBASE-25666	Explain why balancer is skipping runs	Major	Balancer, master, UI
HBASE-25942	Get rid of null regioninfo in wrapped connection exceptions	Trivial	logging
HBASE-25908	Exclude jakarta.activation-api	Major	hadoop3, shading
HBASE-25933	Log trace raw exception, instead of cause message in NettyRpcServerRequestDecoder	Minor	.
HBASE-25906	UI of master-status to show recent history of balancer desicion	Major	Balancer, master, UI

BUG FIXES:

JIRA	Summary	Priority	Component
HBASE-25930	Thrift does not support requests in Kerberos environment	Major	Thrift
HBASE-25929	RegionServer JVM crash when compaction	Critical	Compaction
HBASE-25924	Seeing a spike in uncleanlyClosedWALs metric.	Major	Replication, wal
HBASE-25932	TestWALEntryStream#testCleanClosedWALs test is failing.	Major	metrics, Replication, wal
HBASE-25903	ReadOnlyZKClient APIs - CompletableFuture.get() calls can cause threads to hang forver when ZK client create throws Non IOException	Major	.
HBASE-25927	Fix the log messages by not stringifying the exceptions in log	Minor	logging
HBASE-25938	The SnapshotOfRegionAssignmentFromMeta.initialize call in FavoredNodeLoadBalancer is just a dummy one	Major	Balancer, FavoredNodes
HBASE-25898	RS getting aborted due to NPE in Replication WALEntryStream	Critical	Replication
HBASE-25875	RegionServer failed to start due to IllegalThreadStateException in AuthenticationTokenSecretManager.start	Major	.
HBASE-25892	'False' should be 'True' in auditlog of listLabels	Major	logging, security
HBASE-25817	Memory leak from thrift server hashMap	Minor	Thrift
HBASE-25848	Add flexibility to backup replication in case replication filter throws an exception	Major	.
HBASE-25827	Per Cell TTL tags get duplicated with increments causing tags length overflow	Critical	regionserver

TESTS:

JIRA	Summary	Priority	Component
HBASE-25910	Fix TestClusterPortAssignment.testClusterPortAssignment test and re-enable it.	Minor	flakies, test

SUB-TASKS:

JIRA	Summary	Priority	Component
HBASE-25963	HBaseCluster should be marked as IA.Public	Major	API
HBASE-25941	TestRESTServerSSL fails because of jdk bug	Major	test
HBASE-25940	Update Compression/TestCompressionTest: LZ4, SNAPPY, LZO	Major	.
HBASE-25791	UI of master-status to show a recent history of that why balancer was rejected to run	Major	Balancer, master, UI

Release 2.4.3 - 2021-05-21

NEW FEATURES:

JIRA	Summary	Priority	Component
HBASE-25751	Add writable TimeToPurgeDeletes to ScanOptions	Major	.
HBASE-25587	[hbck2] Schedule SCP for all unknown servers	Major	hbase-operator-tools, hbck2

IMPROVEMENTS:

JIRA	Summary	Priority	Component
HBASE-25860	Add metric for successful wal roll requests.	Major	metrics, wal
HBASE-25754	StripeCompactionPolicy should support compacting cold regions	Minor	Compaction
HBASE-25766	Introduce RegionSplitRestriction that restricts the pattern of the split point	Major	.
HBASE-25798	typo in MetricsAssertHelper	Minor	.
HBASE-25770	Http InfoServers should honor gzip encoding when requested	Major	UI
HBASE-25776	Use Class.asSubclass to fix the warning in StochasticLoadBalancer.loadCustomCostFunctions	Minor	Balancer
HBASE-25767	CandidateGenerator.getRandomIterationOrder is too slow on large cluster	Major	Balancer, Performance
HBASE-25762	Improvement for some debug-logging guards	Minor	logging, Performance
HBASE-25653	Add units and round off region size to 2 digits after decimal	Major	master, Normalizer
HBASE-25759	The master services field in LocalityBasedCostFunction is never used	Major	Balancer
HBASE-25747	Remove unused getWriteAvailable method in OperationQuota	Minor	Quotas
HBASE-25558	Adding audit log for execMasterService	Major	.
HBASE-25703	Support conditional update in MultiRowMutationEndpoint	Major	Coprocessors
HBASE-25627	HBase replication should have a metric to represent if the source is stuck getting initialized	Major	Replication
HBASE-25688	Use CustomRequestLog instead of Slf4jRequestLog for jetty	Major	logging, UI
HBASE-25678	Support nonce operations for Increment/Append in RowMutations and CheckAndMutate	Major	.
HBASE-25679	Size of log queue metric is incorrect in branch-1/branch-2	Major	.
HBASE-25518	Support separate child regions to different region servers	Major	.
HBASE-25621	Balancer should check region plan source to avoid misplace region groups	Major	Balancer
HBASE-25374	Make REST Client connection and socket time out configurable	Minor	REST
HBASE-25597	Add row info in Exception when cell size exceeds maxCellSize	Minor	.
HBASE-25660	Print split policy in use on Region open (as well as split policy vitals)	Trivial	.
HBASE-25635	CandidateGenerator may miss some region balance actions	Major	Balancer
HBASE-25636	Expose HBCK report as metrics	Minor	metrics
HBASE-25548	Optionally allow snapshots to preserve cluster's max filesize config by setting it into table descriptor	Major	.

BUG FIXES:

JIRA	Summary	Priority	Component
HBASE-25867	Extra doc around ITBLL	Minor	documentation
HBASE-25859	Reference class incorrectly parses the protobuf magic marker	Minor	regionserver
HBASE-25774	ServerManager.getOnlineServer may miss some region servers when refreshing state in some procedure implementations	Critical	Replication
HBASE-25825	RSGroupBasedLoadBalancer.onConfigurationChange should chain the request to internal balancer	Major	Balancer
HBASE-25792	Filter out o.a.hadoop.thirdparty building shaded jars	Major	shading
HBASE-25806	Backport the region location finder initialization fix in HBASE-25802	Major	Balancer
HBASE-25735	Add target Region to connection exceptions	Major	rpc
HBASE-25717	RegionServer aborted due to ClassCastException	Major	.
HBASE-25743	Retry REQUESTTIMEOUT KeeperExceptions from ZK	Major	Zookeeper
HBASE-25726	MoveCostFunction is not included in the list of cost functions for StochasticLoadBalancer	Major	Balancer
HBASE-25692	Failure to instantiate WALCellCodec leaks socket in replication	Major	Replication
HBASE-25568	Upgrade Thrift jar to fix CVE-2020-13949	Critical	Thrift
HBASE-25562	ReplicationSourceWALReader log and handle exception immediately without retrying	Major	Replication
HBASE-25693	NPE getting metrics from standby masters (MetricsMasterWrapperImpl.getMergePlanCount)	Major	master
HBASE-25685	asyncprofiler2.0 no longer supports svg; wants html	Major	.
HBASE-25594	graceful_stop.sh fails to unload regions when ran at localhost	Minor	.
HBASE-25674	RegionInfo.parseFrom(DataInputStream) sometimes fails to read the protobuf magic marker	Minor	Client
HBASE-25595	TestLruBlockCache.testBackgroundEvictionThread is flaky	Major	.
HBASE-25662	Fix spotbugs warning in RoundRobinTableInputFormat	Major	findbugs
HBASE-25657	Fix spotbugs warnings after upgrading spotbugs to 4.x	Major	findbugs
HBASE-25646	Possible Resource Leak in CatalogJanitor	Major	master

TESTS:

JIRA	Summary	Priority	Component
HBASE-25691	Test failure: TestVerifyBucketCacheFile.testRetrieveFromFile	Major	test

SUB-TASKS:

JIRA	Summary	Priority	Component
HBASE-25876	Add retry if we fail to read all bytes of the protobuf magic marker	Trivial	io
HBASE-25790	NamedQueue 'BalancerRejection' for recent history of balancer skipping	Major	Balancer, master
HBASE-25854	Remove redundant AM in-memory state changes in CatalogJanitor	Major	.
HBASE-25847	More DEBUG and TRACE level logging in CatalogJanitor and HbckChore	Minor	.
HBASE-25838	Use double instead of Double in StochasticLoadBalancer	Major	Balancer, Performance
HBASE-25835	Ignore duplicate split requests from regionserver reports	Major	.
HBASE-25836	RegionStates#getAssignmentsForBalancer should only care about OPEN or OPENING regions	Major	.
HBASE-25840	CatalogJanitor warns about skipping gc of regions during RIT, but does not actually skip	Minor	.
HBASE-25775	Use a special balancer to deal with maintenance mode	Major	Balancer
HBASE-25199	Remove HStore#getStoreHomedir	Minor	.
HBASE-25696	Need to initialize SLF4JBridgeHandler in jul-to-slf4j for redirecting jul to slf4j	Major	logging
HBASE-25695	Link to the filter on hbase:meta from user tables panel on master page	Major	UI
HBASE-25629	Reimplement TestCurrentHourProvider to not depend on unstable TZs	Major	test
HBASE-25671	Backport HBASE-25608 to branch-2	Major	.
HBASE-25677	Server+table counters on each scan #nextRaw invocation becomes a bottleneck when heavy load	Major	metrics
HBASE-25667	Remove RSGroup test addition made in parent; depends on functionality not in old branches	Major	.

OTHER:

JIRA	Summary	Priority	Component
HBASE-25884	NPE while getting Balancer decisions	Major	.
HBASE-25755	Exclude tomcat-embed-core from libthrift	Critical	dependencies, Thrift
HBASE-25750	Upgrade RpcControllerFactory and HBaseRpcController from Private to LimitedPrivate(COPROC,PHOENIX)	Major	Coprocessors, phoenix, rpc
HBASE-25734	Backport HBASE-24305 to branch-2.4	Minor	.
HBASE-25604	Upgrade spotbugs to 4.x	Major	build, findbugs
HBASE-24305	Handle deprecations in ServerName	Minor	.

Release 2.4.2 - Unreleased (as of 2021-03-08)

NEW FEATURES:

JIRA	Summary	Priority	Component
HBASE-25460	Expose drainingServers as cluster metric	Major	metrics
HBASE-25496	add get_namespace_rsgroup command	Major	.

IMPROVEMENTS:

JIRA	Summary	Priority	Component
HBASE-23578	[UI] Master UI shows long stack traces when table is broken	Minor	master, UI
HBASE-25492	Create table with rsgroup info in branch-2	Major	rsgroup
HBASE-25539	Add metric for age of oldest wal.	Major	metrics, regionserver
HBASE-25574	Revisit put/delete/increment/append related RegionObserver methods	Major	Coprocessors
HBASE-25541	In WALEntryStream, set the current path to null while dequeing the log	Major	.
HBASE-23887	New L1 cache : AdaptiveLRU	Major	BlockCache, Performance
HBASE-25534	Honor TableDescriptor settings earlier in normalization	Major	Normalizer
HBASE-25507	Leak of ESTABLISHED sockets when compaction encountered "java.io.IOException: Invalid HFile block magic"	Major	Compaction
HBASE-25542	Add client detail to scan name so when lease expires, we have clue on who was scanning	Major	scan
HBASE-25528	Dedicated merge dispatch threadpool on master	Minor	master
HBASE-25536	Remove 0 length wal file from logQueue if it belongs to old sources.	Major	Replication
HBASE-25482	Improve SimpleRegionNormalizer#getAverageRegionSizeMb	Minor	Normalizer

BUG FIXES:

JIRA	Summary	Priority	Component
HBASE-25626	Possible Resource Leak in HeterogeneousRegionCountCostFunction	Major	.
HBASE-25644	Scan#setSmall blindly sets ReadType as PREAD	Critical	.
HBASE-25609	There is a problem with the SPLITS_FILE in the HBase shell statement	Minor	.
HBASE-25385	TestCurrentHourProvider fails if the latest timezone changes are not present	Blocker	.
HBASE-25596	Fix NPE in ReplicationSourceManager as well as avoid permanently unreplicated data due to EOFException from WAL	Critical	.
HBASE-25367	Sort broken after Change 'State time' in UI	Major	UI
HBASE-25421	There is no limit on the column family length when creating a table	Major	Client
HBASE-25371	When openRegion fails during initial verification(before initializing and setting seq num), exception is observed during region close.	Major	Region Assignment
HBASE-25611	ExportSnapshot chmod flag uses value as decimal	Major	.
HBASE-25586	Fix HBASE-22492 on branch-2 (SASL GapToken)	Major	rpc
HBASE-25598	TestFromClientSide5.testScanMetrics is flaky	Major	.
HBASE-25556	Frequent replication "Encountered a malformed edit" warnings	Minor	Operability, Replication
HBASE-25575	Should validate Puts in RowMutations	Minor	Client
HBASE-25559	Terminate threads of oldsources while RS is closing	Major	.
HBASE-25543	When configuration "hadoop.security.authorization" is set to false, the system will still try to authorize an RPC and raise AccessDeniedException	Minor	IPC/RPC
HBASE-25554	NPE when init RegionMover	Major	.
HBASE-25523	Region normalizer chore thread is getting killed	Major	Normalizer
HBASE-25533	The metadata of the table and family should not be an empty string	Major	.
HBASE-25478	Implement retries when enabling tables in TestRegionReplicaReplicationEndpoint	Minor	.
HBASE-25513	When the table is turned on normalize, the first region may not be merged even the size is 0	Major	Normalizer
HBASE-25497	move_namespaces_rsgroup should change hbase.rsgroup.name config in NamespaceDescriptor	Major	.

SUB-TASKS:

JIRA	Summary	Priority	Component
HBASE-24900	Make retain assignment configurable during SCP	Major	amv2
HBASE-25509	ChoreService.cancelChore will not call ScheduledChore.cleanup which may lead to resource leak	Major	util

OTHER:

JIRA	Summary	Priority	Component
HBASE-25553	It is better for ReplicationTracker.getListOfRegionServers to return ServerName instead of String	Major	.
HBASE-25620	Increase timeout value for pre commit	Major	build, test
HBASE-25615	Upgrade java version in pre commit docker file	Major	build
HBASE-25601	Remove search hadoop references in book	Major	documentation

Release 2.4.1 - 2021-01-18

NEW FEATURES:

JIRA	Summary	Priority	Component
HBASE-24620	Add a ClusterManager which submits command to ZooKeeper and its Agent which picks and execute those Commands.	Major	integration tests

IMPROVEMENTS:

JIRA	Summary	Priority	Component
HBASE-25329	Dump region hashes in logs for the regions that are stuck in transition for more than a configured amount of time	Minor	.
HBASE-25475	Improve unit test for HBASE-25445 : SplitWALRemoteProcedure failed to archive split WAL	Minor	wal
HBASE-25249	Adding StoreContext	Major	.
HBASE-25449	'dfs.client.read.shortcircuit' should not be set in hbase-default.xml	Major	conf
HBASE-25476	Enable error prone check in pre commit	Major	build
HBASE-25211	Rack awareness in region_mover	Major	.
HBASE-25483	set the loadMeta log level to debug.	Major	MTTR, Region Assignment
HBASE-25435	Slow metric value can be configured	Minor	metrics
HBASE-25318	Configure where IntegrationTestImportTsv generates HFiles	Minor	integration tests
HBASE-24850	CellComparator perf improvement	Critical	Performance, scan
HBASE-25425	Some notes on RawCell	Trivial	.
HBASE-25420	Some minor improvements in rpc implementation	Minor	rpc
HBASE-25246	Backup/Restore hbase cell tags.	Major	backup&restore
HBASE-25328	Add builder method to create Tags.	Minor	.

BUG FIXES:

JIRA	Summary	Priority	Component
HBASE-25356	HBaseAdmin#getRegion() needs to filter out non-regionName and non-encodedRegionName	Major	shell
HBASE-25279	Non-daemon thread in ZKWatcher	Critical	Zookeeper
HBASE-25504	[branch-2.4] Restore method removed by HBASE-25277 to LP(CONFIG) coprocessors	Major	compatibility, Coprocessors, security
HBASE-25503	HBase code download is failing on windows with invalid path error	Major	.
HBASE-24813	ReplicationSource should clear buffer usage on ReplicationSourceManager upon termination	Major	Replication
HBASE-25459	WAL can't be cleaned in some scenes	Major	.
HBASE-25434	SlowDelete & SlowPut metric value should use updateDelete & updatePut	Major	regionserver
HBASE-25441	add security check for some APIs in RSRpcServices	Critical	.
HBASE-25432	we should add security checks for setTableStateInMeta and fixMeta	Blocker	.
HBASE-25445	Old WALs archive fails in procedure based WAL split	Critical	wal
HBASE-25287	Forgetting to unbuffer streams results in many CLOSE_WAIT sockets when loading files	Major	.
HBASE-25447	remoteProc is suspended due to OOM ERROR	Major	proc-v2
HBASE-24755	[LOG][RSGroup]Error message is confusing while adding a offline RS to rsgroup	Major	rsgroup
HBASE-25463	Fix comment error	Minor	shell
HBASE-25457	Possible race in AsyncConnectionImpl between getChoreService and close	Major	Client
HBASE-25456	setRegionStateInMeta need security check	Critical	.
HBASE-25383	HBase doesn't update and remove the peer config from hbase.replication.source.custom.walentryfilters if the config is already set on the peer.	Major	.
HBASE-25404	Procedures table Id under master web UI gets word break to single character	Minor	UI
HBASE-25277	postScannerFilterRow impacts Scan performance a lot in HBase 2.x	Critical	Coprocessors, scan
HBASE-25365	The log in move_servers_rsgroup is incorrect	Minor	.
HBASE-25372	Fix typo in ban-jersey section of the enforcer plugin in pom.xml	Major	build
HBASE-25361	[Flakey Tests] branch-2 TestMetaRegionLocationCache.testStandByMetaLocations	Major	flakies

TESTS:

JIRA	Summary	Priority	Component
HBASE-25502	IntegrationTestMTTR fails with TableNotFoundException	Major	integration tests
HBASE-25334	TestRSGroupsFallback.testFallback is flaky	Major	.
HBASE-25370	Fix flaky test TestClassFinder#testClassFinderDefaultsToOwnPackage	Major	test

SUB-TASKS:

JIRA	Summary	Priority	Component
HBASE-25293	Followup jira to address the client handling issue when chaning from meta replica to non-meta-replica at the server side.	Minor	.
HBASE-25353	[Flakey Tests] branch-2 TestShutdownBackupMaster	Major	flakies

OTHER:

JIRA	Summary	Priority	Component
HBASE-25333	Add maven enforcer rule to ban VisibleForTesting imports	Major	build, pom
HBASE-25452	Use MatcherAssert.assertThat instead of org.junit.Assert.assertThat	Major	test
HBASE-25400	[Flakey Tests] branch-2 TestRegionMoveAndAbandon	Major	.
HBASE-25389	[Flakey Tests] branch-2 TestMetaShutdownHandler	Major	flakies

Release 2.4.0 - Unreleased (as of 2020-12-03)

NEW FEATURES:

JIRA	Summary	Priority	Component
HBASE-25242	Add Increment/Append support to RowMutations	Critical	Client, regionserver
HBASE-25278	Add option to toggle CACHE_BLOCKS in count.rb	Minor	shell
HBASE-18070	Enable memstore replication for meta replica	Critical	.
HBASE-24528	Improve balancer decision observability	Major	Admin, Balancer, Operability, shell, UI
HBASE-24776	[hbtop] Support Batch mode	Major	hbtop
HBASE-24602	Add Increment and Append support to CheckAndMutate	Major	.
HBASE-24760	Add a config hbase.rsgroup.fallback.enable for RSGroup fallback feature	Major	rsgroup
HBASE-24694	Support flush a single column family of table	Major	.
HBASE-24289	Heterogeneous Storage for Date Tiered Compaction	Major	Compaction
HBASE-24038	Add a metric to show the locality of ssd in table.jsp	Major	metrics
HBASE-8458	Support for batch version of checkAndMutate()	Major	Client, regionserver

IMPROVEMENTS:

JIRA	Summary	Priority	Component
HBASE-25339	Method parameter and member variable are duplicated in checkSplittable() of SplitTableRegionProcedure	Minor	.
HBASE-25237	'hbase master stop' shuts down the cluster, not the master only	Major	.
HBASE-25324	Remove unnecessary array to list conversion in SplitLogManager	Minor	.
HBASE-25263	Change encryption key generation algorithm used in the HBase shell	Major	encryption, shell
HBASE-25323	Fix potential NPE when the zookeeper path of RegionServerTracker does not exist when start	Minor	.
HBASE-25281	Bulkload split hfile too many times due to unreasonable split point	Minor	tooling
HBASE-25325	Remove unused class ClusterSchemaException	Minor	.
HBASE-25213	Should request Compaction when bulkLoadHFiles is done	Minor	.
HBASE-24877	Add option to avoid aborting RS process upon uncaught exceptions happen on replication source	Major	Replication
HBASE-24664	Some changing of split region by overall region size rather than only one store size	Major	regionserver
HBASE-25026	Create a metric to track full region scans RPCs	Minor	.
HBASE-25289	[testing] Clean up resources after tests in rsgroup_shell_test.rb	Major	rsgroup, test
HBASE-25261	Upgrade Bootstrap to 3.4.1	Major	security, UI
HBASE-25272	Support scan on a specific replica	Critical	Client, scan
HBASE-25267	Add SSL keystore type and truststore related configs for HBase RESTServer	Major	REST
HBASE-25181	Add options for disabling column family encryption and choosing hash algorithm for wrapped encryption keys.	Major	encryption
HBASE-25254	Rewrite TestMultiLogThreshold to remove the LogDelegate in RSRpcServices	Major	logging, test
HBASE-25252	Move HMaster inner classes out	Minor	master
HBASE-25240	gson format of RpcServer.logResponse is abnormal	Minor	.
HBASE-25210	RegionInfo.isOffline is now a duplication with RegionInfo.isSplit	Major	meta
HBASE-25212	Optionally abort requests in progress after deciding a region should close	Major	regionserver
HBASE-24859	Optimize in-memory representation of mapreduce TableSplit objects	Major	mapreduce
HBASE-24967	The table.jsp cost long time to load if the table include closed regions	Major	UI
HBASE-25167	Normalizer support for hot config reloading	Major	master, Normalizer
HBASE-24419	Normalizer merge plans should consider more than 2 regions when possible	Major	master, Normalizer
HBASE-25224	Maximize sleep for checking meta and namespace regions availability	Major	master
HBASE-25223	Use try-with-resources statement in snapshot package	Minor	.
HBASE-25201	YouAreDeadException should be moved to hbase-server module	Major	Client
HBASE-25193	Add support for row prefix and type in the WAL Pretty Printer and some minor fixes	Minor	wal
HBASE-25128	RSGroupInfo's toString() and hashCode() does not take into account configuration map.	Minor	rsgroup
HBASE-24628	Region normalizer now respects a rate limit	Major	Normalizer
HBASE-25179	Assert format is incorrect in HFilePerformanceEvaluation class.	Minor	Performance, test
HBASE-25065	WAL archival to be done by a separate thread	Major	wal
HBASE-14067	bundle ruby files for hbase shell into a jar.	Major	shell
HBASE-24875	Remove the force param for unassign since it dose not take effect any more	Major	Client
HBASE-24025	Improve performance of move_servers_rsgroup and move_tables_rsgroup by using async region move API	Major	rsgroup
HBASE-25160	Refactor AccessController and VisibilityController	Major	.
HBASE-25146	Add extra logging at info level to HFileCorruptionChecker in order to report progress	Major	hbck, hbck2
HBASE-24054	The Jetty's version number leak occurred while using the thrift service	Minor	.
HBASE-25091	Move LogComparator from ReplicationSource to AbstractFSWALProvider#.WALsStartTimeComparator	Minor	.
HBASE-24981	Enable table replication fails from 1.x to 2.x if table already exist at peer.	Major	Replication
HBASE-25109	Add MR Counters to WALPlayer; currently hard to tell if it is doing anything	Major	.
HBASE-25082	Per table WAL metrics: appendCount and appendSize	Major	metrics
HBASE-25079	Upgrade Bootstrap to 3.3.7	Major	security, UI
HBASE-24976	REST Server failes to start without any error message	Major	REST
HBASE-25066	Use FutureUtils.rethrow in AsyncTableResultScanner to better catch the stack trace	Major	Client, Scanners
HBASE-25069	Display region name instead of encoded region name in HBCK report page.	Minor	hbck
HBASE-24991	Replace MovedRegionsCleaner with guava cache	Minor	.
HBASE-25057	Fix typo "memeber"	Trivial	documentation
HBASE-24764	Add support of adding base peer configs via hbase-site.xml for all replication peers.	Minor	Replication
HBASE-25037	Lots of thread pool are changed to non daemon after HBASE-24750 which causes trouble when shutting down	Major	.
HBASE-24831	Avoid invoke Counter using reflection in SnapshotInputFormat	Major	.
HBASE-25002	Create simple pattern matching query for retrieving metrics matching the pattern	Major	.
HBASE-25022	Remove 'hbase.testing.nocluster' config	Major	test
HBASE-25006	Make the cost functions optional for StochastoicBalancer	Major	.
HBASE-24974	Provide a flexibility to print only row key and filter for multiple tables in the WALPrettyPrinter	Minor	wal
HBASE-24994	Add hedgedReadOpsInCurThread metric	Minor	metrics
HBASE-25005	Refactor CatalogJanitor	Major	master, meta
HBASE-24992	log after Generator success when running ITBLL	Trivial	.
HBASE-24937	table.rb use LocalDateTime to replace Instant	Minor	shell
HBASE-24940	runCatalogJanitor() API should return -1 to indicate already running status	Major	.
HBASE-24973	Remove read point parameter in method StoreFlush#performFlush and StoreFlush#createScanner	Minor	.
HBASE-24569	Get hostAndWeights in addition using localhost if it is null in local mode	Minor	regionserver
HBASE-24949	Optimize FSTableDescriptors.get to not always go to fs when cache miss	Major	master
HBASE-24898	Use EnvironmentEdge.currentTime() instead of System.currentTimeMillis() in CurrentHourProvider	Major	tooling
HBASE-24942	MergeTableRegionsProcedure should not call clean merge region	Major	proc-v2, Region Assignment
HBASE-24811	Use class access static field or method	Minor	.
HBASE-24686	[LOG] Log improvement in Connection#close	Major	Client, logging
HBASE-24912	Enlarge MemstoreFlusherChore/CompactionChecker period for unit test	Major	.
HBASE-24627	Normalize one table at a time	Major	Normalizer
HBASE-24872	refactor valueOf PoolType	Minor	Client
HBASE-24854	Correct the help content of assign and unassign commands in hbase shell	Minor	shell
HBASE-24750	All executor service should start using guava ThreadFactory	Major	.
HBASE-24709	Support MoveCostFunction use a lower multiplier in offpeak hours	Major	Balancer
HBASE-24824	Add more stats in PE for read replica	Minor	PE, read replicas
HBASE-21721	FSHLog : reduce write#syncs() times	Major	.
HBASE-24404	Support flush a single column family of region	Major	shell
HBASE-24826	Add some comments for processlist in hbase shell	Minor	shell
HBASE-24659	Calculate FIXED_OVERHEAD automatically	Major	.
HBASE-24827	BackPort HBASE-11554 Remove Reusable poolmap Rpc client type.	Major	Client
HBASE-24823	Port HBASE-22762 Print the delta between phases in the split/merge/compact/flush transaction journals to master branch	Minor	.
HBASE-24795	RegionMover should deal with unknown (split/merged) regions	Major	.
HBASE-24821	Simplify the logic of getRegionInfo in TestFlushFromClient to reduce redundancy code	Minor	test
HBASE-24704	Make the Table Schema easier to view even there are multiple families	Major	UI
HBASE-24695	FSHLog - close the current WAL file in a background thread	Major	.
HBASE-24803	Unify hbase-shell ::Shell::Commands::Command#help behavior	Minor	shell
HBASE-11686	Shell code should create a binding / irb workspace instead of polluting the root namespace	Minor	shell
HBASE-20226	Performance Improvement Taking Large Snapshots In Remote Filesystems	Minor	snapshots
HBASE-24669	Logging of ppid should be consistent across all occurrences	Minor	Operability, proc-v2
HBASE-24757	ReplicationSink should limit the batch rowcount for batch mutations based on hbase.rpc.rows.warning.threshold	Major	.
HBASE-24777	InfoServer support ipv6 host and port	Minor	UI
HBASE-24758	Avoid flooding replication source RSes logs when no sinks are available	Major	Replication
HBASE-24743	Reject to add a peer which replicate to itself earlier	Major	.
HBASE-24696	Include JVM information on Web UI under "Software Attributes"	Minor	UI
HBASE-24747	Log an ERROR if HBaseSaslRpcServer initialisation fails with an uncaught exception	Major	.
HBASE-24586	Add table level locality in table.jsp	Major	UI
HBASE-24663	Add procedure process time statistics UI	Major	.
HBASE-24653	Show snapshot owner on Master WebUI	Major	.
HBASE-24431	RSGroupInfo add configuration map to store something extra	Major	rsgroup
HBASE-24671	Add excludefile and designatedfile options to graceful_stop.sh	Major	.
HBASE-24560	Add a new option of designatedfile in RegionMover	Major	.
HBASE-24382	Flush partial stores of region filtered by seqId when archive wal due to too many wals	Major	wal
HBASE-24208	Remove RS entry from zk draining servers node after RS been stopped	Major	.
HBASE-24456	Immutable Scan as unmodifiable subclass or wrapper of Scan	Major	.
HBASE-24471	The way we bootstrap meta table is confusing	Major	master, meta, proc-v2
HBASE-24350	HBase table level replication metrics for shippedBytes are always 0	Major	Replication
HBASE-24311	Add more details in MultiVersionConcurrencyControl STUCK log message	Major	.

BUG FIXES:

JIRA	Summary	Priority	Component
HBASE-25355	[Documentation] Fix spelling error	Trivial	documentation
HBASE-25230	Embedded zookeeper server not clean up the old data	Minor	Zookeeper
HBASE-25349	[Flakey Tests] branch-2 TestRefreshRecoveredReplication.testReplicationRefreshSource:141 Waiting timed out after [60,000] msec	Major	flakies
HBASE-25332	one NPE	Major	Zookeeper
HBASE-25345	[Flakey Tests] branch-2 TestReadReplicas#testVerifySecondaryAbilityToReadWithOnFiles	Major	test
HBASE-25307	ThreadLocal pooling leads to NullPointerException	Major	Client
HBASE-25341	Fix ErrorProne error which causes nightly to fail	Major	test
HBASE-25330	RSGroupInfoManagerImpl#moveServers return is not set of servers moved	Major	rsgroup
HBASE-25321	The sort icons not shown after Upgrade JQuery to 3.5.1	Major	UI
HBASE-24268	REST and Thrift server do not handle the "doAs" parameter case insensitively	Minor	REST, Thrift
HBASE-25050	We initialize Filesystems more than once.	Minor	.
HBASE-25311	ui throws NPE	Major	.
HBASE-25306	The log in SimpleLoadBalancer#onConfigurationChange is wrong	Major	.
HBASE-25300	'Unknown table hbase:quota' happens when desc table in shell if quota disabled	Major	shell
HBASE-25255	Master fails to initialize when creating rs group table	Critical	master, rsgroup
HBASE-25275	Upgrade asciidoctor	Blocker	website
HBASE-25276	Need to throw the original exception in HRegion#openHRegion	Major	.
HBASE-20598	Upgrade to JRuby 9.2	Major	dependencies, shell
HBASE-25216	The client zk syncer should deal with meta replica count change	Major	master, Zookeeper
HBASE-25238	Upgrading HBase from 2.2.0 to 2.3.x fails because of “Message missing required fields: state”	Critical	.
HBASE-25234	[Upgrade]Incompatibility in reading RS report from 2.1 RS when Master is upgraded to a version containing HBASE-21406	Major	.
HBASE-25053	WAL replay should ignore 0-length files	Major	master, regionserver
HBASE-25090	CompactionConfiguration logs unrealistic store file sizes	Minor	Compaction
HBASE-24977	Meta table shouldn't be modified as read only	Major	meta
HBASE-25176	MasterStoppedException should be moved to hbase-client module	Major	Client
HBASE-25206	Data loss can happen if a cloned table loses original split region(delete table)	Major	proc-v2, Region Assignment, snapshots
HBASE-25207	Revisit the implementation and usage of RegionStates.include	Major	Region Assignment
HBASE-25186	TestMasterRegionOnTwoFileSystems is failing after HBASE-25065	Blocker	master
HBASE-25204	Nightly job failed as the name of jdk and maven changed	Major	.
HBASE-25093	the RSGroupBasedLoadBalancer#retainAssignment throws NPE	Major	rsgroup
HBASE-25117	ReplicationSourceShipper thread can not be finished	Major	.
HBASE-25168	Unify WAL name timestamp parsers	Major	.
HBASE-23834	HBase fails to run on Hadoop 3.3.0/3.2.2/3.1.4 due to jetty version mismatch	Major	dependencies
HBASE-25165	Change 'State time' in UI so sorts	Minor	UI
HBASE-25048	[HBCK2] Bypassed parent procedures are not updated in store	Major	hbck2, proc-v2
HBASE-25147	Should store the regionNames field in state data for ReopenTableRegionsProcedure	Major	proc-v2
HBASE-25115	HFilePrettyPrinter can't seek to the row which is the first row of a hfile	Major	HFile, tooling
HBASE-25135	Convert the internal seperator while emitting the memstore read metrics to #	Minor	.
HBASE-24665	MultiWAL : Avoid rolling of ALL WALs when one of the WAL needs a roll	Major	wal
HBASE-25096	WAL size in RegionServer UI is wrong	Major	.
HBASE-25077	hbck.jsp page loading fails, logs NPE in master log.	Major	hbck
HBASE-25088	CatalogFamilyFormat/MetaTableAccessor.parseRegionInfoFromRegionName incorrectly setEndKey to regionId	Critical	meta
HBASE-25097	Wrong RIT page number in Master UI	Minor	UI
HBASE-24896	'Stuck' in static initialization creating RegionInfo instance	Major	.
HBASE-24956	ConnectionManager#locateRegionInMeta waits for user region lock indefinitely.	Major	Client
HBASE-24481	HBase Rest: Request for region detail of a table which doesn't exits is success(200 success code) instead of 404	Minor	.
HBASE-25047	WAL split edits number is negative in RegionServerUI	Minor	UI, wal
HBASE-25021	Nightly job should skip hadoop-2 integration test for master	Major	build, scripts
HBASE-25012	HBASE-24359 causes replication missed log of some RemoteException	Major	Replication
HBASE-25009	Hbck chore logs wrong message when loading regions from RS report	Minor	.
HBASE-25014	ScheduledChore is never triggered when initalDelay > 1.5*period	Major	.
HBASE-25016	Should close ResultScanner in MetaTableAccessor.scanByRegionEncodedName	Critical	master, meta
HBASE-24958	CompactingMemStore.timeOfOldestEdit error update	Critical	regionserver
HBASE-24995	MetaFixer fails to fix overlaps when multiple tables have overlaps	Major	hbck2
HBASE-24719	Renaming invalid rsgroup throws NPE instead of proper error message	Major	.
HBASE-19352	Port HADOOP-10379: Protect authentication cookies with the HttpOnly and Secure flags	Major	.
HBASE-24971	Upgrade JQuery to 3.5.1	Major	security, UI
HBASE-24968	One of static initializers of CellComparatorImpl referring to subclass MetaCellComparator	Major	.
HBASE-24916	Region hole contains wrong regions pair when hole is created by first region deletion	Major	hbck2
HBASE-24885	STUCK RIT by hbck2 assigns	Major	hbck2, Region Assignment
HBASE-24926	Should call setFailure in MergeTableRegionsProcedure when isMergeable returns false	Major	master, proc-v2
HBASE-24884	BulkLoadHFilesTool/LoadIncrementalHFiles should accept -D options from command line parameters	Minor	.
HBASE-24583	Normalizer can't actually merge empty regions when neighbor is larger than average size	Major	master, Normalizer
HBASE-24844	Exception on standalone (master) shutdown	Minor	Zookeeper
HBASE-24856	Fix error prone error in FlushTableSubprocedure	Major	.
HBASE-24838	The pre commit job fails to archive surefire reports	Critical	build, scripts
HBASE-23157	WAL unflushed seqId tracking may wrong when Durability.ASYNC_WAL is used	Major	regionserver, wal
HBASE-24625	AsyncFSWAL.getLogFileSizeIfBeingWritten does not return the expected synced file length.	Critical	Replication, wal
HBASE-24830	Some tests involving RS crash fail with NullPointerException after HBASE-24632 in branch-2	Major	.
HBASE-24788	Fix the connection leaks on getting hbase admin from unclosed connection	Major	mapreduce
HBASE-24805	HBaseTestingUtility.getConnection should be threadsafe	Major	test
HBASE-24808	skip empty log cleaner delegate class names (WAS => cleaner.CleanerChore: Can NOT create CleanerDelegate= ClassNotFoundException)	Trivial	.
HBASE-24767	Change default to false for HBASE-15519 per-user metrics	Major	metrics
HBASE-24713	RS startup with FSHLog throws NPE after HBASE-21751	Minor	wal
HBASE-24794	hbase.rowlock.wait.duration should not be <= 0	Minor	regionserver
HBASE-24797	Move log code out of loop	Minor	Normalizer
HBASE-24752	NPE/500 accessing webui on master startup	Minor	master
HBASE-24766	Document Remote Procedure Execution	Major	documentation
HBASE-11676	Scan FORMATTER is not applied for columns using non-printable name in shell	Minor	shell
HBASE-24738	[Shell] processlist command fails with ERROR: Unexpected end of file from server when SSL enabled	Major	shell
HBASE-24675	On Master restart all servers are assigned to default rsgroup.	Major	rsgroup
HBASE-22146	SpaceQuotaViolationPolicy Disable is not working in Namespace level	Major	.
HBASE-24742	Improve performance of SKIP vs SEEK logic	Major	Performance, regionserver
HBASE-24710	Incorrect checksum calculation in saveVersion.sh	Major	scripts
HBASE-24714	Error message is displayed in the UI of table's compaction state if any region of that table is not open.	Major	Compaction, UI
HBASE-24748	Add hbase.master.balancer.stochastic.moveCost.offpeak to doc as support dynamically change	Minor	documentation
HBASE-24746	The sort icons overlap the col name in master UI	Major	UI
HBASE-24721	rename_rsgroup overwriting the existing rsgroup.	Major	.
HBASE-24615	MutableRangeHistogram#updateSnapshotRangeMetrics doesn't calculate the distribution for last bucket.	Major	metrics
HBASE-24705	MetaFixer#fixHoles() does not include the case for read replicas (i.e, replica regions are not created)	Major	read replicas
HBASE-24720	Meta replicas not cleaned when disabled	Minor	read replicas
HBASE-24693	regioninfo#isLast() has a logic error	Minor	.
HBASE-23744	FastPathBalancedQueueRpcExecutor should enforce queue length of 0	Minor	.
HBASE-22738	Fallback to default group to choose RS when there are no RS in current group	Major	rsgroup
HBASE-23126	IntegrationTestRSGroup is useless now	Major	rsgroup
HBASE-24518	waitForNamespaceOnline() should return false if any region is offline	Major	.
HBASE-24564	Make RS abort call idempotent	Major	regionserver
HBASE-24340	PerformanceEvaluation options should not mandate any specific order	Minor	.
HBASE-24130	rat plugin complains about having an unlicensed file.	Minor	.
HBASE-24017	Turn down flakey rerun rate on all but hot branches	Major	.

TESTS:

JIRA	Summary	Priority	Component
HBASE-24015	Coverage for Assign and Unassign of Regions on RegionServer on failure	Major	amv2
HBASE-25156	TestMasterFailover.testSimpleMasterFailover is flaky	Major	test
HBASE-24979	Include batch mutatations in client operation timeout tests	Major	.
HBASE-24894	[Flakey Test] TestStochasticLoadBalancer.testMoveCostMultiplier	Major	Balancer, master, test

SUB-TASKS:

JIRA	Summary	Priority	Component
HBASE-25127	Enhance PerformanceEvaluation to profile meta replica performance.	Major	.
HBASE-25284	Check-in "Enable memstore replication..." design	Major	.
HBASE-25126	Add load balance logic in hbase-client to distribute read load over meta replica regions.	Major	.
HBASE-25291	Document how to enable the meta replica load balance mode for the client and clean up around hbase:meta read replicas	Major	.
HBASE-25253	Deprecated master carrys regions related methods and configs	Major	Balancer, master
HBASE-25203	Change the reference url to flaky list in our jenkins jobs	Major	flakies, jenkins
HBASE-25194	Do not publish workspace in flaky find job	Major	jenkins
HBASE-25169	Update documentation about meta region replica	Major	documentation
HBASE-25164	Make ModifyTableProcedure support changing meta replica count	Major	meta, read replicas
HBASE-25162	Make flaky tests run more aggressively	Major	jenkins, scripts, test
HBASE-25163	Increase the timeout value for nightly jobs	Major	jenkins, scripts, test
HBASE-22976	[HBCK2] Add RecoveredEditsPlayer	Major	hbck2, walplayer
HBASE-25124	Support changing region replica count without disabling table	Major	meta, proc-v2
HBASE-23959	Fix javadoc for JDK11	Major	.
HBASE-25151	warmupRegion frustrates registering WALs on the catalog replicationsource	Major	read replicas
HBASE-25154	Set java.io.tmpdir to project build directory to avoid writing std*deferred files to /tmp	Major	build, test
HBASE-25121	Refactor MetaTableAccessor.addRegionsToMeta and its usage places	Major	meta
HBASE-25055	Add ReplicationSource for meta WALs; add enable/disable when hbase:meta assigned to RS	Major	.
HBASE-25133	Migrate HBase Nightly jenkins job from Hadoop to hbase	Major	jenkins, scripts
HBASE-25132	Migrate flaky test jenkins job from Hadoop to hbase	Major	jenkins, scripts
HBASE-25103	Remove ZNodePaths.metaReplicaZNodes	Major	.
HBASE-25107	Migrate flaky reporting jenkins job from Hadoop to hbase	Major	jenkins, scripts
HBASE-25068	Pass WALFactory to Replication so it knows of all WALProviders, not just default/user-space	Minor	.
HBASE-25067	Edit of log messages around async WAL Replication; checkstyle fixes; and a bugfix	Major	.
HBASE-24857	Fix several problems when starting webUI	Minor	canary, UI
HBASE-24964	Remove MetaTableAccessor.tableExists	Major	meta
HBASE-24765	Dynamic master discovery	Major	Client
HBASE-24945	Remove MetaTableAccessor.getRegionCount	Major	mapreduce, meta
HBASE-24944	Remove MetaTableAccessor.getTableRegionsAndLocations in hbase-rest module	Major	meta, REST
HBASE-24918	Make RegionInfo#UNDEFINED IA.Private	Major	.
HBASE-24806	Small Updates to Functionality of Shell IRB Workspace	Major	shell
HBASE-24876	Fix the flaky job url in hbase-personality.sh	Major	.
HBASE-24841	Change the jenkins job urls in our jenkinsfile	Major	build, scripts
HBASE-24680	Refactor the checkAndMutate code on the server side	Major	.
HBASE-24817	Allow configuring WALEntry filters on ReplicationSource	Major	Replication, wal
HBASE-24632	Enable procedure-based log splitting as default in hbase3	Major	wal
HBASE-24718	Generic NamedQueue framework for recent in-memory history (refactor slowlog)	Major	.
HBASE-24698	Turn OFF Canary WebUI as default	Major	canary
HBASE-24650	Change the return types of the new checkAndMutate methods introduced in HBASE-8458	Major	Client
HBASE-24013	Bump branch-2 version to 2.4.0-SNAPSHOT	Major	.

OTHER:

JIRA	Summary	Priority	Component
HBASE-25099	Change meta replica count by altering meta table descriptor	Major	meta, read replicas
HBASE-25320	Upgrade hbase-thirdparty dependency to 3.4.1	Blocker	dependencies
HBASE-24640	Purge use of VisibleForTesting	Major	community
HBASE-24081	Provide documentation for running Yetus with HBase	Major	documentation
HBASE-24667	Rename configs that support atypical DNS set ups to put them in hbase.unsafe	Major	conf, Operability
HBASE-25228	Delete dev-support/jenkins_precommit_jira_yetus.sh	Minor	build
HBASE-24200	Upgrade to Yetus 0.12.0	Minor	build
HBASE-25120	Remove the deprecated annotation for MetaTableAccessor.getScanForTableName	Major	meta
HBASE-25073	Should not use XXXService.Interface.class.getSimpleName as stub key prefix in AsyncConnectionImpl	Major	Client
HBASE-25072	Remove the unnecessary System.out.println in MasterRegistry	Minor	Client
HBASE-25004	Log RegionTooBusyException details	Major	.
HBASE-24993	Remove OfflineMetaRebuildTestCore	Major	test
HBASE-24809	Yetus IA Javadoc links are no longer available	Minor	.
HBASE-14847	Add FIFO compaction section to HBase book	Major	documentation
HBASE-24843	Sort the constants in `hbase_constants.rb`	Minor	shell
HBASE-24835	Normalizer should log a successful run at INFO level	Minor	Normalizer
HBASE-24779	Improve insight into replication WAL readers hung on checkQuota	Minor	Replication
HBASE-24662	Update DumpClusterStatusAction to notice changes in region server count	Major	integration tests
HBASE-24658	Update PolicyBasedChaosMonkey to handle uncaught exceptions	Minor	integration tests
HBASE-24648	Remove the legacy 'forceSplit' related code at region server side	Major	regionserver
HBASE-24492	ProtobufLogReader.readNext does not need looping	Minor	Replication, wal
HBASE-22033	Update to maven-javadoc-plugin 3.2.0 and switch to non-forking aggregate goals	Major	build, website

Release 2.3.0

CHANGES.md at rel/2.3.0 (e0e1382)

Release 2.2.0

CHANGES.md at rel/2.2.0 (3ec6932)

Release 2.1.0

CHANGES.md at rel/2.1.0 (e1673bb)

Release 2.0.0

CHANGES.md at rel/2.0.0 (7483b11)

Release 1.0.0

CHANGES.txt at rel/1.0.0 (6c98bff)