hbase/CHANGES.md

117 KiB
Raw Blame History

HBASE Changelog

Release 2.4.12 - Unreleased (as of 2022-04-30)

IMPROVEMENTS:

JIRA Summary Priority Component
HBASE-26961 cache region locations when getAllRegionLocations() for branch-2.4+ Minor Client
HBASE-26860 Backport "HBASE-25681 Add a switch for server/table queryMeter" to branch-2.4 Major .
HBASE-26980 Update javadoc of BucketCache.java Trivial documentation
HBASE-26581 Add metrics around failed replication edits Minor metrics, Replication
HBASE-26971 SnapshotInfo --snapshot param is marked as required even when trying to list all snapshots Minor .
HBASE-26618 Involving primary meta region in meta scan with CatalogReplicaLoadBalanceSimpleSelector Minor meta replicas
HBASE-26885 The TRSP should not go on when it get a bogus server name from AM Major proc-v2
HBASE-26872 Load rate calculator for cost functions should be more precise Major Balancer
HBASE-26832 Avoid repeated releasing of flushed wal entries in AsyncFSWAL#syncCompleted Major wal
HBASE-26878 TableInputFormatBase should cache RegionSizeCalculator Minor .
HBASE-26175 MetricsHBaseServer should record all kinds of Exceptions Minor metrics
HBASE-26858 Refactor TestMasterRegionOnTwoFileSystems to avoid dead loop Major test
HBASE-26848 Set java.io.tmpdir on mvn command when running jenkins job Major jenkins, test
HBASE-26680 Close and do not write trailer for the broken WAL writer Major wal
HBASE-26720 ExportSnapshot should validate the source snapshot before copying files Major snapshots
HBASE-26275 update error message when executing deleteall with ROWPREFIXFILTER in meta table Minor shell

BUG FIXES:

JIRA Summary Priority Component
HBASE-26917 Do not add --threads when running 'mvn site' Major build, scripts
HBASE-26941 LocalHBaseCluster.waitOnRegionServer should not call join while interrupted Critical test
HBASE-26944 Possible resource leak while creating new region scanner Major .
HBASE-26895 on hbase shell, 'delete/deleteall' for a columnfamily is not working Major shell
HBASE-26901 delete with null columnQualifier occurs NullPointerException when NewVersionBehavior is on Major Deletes, Scanners
HBASE-26880 Misspelling commands in hbase shell will crash the shell Minor shell
HBASE-26924 [Documentation] Fix log parameter error and spelling error Trivial logging
HBASE-26811 Secondary replica may be disabled for read incorrectly forever Major read replicas
HBASE-26812 ShortCircuitingClusterConnection fails to close RegionScanners when making short-circuited calls Critical .
HBASE-26838 Junit jar is not included in the hbase tar ball, causing issues for some hbase tools that do rely on it Major integration tests, tooling
HBASE-26871 shaded mapreduce and shaded byo-hadoop client artifacts contains no classes Blocker integration tests, jenkins, mapreduce
HBASE-26896 list_quota_snapshots fails with ERROR NameError: uninitialized constant Shell::Commands::ListQuotaSnapshots::TABLE Major shell
HBASE-26718 HFileArchiver can remove referenced StoreFiles from the archive Major Compaction, HFile, snapshots
HBASE-26864 SplitTableRegionProcedure calls openParentRegions() at a wrong state during rollback. Major Region Assignment
HBASE-26876 Use toStringBinary for rowkey in RegionServerCallable error string Minor .
HBASE-26875 RpcRetryingCallerImpl translateException ignores return value of recursive call Minor .
HBASE-26869 RSRpcServices.scan should deep clone cells when RpcCallContext is null Major regionserver

SUB-TASKS:

JIRA Summary Priority Component
HBASE-26932 Skip generating ref guide when running 'mvn site' on branch other than master Major build, pom
HBASE-26928 Fix several indentation problems Major .
HBASE-26922 Fix LineLength warnings as much as possible if it can not be fixed by spotless Major .
HBASE-26929 Upgrade surefire plugin to 3.0.0-M6 Major pom, test
HBASE-26916 Fix missing braces warnings in DefaultVisibilityExpressionResolver Major .
HBASE-26919 Rewrite the counting rows part in TestFromClientSide4 Major test
HBASE-26920 Fix missing braces warnings in TestProcedureMember Major test
HBASE-26921 Rewrite the counting cells part in TestMultiVersions Major test

OTHER:

JIRA Summary Priority Component
HBASE-26882 Backport "HBASE-26810 Add dynamic configuration support for system coprocessors" to branch-2 Major Coprocessors, master, regionserver
HBASE-26903 Bump httpclient from 4.5.3 to 4.5.13 Minor .
HBASE-26902 Bump bcprov-jdk15on from 1.60 to 1.67 Minor .
HBASE-26834 Adapt ConnectionRule for both sync and async connections Major test
HBASE-26861 Fix flaky TestSnapshotFromMaster.testSnapshotHFileArchiving Major snapshots, test

Release 2.4.11 - 2022-03-21

IMPROVEMENTS:

JIRA Summary Priority Component
HBASE-26828 Increase the concurrency when running UTs in pre commit job Major jenkins, test
HBASE-26833 Avoid waiting to clear buffer usage of ReplicationSourceShipper when aborting the RS Major regionserver, Replication
HBASE-26835 Rewrite TestLruAdaptiveBlockCache to make it more stable Major test
HBASE-26830 Rewrite TestLruBlockCache to make it more stable Major test
HBASE-26552 Introduce retry to logroller to avoid abort Major wal
HBASE-26792 Implement ScanInfo#toString Minor regionserver
HBASE-26789 Automatically add default security headers to http/rest if SSL enabled Major REST, UI
HBASE-23303 Add security headers to REST server/info page Major REST

BUG FIXES:

JIRA Summary Priority Component
HBASE-26840 Fix NPE in the retry of logroller Minor wal
HBASE-26670 HFileLinkCleaner should be added even if snapshot is disabled Critical snapshots
HBASE-26761 TestMobStoreScanner (testGetMassive) can OOME Minor mob, test
HBASE-26816 Fix CME in ReplicationSourceManager Minor Replication
HBASE-26715 Blocked on SyncFuture in AsyncProtobufLogWriter#write Major .
HBASE-26815 TestFanOutOneBlockAsyncDFSOutput is flakey Major test
HBASE-26783 ScannerCallable doubly clears meta cache on retries Major .
HBASE-25709 Close region may stuck when region is compacting and skipped most cells read Major Compaction
HBASE-26777 BufferedDataBlockEncoder$OffheapDecodedExtendedCell.deepClone throws UnsupportedOperationException Major regionserver
HBASE-26745 MetricsStochasticBalancerSource metrics don't render in /jmx endpoint Minor .
HBASE-26776 RpcServer failure to SASL handshake always logs user "unknown" to audit log Major security
HBASE-26772 Shell suspended in background Minor shell

SUB-TASKS:

JIRA Summary Priority Component
HBASE-26603 Cherry pick HBASE-26537 to branch-2.4 Major .
HBASE-26824 TestHBaseTestingUtil.testResolvePortConflict failing after HBASE-26582 Major .
HBASE-26582 Prune use of Random and SecureRandom objects Minor .

OTHER:

JIRA Summary Priority Component
HBASE-26839 Fix compatibility issues in 2.4.11RC0 Minor .
HBASE-26817 Mark RpcExecutor as IA.LimitedPrivate COPROC and PHOENIX Major compatibility
HBASE-26760 LICENSE handling should not allow non-aggregated "apache-2.0" Minor community
HBASE-26691 Replacing log4j with reload4j for branch-2.x Critical logging
HBASE-26788 Disable Checks API callback from test results in PRs Major build
HBASE-26622 Update to error-prone 2.10 Major .

Release 2.4.10 - 2022-03-04

NEW FEATURES:

JIRA Summary Priority Component
HBASE-26576 Allow Pluggable Queue to belong to FastPath or normal Balanced Executor Minor regionserver, rpc

IMPROVEMENTS:

JIRA Summary Priority Component
HBASE-26702 Make ageOfLastShip, ageOfLastApplied extend TimeHistogram instead of plain histogram. Minor metrics, Replication
HBASE-26657 ProfileServlet should move the output location to hbase specific directory Minor .
HBASE-26590 Hbase-client Meta lookup performance regression between hbase-1 and hbase-2 Major meta
HBASE-26629 Add expiration for long time vacant scanners in Thrift2 Major Performance, Thrift
HBASE-26609 Round the size to MB or KB at the end of calculation in HRegionServer.createRegionLoad Major regionserver
HBASE-26598 Fix excessive connections in MajorCompactor Major Compaction, tooling
HBASE-26579 Set storage policy of recovered edits when wal storage type is configured Major Recovery

BUG FIXES:

JIRA Summary Priority Component
HBASE-26767 Rest server should not use a large Header Cache. Major REST
HBASE-26546 hbase-shaded-client missing required thirdparty classes under hadoop 3.3.1 Major Client, hadoop3, shading
HBASE-26712 Balancer encounters NPE in rare case Major .
HBASE-26742 Comparator of NOT_EQUAL NULL is invalid for checkAndMutate Major .
HBASE-26688 Threads shared EMPTY_RESULT may lead to unexpected client job down. Major Client
HBASE-26741 Incorrect exception handling in shell Critical shell
HBASE-26729 Backport "HBASE-26714 Introduce path configuration for system coprocessors" to branch-2 Major Coprocessors
HBASE-26713 Increments submitted by 1.x clients will be stored with timestamp 0 on 2.x+ clusters Major .
HBASE-26679 Wait on the future returned by FanOutOneBlockAsyncDFSOutput.flush would stuck Critical wal
HBASE-26662 User.createUserForTesting should not reset UserProvider.groups every time if hbase.group.service.for.test.only is true Major .
HBASE-26671 Misspellings of hbck usage Minor hbck
HBASE-26469 correct HBase shell exit behavior to match code passed to exit Critical shell
HBASE-26643 LoadBalancer should not return empty map Critical proc-v2, Region Assignment, test
HBASE-26646 WALPlayer should obtain token from filesystem Minor .
HBASE-26625 ExportSnapshot tool failed to copy data files for tables with merge region Minor .
HBASE-26615 Snapshot referenced data files are deleted when delete a table with merge regions Major .
HBASE-26613 The logic of the method incrementIV in Encryption class has problem Major Performance, security
HBASE-26488 Memory leak when MemStore retry flushing Major regionserver
HBASE-26340 TableSplit returns false size under 1MB Major mapreduce, regionserver

TESTS:

JIRA Summary Priority Component
HBASE-26689 Backport HBASE-24443 Refactor TestCustomSaslAuthenticationProvider Minor test

SUB-TASKS:

JIRA Summary Priority Component
HBASE-26434 Compact L0 files for cold regions using StripeCompactionPolicy Major .
HBASE-26749 Migrate HBase main pre commit job to ci-hbase Major .
HBASE-26697 Migrate HBase Nightly HBase-Flaky-Tests and HBase-Find-Flaky-Tests to ci-hbase Major jenkins
HBASE-26747 Use python2 instead of python in our python scripts Major jenkins

OTHER:

JIRA Summary Priority Component
HBASE-26616 Refactor code related to ZooKeeper authentication Major Zookeeper
HBASE-26631 Upgrade junit to 4.13.2 Major security, test
HBASE-26580 The message of StoreTooBusy is confused Trivial logging, regionserver

Release 2.4.9 - 2021-12-23

IMPROVEMENTS:

JIRA Summary Priority Component
HBASE-26601 maven-gpg-plugin failing with "Inappropriate ioctl for device" Major build
HBASE-26556 IT and Chaos Monkey improvements Minor integration tests
HBASE-26525 Use unique thread name for group WALs Major wal
HBASE-26517 Add auth method information to AccessChecker audit log Trivial security
HBASE-26512 Make timestamp format configurable in HBase shell scan output Major shell
HBASE-26485 Introduce a method to clean restore directory after Snapshot Scan Minor snapshots
HBASE-26475 The flush and compact methods in HTU should skip processing secondary replicas Major test
HBASE-26267 Master initialization fails if Master Region WAL dir is missing Major master
HBASE-26337 Optimization for weighted random generators Major Balancer
HBASE-26309 Balancer tends to move regions to the server at the end of list Major Balancer

BUG FIXES:

JIRA Summary Priority Component
HBASE-26541 hbase-protocol-shaded not buildable on M1 MacOSX Major .
HBASE-26527 ArrayIndexOutOfBoundsException in KeyValueUtil.copyToNewKeyValue() Major wal
HBASE-26462 Should persist restoreAcl flag in the procedure state for CloneSnapshotProcedure and RestoreSnapshotProcedure Critical proc-v2, snapshots
HBASE-26533 KeyValueScanner might not be properly closed when using InternalScan.checkOnlyMemStore() Minor .
HBASE-26482 HMaster may clean wals that is replicating in rare cases Critical Replication
HBASE-26468 Region Server doesn't exit cleanly incase it crashes. Major regionserver
HBASE-25905 Shutdown of WAL stuck at waitForSafePoint Blocker regionserver, wal
HBASE-26450 Server configuration will overwrite HStore configuration after using shell command 'update_config' Minor Compaction, conf, regionserver
HBASE-26476 Make DefaultMemStore extensible for HStore.memstore Major regionserver
HBASE-26465 MemStoreLAB may be released early when its SegmentScanner is scanning Critical regionserver
HBASE-26467 Wrong Cell Generated by MemStoreLABImpl.forceCopyOfBigCellInto when Cell size bigger than data chunk size Critical in-memory-compaction
HBASE-26463 Unreadable table names after HBASE-24605 Trivial UI
HBASE-26438 Fix flaky test TestHStore.testCompactingMemStoreCellExceedInmemoryFlushSize Major test
HBASE-26311 Balancer gets stuck in cohosted replica distribution Major Balancer
HBASE-26384 Segment already flushed to hfile may still be remained in CompactingMemStore Major in-memory-compaction
HBASE-26410 Fix HBase TestCanaryTool for Java17 Major java
HBASE-26429 HeapMemoryManager fails memstore flushes with NPE if enabled Major Operability, regionserver
HBASE-25322 Redundant Reference file in bottom region of split Minor .
HBASE-26406 Can not add peer replicating to non-HBase Major Replication
HBASE-26404 Update javadoc for CellUtil#createCell with tags methods. Major .
HBASE-26398 CellCounter fails for large tables filling up local disk Minor mapreduce

TESTS:

JIRA Summary Priority Component
HBASE-26542 Apply a `package` to test protobuf files Minor Protobufs, test

SUB-TASKS:

JIRA Summary Priority Component
HBASE-24870 Ignore TestAsyncTableRSCrashPublish Major .
HBASE-26470 Use openlabtesting protoc on linux arm64 in HBASE 2.x Major build
HBASE-26327 Replicas cohosted on a rack shouldn't keep triggering Balancer Major Balancer
HBASE-26308 Sum of multiplier of cost functions is not populated properly when we have a shortcut for trigger Critical Balancer
HBASE-26319 Make flaky find job track more builds Major flakies, jenkins

OTHER:

JIRA Summary Priority Component
HBASE-26549 hbaseprotoc plugin should initialize maven Major jenkins
HBASE-26444 BucketCacheWriter should log only the BucketAllocatorException message, not the full stack trace Major logging, Operability
HBASE-26443 Some BaseLoadBalancer log lines should be at DEBUG level Major logging, Operability

Release 2.4.8 - 2021-11-05

NEW FEATURES:

JIRA Summary Priority Component
HBASE-26284 Add HBase Thrift API to get all table names along with whether it is enabled or not Major Thrift

IMPROVEMENTS:

JIRA Summary Priority Component
HBASE-25773 TestSnapshotScannerHDFSAclController.setupBeforeClass is flaky Major .

BUG FIXES:

JIRA Summary Priority Component
HBASE-26190 High rate logging of BucketAllocatorException: Allocation too big Major BucketCache, Operability
HBASE-26392 Update ClassSize.BYTE_BUFFER for JDK17 Major java, util
HBASE-26394 Cache in RSRpcServices.executeProcedures does not take effect Major .
HBASE-26385 Clear CellScanner when replay Major regionserver, rpc
HBASE-26383 HBCK incorrectly reports inconsistencies for recently split regions following a master failover Critical master
HBASE-26371 Prioritize meta region move over other region moves in region_mover Major .
HBASE-26364 TestThriftServer is failing 100% in our flaky test job Major test, Thrift
HBASE-26350 Missing server side debugging on failed SASL handshake Minor .
HBASE-26344 Fix Bug for MultiByteBuff.put(int, byte) Major .
HBASE-26312 Shell scan fails with timestamp Major shell, test

SUB-TASKS:

JIRA Summary Priority Component
HBASE-26390 Upload src tarball to nightlies for nightly jobs Major jenkins, scripts
HBASE-26382 Use gen_redirect_html for linking flaky test logs Major jenkins, scripts, test
HBASE-26362 Upload mvn site artifacts for nightly build to nightlies Major jenkins, scripts
HBASE-26360 Use gen_redirect_html for linking test logs Major jenkins, scripts
HBASE-26341 Upload dashboard html for flaky find job to nightlies Major flakies, jenkins, scripts
HBASE-26339 SshPublisher will skip uploading artifacts if the build is failure Major jenkins, scripts

OTHER:

JIRA Summary Priority Component
HBASE-26329 Upgrade commons-io to 2.11.0 Major dependencies
HBASE-26186 jenkins script for caching artifacts should verify cached file before relying on it Major build, integration tests

Release 2.4.7 - 2021-10-15

IMPROVEMENTS:

JIRA Summary Priority Component
HBASE-26270 Provide getConfiguration method for Region and Store interface Minor .
HBASE-26273 TableSnapshotInputFormat/TableSnapshotInputFormatImpl should use ReadType.STREAM for scanning HFiles Major mapreduce
HBASE-26276 Allow HashTable/SyncTable to perform rawScan when comparing cells Major .
HBASE-26255 Add an option to use region location from meta table in TableSnapshotInputFormat Major mapreduce
HBASE-26243 Fix typo for file 'hbase-server/src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.java' Trivial .

BUG FIXES:

JIRA Summary Priority Component
HBASE-26295 BucketCache could not free BucketEntry which restored from persistence file Major BucketCache
HBASE-26289 Hbase scan setMaxResultsPerColumnFamily not giving right results Major regionserver
HBASE-26238 OOME in VerifyReplication for the table contains rows with 10M+ cells Major Client, Replication
HBASE-26297 Balancer run is improperly triggered by accuracy error of double comparison Major Balancer
HBASE-26274 Create an option to reintroduce BlockCache to mapreduce job Major BlockCache, HFile, mapreduce
HBASE-26261 Store configuration loss when use update_config Minor .
HBASE-26281 DBB got from BucketCache would be freed unexpectedly before RPC completed Critical BucketCache
HBASE-26197 Fix some obvious bugs in MultiByteBuff.put Major .

TESTS:

JIRA Summary Priority Component
HBASE-26272 TestTableMapReduceUtil failure in branch-2 Major test

SUB-TASKS:

JIRA Summary Priority Component
HBASE-26317 Publish the test logs for pre commit jenkins job to nightlies Major jenkins, scripts
HBASE-26313 Publish the test logs for our nightly jobs to nightlies.apache.org Major jenkins, scripts
HBASE-26318 Publish test logs for flaky jobs to nightlies Major flakies, jenkins

Release 2.4.6 - 2021-09-10

NEW FEATURES:

JIRA Summary Priority Component
HBASE-6908 Pluggable Call BlockingQueue for HBaseServer Major IPC/RPC

IMPROVEMENTS:

JIRA Summary Priority Component
HBASE-25642 Fix or stop warning about already cached block Major BlockCache, Operability, regionserver
HBASE-24652 master-status UI make date type fields sortable Minor master, Operability, UI, Usability
HBASE-25680 Non-idempotent test in TestReplicationHFileCleaner Minor test
HBASE-26179 TestRequestTooBigException spends too much time to finish Major test
HBASE-26160 Configurable disallowlist for live editing of loglevels Minor .
HBASE-25469 Add detailed RIT info in JSON format for consumption as metrics Minor master
HBASE-26154 Provide exception metric for quota exceeded and throttling Minor .
HBASE-26105 Rectify the expired TODO comment in CombinedBC Trivial BlockCache
HBASE-26146 Allow custom opts for hbck in hbase bin Minor .

BUG FIXES:

JIRA Summary Priority Component
HBASE-26106 AbstractFSWALProvider#getArchivedLogPath doesn't look for wal file in all oldWALs directory. Critical wal
HBASE-26205 TableMRUtil#initCredentialsForCluster should use specified conf for UserProvider Major mapreduce
HBASE-26210 HBase Write should be doomed to hang when cell size exceeds InmemoryFlushSize for CompactingMemStore Critical in-memory-compaction
HBASE-26244 Avoid trim the error stack trace when running UT with maven Major .
HBASE-25588 Excessive logging of "hbase.zookeeper.useMulti is deprecated. Default to true always." Minor logging, Operability, Replication
HBASE-26232 SEEK_NEXT_USING_HINT is ignored on reversed Scans Critical Filters, scan
HBASE-26204 VerifyReplication should obtain token for peerQuorumAddress too Major .
HBASE-26219 Negative time is logged while waiting on regionservers Trivial .
HBASE-26087 JVM crash when displaying RPC params by MonitoredRPCHandler Major UI
HBASE-24570 connection#close throws NPE Minor Client
HBASE-26200 Undo 'HBASE-25165 Change 'State time' in UI so sorts (#2508)' in favor of HBASE-24652 Major UI
HBASE-26196 Support configuration override for remote cluster of HFileOutputFormat locality sensitive Major mapreduce
HBASE-26026 HBase Write may be stuck forever when using CompactingMemStore Critical in-memory-compaction
HBASE-26155 JVM crash when scan Major Scanners
HBASE-26176 Correct regex in hbase-personality.sh Minor build
HBASE-26170 handleTooBigRequest in NettyRpcServer didn't skip enough bytes Major .
HBASE-26142 NullPointerException when set 'hbase.hregion.memstore.mslab.indexchunksize.percent' to zero Critical .
HBASE-26166 table list in master ui has a minor bug Minor UI

TESTS:

JIRA Summary Priority Component
HBASE-26185 Fix TestMaster#testMoveRegionWhenNotInitialized with hbase.min.version.move.system.tables Minor .

SUB-TASKS:

JIRA Summary Priority Component
HBASE-26189 Reduce log level of CompactionProgress notice to DEBUG Minor Compaction
HBASE-26227 Forward port HBASE-26223 test code to branch-2.4+ Major test

OTHER:

JIRA Summary Priority Component
HBASE-26152 Exclude javax.servlet:servlet-api in hbase-shaded-testing-util Major .

Release 2.4.5 - 2021-07-31

IMPROVEMENTS:

JIRA Summary Priority Component
HBASE-26108 add option to disable scanMetrics in TableSnapshotInputFormat Major .
HBASE-26025 Add a flag to mark if the IOError can be solved by retry in thrift IOError Major Thrift
HBASE-25986 Expose the NORMALIZARION_ENABLED table descriptor through a property in hbase-site Minor Normalizer
HBASE-26012 Improve logging and dequeue logic in DelayQueue Minor .
HBASE-26020 Split TestWALEntryStream.testDifferentCounts out Major Replication, test
HBASE-25937 Clarify UnknownRegionException Minor Client
HBASE-25998 Revisit synchronization in SyncFuture Major Performance, regionserver, wal
HBASE-26000 Optimize the display of ZK dump in the master web UI Minor .
HBASE-25995 Change the method name for DoubleArrayCost.setCosts Major Balancer
HBASE-26002 MultiRowMutationEndpoint should return the result of the conditional update Major Coprocessors
HBASE-25993 Make excluded SSL cipher suites configurable for all Web UIs Major .
HBASE-25987 Make SSL keystore type configurable for HBase ThriftServer Major Thrift

BUG FIXES:

JIRA Summary Priority Component
HBASE-26120 New replication gets stuck or data loss when multiwal groups more than 10 Critical Replication
HBASE-26001 When turn on access control, the cell level TTL of Increment and Append operations is invalid. Minor Coprocessors
HBASE-24984 WAL corruption due to early DBBs re-use when Durability.ASYNC_WAL is used with multi operation Critical rpc, wal
HBASE-26088 conn.getBufferedMutator(tableName) leaks thread executors and other problems Critical Client
HBASE-25973 Balancer should explain progress in a better way in log Major Balancer
HBASE-26083 L1 miss metric is incorrect when using CombinedBlockCache Minor BlockCache
HBASE-26086 TestHRegionReplayEvents do not pass in branch-2 and throws NullPointerException Minor .
HBASE-26036 DBB released too early and dirty data for some operations Critical rpc
HBASE-26068 The last assertion in TestHStore.testRefreshStoreFilesNotChanged is wrong Major test
HBASE-22923 hbase:meta is assigned to localhost when we downgrade the hbase version Major .
HBASE-26030 hbase-cleanup.sh did not clean the wal dir if hbase.wal.dir configured individually Major scripts
HBASE-26035 Redundant null check in the compareTo function Minor metrics, Performance
HBASE-25902 Add missing CFs in meta during HBase 1 to 2.3+ Upgrade Critical meta, Operability
HBASE-26028 The view as json page shows exception when using TinyLfuBlockCache Major UI
HBASE-26039 TestReplicationKillRS is useless after HBASE-23956 Major Replication, test
HBASE-25980 Master table.jsp pointed at meta throws 500 when no all replicas are online Major master, meta replicas, UI
HBASE-26013 Get operations readRows metrics becomes zero after HBASE-25677 Minor metrics
HBASE-25877 Add access check for compactionSwitch Major security
HBASE-25698 Persistent IllegalReferenceCountException at scanner open when using TinyLfuBlockCache Major BucketCache, HFile, Scanners
HBASE-25984 FSHLog WAL lockup with sync future reuse [RS deadlock] Critical regionserver, wal
HBASE-25997 NettyRpcFrameDecoder decode request header wrong when handleTooBigRequest Major rpc
HBASE-25967 The readRequestsCount does not calculate when the outResults is empty Major metrics
HBASE-25981 JVM crash when displaying regionserver UI Major rpc, UI

SUB-TASKS:

JIRA Summary Priority Component
HBASE-26093 Replication is stuck due to zero length wal file in oldWALs directory [master/branch-2] Major .
HBASE-24734 RegionInfo#containsRange should support check meta table Major HFile, MTTR
HBASE-25739 TableSkewCostFunction need to use aggregated deviation Major Balancer, master
HBASE-25992 Polish the ReplicationSourceWALReader code for 2.x after HBASE-25596 Major Replication
HBASE-25989 FanOutOneBlockAsyncDFSOutput using shaded protobuf in hdfs 3.3+ Major .
HBASE-25947 Backport 'HBASE-25894 Improve the performance for region load and region count related cost functions' to branch-2.4 and branch-2.3 Major Balancer, Performance
HBASE-25969 Cleanup netty-all transitive includes Major .

OTHER:

JIRA Summary Priority Component
HBASE-25934 Add username for RegionScannerHolder Minor .
HBASE-26123 Restore fields dropped by HBASE-25986 to public interfaces Major .
HBASE-25521 Change ChoreService and ScheduledChore to IA.Private Major util
HBASE-26015 Should implement getRegionServers(boolean) method in AsyncAdmin Major Admin, Client
HBASE-25918 Upgrade hbase-thirdparty dependency to 3.5.1 Critical dependencies

Release 2.4.4 - 2021-06-14

IMPROVEMENTS:

JIRA Summary Priority Component
HBASE-25666 Explain why balancer is skipping runs Major Balancer, master, UI
HBASE-25942 Get rid of null regioninfo in wrapped connection exceptions Trivial logging
HBASE-25908 Exclude jakarta.activation-api Major hadoop3, shading
HBASE-25933 Log trace raw exception, instead of cause message in NettyRpcServerRequestDecoder Minor .
HBASE-25906 UI of master-status to show recent history of balancer desicion Major Balancer, master, UI

BUG FIXES:

JIRA Summary Priority Component
HBASE-25930 Thrift does not support requests in Kerberos environment Major Thrift
HBASE-25929 RegionServer JVM crash when compaction Critical Compaction
HBASE-25924 Seeing a spike in uncleanlyClosedWALs metric. Major Replication, wal
HBASE-25932 TestWALEntryStream#testCleanClosedWALs test is failing. Major metrics, Replication, wal
HBASE-25903 ReadOnlyZKClient APIs - CompletableFuture.get() calls can cause threads to hang forver when ZK client create throws Non IOException Major .
HBASE-25927 Fix the log messages by not stringifying the exceptions in log Minor logging
HBASE-25938 The SnapshotOfRegionAssignmentFromMeta.initialize call in FavoredNodeLoadBalancer is just a dummy one Major Balancer, FavoredNodes
HBASE-25898 RS getting aborted due to NPE in Replication WALEntryStream Critical Replication
HBASE-25875 RegionServer failed to start due to IllegalThreadStateException in AuthenticationTokenSecretManager.start Major .
HBASE-25892 'False' should be 'True' in auditlog of listLabels Major logging, security
HBASE-25817 Memory leak from thrift server hashMap Minor Thrift
HBASE-25848 Add flexibility to backup replication in case replication filter throws an exception Major .
HBASE-25827 Per Cell TTL tags get duplicated with increments causing tags length overflow Critical regionserver

TESTS:

JIRA Summary Priority Component
HBASE-25910 Fix TestClusterPortAssignment.testClusterPortAssignment test and re-enable it. Minor flakies, test

SUB-TASKS:

JIRA Summary Priority Component
HBASE-25963 HBaseCluster should be marked as IA.Public Major API
HBASE-25941 TestRESTServerSSL fails because of jdk bug Major test
HBASE-25940 Update Compression/TestCompressionTest: LZ4, SNAPPY, LZO Major .
HBASE-25791 UI of master-status to show a recent history of that why balancer was rejected to run Major Balancer, master, UI

Release 2.4.3 - 2021-05-21

NEW FEATURES:

JIRA Summary Priority Component
HBASE-25751 Add writable TimeToPurgeDeletes to ScanOptions Major .
HBASE-25587 [hbck2] Schedule SCP for all unknown servers Major hbase-operator-tools, hbck2

IMPROVEMENTS:

JIRA Summary Priority Component
HBASE-25860 Add metric for successful wal roll requests. Major metrics, wal
HBASE-25754 StripeCompactionPolicy should support compacting cold regions Minor Compaction
HBASE-25766 Introduce RegionSplitRestriction that restricts the pattern of the split point Major .
HBASE-25798 typo in MetricsAssertHelper Minor .
HBASE-25770 Http InfoServers should honor gzip encoding when requested Major UI
HBASE-25776 Use Class.asSubclass to fix the warning in StochasticLoadBalancer.loadCustomCostFunctions Minor Balancer
HBASE-25767 CandidateGenerator.getRandomIterationOrder is too slow on large cluster Major Balancer, Performance
HBASE-25762 Improvement for some debug-logging guards Minor logging, Performance
HBASE-25653 Add units and round off region size to 2 digits after decimal Major master, Normalizer
HBASE-25759 The master services field in LocalityBasedCostFunction is never used Major Balancer
HBASE-25747 Remove unused getWriteAvailable method in OperationQuota Minor Quotas
HBASE-25558 Adding audit log for execMasterService Major .
HBASE-25703 Support conditional update in MultiRowMutationEndpoint Major Coprocessors
HBASE-25627 HBase replication should have a metric to represent if the source is stuck getting initialized Major Replication
HBASE-25688 Use CustomRequestLog instead of Slf4jRequestLog for jetty Major logging, UI
HBASE-25678 Support nonce operations for Increment/Append in RowMutations and CheckAndMutate Major .
HBASE-25679 Size of log queue metric is incorrect in branch-1/branch-2 Major .
HBASE-25518 Support separate child regions to different region servers Major .
HBASE-25621 Balancer should check region plan source to avoid misplace region groups Major Balancer
HBASE-25374 Make REST Client connection and socket time out configurable Minor REST
HBASE-25597 Add row info in Exception when cell size exceeds maxCellSize Minor .
HBASE-25660 Print split policy in use on Region open (as well as split policy vitals) Trivial .
HBASE-25635 CandidateGenerator may miss some region balance actions Major Balancer
HBASE-25636 Expose HBCK report as metrics Minor metrics
HBASE-25548 Optionally allow snapshots to preserve cluster's max filesize config by setting it into table descriptor Major .

BUG FIXES:

JIRA Summary Priority Component
HBASE-25867 Extra doc around ITBLL Minor documentation
HBASE-25859 Reference class incorrectly parses the protobuf magic marker Minor regionserver
HBASE-25774 ServerManager.getOnlineServer may miss some region servers when refreshing state in some procedure implementations Critical Replication
HBASE-25825 RSGroupBasedLoadBalancer.onConfigurationChange should chain the request to internal balancer Major Balancer
HBASE-25792 Filter out o.a.hadoop.thirdparty building shaded jars Major shading
HBASE-25806 Backport the region location finder initialization fix in HBASE-25802 Major Balancer
HBASE-25735 Add target Region to connection exceptions Major rpc
HBASE-25717 RegionServer aborted due to ClassCastException Major .
HBASE-25743 Retry REQUESTTIMEOUT KeeperExceptions from ZK Major Zookeeper
HBASE-25726 MoveCostFunction is not included in the list of cost functions for StochasticLoadBalancer Major Balancer
HBASE-25692 Failure to instantiate WALCellCodec leaks socket in replication Major Replication
HBASE-25568 Upgrade Thrift jar to fix CVE-2020-13949 Critical Thrift
HBASE-25562 ReplicationSourceWALReader log and handle exception immediately without retrying Major Replication
HBASE-25693 NPE getting metrics from standby masters (MetricsMasterWrapperImpl.getMergePlanCount) Major master
HBASE-25685 asyncprofiler2.0 no longer supports svg; wants html Major .
HBASE-25594 graceful_stop.sh fails to unload regions when ran at localhost Minor .
HBASE-25674 RegionInfo.parseFrom(DataInputStream) sometimes fails to read the protobuf magic marker Minor Client
HBASE-25595 TestLruBlockCache.testBackgroundEvictionThread is flaky Major .
HBASE-25662 Fix spotbugs warning in RoundRobinTableInputFormat Major findbugs
HBASE-25657 Fix spotbugs warnings after upgrading spotbugs to 4.x Major findbugs
HBASE-25646 Possible Resource Leak in CatalogJanitor Major master

TESTS:

JIRA Summary Priority Component
HBASE-25691 Test failure: TestVerifyBucketCacheFile.testRetrieveFromFile Major test

SUB-TASKS:

JIRA Summary Priority Component
HBASE-25876 Add retry if we fail to read all bytes of the protobuf magic marker Trivial io
HBASE-25790 NamedQueue 'BalancerRejection' for recent history of balancer skipping Major Balancer, master
HBASE-25854 Remove redundant AM in-memory state changes in CatalogJanitor Major .
HBASE-25847 More DEBUG and TRACE level logging in CatalogJanitor and HbckChore Minor .
HBASE-25838 Use double instead of Double in StochasticLoadBalancer Major Balancer, Performance
HBASE-25835 Ignore duplicate split requests from regionserver reports Major .
HBASE-25836 RegionStates#getAssignmentsForBalancer should only care about OPEN or OPENING regions Major .
HBASE-25840 CatalogJanitor warns about skipping gc of regions during RIT, but does not actually skip Minor .
HBASE-25775 Use a special balancer to deal with maintenance mode Major Balancer
HBASE-25199 Remove HStore#getStoreHomedir Minor .
HBASE-25696 Need to initialize SLF4JBridgeHandler in jul-to-slf4j for redirecting jul to slf4j Major logging
HBASE-25695 Link to the filter on hbase:meta from user tables panel on master page Major UI
HBASE-25629 Reimplement TestCurrentHourProvider to not depend on unstable TZs Major test
HBASE-25671 Backport HBASE-25608 to branch-2 Major .
HBASE-25677 Server+table counters on each scan #nextRaw invocation becomes a bottleneck when heavy load Major metrics
HBASE-25667 Remove RSGroup test addition made in parent; depends on functionality not in old branches Major .

OTHER:

JIRA Summary Priority Component
HBASE-25884 NPE while getting Balancer decisions Major .
HBASE-25755 Exclude tomcat-embed-core from libthrift Critical dependencies, Thrift
HBASE-25750 Upgrade RpcControllerFactory and HBaseRpcController from Private to LimitedPrivate(COPROC,PHOENIX) Major Coprocessors, phoenix, rpc
HBASE-25734 Backport HBASE-24305 to branch-2.4 Minor .
HBASE-25604 Upgrade spotbugs to 4.x Major build, findbugs
HBASE-24305 Handle deprecations in ServerName Minor .

Release 2.4.2 - Unreleased (as of 2021-03-08)

NEW FEATURES:

JIRA Summary Priority Component
HBASE-25460 Expose drainingServers as cluster metric Major metrics
HBASE-25496 add get_namespace_rsgroup command Major .

IMPROVEMENTS:

JIRA Summary Priority Component
HBASE-23578 [UI] Master UI shows long stack traces when table is broken Minor master, UI
HBASE-25492 Create table with rsgroup info in branch-2 Major rsgroup
HBASE-25539 Add metric for age of oldest wal. Major metrics, regionserver
HBASE-25574 Revisit put/delete/increment/append related RegionObserver methods Major Coprocessors
HBASE-25541 In WALEntryStream, set the current path to null while dequeing the log Major .
HBASE-23887 New L1 cache : AdaptiveLRU Major BlockCache, Performance
HBASE-25534 Honor TableDescriptor settings earlier in normalization Major Normalizer
HBASE-25507 Leak of ESTABLISHED sockets when compaction encountered "java.io.IOException: Invalid HFile block magic" Major Compaction
HBASE-25542 Add client detail to scan name so when lease expires, we have clue on who was scanning Major scan
HBASE-25528 Dedicated merge dispatch threadpool on master Minor master
HBASE-25536 Remove 0 length wal file from logQueue if it belongs to old sources. Major Replication
HBASE-25482 Improve SimpleRegionNormalizer#getAverageRegionSizeMb Minor Normalizer

BUG FIXES:

JIRA Summary Priority Component
HBASE-25626 Possible Resource Leak in HeterogeneousRegionCountCostFunction Major .
HBASE-25644 Scan#setSmall blindly sets ReadType as PREAD Critical .
HBASE-25609 There is a problem with the SPLITS_FILE in the HBase shell statement Minor .
HBASE-25385 TestCurrentHourProvider fails if the latest timezone changes are not present Blocker .
HBASE-25596 Fix NPE in ReplicationSourceManager as well as avoid permanently unreplicated data due to EOFException from WAL Critical .
HBASE-25367 Sort broken after Change 'State time' in UI Major UI
HBASE-25421 There is no limit on the column family length when creating a table Major Client
HBASE-25371 When openRegion fails during initial verification(before initializing and setting seq num), exception is observed during region close. Major Region Assignment
HBASE-25611 ExportSnapshot chmod flag uses value as decimal Major .
HBASE-25586 Fix HBASE-22492 on branch-2 (SASL GapToken) Major rpc
HBASE-25598 TestFromClientSide5.testScanMetrics is flaky Major .
HBASE-25556 Frequent replication "Encountered a malformed edit" warnings Minor Operability, Replication
HBASE-25575 Should validate Puts in RowMutations Minor Client
HBASE-25559 Terminate threads of oldsources while RS is closing Major .
HBASE-25543 When configuration "hadoop.security.authorization" is set to false, the system will still try to authorize an RPC and raise AccessDeniedException Minor IPC/RPC
HBASE-25554 NPE when init RegionMover Major .
HBASE-25523 Region normalizer chore thread is getting killed Major Normalizer
HBASE-25533 The metadata of the table and family should not be an empty string Major .
HBASE-25478 Implement retries when enabling tables in TestRegionReplicaReplicationEndpoint Minor .
HBASE-25513 When the table is turned on normalize, the first region may not be merged even the size is 0 Major Normalizer
HBASE-25497 move_namespaces_rsgroup should change hbase.rsgroup.name config in NamespaceDescriptor Major .

SUB-TASKS:

JIRA Summary Priority Component
HBASE-24900 Make retain assignment configurable during SCP Major amv2
HBASE-25509 ChoreService.cancelChore will not call ScheduledChore.cleanup which may lead to resource leak Major util

OTHER:

JIRA Summary Priority Component
HBASE-25553 It is better for ReplicationTracker.getListOfRegionServers to return ServerName instead of String Major .
HBASE-25620 Increase timeout value for pre commit Major build, test
HBASE-25615 Upgrade java version in pre commit docker file Major build
HBASE-25601 Remove search hadoop references in book Major documentation

Release 2.4.1 - 2021-01-18

NEW FEATURES:

JIRA Summary Priority Component
HBASE-24620 Add a ClusterManager which submits command to ZooKeeper and its Agent which picks and execute those Commands. Major integration tests

IMPROVEMENTS:

JIRA Summary Priority Component
HBASE-25329 Dump region hashes in logs for the regions that are stuck in transition for more than a configured amount of time Minor .
HBASE-25475 Improve unit test for HBASE-25445 : SplitWALRemoteProcedure failed to archive split WAL Minor wal
HBASE-25249 Adding StoreContext Major .
HBASE-25449 'dfs.client.read.shortcircuit' should not be set in hbase-default.xml Major conf
HBASE-25476 Enable error prone check in pre commit Major build
HBASE-25211 Rack awareness in region_mover Major .
HBASE-25483 set the loadMeta log level to debug. Major MTTR, Region Assignment
HBASE-25435 Slow metric value can be configured Minor metrics
HBASE-25318 Configure where IntegrationTestImportTsv generates HFiles Minor integration tests
HBASE-24850 CellComparator perf improvement Critical Performance, scan
HBASE-25425 Some notes on RawCell Trivial .
HBASE-25420 Some minor improvements in rpc implementation Minor rpc
HBASE-25246 Backup/Restore hbase cell tags. Major backup&restore
HBASE-25328 Add builder method to create Tags. Minor .

BUG FIXES:

JIRA Summary Priority Component
HBASE-25356 HBaseAdmin#getRegion() needs to filter out non-regionName and non-encodedRegionName Major shell
HBASE-25279 Non-daemon thread in ZKWatcher Critical Zookeeper
HBASE-25504 [branch-2.4] Restore method removed by HBASE-25277 to LP(CONFIG) coprocessors Major compatibility, Coprocessors, security
HBASE-25503 HBase code download is failing on windows with invalid path error Major .
HBASE-24813 ReplicationSource should clear buffer usage on ReplicationSourceManager upon termination Major Replication
HBASE-25459 WAL can't be cleaned in some scenes Major .
HBASE-25434 SlowDelete & SlowPut metric value should use updateDelete & updatePut Major regionserver
HBASE-25441 add security check for some APIs in RSRpcServices Critical .
HBASE-25432 we should add security checks for setTableStateInMeta and fixMeta Blocker .
HBASE-25445 Old WALs archive fails in procedure based WAL split Critical wal
HBASE-25287 Forgetting to unbuffer streams results in many CLOSE_WAIT sockets when loading files Major .
HBASE-25447 remoteProc is suspended due to OOM ERROR Major proc-v2
HBASE-24755 [LOG][RSGroup]Error message is confusing while adding a offline RS to rsgroup Major rsgroup
HBASE-25463 Fix comment error Minor shell
HBASE-25457 Possible race in AsyncConnectionImpl between getChoreService and close Major Client
HBASE-25456 setRegionStateInMeta need security check Critical .
HBASE-25383 HBase doesn't update and remove the peer config from hbase.replication.source.custom.walentryfilters if the config is already set on the peer. Major .
HBASE-25404 Procedures table Id under master web UI gets word break to single character Minor UI
HBASE-25277 postScannerFilterRow impacts Scan performance a lot in HBase 2.x Critical Coprocessors, scan
HBASE-25365 The log in move_servers_rsgroup is incorrect Minor .
HBASE-25372 Fix typo in ban-jersey section of the enforcer plugin in pom.xml Major build
HBASE-25361 [Flakey Tests] branch-2 TestMetaRegionLocationCache.testStandByMetaLocations Major flakies

TESTS:

JIRA Summary Priority Component
HBASE-25502 IntegrationTestMTTR fails with TableNotFoundException Major integration tests
HBASE-25334 TestRSGroupsFallback.testFallback is flaky Major .
HBASE-25370 Fix flaky test TestClassFinder#testClassFinderDefaultsToOwnPackage Major test

SUB-TASKS:

JIRA Summary Priority Component
HBASE-25293 Followup jira to address the client handling issue when chaning from meta replica to non-meta-replica at the server side. Minor .
HBASE-25353 [Flakey Tests] branch-2 TestShutdownBackupMaster Major flakies

OTHER:

JIRA Summary Priority Component
HBASE-25333 Add maven enforcer rule to ban VisibleForTesting imports Major build, pom
HBASE-25452 Use MatcherAssert.assertThat instead of org.junit.Assert.assertThat Major test
HBASE-25400 [Flakey Tests] branch-2 TestRegionMoveAndAbandon Major .
HBASE-25389 [Flakey Tests] branch-2 TestMetaShutdownHandler Major flakies

Release 2.4.0 - Unreleased (as of 2020-12-03)

NEW FEATURES:

JIRA Summary Priority Component
HBASE-25242 Add Increment/Append support to RowMutations Critical Client, regionserver
HBASE-25278 Add option to toggle CACHE_BLOCKS in count.rb Minor shell
HBASE-18070 Enable memstore replication for meta replica Critical .
HBASE-24528 Improve balancer decision observability Major Admin, Balancer, Operability, shell, UI
HBASE-24776 [hbtop] Support Batch mode Major hbtop
HBASE-24602 Add Increment and Append support to CheckAndMutate Major .
HBASE-24760 Add a config hbase.rsgroup.fallback.enable for RSGroup fallback feature Major rsgroup
HBASE-24694 Support flush a single column family of table Major .
HBASE-24289 Heterogeneous Storage for Date Tiered Compaction Major Compaction
HBASE-24038 Add a metric to show the locality of ssd in table.jsp Major metrics
HBASE-8458 Support for batch version of checkAndMutate() Major Client, regionserver

IMPROVEMENTS:

JIRA Summary Priority Component
HBASE-25339 Method parameter and member variable are duplicated in checkSplittable() of SplitTableRegionProcedure Minor .
HBASE-25237 'hbase master stop' shuts down the cluster, not the master only Major .
HBASE-25324 Remove unnecessary array to list conversion in SplitLogManager Minor .
HBASE-25263 Change encryption key generation algorithm used in the HBase shell Major encryption, shell
HBASE-25323 Fix potential NPE when the zookeeper path of RegionServerTracker does not exist when start Minor .
HBASE-25281 Bulkload split hfile too many times due to unreasonable split point Minor tooling
HBASE-25325 Remove unused class ClusterSchemaException Minor .
HBASE-25213 Should request Compaction when bulkLoadHFiles is done Minor .
HBASE-24877 Add option to avoid aborting RS process upon uncaught exceptions happen on replication source Major Replication
HBASE-24664 Some changing of split region by overall region size rather than only one store size Major regionserver
HBASE-25026 Create a metric to track full region scans RPCs Minor .
HBASE-25289 [testing] Clean up resources after tests in rsgroup_shell_test.rb Major rsgroup, test
HBASE-25261 Upgrade Bootstrap to 3.4.1 Major security, UI
HBASE-25272 Support scan on a specific replica Critical Client, scan
HBASE-25267 Add SSL keystore type and truststore related configs for HBase RESTServer Major REST
HBASE-25181 Add options for disabling column family encryption and choosing hash algorithm for wrapped encryption keys. Major encryption
HBASE-25254 Rewrite TestMultiLogThreshold to remove the LogDelegate in RSRpcServices Major logging, test
HBASE-25252 Move HMaster inner classes out Minor master
HBASE-25240 gson format of RpcServer.logResponse is abnormal Minor .
HBASE-25210 RegionInfo.isOffline is now a duplication with RegionInfo.isSplit Major meta
HBASE-25212 Optionally abort requests in progress after deciding a region should close Major regionserver
HBASE-24859 Optimize in-memory representation of mapreduce TableSplit objects Major mapreduce
HBASE-24967 The table.jsp cost long time to load if the table include closed regions Major UI
HBASE-25167 Normalizer support for hot config reloading Major master, Normalizer
HBASE-24419 Normalizer merge plans should consider more than 2 regions when possible Major master, Normalizer
HBASE-25224 Maximize sleep for checking meta and namespace regions availability Major master
HBASE-25223 Use try-with-resources statement in snapshot package Minor .
HBASE-25201 YouAreDeadException should be moved to hbase-server module Major Client
HBASE-25193 Add support for row prefix and type in the WAL Pretty Printer and some minor fixes Minor wal
HBASE-25128 RSGroupInfo's toString() and hashCode() does not take into account configuration map. Minor rsgroup
HBASE-24628 Region normalizer now respects a rate limit Major Normalizer
HBASE-25179 Assert format is incorrect in HFilePerformanceEvaluation class. Minor Performance, test
HBASE-25065 WAL archival to be done by a separate thread Major wal
HBASE-14067 bundle ruby files for hbase shell into a jar. Major shell
HBASE-24875 Remove the force param for unassign since it dose not take effect any more Major Client
HBASE-24025 Improve performance of move_servers_rsgroup and move_tables_rsgroup by using async region move API Major rsgroup
HBASE-25160 Refactor AccessController and VisibilityController Major .
HBASE-25146 Add extra logging at info level to HFileCorruptionChecker in order to report progress Major hbck, hbck2
HBASE-24054 The Jetty's version number leak occurred while using the thrift service Minor .
HBASE-25091 Move LogComparator from ReplicationSource to AbstractFSWALProvider#.WALsStartTimeComparator Minor .
HBASE-24981 Enable table replication fails from 1.x to 2.x if table already exist at peer. Major Replication
HBASE-25109 Add MR Counters to WALPlayer; currently hard to tell if it is doing anything Major .
HBASE-25082 Per table WAL metrics: appendCount and appendSize Major metrics
HBASE-25079 Upgrade Bootstrap to 3.3.7 Major security, UI
HBASE-24976 REST Server failes to start without any error message Major REST
HBASE-25066 Use FutureUtils.rethrow in AsyncTableResultScanner to better catch the stack trace Major Client, Scanners
HBASE-25069 Display region name instead of encoded region name in HBCK report page. Minor hbck
HBASE-24991 Replace MovedRegionsCleaner with guava cache Minor .
HBASE-25057 Fix typo "memeber" Trivial documentation
HBASE-24764 Add support of adding base peer configs via hbase-site.xml for all replication peers. Minor Replication
HBASE-25037 Lots of thread pool are changed to non daemon after HBASE-24750 which causes trouble when shutting down Major .
HBASE-24831 Avoid invoke Counter using reflection in SnapshotInputFormat Major .
HBASE-25002 Create simple pattern matching query for retrieving metrics matching the pattern Major .
HBASE-25022 Remove 'hbase.testing.nocluster' config Major test
HBASE-25006 Make the cost functions optional for StochastoicBalancer Major .
HBASE-24974 Provide a flexibility to print only row key and filter for multiple tables in the WALPrettyPrinter Minor wal
HBASE-24994 Add hedgedReadOpsInCurThread metric Minor metrics
HBASE-25005 Refactor CatalogJanitor Major master, meta
HBASE-24992 log after Generator success when running ITBLL Trivial .
HBASE-24937 table.rb use LocalDateTime to replace Instant Minor shell
HBASE-24940 runCatalogJanitor() API should return -1 to indicate already running status Major .
HBASE-24973 Remove read point parameter in method StoreFlush#performFlush and StoreFlush#createScanner Minor .
HBASE-24569 Get hostAndWeights in addition using localhost if it is null in local mode Minor regionserver
HBASE-24949 Optimize FSTableDescriptors.get to not always go to fs when cache miss Major master
HBASE-24898 Use EnvironmentEdge.currentTime() instead of System.currentTimeMillis() in CurrentHourProvider Major tooling
HBASE-24942 MergeTableRegionsProcedure should not call clean merge region Major proc-v2, Region Assignment
HBASE-24811 Use class access static field or method Minor .
HBASE-24686 [LOG] Log improvement in Connection#close Major Client, logging
HBASE-24912 Enlarge MemstoreFlusherChore/CompactionChecker period for unit test Major .
HBASE-24627 Normalize one table at a time Major Normalizer
HBASE-24872 refactor valueOf PoolType Minor Client
HBASE-24854 Correct the help content of assign and unassign commands in hbase shell Minor shell
HBASE-24750 All executor service should start using guava ThreadFactory Major .
HBASE-24709 Support MoveCostFunction use a lower multiplier in offpeak hours Major Balancer
HBASE-24824 Add more stats in PE for read replica Minor PE, read replicas
HBASE-21721 FSHLog : reduce write#syncs() times Major .
HBASE-24404 Support flush a single column family of region Major shell
HBASE-24826 Add some comments for processlist in hbase shell Minor shell
HBASE-24659 Calculate FIXED_OVERHEAD automatically Major .
HBASE-24827 BackPort HBASE-11554 Remove Reusable poolmap Rpc client type. Major Client
HBASE-24823 Port HBASE-22762 Print the delta between phases in the split/merge/compact/flush transaction journals to master branch Minor .
HBASE-24795 RegionMover should deal with unknown (split/merged) regions Major .
HBASE-24821 Simplify the logic of getRegionInfo in TestFlushFromClient to reduce redundancy code Minor test
HBASE-24704 Make the Table Schema easier to view even there are multiple families Major UI
HBASE-24695 FSHLog - close the current WAL file in a background thread Major .
HBASE-24803 Unify hbase-shell ::Shell::Commands::Command#help behavior Minor shell
HBASE-11686 Shell code should create a binding / irb workspace instead of polluting the root namespace Minor shell
HBASE-20226 Performance Improvement Taking Large Snapshots In Remote Filesystems Minor snapshots
HBASE-24669 Logging of ppid should be consistent across all occurrences Minor Operability, proc-v2
HBASE-24757 ReplicationSink should limit the batch rowcount for batch mutations based on hbase.rpc.rows.warning.threshold Major .
HBASE-24777 InfoServer support ipv6 host and port Minor UI
HBASE-24758 Avoid flooding replication source RSes logs when no sinks are available Major Replication
HBASE-24743 Reject to add a peer which replicate to itself earlier Major .
HBASE-24696 Include JVM information on Web UI under "Software Attributes" Minor UI
HBASE-24747 Log an ERROR if HBaseSaslRpcServer initialisation fails with an uncaught exception Major .
HBASE-24586 Add table level locality in table.jsp Major UI
HBASE-24663 Add procedure process time statistics UI Major .
HBASE-24653 Show snapshot owner on Master WebUI Major .
HBASE-24431 RSGroupInfo add configuration map to store something extra Major rsgroup
HBASE-24671 Add excludefile and designatedfile options to graceful_stop.sh Major .
HBASE-24560 Add a new option of designatedfile in RegionMover Major .
HBASE-24382 Flush partial stores of region filtered by seqId when archive wal due to too many wals Major wal
HBASE-24208 Remove RS entry from zk draining servers node after RS been stopped Major .
HBASE-24456 Immutable Scan as unmodifiable subclass or wrapper of Scan Major .
HBASE-24471 The way we bootstrap meta table is confusing Major master, meta, proc-v2
HBASE-24350 HBase table level replication metrics for shippedBytes are always 0 Major Replication
HBASE-24311 Add more details in MultiVersionConcurrencyControl STUCK log message Major .

BUG FIXES:

JIRA Summary Priority Component
HBASE-25355 [Documentation] Fix spelling error Trivial documentation
HBASE-25230 Embedded zookeeper server not clean up the old data Minor Zookeeper
HBASE-25349 [Flakey Tests] branch-2 TestRefreshRecoveredReplication.testReplicationRefreshSource:141 Waiting timed out after [60,000] msec Major flakies
HBASE-25332 one NPE Major Zookeeper
HBASE-25345 [Flakey Tests] branch-2 TestReadReplicas#testVerifySecondaryAbilityToReadWithOnFiles Major test
HBASE-25307 ThreadLocal pooling leads to NullPointerException Major Client
HBASE-25341 Fix ErrorProne error which causes nightly to fail Major test
HBASE-25330 RSGroupInfoManagerImpl#moveServers return is not set of servers moved Major rsgroup
HBASE-25321 The sort icons not shown after Upgrade JQuery to 3.5.1 Major UI
HBASE-24268 REST and Thrift server do not handle the "doAs" parameter case insensitively Minor REST, Thrift
HBASE-25050 We initialize Filesystems more than once. Minor .
HBASE-25311 ui throws NPE Major .
HBASE-25306 The log in SimpleLoadBalancer#onConfigurationChange is wrong Major .
HBASE-25300 'Unknown table hbase:quota' happens when desc table in shell if quota disabled Major shell
HBASE-25255 Master fails to initialize when creating rs group table Critical master, rsgroup
HBASE-25275 Upgrade asciidoctor Blocker website
HBASE-25276 Need to throw the original exception in HRegion#openHRegion Major .
HBASE-20598 Upgrade to JRuby 9.2 Major dependencies, shell
HBASE-25216 The client zk syncer should deal with meta replica count change Major master, Zookeeper
HBASE-25238 Upgrading HBase from 2.2.0 to 2.3.x fails because of “Message missing required fields: state” Critical .
HBASE-25234 [Upgrade]Incompatibility in reading RS report from 2.1 RS when Master is upgraded to a version containing HBASE-21406 Major .
HBASE-25053 WAL replay should ignore 0-length files Major master, regionserver
HBASE-25090 CompactionConfiguration logs unrealistic store file sizes Minor Compaction
HBASE-24977 Meta table shouldn't be modified as read only Major meta
HBASE-25176 MasterStoppedException should be moved to hbase-client module Major Client
HBASE-25206 Data loss can happen if a cloned table loses original split region(delete table) Major proc-v2, Region Assignment, snapshots
HBASE-25207 Revisit the implementation and usage of RegionStates.include Major Region Assignment
HBASE-25186 TestMasterRegionOnTwoFileSystems is failing after HBASE-25065 Blocker master
HBASE-25204 Nightly job failed as the name of jdk and maven changed Major .
HBASE-25093 the RSGroupBasedLoadBalancer#retainAssignment throws NPE Major rsgroup
HBASE-25117 ReplicationSourceShipper thread can not be finished Major .
HBASE-25168 Unify WAL name timestamp parsers Major .
HBASE-23834 HBase fails to run on Hadoop 3.3.0/3.2.2/3.1.4 due to jetty version mismatch Major dependencies
HBASE-25165 Change 'State time' in UI so sorts Minor UI
HBASE-25048 [HBCK2] Bypassed parent procedures are not updated in store Major hbck2, proc-v2
HBASE-25147 Should store the regionNames field in state data for ReopenTableRegionsProcedure Major proc-v2
HBASE-25115 HFilePrettyPrinter can't seek to the row which is the first row of a hfile Major HFile, tooling
HBASE-25135 Convert the internal seperator while emitting the memstore read metrics to # Minor .
HBASE-24665 MultiWAL : Avoid rolling of ALL WALs when one of the WAL needs a roll Major wal
HBASE-25096 WAL size in RegionServer UI is wrong Major .
HBASE-25077 hbck.jsp page loading fails, logs NPE in master log. Major hbck
HBASE-25088 CatalogFamilyFormat/MetaTableAccessor.parseRegionInfoFromRegionName incorrectly setEndKey to regionId Critical meta
HBASE-25097 Wrong RIT page number in Master UI Minor UI
HBASE-24896 'Stuck' in static initialization creating RegionInfo instance Major .
HBASE-24956 ConnectionManager#locateRegionInMeta waits for user region lock indefinitely. Major Client
HBASE-24481 HBase Rest: Request for region detail of a table which doesn't exits is success(200 success code) instead of 404 Minor .
HBASE-25047 WAL split edits number is negative in RegionServerUI Minor UI, wal
HBASE-25021 Nightly job should skip hadoop-2 integration test for master Major build, scripts
HBASE-25012 HBASE-24359 causes replication missed log of some RemoteException Major Replication
HBASE-25009 Hbck chore logs wrong message when loading regions from RS report Minor .
HBASE-25014 ScheduledChore is never triggered when initalDelay > 1.5*period Major .
HBASE-25016 Should close ResultScanner in MetaTableAccessor.scanByRegionEncodedName Critical master, meta
HBASE-24958 CompactingMemStore.timeOfOldestEdit error update Critical regionserver
HBASE-24995 MetaFixer fails to fix overlaps when multiple tables have overlaps Major hbck2
HBASE-24719 Renaming invalid rsgroup throws NPE instead of proper error message Major .
HBASE-19352 Port HADOOP-10379: Protect authentication cookies with the HttpOnly and Secure flags Major .
HBASE-24971 Upgrade JQuery to 3.5.1 Major security, UI
HBASE-24968 One of static initializers of CellComparatorImpl referring to subclass MetaCellComparator Major .
HBASE-24916 Region hole contains wrong regions pair when hole is created by first region deletion Major hbck2
HBASE-24885 STUCK RIT by hbck2 assigns Major hbck2, Region Assignment
HBASE-24926 Should call setFailure in MergeTableRegionsProcedure when isMergeable returns false Major master, proc-v2
HBASE-24884 BulkLoadHFilesTool/LoadIncrementalHFiles should accept -D options from command line parameters Minor .
HBASE-24583 Normalizer can't actually merge empty regions when neighbor is larger than average size Major master, Normalizer
HBASE-24844 Exception on standalone (master) shutdown Minor Zookeeper
HBASE-24856 Fix error prone error in FlushTableSubprocedure Major .
HBASE-24838 The pre commit job fails to archive surefire reports Critical build, scripts
HBASE-23157 WAL unflushed seqId tracking may wrong when Durability.ASYNC_WAL is used Major regionserver, wal
HBASE-24625 AsyncFSWAL.getLogFileSizeIfBeingWritten does not return the expected synced file length. Critical Replication, wal
HBASE-24830 Some tests involving RS crash fail with NullPointerException after HBASE-24632 in branch-2 Major .
HBASE-24788 Fix the connection leaks on getting hbase admin from unclosed connection Major mapreduce
HBASE-24805 HBaseTestingUtility.getConnection should be threadsafe Major test
HBASE-24808 skip empty log cleaner delegate class names (WAS => cleaner.CleanerChore: Can NOT create CleanerDelegate= ClassNotFoundException) Trivial .
HBASE-24767 Change default to false for HBASE-15519 per-user metrics Major metrics
HBASE-24713 RS startup with FSHLog throws NPE after HBASE-21751 Minor wal
HBASE-24794 hbase.rowlock.wait.duration should not be <= 0 Minor regionserver
HBASE-24797 Move log code out of loop Minor Normalizer
HBASE-24752 NPE/500 accessing webui on master startup Minor master
HBASE-24766 Document Remote Procedure Execution Major documentation
HBASE-11676 Scan FORMATTER is not applied for columns using non-printable name in shell Minor shell
HBASE-24738 [Shell] processlist command fails with ERROR: Unexpected end of file from server when SSL enabled Major shell
HBASE-24675 On Master restart all servers are assigned to default rsgroup. Major rsgroup
HBASE-22146 SpaceQuotaViolationPolicy Disable is not working in Namespace level Major .
HBASE-24742 Improve performance of SKIP vs SEEK logic Major Performance, regionserver
HBASE-24710 Incorrect checksum calculation in saveVersion.sh Major scripts
HBASE-24714 Error message is displayed in the UI of table's compaction state if any region of that table is not open. Major Compaction, UI
HBASE-24748 Add hbase.master.balancer.stochastic.moveCost.offpeak to doc as support dynamically change Minor documentation
HBASE-24746 The sort icons overlap the col name in master UI Major UI
HBASE-24721 rename_rsgroup overwriting the existing rsgroup. Major .
HBASE-24615 MutableRangeHistogram#updateSnapshotRangeMetrics doesn't calculate the distribution for last bucket. Major metrics
HBASE-24705 MetaFixer#fixHoles() does not include the case for read replicas (i.e, replica regions are not created) Major read replicas
HBASE-24720 Meta replicas not cleaned when disabled Minor read replicas
HBASE-24693 regioninfo#isLast() has a logic error Minor .
HBASE-23744 FastPathBalancedQueueRpcExecutor should enforce queue length of 0 Minor .
HBASE-22738 Fallback to default group to choose RS when there are no RS in current group Major rsgroup
HBASE-23126 IntegrationTestRSGroup is useless now Major rsgroup
HBASE-24518 waitForNamespaceOnline() should return false if any region is offline Major .
HBASE-24564 Make RS abort call idempotent Major regionserver
HBASE-24340 PerformanceEvaluation options should not mandate any specific order Minor .
HBASE-24130 rat plugin complains about having an unlicensed file. Minor .
HBASE-24017 Turn down flakey rerun rate on all but hot branches Major .

TESTS:

JIRA Summary Priority Component
HBASE-24015 Coverage for Assign and Unassign of Regions on RegionServer on failure Major amv2
HBASE-25156 TestMasterFailover.testSimpleMasterFailover is flaky Major test
HBASE-24979 Include batch mutatations in client operation timeout tests Major .
HBASE-24894 [Flakey Test] TestStochasticLoadBalancer.testMoveCostMultiplier Major Balancer, master, test

SUB-TASKS:

JIRA Summary Priority Component
HBASE-25127 Enhance PerformanceEvaluation to profile meta replica performance. Major .
HBASE-25284 Check-in "Enable memstore replication..." design Major .
HBASE-25126 Add load balance logic in hbase-client to distribute read load over meta replica regions. Major .
HBASE-25291 Document how to enable the meta replica load balance mode for the client and clean up around hbase:meta read replicas Major .
HBASE-25253 Deprecated master carrys regions related methods and configs Major Balancer, master
HBASE-25203 Change the reference url to flaky list in our jenkins jobs Major flakies, jenkins
HBASE-25194 Do not publish workspace in flaky find job Major jenkins
HBASE-25169 Update documentation about meta region replica Major documentation
HBASE-25164 Make ModifyTableProcedure support changing meta replica count Major meta, read replicas
HBASE-25162 Make flaky tests run more aggressively Major jenkins, scripts, test
HBASE-25163 Increase the timeout value for nightly jobs Major jenkins, scripts, test
HBASE-22976 [HBCK2] Add RecoveredEditsPlayer Major hbck2, walplayer
HBASE-25124 Support changing region replica count without disabling table Major meta, proc-v2
HBASE-23959 Fix javadoc for JDK11 Major .
HBASE-25151 warmupRegion frustrates registering WALs on the catalog replicationsource Major read replicas
HBASE-25154 Set java.io.tmpdir to project build directory to avoid writing std*deferred files to /tmp Major build, test
HBASE-25121 Refactor MetaTableAccessor.addRegionsToMeta and its usage places Major meta
HBASE-25055 Add ReplicationSource for meta WALs; add enable/disable when hbase:meta assigned to RS Major .
HBASE-25133 Migrate HBase Nightly jenkins job from Hadoop to hbase Major jenkins, scripts
HBASE-25132 Migrate flaky test jenkins job from Hadoop to hbase Major jenkins, scripts
HBASE-25103 Remove ZNodePaths.metaReplicaZNodes Major .
HBASE-25107 Migrate flaky reporting jenkins job from Hadoop to hbase Major jenkins, scripts
HBASE-25068 Pass WALFactory to Replication so it knows of all WALProviders, not just default/user-space Minor .
HBASE-25067 Edit of log messages around async WAL Replication; checkstyle fixes; and a bugfix Major .
HBASE-24857 Fix several problems when starting webUI Minor canary, UI
HBASE-24964 Remove MetaTableAccessor.tableExists Major meta
HBASE-24765 Dynamic master discovery Major Client
HBASE-24945 Remove MetaTableAccessor.getRegionCount Major mapreduce, meta
HBASE-24944 Remove MetaTableAccessor.getTableRegionsAndLocations in hbase-rest module Major meta, REST
HBASE-24918 Make RegionInfo#UNDEFINED IA.Private Major .
HBASE-24806 Small Updates to Functionality of Shell IRB Workspace Major shell
HBASE-24876 Fix the flaky job url in hbase-personality.sh Major .
HBASE-24841 Change the jenkins job urls in our jenkinsfile Major build, scripts
HBASE-24680 Refactor the checkAndMutate code on the server side Major .
HBASE-24817 Allow configuring WALEntry filters on ReplicationSource Major Replication, wal
HBASE-24632 Enable procedure-based log splitting as default in hbase3 Major wal
HBASE-24718 Generic NamedQueue framework for recent in-memory history (refactor slowlog) Major .
HBASE-24698 Turn OFF Canary WebUI as default Major canary
HBASE-24650 Change the return types of the new checkAndMutate methods introduced in HBASE-8458 Major Client
HBASE-24013 Bump branch-2 version to 2.4.0-SNAPSHOT Major .

OTHER:

JIRA Summary Priority Component
HBASE-25099 Change meta replica count by altering meta table descriptor Major meta, read replicas
HBASE-25320 Upgrade hbase-thirdparty dependency to 3.4.1 Blocker dependencies
HBASE-24640 Purge use of VisibleForTesting Major community
HBASE-24081 Provide documentation for running Yetus with HBase Major documentation
HBASE-24667 Rename configs that support atypical DNS set ups to put them in hbase.unsafe Major conf, Operability
HBASE-25228 Delete dev-support/jenkins_precommit_jira_yetus.sh Minor build
HBASE-24200 Upgrade to Yetus 0.12.0 Minor build
HBASE-25120 Remove the deprecated annotation for MetaTableAccessor.getScanForTableName Major meta
HBASE-25073 Should not use XXXService.Interface.class.getSimpleName as stub key prefix in AsyncConnectionImpl Major Client
HBASE-25072 Remove the unnecessary System.out.println in MasterRegistry Minor Client
HBASE-25004 Log RegionTooBusyException details Major .
HBASE-24993 Remove OfflineMetaRebuildTestCore Major test
HBASE-24809 Yetus IA Javadoc links are no longer available Minor .
HBASE-14847 Add FIFO compaction section to HBase book Major documentation
HBASE-24843 Sort the constants in `hbase_constants.rb` Minor shell
HBASE-24835 Normalizer should log a successful run at INFO level Minor Normalizer
HBASE-24779 Improve insight into replication WAL readers hung on checkQuota Minor Replication
HBASE-24662 Update DumpClusterStatusAction to notice changes in region server count Major integration tests
HBASE-24658 Update PolicyBasedChaosMonkey to handle uncaught exceptions Minor integration tests
HBASE-24648 Remove the legacy 'forceSplit' related code at region server side Major regionserver
HBASE-24492 ProtobufLogReader.readNext does not need looping Minor Replication, wal
HBASE-22033 Update to maven-javadoc-plugin 3.2.0 and switch to non-forking aggregate goals Major build, website

Release 2.3.0

CHANGES.md at rel/2.3.0 (e0e1382)

Release 2.2.0

CHANGES.md at rel/2.2.0 (3ec6932)

Release 2.1.0

CHANGES.md at rel/2.1.0 (e1673bb)

Release 2.0.0

CHANGES.md at rel/2.0.0 (7483b11)

Release 1.0.0

CHANGES.txt at rel/1.0.0 (6c98bff)