Commit Graph

12396 Commits

Author SHA1 Message Date
tedyu e2974f4b91 HBASE-21042 processor.getRowsToLock() always assumes there is some row being locked in HRegion#processRowsWithLocks 2018-08-18 11:47:23 -07:00
Andrew Purtell 56c59f11e3 HBASE-20940 HStore.cansplit should not allow split to happen if it has references (Vishal Khandelwal) 2018-08-17 15:30:40 -07:00
Sean Busbey 8716ac2568 HBASE-20387 ADDENDUM backport findHangingTests.py changes from master to branches-1. 2018-08-16 23:55:28 -05:00
Sean Busbey 18840e9510 HBASE-20387 turn flaky test tracking infra into per-branch pipeline.
* gather up all the flaky test stuff into a directory
* create Jenkins Pipeline DSL for the report generation and the flaky re-testing
* have the nightly per-branch job consume the results of flaky reporting

Signed-off-by: Mike Drob <mdrob@apache.org>

 Conflicts:
	dev-support/Dockerfile
	dev-support/Jenkinsfile
	dev-support/flaky-tests/flaky-dashboard-template.html
	dev-support/flaky-tests/report-flakies.py

For branches 1, includes a backport of the current version of report-flakies.py
and supporting files.
2018-08-16 23:24:11 -05:00
Andrew Purtell 971d48406e HBASE-21047 Object creation of StoreFileScanner thru constructor and close may leave refCount to -1 (Vishal Khandelwal) 2018-08-16 11:43:24 -07:00
Nihal Jain 5520fa1ab3 HBASE-20469 Directory used for sidelining old recovered edits files should be made configurable
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-08-15 18:01:43 -07:00
Guangxu Cheng 8510331637 HBASE-20845 Support set the consistency for Gets and Scans in thrift2
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift2/ThriftUtilities.java
	hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift2/generated/TGet.java
	hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift2/generated/THBaseService.java
	hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift2/generated/TResult.java
	hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift2/generated/TScan.java
	hbase-thrift/src/main/resources/org/apache/hadoop/hbase/thrift2/hbase.thrift
	hbase-thrift/src/test/java/org/apache/hadoop/hbase/thrift2/TestThriftHBaseServiceHandler.java
2018-08-07 13:49:19 -07:00
Bosko Devetak d79bb23c64 HBASE-21007 Memory leak in HBase REST server
Close the scanner leak in rest server when using the limit number of rows.

Example: when using uris like

        /sometable/*?limit=5&startrow=eGlND&endrow=eGlNE

where the scan range has more rows than the limit, the
rest server will start leaking memmory.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-08-07 12:40:40 -07:00
Huaxiang Sun 1b50fe5372 HBASE-20997 rebuildUserRegions() does not build ReplicaMapping during master switchover
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Pankaj Kumar <Username: pankaj2461t>
2018-08-06 11:25:02 -07:00
Vikas Vishwakarma 3bc4bc48f6 HBASE-20896 Port HBASE-20866 to branch-1 and branch-1.4
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-08-04 10:24:18 +08:00
Monani Mihir 0298c06b4f HBASE-19036 Add action in Chaos Monkey to restart Active Namenode
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-08-02 05:04:27 -07:00
Andrew Purtell a15c445743 HBASE-20935 HStore.removeCompactedFiles should log in case it is unable to delete a file (Vishal Khandelwal) 2018-07-31 16:12:50 -07:00
Josh Elser ab3ec9477a HBASE-20930 MetaScanner.metaScan should respect meta table name (Vishal Khandelwal) 2018-07-30 17:12:03 -04:00
Andrew Purtell 9b5a839b99 HBASE-20974 Backport HBASE-20583 (SplitLogWorker should handle FileNotFoundException when split a wal) to branch-1 (Pankaj Kumar) 2018-07-30 12:34:45 -07:00
Andrew Purtell 2d70120eb3 HBASE-20895 NPE in RpcServer#readAndProcess
Synchronize readAndProcess() on the Connection to avoid MT issues with
data buffer management
2018-07-27 18:07:58 -07:00
Andrew Purtell 203a3324e9 HBASE-20931 [branch-1] Add -Dhttps.protocols=TLSv1.2 to Maven command line in make_rc.sh 2018-07-24 15:04:08 -07:00
huzheng 0b7081e67a HBASE-20565 ColumnRangeFilter combined with ColumnPaginationFilter can produce incorrect result 2018-07-24 10:25:43 +08:00
Xu Cang 3a97976eae HBASE-20744 Address FindBugs warnings in branch-1
minor fix

Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-23 16:29:13 -07:00
Xu Cang dfc7ecd9ca HBASE-20230 Incorrrect log message in RSRpcServices
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-07-23 16:01:33 -07:00
Ankit Singhal 56aa9ab8a3 HBASE-20908 Infinite loop on regionserver if region replica are reduced
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-07-23 13:11:39 -07:00
Toshihiro Suzuki 2eaa24a132 HBASE-17885 Backport HBASE-15871 to branch-1
HBASE-15871 Memstore flush doesn't finish because of backwardseek() in memstore scanner (ramkrishna.s.vasudevan)

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-07-23 12:27:52 -07:00
tedyu a7fe71da88 HBASE-20917 MetaTableMetrics#stop references uninitialized requestsMap for non-meta region 2018-07-23 10:04:10 -07:00
TAK LON WU 9db4a4059a HBASE-20401 Make `MAX_WAIT` and `waitIfNotFinished` in CleanerContext configurable
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-07-23 17:16:08 +08:00
TAK LON WU 896b69a0fc HBASE-20559 Backport HBASE-18083 (Make large/small file clean thread number configurable in HFileCleaner) to branch-1
The last port commit of HBASE-20555

Signed-off-by: Yu Li <liyu@apache.org>
2018-07-23 11:36:47 +08:00
TAK LON WU 780724b15a HBASE-20558 Port HBASE-17854 (Use StealJobQueue in HFileCleaner after HBASE-17215) to branch-1
The third port commit of HBASE-20555
2018-07-20 16:11:09 -07:00
Ankit e5618a6674 HBASE-20672 New metrics ReadRequestRate and WriteRequestRate
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-07-19 15:36:01 -07:00
jingyuntian 15ed2e86e1 HBASE-20855 PeerConfigTracker only supporting one listener will cause problem when there is a recovered replication queue
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-19 08:43:23 -07:00
Mike Drob 61288f843c HBASE-20905 pin pylint to 1.x in branch-1 2018-07-17 10:11:12 -05:00
tedyu 7211d13ac8 HBASE-20889 PE scan is failing with NullPointerException 2018-07-16 09:53:47 -07:00
Mike Drob 2ae61521aa HBASE-20884 Reclassify Base64 as IA.Private 2018-07-13 14:33:23 -05:00
Guanghao Zhang 3835f715f2 HBASE-20697 (addendum) Can't cache All region locations of the specify table by calling table.getRegionLocator().getAllRegionLocations() 2018-07-12 13:47:55 +08:00
zhaoyuan 6edb27e1e6 HBASE-20697 Can't cache All region locations of the specify table by calling table.getRegionLocator().getAllRegionLocations()
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-07-11 11:33:32 +08:00
Huaxiang Sun f2dc754aa3 HBASE-20651 Master, prevents hbck or shell command to reassign the split parent region
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2018-07-10 16:07:30 -07:00
Pankaj 0953eb7ed9 HBASE-20771 PUT operation fail with "No server address listed in hbase:meta for region xxxxx"
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-07-09 15:54:54 -07:00
Xu Cang 99189f284b HBASE-20858 Port HBASE-20695 (Implement table level RegionServer replication metrics) to branch-1
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-07-09 12:19:21 -07:00
TAK LON WU a52c6bf2f3 HBASE-20557 Backport HBASE-17215 to branch-1
The second backport of HBASE-20555

Signed-off-by: Zach York <zyork@apache.org>
2018-07-09 11:32:04 -07:00
Abhishek Singh Chouhan a4db453c6d HBASE-20806 Split style journal for flushes and compactions 2018-07-09 18:44:07 +05:30
Nihal Jain 77e5668ed2 HBASE-20808 Wrong shutdown order between Chores and ChoreService
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-07-07 00:32:33 +08:00
Josh Elser 154b77307f HBASE-20826 Truncate really long RpcServer warnings unless TRACE is on
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Ted Yu <tyu@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2018-07-05 17:21:30 -07:00
Andrew Purtell d6d1efd89d HBASE-20840 Backport HBASE-20791 'RSGroupBasedLoadBalancer#setClusterMetrics should pass ClusterMetrics to its internalBalancer' to branch-1 (chenxu) 2018-07-05 16:12:13 -07:00
Yu Li 50f7894cc4 HBASE-20691 Change the default WAL storage policy back to "NONE""
This partially reverts HBASE-19858 and adds more doc about why we choose "NONE" as the default.
2018-07-05 15:26:56 +08:00
huzheng a25cf7bbdb HBASE-20789 TestBucketCache#testCacheBlockNextBlockMetadataMissing is flaky 2018-07-04 09:49:07 +08:00
Nihal Jain f94ad9d78f HBASE-20450 Provide metrics for number of total active, priority and replication rpc handlers
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-02 11:19:19 -07:00
jingyuntian cc8e1cc393 HBASE-20769 getSplits() has a out of bounds problem in TableSnapshotInputFormatImpl
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-06-29 15:25:06 -07:00
Xu Cang 2fd69cf93c HBASE-19722 Implement a meta query statistics metrics source
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-06-28 17:17:50 -07:00
Reid Chan c81d0aff95 HBASE-20732 Shutdown scan pool when master is stopped 2018-06-28 12:36:50 +08:00
Michael Stack 03946a389a HBASE-20785 NPE getting metrics in PE testing scans 2018-06-27 12:04:21 -07:00
Michael Stack ccead1264c HBASE-20770 WAL cleaner logs way too much; gets clogged when lots of work to do
General log cleanup; setting stuff that can flood the log to TRACE.

Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-06-26 15:54:47 -07:00
Monani Mihir 4936750d3a HBASE-20701 too much logging when balancer runs from BaseLoadBalancer
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-06-25 17:17:31 -07:00
tedyu 6fa9f0bea9 HBASE-20723 Custom hbase.wal.dir results in data loss because we write recovered edits into a different place than where the recovering region server looks for them 2018-06-15 19:51:33 -07:00