bbdc39c13e
YARN-9462. TestResourceTrackerService.testNodeRemovalGracefully fails sporadically. Contributed by Prabhu Joseph
2020-01-22 15:49:35 +01:00
c36fbcbf17
Remove WARN log when ipc connection interrupted in Client#handleSaslConnectionFailure()
...
Signed-off-by: sunlisheng <sunlisheng@xiaomi.com>
(cherry picked from commit d887e49dd4
2020-01-21 18:24:00 +09:00
d4f75e2798
HADOOP-16808. Use forkCount and reuseForks parameters instead of forkMode in the config of maven surefire plugin. Contributed by Xieming Li.
...
(cherry picked from commit f6d20daf40
2020-01-21 18:03:56 +09:00
429d5db3d9
HADOOP-16785. followup to abfs close() fix.
...
Adds one extra test to the ABFS close logic, to explicitly
verify that the close sequence of FilterOutputStream is
not going to fail.
This is just a due-diligence patch, but it helps ensure
that no regressions creep in in future.
Contributed by Steve Loughran.
Change-Id: Ifd33a8c322d32513411405b15f50a1aebcfa6e48
2020-01-20 16:26:33 +00:00
c411a1468f
YARN-8148. Update decimal values for queue capacities shown on queue status CLI. Contributed by Prabhu Joseph
2020-01-20 09:29:52 +01:00
805589fc71
YARN-9970. Refactor TestUserGroupMappingPlacementRule#verifyQueueMapping. Contributed by Manikandan R
2020-01-16 18:51:56 +01:00
8c150ed484
HADOOP-16790. Add Write Convenience Methods.
...
Contributed by David Mollitor.
This adds operations in FileUtil to write text to a file via
either a FileSystem or FileContext instance.
Change-Id: I5fe8fcf1bdbdbc734e137f922a75a822f2b88410
2020-01-16 11:27:13 +00:00
45b23fd74a
MAPREDUCE-7247. Modify HistoryServerRest.html content,change The job attempt id‘s datatype from string to int ( #1684 )
...
(cherry picked from commit b8518e6dab
2020-01-16 12:58:07 +09:00
1f464e2396
HADOOP-16803. Upgrade jackson-databind to 2.9.10.2. ( #1805 )
...
(cherry picked from commit 7f3510048d
2020-01-15 19:51:38 +09:00
0c2e312fef
YARN-10028. Integrate the new abstract log servlet to the JobHistory server. Contributed by Adam Antal
2020-01-15 10:51:02 +01:00
483d54f1a7
MAPREDUCE-7256. Fix javadoc error in SimpleExponentialSmoothing. ( #1804 )
...
(cherry picked from commit a2fdd7c2b5
2020-01-15 12:09:59 +09:00
1d2c5dffa8
HADOOP-16683. Disable retry of FailoverOnNetworkExceptionRetry in case of wrapped AccessControlException. Contributed by Adam Antal
2020-01-14 11:18:54 +01:00
aa3c96474f
HDFS-15097. Purge log in KMS and HttpFS. Contributed by Doris Gu.
...
(cherry picked from commit 6b86a5110e
2020-01-13 10:49:26 -08:00
6a7dfb3bf3
YARN-10026. Pull out common code pieces from ATS v1.5 and v2. Contributed by Adam Antal
2020-01-12 13:54:08 +01:00
d3c4c8be6a
HDFS-14578. AvailableSpaceBlockPlacementPolicy always prefers local node. Contributed by Ayush Saxena.
2020-01-11 10:34:01 +05:30
1ee90d6731
HDFS-15099. [SBN Read] checkOperation(WRITE) should throw ObserverRetryOnActiveException for ObserverNode. Contributed by Chen Liang.
...
(cherry picked from commit 26a969ec73
2020-01-10 17:17:11 -08:00
59260a0e0e
HDFS-15095. Fix TestDecommissioningStatus. Contributed by Ahmed Hussein.
...
(cherry picked from commit 5fb901ac40
2020-01-10 12:46:49 -06:00
57cb180267
HADOOP-16749. Configuration parsing of CDATA values are blank
...
Signed-off-by: Jonathan Eagles <jeagles@gmail.com>
(cherry picked from commit c4fb43c942
2020-01-10 10:32:42 -06:00
3ba0fd1e50
YARN-9018. Add functionality to AuxiliaryLocalPathHandler to return all locations to read for a given path. Contributed by Kuhu Shukla (kshukla)
...
(cherry picked from commit 93233a7d6e
2020-01-09 17:22:10 +00:00
6304f94bc0
HDFS-14957. INodeReference Space Consumed was not same in QuotaUsage and ContentSummary. Contributed by hemanthboyina.
2020-01-09 12:07:23 +05:30
58db04ce15
YARN-8672. TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out. Contributed by Chandni Singh and Jim Brennan.
2020-01-08 19:44:43 +00:00
5e2be81fcb
YARN-7387: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestIncreaseAllocationExpirer fails intermittently. Contributed by Jim Brennan (Jim_Brennan)
...
(cherry picked from commit b1e07d27cc
2020-01-08 19:30:09 +00:00
b20ce118da
YARN-10072: TestCSAllocateCustomResource failures. Contributed by Jim Brennan (Jim_Brennan)
...
(cherry picked from commit 6899be5a17
2020-01-08 17:42:41 +00:00
ee7c56c6de
MAPREDUCE-7252. Handling 0 progress in SimpleExponential task runtime estimator
...
Signed-off-by: Jonathan Eagles <jeagles@gmail.com>
(cherry picked from commit cdd6efd3ab
2020-01-08 11:09:58 -06:00
e21cb8f96e
HADOOP-16785. Improve wasb and abfs resilience on double close() calls.
...
This hardens the wasb and abfs output streams' resilience to being invoked
in/after close().
wasb:
Explicity raise IOEs on operations invoked after close,
rather than implicitly raise NPEs.
This ensures that invocations which catch and swallow IOEs will perform as
expected.
abfs:
When rethrowing an IOException in the close() call, explicitly wrap it
with a new instance of the same subclass.
This is needed to handle failures in try-with-resources clauses, where
any exception in closed() is added as a suppressed exception to the one
thrown in the try {} clause
*and you cannot attach the same exception to itself*
Contributed by Steve Loughran.
Change-Id: Ic44b494ff5da332b47d6c198ceb67b965d34dd1b
2020-01-08 12:04:11 +00:00
d7f9a90e2c
HDFS-15080. Fix the issue in reading persistent memory cached data with an offset. Contributed by Feilong He.
...
(cherry picked from commit 7030722e5d
2020-01-08 14:29:05 +05:30
3e17b471b6
HDFS-15077. Fix intermittent failure of TestDFSClientRetries#testLeaseRenewSocketTimeout. ( #1797 )
...
(cherry picked from commit aba3f6c3e1
2020-01-08 17:05:20 +09:00
3e32f5476a
HDFS-15072. HDFS MiniCluster fails to start when run in directory path with a %. ( #1775 )
...
(cherry picked from commit a43c177f1d
2020-01-08 11:29:23 +09:00
250cd9f575
HADOOP-16772. Extract version numbers to head of pom.xml (addendum) ( #1774 ). Contributed by Tamas Penzes.
...
Follow up task of HADOOP-16729, extract even more version numbers for branch-3.2.
Change-Id: I0546fc8ec8f68baa4bcfa9db0df4d8293b078913
2020-01-06 14:12:28 +01:00
d7cc897bdc
MAPREDUCE-7255. Fix typo in MapReduce documentaion example ( #1793 )
...
(cherry picked from commit b343e1533b
2020-01-06 12:40:29 +09:00
3a624cad37
HADOOP-16784. Update the year to 2020. Contributed by Ayush Saxena.
2020-01-02 21:38:49 +05:30
5410732cff
HADOOP-16775. DistCp reuses the same temp file within the task for different files.
...
Contributed by Amir Shenavandeh.
This avoids overwrite consistency issues with S3 and other stores -though
given S3's copy operation is O(data), you are still best of using -direct
when distcp-ing to it.
Change-Id: I8dc9f048ad0cc57ff01543b849da1ce4eaadf8c3
2020-01-02 15:37:55 +00:00
ad98a30810
YARN-10053. Use Shared Group Mapping Service in Placement Rules. Contributed by Wilfred Spiegelenburg.
...
(cherry Picked from commit 217b56ffdd
2020-01-02 14:30:01 +05:30
a27f9bd28e
HDFS-14740. Recover data blocks from persistent memory read cache during datanode restarts. Contributed by Feilong He.
...
(cherry picked from commit d79cce20ab
2020-01-02 11:57:02 +05:30
5d9cbca31e
HDFS-15074. DataNode.DataTransfer thread should catch all the expception and log it. Contributed by hemanthboyina.
2019-12-29 11:21:33 +05:30
ad11b25df2
HDFS-14934. [SBN Read] Standby NN throws many InterruptedExceptions when dfs.ha.tail-edits.period is 0. Contributed by Ayush Saxena.
...
(cherry picked from commit dc32f583af
2019-12-28 21:34:19 +09:00
8ec1461b25
HADOOP-16042. Update the link to HadoopJavaVersion ( #1784 )
...
(cherry picked from commit d80d86264d
2019-12-27 17:20:26 +09:00
440b7abc04
HADOOP-16610. Upgrade to yetus 0.11.1 and use emoji vote on github pre commit ( #1527 ). Contributed by Duo Zhang.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
(cherry picked from commit 3cecb2a469
2019-12-25 19:48:15 +09:00
0d94e0b1a0
HDFS-15073. Replace curator-shaded guava import with the standard one ( #1782 )
...
(cherry picked from commit d8cd7098b4
2019-12-25 11:12:03 +09:00
82957562ea
HDFS-15076. Fix tests that hold FSDirectory lock, without holding FSNamesystem lock. Contributed by Konstantin V Shvachko.
...
(cherry picked from commit b98ac2a3af
2019-12-24 12:50:57 -08:00
85da5cb870
YARN-10055. bower install fails. ( #1778 )
...
(cherry picked from commit 34ff7dbaf5
2019-12-23 20:26:40 +09:00
355ec33416
YARN-10009. In Capacity Scheduler, DRC can treat minimum user limit percent as a max when custom resource is defined. Contributed by Eric Payne
2019-12-20 19:32:36 +00:00
11c5396b4a
Revert "HDFS-15062. Add LOG when sendIBRs failed. Contributed by Fei Hui."
...
This reverts commit 59cdf18d5a
2019-12-20 19:04:45 +00:00
7201384e1b
HADOOP-16771. Update checkstyle to 8.26 and maven-checkstyle-plugin to 3.1.0. Contributed by Andras Bokor.
...
(cherry picked from commit f777cd398f
2019-12-20 13:12:02 +09:00
59cdf18d5a
HDFS-15062. Add LOG when sendIBRs failed. Contributed by Fei Hui.
...
(cherry picked from commit 52d7b745c6
2019-12-19 09:43:40 -08:00
0707d0a0ae
YARN-9894. CapacitySchedulerPerf test for measuring hundreds of apps in a large number of queues. Contributed by Eric Payne
...
(cherry picked from commit 7b93575b92
2019-12-18 13:18:22 -08:00
01e2c996ff
YARN-10039. Allow disabling app submission from REST endpoints
...
(cherry picked from commit fddc3d55c3
2019-12-18 10:51:57 -08:00
afe00a1ca5
HDFS-15012. NN fails to parse Edit logs after applying HDFS-13101. Contributed by Shashikant Banerjee.
...
(cherry picked from commit fdd96e46d1
2019-12-18 23:10:00 +05:30
18b515322c
YARN-10033. TestProportionalCapacityPreemptionPolicy not initializing vcores for effective max resources. Contributed by Eric Payne.
...
(cherry picked from commit f47dcf2d4c
2019-12-17 17:36:52 +00:00
d4a6901c42
HDFS-15036. Active NameNode should not silently fail the image transfer. Contributed by Chen Liang.
...
(cherry picked from commit 65c4660bcd
2019-12-12 15:57:15 -08:00
Szilard Nemeth
sunlisheng
Akira Ajisaka
Steve Loughran
David Mollitor
kevinzhao1661
Masatake Iwasaki
Wei-Chiu Chuang
Ayush Saxena
Chen Liang
Kihwal Lee
Daryn Sharp
Eric E Payne
Surendra Singh Lilhore
Eric Badger
Ahmed Hussein
Rakesh Radhakrishnan
Tamás Pénzes
Sergey Pogorelov
Prabhu Joseph
Takanobu Asanuma
Chandra Sanivarapu
Duo Zhang
Konstantin V Shvachko
Inigo Goiri
Jonathan Hung
Shashikant Banerjee