5257afb153
HDFS-12491. Support wildcard in CLASSPATH for libhdfs. Contributed by Muhammad Samir Khan.
...
(cherry picked from commit 10a60fbe20
2020-02-04 12:24:12 -06:00
7136ebbb7a
YARN-10022. Add RM Rest API to validate a CapacityScheduler Config with delta change
...
Contributed by Kinga Marton.
(cherry-picked from commit 1ab9c692fa
2020-02-04 14:06:23 +05:30
e89436b183
HDFS-7175. Client-side SocketTimeoutException during Fsck. Contributed by Stephen O'Donnell, Akira Ajisaka.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Co-authored-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 1e3a0b0d93
2020-01-31 16:13:42 -08:00
2c8c6e8e22
HDFS-13179. TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas fails intermittently. Contributed by Ahmed Hussein.
...
(cherry picked from commit 1839c467f6
2020-01-31 11:24:37 -08:00
f62c472944
MAPREDUCE-7079: JobHistory#ServiceStop implementation is incorrect. Contributed by Ahmed Hussein (ahussein)
...
(cherry picked from commit b897f6834b
2020-01-29 17:10:13 +00:00
7034482222
HDFS-15146. TestBalancerRPCDelay.testBalancerRPCDelay fails
...
intermittently. Contributed by Ahmed Hussein.
(cherry picked from commit 799d4c1cf4
2020-01-29 11:01:12 -06:00
351c64f327
MAPREDUCE-7260. Cross origin request support for Job history server web UI. Contributed by Adam Antal
2020-01-29 14:47:10 +01:00
5736ecd123
YARN-10084. Allow inheritance of max app lifetime / default app lifetime. Contributed by Eric Payne.
2020-01-29 04:07:28 +00:00
9813ba2ebc
[SBN Read] Slow clients when Observer reads are enabled but there are no Observers on the cluster. Contributed by Chen Liang
2020-01-28 16:36:27 -08:00
8a1b02f44c
HDFS-14993. checkDiskError doesn't work during datanode startup. Contributed by Yang Yun.
2020-01-28 23:12:44 +05:30
96caaf7185
MAPREDUCE-7259. testSpeculateSuccessfulWithUpdateEvents fails Intermittently
...
Signed-off-by: Jonathan Eagles <jeagles@gmail.com>
(cherry picked from commit 08251538fe
2020-01-28 10:58:42 -06:00
6538e57c41
MAPREDUCE-7262. MRApp helpers block for long intervals (500ms)
...
Signed-off-by: Jonathan Eagles <jeagles@gmail.com>
(cherry picked from commit 3f01c48106
2020-01-27 16:10:42 -06:00
1bb9667137
HDFS-15119. Allow expiration of cached locations in DFSInputStream.
...
Contributed by Ahmed Hussein.
(cherry picked from commit d10f77e3c9
2020-01-24 09:21:09 -06:00
be412546be
YARN-9790. Failed to set default-application-lifetime if maximum-application-lifetime is less than or equal to zero. Contributed by kyungwan nam.
...
(cherry picked from commit d2d963f3d4
2020-01-23 15:23:45 +00:00
dcc16b07fa
YARN-10083. Addendum to fix compilation error due to missing import
2020-01-22 17:18:03 +01:00
1e7679035f
YARN-7913. Improve error handling when application recovery fails with exception. Contributed by Wilfred Spiegelenburg
2020-01-22 16:50:15 +01:00
4842708320
HDFS-14968. Add ability to log stale datanodes. Contributed by Ahmed Hussein.
...
(cherry picked from commit bd03053ea2
2020-01-22 09:26:47 -06:00
da416c826f
YARN-10083. Provide utility to ask whether an application is in final status. Contributed by Adam Antal
2020-01-22 16:18:35 +01:00
bbdc39c13e
YARN-9462. TestResourceTrackerService.testNodeRemovalGracefully fails sporadically. Contributed by Prabhu Joseph
2020-01-22 15:49:35 +01:00
c36fbcbf17
Remove WARN log when ipc connection interrupted in Client#handleSaslConnectionFailure()
...
Signed-off-by: sunlisheng <sunlisheng@xiaomi.com>
(cherry picked from commit d887e49dd4
2020-01-21 18:24:00 +09:00
d4f75e2798
HADOOP-16808. Use forkCount and reuseForks parameters instead of forkMode in the config of maven surefire plugin. Contributed by Xieming Li.
...
(cherry picked from commit f6d20daf40
2020-01-21 18:03:56 +09:00
429d5db3d9
HADOOP-16785. followup to abfs close() fix.
...
Adds one extra test to the ABFS close logic, to explicitly
verify that the close sequence of FilterOutputStream is
not going to fail.
This is just a due-diligence patch, but it helps ensure
that no regressions creep in in future.
Contributed by Steve Loughran.
Change-Id: Ifd33a8c322d32513411405b15f50a1aebcfa6e48
2020-01-20 16:26:33 +00:00
c411a1468f
YARN-8148. Update decimal values for queue capacities shown on queue status CLI. Contributed by Prabhu Joseph
2020-01-20 09:29:52 +01:00
805589fc71
YARN-9970. Refactor TestUserGroupMappingPlacementRule#verifyQueueMapping. Contributed by Manikandan R
2020-01-16 18:51:56 +01:00
8c150ed484
HADOOP-16790. Add Write Convenience Methods.
...
Contributed by David Mollitor.
This adds operations in FileUtil to write text to a file via
either a FileSystem or FileContext instance.
Change-Id: I5fe8fcf1bdbdbc734e137f922a75a822f2b88410
2020-01-16 11:27:13 +00:00
45b23fd74a
MAPREDUCE-7247. Modify HistoryServerRest.html content,change The job attempt id‘s datatype from string to int ( #1684 )
...
(cherry picked from commit b8518e6dab
2020-01-16 12:58:07 +09:00
1f464e2396
HADOOP-16803. Upgrade jackson-databind to 2.9.10.2. ( #1805 )
...
(cherry picked from commit 7f3510048d
2020-01-15 19:51:38 +09:00
0c2e312fef
YARN-10028. Integrate the new abstract log servlet to the JobHistory server. Contributed by Adam Antal
2020-01-15 10:51:02 +01:00
483d54f1a7
MAPREDUCE-7256. Fix javadoc error in SimpleExponentialSmoothing. ( #1804 )
...
(cherry picked from commit a2fdd7c2b5
2020-01-15 12:09:59 +09:00
1d2c5dffa8
HADOOP-16683. Disable retry of FailoverOnNetworkExceptionRetry in case of wrapped AccessControlException. Contributed by Adam Antal
2020-01-14 11:18:54 +01:00
aa3c96474f
HDFS-15097. Purge log in KMS and HttpFS. Contributed by Doris Gu.
...
(cherry picked from commit 6b86a5110e
2020-01-13 10:49:26 -08:00
6a7dfb3bf3
YARN-10026. Pull out common code pieces from ATS v1.5 and v2. Contributed by Adam Antal
2020-01-12 13:54:08 +01:00
d3c4c8be6a
HDFS-14578. AvailableSpaceBlockPlacementPolicy always prefers local node. Contributed by Ayush Saxena.
2020-01-11 10:34:01 +05:30
1ee90d6731
HDFS-15099. [SBN Read] checkOperation(WRITE) should throw ObserverRetryOnActiveException for ObserverNode. Contributed by Chen Liang.
...
(cherry picked from commit 26a969ec73
2020-01-10 17:17:11 -08:00
59260a0e0e
HDFS-15095. Fix TestDecommissioningStatus. Contributed by Ahmed Hussein.
...
(cherry picked from commit 5fb901ac40
2020-01-10 12:46:49 -06:00
57cb180267
HADOOP-16749. Configuration parsing of CDATA values are blank
...
Signed-off-by: Jonathan Eagles <jeagles@gmail.com>
(cherry picked from commit c4fb43c942
2020-01-10 10:32:42 -06:00
3ba0fd1e50
YARN-9018. Add functionality to AuxiliaryLocalPathHandler to return all locations to read for a given path. Contributed by Kuhu Shukla (kshukla)
...
(cherry picked from commit 93233a7d6e
2020-01-09 17:22:10 +00:00
6304f94bc0
HDFS-14957. INodeReference Space Consumed was not same in QuotaUsage and ContentSummary. Contributed by hemanthboyina.
2020-01-09 12:07:23 +05:30
58db04ce15
YARN-8672. TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out. Contributed by Chandni Singh and Jim Brennan.
2020-01-08 19:44:43 +00:00
5e2be81fcb
YARN-7387: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestIncreaseAllocationExpirer fails intermittently. Contributed by Jim Brennan (Jim_Brennan)
...
(cherry picked from commit b1e07d27cc
2020-01-08 19:30:09 +00:00
b20ce118da
YARN-10072: TestCSAllocateCustomResource failures. Contributed by Jim Brennan (Jim_Brennan)
...
(cherry picked from commit 6899be5a17
2020-01-08 17:42:41 +00:00
ee7c56c6de
MAPREDUCE-7252. Handling 0 progress in SimpleExponential task runtime estimator
...
Signed-off-by: Jonathan Eagles <jeagles@gmail.com>
(cherry picked from commit cdd6efd3ab
2020-01-08 11:09:58 -06:00
e21cb8f96e
HADOOP-16785. Improve wasb and abfs resilience on double close() calls.
...
This hardens the wasb and abfs output streams' resilience to being invoked
in/after close().
wasb:
Explicity raise IOEs on operations invoked after close,
rather than implicitly raise NPEs.
This ensures that invocations which catch and swallow IOEs will perform as
expected.
abfs:
When rethrowing an IOException in the close() call, explicitly wrap it
with a new instance of the same subclass.
This is needed to handle failures in try-with-resources clauses, where
any exception in closed() is added as a suppressed exception to the one
thrown in the try {} clause
*and you cannot attach the same exception to itself*
Contributed by Steve Loughran.
Change-Id: Ic44b494ff5da332b47d6c198ceb67b965d34dd1b
2020-01-08 12:04:11 +00:00
d7f9a90e2c
HDFS-15080. Fix the issue in reading persistent memory cached data with an offset. Contributed by Feilong He.
...
(cherry picked from commit 7030722e5d
2020-01-08 14:29:05 +05:30
3e17b471b6
HDFS-15077. Fix intermittent failure of TestDFSClientRetries#testLeaseRenewSocketTimeout. ( #1797 )
...
(cherry picked from commit aba3f6c3e1
2020-01-08 17:05:20 +09:00
3e32f5476a
HDFS-15072. HDFS MiniCluster fails to start when run in directory path with a %. ( #1775 )
...
(cherry picked from commit a43c177f1d
2020-01-08 11:29:23 +09:00
250cd9f575
HADOOP-16772. Extract version numbers to head of pom.xml (addendum) ( #1774 ). Contributed by Tamas Penzes.
...
Follow up task of HADOOP-16729, extract even more version numbers for branch-3.2.
Change-Id: I0546fc8ec8f68baa4bcfa9db0df4d8293b078913
2020-01-06 14:12:28 +01:00
d7cc897bdc
MAPREDUCE-7255. Fix typo in MapReduce documentaion example ( #1793 )
...
(cherry picked from commit b343e1533b
2020-01-06 12:40:29 +09:00
3a624cad37
HADOOP-16784. Update the year to 2020. Contributed by Ayush Saxena.
2020-01-02 21:38:49 +05:30
5410732cff
HADOOP-16775. DistCp reuses the same temp file within the task for different files.
...
Contributed by Amir Shenavandeh.
This avoids overwrite consistency issues with S3 and other stores -though
given S3's copy operation is O(data), you are still best of using -direct
when distcp-ing to it.
Change-Id: I8dc9f048ad0cc57ff01543b849da1ce4eaadf8c3
2020-01-02 15:37:55 +00:00
Kihwal Lee
Prabhu Joseph
Stephen O'Donnell
Inigo Goiri
Eric E Payne
Szilard Nemeth
Eric Badger
Chen Liang
Ayush Saxena
Ahmed Hussein
Abhishek Modi
sunlisheng
Akira Ajisaka
Steve Loughran
David Mollitor
kevinzhao1661
Masatake Iwasaki
Wei-Chiu Chuang
Daryn Sharp
Surendra Singh Lilhore
Rakesh Radhakrishnan
Tamás Pénzes
Sergey Pogorelov