Shashikant Banerjee
|
2c4b1c2b15
|
HADOOP-15396. Some java source files are executable
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit e4c39f3247da77d03c6015de4f18be75924fcb22)
|
2018-04-19 08:36:59 +09:00 |
|
Erik Krogen
|
bce57a139b
|
HADOOP-14970. MiniHadoopClusterManager doesn't respect lack of format option. Contributed by Erik Krogen
(cherry picked from commit 1a407bc9906306801690bc75ff0f0456f8f265fd)
|
2018-04-12 23:35:58 -07:00 |
|
Lei Xu
|
3717df89ee
|
Preparing for 3.0.3 development
|
2018-04-12 13:57:46 -07:00 |
|
Eric E Payne
|
081ea1ec39
|
YARN-8120. JVM can crash with SIGSEGV when exiting due to custom leveldb logger. Contributed by Jason Lowe.
(cherry picked from commit 6bb128dfb893cf0e4aa2d3ecc65440668a1fc8d7)
|
2018-04-12 16:22:48 +00:00 |
|
Rohith Sharma K S
|
7cca3486b7
|
MAPREDUCE-7062. Update mapreduce.job.tags description for making use for ATSv2 purpose. Contributed by Charan Hebri.
(cherry picked from commit 6cc59a09e7330dc893b386d84c8f2aa86c02eace)
|
2018-04-11 09:49:38 +05:30 |
|
Vrushali C
|
ec258b8ed1
|
YARN-8073 TimelineClientImpl doesn't honor yarn.timeline-service.versions configuration. Contributed by Rohith Sharma K S
(cherry picked from commit 345e7624d58a058a1bad666bd1e5ce4b346a9056)
|
2018-04-11 09:49:25 +05:30 |
|
Jason Lowe
|
31eef823f0
|
MAPREDUCE-7064. Flaky test TestTaskAttempt#testReducerCustomResourceTypes. Contributed by Peter Bacsko
(cherry picked from commit 2626ec35e997c06cda975fbfb2b95da740270059)
|
2018-03-14 15:21:09 -05:00 |
|
Owen O'Malley
|
0f106df4d6
|
Revert "HADOOP-14077. Add ability to access jmx via proxy. Contributed by Yuanbo Liu."
This reverts commit 172b23af33554b7d58fd41b022d983bcc2433da7.
(cherry picked from commit d0d2d4c51e9534e08893ae14cf3fff7b2ee70b1d)
|
2018-03-10 13:33:52 -08:00 |
|
Jason Lowe
|
9dacb9fb27
|
MAPREDUCE-6930. mapreduce.map.cpu.vcores and mapreduce.reduce.cpu.vcores are both present twice in mapred-default.xml. Contributed by Sen Zhao
(cherry picked from commit 32fa3a63e0e7d8bfb3d3b9b3c500ecb3a4874ecf)
|
2018-03-09 10:44:49 -06:00 |
|
Weiwei Yang
|
5db733fb09
|
MAPREDUCE-7059. Downward Compatibility issue: MR job fails because of unknown setErasureCodingPolicy method from 3.x client to HDFS 2.x cluster. Contributed by Jiandan Yang.
|
2018-03-02 10:43:03 +08:00 |
|
Steve Loughran
|
c960ae0b9a
|
MAPREDUCE-7060. Cherry Pick PathOutputCommitter class/factory to branch-3.0.
Contributed by Steve Loughran.
|
2018-03-01 18:39:54 +00:00 |
|
Jason Lowe
|
f173e9cc04
|
HADOOP-15206. BZip2 drops and duplicates records when input split size is small. Contributed by Aki Tanaka
(cherry picked from commit 0898ff42e9e5c53f2fce7ccdeb4e1cd7d0f123b3)
|
2018-02-16 14:54:55 -06:00 |
|
Eric Payne
|
cf933e17bc
|
MAPREDUCE-7053: Timed out tasks can fail to produce thread dump. Contributed by Jason Lowe.
(cherry picked from commit 82f029f7b50679ea477a3a898e4ee400fa394adf)
|
2018-02-16 08:25:52 -06:00 |
|
Jason Lowe
|
b9ce463fbd
|
MAPREDUCE-7052. TestFixedLengthInputFormat#testFormatCompressedIn is flaky. Contributed by Peter Bacsko
(cherry picked from commit a53d62ab26e170a0338f93e228718da52e9196e4)
|
2018-02-15 15:21:05 -06:00 |
|
Jason Lowe
|
bc2d4ba507
|
MAPREDUCE-7048. Uber AM can crash due to unknown task in statusUpdate. Contributed by Peter Bacsko
(cherry picked from commit 87e2570a1419d3616de2de3b553108ad1a8af425)
|
2018-02-12 14:49:35 -06:00 |
|
Anu Engineer
|
2d6ab20007
|
HDFS-12990. Change default NameNode RPC port back to 8020. Contributed by Xiao Chen.
(cherry picked from commit 4304fcd5bdf9fb7aa9181e866eea383f89bf171f)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/ViewFs.md
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/tools/TestGetConf.java
(cherry picked from commit 9264f10bb35dbe30c75c648bf759e8aeb715834a)
|
2018-02-07 11:16:53 -08:00 |
|
Lei Xu
|
7b377f43d0
|
Preparing for 3.0.2 development
|
2018-02-06 10:50:37 -08:00 |
|
Eric Payne
|
1d53c9d3a9
|
MAPREDUCE-7033: Map outputs implicitly rely on permissive umask for shuffle. Contributed by Jason Lowe
(cherry picked from commit 5a725bb886eb0b9182840c4a91466c361ecc11e0)
|
2018-01-31 16:01:46 -06:00 |
|
Jason Lowe
|
d7acc45ce4
|
MAPREDUCE-7020. Task timeout in uber mode can crash AM. Contributed by Peter Bacsko
(cherry picked from commit 6eef3d7f1a1e5e3f27fb3bf7596663640d786181)
|
2018-01-26 15:37:16 -06:00 |
|
Haibo Chen
|
e6c66baba9
|
MAPREDUCE-7041. MR should not try to clean up at first job attempt. (Gergo Repas via Haibo Chen)
(cherry picked from commit cc10852252c2d69294eabc68bd032cc630a53b18)
|
2018-01-25 17:14:25 -08:00 |
|
Jason Lowe
|
5281c188df
|
MAPREDUCE-7015. Possible race condition in JHS if the job is not loaded. Contributed by Peter Bacsko
(cherry picked from commit cff9edd4b514bdcfe22cd49964e3707fb78ab876)
|
2018-01-24 14:45:46 -06:00 |
|
Haibo Chen
|
fc669778be
|
MAPREDUCE-6984. MR AM to clean up temporary files from previous attempt in case of no recovery. (Gergo Repas via Haibo Chen)
(cherry picked from commit cce71dceef9e82d31fe8ec59648b2a4a50c8869a)
|
2018-01-19 13:05:40 -08:00 |
|
Jason Lowe
|
2a870d91fe
|
MAPREDUCE-7028. Concurrent task progress updates causing NPE in Application Master. Contributed by Gergo Repas
(cherry picked from commit fe35103591ece0209f8345aba5544313e45a073c)
|
2018-01-03 11:03:16 -06:00 |
|
Jason Lowe
|
0dd7f1f4e8
|
MAPREDUCE-5124. AM lacks flow control for task events. Contributed by Peter Bacsko
(cherry picked from commit 21d36273551fa45c4130e5523b6724358cf34b1e)
|
2017-12-01 14:10:02 -06:00 |
|
Chris Douglas
|
03f0b8b3f2
|
MAPREDUCE-7011. TestClientDistributedCacheManager::testDetermineCacheVisibilities assumes all parent dirs set other exec
(cherry picked from commit 782ba3bf9da52699b27405a3f147464975d1df99)
|
2017-11-21 20:42:59 -08:00 |
|
Andrew Wang
|
1c8d334287
|
Preparing for 3.0.1 development
|
2017-11-14 11:17:18 -08:00 |
|
Arun Suresh
|
72d7bedac9
|
Fixing Job History Server Configuration parsing. (Jason Lowe via asuresh)
(cherry picked from commit 5eb7dbe9b31a45f57f2e1623aa1c9ce84a56c4d1)
|
2017-11-09 15:16:55 -08:00 |
|
Akira Ajisaka
|
a536655c63
|
MAPREDUCE-7001. Moving logging APIs over to slf4j in hadoop-mapreduce-client-shuffle. Contributed by Jinjiang Ling.
(cherry picked from commit e4c220ee4fdc4550275bda0fa9468d7d87d143c3)
|
2017-11-08 19:28:59 +09:00 |
|
Akira Ajisaka
|
d77f17458c
|
MAPREDUCE-6997. Moving logging APIs over to slf4j in hadoop-mapreduce-client-hs. Contributed by Gergely Novák.
(cherry picked from commit ffee10b68ef1f2d75c9d0df9140c2a605f826724)
|
2017-11-08 19:23:51 +09:00 |
|
Naganarasimha
|
8e9369d387
|
MAPREDUCE-6975. Logging task counters. Contributed by Prabhu Joseph.
(cherry picked from commit 61bbdc511e4e98c11a05d7c3bc01f3e971adbe13)
|
2017-11-06 12:59:52 +05:30 |
|
Xiao Chen
|
1c96e0d693
|
HDFS-12682. ECAdmin -listPolicies will always show SystemErasureCodingPolicies state as DISABLED.
(cherry picked from commit 4f4cea56b25d5acc14dd6d61dea70fd4a0c7a9d9)
|
2017-11-02 21:27:43 -07:00 |
|
Akira Ajisaka
|
12f92e636e
|
MAPREDUCE-6983. Moving logging APIs over to slf4j in hadoop-mapreduce-client-core. Contributed by Jinjiang Ling.
(cherry picked from commit 178751ed8c9d47038acf8616c226f1f52e884feb)
|
2017-11-02 17:43:55 +09:00 |
|
Daniel Templeton
|
7689d4781a
|
YARN-6927. Add support for individual resource types requests in MapReduce
(Contributed by Gergo Repas via Daniel Templeton)
(cherry picked from commit 9a7e81083801a57d6bb96584988415cbef67460d)
|
2017-10-31 15:06:18 -07:00 |
|
Wangda Tan
|
4af3deaeb0
|
YARN-6789. Add Client API to get all supported resource types from RM. (Sunil G via wangda)
Change-Id: I366d8db6f6700acd087db5acb7a1be7e41b2b68d
(cherry picked from commit df3855541af98a3805958f2b5b9db6be705d52ab)
|
2017-10-31 15:06:17 -07:00 |
|
Jason Lowe
|
75605766fd
|
HADOOP-14919. BZip2 drops records when reading data in splits. Contributed by Jason Lowe
(cherry picked from commit 2fae63aa60c43b62bd908a9499562fe528603185)
|
2017-10-31 09:32:02 -05:00 |
|
Jason Lowe
|
00345eed50
|
YARN-7244. ShuffleHandler is not aware of disks that are added. Contributed by Kuhu Shukla
(cherry picked from commit 665bb147aa3fc198e53335931562dd69f9f0e345)
|
2017-10-27 17:00:31 -05:00 |
|
Akira Ajisaka
|
a887016e1d
|
MAPREDUCE-6972. Enable try-with-resources for RecordReader. Contributed by Zoltan Haindrich.
(cherry picked from commit 2523e1cce5f6d6c3762c958c7f3138ab486c8497)
|
2017-10-18 11:19:00 +09:00 |
|
Chris Trezzo
|
24b03eb79f
|
MAPREDUCE-5951. Add support for the YARN Shared Cache.
(cherry picked from commit e46d5bb962b0c942f993afc505b165b1cd96e51b)
|
2017-10-12 11:15:46 -07:00 |
|
Akira Ajisaka
|
47aa044fcc
|
MAPREDUCE-6971. Moving logging APIs over to slf4j in hadoop-mapreduce-client-app. Contributed by Jinjiang Ling.
(cherry picked from commit 453d48bdfbb67ed3e66c33c4aef239c3d7bdd3bc)
|
2017-10-03 12:15:43 +09:00 |
|
Andrew Wang
|
5a4f37019a
|
Preparing for 3.0.0 GA development
|
2017-09-28 11:32:01 -07:00 |
|
Jason Lowe
|
bf03363d83
|
MAPREDUCE-6968. Staging directory erasure coding config property has a typo. Contributed by Jason Lowe
(cherry picked from commit 9df05005ac258441eeceec25ecef7b28f9f50a02)
|
2017-09-26 14:53:47 -05:00 |
|
Eric Payne
|
839d5b124d
|
MAPREDUCE-6960. Shuffle Handler prints disk error stack traces for every read failure.
(cherry picked from commit 595d478408104bdfe1f08efd79930e18862fafbb)
|
2017-09-19 10:40:41 -05:00 |
|
Jason Lowe
|
731a622627
|
MAPREDUCE-6958. Shuffle audit logger should log size of shuffle transfer. Contributed by Jason Lowe
(cherry picked from commit 3a20debddeac69596ceb5b36f8413529ea8570e6)
|
2017-09-19 09:14:12 -05:00 |
|
Jason Lowe
|
db88b6179d
|
Revert "MAPREDUCE-6958. Shuffle audit logger should log size of shuffle transfer. Contributed by Jason Lowe"
This reverts commit b3d61304f2fa4a99526f7a60ccaac9f262083079.
(cherry picked from commit ea845ba58c585647c4be8d30d9b814f098e34a12)
|
2017-09-19 08:50:20 -05:00 |
|
Andrew Wang
|
531290c2c8
|
HADOOP-14835. mvn site build throws SAX errors. Contributed by Andrew Wang and Sean Mackrory.
(cherry picked from commit 3cf3540f19b5fd1a174690db9f1b7be2977d96ba)
|
2017-09-18 15:13:45 -07:00 |
|
Jason Lowe
|
8894654fde
|
MAPREDUCE-6958. Shuffle audit logger should log size of shuffle transfer. Contributed by Jason Lowe
(cherry picked from commit b3d61304f2fa4a99526f7a60ccaac9f262083079)
|
2017-09-18 17:06:02 -05:00 |
|
Robert Kanter
|
917e875e51
|
MAPREDUCE-6954. Disable erasure coding for files that are uploaded to the MR staging area (pbacsko via rkanter)
(cherry picked from commit 0adc0471d0c06f66a31060f270dcb50a7b4ffafa)
|
2017-09-18 10:42:01 -07:00 |
|
Robert Kanter
|
3847b8c861
|
Revert "YARN-7162. Remove XML excludes file format (rkanter)" - wrong commit message
This reverts commit 293ab432e116b93ada6ee56e518ae07aa853ab41.
|
2017-09-18 10:41:46 -07:00 |
|
Robert Kanter
|
293ab432e1
|
YARN-7162. Remove XML excludes file format (rkanter)
(cherry picked from commit 3a8d57a0a2e047b34be82f602a2b6cf5593d2125)
|
2017-09-15 12:01:41 -07:00 |
|
Steve Loughran
|
b5e9982355
|
MAPREDUCE-6956 FileOutputCommitter to gain abstract superclass PathOutputCommitter.
Contributed by Steve Loughran
(cherry picked from commit 11390c2d111910b01d9c4d3e39dee49babae272f)
|
2017-09-15 17:00:16 +01:00 |
|