Abhishek Modi
e9159db623
MAPREDUCE-7093. Use assertEquals instead of assertTrue(a == b) in TestMapReduceJobControlWithMocks
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-05-07 01:15:14 +09:00
Eric Yang
8cdb032aff
YARN-8223. Improved yarn auxiliary service to load jar file from HDFS.
...
Contributed by Zian Chen
2018-05-04 12:36:31 -04:00
Bibin A Chundatt
1a95a4524a
MAPREDUCE-7073. Optimize TokenCache#obtainTokensForNamenodesInternal
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-05-02 16:14:28 +09:00
Jason Lowe
68c6ec719d
MAPREDUCE-7086. Add config to allow FileInputFormat to ignore directories when recursive=false. Contributed by Sergey Shelukhin
2018-05-01 16:19:53 -05:00
Ewan Higgs
84ecfe3ceb
HADOOP-14188. Remove the usage of org.mockito.internal.util.reflection.Whitebox
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-04-27 19:21:37 +09:00
Sunil G
83e60cd2db
MAPREDUCE-7042. Killed MR job data does not move to mapreduce.jobhistory.done-dir when ATS v2 is enabled. Contributed by Rohith Sharma K S.
2018-04-26 13:54:40 -07:00
Anu Engineer
42e248372c
Revert "HDFS-12515. Ozone: mvn package compilation fails on HDFS-7240. Contributed by Anu Engineer."
...
This fix was need because of change in Trunk. That patch has been reverted and change proposed by this
patch will be applied in trunk. So reverting now to match the changes in trunk. Please see the JIRA for
details.
This reverts commit 244e7a5f65
.
2018-04-26 05:36:04 -07:00
Anu Engineer
c14e8b17ec
HDFS-12515. Ozone: mvn package compilation fails on HDFS-7240. Contributed by Anu Engineer.
2018-04-26 05:36:04 -07:00
Robert Kanter
1b9ecc264a
MAPREDUCE-7072. mapred job -history prints duplicate counter in human output (wilfreds via rkanter)
2018-04-24 11:30:38 -07:00
Shashikant Banerjee
e4c39f3247
HADOOP-15396. Some java source files are executable
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-04-19 08:35:38 +09:00
Haibo Chen
bb92bfb4ef
YARN-7088. Add application launch time to Resource Manager REST API. (Kanwaljeet Sachdev via Haibo Chen)
2018-04-17 11:15:20 -07:00
Haibo Chen
86dfb70875
Revert "YARN-7088. Add application launch time to Resource Manager REST API. (Kanwaljeet Sachdev via Haibo Chen)"
...
This reverts commit 0c14b6f0d8
.
2018-04-17 06:04:38 -07:00
Haibo Chen
0c14b6f0d8
YARN-7088. Add application launch time to Resource Manager REST API. (Kanwaljeet Sachdev via Haibo Chen)
2018-04-17 05:59:03 -07:00
Wangda Tan
995cba65fe
MAPREDUCE-7077. Pipe mapreduce job fails with Permission denied for jobTokenPassword. (Akira Ajisaka via wangda)
...
Change-Id: Ie8f01425d58409fa3661f768205b7616128c8aa4
(cherry picked from commit 035e0f97ea
)
2018-04-13 13:52:10 -07:00
Erik Krogen
1a407bc990
HADOOP-14970. MiniHadoopClusterManager doesn't respect lack of format option. Contributed by Erik Krogen
2018-04-12 23:27:51 -07:00
Jason Lowe
4571351ccc
MAPREDUCE-7069. Add ability to specify user environment variables individually. Contributed by Jim Brennan
2018-04-12 11:12:46 -05:00
Eric E Payne
6bb128dfb8
YARN-8120. JVM can crash with SIGSEGV when exiting due to custom leveldb logger. Contributed by Jason Lowe.
2018-04-12 16:04:23 +00:00
Rohith Sharma K S
6cc59a09e7
MAPREDUCE-7062. Update mapreduce.job.tags description for making use for ATSv2 purpose. Contributed by Charan Hebri.
2018-04-11 09:45:39 +05:30
Wangda Tan
6cf023f9b7
Added CHANGES/RELEASES/Jdiff for 3.1.0 release
...
Change-Id: Ied5067a996151c04d15cad46c46ac98b60c37b39
(cherry picked from commit 2d96570452a72569befdf9cfe9b90c9fa2e0e261)
2018-04-05 15:52:39 -07:00
Vrushali C
345e7624d5
YARN-8073 TimelineClientImpl doesn't honor yarn.timeline-service.versions configuration. Contributed by Rohith Sharma K S
2018-04-04 15:08:03 -07:00
Steve Loughran
dde1579096
HADOOP-15146. Remove DataOutputByteBuffer.
...
Contributed by BELUGA BEHR.
2018-04-02 15:52:40 +01:00
Robert Kanter
edb202e493
MAPREDUCE-6441. Improve temporary directory name generation in LocalDistributedCacheManager for concurrent processes (wattsinabox, rchiang, haibochen via rkanter)
2018-03-26 14:55:53 -07:00
Takanobu Asanuma
86816da5b4
MAPREDUCE-7066. TestQueue fails on Java9
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-03-19 09:39:49 +09:00
Jason Lowe
2626ec35e9
MAPREDUCE-7064. Flaky test TestTaskAttempt#testReducerCustomResourceTypes. Contributed by Peter Bacsko
2018-03-14 15:05:24 -05:00
Owen O'Malley
3a8dade9b1
Revert "HADOOP-14077. Add ability to access jmx via proxy. Contributed by Yuanbo Liu."
...
This reverts commit 172b23af33
.
(cherry picked from commit d0d2d4c51e9534e08893ae14cf3fff7b2ee70b1d)
2018-03-09 22:46:30 -08:00
Jason Lowe
32fa3a63e0
MAPREDUCE-6930. mapreduce.map.cpu.vcores and mapreduce.reduce.cpu.vcores are both present twice in mapred-default.xml. Contributed by Sen Zhao
2018-03-09 10:41:16 -06:00
Takanobu Asanuma
4971276631
HADOOP-15271. Remove unicode multibyte characters from JavaDoc
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-03-05 15:07:58 -08:00
Weiwei Yang
6e6945cd78
MAPREDUCE-7059. Downward Compatibility issue: MR job fails because of unknown setErasureCodingPolicy method from 3.x client to HDFS 2.x cluster. Contributed by Jiandan Yang.
2018-03-01 10:18:53 +08:00
Billie Rinaldi
7dd385098c
MAPREDUCE-7010. Make Job History File Permissions configurable. Contributed by Gergely Novák
2018-02-26 14:32:46 -08:00
Arpit Agarwal
2fa7963c3d
HADOOP-15254. Correct the wrong word spelling 'intialize'. Contributed by fang zhenyi.
2018-02-24 14:41:55 -08:00
Sean Mackrory
2bc3351eaf
HADOOP-6852. apparent bug in concatenated-bzip2 support (decoding). Contributed by Zsolt Venczel.
2018-02-21 12:57:14 -07:00
Jason Lowe
0898ff42e9
HADOOP-15206. BZip2 drops and duplicates records when input split size is small. Contributed by Aki Tanaka
2018-02-16 14:49:00 -06:00
Eric Payne
82f029f7b5
MAPREDUCE-7053: Timed out tasks can fail to produce thread dump. Contributed by Jason Lowe.
2018-02-16 08:15:09 -06:00
Jason Lowe
a53d62ab26
MAPREDUCE-7052. TestFixedLengthInputFormat#testFormatCompressedIn is flaky. Contributed by Peter Bacsko
2018-02-15 15:12:57 -06:00
Jason Lowe
87e2570a14
MAPREDUCE-7048. Uber AM can crash due to unknown task in statusUpdate. Contributed by Peter Bacsko
2018-02-12 13:21:09 -06:00
Wangda Tan
60f9e60b3b
Preparing for 3.2.0 development
...
Change-Id: I6d0e01f3d665d26573ef2b957add1cf0cddf7938
2018-02-11 11:17:38 +08:00
Anu Engineer
4304fcd5bd
HDFS-12990. Change default NameNode RPC port back to 8020. Contributed by Xiao Chen.
2018-02-06 13:43:45 -08:00
Eric Payne
5a725bb886
MAPREDUCE-7033: Map outputs implicitly rely on permissive umask for shuffle. Contributed by Jason Lowe
2018-01-31 15:45:30 -06:00
Arun Suresh
38af237969
YARN-6599. Support anti-affinity constraint via AppPlacementAllocator. (Wangda Tan via asuresh)
2018-01-31 01:30:17 -08:00
Takanobu Asanuma
56feaa40bb
MAPREDUCE-7036. ASF License warning in hadoop-mapreduce-client
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-01-30 00:39:39 +09:00
Jason Lowe
6eef3d7f1a
MAPREDUCE-7020. Task timeout in uber mode can crash AM. Contributed by Peter Bacsko
2018-01-26 15:31:43 -06:00
Jason Lowe
a37e7f0ad8
MAPREDUCE-7022. Fast fail rogue jobs based on task scratch dir size. Contributed by Johan Gustavsson
2018-01-26 14:36:45 -06:00
Haibo Chen
cc10852252
MAPREDUCE-7041. MR should not try to clean up at first job attempt. (Gergo Repas via Haibo Chen)
2018-01-25 16:11:30 -08:00
Jason Lowe
cff9edd4b5
MAPREDUCE-7015. Possible race condition in JHS if the job is not loaded. Contributed by Peter Bacsko
2018-01-24 14:44:07 -06:00
Robert Kanter
836643d793
MAPREDUCE-6995. Uploader tool for Distributed Cache Deploy documentation (miklos.szegedi@cloudera.com via rkanter)
2018-01-19 17:57:54 -08:00
Vrushali C
c191538ed1
HADOOP-15166 CLI MiniCluster fails with ClassNotFoundException o.a.h.yarn.server.timelineservice.collector.TimelineCollectorManager. Contributed by Gera Shegalov
2018-01-19 16:15:55 -08:00
Haibo Chen
cce71dceef
MAPREDUCE-6984. MR AM to clean up temporary files from previous attempt in case of no recovery. (Gergo Repas via Haibo Chen)
2018-01-19 12:56:17 -08:00
Jason Lowe
6e42d05829
MAPREDUCE-7029. FileOutputCommitter is slow on filesystems lacking recursive delete. Contributed by Karthik Palaniappan
2018-01-17 08:14:11 -06:00
Robert Kanter
d716084f45
MAPREDUCE-7032. Add the ability to specify a delayed replication count (miklos.szegedi@cloudera.com via rkanter)
2018-01-16 10:45:45 -08:00
Takanobu Asanuma
1a9c5d479e
MAPREDUCE-7034. Moving logging APIs over to slf4j the rest of all in hadoop-mapreduce
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-01-15 15:38:03 +09:00
Robert Kanter
e404650f48
MAPREDUCE-7030. Uploader tool should ignore symlinks to the same directory (miklos.szegedi@cloudera.com via rkanter)
2018-01-12 14:18:01 -08:00
Jason Lowe
fe35103591
MAPREDUCE-7028. Concurrent task progress updates causing NPE in Application Master. Contributed by Gergo Repas
2018-01-03 11:01:38 -06:00
Junping Du
a7f8caf58e
Add 2.8.3 release jdiff files.
...
(cherry picked from commit c89f99aade
)
2017-12-18 22:39:01 -08:00
Chen Liang
c7a4dda3c5
HADOOP-15109. TestDFSIO -read -random doesn't work on file sized 4GB. Contributed by Ajay Kumar.
2017-12-18 13:25:47 -08:00
Robert Kanter
2316f52690
MAPREDUCE-7018. Apply erasure coding properly to framework tarball and support plain tar (miklos.szegedi@cloudera.com via rkanter)
2017-12-11 14:00:42 -08:00
Akira Ajisaka
c2e8a5c229
MAPREDUCE-7000. Moving logging APIs over to slf4j in hadoop-mapreduce-client-nativetask. Contributed by Jinjiang Ling.
2017-12-07 16:27:08 +09:00
Akira Ajisaka
d4cae977a2
MAPREDUCE-6998. Moving logging APIs over to slf4j in hadoop-mapreduce-client-jobclient. Contributed by Gergely Novák.
2017-12-07 16:21:25 +09:00
Arpit Agarwal
e00c7f78c1
HADOOP-14976. Set HADOOP_SHELL_EXECNAME explicitly in scripts.
2017-12-04 21:02:04 -08:00
Robert Kanter
3b78607a02
MAPREDUCE-6994. Uploader tool for Distributed Cache Deploy code changes (miklos.szegedi@cloudera.com via rkanter)
2017-12-01 12:12:15 -08:00
Jason Lowe
21d3627355
MAPREDUCE-5124. AM lacks flow control for task events. Contributed by Peter Bacsko
2017-12-01 14:04:25 -06:00
Rohith Sharma K S
3cd75845da
MAPREDUCE-7014. Fix java doc errors in jdk1.8. Contributed by Steve Loughran.
2017-11-27 22:01:00 +05:30
Steve Loughran
de8b6ca5ef
HADOOP-13786 Add S3A committer for zero-rename commits to S3 endpoints.
...
Contributed by Steve Loughran and Ryan Blue.
2017-11-22 15:28:12 +00:00
Chris Douglas
782ba3bf9d
MAPREDUCE-7011. TestClientDistributedCacheManager::testDetermineCacheVisibilities assumes all parent dirs set other exec
2017-11-21 20:42:28 -08:00
Arun Suresh
5eb7dbe9b3
Fixing Job History Server Configuration parsing. (Jason Lowe via asuresh)
2017-11-09 15:15:51 -08:00
Akira Ajisaka
e4c220ee4f
MAPREDUCE-7001. Moving logging APIs over to slf4j in hadoop-mapreduce-client-shuffle. Contributed by Jinjiang Ling.
2017-11-08 19:28:08 +09:00
Akira Ajisaka
ffee10b68e
MAPREDUCE-6997. Moving logging APIs over to slf4j in hadoop-mapreduce-client-hs. Contributed by Gergely Novák.
2017-11-08 19:21:43 +09:00
Naganarasimha
61bbdc511e
MAPREDUCE-6975. Logging task counters. Contributed by Prabhu Joseph.
2017-11-06 12:58:38 +05:30
Xiao Chen
e565b5277d
HDFS-12682. ECAdmin -listPolicies will always show SystemErasureCodingPolicies state as DISABLED.
2017-11-02 21:27:35 -07:00
Akira Ajisaka
178751ed8c
MAPREDUCE-6983. Moving logging APIs over to slf4j in hadoop-mapreduce-client-core. Contributed by Jinjiang Ling.
2017-11-02 17:43:08 +09:00
Jason Lowe
2fae63aa60
HADOOP-14919. BZip2 drops records when reading data in splits. Contributed by Jason Lowe
2017-10-31 09:30:13 -05:00
Daniel Templeton
9a7e810838
YARN-6927. Add support for individual resource types requests in MapReduce
...
(Contributed by Gergo Repas via Daniel Templeton)
2017-10-30 11:04:22 -07:00
Jason Lowe
665bb147aa
YARN-7244. ShuffleHandler is not aware of disks that are added. Contributed by Kuhu Shukla
2017-10-27 16:56:05 -05:00
Steve Loughran
de09716fb8
MAPREDUCE-6977 Move logging APIs over to slf4j in hadoop-mapreduce-client-common.
...
Contributed by Jinjiang Ling.
2017-10-27 10:45:03 +01:00
Junping Du
a25b5aa0cf
Add several jdiff xml files for 2.8.2 release.
2017-10-26 19:30:48 -07:00
Akira Ajisaka
2523e1cce5
MAPREDUCE-6972. Enable try-with-resources for RecordReader. Contributed by Zoltan Haindrich.
2017-10-18 11:18:39 +09:00
Chris Trezzo
e46d5bb962
MAPREDUCE-5951. Add support for the YARN Shared Cache.
2017-10-12 10:59:20 -07:00
Rohith Sharma K S
639f98cc9d
MAPREDUCE-6951. Improve exception message when mapreduce.jobhistory.webapp.address is in wrong format. Contributed by Prabhu Joseph.
2017-10-11 14:27:38 +05:30
Akira Ajisaka
453d48bdfb
MAPREDUCE-6971. Moving logging APIs over to slf4j in hadoop-mapreduce-client-app. Contributed by Jinjiang Ling.
2017-10-03 12:14:54 +09:00
Jason Lowe
9df05005ac
MAPREDUCE-6968. Staging directory erasure coding config property has a typo. Contributed by Jason Lowe
2017-09-26 14:52:27 -05:00
Jason Lowe
908d8e914e
MAPREDUCE-6965. QuasiMonteCarlo should use Time.monotonicNow for measuring durations. Contributed by Chetna Chaudhari
2017-09-22 09:34:53 -05:00
Akira Ajisaka
c71d137960
MAPREDUCE-6966. DistSum should use Time.monotonicNow for measuring durations. Contributed by Chetna Chaudhari.
2017-09-22 15:07:59 +09:00
Akira Ajisaka
53be075241
MAPREDUCE-6947. Moving logging APIs over to slf4j in hadoop-mapreduce-examples. Contributed by Gergely Novák.
2017-09-22 13:27:59 +09:00
Jason Lowe
b9db0afa1e
MAPREDUCE-6964. BaileyBorweinPlouffe should use Time.monotonicNow for measuring durations. Contributed by Chetna Chaudhari
2017-09-21 09:37:19 -05:00
Akira Ajisaka
53047f934e
Revert "MAPREDUCE-6947. Moving logging APIs over to slf4j in hadoop-mapreduce-examples. Contributed by Gergery Novák."
...
This reverts commit 2018538fdb
.
2017-09-21 11:16:05 +09:00
Andrew Wang
51edaacd09
HDFS-12445. Correct spellings of choosen to chosen. Contributed by hu xiaodong.
2017-09-19 13:48:23 -07:00
Eric Payne
595d478408
MAPREDUCE-6960. Shuffle Handler prints disk error stack traces for every read failure.
2017-09-19 10:35:15 -05:00
Jason Lowe
3a20debdde
MAPREDUCE-6958. Shuffle audit logger should log size of shuffle transfer. Contributed by Jason Lowe
2017-09-19 09:13:17 -05:00
Jason Lowe
ea845ba58c
Revert "MAPREDUCE-6958. Shuffle audit logger should log size of shuffle transfer. Contributed by Jason Lowe"
...
This reverts commit b3d61304f2
.
2017-09-19 08:45:05 -05:00
Akira Ajisaka
2018538fdb
MAPREDUCE-6947. Moving logging APIs over to slf4j in hadoop-mapreduce-examples. Contributed by Gergery Novák.
2017-09-19 11:05:54 +09:00
Andrew Wang
3cf3540f19
HADOOP-14835. mvn site build throws SAX errors. Contributed by Andrew Wang and Sean Mackrory.
2017-09-18 15:13:42 -07:00
Jason Lowe
b3d61304f2
MAPREDUCE-6958. Shuffle audit logger should log size of shuffle transfer. Contributed by Jason Lowe
2017-09-18 17:04:43 -05:00
Robert Kanter
0adc0471d0
MAPREDUCE-6954. Disable erasure coding for files that are uploaded to the MR staging area (pbacsko via rkanter)
2017-09-18 10:40:06 -07:00
Robert Kanter
5f496683fb
Revert "YARN-7162. Remove XML excludes file format (rkanter)" - wrong commit message
...
This reverts commit 3a8d57a0a2
.
2017-09-18 10:32:08 -07:00
Robert Kanter
3a8d57a0a2
YARN-7162. Remove XML excludes file format (rkanter)
2017-09-15 12:00:26 -07:00
Steve Loughran
11390c2d11
MAPREDUCE-6956 FileOutputCommitter to gain abstract superclass PathOutputCommitter.
...
Contributed by Steve Loughran
2017-09-15 16:59:04 +01:00
Andrew Wang
c3f35c422b
HADOOP-14089. Automated checking for malformed client. Contributed by Sean Busbey.
2017-09-13 16:57:50 -07:00
Jason Lowe
4d98936eec
MAPREDUCE-6957. shuffle hangs after a node manager connection timeout. Contributed by Jooseong Kim
2017-09-13 17:21:13 -05:00
Ray Chiang
556812c179
HADOOP-14799. Update nimbus-jose-jwt to 4.41.1. (rchiang)
2017-09-12 10:19:34 -07:00
Wangda Tan
df3855541a
YARN-6789. Add Client API to get all supported resource types from RM. (Sunil G via wangda)
...
Change-Id: I366d8db6f6700acd087db5acb7a1be7e41b2b68d
2017-09-12 09:19:12 -07:00
Varun Vasudev
c2032e251e
YARN-5708. Implement APIs to get resource profiles from the RM. Contributed by Varun Vasudev.
2017-09-12 09:19:10 -07:00
Robert Kanter
a323f73bae
MAPREDUCE-6953. Skip the testcase testJobWithChangePriority if FairScheduler is used (pbacsko via rkanter)
2017-09-08 13:14:36 -07:00
Anu Engineer
c35510a465
HADOOP-14849. some wrong spelling words update. Contributed by Chen Hongfei.
2017-09-08 10:02:34 -07:00
Andrew Wang
0d419c984f
Preparing for 3.1.0 development
2017-09-01 11:53:48 -07:00
Allen Wittenauer
190410085b
HADOOP-14364. refresh changelog/release notes with newer Apache Yetus build
...
Signed-off-by: Andrew Wang <wang@apache.org>
2017-08-31 19:06:49 -07:00
Allen Wittenauer
71bbb86d69
HADOOP-14670. Increase minimum cmake version for all platforms
...
Signed-off-by: Chris Douglas <cdouglas@apache.org>
2017-08-30 21:47:24 -07:00
Konstantin V Shvachko
3e0e2033cc
MAPREDUCE-6931. Remove TestDFSIO "Total Throughput" calculation. Contributed by Dennis Huo.
2017-08-30 14:07:23 -07:00
Haibo Chen
d04f85f387
MAPREDUCE-6892. Issues with the count of failed/killed tasks in the jhist file. (Peter Bacsko via Haibo Chen)
2017-08-30 10:07:48 -07:00
Varun Saxena
3d00c8f394
Made fixes for whitespace errors and checstyle warnings before merge.
2017-08-30 11:29:54 +05:30
Jian He
08f40bcc7f
MAPREDUCE-6838. [ATSv2 Security] Add timeline delegation token received in allocate response to UGI. Contributed by Varun Saxena
2017-08-30 11:29:54 +05:30
Rohith Sharma K S
7594d1de7b
YARN-6130. [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM. Contributed by Varun Saxena.
2017-08-30 11:29:53 +05:30
Sangjin Lee
684de1a902
YARN-4675. Reorganize TimelineClient and TimelineClientImpl into separate classes for ATSv1.x and ATSv2. Contributed by Naganarasimha G R.
2017-08-30 11:29:52 +05:30
Sangjin Lee
8499299740
MAPREDUCE-6818. Remove direct reference to TimelineClientImpl. Contributed by Li Lu.
2017-08-30 11:29:51 +05:30
Sangjin Lee
092fead5d9
YARN-5792. Adopt the id prefix for YARN, MR, and DS entities. Contributed by Varun Saxena.
2017-08-30 11:29:51 +05:30
Mingliang Liu
ae7abad3d9
MAPREDUCE-6945. TestMapFileOutputFormat missing @after annotation. Contributed by Ajay Kumar
2017-08-27 15:19:55 -07:00
Arpit Agarwal
8b7cbe3840
HADOOP-14729. Upgrade JUnit 3 test cases to JUnit 4. Contributed by Ajay Kumar.
2017-08-25 09:55:46 -07:00
Andrew Wang
dd7916d3cd
HDFS-12250. Reduce usage of FsPermissionExtension in unit tests. Contributed by Chris Douglas.
2017-08-17 09:35:36 -07:00
Robert Kanter
ab051bd42e
MAPREDUCE-6936. Remove unnecessary dependency of hadoop-yarn-server-common from hadoop-mapreduce-client-common (haibochen via rkanter)
2017-08-16 16:14:04 -07:00
Jason Lowe
0acc5e0036
MAPREDUCE-6940. Copy-paste error in the TaskAttemptUnsuccessfulCompletionEvent constructor. Contributed by Oleg Danilov
2017-08-16 16:34:06 -05:00
Chris Douglas
645a8f2a4d
HADOOP-14726. Mark FileStatus::isDir as final
2017-08-14 21:57:20 -07:00
Lei Xu
ce797a1706
HDFS-12221. Replace xcerces in XmlEditsVisitor. (Ajay Kumar via lei)
2017-08-14 10:27:47 -07:00
Allen Wittenauer
4222c97108
HADOOP-10392. Use FileSystem#makeQualified(Path) instead of Path#makeQualified(FileSystem) (ajisakaa via aw)
2017-08-11 09:25:56 -07:00
Haibo Chen
a32e0138fb
MAPREDUCE-6870. Add configuration for MR job to finish when all reducers are complete. (Peter Bacsko via Haibo Chen)
2017-08-10 15:17:36 -07:00
Ravi Prakash
ac7d0604bc
MAPREDUCE-6923. Optimize MapReduce Shuffle I/O for small partitions. Contributed by Robert Schmidtke.
2017-08-09 15:39:52 -07:00
Jason Lowe
735fce5bec
MAPREDUCE-6927. MR job should only set tracking url if history was successfully written. Contributed by Eric Badger
2017-08-08 14:46:47 -05:00
Arun Suresh
35dc782923
YARN-5977. ContainerManagementProtocol changes to support change of container ExecutionType. (Kartheek Muthyala via asuresh)
2017-08-03 21:15:40 -07:00
Yufei Gu
b8e8241854
MAPREDUCE-6914. Tests use assertTrue(....equals(...)) instead of assertEquals()). (Daniel Templeton via Yufei Gu)
2017-08-03 11:44:34 -07:00
Sean Mackrory
1a1bf6b7d0
HADOOP-13595. Rework hadoop_usage to be broken up by clients/daemons/etc. Contributed by Allen Wittenauer.
2017-08-02 12:25:05 -06:00
Akira Ajisaka
ceacadc51e
MAPREDUCE-6921. TestUmbilicalProtocolWithJobToken#testJobTokenRpc fails.
2017-08-01 14:56:42 +09:00
Junping Du
fbb7d6bcbb
Revert "MAPREDUCE-5875. Make Counter limits consistent across JobClient, MRAppMaster, and YarnChild. (Gera Shegalov via kasha)"
...
This reverts commit e8a31f2e1c
.
2017-07-31 14:09:16 -07:00
Junping Du
713349a9af
Revert "MAPREDUCE-6199. AbstractCounters are not reset completely on deserialization (adhoot via rkanter)"
...
This reverts commit 390a7c12f5
.
2017-07-28 14:21:04 -07:00
Junping Du
e15f928295
Revert "MAPREDUCE-6286. A typo in HistoryViewer makes some code useless, which causes counter limits are not reset correctly. Contributed by Zhihai Xu."
...
This reverts commit 433542904a
.
2017-07-28 14:06:59 -07:00
Akira Ajisaka
38c6fa5c7a
HADOOP-11875. [JDK9] Adding a second copy of Hamlet without _ as a one-character identifier.
2017-07-28 09:10:52 +09:00
Varun Saxena
f66fd11e51
YARN-5548. Use MockRMMemoryStateStore to reduce test failures (Bibin A Chundatt via Varun Saxena)
2017-07-27 23:14:50 +05:30
Akira Ajisaka
cca51e916b
HADOOP-14681. Remove MockitoMaker class. Contributed by Andras Bokor.
2017-07-25 15:24:56 +09:00
Sunil G
fb3b5d33ff
MAPREDUCE-6889. Add Job#close API to shutdown MR client services. Contributed by Rohith Sharma K S.
2017-07-17 13:35:15 +05:30
Ravi Prakash
43f0503286
MAPREDUCE-6910. MapReduceTrackingUriPlugin can not return the right URI of history server with HTTPS. Contributed by Lantao Jin
2017-07-13 16:16:45 -07:00
Junping Du
f484a6ff60
MAPREDUCE-6246. DBOutputFormat.java appending extra semicolon to query which is incompatible with DB2. Contributed by ramtin and Gergely Novák.
2017-07-07 13:26:16 -07:00
Naganarasimha
bf1f59937d
MAPREDUCE-6905. HADOOP_JOB_HISTORY_OPTS should be HADOOP_JOB_HISTORYSERVER_OPTS in mapred-config.sh. Contributed by LiXin Ge.
2017-07-02 15:56:27 +05:30
Andrew Wang
af2773f609
Updating version for 3.0.0-beta1 development
2017-06-29 17:57:40 -07:00
Akira Ajisaka
a5c0476a99
MAPREDUCE-6697. Concurrent task limits should only be applied when necessary. Contributed by Nathan Roberts.
2017-06-28 10:50:09 +09:00
Robert Kanter
2b87faf166
MAPREDUCE-6904. HADOOP_JOB_HISTORY_OPTS should be HADOOP_JOB_HISTORYSERVER_OPTS in mapred-config.sh (rkanter)
2017-06-26 17:35:55 -07:00
Ravi Prakash
82bbcbf37f
MAPREDUCE-6897. Add Unit Test to ensure Job end notification gets sent even when appMaster stop gets YarnRuntimeException. Contributed by Gergely Novák
2017-06-16 14:25:44 -07:00
Jason Lowe
9ef2743fa1
Revert "MAPREDUCE-6898. TestKill.testKillTask is flaky. Contributed by Peter Bacsko"
...
This reverts commit e78542f4be
.
2017-06-16 14:48:51 -05:00
Jason Lowe
e78542f4be
MAPREDUCE-6898. TestKill.testKillTask is flaky. Contributed by Peter Bacsko
2017-06-16 14:24:54 -05:00
Xiao Chen
4ebc23ba7b
HADOOP-14524. Make CryptoCodec Closeable so it can be cleaned up proactively.
2017-06-16 09:49:33 -07:00
Junping Du
6ed54f3439
MAPREDUCE-6895. Job end notification not send due to YarnRuntimeException. Contributed by yunjiong zhao.
2017-06-13 15:21:04 -07:00
Daniel Templeton
036a24bab3
MAPREDUCE-6896. Document wrong spelling in usage of MapredTestDriver tools.
...
(Contributed by LiXin Ge via Daniel Templeton)
2017-06-13 13:21:23 -07:00
Brahma Reddy Battula
24181f559f
MAPREDUCE-6676. NNBench should Throw IOException when rename and delete fails. Contributed by Brahma Reddy Battula.
2017-06-07 16:34:47 +08:00
Sean Busbey
f5517a8200
HADOOP-13921. Remove log4j classes from JobConf.
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2017-06-01 13:35:14 +09:00
Akira Ajisaka
d4015f8628
MAPREDUCE-6887. Modifier 'static' is redundant for inner enums. Contributed by ZhangBing Lin.
2017-05-30 14:48:58 +09:00