Jian He
|
d458805690
|
YARN-1651. CapacityScheduler side changes to support container resize. Contributed by Wangda Tan
(cherry picked from commit 89cab1ba5f )
Conflicts:
hadoop-tools/hadoop-sls/src/main/java/org/apache/hadoop/yarn/sls/scheduler/SLSCapacityScheduler.java
|
2015-09-24 10:30:04 -07:00 |
Jian He
|
c19e8ffdc7
|
YARN-1449. AM-NM protocol changes to support container resizing. Contributed by Meng Ding & Wangda Tan)
(cherry picked from commit 83a18add10 )
|
2015-09-24 10:23:25 -07:00 |
Jian He
|
89dc37450c
|
YARN-3866. AM-RM protocol changes to support container resizing. Contributed by Meng Ding
(cherry picked from commit dfe2cb849f )
|
2015-09-24 10:23:13 -07:00 |
Zhihai Xu
|
e5ba1a0521
|
MAPREDUCE-6484. Yarn Client uses local address instead of RM address as token renewer in a secure cluster when RM HA is enabled. Contributed by Zhihai Xu
(cherry picked from commit 97a08807ec )
|
2015-09-24 08:14:11 -07:00 |
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
|
f48af332a7
|
Release process for 2.6.1: Set the release date for 2.6.1
(cherry picked from commit 1f707ecffd )
|
2015-09-23 15:12:30 -07:00 |
Harsh J
|
38420754f5
|
MAPREDUCE-5045. UtilTest#isCygwin method appears to be unused. Contributed by Neelesh Srinivas Salian.
(cherry picked from commit de1322aa76007832698af682a3b76042116043b9)
|
2015-09-22 21:38:31 +05:30 |
Tsuyoshi Ozawa
|
52cc2ca488
|
HADOOP-12428. Fix inconsistency between log-level guards and statements. Contributed by Jagadesh Kiran N and Jackie Chang.
(cherry picked from commit dfd807afab )
|
2015-09-22 12:54:44 +09:00 |
Zhihai Xu
|
88a3a07636
|
MAPREDUCE-6460. TestRMContainerAllocator.testAttemptNotFoundCausesRMCommunicatorException fails. Contributed by Zhihai Xu.
(cherry picked from commit e3ace31e2b )
|
2015-09-19 00:12:15 -07:00 |
Haohui Mai
|
0971503522
|
MAPREDUCE-6483. Replace deprecated method NameNode.getUri() with DFSUtilClient.getNNUri() in TestMRCredentials. Contributed by Mingliang Liu.
|
2015-09-18 13:36:22 -07:00 |
Jason Lowe
|
9240a021fc
|
Update CHANGES.txt to reflect commit of MR-5982 to 2.7.2
(cherry picked from commit f97dc034fe )
|
2015-09-18 19:25:09 +00:00 |
Wangda Tan
|
6041fc75d8
|
MAPREDUCE-6478. Add an option to skip cleanupJob stage or ignore cleanup failure during commitJob. (Junping Du via wangda)
|
2015-09-18 10:19:32 -07:00 |
Jason Lowe
|
6641ab83eb
|
Update CHANGES.txt to reflect LineRecordReader fixes committed to 2.7.2
(cherry picked from commit 288c8854a6 )
|
2015-09-18 15:16:06 +00:00 |
Jason Lowe
|
f27f1ef44c
|
MAPREDUCE-5982. Task attempts that fail from the ASSIGNED state can disappear. Contributed by Chang Li
(cherry picked from commit ee4ee6af6a )
|
2015-09-17 21:38:44 +00:00 |
Jason Lowe
|
4861fadb17
|
MAPREDUCE-5002. AM could potentially allocate a reduce container to a map attempt. Contributed by Chang Li
(cherry picked from commit 3f82f582e5 )
|
2015-09-17 18:18:28 +00:00 |
Jason Lowe
|
316296e35f
|
MAPREDUCE-6481. LineRecordReader may give incomplete record and wrong position/key information for uncompressed input sometimes. Contributed by Zhihai Xu
(cherry picked from commit 58d1a02b8d )
|
2015-09-17 14:31:57 +00:00 |
Haohui Mai
|
ac2ed09be7
|
MAPREDUCE-6477. Replace usage of deprecated NameNode.DEFAULT_PORT in TestFileSystem. Contributed by Mingliang Liu.
|
2015-09-16 13:06:38 -07:00 |
Jason Lowe
|
52f56524d4
|
MAPREDUCE-6472. MapReduce AM should have java.io.tmpdir=./tmp to be consistent with tasks. Contributed by Naganarasimha G R
(cherry picked from commit 62943b8e3a )
|
2015-09-15 19:44:17 +00:00 |
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
|
cbf90f93f9
|
Updating all CHANGES.txt files to move entires from future releases into 2.6.1
section given the large number of backports to 2.6.1.
(cherry picked from commit fbbb7ff1ed )
|
2015-09-10 14:01:15 -07:00 |
Jason Lowe
|
7909462c3a
|
MAPREDUCE-6474. ShuffleHandler can possibly exhaust nodemanager file descriptors. Contributed by Kuhu Shukla
(cherry picked from commit 8e615588d5 )
|
2015-09-10 16:01:27 +00:00 |
Karthik Kambatla
|
999aa22509
|
MAPREDUCE-6415. Create a tool to combine aggregated logs into HAR files. (Robert Kanter via kasha)
|
2015-09-09 17:49:23 -07:00 |
Tsuyoshi Ozawa
|
8bf5362014
|
MAPREDUCE-6442. Stack trace is missing when error occurs in client protocol provider's constructor Contributed by Chang Li.
(cherry picked from commit 9b685773ec )
|
2015-09-05 11:21:35 +09:00 |
Andrew Wang
|
355398e441
|
HADOOP-12358. Add -safely flag to rm to prompt when deleting many files. Contributed by Xiaoyu Yao.
(cherry picked from commit e1feaf6db0 )
|
2015-09-04 13:48:42 -07:00 |
Akira Ajisaka
|
a61c0f5ca1
|
Revert "MAPREDUCE-6363. [NNBench] Lease mismatch error when running with multiple mappers. Contributed by Brahma Reddy Battula."
This reverts commit 98446ee695 .
|
2015-09-02 12:26:25 +09:00 |
Zhihai Xu
|
297bda600e
|
MAPREDUCE-6452. NPE when intermediate encrypt enabled for LocalRunner. Contributed by Zhihai Xu
(cherry picked from commit cbb249534a )
|
2015-08-28 12:20:49 -07:00 |
Jian He
|
387076894f
|
YARN-4014. Support user cli interface in for Application Priority. Contributed by Rohith Sharma K S
(cherry picked from commit 57c7ae1aff )
|
2015-08-24 20:37:18 -07:00 |
Akira Ajisaka
|
29819e7240
|
MAPREDUCE-6357. MultipleOutputs.write() API should document that output committing is not utilized when input path is absolute. Contributed by Dustin Cote.
(cherry picked from commit 2ba90c93d7 )
|
2015-08-21 10:43:05 +09:00 |
Vinod Kumar Vavilapalli
|
9da81a3955
|
MAPREDUCE-6454. Fixed MapReduce to modify HADOOP_CLASSPATH to have distributed cache files so that child processes running hadoop scripts can access these files. Contributed by Junping Du.
|
2015-08-20 17:35:24 -07:00 |
Vinod Kumar Vavilapalli
|
45be1240d9
|
Creating 2.6.2 entries in CHANGES.txt files.
(cherry picked from commit 33474939a0 )
|
2015-08-20 17:23:54 -07:00 |
Karthik Kambatla
|
20734320a1
|
MAPREDUCE-6439. AM may fail instead of retrying if RM shuts down during the allocate call. (Anubhav Dhoot via kasha)
(cherry picked from commit 8dfec7a197 )
|
2015-08-15 00:53:13 -07:00 |
Karthik Kambatla
|
b826168173
|
MAPREDUCE-5817. Mappers get rescheduled on node transition even after all reducers are completed. (Sangjin Lee via kasha)
(cherry picked from commit 27d24f96ab )
|
2015-08-14 12:40:38 -07:00 |
Junping Du
|
c8469357ba
|
MAPREDUCE-6443. Add JvmPauseMonitor to JobHistoryServer. Contributed by Robert Kanter.
|
2015-08-06 07:00:42 -07:00 |
Colin Patrick Mccabe
|
07a042aa3c
|
HADOOP-7824. NativeIO.java flags and identifiers must be set correctly for each platform, not hardcoded to their Linux values (Martin Walsh via Colin P. McCabe)
(cherry picked from commit 21d10ccc6e )
|
2015-07-31 15:02:01 -07:00 |
Jason Lowe
|
508da4d461
|
MAPREDUCE-6394. Speed up Task processing loop in HsTasksBlock#render(). Contributed by Ray Chiang
(cherry picked from commit d0e0ba8010 )
|
2015-07-31 18:19:52 +00:00 |
Zhihai Xu
|
9d40eead81
|
MAPREDUCE-6433. launchTime may be negative. Contributed by Zhihai Xu
(cherry picked from commit 93d50b7824 )
|
2015-07-30 23:12:30 -07:00 |
Akira Ajisaka
|
4da8ff60ef
|
MAPREDUCE-5762. Port MAPREDUCE-3223 and MAPREDUCE-4695 (Remove MRv1 config from mapred-default.xml) to branch-2. (aajisaka)
|
2015-07-16 03:43:49 +09:00 |
Chris Douglas
|
2a0e551cd8
|
MAPREDUCE-6427. Fix typo in JobHistoryEventHandler. Contributed by Ray Chiang
|
2015-07-14 14:56:21 -07:00 |
Akira Ajisaka
|
0ba2defb9e
|
YARN-3381. Fix typo InvalidStateTransitonException. Contributed by Brahma Reddy Battula.
(cherry picked from commit 19295b36d9 )
|
2015-07-13 17:53:27 +09:00 |
Akira Ajisaka
|
0e4d251fb2
|
MAPREDUCE-6421. Fix findbugs warning in RMContainerAllocator.reduceNodeLabelExpression. Contributed by Brahma Reddy Battula.
(cherry picked from commit e04faf8e46 )
|
2015-07-13 14:29:39 +09:00 |
Devaraj K
|
3074d7082e
|
MAPREDUCE-6426. TestShuffleHandler#testGetMapOutputInfo is failing.
Contributed by zhihai xu.
(cherry picked from commit fffb15bb43 )
|
2015-07-09 15:02:09 +05:30 |
Chris Douglas
|
5fbf91b453
|
MAPREDUCE-6038. A boolean may be set error in the Word Count v2.0 in MapReduce Tutorial. Contributed by Tsuyoshi Ozawa
(cherry picked from commit 4990ccfdc742be9c0517557a6256fefcae0df67d)
|
2015-07-07 10:26:57 -07:00 |
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
|
a8bf34cad8
|
Release process for 2.7.1: Set the release date for 2.7.1.
(cherry picked from commit bf89ddb9b8 )
|
2015-07-06 16:41:00 -07:00 |
Devaraj K
|
415dd64461
|
MAPREDUCE-6425. ShuffleHandler passes wrong "base" parameter to
getMapOutputInfo if mapId is not in the cache. Contributed by zhihai xu.
(cherry picked from commit bff67dfe2f )
|
2015-07-06 13:47:54 +05:30 |
Jason Lowe
|
8a4970e845
|
MAPREDUCE-6418. MRApp should not shutdown LogManager during shutdown. Contributed by Chang Li
(cherry picked from commit eac1d18943 )
|
2015-07-01 18:02:17 +00:00 |
Jason Lowe
|
f3195eda27
|
MAPREDUCE-6420. Interrupted Exception in LocalContainerLauncher should be logged in warn/info level. Contributed by Chang Li
(cherry picked from commit 826715622e )
|
2015-07-01 17:50:47 +00:00 |
Jason Lowe
|
df4e1e4965
|
MAPREDUCE-6376. Add avro binary support for jhist files. Contributed by Ray Chiang
(cherry picked from commit 2ac87df578 )
Conflicts:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
|
2015-07-01 16:07:54 +00:00 |
cnauroth
|
f7ba3c0045
|
HADOOP-12116. Fix unrecommended syntax usages in hadoop/hdfs/yarn script for cygwin in branch-2. Contributed by Li Lu.
|
2015-06-30 16:55:10 -07:00 |
Robert Kanter
|
e5b0439bc1
|
MAPREDUCE-6121. JobResourceUpdater#compareFs() doesn't handle HA namespaces (rchiang via rkanter)
(cherry picked from commit 3a72bfd082 )
|
2015-06-30 16:50:48 -07:00 |
Jason Lowe
|
fdfd5be2b3
|
MAPREDUCE-6384. Add the last reporting reducer info for too many fetch failure diagnostics. Contributed by Chang Li
(cherry picked from commit b6ba56457c )
|
2015-06-30 21:24:38 +00:00 |
Vinod Kumar Vavilapalli
|
4155bb565e
|
Adding release 2.7.2 to CHANGES.txt.
(cherry picked from commit aad6a7d5db )
|
2015-06-28 16:30:27 -07:00 |
Jason Lowe
|
31fd7a51d8
|
MAPREDUCE-6413. TestLocalJobSubmission is failing with unknown host. Contributed by zhihai xu
(cherry picked from commit aa5b15b03b )
|
2015-06-25 19:52:23 +00:00 |
Jason Lowe
|
2762affbb2
|
MAPREDUCE-6400. Multiple shuffle transfer fails because input is closed too early. Contributed by Brahma Reddy Battula, Akira AJISAKA, and Gera Shegalov.
(cherry picked from commit 72d08a0e41 )
|
2015-06-24 15:30:09 +00:00 |
Vinod Kumar Vavilapalli
|
8c9e2cf10a
|
MAPREDUCE-6410. Fixed MapReduce JobHistory server to use the right (login) UGI to refresh log and cleaner settings. Contributed by Varun Saxena.
(cherry picked from commit d481684c7c )
|
2015-06-23 11:41:05 -07:00 |
Jason Lowe
|
3bf44b862b
|
MAPREDUCE-5948. org.apache.hadoop.mapred.LineRecordReader does not handle multibyte record delimiters well. Contributed by Vinayakumar B, Rushabh Shah, and Akira AJISAKA
(cherry picked from commit 077250d8d7 )
|
2015-06-22 22:00:20 +00:00 |
Gera Shegalov
|
d8cc8f54dd
|
MAPREDUCE-6408. Queue name and user name should be printed on the job page. (Siqi Li via gera)
(cherry picked from commit 11ac848207 )
|
2015-06-22 14:42:31 -07:00 |
Akira Ajisaka
|
c4747158b7
|
MAPREDUCE-6403. Fix typo in the usage of NNBench. Contributed by Jagadesh Kiran N.
(cherry picked from commit 445b13240c )
|
2015-06-22 15:34:34 +09:00 |
Gera Shegalov
|
ee63c3e831
|
MAPREDUCE-6305. AM/Task log page should be able to link back to the job. (Siqi Li via gera)
(cherry picked from commit 055cd5a9a1 )
|
2015-06-20 12:40:59 -07:00 |
Gera Shegalov
|
34e744ce1a
|
MAPREDUCE-6316. Task Attempt List entries should link to the task overview. (Siqi Li via gera)
(cherry picked from commit 63d40d5286 )
|
2015-06-20 11:52:11 -07:00 |
Devaraj K
|
5c3070dc16
|
MAPREDUCE-6405. NullPointerException in App Attempts page. Contributed by
Siqi Li and Gera Shegalov.
(cherry picked from commit 311a4179cc )
|
2015-06-20 10:37:42 +05:30 |
Gera Shegalov
|
01991876ed
|
MAPREDUCE-6395. Improve the commit failure messages in MRAppMaster recovery. (Brahma Reddy Battula via gera)
(cherry picked from commit 10107243be )
|
2015-06-19 02:29:31 -07:00 |
Devaraj K
|
c4c7fd0bf1
|
MAPREDUCE-6373. The logger reports total input paths but it is referring
to input files. Contributed by Bibin A Chundatt.
(cherry picked from commit 1babe50a2c )
|
2015-06-18 11:45:11 +05:30 |
Akira Ajisaka
|
98446ee695
|
MAPREDUCE-6363. [NNBench] Lease mismatch error when running with multiple mappers. Contributed by Brahma Reddy Battula.
(cherry picked from commit 75a2560e51 )
|
2015-06-15 14:53:28 -07:00 |
Devaraj K
|
b117527bf3
|
MAPREDUCE-6389. Fix BaileyBorweinPlouffe CLI usage message. Contributed by
Brahma Reddy Battula.
(cherry picked from commit c7729efee8 )
|
2015-06-10 21:06:35 +05:30 |
Devaraj K
|
5426e3e929
|
MAPREDUCE-6350. JobHistory doesn't support fully-functional search.
Contributed by Siqi Li.
|
2015-06-10 12:43:31 +05:30 |
cnauroth
|
5a002aef12
|
MAPREDUCE-6392. Document mapred class path options. Contributed by Brahma Reddy Battula.
(cherry picked from commit 025a3a8be0 )
|
2015-06-08 16:22:12 -07:00 |
Tsuyoshi Ozawa
|
c6cdecc6b3
|
MAPREDUCE-6388. Remove deprecation warnings from JobHistoryServer classes. Contributed by Ray Chiang.
(cherry picked from commit 6afe20a7a4 )
|
2015-06-08 15:06:23 -07:00 |
Jason Lowe
|
588c22e5a0
|
MAPREDUCE-6354. ShuffleHandler should be able to log shuffle connections. Contributed by Chang Li
(cherry picked from commit b3ffa87003 )
|
2015-06-05 22:39:52 +00:00 |
Karthik Kambatla
|
1a2e6e8091
|
MAPREDUCE-6387. Serialize the recently added Task#encryptedSpillKey field at the end. (Arun Suresh via kasha)
(cherry picked from commit 6786daab33 )
|
2015-06-05 09:17:34 -07:00 |
Devaraj K
|
37ad3b3fef
|
MAPREDUCE-6383. Pi job (QuasiMonteCarlo) should not try to read the
results file if its job fails. Contributed by Harsh J.
(cherry picked from commit 09b8241e6e )
|
2015-06-05 21:23:48 +05:30 |
Devaraj K
|
7f075f2b75
|
MAPREDUCE-6377. JHS sorting on state column not working in webUi.
Contributed by zhihai xu.
(cherry picked from commit 790a861766 )
Conflicts:
hadoop-mapreduce-project/CHANGES.txt
|
2015-06-05 16:03:02 +05:30 |
Vinod Kumar Vavilapalli
|
6044b5e5f6
|
MAPREDUCE-5232. Add a configuration to be able to log classpath and other system properties on mapreduce JVMs startup. Contributed by Sangjin Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1482643 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 4d8e350750 )
Conflicts:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/v2/util/TestMRApps.java
|
2015-06-04 11:15:30 -07:00 |
Akira Ajisaka
|
1cccd1eeb3
|
HADOOP-12058. Fix dead links to DistCp and Hadoop Archives pages. Contributed by Kazuho Fujii.
(cherry picked from commit dbed757cba )
|
2015-06-05 01:46:33 +09:00 |
Gera Shegalov
|
bae1ec5f29
|
MAPREDUCE-6382. Don't escape HTML links in Diagnostics in JHS job overview. (Siqi Li via gera)
(cherry picked from commit e8302071ff )
|
2015-06-03 23:52:16 -07:00 |
Robert Kanter
|
ee3002933a
|
MAPREDUCE-5965. Hadoop streaming throws error if list of input files is high. Error is: "error=7, Argument list too long at if number of input file is high" (wilfreds via rkanter)
(cherry picked from commit cc70df98e7 )
|
2015-06-03 18:42:16 -07:00 |
Gera Shegalov
|
25c1e54d3f
|
MAPREDUCE-6174. Combine common stream code into parent class for InMemoryMapOutput and OnDiskMapOutput. (Eric Payne via gera)
(cherry picked from commit d90c13e2da )
|
2015-06-03 16:57:54 -07:00 |
Zhijie Shen
|
2fcd3fe6ba
|
Revert "YARN-1462. Made RM write application tags to timeline server and exposed them to users via generic history web UI and REST API. Contributed by Xuan Gong."
This reverts commit 4e2ed34d20 .
|
2015-06-03 14:16:51 -07:00 |
Jason Lowe
|
5ecc647ae0
|
MAPREDUCE-6374. Distributed Cache File visibility should check permission of full path. Contributed by Chang Li
(cherry picked from commit 107da29ff9 )
|
2015-06-03 20:20:47 +00:00 |
Zhijie Shen
|
4e2ed34d20
|
YARN-1462. Made RM write application tags to timeline server and exposed them to users via generic history web UI and REST API. Contributed by Xuan Gong.
(cherry picked from commit a9f986bc5a41ab74171da1076d10e83c5adc284f)
|
2015-05-30 21:06:32 -07:00 |
Andrew Wang
|
bdaa0fed13
|
HADOOP-11885. hadoop-dist dist-layout-stitching.sh does not work with dash. (wang)
(cherry picked from commit 7673d4f205 )
Conflicts:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-nativetask/pom.xml
hadoop-mapreduce-project/pom.xml
|
2015-05-29 14:55:52 -07:00 |
Wangda Tan
|
7cd0874dfd
|
MAPREDUCE-6304. Specifying node labels when submitting MR jobs. (Naganarasimha G R via wangda)
(cherry picked from commit 3164e7d838 )
Conflicts:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/RMContainerAllocator.java
|
2015-05-27 14:43:20 -07:00 |
cnauroth
|
6ed8989a6f
|
YARN-3626. On Windows localized resources are not moved to the front of the classpath when they should be. Contributed by Craig Welch.
(cherry picked from commit 7bc33b63c78c6ee9a04c0c1511ef16e63f7f3074)
|
2015-05-27 14:21:15 -07:00 |
Colin Patrick Mccabe
|
3dec58dd78
|
HADOOP-11969. ThreadLocal initialization in several classes is not thread safe (Sean Busbey via Colin P. McCabe)
(cherry picked from commit 7dba7005b7 )
|
2015-05-26 12:40:41 -07:00 |
Tsuyoshi Ozawa
|
e694c3339e
|
MAPREDUCE-6364. Add a Kill link to Task Attempts page. Contributed by Ryu Kobayashi.
(cherry picked from commit 022f49d59e )
|
2015-05-26 23:59:20 +09:00 |
Tsuyoshi Ozawa
|
6042b53a74
|
MAPREDUCE-6204. TestJobCounters should use new properties instead of JobConf.MAPRED_TASK_JAVA_OPTS.
(cherry picked from commit b27ce3c531 )
|
2015-05-22 23:30:12 +09:00 |
Vinayakumar B
|
19895a41ad
|
HADOOP-11743. maven doesn't clean all the site files (Contributed by ramtin)
(cherry picked from commit 55ed6558ba )
Conflicts:
hadoop-common-project/hadoop-common/pom.xml
|
2015-05-22 16:46:50 +05:30 |
Wangda Tan
|
b5ba6979b7
|
YARN-3583. Support of NodeLabel object instead of plain String in YarnClient side. (Sunil G via wangda)
(cherry picked from commit 563eb1ad2a )
(cherry picked from commit b0d22b0c606fad6b4ab5443c0aed07c829b46726)
|
2015-05-19 17:37:24 -07:00 |
Junping Du
|
dafe33efbf
|
Moving MAPREDUCE-6361 to 2.7.1 CHANGES.txt
|
2015-05-19 11:53:46 -07:00 |
Devaraj K
|
b9865cbf3d
|
MAPREDUCE-6273. HistoryFileManager should check whether summaryFile exists
to avoid FileNotFoundException causing HistoryFileInfo into MOVE_FAILED
state. Contributed by zhihai xu.
(cherry picked from commit 1ea90144d5 )
|
2015-05-15 12:34:08 +05:30 |
Vinod Kumar Vavilapalli
|
87862970f1
|
Fixing MR intermediate spills. Contributed by Arun Suresh.
(cherry picked from commit 6b710a42e0 )
|
2015-05-14 16:56:56 -07:00 |
Devaraj K
|
454236ec19
|
MAPREDUCE-5708. Duplicate String.format in
YarnOutputFiles.getSpillFileForWrite. Contributed by Konstantin Weitz.
(cherry picked from commit 05ff54c66c )
|
2015-05-14 22:11:15 +05:30 |
Xuan
|
487d9b0f3f
|
YARN-3626. On Windows localized resources are not moved to the front of the classpath when they should be. Contributed by Craig Welch
(cherry picked from commit 0f95921447 )
|
2015-05-13 13:12:04 -07:00 |
cnauroth
|
ddc4afeff2
|
HADOOP-11966. Variable cygwin is undefined in hadoop-config.sh when executed through hadoop-daemon.sh. Contributed by Chris Nauroth.
|
2015-05-13 12:25:49 -07:00 |
Tsuyoshi Ozawa
|
780d4f416e
|
MAPREDUCE-6366. mapreduce.terasort.final.sync configuration in TeraSort doesn't work. Contributed by Takuya Fukudome.
(cherry picked from commit e82067bfe6 )
|
2015-05-13 16:45:46 +09:00 |
Akira Ajisaka
|
345e62c6d5
|
Revert "MAPREDUCE-5762. Port MAPREDUCE-3223 (Remove MRv1 config from mapred-default.xml) to branch-2. (aajisaka)"
This reverts commit 853cc04668 .
|
2015-05-13 14:02:41 +09:00 |
Vinod Kumar Vavilapalli
|
d5755ba241
|
MAPREDUCE-6251. Added a new config for JobClient to retry JobStatus calls so that they don't fail on history-server backed by DFSes with not so strong guarantees. Contributed by Craig Welch.
(cherry picked from commit f24452d14e )
|
2015-05-12 12:13:23 -07:00 |
Tsuyoshi Ozawa
|
fb5b0ebb45
|
MAPREDUCE-6361. NPE issue in shuffle caused by concurrent issue between copySucceeded() in one thread and copyFailed() in another thread on the same host. Contributed by Junping Du.
(cherry picked from commit f4e2b3cc0b )
|
2015-05-13 00:28:36 +09:00 |
Vinayakumar B
|
cda1962996
|
MAPREDUCE-6360. TestMapreduceConfigFields is placed in wrong dir, introducing compile error (Contributed by Arshad Mohammad)
(cherry picked from commit 360dff5903 )
|
2015-05-12 12:50:44 +05:30 |
Jason Lowe
|
53e9973afc
|
MAPREDUCE-5465. Tasks are often killed before they exit on their own. Contributed by Ming Ma
|
2015-05-11 22:40:05 +00:00 |
Junping Du
|
a1a7deebf8
|
YARN-3587. Fix the javadoc of DelegationTokenSecretManager in yarn, etc. projects. Contributed by Gabor Liptak.
(cherry picked from commit 7e543c27fa )
|
2015-05-11 05:28:25 -07:00 |
Karthik Kambatla
|
52469b10dd
|
MAPREDUCE-6353. Divide by zero error in MR AM when calculating available containers. (Anubhav Dhoot via kasha)
(cherry picked from commit 1773aac780 )
|
2015-05-09 14:43:57 -07:00 |
Karthik Kambatla
|
e8dd0bc4fd
|
YARN-1287. Consolidate MockClocks. (Sebastian Wong and Anubhav Dhoot via kasha)
(cherry picked from commit 70fb37cd79 )
|
2015-05-09 14:35:13 -07:00 |
Junping Du
|
39c188449e
|
MAPREDUCE-6359. In RM HA setup, Cluster tab links populated with AM hostname instead of RM. Contributed by zhaoyunjiong.
(cherry picked from commit df36ad0a08 )
|
2015-05-09 06:12:01 -07:00 |
Ravi Prakash
|
23065e6051
|
MAPREDUCE-4750. Enable NNBenchWithoutMR in MapredTestDriver (Liang Xie and Jason Lowe via raviprak)
(cherry picked from commit 5aab014340 )
|
2015-05-08 15:58:29 -07:00 |
Jason Lowe
|
0f6c971282
|
MAPREDUCE-5248. Let NNBenchWithoutMR specify the replication factor for its test. Contributed by Erik Paulson
(cherry picked from commit 30099a36c6 )
|
2015-05-08 22:30:21 +00:00 |
Chris Douglas
|
4f301f92c1
|
MAPREDUCE-2094. LineRecordReader should not seek into non-splittable, compressed streams.
|
2015-05-08 14:30:56 -07:00 |
Jason Lowe
|
dfc4a62f7d
|
MAPREDUCE-3383. Duplicate job.getOutputValueGroupingComparator() in ReduceTask. Contributed by Binglin Chang
(cherry picked from commit c39012f4a0 )
|
2015-05-08 21:17:05 +00:00 |
Devaraj K
|
a957baeb71
|
MAPREDUCE-5981. Log levels of certain MR logs can be changed to DEBUG.
Contributed by Varun Saxena.
(cherry picked from commit dc2b2ae31f )
|
2015-05-08 21:28:52 +05:30 |
Devaraj K
|
ade5165ecf
|
MAPREDUCE-6342. Make POM project names consistent. Contributed by Rohith.
|
2015-05-08 15:20:35 +05:30 |
Akira Ajisaka
|
5cc036d473
|
MAPREDUCE-6079. Rename JobImpl#username to reporterUserName. Contributed by Tsuyoshi Ozawa.
(cherry picked from commit ecfa052274 )
|
2015-05-08 18:17:35 +09:00 |
Tsuyoshi Ozawa
|
1ae8bf5b21
|
MAPREDUCE-6284. Add Task Attempt State API to MapReduce Application Master REST API. Contributed by Ryu Kobayashi.
(cherry picked from commit d18f10ad1b )
|
2015-05-08 16:00:41 +09:00 |
Jason Lowe
|
976a3c1f9d
|
MAPREDUCE-6279. AM should explicity exit JVM after all services have stopped. Contributed by Eric Payne
(cherry picked from commit f30065c8b6 )
|
2015-05-07 22:06:54 +00:00 |
Akira Ajisaka
|
f7c011cbaa
|
MAPREDUCE-6356. Misspelling of threshold in log4j.properties for tests. Contributed by Brahma Reddy Battula.
(cherry picked from commit d335071398 )
|
2015-05-07 19:41:44 +09:00 |
Robert Kanter
|
bd207b6cc0
|
MAPREDUCE-6192. Create unit test to automatically compare MR related classes and mapred-default.xml (rchiang via rkanter)
|
2015-05-05 14:47:52 -07:00 |
Xuan
|
02cdcaec58
|
YARN-2123. Progress bars in Web UI always at 100% due to non-US locale.
Contributed by Akira AJISAKA
(cherry picked from commit b7dd3a4f04 )
|
2015-05-05 10:45:18 -07:00 |
Tsuyoshi Ozawa
|
4e96175b33
|
MAPREDUCE-6165. [JDK8] TestCombineFileInputFormat failed on JDK8. Contributed by Akira AJISAKA.
(cherry picked from commit 551615fa13 )
|
2015-05-05 10:23:25 +09:00 |
Jason Lowe
|
81f128f293
|
MAPREDUCE-6259. IllegalArgumentException due to missing job submit time. Contributed by zhihai xu
(cherry picked from commit bf70c5ae28 )
|
2015-05-04 20:40:16 +00:00 |
Jason Lowe
|
87c2d915f1
|
MAPREDUCE-5649. Reduce cannot use more than 2G memory for the final merge. Contributed by Gera Shegalov
(cherry picked from commit 7dc3c1203d )
|
2015-05-04 19:03:43 +00:00 |
Tsuyoshi Ozawa
|
7e03bda3e7
|
MAPREDUCE-6349. Fix typo in property org.apache.hadoop.mapreduce.lib.chain.Chain.REDUCER_INPUT_VALUE_CLASS. Contributed by Ray Chiang.
(cherry picked from commit bb6ef2984d )
|
2015-05-04 15:36:53 +09:00 |
Tsuyoshi Ozawa
|
1035f550b9
|
MAPREDUCE-5905. CountersStrings.toEscapedCompactStrings outputs unnecessary null strings. Contributed by Akira AJISAKA.
(cherry picked from commit 3ba18362f2 )
|
2015-05-04 15:02:40 +09:00 |
Gera Shegalov
|
ff6492d603
|
MAPREDUCE-6345. Documentation fix for when CRLA is enabled for MRAppMaster logs. (Rohit Agarwal via gera)
(cherry picked from commit f1a152cc0a )
|
2015-05-01 19:07:14 -07:00 |
Devaraj K
|
c3d083a9ff
|
MAPREDUCE-6339. Job history file is not flushed correctly because
isTimerActive flag is not set true when flushTimerTask is scheduled.
Contributed by zhihai xu.
(cherry picked from commit f5b38477f9 )
|
2015-04-30 12:36:00 +05:30 |
Jason Lowe
|
ea828578a3
|
MAPREDUCE-6334. Fetcher#copyMapOutput is leaking usedMemory upon IOException during InMemoryMapOutput shuffle handler. Contributed by Eric Payne
(cherry picked from commit bc1bd7e5c4 )
|
2015-04-28 20:19:52 +00:00 |
Devaraj K
|
1d03ac3533
|
Moving MAPREDUCE-6252 to the 2.7.1 CHANGES.txt
(cherry picked from commit 99fe03e439 )
|
2015-04-28 12:44:07 +05:30 |
Vinod Kumar Vavilapalli
|
32dc13d907
|
MAPREDUCE-6324. Fixed MapReduce uber jobs to not fail the udpate of AM-RM tokens when they roll-over. Contributed by Jason Lowe.
(cherry picked from commit 9fc32c5c4d )
|
2015-04-27 14:59:57 -07:00 |
Tsuyoshi Ozawa
|
fa9def5a2a
|
MAPREDUCE-6341. Fix typo in mapreduce tutorial. Contributed by John Michael Luy.
(cherry picked from commit 9a3dda3d34 )
Conflicts:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/site/markdown/MapReduceTutorial.md
|
2015-04-28 01:58:12 +09:00 |
Devaraj K
|
84ae26573c
|
MAPREDUCE-6252. JobHistoryServer should not fail when encountering a
missing directory. Contributed by Craig Welch.
(cherry picked from commit 5e67c4d384 )
|
2015-04-27 15:02:44 +05:30 |
Gera Shegalov
|
fa915f73e2
|
MAPREDUCE-6333. TestEvents,TestAMWebServicesTasks,TestAppController are broken due to MAPREDUCE-6297. (Siqi Li via gera)
(cherry picked from commit 78c6b46241 )
|
2015-04-24 17:38:16 -07:00 |
Vinod Kumar Vavilapalli
|
db1a33e956
|
Moving YARN-3351, YARN-3382, YARN-3472, MAPREDUCE-6238 to the 2.7.1 CHANGES.txt
sections given the recent merge into branch-2.7.
(cherry picked from commit 2f82ae042a )
|
2015-04-24 17:20:02 -07:00 |
Vinod Kumar Vavilapalli
|
0ec6e7e7f5
|
YARN-3413. Changed Nodelabel attributes (like exclusivity) to be settable only via addToClusterNodeLabels but not changeable at runtime. (Wangda Tan via vinodkv)
(cherry picked from commit f5fe35e297 )
|
2015-04-23 11:25:30 -07:00 |
Tsuyoshi Ozawa
|
a479669e96
|
Fix a misleading summary of MAPREDUCE-6330 in CHANGES.txt.
(cherry picked from commit 252e69f562 )
|
2015-04-23 03:28:46 +09:00 |
Tsuyoshi Ozawa
|
542d53a268
|
MAPREDUCE-6330. Fix typo in some Task Attempt API's URL. Contributed by Ryu Kobayashi.
(cherry picked from commit e33594dd87 )
|
2015-04-23 03:22:02 +09:00 |
Gera Shegalov
|
6f06e3b7ea
|
MAPREDUCE-6297. Task Id of the failed task in diagnostics should link to the task page. (Siqi Li via gera)
(cherry picked from commit 89ded89e86 )
|
2015-04-21 14:21:57 -07:00 |
Gera Shegalov
|
6f5dc9f5af
|
MAPREDUCE-6293. Set job classloader on uber-job's LocalContainerLauncher event thread. (Sangjin Lee via gera)
(cherry picked from commit 725eb52ddc )
|
2015-04-21 14:21:56 -07:00 |
Vinod Kumar Vavilapalli
|
27fc4fb998
|
Set the release date for 2.7.0
(cherry picked from commit d52de61544 )
|
2015-04-20 20:18:01 -07:00 |
Robert Kanter
|
756c254293
|
MAPREDUCE-6238. MR2 can't run local jobs with -libjars command options which is a regression from MR1 (zxu via rkanter)
(cherry picked from commit d50e8f0928 )
|
2015-04-20 14:14:49 -07:00 |
Jian He
|
42cf8e0554
|
YARN-3021. YARN's delegation-token handling disallows certain trust setups to operate properly over DistCp. Contributed by Yongjun Zhang
(cherry picked from commit bb6dde68f1 )
|
2015-04-16 19:44:32 -07:00 |
Akira Ajisaka
|
51c458a5c4
|
MAPREDUCE-6300. Task list sort by task id broken. Contributed by Siqi Li.
(cherry picked from commit 1fa8075794 )
|
2015-04-16 10:06:03 -05:00 |
Akira Ajisaka
|
4801b0b478
|
Revert "MAPREDUCE-6300. Task list sort by task id broken. Contributed by Siqi Li."
This reverts commit 3de0bf9a35 .
|
2015-04-11 12:37:44 +09:00 |
Jian He
|
d3daf9665c
|
YARN-3348. Add a 'yarn top' tool to help understand cluster usage. Contributed by Varun Vasudev
|
2015-04-10 10:40:31 -07:00 |
Akira Ajisaka
|
3de0bf9a35
|
MAPREDUCE-6300. Task list sort by task id broken. Contributed by Siqi Li.
(cherry picked from commit 4cec9975c0e2c2fcca090888dc2c5e149c5be1e9)
|
2015-04-11 01:31:44 +09:00 |
Akira Ajisaka
|
f603b9ccca
|
MAPREDUCE-6307. Remove property mapreduce.tasktracker.taskmemorymanager.monitoringinterval. Contributed by J.Andreina.
(cherry picked from commit 83979e61a4 )
Conflicts:
hadoop-mapreduce-project/CHANGES.txt
|
2015-04-10 20:23:46 +09:00 |
Harsh J
|
b817f0924d
|
MAPREDUCE-6314. TestPipeApplication fails on trunk. Contributed by Varun Vasudev.
(cherry picked from commit c91b2de68a )
|
2015-04-10 14:03:37 +05:30 |
Vinod Kumar Vavilapalli
|
aec1c5ec7d
|
Adding release 2.7.1 to CHANGES.txt
(cherry picked from commit 623fd46c1e )
|
2015-04-09 13:56:14 -07:00 |
Robert Kanter
|
0fdd5c23c3
|
MAPREDUCE-6266. Job#getTrackingURL should consistently return a proper URL (rchiang via rkanter)
(cherry picked from commit c4986b2d00 )
|
2015-04-09 13:49:03 -07:00 |
Hitesh Shah
|
55b794e7fa
|
YARN-2890. MiniYarnCluster should turn on timeline service if configured to do so. Contributed by Mit Desai.
(cherry picked from commit 265ed1fe80 )
|
2015-04-08 14:14:06 -07:00 |
Gera Shegalov
|
3757e731e6
|
MAPREDUCE-4844. Counters / AbstractCounters have constant references not declared final. (Brahma Reddy Battula via gera)
(cherry picked from commit a0795c1e81 )
|
2015-04-03 10:35:18 -07:00 |
Junping Du
|
cacadea632
|
MAPREDUCE-6303. Read timeout when retrying a fetch error can be fatal to a reducer. Contributed by Jason Lowe.
(cherry picked from commit eccb7d46ef )
|
2015-04-02 12:15:12 -07:00 |
Vinod Kumar Vavilapalli
|
4cf44bef5c
|
Reverted MAPREDUCE-6286, MAPREDUCE-6199, and MAPREDUCE-5875 from branch-2.7. Editing CHANGES.txt to reflect this.
(cherry picked from commit e428fea730 )
|
2015-03-31 13:30:22 -07:00 |
Vinod Kumar Vavilapalli
|
defae1d399
|
Revert "MAPREDUCE-6288. Changed permissions on JobHistory server's done directory so that user's client can load the conf files directly. Contributed by Robert Kanter."
This reverts commit 5358b83167 .
(cherry picked from commit cc0a01c503 )
|
2015-03-30 14:52:36 -07:00 |
Vinod Kumar Vavilapalli
|
cc130a033a
|
MAPREDUCE-6288. Changed permissions on JobHistory server's done directory so that user's client can load the conf files directly. Contributed by Robert Kanter.
(cherry picked from commit 5358b83167 )
|
2015-03-30 10:28:28 -07:00 |
Vinod Kumar Vavilapalli
|
c5bc48946d
|
YARN-3304. Cleaning up ResourceCalculatorProcessTree APIs for public use and removing inconsistencies in the default values. Contributed by Junping Du and Karthik Kambatla.
(cherry picked from commit c358368f51 )
|
2015-03-30 10:11:12 -07:00 |
Harsh J
|
274db918c3
|
MAPREDUCE-6291. Correct mapred queue usage command. Contributed by Brahma Reddy Battula.
(cherry picked from commit f5432cb47dfacaa57faed32a29d00bbeff8a5385)
|
2015-03-28 11:58:44 +05:30 |
Akira Ajisaka
|
853cc04668
|
MAPREDUCE-5762. Port MAPREDUCE-3223 (Remove MRv1 config from mapred-default.xml) to branch-2. (aajisaka)
|
2015-03-28 03:35:03 +09:00 |
Tsuyoshi Ozawa
|
f0aa2a7466
|
MAPREDUCE-6294. Remove an extra parameter described in Javadoc of TockenCache. Contributed by Brahma Reddy Battula.
(cherry picked from commit 05499b1093 )
|
2015-03-28 00:08:56 +09:00 |
Akira Ajisaka
|
2e509908ee
|
MAPREDUCE-6292. Use org.junit package instead of junit.framework in TestCombineFileInputFormat. (aajisaka)
(cherry picked from commit c770df49b4 )
|
2015-03-25 19:01:38 +09:00 |
Harsh J
|
d85c14afbf
|
MAPREDUCE-579. Streaming slowmatch documentation.
(cherry picked from commit a2e42d2deee715f6255d6fd2c95f34e80888dc5f)
|
2015-03-25 14:39:46 +05:30 |
Tsuyoshi Ozawa
|
94eb8e5b3d
|
MAPREDUCE-6285. ClientServiceDelegate should not retry upon AuthenticationException. Contributed by Jonathan Eagles.
(cherry picked from commit 4170c99147 )
|
2015-03-25 00:57:08 +09:00 |
Devaraj K
|
943d9ee603
|
MAPREDUCE-6242. Progress report log is incredibly excessive in application
master. Contributed by Varun Saxena.
|
2015-03-23 22:48:00 +05:30 |
Harsh J
|
2cd2431289
|
MAPREDUCE-6287. Deprecated methods in org.apache.hadoop.examples.Sort. Contributed by Chao Zhang.
(cherry picked from commit b375d1fc93 )
|
2015-03-23 03:48:55 +05:30 |
Harsh J
|
6e6e0e4a37
|
MAPREDUCE-5448. Addendum fix to remove deprecation warning by junit.Assert import in TestFileOutputCommitter.
(cherry picked from commit 4cd54d9a29 )
|
2015-03-22 10:33:29 +05:30 |
Harsh J
|
40682a4aad
|
MAPREDUCE-6286. Amend commit to CHANGES.txt for backport into 2.7.0.
(cherry picked from commit 8770c82acc )
|
2015-03-22 10:16:12 +05:30 |
Harsh J
|
d43c0da7d7
|
MAPREDUCE-5190. Unnecessary condition test in RandomSampler. Contributed by Jingguo Yao.
(cherry picked from commit 1d5c796d65 )
|
2015-03-22 10:04:19 +05:30 |
Harsh J
|
a7f1c1b993
|
MAPREDUCE-5448. MapFileOutputFormat#getReaders bug with invisible files/folders. Contributed by Maysam Yabandeh.
(cherry picked from commit b46c2bb51a )
|
2015-03-22 09:46:54 +05:30 |
Harsh J
|
7c72c7f529
|
MAPREDUCE-6286. A typo in HistoryViewer makes some code useless, which causes counter limits are not reset correctly. Contributed by Zhihai Xu.
(cherry picked from commit 433542904a )
|
2015-03-22 02:51:17 +05:30 |
Harsh J
|
418d078bc5
|
MAPREDUCE-6213. NullPointerException caused by job history server addr not resolvable. Contributed by Peng Zhang.
(cherry picked from commit e1e09052e8 )
|
2015-03-22 02:45:01 +05:30 |
Harsh J
|
97da36777f
|
MAPREDUCE-6239. Consolidate TestJobConf classes in hadoop-mapreduce-client-jobclient and hadoop-mapreduce-client-core. Contributed by Varun Saxena.
|
2015-03-22 02:20:11 +05:30 |
Robert Kanter
|
308460654a
|
MAPREDUCE-6282. Reuse historyFileAbsolute.getFileSystem in CompletedJob#loadFullHistoryData for code optimization. (zxu via rkanter)
(cherry picked from commit d4f7e2507f )
|
2015-03-20 13:12:34 -07:00 |
Jason Lowe
|
cabe676d67
|
MAPREDUCE-6275. Race condition in FileOutputCommitter v2 for user-specified task output subdirs. Contributed by Gera Shegalov and Siqi Li
(cherry picked from commit 91baca145a )
|
2015-03-19 21:40:51 +00:00 |
Tsuyoshi Ozawa
|
ef9aa7c34b
|
MAPREDUCE-6281. Fix javadoc in Terasort. Contributed by Albert Chu.
(cherry picked from commit 1ccbc29708 )
|
2015-03-20 00:59:43 +09:00 |
Jason Lowe
|
24d8c6f355
|
MAPREDUCE-6277. Job can post multiple history files if attempt loses connection to the RM. Contributed by Chang Li
(cherry picked from commit 30da99cbaf )
|
2015-03-18 19:31:32 +00:00 |
Harsh J
|
4e80c4cd5e
|
MAPREDUCE-5807. Print usage for TeraSort job. Contributed by Rohith.
(cherry picked from commit 9d72f93975 )
|
2015-03-18 17:31:25 +05:30 |
Harsh J
|
c58786794b
|
MAPREDUCE-4653. TestRandomAlgorithm has an unused import statement. Contributed by Amir Sanjar.
(cherry picked from commit 75e4670408a058efa95eaa768fedbe614008658f)
|
2015-03-17 14:13:23 +05:30 |
Tsuyoshi Ozawa
|
bb828565f8
|
MAPREDUCE-5755. MapTask.MapOutputBuffer#compare/swap should have @Override annotation. (ozawa)
(cherry picked from commit bb243cea93 )
|
2015-03-17 14:55:33 +09:00 |
Harsh J
|
5e403e8b8d
|
MAPREDUCE-6100. replace mapreduce.job.credentials.binary with MRJobConfig.MAPREDUCE_JOB_CREDENTIALS_BINARY for better readability. Contributed by Zhihai Xu.
(cherry picked from commit f222bde273 )
|
2015-03-17 11:08:32 +05:30 |
Harsh J
|
0e9f78dda2
|
MAPREDUCE-6105. nconsistent configuration in property mapreduce.reduce.shuffle.merge.percent. Contributed by Ray Chiang.
(cherry picked from commit 26a23b11598b3757ed4973781890e2cd2fc270df)
|
2015-03-17 02:27:33 +05:30 |
Harsh J
|
2684b0b440
|
MAPREDUCE-4414. Add main methods to JobConf and YarnConfiguration, for debug purposes. Contributed by Plamen Jeliazkov.
(cherry picked from commit 571f75b468a4412be2178466cb5d3888b05cd076)
|
2015-03-17 01:02:21 +05:30 |
Tsuyoshi Ozawa
|
c5c544c1b7
|
Moving CHANGES.txt entry for MAPREDUCE-4742 to branch-2.7.
(cherry picked from commit bd0a9ba8e3 )
|
2015-03-14 16:54:50 +09:00 |
Tsuyoshi Ozawa
|
10745fcecd
|
MAPREDUCE-6265. Make ContainerLauncherImpl.INITIAL_POOL_SIZE configurable to better control to launch/kill containers. Contributed by Zhihai Xu
(cherry picked from commit 9d38520c8e )
Conflicts:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
|
2015-03-14 16:45:23 +09:00 |
Jonathan Eagles
|
44aedad5dd
|
YARN-3267. Timelineserver applies the ACL rules after applying the limit on the number of records (Chang Li via jeagles)
(cherry picked from commit 8180e676ab )
|
2015-03-13 12:05:21 -05:00 |
Haohui Mai
|
e75e6c66ea
|
HADOOP-11633. Convert remaining branch-2 .apt.vm files to markdown. Contributed by Masatake Iwasaki.
|
2015-03-11 14:23:44 -07:00 |
Gera Shegalov
|
6802e8fefc
|
MAPREDUCE-4815. Speed up FileOutputCommitter#commitJob for many output files. (Siqi Li via gera)
(cherry picked from commit aa92b764a7 )
|
2015-03-10 11:40:45 -07:00 |
Tsuyoshi Ozawa
|
482504befd
|
MAPREDUCE-4742. Fix typo in nnbench#displayUsage. Contributed by Liang Xie.
(cherry picked from commit 20b8ee1350 )
|
2015-03-11 00:41:37 +09:00 |
Junping Du
|
dbcdcb0d3c
|
Configurable timeout between YARNRunner terminate the application and forcefully kill. Contributed by Eric Payne.
(cherry picked from commit d39bc903a0 )
|
2015-03-10 06:23:24 -07:00 |
Tsuyoshi Ozawa
|
b46f9e72db
|
HADOOP-11602. Backport 'Fix toUpperCase/toLowerCase to use Locale.ENGLISH.' (ozawa)
|
2015-03-09 19:53:55 +09:00 |
Vinod Kumar Vavilapalli
|
d9416317a9
|
Preparing for 2.8.0 development. Changing SNAPSHOT version to be 2.8 on branch-2.
|
2015-03-08 20:32:51 -07:00 |
Vinod Kumar Vavilapalli
|
8e6f8e9a04
|
Adding 2.8 section in CHANGES.txt
|
2015-03-08 20:26:57 -07:00 |
Tsuyoshi Ozawa
|
3c24e50ce2
|
Update CHANGES.txt for MAPREDUCE-5657.
|
2015-03-09 12:07:56 +09:00 |
Tsuyoshi Ozawa
|
ccde4aed18
|
MAPREDUCE-5657. Backport '[JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments.' Contributed by Akira AJISAKA.
|
2015-03-09 12:00:04 +09:00 |
Tsuyoshi Ozawa
|
ac874764d5
|
MAPREDUCE-6136. MRAppMaster doesn't shutdown file systems. Contributed by Brahma Reddy Battula.
(cherry picked from commit 348208014b )
|
2015-03-05 14:13:13 +09:00 |
Karthik Kambatla
|
f4d6c5e337
|
MAPREDUCE-6267. Refactor JobSubmitter#copyAndConfigureFiles into it's own class. (Chris Trezzo via kasha)
(cherry picked from commit c66c3ac6bf )
|
2015-03-04 14:47:06 -08:00 |
Vinod Kumar Vavilapalli
|
6604613bc5
|
MAPREDUCE-6248. Exposed the internal MapReduce job's information as a public API in DistCp. Contributed by Jing Zhao.
(cherry picked from commit 5af693fde2 )
|
2015-03-03 16:29:36 -08:00 |
Junping Du
|
a9613bcc94
|
Ability to limit running map and reduce tasks. Contributed by Jason Lowe.
(cherry picked from commit 4228de9402 )
Conflicts:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
|
2015-03-03 02:23:00 -08:00 |
Tsuyoshi Ozawa
|
b1e7f9c588
|
MAPREDUCE-6268. Fix typo in Task Attempt API's URL. Contributed by Ryu Kobayashi.
(cherry picked from commit 742f9d90c0 )
Conflicts:
hadoop-mapreduce-project/CHANGES.txt
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/site/markdown/HistoryServerRest.md
|
2015-03-03 16:24:27 +09:00 |
Akira Ajisaka
|
f7a724ca9e
|
HADOOP-10976. Backport "moving the source code of hadoop-tools docs to the directory under hadoop-tools" to branch-2. Contributed by Masatake Iwasaki.
(cherry picked from commit 9112f093cd )
Conflicts:
hadoop-common-project/hadoop-common/CHANGES.txt
|
2015-02-28 17:06:58 -08:00 |
Konstantin V Shvachko
|
9e67f2cb0d
|
YARN-3255. RM, NM, JobHistoryServer, and WebAppProxyServer's main() should support generic options. Contributed by Konstantin Shvachko.
|
2015-02-26 17:26:08 -08:00 |
Akira Ajisaka
|
8aa0c73294
|
MAPREDUCE-5612. Add javadoc for TaskCompletionEvent.Status. Contributed by Chris Palmer.
(cherry picked from commit bfbf076b7d )
|
2015-02-26 15:06:26 -08:00 |
Akira Ajisaka
|
5f0d1f10db
|
MAPREDUCE-2815. JavaDoc does not generate correctly for MultithreadedMapRunner. Contributed by Chris Palmer.
(cherry picked from commit 9a37247a67 )
|
2015-02-24 12:11:22 -08:00 |
Akira Ajisaka
|
5e686dae44
|
MAPREDUCE-6264. Remove httpclient dependency from hadoop-mapreduce-client. Contributed by Brahma Reddy Battula.
(cherry picked from commit 3f665aa4d5ac2e737e29ff63b3837c083a49ea80)
|
2015-02-24 11:33:05 -08:00 |
Wangda Tan
|
cd5eb9c1de
|
YARN-3076. Add API/Implementation to YarnClient to retrieve label-to-node mapping (Varun Saxena via wangda)
(cherry picked from commit d49ae725d5 )
|
2015-02-19 11:01:47 -08:00 |
Plamen Jeliazkov
|
32d215dc89
|
MAPREDUCE-6228. Add truncate operation to SLive. Contributed by Plamen Jeliazkov.
|
2015-02-19 00:14:11 -08:00 |
Jason Lowe
|
386e62ace3
|
MAPREDUCE-6261. NullPointerException if MapOutputBuffer.flush invoked twice. Contributed by Tsuyoshi OZAWA
(cherry picked from commit 4981d082d4 )
|
2015-02-18 19:28:45 +00:00 |
Tsuyoshi Ozawa
|
9523b52da5
|
MAPREDUCE-4286. TestClientProtocolProviderImpls passes on failure conditions. Contributed by Devaraj K.
(cherry picked from commit 7c782047c6 )
|
2015-02-18 15:46:06 +09:00 |
Junping Du
|
1d91daaae9
|
MAPREDUCE-6225. Fix new findbug warnings in hadoop-mapreduce-client-core. Contributed by Varun Saxena
(cherry picked from commit 814afa46ef )
|
2015-02-16 09:39:20 -08:00 |
Tsuyoshi Ozawa
|
7011125778
|
MAPREDUCE-6256. Removed unused private methods in o.a.h.mapreduce.Job.java. Contributed by Naganarasimha G R.
(cherry picked from commit 3338f6d907 )
|
2015-02-15 10:10:11 +09:00 |
Tsuyoshi Ozawa
|
7386323735
|
MAPREDUCE-6255. Fix JobCounter's format to use grouping separator. Contributed by Ryu Kobayashi.
(cherry picked from commit ba3c80a5ca )
|
2015-02-13 16:11:16 +09:00 |
Tsuyoshi Ozawa
|
9d57392f5b
|
MAPREDUCE-6221. Stringifier is left unclosed in Chain#getChainElementConf(). Contributed by Ted Yu.
(cherry picked from commit 9b0ba59b82 )
|
2015-02-13 02:28:19 +09:00 |
Tsuyoshi Ozawa
|
941a923514
|
MAPREDUCE-4431. mapred command should print the reason on killing already completed jobs. Contributed by Devaraj K.
(cherry picked from commit ac8d52bf50 )
|
2015-02-12 20:37:14 +09:00 |
Tsuyoshi Ozawa
|
9129b3415c
|
MAPREDUCE-5335. Rename Job Tracker terminology in ShuffleSchedulerImpl. Contributed by Devaraj K.
(cherry picked from commit b42d09eb62 )
|
2015-02-12 20:08:47 +09:00 |
Devaraj K
|
a00c9362e6
|
MAPREDUCE-6253. Update use of Iterator to Iterable. Contributed by Ray
Chiang.
(cherry picked from commit 76e309ead0 )
|
2015-02-12 13:47:19 +05:30 |
Tsuyoshi Ozawa
|
b1aad1d941
|
MAPREDUCE-6237. Multiple mappers with DBInputFormat don't work because of reusing conections. Contributed by Kannan Rajah.
(cherry picked from commit 241336ca2b )
|
2015-02-10 03:53:15 +09:00 |
yliu
|
6933975143
|
MAPREDUCE-6227. DFSIO for truncate. (shv via yliu)
|
2015-02-08 02:42:10 +08:00 |
Robert Kanter
|
46a2027226
|
MAPREDUCE-6233. org.apache.hadoop.mapreduce.TestLargeSort.testLargeSort failed in trunk (zxu via rkanter)
(cherry picked from commit e2ee2ff7d7 )
|
2015-02-05 14:31:44 -08:00 |
Jason Lowe
|
eb927a1d6b
|
MAPREDUCE-6186. Redundant call to requireJob() while displaying the conf page. Contributed by Rohit Agarwal
(cherry picked from commit e1990ab427 )
|
2015-02-05 20:14:13 +00:00 |
Jason Lowe
|
2dc4af2b93
|
MAPREDUCE-6059. Speed up history server startup time (Siqi Li via aw)
(cherry picked from commit fd57ab2002 )
Conflicts:
hadoop-mapreduce-project/CHANGES.txt
|
2015-02-05 16:40:09 +00:00 |
Akira Ajisaka
|
ad4b243586
|
MAPREDUCE-5988. Fix dead links to the javadocs in mapreduce project. (aajisaka)
(cherry picked from commit cc6bbfceae )
|
2015-02-04 17:46:39 -08:00 |
Akira Ajisaka
|
0a030871dd
|
MAPREDUCE-6243. Fix findbugs warnings in hadoop-rumen. Contributed by Masatake Iwasaki.
(cherry picked from commit 34fe11c987 )
|
2015-02-04 09:27:01 -08:00 |
Akira Ajisaka
|
8d98e5c960
|
MAPREDUCE-5800. Use Job#getInstance instead of deprecated constructors. (aajisaka)
(cherry picked from commit bd69fb2d44 )
Conflicts:
hadoop-tools/hadoop-streaming/src/test/java/org/apache/hadoop/streaming/mapreduce/TestStreamXmlRecordReader.java
|
2015-02-03 14:35:15 -08:00 |
Robert Kanter
|
a3a7efe748
|
MAPREDUCE-6143. add configuration for mapreduce speculative execution in MR2 (zxu via rkanter)
(cherry picked from commit 8acc5e9b4b )
|
2015-02-02 13:52:29 -08:00 |
Allen Wittenauer
|
a754f94ed7
|
MAPREDUCE-6151. Update document of GridMix (Masatake Iwasaki via aw)
|
2015-01-30 11:09:03 -08:00 |
Allen Wittenauer
|
3165e778f3
|
MAPREDUCE-6150. Update document of Rumen (Masatake Iwasaki via aw)
|
2015-01-29 14:18:25 -08:00 |
Akira Ajisaka
|
1081b4c4a7
|
HADOOP-9907. Webapp http://hostname:port/metrics link is not working. (aajisaka)
(cherry picked from commit 342efa110a )
|
2015-01-30 02:50:46 +09:00 |
Akira Ajisaka
|
57172c09e2
|
MAPREDUCE-6231. Grep example job is not working on a fully-distributed cluster. (aajisaka)
(cherry picked from commit fe2188a042 )
|
2015-01-30 01:11:22 +09:00 |
Jian He
|
43b3b43cea
|
MAPREDUCE-6230. Fixed RMContainerAllocator to update the new AMRMToken service name properly. Contributed by Jason Lowe
(cherry picked from commit cff05bff1f )
|
2015-01-28 15:52:11 -08:00 |
Allen Wittenauer
|
874e38d81f
|
HDFS-7566. Remove obsolete entries from hdfs-default.xml (Ray Chiang via aw)
|
2015-01-27 14:32:21 -08:00 |
Jason Lowe
|
2cf58ca5a6
|
MAPREDUCE-6141. History server leveldb recovery store. Contributed by Jason Lowe
(cherry picked from commit 56b7ec71a6 )
|
2015-01-26 16:30:10 +00:00 |
cnauroth
|
60dc848f23
|
MAPREDUCE-3283. mapred classpath CLI does not display the complete classpath. Contributed by Varun Saxena.
|
2015-01-21 13:52:09 -08:00 |
Allen Wittenauer
|
683cc18bba
|
HADOOP-11256. Some site docs have inconsistent appearance (Masatake Iwasaki via aw)
|
2015-01-21 08:46:19 -08:00 |
Akira Ajisaka
|
2e5eef9da2
|
MAPREDUCE-6210. Use getApplicationAttemptId() instead of getApplicationID() for logging AttemptId in RMContainerAllocator.java (Contributed by Leitao Guo)
(cherry picked from commit d336d13678 )
|
2015-01-14 17:43:25 +09:00 |
Xuan
|
0562f382fa
|
MAPREDUCE-6173. Document the configuration of deploying MR over
distributed cache with enabling wired encryption at the same time.
Contributed by Junping Du.
(cherry picked from commit 10ac5abb86 )
|
2015-01-13 10:08:24 -08:00 |
Brandon Li
|
d847363821
|
HADOOP-9992. Modify the NN loadGenerator to optionally run as a MapReduce job. Contributed by Akshay Radia
(cherry picked from commit 09d31bc630 )
|
2015-01-09 17:25:19 -08:00 |
cnauroth
|
9a7c763b3f
|
HADOOP-11464. Reinstate support for launching Hadoop processes on Windows using Cygwin. Contributed by Chris Nauroth.
|
2015-01-09 15:01:33 -08:00 |
Tsuyoshi Ozawa
|
132fd6ba58
|
HADOOP-11032. Replace use of Guava's Stopwatch with Hadoop's StopWatch. (ozawa)
(cherry picked from commit a6ed4894b5 )
Conflicts:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-nativetask/src/test/java/org/apache/hadoop/mapred/nativetask/kvtest/KVJob.java
|
2015-01-08 15:00:02 +09:00 |
Jason Lowe
|
c22c27068e
|
MAPREDUCE-6206. TestAggregatedTransferRate fails on non-US systems. Contributed by Jens Rabe
(cherry picked from commit a0aeed100b )
|
2015-01-06 23:40:42 +00:00 |
Jason Lowe
|
2b408d8dc7
|
HADOOP-11445. Bzip2Codec: Data block is skipped when position of newly created stream is equal to start of split. Contributed by Ankit Kamboj
(cherry picked from commit d02fb53750 )
|
2015-01-06 21:20:31 +00:00 |
Harsh J
|
6d65e74670
|
MAPREDUCE-6149. Document override log4j.properties in MR job. Contributed by Junping Du.
(cherry picked from commit 6621c3598e )
|
2014-12-30 23:13:19 +05:30 |
Jian He
|
9180d11b3b
|
YARN-2952. Fixed incorrect version check in StateStore. Contributed by Rohith Sharmaks
(cherry picked from commit 808cba3821 )
|
2014-12-19 16:56:55 -08:00 |
Robert Kanter
|
f9341c1e2c
|
MAPREDUCE-6199. AbstractCounters are not reset completely on deserialization (adhoot via rkanter)
(cherry picked from commit 390a7c12f5 )
|
2014-12-19 15:44:01 -08:00 |
Karthik Kambatla
|
e6c73a1c1a
|
HADOOP-11213. Typos in html pages: SecureMode and EncryptedShuffle. (Wei Yan via kasha)
(cherry picked from commit 6f1e3667cf )
|
2014-12-19 15:07:39 -08:00 |
Robert Kanter
|
22b38cf29a
|
MAPREDUCE-6045. need close the DataInputStream after open it in TestMapReduce.java (zxu via rkanter)
(cherry picked from commit d9e4d67d18 )
|
2014-12-19 12:00:00 -08:00 |
Gera Shegalov
|
7c7bccfc31
|
MAPREDUCE-6166. Reducers do not validate checksum of map outputs when fetching directly to disk. (Eric Payne via gera)
(cherry picked from commit af006937e8 )
|
2014-12-15 19:21:46 -08:00 |
Jian He
|
d2356a552a
|
Revert "YARN-2890. MiniYARNCluster should start the timeline server based on the configuration. Contributed by Mit Desai."
This reverts commit 51af8d367d .
Conflicts:
hadoop-yarn-project/CHANGES.txt
(cherry picked from commit a4f2995b9e )
|
2014-12-15 11:08:44 -08:00 |
Harsh J
|
a3fa1f0761
|
MAPREDUCE-6194. Bubble up final exception in failures during creation of output collectors. Contributed by Varun Saxena.
(cherry picked from commit 298d09c9b5 )
|
2014-12-15 14:27:49 +05:30 |
Gera Shegalov
|
6465931c19
|
MAPREDUCE-4879. TeraOutputFormat may overwrite an existing output directory. (gera)
(cherry picked from commit 25a0440238 )
|
2014-12-13 18:12:02 -08:00 |
Devaraj K
|
25f4a0193b
|
MAPREDUCE-6046. Change the class name for logs in RMCommunicator.
Contributed by Sahil Takiar.
(cherry picked from commit 0bd0229110 )
|
2014-12-12 11:44:00 +05:30 |
Gera Shegalov
|
8437c31b67
|
HADOOP-11211. mapreduce.job.classloader.system.classes semantics should be order-independent. (Yitong Zhou via gera)
(cherry picked from commit 0bcea111e5 )
|
2014-12-11 13:29:40 -08:00 |
Harsh J
|
6e06a51e30
|
MAPREDUCE-5420. Remove mapreduce.task.tmp.dir from mapred-default.xml. Contributed by James Carman. (harsh)
(cherry picked from commit cb99f43305 )
|
2014-12-11 09:46:08 +05:30 |
Haohui Mai
|
49aacee2cb
|
HADOOP-11372. Fix new findbugs warnings in mapreduce-examples. Contributed by Li Lu.
|
2014-12-09 10:49:11 -08:00 |
Haohui Mai
|
759179e631
|
HADOOP-11369. Fix new findbugs warnings in hadoop-mapreduce-client, non-core directories. Contributed by Li Lu.
|
2014-12-09 10:46:25 -08:00 |
Harsh J
|
bb1fedfbc3
|
MAPREDUCE-6177. Minor typo in the EncryptedShuffle document about ssl-client.xml. Contributed by Yangping Wu. (harsh)
(cherry picked from commit 8963515b88 )
|
2014-12-08 16:00:12 +05:30 |
Jason Lowe
|
db723a8499
|
MAPREDUCE-5932. Provide an option to use a dedicated reduce-side shuffle log. Contributed by Gera Shegalov
(cherry picked from commit 03ab24aa01 )
Conflicts:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
|
2014-12-03 17:12:47 +00:00 |
Zhijie Shen
|
d21ef79707
|
YARN-2890. MiniYARNCluster should start the timeline server based on the configuration. Contributed by Mit Desai.
(cherry picked from commit 51af8d367d )
|
2014-12-01 19:08:31 -08:00 |