Tsuyoshi Ozawa
|
1c80473a41
|
YARN-4320. TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no longer binds to default port 8188. Contributed by Varun Saxena.
(cherry picked from commit ce31b22739 )
|
2015-10-30 18:00:35 +09:00 |
Xuan
|
b505bf9e58
|
YARN-4313. Race condition in MiniMRYarnCluster when getting history
server address. Contributed by Jian He
(cherry picked from commit 7412ff48ee )
|
2015-10-29 17:37:24 -07:00 |
Jason Lowe
|
d6d642a4e3
|
Update CHANGES.txt to reflect commit of MR-6273 to branch-2.7
(cherry picked from commit ecad1253b7 )
|
2015-10-29 18:33:24 +00:00 |
Jason Lowe
|
145058003a
|
MAPREDUCE-6515. Update Application priority in AM side from AM-RM heartbeat. Contributed by Sunil G
(cherry picked from commit cf953b6258 )
|
2015-10-29 18:05:56 +00:00 |
Sangjin Lee
|
16db203a83
|
Set the release date for 2.6.2
|
2015-10-28 20:48:49 -07:00 |
Tsuyoshi Ozawa
|
3138b43f16
|
YARN-3573. MiniMRYarnCluster constructor that starts the timeline server using a boolean should be marked deprecated. Contributed by Brahma Reddy Battula.
(cherry picked from commit 96677bef00 )
|
2015-10-27 12:35:20 +09:00 |
Junping Du
|
801ce47e28
|
MAPREDUCE-6508. TestNetworkedJob fails consistently due to delegation token changes on RM. Contributed by Akira AJISAKA
(cherry picked from commit eb6379ca25 )
|
2015-10-23 10:07:41 -07:00 |
Jason Lowe
|
7c002e2416
|
MAPREDUCE-6518. Set SO_KEEPALIVE on shuffle connections. Contributed by Chang Li
(cherry picked from commit ee9b80acf8 )
|
2015-10-21 21:45:51 +00:00 |
Jason Lowe
|
be72ed1c75
|
MAPREDUCE-6489. Fail fast rogue tasks that write too much to local disk. Contributed by Maysam Yabandeh
|
2015-10-21 14:11:48 +00:00 |
Robert Kanter
|
492142097b
|
MAPREDUCE-6495. Docs for archive-logs tool (rkanter)
(cherry picked from commit 0c4af0f998 )
|
2015-10-20 17:34:56 -07:00 |
Sangjin Lee
|
180efe6677
|
YARN-2556. Tool to measure the performance of the timeline server (Chang Li via sjlee)
(cherry picked from commit 58590fef49 )
|
2015-10-16 16:57:32 -07:00 |
Haohui Mai
|
ee04add696
|
HDFS-9167. Update pom.xml in other modules to depend on hdfs-client instead of hdfs. Contributed by Mingliang Liu.
|
2015-10-13 15:24:29 -07:00 |
Karthik Kambatla
|
2d8f9e3fd9
|
MAPREDUCE-6302. Incorrect headroom can lead to a deadlock between map and reduce allocations. (kasha)
(cherry picked from commit 4aa9b3e75c )
Conflicts:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/RMContainerAllocator.java
|
2015-10-09 07:54:47 -07:00 |
Jason Lowe
|
0139517811
|
YARN-261. Ability to fail AM attempts. Contributed by Andrey Klochkov and Rohith Sharma K S
(cherry picked from commit a0bca2b5ad )
|
2015-10-09 14:19:41 +00:00 |
Akira Ajisaka
|
22ff37f5ce
|
MAPREDUCE-6479. Add missing mapred job command options in mapreduce document. Contributed by nijel.
(cherry picked from commit 584cf3bb35 )
|
2015-10-09 10:58:15 +09:00 |
Robert Kanter
|
e5bf4594cc
|
MAPREDUCE-6503. archive-logs tool should use HADOOP_PREFIX instead of HADOOP_HOME (rkanter)
(cherry picked from commit 1bca1bb517 )
|
2015-10-06 16:50:18 -07:00 |
Xuan
|
53bddc410f
|
YARN-1897. CLI and core support for signal container functionality. Contributed by Ming Ma
(cherry picked from commit 8f08532bde )
|
2015-10-02 18:53:04 -07:00 |
rohithsharmaks
|
7dd9ebdebc
|
MAPREDUCE-6485. Create a new task attempt with failed map task priority if in-progress attempts are unassigned. (Xianyin Xin via rohithsharmaks)
(cherry picked from commit 439f43ad3d )
|
2015-10-02 20:36:20 +05:30 |
Akira Ajisaka
|
e42f576232
|
MAPREDUCE-6497. Fix wrong value of JOB_FINISHED event in JobHistoryEventHandler. Contributed by Shinichi Yamashita.
(cherry picked from commit 195793c6f3 )
|
2015-10-01 10:26:00 +02:00 |
Robert Kanter
|
46ef5aa8eb
|
MAPREDUCE-6494. Permission issue when running archive-logs tool as different users (rkanter)
(cherry picked from commit 5db371f52f )
|
2015-09-30 17:34:03 -07:00 |
Jason Lowe
|
3c4c52a095
|
MAPREDUCE-6492. AsyncDispatcher exit with NPE on TaskAttemptImpl#sendJHStartEventForAssignedFailTask. Contributed by Bibin A Chundatt
(cherry picked from commit ab11085b81 )
|
2015-09-28 22:13:03 +00:00 |
Harsh J
|
03e370e306
|
MAPREDUCE-6471. Document distcp incremental copy. Contributed by Neelesh Srinivas Salian.
(cherry picked from commit 66dad854c0 )
|
2015-09-28 13:14:20 +05:30 |
Robert Kanter
|
d8a5d2b2fc
|
MAPREDUCE-6480. archive-logs tool may miss applications (rkanter)
(cherry picked from commit 8fec882cfaac047af1892615fe32d8c3ca02e7f9)
|
2015-09-25 15:00:07 -07:00 |
Jian He
|
d458805690
|
YARN-1651. CapacityScheduler side changes to support container resize. Contributed by Wangda Tan
(cherry picked from commit 89cab1ba5f )
Conflicts:
hadoop-tools/hadoop-sls/src/main/java/org/apache/hadoop/yarn/sls/scheduler/SLSCapacityScheduler.java
|
2015-09-24 10:30:04 -07:00 |
Jian He
|
c19e8ffdc7
|
YARN-1449. AM-NM protocol changes to support container resizing. Contributed by Meng Ding & Wangda Tan)
(cherry picked from commit 83a18add10 )
|
2015-09-24 10:23:25 -07:00 |
Jian He
|
89dc37450c
|
YARN-3866. AM-RM protocol changes to support container resizing. Contributed by Meng Ding
(cherry picked from commit dfe2cb849f )
|
2015-09-24 10:23:13 -07:00 |
Zhihai Xu
|
e5ba1a0521
|
MAPREDUCE-6484. Yarn Client uses local address instead of RM address as token renewer in a secure cluster when RM HA is enabled. Contributed by Zhihai Xu
(cherry picked from commit 97a08807ec )
|
2015-09-24 08:14:11 -07:00 |
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
|
f48af332a7
|
Release process for 2.6.1: Set the release date for 2.6.1
(cherry picked from commit 1f707ecffd )
|
2015-09-23 15:12:30 -07:00 |
Harsh J
|
38420754f5
|
MAPREDUCE-5045. UtilTest#isCygwin method appears to be unused. Contributed by Neelesh Srinivas Salian.
(cherry picked from commit de1322aa76007832698af682a3b76042116043b9)
|
2015-09-22 21:38:31 +05:30 |
Tsuyoshi Ozawa
|
52cc2ca488
|
HADOOP-12428. Fix inconsistency between log-level guards and statements. Contributed by Jagadesh Kiran N and Jackie Chang.
(cherry picked from commit dfd807afab )
|
2015-09-22 12:54:44 +09:00 |
Zhihai Xu
|
88a3a07636
|
MAPREDUCE-6460. TestRMContainerAllocator.testAttemptNotFoundCausesRMCommunicatorException fails. Contributed by Zhihai Xu.
(cherry picked from commit e3ace31e2b )
|
2015-09-19 00:12:15 -07:00 |
Haohui Mai
|
0971503522
|
MAPREDUCE-6483. Replace deprecated method NameNode.getUri() with DFSUtilClient.getNNUri() in TestMRCredentials. Contributed by Mingliang Liu.
|
2015-09-18 13:36:22 -07:00 |
Jason Lowe
|
9240a021fc
|
Update CHANGES.txt to reflect commit of MR-5982 to 2.7.2
(cherry picked from commit f97dc034fe )
|
2015-09-18 19:25:09 +00:00 |
Wangda Tan
|
6041fc75d8
|
MAPREDUCE-6478. Add an option to skip cleanupJob stage or ignore cleanup failure during commitJob. (Junping Du via wangda)
|
2015-09-18 10:19:32 -07:00 |
Jason Lowe
|
6641ab83eb
|
Update CHANGES.txt to reflect LineRecordReader fixes committed to 2.7.2
(cherry picked from commit 288c8854a6 )
|
2015-09-18 15:16:06 +00:00 |
Jason Lowe
|
f27f1ef44c
|
MAPREDUCE-5982. Task attempts that fail from the ASSIGNED state can disappear. Contributed by Chang Li
(cherry picked from commit ee4ee6af6a )
|
2015-09-17 21:38:44 +00:00 |
Jason Lowe
|
4861fadb17
|
MAPREDUCE-5002. AM could potentially allocate a reduce container to a map attempt. Contributed by Chang Li
(cherry picked from commit 3f82f582e5 )
|
2015-09-17 18:18:28 +00:00 |
Jason Lowe
|
316296e35f
|
MAPREDUCE-6481. LineRecordReader may give incomplete record and wrong position/key information for uncompressed input sometimes. Contributed by Zhihai Xu
(cherry picked from commit 58d1a02b8d )
|
2015-09-17 14:31:57 +00:00 |
Haohui Mai
|
ac2ed09be7
|
MAPREDUCE-6477. Replace usage of deprecated NameNode.DEFAULT_PORT in TestFileSystem. Contributed by Mingliang Liu.
|
2015-09-16 13:06:38 -07:00 |
Jason Lowe
|
52f56524d4
|
MAPREDUCE-6472. MapReduce AM should have java.io.tmpdir=./tmp to be consistent with tasks. Contributed by Naganarasimha G R
(cherry picked from commit 62943b8e3a )
|
2015-09-15 19:44:17 +00:00 |
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
|
cbf90f93f9
|
Updating all CHANGES.txt files to move entires from future releases into 2.6.1
section given the large number of backports to 2.6.1.
(cherry picked from commit fbbb7ff1ed )
|
2015-09-10 14:01:15 -07:00 |
Jason Lowe
|
7909462c3a
|
MAPREDUCE-6474. ShuffleHandler can possibly exhaust nodemanager file descriptors. Contributed by Kuhu Shukla
(cherry picked from commit 8e615588d5 )
|
2015-09-10 16:01:27 +00:00 |
Karthik Kambatla
|
999aa22509
|
MAPREDUCE-6415. Create a tool to combine aggregated logs into HAR files. (Robert Kanter via kasha)
|
2015-09-09 17:49:23 -07:00 |
Tsuyoshi Ozawa
|
8bf5362014
|
MAPREDUCE-6442. Stack trace is missing when error occurs in client protocol provider's constructor Contributed by Chang Li.
(cherry picked from commit 9b685773ec )
|
2015-09-05 11:21:35 +09:00 |
Andrew Wang
|
355398e441
|
HADOOP-12358. Add -safely flag to rm to prompt when deleting many files. Contributed by Xiaoyu Yao.
(cherry picked from commit e1feaf6db0 )
|
2015-09-04 13:48:42 -07:00 |
Akira Ajisaka
|
a61c0f5ca1
|
Revert "MAPREDUCE-6363. [NNBench] Lease mismatch error when running with multiple mappers. Contributed by Brahma Reddy Battula."
This reverts commit 98446ee695 .
|
2015-09-02 12:26:25 +09:00 |
Zhihai Xu
|
297bda600e
|
MAPREDUCE-6452. NPE when intermediate encrypt enabled for LocalRunner. Contributed by Zhihai Xu
(cherry picked from commit cbb249534a )
|
2015-08-28 12:20:49 -07:00 |
Jian He
|
387076894f
|
YARN-4014. Support user cli interface in for Application Priority. Contributed by Rohith Sharma K S
(cherry picked from commit 57c7ae1aff )
|
2015-08-24 20:37:18 -07:00 |
Akira Ajisaka
|
29819e7240
|
MAPREDUCE-6357. MultipleOutputs.write() API should document that output committing is not utilized when input path is absolute. Contributed by Dustin Cote.
(cherry picked from commit 2ba90c93d7 )
|
2015-08-21 10:43:05 +09:00 |
Vinod Kumar Vavilapalli
|
9da81a3955
|
MAPREDUCE-6454. Fixed MapReduce to modify HADOOP_CLASSPATH to have distributed cache files so that child processes running hadoop scripts can access these files. Contributed by Junping Du.
|
2015-08-20 17:35:24 -07:00 |
Vinod Kumar Vavilapalli
|
45be1240d9
|
Creating 2.6.2 entries in CHANGES.txt files.
(cherry picked from commit 33474939a0 )
|
2015-08-20 17:23:54 -07:00 |
Karthik Kambatla
|
20734320a1
|
MAPREDUCE-6439. AM may fail instead of retrying if RM shuts down during the allocate call. (Anubhav Dhoot via kasha)
(cherry picked from commit 8dfec7a197 )
|
2015-08-15 00:53:13 -07:00 |
Karthik Kambatla
|
b826168173
|
MAPREDUCE-5817. Mappers get rescheduled on node transition even after all reducers are completed. (Sangjin Lee via kasha)
(cherry picked from commit 27d24f96ab )
|
2015-08-14 12:40:38 -07:00 |
Junping Du
|
c8469357ba
|
MAPREDUCE-6443. Add JvmPauseMonitor to JobHistoryServer. Contributed by Robert Kanter.
|
2015-08-06 07:00:42 -07:00 |
Colin Patrick Mccabe
|
07a042aa3c
|
HADOOP-7824. NativeIO.java flags and identifiers must be set correctly for each platform, not hardcoded to their Linux values (Martin Walsh via Colin P. McCabe)
(cherry picked from commit 21d10ccc6e )
|
2015-07-31 15:02:01 -07:00 |
Jason Lowe
|
508da4d461
|
MAPREDUCE-6394. Speed up Task processing loop in HsTasksBlock#render(). Contributed by Ray Chiang
(cherry picked from commit d0e0ba8010 )
|
2015-07-31 18:19:52 +00:00 |
Zhihai Xu
|
9d40eead81
|
MAPREDUCE-6433. launchTime may be negative. Contributed by Zhihai Xu
(cherry picked from commit 93d50b7824 )
|
2015-07-30 23:12:30 -07:00 |
Akira Ajisaka
|
4da8ff60ef
|
MAPREDUCE-5762. Port MAPREDUCE-3223 and MAPREDUCE-4695 (Remove MRv1 config from mapred-default.xml) to branch-2. (aajisaka)
|
2015-07-16 03:43:49 +09:00 |
Chris Douglas
|
2a0e551cd8
|
MAPREDUCE-6427. Fix typo in JobHistoryEventHandler. Contributed by Ray Chiang
|
2015-07-14 14:56:21 -07:00 |
Akira Ajisaka
|
0ba2defb9e
|
YARN-3381. Fix typo InvalidStateTransitonException. Contributed by Brahma Reddy Battula.
(cherry picked from commit 19295b36d9 )
|
2015-07-13 17:53:27 +09:00 |
Akira Ajisaka
|
0e4d251fb2
|
MAPREDUCE-6421. Fix findbugs warning in RMContainerAllocator.reduceNodeLabelExpression. Contributed by Brahma Reddy Battula.
(cherry picked from commit e04faf8e46 )
|
2015-07-13 14:29:39 +09:00 |
Devaraj K
|
3074d7082e
|
MAPREDUCE-6426. TestShuffleHandler#testGetMapOutputInfo is failing.
Contributed by zhihai xu.
(cherry picked from commit fffb15bb43 )
|
2015-07-09 15:02:09 +05:30 |
Chris Douglas
|
5fbf91b453
|
MAPREDUCE-6038. A boolean may be set error in the Word Count v2.0 in MapReduce Tutorial. Contributed by Tsuyoshi Ozawa
(cherry picked from commit 4990ccfdc742be9c0517557a6256fefcae0df67d)
|
2015-07-07 10:26:57 -07:00 |
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
|
a8bf34cad8
|
Release process for 2.7.1: Set the release date for 2.7.1.
(cherry picked from commit bf89ddb9b8 )
|
2015-07-06 16:41:00 -07:00 |
Devaraj K
|
415dd64461
|
MAPREDUCE-6425. ShuffleHandler passes wrong "base" parameter to
getMapOutputInfo if mapId is not in the cache. Contributed by zhihai xu.
(cherry picked from commit bff67dfe2f )
|
2015-07-06 13:47:54 +05:30 |
Jason Lowe
|
8a4970e845
|
MAPREDUCE-6418. MRApp should not shutdown LogManager during shutdown. Contributed by Chang Li
(cherry picked from commit eac1d18943 )
|
2015-07-01 18:02:17 +00:00 |
Jason Lowe
|
f3195eda27
|
MAPREDUCE-6420. Interrupted Exception in LocalContainerLauncher should be logged in warn/info level. Contributed by Chang Li
(cherry picked from commit 826715622e )
|
2015-07-01 17:50:47 +00:00 |
Jason Lowe
|
df4e1e4965
|
MAPREDUCE-6376. Add avro binary support for jhist files. Contributed by Ray Chiang
(cherry picked from commit 2ac87df578 )
Conflicts:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
|
2015-07-01 16:07:54 +00:00 |
cnauroth
|
f7ba3c0045
|
HADOOP-12116. Fix unrecommended syntax usages in hadoop/hdfs/yarn script for cygwin in branch-2. Contributed by Li Lu.
|
2015-06-30 16:55:10 -07:00 |
Robert Kanter
|
e5b0439bc1
|
MAPREDUCE-6121. JobResourceUpdater#compareFs() doesn't handle HA namespaces (rchiang via rkanter)
(cherry picked from commit 3a72bfd082 )
|
2015-06-30 16:50:48 -07:00 |
Jason Lowe
|
fdfd5be2b3
|
MAPREDUCE-6384. Add the last reporting reducer info for too many fetch failure diagnostics. Contributed by Chang Li
(cherry picked from commit b6ba56457c )
|
2015-06-30 21:24:38 +00:00 |
Vinod Kumar Vavilapalli
|
4155bb565e
|
Adding release 2.7.2 to CHANGES.txt.
(cherry picked from commit aad6a7d5db )
|
2015-06-28 16:30:27 -07:00 |
Jason Lowe
|
31fd7a51d8
|
MAPREDUCE-6413. TestLocalJobSubmission is failing with unknown host. Contributed by zhihai xu
(cherry picked from commit aa5b15b03b )
|
2015-06-25 19:52:23 +00:00 |
Jason Lowe
|
2762affbb2
|
MAPREDUCE-6400. Multiple shuffle transfer fails because input is closed too early. Contributed by Brahma Reddy Battula, Akira AJISAKA, and Gera Shegalov.
(cherry picked from commit 72d08a0e41 )
|
2015-06-24 15:30:09 +00:00 |
Vinod Kumar Vavilapalli
|
8c9e2cf10a
|
MAPREDUCE-6410. Fixed MapReduce JobHistory server to use the right (login) UGI to refresh log and cleaner settings. Contributed by Varun Saxena.
(cherry picked from commit d481684c7c )
|
2015-06-23 11:41:05 -07:00 |
Jason Lowe
|
3bf44b862b
|
MAPREDUCE-5948. org.apache.hadoop.mapred.LineRecordReader does not handle multibyte record delimiters well. Contributed by Vinayakumar B, Rushabh Shah, and Akira AJISAKA
(cherry picked from commit 077250d8d7 )
|
2015-06-22 22:00:20 +00:00 |
Gera Shegalov
|
d8cc8f54dd
|
MAPREDUCE-6408. Queue name and user name should be printed on the job page. (Siqi Li via gera)
(cherry picked from commit 11ac848207 )
|
2015-06-22 14:42:31 -07:00 |
Akira Ajisaka
|
c4747158b7
|
MAPREDUCE-6403. Fix typo in the usage of NNBench. Contributed by Jagadesh Kiran N.
(cherry picked from commit 445b13240c )
|
2015-06-22 15:34:34 +09:00 |
Gera Shegalov
|
ee63c3e831
|
MAPREDUCE-6305. AM/Task log page should be able to link back to the job. (Siqi Li via gera)
(cherry picked from commit 055cd5a9a1 )
|
2015-06-20 12:40:59 -07:00 |
Gera Shegalov
|
34e744ce1a
|
MAPREDUCE-6316. Task Attempt List entries should link to the task overview. (Siqi Li via gera)
(cherry picked from commit 63d40d5286 )
|
2015-06-20 11:52:11 -07:00 |
Devaraj K
|
5c3070dc16
|
MAPREDUCE-6405. NullPointerException in App Attempts page. Contributed by
Siqi Li and Gera Shegalov.
(cherry picked from commit 311a4179cc )
|
2015-06-20 10:37:42 +05:30 |
Gera Shegalov
|
01991876ed
|
MAPREDUCE-6395. Improve the commit failure messages in MRAppMaster recovery. (Brahma Reddy Battula via gera)
(cherry picked from commit 10107243be )
|
2015-06-19 02:29:31 -07:00 |
Devaraj K
|
c4c7fd0bf1
|
MAPREDUCE-6373. The logger reports total input paths but it is referring
to input files. Contributed by Bibin A Chundatt.
(cherry picked from commit 1babe50a2c )
|
2015-06-18 11:45:11 +05:30 |
Akira Ajisaka
|
98446ee695
|
MAPREDUCE-6363. [NNBench] Lease mismatch error when running with multiple mappers. Contributed by Brahma Reddy Battula.
(cherry picked from commit 75a2560e51 )
|
2015-06-15 14:53:28 -07:00 |
Devaraj K
|
b117527bf3
|
MAPREDUCE-6389. Fix BaileyBorweinPlouffe CLI usage message. Contributed by
Brahma Reddy Battula.
(cherry picked from commit c7729efee8 )
|
2015-06-10 21:06:35 +05:30 |
Devaraj K
|
5426e3e929
|
MAPREDUCE-6350. JobHistory doesn't support fully-functional search.
Contributed by Siqi Li.
|
2015-06-10 12:43:31 +05:30 |
cnauroth
|
5a002aef12
|
MAPREDUCE-6392. Document mapred class path options. Contributed by Brahma Reddy Battula.
(cherry picked from commit 025a3a8be0 )
|
2015-06-08 16:22:12 -07:00 |
Tsuyoshi Ozawa
|
c6cdecc6b3
|
MAPREDUCE-6388. Remove deprecation warnings from JobHistoryServer classes. Contributed by Ray Chiang.
(cherry picked from commit 6afe20a7a4 )
|
2015-06-08 15:06:23 -07:00 |
Jason Lowe
|
588c22e5a0
|
MAPREDUCE-6354. ShuffleHandler should be able to log shuffle connections. Contributed by Chang Li
(cherry picked from commit b3ffa87003 )
|
2015-06-05 22:39:52 +00:00 |
Karthik Kambatla
|
1a2e6e8091
|
MAPREDUCE-6387. Serialize the recently added Task#encryptedSpillKey field at the end. (Arun Suresh via kasha)
(cherry picked from commit 6786daab33 )
|
2015-06-05 09:17:34 -07:00 |
Devaraj K
|
37ad3b3fef
|
MAPREDUCE-6383. Pi job (QuasiMonteCarlo) should not try to read the
results file if its job fails. Contributed by Harsh J.
(cherry picked from commit 09b8241e6e )
|
2015-06-05 21:23:48 +05:30 |
Devaraj K
|
7f075f2b75
|
MAPREDUCE-6377. JHS sorting on state column not working in webUi.
Contributed by zhihai xu.
(cherry picked from commit 790a861766 )
Conflicts:
hadoop-mapreduce-project/CHANGES.txt
|
2015-06-05 16:03:02 +05:30 |
Vinod Kumar Vavilapalli
|
6044b5e5f6
|
MAPREDUCE-5232. Add a configuration to be able to log classpath and other system properties on mapreduce JVMs startup. Contributed by Sangjin Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1482643 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 4d8e350750 )
Conflicts:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/v2/util/TestMRApps.java
|
2015-06-04 11:15:30 -07:00 |
Akira Ajisaka
|
1cccd1eeb3
|
HADOOP-12058. Fix dead links to DistCp and Hadoop Archives pages. Contributed by Kazuho Fujii.
(cherry picked from commit dbed757cba )
|
2015-06-05 01:46:33 +09:00 |
Gera Shegalov
|
bae1ec5f29
|
MAPREDUCE-6382. Don't escape HTML links in Diagnostics in JHS job overview. (Siqi Li via gera)
(cherry picked from commit e8302071ff )
|
2015-06-03 23:52:16 -07:00 |
Robert Kanter
|
ee3002933a
|
MAPREDUCE-5965. Hadoop streaming throws error if list of input files is high. Error is: "error=7, Argument list too long at if number of input file is high" (wilfreds via rkanter)
(cherry picked from commit cc70df98e7 )
|
2015-06-03 18:42:16 -07:00 |
Gera Shegalov
|
25c1e54d3f
|
MAPREDUCE-6174. Combine common stream code into parent class for InMemoryMapOutput and OnDiskMapOutput. (Eric Payne via gera)
(cherry picked from commit d90c13e2da )
|
2015-06-03 16:57:54 -07:00 |
Zhijie Shen
|
2fcd3fe6ba
|
Revert "YARN-1462. Made RM write application tags to timeline server and exposed them to users via generic history web UI and REST API. Contributed by Xuan Gong."
This reverts commit 4e2ed34d20 .
|
2015-06-03 14:16:51 -07:00 |
Jason Lowe
|
5ecc647ae0
|
MAPREDUCE-6374. Distributed Cache File visibility should check permission of full path. Contributed by Chang Li
(cherry picked from commit 107da29ff9 )
|
2015-06-03 20:20:47 +00:00 |
Zhijie Shen
|
4e2ed34d20
|
YARN-1462. Made RM write application tags to timeline server and exposed them to users via generic history web UI and REST API. Contributed by Xuan Gong.
(cherry picked from commit a9f986bc5a41ab74171da1076d10e83c5adc284f)
|
2015-05-30 21:06:32 -07:00 |
Andrew Wang
|
bdaa0fed13
|
HADOOP-11885. hadoop-dist dist-layout-stitching.sh does not work with dash. (wang)
(cherry picked from commit 7673d4f205 )
Conflicts:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-nativetask/pom.xml
hadoop-mapreduce-project/pom.xml
|
2015-05-29 14:55:52 -07:00 |
Wangda Tan
|
7cd0874dfd
|
MAPREDUCE-6304. Specifying node labels when submitting MR jobs. (Naganarasimha G R via wangda)
(cherry picked from commit 3164e7d838 )
Conflicts:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/RMContainerAllocator.java
|
2015-05-27 14:43:20 -07:00 |
cnauroth
|
6ed8989a6f
|
YARN-3626. On Windows localized resources are not moved to the front of the classpath when they should be. Contributed by Craig Welch.
(cherry picked from commit 7bc33b63c78c6ee9a04c0c1511ef16e63f7f3074)
|
2015-05-27 14:21:15 -07:00 |
Colin Patrick Mccabe
|
3dec58dd78
|
HADOOP-11969. ThreadLocal initialization in several classes is not thread safe (Sean Busbey via Colin P. McCabe)
(cherry picked from commit 7dba7005b7 )
|
2015-05-26 12:40:41 -07:00 |
Tsuyoshi Ozawa
|
e694c3339e
|
MAPREDUCE-6364. Add a Kill link to Task Attempts page. Contributed by Ryu Kobayashi.
(cherry picked from commit 022f49d59e )
|
2015-05-26 23:59:20 +09:00 |
Tsuyoshi Ozawa
|
6042b53a74
|
MAPREDUCE-6204. TestJobCounters should use new properties instead of JobConf.MAPRED_TASK_JAVA_OPTS.
(cherry picked from commit b27ce3c531 )
|
2015-05-22 23:30:12 +09:00 |
Vinayakumar B
|
19895a41ad
|
HADOOP-11743. maven doesn't clean all the site files (Contributed by ramtin)
(cherry picked from commit 55ed6558ba )
Conflicts:
hadoop-common-project/hadoop-common/pom.xml
|
2015-05-22 16:46:50 +05:30 |
Wangda Tan
|
b5ba6979b7
|
YARN-3583. Support of NodeLabel object instead of plain String in YarnClient side. (Sunil G via wangda)
(cherry picked from commit 563eb1ad2a )
(cherry picked from commit b0d22b0c606fad6b4ab5443c0aed07c829b46726)
|
2015-05-19 17:37:24 -07:00 |
Junping Du
|
dafe33efbf
|
Moving MAPREDUCE-6361 to 2.7.1 CHANGES.txt
|
2015-05-19 11:53:46 -07:00 |
Devaraj K
|
b9865cbf3d
|
MAPREDUCE-6273. HistoryFileManager should check whether summaryFile exists
to avoid FileNotFoundException causing HistoryFileInfo into MOVE_FAILED
state. Contributed by zhihai xu.
(cherry picked from commit 1ea90144d5 )
|
2015-05-15 12:34:08 +05:30 |
Vinod Kumar Vavilapalli
|
87862970f1
|
Fixing MR intermediate spills. Contributed by Arun Suresh.
(cherry picked from commit 6b710a42e0 )
|
2015-05-14 16:56:56 -07:00 |
Devaraj K
|
454236ec19
|
MAPREDUCE-5708. Duplicate String.format in
YarnOutputFiles.getSpillFileForWrite. Contributed by Konstantin Weitz.
(cherry picked from commit 05ff54c66c )
|
2015-05-14 22:11:15 +05:30 |
Xuan
|
487d9b0f3f
|
YARN-3626. On Windows localized resources are not moved to the front of the classpath when they should be. Contributed by Craig Welch
(cherry picked from commit 0f95921447 )
|
2015-05-13 13:12:04 -07:00 |
cnauroth
|
ddc4afeff2
|
HADOOP-11966. Variable cygwin is undefined in hadoop-config.sh when executed through hadoop-daemon.sh. Contributed by Chris Nauroth.
|
2015-05-13 12:25:49 -07:00 |
Tsuyoshi Ozawa
|
780d4f416e
|
MAPREDUCE-6366. mapreduce.terasort.final.sync configuration in TeraSort doesn't work. Contributed by Takuya Fukudome.
(cherry picked from commit e82067bfe6 )
|
2015-05-13 16:45:46 +09:00 |
Akira Ajisaka
|
345e62c6d5
|
Revert "MAPREDUCE-5762. Port MAPREDUCE-3223 (Remove MRv1 config from mapred-default.xml) to branch-2. (aajisaka)"
This reverts commit 853cc04668 .
|
2015-05-13 14:02:41 +09:00 |
Vinod Kumar Vavilapalli
|
d5755ba241
|
MAPREDUCE-6251. Added a new config for JobClient to retry JobStatus calls so that they don't fail on history-server backed by DFSes with not so strong guarantees. Contributed by Craig Welch.
(cherry picked from commit f24452d14e )
|
2015-05-12 12:13:23 -07:00 |
Tsuyoshi Ozawa
|
fb5b0ebb45
|
MAPREDUCE-6361. NPE issue in shuffle caused by concurrent issue between copySucceeded() in one thread and copyFailed() in another thread on the same host. Contributed by Junping Du.
(cherry picked from commit f4e2b3cc0b )
|
2015-05-13 00:28:36 +09:00 |
Vinayakumar B
|
cda1962996
|
MAPREDUCE-6360. TestMapreduceConfigFields is placed in wrong dir, introducing compile error (Contributed by Arshad Mohammad)
(cherry picked from commit 360dff5903 )
|
2015-05-12 12:50:44 +05:30 |
Jason Lowe
|
53e9973afc
|
MAPREDUCE-5465. Tasks are often killed before they exit on their own. Contributed by Ming Ma
|
2015-05-11 22:40:05 +00:00 |
Junping Du
|
a1a7deebf8
|
YARN-3587. Fix the javadoc of DelegationTokenSecretManager in yarn, etc. projects. Contributed by Gabor Liptak.
(cherry picked from commit 7e543c27fa )
|
2015-05-11 05:28:25 -07:00 |
Karthik Kambatla
|
52469b10dd
|
MAPREDUCE-6353. Divide by zero error in MR AM when calculating available containers. (Anubhav Dhoot via kasha)
(cherry picked from commit 1773aac780 )
|
2015-05-09 14:43:57 -07:00 |
Karthik Kambatla
|
e8dd0bc4fd
|
YARN-1287. Consolidate MockClocks. (Sebastian Wong and Anubhav Dhoot via kasha)
(cherry picked from commit 70fb37cd79 )
|
2015-05-09 14:35:13 -07:00 |
Junping Du
|
39c188449e
|
MAPREDUCE-6359. In RM HA setup, Cluster tab links populated with AM hostname instead of RM. Contributed by zhaoyunjiong.
(cherry picked from commit df36ad0a08 )
|
2015-05-09 06:12:01 -07:00 |
Ravi Prakash
|
23065e6051
|
MAPREDUCE-4750. Enable NNBenchWithoutMR in MapredTestDriver (Liang Xie and Jason Lowe via raviprak)
(cherry picked from commit 5aab014340 )
|
2015-05-08 15:58:29 -07:00 |
Jason Lowe
|
0f6c971282
|
MAPREDUCE-5248. Let NNBenchWithoutMR specify the replication factor for its test. Contributed by Erik Paulson
(cherry picked from commit 30099a36c6 )
|
2015-05-08 22:30:21 +00:00 |
Chris Douglas
|
4f301f92c1
|
MAPREDUCE-2094. LineRecordReader should not seek into non-splittable, compressed streams.
|
2015-05-08 14:30:56 -07:00 |
Jason Lowe
|
dfc4a62f7d
|
MAPREDUCE-3383. Duplicate job.getOutputValueGroupingComparator() in ReduceTask. Contributed by Binglin Chang
(cherry picked from commit c39012f4a0 )
|
2015-05-08 21:17:05 +00:00 |
Devaraj K
|
a957baeb71
|
MAPREDUCE-5981. Log levels of certain MR logs can be changed to DEBUG.
Contributed by Varun Saxena.
(cherry picked from commit dc2b2ae31f )
|
2015-05-08 21:28:52 +05:30 |
Devaraj K
|
ade5165ecf
|
MAPREDUCE-6342. Make POM project names consistent. Contributed by Rohith.
|
2015-05-08 15:20:35 +05:30 |
Akira Ajisaka
|
5cc036d473
|
MAPREDUCE-6079. Rename JobImpl#username to reporterUserName. Contributed by Tsuyoshi Ozawa.
(cherry picked from commit ecfa052274 )
|
2015-05-08 18:17:35 +09:00 |
Tsuyoshi Ozawa
|
1ae8bf5b21
|
MAPREDUCE-6284. Add Task Attempt State API to MapReduce Application Master REST API. Contributed by Ryu Kobayashi.
(cherry picked from commit d18f10ad1b )
|
2015-05-08 16:00:41 +09:00 |
Jason Lowe
|
976a3c1f9d
|
MAPREDUCE-6279. AM should explicity exit JVM after all services have stopped. Contributed by Eric Payne
(cherry picked from commit f30065c8b6 )
|
2015-05-07 22:06:54 +00:00 |
Akira Ajisaka
|
f7c011cbaa
|
MAPREDUCE-6356. Misspelling of threshold in log4j.properties for tests. Contributed by Brahma Reddy Battula.
(cherry picked from commit d335071398 )
|
2015-05-07 19:41:44 +09:00 |
Robert Kanter
|
bd207b6cc0
|
MAPREDUCE-6192. Create unit test to automatically compare MR related classes and mapred-default.xml (rchiang via rkanter)
|
2015-05-05 14:47:52 -07:00 |
Xuan
|
02cdcaec58
|
YARN-2123. Progress bars in Web UI always at 100% due to non-US locale.
Contributed by Akira AJISAKA
(cherry picked from commit b7dd3a4f04 )
|
2015-05-05 10:45:18 -07:00 |
Tsuyoshi Ozawa
|
4e96175b33
|
MAPREDUCE-6165. [JDK8] TestCombineFileInputFormat failed on JDK8. Contributed by Akira AJISAKA.
(cherry picked from commit 551615fa13 )
|
2015-05-05 10:23:25 +09:00 |
Jason Lowe
|
81f128f293
|
MAPREDUCE-6259. IllegalArgumentException due to missing job submit time. Contributed by zhihai xu
(cherry picked from commit bf70c5ae28 )
|
2015-05-04 20:40:16 +00:00 |
Jason Lowe
|
87c2d915f1
|
MAPREDUCE-5649. Reduce cannot use more than 2G memory for the final merge. Contributed by Gera Shegalov
(cherry picked from commit 7dc3c1203d )
|
2015-05-04 19:03:43 +00:00 |
Tsuyoshi Ozawa
|
7e03bda3e7
|
MAPREDUCE-6349. Fix typo in property org.apache.hadoop.mapreduce.lib.chain.Chain.REDUCER_INPUT_VALUE_CLASS. Contributed by Ray Chiang.
(cherry picked from commit bb6ef2984d )
|
2015-05-04 15:36:53 +09:00 |
Tsuyoshi Ozawa
|
1035f550b9
|
MAPREDUCE-5905. CountersStrings.toEscapedCompactStrings outputs unnecessary null strings. Contributed by Akira AJISAKA.
(cherry picked from commit 3ba18362f2 )
|
2015-05-04 15:02:40 +09:00 |
Gera Shegalov
|
ff6492d603
|
MAPREDUCE-6345. Documentation fix for when CRLA is enabled for MRAppMaster logs. (Rohit Agarwal via gera)
(cherry picked from commit f1a152cc0a )
|
2015-05-01 19:07:14 -07:00 |
Devaraj K
|
c3d083a9ff
|
MAPREDUCE-6339. Job history file is not flushed correctly because
isTimerActive flag is not set true when flushTimerTask is scheduled.
Contributed by zhihai xu.
(cherry picked from commit f5b38477f9 )
|
2015-04-30 12:36:00 +05:30 |
Jason Lowe
|
ea828578a3
|
MAPREDUCE-6334. Fetcher#copyMapOutput is leaking usedMemory upon IOException during InMemoryMapOutput shuffle handler. Contributed by Eric Payne
(cherry picked from commit bc1bd7e5c4 )
|
2015-04-28 20:19:52 +00:00 |
Devaraj K
|
1d03ac3533
|
Moving MAPREDUCE-6252 to the 2.7.1 CHANGES.txt
(cherry picked from commit 99fe03e439 )
|
2015-04-28 12:44:07 +05:30 |
Vinod Kumar Vavilapalli
|
32dc13d907
|
MAPREDUCE-6324. Fixed MapReduce uber jobs to not fail the udpate of AM-RM tokens when they roll-over. Contributed by Jason Lowe.
(cherry picked from commit 9fc32c5c4d )
|
2015-04-27 14:59:57 -07:00 |
Tsuyoshi Ozawa
|
fa9def5a2a
|
MAPREDUCE-6341. Fix typo in mapreduce tutorial. Contributed by John Michael Luy.
(cherry picked from commit 9a3dda3d34 )
Conflicts:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/site/markdown/MapReduceTutorial.md
|
2015-04-28 01:58:12 +09:00 |
Devaraj K
|
84ae26573c
|
MAPREDUCE-6252. JobHistoryServer should not fail when encountering a
missing directory. Contributed by Craig Welch.
(cherry picked from commit 5e67c4d384 )
|
2015-04-27 15:02:44 +05:30 |
Gera Shegalov
|
fa915f73e2
|
MAPREDUCE-6333. TestEvents,TestAMWebServicesTasks,TestAppController are broken due to MAPREDUCE-6297. (Siqi Li via gera)
(cherry picked from commit 78c6b46241 )
|
2015-04-24 17:38:16 -07:00 |
Vinod Kumar Vavilapalli
|
db1a33e956
|
Moving YARN-3351, YARN-3382, YARN-3472, MAPREDUCE-6238 to the 2.7.1 CHANGES.txt
sections given the recent merge into branch-2.7.
(cherry picked from commit 2f82ae042a )
|
2015-04-24 17:20:02 -07:00 |