Wangda Tan
|
c487453b91
|
YARN-4340. Add list API to reservation system. (Sean Po via wangda)
(cherry picked from commit 9875325d5c )
|
2016-02-02 10:23:25 +08:00 |
Jason Lowe
|
7bb48ed162
|
MAPREDUCE-6618. YarnClientProtocolProvider leaking the YarnClient thread. Contributed by Xuan Gong
(cherry picked from commit 59a212b6e1 )
|
2016-02-01 16:11:20 +00:00 |
Akira Ajisaka
|
ce5947916d
|
MAPREDUCE-6616. Fail to create jobhistory file if there are some multibyte characters in the job name. Contributed by Kousuke Saruta.
(cherry picked from commit d314a3f99d5d03c62a3b8fb8883886440ab7d1db)
(cherry picked from commit 79cde21064a1fe274a4dcbf3dec4ed0d743876cf)
|
2016-01-29 16:20:45 +09:00 |
Jian He
|
d83b124c97
|
MAPREDUCE-6619. HADOOP_CLASSPATH is overwritten in MR container. Contributed by Junping Du
(cherry picked from commit da18bbedaf )
|
2016-01-27 13:18:19 -08:00 |
Jian He
|
b6fe3c20c5
|
MAPREDUCE-6610. JobHistoryEventHandler should not swallow timeline response. Contributed by Li Lu
|
2016-01-25 23:01:52 -08:00 |
Akira Ajisaka
|
8ffa844d48
|
MAPREDUCE-6614. Remove unnecessary code in TestMapreduceConfigFields. Contributed by Kai Sasaki.
(cherry picked from commit a9386cae6e )
|
2016-01-25 11:40:08 +09:00 |
Akira Ajisaka
|
b85b8d90d1
|
MAPREDUCE-6605. Fix typos mapreduce.map.skip.proc.count.autoincr and mapreduce.reduce.skip.proc.count.autoincr in mapred-default.xml. Contributed by Kai Sasaki.
(cherry picked from commit 7f215ffdd5 )
|
2016-01-22 18:38:08 +09:00 |
Jason Lowe
|
de31bff67d
|
MAPREDUCE-6554. MRAppMaster servicestart failing with NPE in MRAppMaster#parsePreviousJobHistory. Contributed by Bibin A Chundatt
(cherry picked from commit 9fbd579ab5 )
|
2016-01-15 16:54:03 +00:00 |
Akira Ajisaka
|
6816481c72
|
MAPREDUCE-6601. Fix typo in Job#setUseNewAPI. Contributed by Kai Sasaki.
(cherry picked from commit 5cc44d18aa )
(cherry picked from commit 7c4be15991 )
|
2016-01-15 00:44:52 +09:00 |
Akira Ajisaka
|
d4d368d4e8
|
MAPREDUCE-6363. [NNBench] Lease mismatch error when running with multiple mappers. Contributed by Vlad Sharanhovich and Bibin A Chundatt.
(cherry picked from commit 7b0964f354 )
(cherry picked from commit 6efee8907a )
|
2016-01-14 10:41:45 +09:00 |
Jason Lowe
|
a22a7f61e4
|
MAPREDUCE-6473. Job submission can take a long time during Cluster initialization. Contributed by Kuhu Shukla
(cherry picked from commit f657b54281 )
|
2016-01-12 23:59:06 +00:00 |
Wangda Tan
|
00fca06b43
|
YARN-4582. Label-related invalid resource request exception should be able to properly handled by application. (Bibin A Chundatt via wangda)
(cherry picked from commit 9e792da014 )
|
2016-01-12 12:56:12 +08:00 |
Junping Du
|
d7e10f8174
|
MAPREDUCE-6068. Illegal progress value warnings in map tasks. Contributed by Binglin Chang.
(cherry picked from commit 8c1adeaa26 )
(cherry picked from commit 51073c910c )
|
2016-01-11 06:14:58 -08:00 |
Sangjin Lee
|
ae535ec93e
|
MAPREDUCE-6577. MR AM unable to load native library without MR_AM_ADMIN_USER_ENV set (sjlee)
(cherry picked from commit f6f16118d3 )
(cherry picked from commit 28fd4c70ca )
|
2016-01-06 08:44:37 -08:00 |
Akira Ajisaka
|
5daa07481e
|
MAPREDUCE-6593. TestJobHistoryEventHandler.testTimelineEventHandling fails on trunk because of NPE. Contributed by Naganarasimha G R.
(cherry picked from commit 7dafee11d8 )
(cherry picked from commit 6d235f0b91 )
|
2016-01-04 16:31:42 +09:00 |
Akira Ajisaka
|
2139458a98
|
MAPREDUCE-6589. TestTaskLog outputs a log under directory other than target/test-dir. (aajisaka)
(cherry picked from commit 2a59d01503 )
(cherry picked from commit a8314505d0 )
|
2015-12-30 01:34:26 +09:00 |
Akira Ajisaka
|
7063d8d013
|
MAPREDUCE-6584. Remove trailing whitespaces from mapred-default.xml. (aajisaka)
(cherry picked from commit 1a06949126 )
|
2015-12-30 01:04:40 +09:00 |
Wangda Tan
|
aa85ce73de
|
MAPREDUCE-6574. MR AM should print host of failed tasks. (Mohammad Shahid Khan via wangda)
(cherry picked from commit 32b3dc11eb )
(cherry picked from commit ca575e6add )
|
2015-12-28 11:08:31 -08:00 |
Rohith Sharma K S
|
550840f402
|
MAPREDUCE-6419. JobHistoryServer doesn't sort properly based on Job ID when Job id's exceed 9999. (Mohammad Shahid Khan via rohithsharmaks)
(cherry picked from commit a308e86621 )
|
2015-12-24 12:02:53 +05:30 |
Akira Ajisaka
|
5f34cbff5c
|
MAPREDUCE-6583. Clarify confusing sentence in MapReduce tutorial document. Contributed by Kai Sasaki.
(cherry picked from commit 7995a6ea4d )
(cherry picked from commit 8607cb6074 )
|
2015-12-21 00:18:40 +09:00 |
Xuan
|
93c483889c
|
MAPREDUCE-6566. Add retry support to mapreduce CLI tool. Contributed by Varun Vasudev
(cherry picked from commit d4e766de93 )
(cherry picked from commit 5891d6ed55 )
|
2015-12-16 15:31:09 -08:00 |
Zhihai Xu
|
c4febc7d02
|
MAPREDUCE-6436. JobHistory cache issue. Contributed by Kai Sasaki
(cherry picked from commit 5b7078d069 )
|
2015-12-15 22:42:19 -08:00 |
Robert Kanter
|
8c6273d117
|
MAPREDUCE-6549. multibyte delimiters with LineRecordReader cause duplicate records (wilfreds via rkanter)
(cherry picked from commit 7fd00b3db4 )
|
2015-11-25 17:03:52 -08:00 |
Junping Du
|
628c782870
|
Tests in mapreduce-client-app are writing outside of target. Contributed by Akira AJISAKA.
(cherry picked from commit 15d577bfbb )
|
2015-11-25 09:16:22 -08:00 |
Akira Ajisaka
|
c6cf7910a4
|
MAPREDUCE-6553. Replace '\u2b05' with '<-' in rendering job configuration. Contributed by Gabor Liptak.
(cherry picked from commit 5ec44fc35c )
|
2015-11-25 16:33:18 +09:00 |
Jason Lowe
|
2f18218508
|
MAPREDUCE-5870. Support for passing Job priority through Application Submission Context in Mapreduce Side. Contributed by Sunil G
(cherry picked from commit f634505d48 )
Conflicts:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestJobConf.java
|
2015-11-24 22:15:37 +00:00 |
Jason Lowe
|
ef3e01a1e4
|
MAPREDUCE-5883. "Total megabyte-seconds" in job counters is slightly misleading. Contributed by Nathan Roberts
(cherry picked from commit cab3c7c889 )
|
2015-11-24 22:01:53 +00:00 |
Jian He
|
b339a4b8d6
|
YARN-4349. Support CallerContext in YARN. Contributed by Wangda Tan
(cherry picked from commit 8676a118a1 )
|
2015-11-23 17:20:24 -08:00 |
Haohui Mai
|
469fef2a4f
|
HDFS-9153. Pretty-format the output for DFSIO. Contributed by Kai Zheng.
|
2015-11-22 16:18:16 -08:00 |
Akira Ajisaka
|
8de7911eb3
|
MAPREDUCE-6499. Add elapsed time for retired job in JobHistoryServer WebUI. Contributed by Lin Yiqun.
(cherry picked from commit a7f776ffdf )
|
2015-11-17 15:18:32 +09:00 |
Jian He
|
2cf084ac76
|
Revert "YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999) Contributed by Mohammad Shahid Khan"
This reverts commit a4ff03b200 .
Conflicts:
hadoop-yarn-project/CHANGES.txt
|
2015-11-16 20:19:31 -08:00 |
Jian He
|
f562c155d2
|
MAPREDUCE-5485. Allow repeating job commit by extending OutputCommitter API. Contributed by Junping Du
|
2015-11-16 17:08:22 -08:00 |
Sangjin Lee
|
3214c2331f
|
MAPREDUCE-6540. TestMRTimelineEventHandling fails (sjlee)
(cherry picked from commit 9ad708a0df )
|
2015-11-11 16:22:28 -08:00 |
Jason Lowe
|
ee5c20ddef
|
MAPREDUCE-6533. testDetermineCacheVisibilities of TestClientDistributedCacheManager is broken. Contributed by Chang Li
(cherry picked from commit df68eac825 )
|
2015-11-11 17:27:03 +00:00 |
Jian He
|
a4ff03b200
|
YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999) Contributed by Mohammad Shahid Khan
(cherry picked from commit 8fbea531d7 )
|
2015-11-09 11:05:12 -08:00 |
Tsuyoshi Ozawa
|
1c0c77e7f0
|
MAPREDUCE-5763. Warn message about httpshuffle in NM logs. Contributed by Akira AJISAKA.
(cherry picked from commit 668e897538 )
|
2015-11-09 15:26:02 +09:00 |
Jason Lowe
|
a7d8895b60
|
MAPREDUCE-6528. Memory leak for HistoryFileManager.getJobSummary(). Contributed by Junping Du
(cherry picked from commit 6344b6a769 )
|
2015-10-30 15:32:48 +00:00 |
Tsuyoshi Ozawa
|
1c80473a41
|
YARN-4320. TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no longer binds to default port 8188. Contributed by Varun Saxena.
(cherry picked from commit ce31b22739 )
|
2015-10-30 18:00:35 +09:00 |
Xuan
|
b505bf9e58
|
YARN-4313. Race condition in MiniMRYarnCluster when getting history
server address. Contributed by Jian He
(cherry picked from commit 7412ff48ee )
|
2015-10-29 17:37:24 -07:00 |
Jason Lowe
|
145058003a
|
MAPREDUCE-6515. Update Application priority in AM side from AM-RM heartbeat. Contributed by Sunil G
(cherry picked from commit cf953b6258 )
|
2015-10-29 18:05:56 +00:00 |
Tsuyoshi Ozawa
|
3138b43f16
|
YARN-3573. MiniMRYarnCluster constructor that starts the timeline server using a boolean should be marked deprecated. Contributed by Brahma Reddy Battula.
(cherry picked from commit 96677bef00 )
|
2015-10-27 12:35:20 +09:00 |
Junping Du
|
801ce47e28
|
MAPREDUCE-6508. TestNetworkedJob fails consistently due to delegation token changes on RM. Contributed by Akira AJISAKA
(cherry picked from commit eb6379ca25 )
|
2015-10-23 10:07:41 -07:00 |
Jason Lowe
|
7c002e2416
|
MAPREDUCE-6518. Set SO_KEEPALIVE on shuffle connections. Contributed by Chang Li
(cherry picked from commit ee9b80acf8 )
|
2015-10-21 21:45:51 +00:00 |
Jason Lowe
|
be72ed1c75
|
MAPREDUCE-6489. Fail fast rogue tasks that write too much to local disk. Contributed by Maysam Yabandeh
|
2015-10-21 14:11:48 +00:00 |
Robert Kanter
|
492142097b
|
MAPREDUCE-6495. Docs for archive-logs tool (rkanter)
(cherry picked from commit 0c4af0f998 )
|
2015-10-20 17:34:56 -07:00 |
Sangjin Lee
|
180efe6677
|
YARN-2556. Tool to measure the performance of the timeline server (Chang Li via sjlee)
(cherry picked from commit 58590fef49 )
|
2015-10-16 16:57:32 -07:00 |
Haohui Mai
|
ee04add696
|
HDFS-9167. Update pom.xml in other modules to depend on hdfs-client instead of hdfs. Contributed by Mingliang Liu.
|
2015-10-13 15:24:29 -07:00 |
Karthik Kambatla
|
2d8f9e3fd9
|
MAPREDUCE-6302. Incorrect headroom can lead to a deadlock between map and reduce allocations. (kasha)
(cherry picked from commit 4aa9b3e75c )
Conflicts:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/RMContainerAllocator.java
|
2015-10-09 07:54:47 -07:00 |
Jason Lowe
|
0139517811
|
YARN-261. Ability to fail AM attempts. Contributed by Andrey Klochkov and Rohith Sharma K S
(cherry picked from commit a0bca2b5ad )
|
2015-10-09 14:19:41 +00:00 |
Akira Ajisaka
|
22ff37f5ce
|
MAPREDUCE-6479. Add missing mapred job command options in mapreduce document. Contributed by nijel.
(cherry picked from commit 584cf3bb35 )
|
2015-10-09 10:58:15 +09:00 |
Xuan
|
53bddc410f
|
YARN-1897. CLI and core support for signal container functionality. Contributed by Ming Ma
(cherry picked from commit 8f08532bde )
|
2015-10-02 18:53:04 -07:00 |
rohithsharmaks
|
7dd9ebdebc
|
MAPREDUCE-6485. Create a new task attempt with failed map task priority if in-progress attempts are unassigned. (Xianyin Xin via rohithsharmaks)
(cherry picked from commit 439f43ad3d )
|
2015-10-02 20:36:20 +05:30 |
Akira Ajisaka
|
e42f576232
|
MAPREDUCE-6497. Fix wrong value of JOB_FINISHED event in JobHistoryEventHandler. Contributed by Shinichi Yamashita.
(cherry picked from commit 195793c6f3 )
|
2015-10-01 10:26:00 +02:00 |
Jason Lowe
|
3c4c52a095
|
MAPREDUCE-6492. AsyncDispatcher exit with NPE on TaskAttemptImpl#sendJHStartEventForAssignedFailTask. Contributed by Bibin A Chundatt
(cherry picked from commit ab11085b81 )
|
2015-09-28 22:13:03 +00:00 |
Jian He
|
d458805690
|
YARN-1651. CapacityScheduler side changes to support container resize. Contributed by Wangda Tan
(cherry picked from commit 89cab1ba5f )
Conflicts:
hadoop-tools/hadoop-sls/src/main/java/org/apache/hadoop/yarn/sls/scheduler/SLSCapacityScheduler.java
|
2015-09-24 10:30:04 -07:00 |
Jian He
|
c19e8ffdc7
|
YARN-1449. AM-NM protocol changes to support container resizing. Contributed by Meng Ding & Wangda Tan)
(cherry picked from commit 83a18add10 )
|
2015-09-24 10:23:25 -07:00 |
Jian He
|
89dc37450c
|
YARN-3866. AM-RM protocol changes to support container resizing. Contributed by Meng Ding
(cherry picked from commit dfe2cb849f )
|
2015-09-24 10:23:13 -07:00 |
Zhihai Xu
|
e5ba1a0521
|
MAPREDUCE-6484. Yarn Client uses local address instead of RM address as token renewer in a secure cluster when RM HA is enabled. Contributed by Zhihai Xu
(cherry picked from commit 97a08807ec )
|
2015-09-24 08:14:11 -07:00 |
Tsuyoshi Ozawa
|
52cc2ca488
|
HADOOP-12428. Fix inconsistency between log-level guards and statements. Contributed by Jagadesh Kiran N and Jackie Chang.
(cherry picked from commit dfd807afab )
|
2015-09-22 12:54:44 +09:00 |
Zhihai Xu
|
88a3a07636
|
MAPREDUCE-6460. TestRMContainerAllocator.testAttemptNotFoundCausesRMCommunicatorException fails. Contributed by Zhihai Xu.
(cherry picked from commit e3ace31e2b )
|
2015-09-19 00:12:15 -07:00 |
Haohui Mai
|
0971503522
|
MAPREDUCE-6483. Replace deprecated method NameNode.getUri() with DFSUtilClient.getNNUri() in TestMRCredentials. Contributed by Mingliang Liu.
|
2015-09-18 13:36:22 -07:00 |
Wangda Tan
|
6041fc75d8
|
MAPREDUCE-6478. Add an option to skip cleanupJob stage or ignore cleanup failure during commitJob. (Junping Du via wangda)
|
2015-09-18 10:19:32 -07:00 |
Jason Lowe
|
f27f1ef44c
|
MAPREDUCE-5982. Task attempts that fail from the ASSIGNED state can disappear. Contributed by Chang Li
(cherry picked from commit ee4ee6af6a )
|
2015-09-17 21:38:44 +00:00 |
Jason Lowe
|
4861fadb17
|
MAPREDUCE-5002. AM could potentially allocate a reduce container to a map attempt. Contributed by Chang Li
(cherry picked from commit 3f82f582e5 )
|
2015-09-17 18:18:28 +00:00 |
Jason Lowe
|
316296e35f
|
MAPREDUCE-6481. LineRecordReader may give incomplete record and wrong position/key information for uncompressed input sometimes. Contributed by Zhihai Xu
(cherry picked from commit 58d1a02b8d )
|
2015-09-17 14:31:57 +00:00 |
Haohui Mai
|
ac2ed09be7
|
MAPREDUCE-6477. Replace usage of deprecated NameNode.DEFAULT_PORT in TestFileSystem. Contributed by Mingliang Liu.
|
2015-09-16 13:06:38 -07:00 |
Jason Lowe
|
52f56524d4
|
MAPREDUCE-6472. MapReduce AM should have java.io.tmpdir=./tmp to be consistent with tasks. Contributed by Naganarasimha G R
(cherry picked from commit 62943b8e3a )
|
2015-09-15 19:44:17 +00:00 |
Jason Lowe
|
7909462c3a
|
MAPREDUCE-6474. ShuffleHandler can possibly exhaust nodemanager file descriptors. Contributed by Kuhu Shukla
(cherry picked from commit 8e615588d5 )
|
2015-09-10 16:01:27 +00:00 |
Tsuyoshi Ozawa
|
8bf5362014
|
MAPREDUCE-6442. Stack trace is missing when error occurs in client protocol provider's constructor Contributed by Chang Li.
(cherry picked from commit 9b685773ec )
|
2015-09-05 11:21:35 +09:00 |
Andrew Wang
|
355398e441
|
HADOOP-12358. Add -safely flag to rm to prompt when deleting many files. Contributed by Xiaoyu Yao.
(cherry picked from commit e1feaf6db0 )
|
2015-09-04 13:48:42 -07:00 |
Akira Ajisaka
|
a61c0f5ca1
|
Revert "MAPREDUCE-6363. [NNBench] Lease mismatch error when running with multiple mappers. Contributed by Brahma Reddy Battula."
This reverts commit 98446ee695 .
|
2015-09-02 12:26:25 +09:00 |
Zhihai Xu
|
297bda600e
|
MAPREDUCE-6452. NPE when intermediate encrypt enabled for LocalRunner. Contributed by Zhihai Xu
(cherry picked from commit cbb249534a )
|
2015-08-28 12:20:49 -07:00 |
Jian He
|
387076894f
|
YARN-4014. Support user cli interface in for Application Priority. Contributed by Rohith Sharma K S
(cherry picked from commit 57c7ae1aff )
|
2015-08-24 20:37:18 -07:00 |
Akira Ajisaka
|
29819e7240
|
MAPREDUCE-6357. MultipleOutputs.write() API should document that output committing is not utilized when input path is absolute. Contributed by Dustin Cote.
(cherry picked from commit 2ba90c93d7 )
|
2015-08-21 10:43:05 +09:00 |
Vinod Kumar Vavilapalli
|
9da81a3955
|
MAPREDUCE-6454. Fixed MapReduce to modify HADOOP_CLASSPATH to have distributed cache files so that child processes running hadoop scripts can access these files. Contributed by Junping Du.
|
2015-08-20 17:35:24 -07:00 |
Karthik Kambatla
|
20734320a1
|
MAPREDUCE-6439. AM may fail instead of retrying if RM shuts down during the allocate call. (Anubhav Dhoot via kasha)
(cherry picked from commit 8dfec7a197 )
|
2015-08-15 00:53:13 -07:00 |
Karthik Kambatla
|
b826168173
|
MAPREDUCE-5817. Mappers get rescheduled on node transition even after all reducers are completed. (Sangjin Lee via kasha)
(cherry picked from commit 27d24f96ab )
|
2015-08-14 12:40:38 -07:00 |
Junping Du
|
c8469357ba
|
MAPREDUCE-6443. Add JvmPauseMonitor to JobHistoryServer. Contributed by Robert Kanter.
|
2015-08-06 07:00:42 -07:00 |
Colin Patrick Mccabe
|
07a042aa3c
|
HADOOP-7824. NativeIO.java flags and identifiers must be set correctly for each platform, not hardcoded to their Linux values (Martin Walsh via Colin P. McCabe)
(cherry picked from commit 21d10ccc6e )
|
2015-07-31 15:02:01 -07:00 |
Jason Lowe
|
508da4d461
|
MAPREDUCE-6394. Speed up Task processing loop in HsTasksBlock#render(). Contributed by Ray Chiang
(cherry picked from commit d0e0ba8010 )
|
2015-07-31 18:19:52 +00:00 |
Zhihai Xu
|
9d40eead81
|
MAPREDUCE-6433. launchTime may be negative. Contributed by Zhihai Xu
(cherry picked from commit 93d50b7824 )
|
2015-07-30 23:12:30 -07:00 |
Akira Ajisaka
|
4da8ff60ef
|
MAPREDUCE-5762. Port MAPREDUCE-3223 and MAPREDUCE-4695 (Remove MRv1 config from mapred-default.xml) to branch-2. (aajisaka)
|
2015-07-16 03:43:49 +09:00 |
Chris Douglas
|
2a0e551cd8
|
MAPREDUCE-6427. Fix typo in JobHistoryEventHandler. Contributed by Ray Chiang
|
2015-07-14 14:56:21 -07:00 |
Akira Ajisaka
|
0ba2defb9e
|
YARN-3381. Fix typo InvalidStateTransitonException. Contributed by Brahma Reddy Battula.
(cherry picked from commit 19295b36d9 )
|
2015-07-13 17:53:27 +09:00 |
Devaraj K
|
3074d7082e
|
MAPREDUCE-6426. TestShuffleHandler#testGetMapOutputInfo is failing.
Contributed by zhihai xu.
(cherry picked from commit fffb15bb43 )
|
2015-07-09 15:02:09 +05:30 |
Chris Douglas
|
5fbf91b453
|
MAPREDUCE-6038. A boolean may be set error in the Word Count v2.0 in MapReduce Tutorial. Contributed by Tsuyoshi Ozawa
(cherry picked from commit 4990ccfdc742be9c0517557a6256fefcae0df67d)
|
2015-07-07 10:26:57 -07:00 |
Devaraj K
|
415dd64461
|
MAPREDUCE-6425. ShuffleHandler passes wrong "base" parameter to
getMapOutputInfo if mapId is not in the cache. Contributed by zhihai xu.
(cherry picked from commit bff67dfe2f )
|
2015-07-06 13:47:54 +05:30 |
Jason Lowe
|
8a4970e845
|
MAPREDUCE-6418. MRApp should not shutdown LogManager during shutdown. Contributed by Chang Li
(cherry picked from commit eac1d18943 )
|
2015-07-01 18:02:17 +00:00 |
Jason Lowe
|
f3195eda27
|
MAPREDUCE-6420. Interrupted Exception in LocalContainerLauncher should be logged in warn/info level. Contributed by Chang Li
(cherry picked from commit 826715622e )
|
2015-07-01 17:50:47 +00:00 |
Jason Lowe
|
df4e1e4965
|
MAPREDUCE-6376. Add avro binary support for jhist files. Contributed by Ray Chiang
(cherry picked from commit 2ac87df578 )
Conflicts:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
|
2015-07-01 16:07:54 +00:00 |
Robert Kanter
|
e5b0439bc1
|
MAPREDUCE-6121. JobResourceUpdater#compareFs() doesn't handle HA namespaces (rchiang via rkanter)
(cherry picked from commit 3a72bfd082 )
|
2015-06-30 16:50:48 -07:00 |
Jason Lowe
|
fdfd5be2b3
|
MAPREDUCE-6384. Add the last reporting reducer info for too many fetch failure diagnostics. Contributed by Chang Li
(cherry picked from commit b6ba56457c )
|
2015-06-30 21:24:38 +00:00 |
Jason Lowe
|
31fd7a51d8
|
MAPREDUCE-6413. TestLocalJobSubmission is failing with unknown host. Contributed by zhihai xu
(cherry picked from commit aa5b15b03b )
|
2015-06-25 19:52:23 +00:00 |
Jason Lowe
|
2762affbb2
|
MAPREDUCE-6400. Multiple shuffle transfer fails because input is closed too early. Contributed by Brahma Reddy Battula, Akira AJISAKA, and Gera Shegalov.
(cherry picked from commit 72d08a0e41 )
|
2015-06-24 15:30:09 +00:00 |
Vinod Kumar Vavilapalli
|
8c9e2cf10a
|
MAPREDUCE-6410. Fixed MapReduce JobHistory server to use the right (login) UGI to refresh log and cleaner settings. Contributed by Varun Saxena.
(cherry picked from commit d481684c7c )
|
2015-06-23 11:41:05 -07:00 |
Jason Lowe
|
3bf44b862b
|
MAPREDUCE-5948. org.apache.hadoop.mapred.LineRecordReader does not handle multibyte record delimiters well. Contributed by Vinayakumar B, Rushabh Shah, and Akira AJISAKA
(cherry picked from commit 077250d8d7 )
|
2015-06-22 22:00:20 +00:00 |
Gera Shegalov
|
d8cc8f54dd
|
MAPREDUCE-6408. Queue name and user name should be printed on the job page. (Siqi Li via gera)
(cherry picked from commit 11ac848207 )
|
2015-06-22 14:42:31 -07:00 |
Akira Ajisaka
|
c4747158b7
|
MAPREDUCE-6403. Fix typo in the usage of NNBench. Contributed by Jagadesh Kiran N.
(cherry picked from commit 445b13240c )
|
2015-06-22 15:34:34 +09:00 |
Gera Shegalov
|
ee63c3e831
|
MAPREDUCE-6305. AM/Task log page should be able to link back to the job. (Siqi Li via gera)
(cherry picked from commit 055cd5a9a1 )
|
2015-06-20 12:40:59 -07:00 |
Gera Shegalov
|
34e744ce1a
|
MAPREDUCE-6316. Task Attempt List entries should link to the task overview. (Siqi Li via gera)
(cherry picked from commit 63d40d5286 )
|
2015-06-20 11:52:11 -07:00 |
Devaraj K
|
5c3070dc16
|
MAPREDUCE-6405. NullPointerException in App Attempts page. Contributed by
Siqi Li and Gera Shegalov.
(cherry picked from commit 311a4179cc )
|
2015-06-20 10:37:42 +05:30 |
Gera Shegalov
|
01991876ed
|
MAPREDUCE-6395. Improve the commit failure messages in MRAppMaster recovery. (Brahma Reddy Battula via gera)
(cherry picked from commit 10107243be )
|
2015-06-19 02:29:31 -07:00 |
Devaraj K
|
c4c7fd0bf1
|
MAPREDUCE-6373. The logger reports total input paths but it is referring
to input files. Contributed by Bibin A Chundatt.
(cherry picked from commit 1babe50a2c )
|
2015-06-18 11:45:11 +05:30 |
Akira Ajisaka
|
98446ee695
|
MAPREDUCE-6363. [NNBench] Lease mismatch error when running with multiple mappers. Contributed by Brahma Reddy Battula.
(cherry picked from commit 75a2560e51 )
|
2015-06-15 14:53:28 -07:00 |
Devaraj K
|
5426e3e929
|
MAPREDUCE-6350. JobHistory doesn't support fully-functional search.
Contributed by Siqi Li.
|
2015-06-10 12:43:31 +05:30 |
cnauroth
|
5a002aef12
|
MAPREDUCE-6392. Document mapred class path options. Contributed by Brahma Reddy Battula.
(cherry picked from commit 025a3a8be0 )
|
2015-06-08 16:22:12 -07:00 |
Tsuyoshi Ozawa
|
c6cdecc6b3
|
MAPREDUCE-6388. Remove deprecation warnings from JobHistoryServer classes. Contributed by Ray Chiang.
(cherry picked from commit 6afe20a7a4 )
|
2015-06-08 15:06:23 -07:00 |
Jason Lowe
|
588c22e5a0
|
MAPREDUCE-6354. ShuffleHandler should be able to log shuffle connections. Contributed by Chang Li
(cherry picked from commit b3ffa87003 )
|
2015-06-05 22:39:52 +00:00 |
Karthik Kambatla
|
1a2e6e8091
|
MAPREDUCE-6387. Serialize the recently added Task#encryptedSpillKey field at the end. (Arun Suresh via kasha)
(cherry picked from commit 6786daab33 )
|
2015-06-05 09:17:34 -07:00 |
Devaraj K
|
7f075f2b75
|
MAPREDUCE-6377. JHS sorting on state column not working in webUi.
Contributed by zhihai xu.
(cherry picked from commit 790a861766 )
Conflicts:
hadoop-mapreduce-project/CHANGES.txt
|
2015-06-05 16:03:02 +05:30 |
Vinod Kumar Vavilapalli
|
6044b5e5f6
|
MAPREDUCE-5232. Add a configuration to be able to log classpath and other system properties on mapreduce JVMs startup. Contributed by Sangjin Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1482643 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 4d8e350750 )
Conflicts:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/v2/util/TestMRApps.java
|
2015-06-04 11:15:30 -07:00 |
Akira Ajisaka
|
1cccd1eeb3
|
HADOOP-12058. Fix dead links to DistCp and Hadoop Archives pages. Contributed by Kazuho Fujii.
(cherry picked from commit dbed757cba )
|
2015-06-05 01:46:33 +09:00 |
Gera Shegalov
|
bae1ec5f29
|
MAPREDUCE-6382. Don't escape HTML links in Diagnostics in JHS job overview. (Siqi Li via gera)
(cherry picked from commit e8302071ff )
|
2015-06-03 23:52:16 -07:00 |
Gera Shegalov
|
25c1e54d3f
|
MAPREDUCE-6174. Combine common stream code into parent class for InMemoryMapOutput and OnDiskMapOutput. (Eric Payne via gera)
(cherry picked from commit d90c13e2da )
|
2015-06-03 16:57:54 -07:00 |
Zhijie Shen
|
2fcd3fe6ba
|
Revert "YARN-1462. Made RM write application tags to timeline server and exposed them to users via generic history web UI and REST API. Contributed by Xuan Gong."
This reverts commit 4e2ed34d20 .
|
2015-06-03 14:16:51 -07:00 |
Jason Lowe
|
5ecc647ae0
|
MAPREDUCE-6374. Distributed Cache File visibility should check permission of full path. Contributed by Chang Li
(cherry picked from commit 107da29ff9 )
|
2015-06-03 20:20:47 +00:00 |
Zhijie Shen
|
4e2ed34d20
|
YARN-1462. Made RM write application tags to timeline server and exposed them to users via generic history web UI and REST API. Contributed by Xuan Gong.
(cherry picked from commit a9f986bc5a41ab74171da1076d10e83c5adc284f)
|
2015-05-30 21:06:32 -07:00 |
Wangda Tan
|
7cd0874dfd
|
MAPREDUCE-6304. Specifying node labels when submitting MR jobs. (Naganarasimha G R via wangda)
(cherry picked from commit 3164e7d838 )
Conflicts:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/RMContainerAllocator.java
|
2015-05-27 14:43:20 -07:00 |
cnauroth
|
6ed8989a6f
|
YARN-3626. On Windows localized resources are not moved to the front of the classpath when they should be. Contributed by Craig Welch.
(cherry picked from commit 7bc33b63c78c6ee9a04c0c1511ef16e63f7f3074)
|
2015-05-27 14:21:15 -07:00 |
Colin Patrick Mccabe
|
3dec58dd78
|
HADOOP-11969. ThreadLocal initialization in several classes is not thread safe (Sean Busbey via Colin P. McCabe)
(cherry picked from commit 7dba7005b7 )
|
2015-05-26 12:40:41 -07:00 |
Tsuyoshi Ozawa
|
e694c3339e
|
MAPREDUCE-6364. Add a Kill link to Task Attempts page. Contributed by Ryu Kobayashi.
(cherry picked from commit 022f49d59e )
|
2015-05-26 23:59:20 +09:00 |
Tsuyoshi Ozawa
|
6042b53a74
|
MAPREDUCE-6204. TestJobCounters should use new properties instead of JobConf.MAPRED_TASK_JAVA_OPTS.
(cherry picked from commit b27ce3c531 )
|
2015-05-22 23:30:12 +09:00 |
Vinayakumar B
|
19895a41ad
|
HADOOP-11743. maven doesn't clean all the site files (Contributed by ramtin)
(cherry picked from commit 55ed6558ba )
Conflicts:
hadoop-common-project/hadoop-common/pom.xml
|
2015-05-22 16:46:50 +05:30 |
Wangda Tan
|
b5ba6979b7
|
YARN-3583. Support of NodeLabel object instead of plain String in YarnClient side. (Sunil G via wangda)
(cherry picked from commit 563eb1ad2a )
(cherry picked from commit b0d22b0c606fad6b4ab5443c0aed07c829b46726)
|
2015-05-19 17:37:24 -07:00 |
Devaraj K
|
b9865cbf3d
|
MAPREDUCE-6273. HistoryFileManager should check whether summaryFile exists
to avoid FileNotFoundException causing HistoryFileInfo into MOVE_FAILED
state. Contributed by zhihai xu.
(cherry picked from commit 1ea90144d5 )
|
2015-05-15 12:34:08 +05:30 |
Vinod Kumar Vavilapalli
|
87862970f1
|
Fixing MR intermediate spills. Contributed by Arun Suresh.
(cherry picked from commit 6b710a42e0 )
|
2015-05-14 16:56:56 -07:00 |
Devaraj K
|
454236ec19
|
MAPREDUCE-5708. Duplicate String.format in
YarnOutputFiles.getSpillFileForWrite. Contributed by Konstantin Weitz.
(cherry picked from commit 05ff54c66c )
|
2015-05-14 22:11:15 +05:30 |
Xuan
|
487d9b0f3f
|
YARN-3626. On Windows localized resources are not moved to the front of the classpath when they should be. Contributed by Craig Welch
(cherry picked from commit 0f95921447 )
|
2015-05-13 13:12:04 -07:00 |
Akira Ajisaka
|
345e62c6d5
|
Revert "MAPREDUCE-5762. Port MAPREDUCE-3223 (Remove MRv1 config from mapred-default.xml) to branch-2. (aajisaka)"
This reverts commit 853cc04668 .
|
2015-05-13 14:02:41 +09:00 |
Vinod Kumar Vavilapalli
|
d5755ba241
|
MAPREDUCE-6251. Added a new config for JobClient to retry JobStatus calls so that they don't fail on history-server backed by DFSes with not so strong guarantees. Contributed by Craig Welch.
(cherry picked from commit f24452d14e )
|
2015-05-12 12:13:23 -07:00 |
Tsuyoshi Ozawa
|
fb5b0ebb45
|
MAPREDUCE-6361. NPE issue in shuffle caused by concurrent issue between copySucceeded() in one thread and copyFailed() in another thread on the same host. Contributed by Junping Du.
(cherry picked from commit f4e2b3cc0b )
|
2015-05-13 00:28:36 +09:00 |
Vinayakumar B
|
cda1962996
|
MAPREDUCE-6360. TestMapreduceConfigFields is placed in wrong dir, introducing compile error (Contributed by Arshad Mohammad)
(cherry picked from commit 360dff5903 )
|
2015-05-12 12:50:44 +05:30 |
Jason Lowe
|
53e9973afc
|
MAPREDUCE-5465. Tasks are often killed before they exit on their own. Contributed by Ming Ma
|
2015-05-11 22:40:05 +00:00 |
Junping Du
|
a1a7deebf8
|
YARN-3587. Fix the javadoc of DelegationTokenSecretManager in yarn, etc. projects. Contributed by Gabor Liptak.
(cherry picked from commit 7e543c27fa )
|
2015-05-11 05:28:25 -07:00 |
Karthik Kambatla
|
52469b10dd
|
MAPREDUCE-6353. Divide by zero error in MR AM when calculating available containers. (Anubhav Dhoot via kasha)
(cherry picked from commit 1773aac780 )
|
2015-05-09 14:43:57 -07:00 |
Karthik Kambatla
|
e8dd0bc4fd
|
YARN-1287. Consolidate MockClocks. (Sebastian Wong and Anubhav Dhoot via kasha)
(cherry picked from commit 70fb37cd79 )
|
2015-05-09 14:35:13 -07:00 |
Junping Du
|
39c188449e
|
MAPREDUCE-6359. In RM HA setup, Cluster tab links populated with AM hostname instead of RM. Contributed by zhaoyunjiong.
(cherry picked from commit df36ad0a08 )
|
2015-05-09 06:12:01 -07:00 |
Ravi Prakash
|
23065e6051
|
MAPREDUCE-4750. Enable NNBenchWithoutMR in MapredTestDriver (Liang Xie and Jason Lowe via raviprak)
(cherry picked from commit 5aab014340 )
|
2015-05-08 15:58:29 -07:00 |
Jason Lowe
|
0f6c971282
|
MAPREDUCE-5248. Let NNBenchWithoutMR specify the replication factor for its test. Contributed by Erik Paulson
(cherry picked from commit 30099a36c6 )
|
2015-05-08 22:30:21 +00:00 |
Chris Douglas
|
4f301f92c1
|
MAPREDUCE-2094. LineRecordReader should not seek into non-splittable, compressed streams.
|
2015-05-08 14:30:56 -07:00 |
Jason Lowe
|
dfc4a62f7d
|
MAPREDUCE-3383. Duplicate job.getOutputValueGroupingComparator() in ReduceTask. Contributed by Binglin Chang
(cherry picked from commit c39012f4a0 )
|
2015-05-08 21:17:05 +00:00 |
Devaraj K
|
a957baeb71
|
MAPREDUCE-5981. Log levels of certain MR logs can be changed to DEBUG.
Contributed by Varun Saxena.
(cherry picked from commit dc2b2ae31f )
|
2015-05-08 21:28:52 +05:30 |
Devaraj K
|
ade5165ecf
|
MAPREDUCE-6342. Make POM project names consistent. Contributed by Rohith.
|
2015-05-08 15:20:35 +05:30 |
Akira Ajisaka
|
5cc036d473
|
MAPREDUCE-6079. Rename JobImpl#username to reporterUserName. Contributed by Tsuyoshi Ozawa.
(cherry picked from commit ecfa052274 )
|
2015-05-08 18:17:35 +09:00 |
Tsuyoshi Ozawa
|
1ae8bf5b21
|
MAPREDUCE-6284. Add Task Attempt State API to MapReduce Application Master REST API. Contributed by Ryu Kobayashi.
(cherry picked from commit d18f10ad1b )
|
2015-05-08 16:00:41 +09:00 |
Jason Lowe
|
976a3c1f9d
|
MAPREDUCE-6279. AM should explicity exit JVM after all services have stopped. Contributed by Eric Payne
(cherry picked from commit f30065c8b6 )
|
2015-05-07 22:06:54 +00:00 |
Akira Ajisaka
|
f7c011cbaa
|
MAPREDUCE-6356. Misspelling of threshold in log4j.properties for tests. Contributed by Brahma Reddy Battula.
(cherry picked from commit d335071398 )
|
2015-05-07 19:41:44 +09:00 |
Robert Kanter
|
bd207b6cc0
|
MAPREDUCE-6192. Create unit test to automatically compare MR related classes and mapred-default.xml (rchiang via rkanter)
|
2015-05-05 14:47:52 -07:00 |
Xuan
|
02cdcaec58
|
YARN-2123. Progress bars in Web UI always at 100% due to non-US locale.
Contributed by Akira AJISAKA
(cherry picked from commit b7dd3a4f04 )
|
2015-05-05 10:45:18 -07:00 |
Tsuyoshi Ozawa
|
4e96175b33
|
MAPREDUCE-6165. [JDK8] TestCombineFileInputFormat failed on JDK8. Contributed by Akira AJISAKA.
(cherry picked from commit 551615fa13 )
|
2015-05-05 10:23:25 +09:00 |