Akira Ajisaka
|
a8314505d0
|
MAPREDUCE-6589. TestTaskLog outputs a log under directory other than target/test-dir. (aajisaka)
(cherry picked from commit 2a59d01503 )
|
2015-12-30 01:34:15 +09:00 |
Akira Ajisaka
|
1a06949126
|
MAPREDUCE-6584. Remove trailing whitespaces from mapred-default.xml. (aajisaka)
|
2015-12-30 01:04:11 +09:00 |
Wangda Tan
|
ca575e6add
|
MAPREDUCE-6574. MR AM should print host of failed tasks. (Mohammad Shahid Khan via wangda)
(cherry picked from commit 32b3dc11eb )
|
2015-12-28 11:04:30 -08:00 |
Rohith Sharma K S
|
2d0348c907
|
MAPREDUCE-6419. JobHistoryServer doesn't sort properly based on Job ID when Job id's exceed 9999. (Mohammad Shahid Khan via rohithsharmaks)
(cherry picked from commit a308e86621 )
|
2015-12-24 12:00:37 +05:30 |
Akira Ajisaka
|
8607cb6074
|
MAPREDUCE-6583. Clarify confusing sentence in MapReduce tutorial document. Contributed by Kai Sasaki.
(cherry picked from commit 7995a6ea4d )
|
2015-12-21 00:16:39 +09:00 |
Jian He
|
1147b086d9
|
YARN-4164. Changed updateApplicationPriority API to return the updated application priority. Contributed by Rohith Sharma K S
|
2015-12-18 14:14:31 -08:00 |
Xuan
|
5891d6ed55
|
MAPREDUCE-6566. Add retry support to mapreduce CLI tool. Contributed by Varun Vasudev
(cherry picked from commit d4e766de93 )
|
2015-12-16 15:29:33 -08:00 |
Vinod Kumar Vavilapalli
|
74a011d73a
|
Revert "MAPREDUCE-6566. Add retry support to mapreduce CLI tool. Contributed by Varun Vasudev"
This reverts commit 3b10ff6a6f .
|
2015-12-16 15:12:24 -08:00 |
Zhihai Xu
|
da7bde60c0
|
MAPREDUCE-6436. JobHistory cache issue. Contributed by Kai Sasaki
(cherry picked from commit 5b7078d069 )
|
2015-12-15 01:03:10 -08:00 |
Xuan
|
3b10ff6a6f
|
MAPREDUCE-6566. Add retry support to mapreduce CLI tool. Contributed by Varun Vasudev
(cherry picked from commit fc470840a0 )
|
2015-12-07 14:15:50 -08:00 |
Steve Loughran
|
af14458de7
|
HADOOP-12321. Make JvmPauseMonitor an AbstractService. (Sunil G via Stevel) [includes HDFS-8947 MAPREDUCE-6462 and YARN-4072]
|
2015-12-06 17:42:56 +00:00 |
Jian He
|
23fe1abc02
|
YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999). Contributed by Mohammad Shahid Khan and Varun Saxena
(cherry picked from commit 9f77ccad73 )
|
2015-12-03 12:49:22 -08:00 |
Vinod Kumar Vavilapalli
|
b20e77eba3
|
Preparing for 2.9.0 development: mvn versions:set -DnewVersion=2.9.0
|
2015-11-25 17:47:22 -08:00 |
Robert Kanter
|
8c6273d117
|
MAPREDUCE-6549. multibyte delimiters with LineRecordReader cause duplicate records (wilfreds via rkanter)
(cherry picked from commit 7fd00b3db4 )
|
2015-11-25 17:03:52 -08:00 |
Junping Du
|
628c782870
|
Tests in mapreduce-client-app are writing outside of target. Contributed by Akira AJISAKA.
(cherry picked from commit 15d577bfbb )
|
2015-11-25 09:16:22 -08:00 |
Akira Ajisaka
|
c6cf7910a4
|
MAPREDUCE-6553. Replace '\u2b05' with '<-' in rendering job configuration. Contributed by Gabor Liptak.
(cherry picked from commit 5ec44fc35c )
|
2015-11-25 16:33:18 +09:00 |
Jason Lowe
|
2f18218508
|
MAPREDUCE-5870. Support for passing Job priority through Application Submission Context in Mapreduce Side. Contributed by Sunil G
(cherry picked from commit f634505d48 )
Conflicts:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestJobConf.java
|
2015-11-24 22:15:37 +00:00 |
Jason Lowe
|
ef3e01a1e4
|
MAPREDUCE-5883. "Total megabyte-seconds" in job counters is slightly misleading. Contributed by Nathan Roberts
(cherry picked from commit cab3c7c889 )
|
2015-11-24 22:01:53 +00:00 |
Jian He
|
b339a4b8d6
|
YARN-4349. Support CallerContext in YARN. Contributed by Wangda Tan
(cherry picked from commit 8676a118a1 )
|
2015-11-23 17:20:24 -08:00 |
Haohui Mai
|
469fef2a4f
|
HDFS-9153. Pretty-format the output for DFSIO. Contributed by Kai Zheng.
|
2015-11-22 16:18:16 -08:00 |
Akira Ajisaka
|
8de7911eb3
|
MAPREDUCE-6499. Add elapsed time for retired job in JobHistoryServer WebUI. Contributed by Lin Yiqun.
(cherry picked from commit a7f776ffdf )
|
2015-11-17 15:18:32 +09:00 |
Jian He
|
2cf084ac76
|
Revert "YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999) Contributed by Mohammad Shahid Khan"
This reverts commit a4ff03b200 .
Conflicts:
hadoop-yarn-project/CHANGES.txt
|
2015-11-16 20:19:31 -08:00 |
Jian He
|
f562c155d2
|
MAPREDUCE-5485. Allow repeating job commit by extending OutputCommitter API. Contributed by Junping Du
|
2015-11-16 17:08:22 -08:00 |
Sangjin Lee
|
3214c2331f
|
MAPREDUCE-6540. TestMRTimelineEventHandling fails (sjlee)
(cherry picked from commit 9ad708a0df )
|
2015-11-11 16:22:28 -08:00 |
Jason Lowe
|
ee5c20ddef
|
MAPREDUCE-6533. testDetermineCacheVisibilities of TestClientDistributedCacheManager is broken. Contributed by Chang Li
(cherry picked from commit df68eac825 )
|
2015-11-11 17:27:03 +00:00 |
Jian He
|
a4ff03b200
|
YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999) Contributed by Mohammad Shahid Khan
(cherry picked from commit 8fbea531d7 )
|
2015-11-09 11:05:12 -08:00 |
Tsuyoshi Ozawa
|
1c0c77e7f0
|
MAPREDUCE-5763. Warn message about httpshuffle in NM logs. Contributed by Akira AJISAKA.
(cherry picked from commit 668e897538 )
|
2015-11-09 15:26:02 +09:00 |
Jason Lowe
|
a7d8895b60
|
MAPREDUCE-6528. Memory leak for HistoryFileManager.getJobSummary(). Contributed by Junping Du
(cherry picked from commit 6344b6a769 )
|
2015-10-30 15:32:48 +00:00 |
Tsuyoshi Ozawa
|
1c80473a41
|
YARN-4320. TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no longer binds to default port 8188. Contributed by Varun Saxena.
(cherry picked from commit ce31b22739 )
|
2015-10-30 18:00:35 +09:00 |
Xuan
|
b505bf9e58
|
YARN-4313. Race condition in MiniMRYarnCluster when getting history
server address. Contributed by Jian He
(cherry picked from commit 7412ff48ee )
|
2015-10-29 17:37:24 -07:00 |
Jason Lowe
|
145058003a
|
MAPREDUCE-6515. Update Application priority in AM side from AM-RM heartbeat. Contributed by Sunil G
(cherry picked from commit cf953b6258 )
|
2015-10-29 18:05:56 +00:00 |
Tsuyoshi Ozawa
|
3138b43f16
|
YARN-3573. MiniMRYarnCluster constructor that starts the timeline server using a boolean should be marked deprecated. Contributed by Brahma Reddy Battula.
(cherry picked from commit 96677bef00 )
|
2015-10-27 12:35:20 +09:00 |
Junping Du
|
801ce47e28
|
MAPREDUCE-6508. TestNetworkedJob fails consistently due to delegation token changes on RM. Contributed by Akira AJISAKA
(cherry picked from commit eb6379ca25 )
|
2015-10-23 10:07:41 -07:00 |
Jason Lowe
|
7c002e2416
|
MAPREDUCE-6518. Set SO_KEEPALIVE on shuffle connections. Contributed by Chang Li
(cherry picked from commit ee9b80acf8 )
|
2015-10-21 21:45:51 +00:00 |
Jason Lowe
|
be72ed1c75
|
MAPREDUCE-6489. Fail fast rogue tasks that write too much to local disk. Contributed by Maysam Yabandeh
|
2015-10-21 14:11:48 +00:00 |
Robert Kanter
|
492142097b
|
MAPREDUCE-6495. Docs for archive-logs tool (rkanter)
(cherry picked from commit 0c4af0f998 )
|
2015-10-20 17:34:56 -07:00 |
Sangjin Lee
|
180efe6677
|
YARN-2556. Tool to measure the performance of the timeline server (Chang Li via sjlee)
(cherry picked from commit 58590fef49 )
|
2015-10-16 16:57:32 -07:00 |
Haohui Mai
|
ee04add696
|
HDFS-9167. Update pom.xml in other modules to depend on hdfs-client instead of hdfs. Contributed by Mingliang Liu.
|
2015-10-13 15:24:29 -07:00 |
Karthik Kambatla
|
2d8f9e3fd9
|
MAPREDUCE-6302. Incorrect headroom can lead to a deadlock between map and reduce allocations. (kasha)
(cherry picked from commit 4aa9b3e75c )
Conflicts:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/RMContainerAllocator.java
|
2015-10-09 07:54:47 -07:00 |
Jason Lowe
|
0139517811
|
YARN-261. Ability to fail AM attempts. Contributed by Andrey Klochkov and Rohith Sharma K S
(cherry picked from commit a0bca2b5ad )
|
2015-10-09 14:19:41 +00:00 |
Akira Ajisaka
|
22ff37f5ce
|
MAPREDUCE-6479. Add missing mapred job command options in mapreduce document. Contributed by nijel.
(cherry picked from commit 584cf3bb35 )
|
2015-10-09 10:58:15 +09:00 |
Xuan
|
53bddc410f
|
YARN-1897. CLI and core support for signal container functionality. Contributed by Ming Ma
(cherry picked from commit 8f08532bde )
|
2015-10-02 18:53:04 -07:00 |
rohithsharmaks
|
7dd9ebdebc
|
MAPREDUCE-6485. Create a new task attempt with failed map task priority if in-progress attempts are unassigned. (Xianyin Xin via rohithsharmaks)
(cherry picked from commit 439f43ad3d )
|
2015-10-02 20:36:20 +05:30 |
Akira Ajisaka
|
e42f576232
|
MAPREDUCE-6497. Fix wrong value of JOB_FINISHED event in JobHistoryEventHandler. Contributed by Shinichi Yamashita.
(cherry picked from commit 195793c6f3 )
|
2015-10-01 10:26:00 +02:00 |
Jason Lowe
|
3c4c52a095
|
MAPREDUCE-6492. AsyncDispatcher exit with NPE on TaskAttemptImpl#sendJHStartEventForAssignedFailTask. Contributed by Bibin A Chundatt
(cherry picked from commit ab11085b81 )
|
2015-09-28 22:13:03 +00:00 |
Jian He
|
d458805690
|
YARN-1651. CapacityScheduler side changes to support container resize. Contributed by Wangda Tan
(cherry picked from commit 89cab1ba5f )
Conflicts:
hadoop-tools/hadoop-sls/src/main/java/org/apache/hadoop/yarn/sls/scheduler/SLSCapacityScheduler.java
|
2015-09-24 10:30:04 -07:00 |
Jian He
|
c19e8ffdc7
|
YARN-1449. AM-NM protocol changes to support container resizing. Contributed by Meng Ding & Wangda Tan)
(cherry picked from commit 83a18add10 )
|
2015-09-24 10:23:25 -07:00 |
Jian He
|
89dc37450c
|
YARN-3866. AM-RM protocol changes to support container resizing. Contributed by Meng Ding
(cherry picked from commit dfe2cb849f )
|
2015-09-24 10:23:13 -07:00 |
Zhihai Xu
|
e5ba1a0521
|
MAPREDUCE-6484. Yarn Client uses local address instead of RM address as token renewer in a secure cluster when RM HA is enabled. Contributed by Zhihai Xu
(cherry picked from commit 97a08807ec )
|
2015-09-24 08:14:11 -07:00 |
Tsuyoshi Ozawa
|
52cc2ca488
|
HADOOP-12428. Fix inconsistency between log-level guards and statements. Contributed by Jagadesh Kiran N and Jackie Chang.
(cherry picked from commit dfd807afab )
|
2015-09-22 12:54:44 +09:00 |
Zhihai Xu
|
88a3a07636
|
MAPREDUCE-6460. TestRMContainerAllocator.testAttemptNotFoundCausesRMCommunicatorException fails. Contributed by Zhihai Xu.
(cherry picked from commit e3ace31e2b )
|
2015-09-19 00:12:15 -07:00 |
Haohui Mai
|
0971503522
|
MAPREDUCE-6483. Replace deprecated method NameNode.getUri() with DFSUtilClient.getNNUri() in TestMRCredentials. Contributed by Mingliang Liu.
|
2015-09-18 13:36:22 -07:00 |
Wangda Tan
|
6041fc75d8
|
MAPREDUCE-6478. Add an option to skip cleanupJob stage or ignore cleanup failure during commitJob. (Junping Du via wangda)
|
2015-09-18 10:19:32 -07:00 |
Jason Lowe
|
f27f1ef44c
|
MAPREDUCE-5982. Task attempts that fail from the ASSIGNED state can disappear. Contributed by Chang Li
(cherry picked from commit ee4ee6af6a )
|
2015-09-17 21:38:44 +00:00 |
Jason Lowe
|
4861fadb17
|
MAPREDUCE-5002. AM could potentially allocate a reduce container to a map attempt. Contributed by Chang Li
(cherry picked from commit 3f82f582e5 )
|
2015-09-17 18:18:28 +00:00 |
Jason Lowe
|
316296e35f
|
MAPREDUCE-6481. LineRecordReader may give incomplete record and wrong position/key information for uncompressed input sometimes. Contributed by Zhihai Xu
(cherry picked from commit 58d1a02b8d )
|
2015-09-17 14:31:57 +00:00 |
Haohui Mai
|
ac2ed09be7
|
MAPREDUCE-6477. Replace usage of deprecated NameNode.DEFAULT_PORT in TestFileSystem. Contributed by Mingliang Liu.
|
2015-09-16 13:06:38 -07:00 |
Jason Lowe
|
52f56524d4
|
MAPREDUCE-6472. MapReduce AM should have java.io.tmpdir=./tmp to be consistent with tasks. Contributed by Naganarasimha G R
(cherry picked from commit 62943b8e3a )
|
2015-09-15 19:44:17 +00:00 |
Jason Lowe
|
7909462c3a
|
MAPREDUCE-6474. ShuffleHandler can possibly exhaust nodemanager file descriptors. Contributed by Kuhu Shukla
(cherry picked from commit 8e615588d5 )
|
2015-09-10 16:01:27 +00:00 |
Tsuyoshi Ozawa
|
8bf5362014
|
MAPREDUCE-6442. Stack trace is missing when error occurs in client protocol provider's constructor Contributed by Chang Li.
(cherry picked from commit 9b685773ec )
|
2015-09-05 11:21:35 +09:00 |
Andrew Wang
|
355398e441
|
HADOOP-12358. Add -safely flag to rm to prompt when deleting many files. Contributed by Xiaoyu Yao.
(cherry picked from commit e1feaf6db0 )
|
2015-09-04 13:48:42 -07:00 |
Akira Ajisaka
|
a61c0f5ca1
|
Revert "MAPREDUCE-6363. [NNBench] Lease mismatch error when running with multiple mappers. Contributed by Brahma Reddy Battula."
This reverts commit 98446ee695 .
|
2015-09-02 12:26:25 +09:00 |
Zhihai Xu
|
297bda600e
|
MAPREDUCE-6452. NPE when intermediate encrypt enabled for LocalRunner. Contributed by Zhihai Xu
(cherry picked from commit cbb249534a )
|
2015-08-28 12:20:49 -07:00 |
Jian He
|
387076894f
|
YARN-4014. Support user cli interface in for Application Priority. Contributed by Rohith Sharma K S
(cherry picked from commit 57c7ae1aff )
|
2015-08-24 20:37:18 -07:00 |
Akira Ajisaka
|
29819e7240
|
MAPREDUCE-6357. MultipleOutputs.write() API should document that output committing is not utilized when input path is absolute. Contributed by Dustin Cote.
(cherry picked from commit 2ba90c93d7 )
|
2015-08-21 10:43:05 +09:00 |
Vinod Kumar Vavilapalli
|
9da81a3955
|
MAPREDUCE-6454. Fixed MapReduce to modify HADOOP_CLASSPATH to have distributed cache files so that child processes running hadoop scripts can access these files. Contributed by Junping Du.
|
2015-08-20 17:35:24 -07:00 |
Karthik Kambatla
|
20734320a1
|
MAPREDUCE-6439. AM may fail instead of retrying if RM shuts down during the allocate call. (Anubhav Dhoot via kasha)
(cherry picked from commit 8dfec7a197 )
|
2015-08-15 00:53:13 -07:00 |
Karthik Kambatla
|
b826168173
|
MAPREDUCE-5817. Mappers get rescheduled on node transition even after all reducers are completed. (Sangjin Lee via kasha)
(cherry picked from commit 27d24f96ab )
|
2015-08-14 12:40:38 -07:00 |
Junping Du
|
c8469357ba
|
MAPREDUCE-6443. Add JvmPauseMonitor to JobHistoryServer. Contributed by Robert Kanter.
|
2015-08-06 07:00:42 -07:00 |
Colin Patrick Mccabe
|
07a042aa3c
|
HADOOP-7824. NativeIO.java flags and identifiers must be set correctly for each platform, not hardcoded to their Linux values (Martin Walsh via Colin P. McCabe)
(cherry picked from commit 21d10ccc6e )
|
2015-07-31 15:02:01 -07:00 |
Jason Lowe
|
508da4d461
|
MAPREDUCE-6394. Speed up Task processing loop in HsTasksBlock#render(). Contributed by Ray Chiang
(cherry picked from commit d0e0ba8010 )
|
2015-07-31 18:19:52 +00:00 |
Zhihai Xu
|
9d40eead81
|
MAPREDUCE-6433. launchTime may be negative. Contributed by Zhihai Xu
(cherry picked from commit 93d50b7824 )
|
2015-07-30 23:12:30 -07:00 |
Akira Ajisaka
|
4da8ff60ef
|
MAPREDUCE-5762. Port MAPREDUCE-3223 and MAPREDUCE-4695 (Remove MRv1 config from mapred-default.xml) to branch-2. (aajisaka)
|
2015-07-16 03:43:49 +09:00 |
Chris Douglas
|
2a0e551cd8
|
MAPREDUCE-6427. Fix typo in JobHistoryEventHandler. Contributed by Ray Chiang
|
2015-07-14 14:56:21 -07:00 |
Akira Ajisaka
|
0ba2defb9e
|
YARN-3381. Fix typo InvalidStateTransitonException. Contributed by Brahma Reddy Battula.
(cherry picked from commit 19295b36d9 )
|
2015-07-13 17:53:27 +09:00 |
Devaraj K
|
3074d7082e
|
MAPREDUCE-6426. TestShuffleHandler#testGetMapOutputInfo is failing.
Contributed by zhihai xu.
(cherry picked from commit fffb15bb43 )
|
2015-07-09 15:02:09 +05:30 |
Chris Douglas
|
5fbf91b453
|
MAPREDUCE-6038. A boolean may be set error in the Word Count v2.0 in MapReduce Tutorial. Contributed by Tsuyoshi Ozawa
(cherry picked from commit 4990ccfdc742be9c0517557a6256fefcae0df67d)
|
2015-07-07 10:26:57 -07:00 |
Devaraj K
|
415dd64461
|
MAPREDUCE-6425. ShuffleHandler passes wrong "base" parameter to
getMapOutputInfo if mapId is not in the cache. Contributed by zhihai xu.
(cherry picked from commit bff67dfe2f )
|
2015-07-06 13:47:54 +05:30 |
Jason Lowe
|
8a4970e845
|
MAPREDUCE-6418. MRApp should not shutdown LogManager during shutdown. Contributed by Chang Li
(cherry picked from commit eac1d18943 )
|
2015-07-01 18:02:17 +00:00 |
Jason Lowe
|
f3195eda27
|
MAPREDUCE-6420. Interrupted Exception in LocalContainerLauncher should be logged in warn/info level. Contributed by Chang Li
(cherry picked from commit 826715622e )
|
2015-07-01 17:50:47 +00:00 |
Jason Lowe
|
df4e1e4965
|
MAPREDUCE-6376. Add avro binary support for jhist files. Contributed by Ray Chiang
(cherry picked from commit 2ac87df578 )
Conflicts:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
|
2015-07-01 16:07:54 +00:00 |
Robert Kanter
|
e5b0439bc1
|
MAPREDUCE-6121. JobResourceUpdater#compareFs() doesn't handle HA namespaces (rchiang via rkanter)
(cherry picked from commit 3a72bfd082 )
|
2015-06-30 16:50:48 -07:00 |
Jason Lowe
|
fdfd5be2b3
|
MAPREDUCE-6384. Add the last reporting reducer info for too many fetch failure diagnostics. Contributed by Chang Li
(cherry picked from commit b6ba56457c )
|
2015-06-30 21:24:38 +00:00 |
Jason Lowe
|
31fd7a51d8
|
MAPREDUCE-6413. TestLocalJobSubmission is failing with unknown host. Contributed by zhihai xu
(cherry picked from commit aa5b15b03b )
|
2015-06-25 19:52:23 +00:00 |
Jason Lowe
|
2762affbb2
|
MAPREDUCE-6400. Multiple shuffle transfer fails because input is closed too early. Contributed by Brahma Reddy Battula, Akira AJISAKA, and Gera Shegalov.
(cherry picked from commit 72d08a0e41 )
|
2015-06-24 15:30:09 +00:00 |
Vinod Kumar Vavilapalli
|
8c9e2cf10a
|
MAPREDUCE-6410. Fixed MapReduce JobHistory server to use the right (login) UGI to refresh log and cleaner settings. Contributed by Varun Saxena.
(cherry picked from commit d481684c7c )
|
2015-06-23 11:41:05 -07:00 |
Jason Lowe
|
3bf44b862b
|
MAPREDUCE-5948. org.apache.hadoop.mapred.LineRecordReader does not handle multibyte record delimiters well. Contributed by Vinayakumar B, Rushabh Shah, and Akira AJISAKA
(cherry picked from commit 077250d8d7 )
|
2015-06-22 22:00:20 +00:00 |
Gera Shegalov
|
d8cc8f54dd
|
MAPREDUCE-6408. Queue name and user name should be printed on the job page. (Siqi Li via gera)
(cherry picked from commit 11ac848207 )
|
2015-06-22 14:42:31 -07:00 |
Akira Ajisaka
|
c4747158b7
|
MAPREDUCE-6403. Fix typo in the usage of NNBench. Contributed by Jagadesh Kiran N.
(cherry picked from commit 445b13240c )
|
2015-06-22 15:34:34 +09:00 |
Gera Shegalov
|
ee63c3e831
|
MAPREDUCE-6305. AM/Task log page should be able to link back to the job. (Siqi Li via gera)
(cherry picked from commit 055cd5a9a1 )
|
2015-06-20 12:40:59 -07:00 |
Gera Shegalov
|
34e744ce1a
|
MAPREDUCE-6316. Task Attempt List entries should link to the task overview. (Siqi Li via gera)
(cherry picked from commit 63d40d5286 )
|
2015-06-20 11:52:11 -07:00 |
Devaraj K
|
5c3070dc16
|
MAPREDUCE-6405. NullPointerException in App Attempts page. Contributed by
Siqi Li and Gera Shegalov.
(cherry picked from commit 311a4179cc )
|
2015-06-20 10:37:42 +05:30 |
Gera Shegalov
|
01991876ed
|
MAPREDUCE-6395. Improve the commit failure messages in MRAppMaster recovery. (Brahma Reddy Battula via gera)
(cherry picked from commit 10107243be )
|
2015-06-19 02:29:31 -07:00 |
Devaraj K
|
c4c7fd0bf1
|
MAPREDUCE-6373. The logger reports total input paths but it is referring
to input files. Contributed by Bibin A Chundatt.
(cherry picked from commit 1babe50a2c )
|
2015-06-18 11:45:11 +05:30 |
Akira Ajisaka
|
98446ee695
|
MAPREDUCE-6363. [NNBench] Lease mismatch error when running with multiple mappers. Contributed by Brahma Reddy Battula.
(cherry picked from commit 75a2560e51 )
|
2015-06-15 14:53:28 -07:00 |
Devaraj K
|
5426e3e929
|
MAPREDUCE-6350. JobHistory doesn't support fully-functional search.
Contributed by Siqi Li.
|
2015-06-10 12:43:31 +05:30 |
cnauroth
|
5a002aef12
|
MAPREDUCE-6392. Document mapred class path options. Contributed by Brahma Reddy Battula.
(cherry picked from commit 025a3a8be0 )
|
2015-06-08 16:22:12 -07:00 |
Tsuyoshi Ozawa
|
c6cdecc6b3
|
MAPREDUCE-6388. Remove deprecation warnings from JobHistoryServer classes. Contributed by Ray Chiang.
(cherry picked from commit 6afe20a7a4 )
|
2015-06-08 15:06:23 -07:00 |
Jason Lowe
|
588c22e5a0
|
MAPREDUCE-6354. ShuffleHandler should be able to log shuffle connections. Contributed by Chang Li
(cherry picked from commit b3ffa87003 )
|
2015-06-05 22:39:52 +00:00 |
Karthik Kambatla
|
1a2e6e8091
|
MAPREDUCE-6387. Serialize the recently added Task#encryptedSpillKey field at the end. (Arun Suresh via kasha)
(cherry picked from commit 6786daab33 )
|
2015-06-05 09:17:34 -07:00 |
Devaraj K
|
7f075f2b75
|
MAPREDUCE-6377. JHS sorting on state column not working in webUi.
Contributed by zhihai xu.
(cherry picked from commit 790a861766 )
Conflicts:
hadoop-mapreduce-project/CHANGES.txt
|
2015-06-05 16:03:02 +05:30 |
Vinod Kumar Vavilapalli
|
6044b5e5f6
|
MAPREDUCE-5232. Add a configuration to be able to log classpath and other system properties on mapreduce JVMs startup. Contributed by Sangjin Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1482643 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 4d8e350750 )
Conflicts:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/v2/util/TestMRApps.java
|
2015-06-04 11:15:30 -07:00 |
Akira Ajisaka
|
1cccd1eeb3
|
HADOOP-12058. Fix dead links to DistCp and Hadoop Archives pages. Contributed by Kazuho Fujii.
(cherry picked from commit dbed757cba )
|
2015-06-05 01:46:33 +09:00 |
Gera Shegalov
|
bae1ec5f29
|
MAPREDUCE-6382. Don't escape HTML links in Diagnostics in JHS job overview. (Siqi Li via gera)
(cherry picked from commit e8302071ff )
|
2015-06-03 23:52:16 -07:00 |
Gera Shegalov
|
25c1e54d3f
|
MAPREDUCE-6174. Combine common stream code into parent class for InMemoryMapOutput and OnDiskMapOutput. (Eric Payne via gera)
(cherry picked from commit d90c13e2da )
|
2015-06-03 16:57:54 -07:00 |
Zhijie Shen
|
2fcd3fe6ba
|
Revert "YARN-1462. Made RM write application tags to timeline server and exposed them to users via generic history web UI and REST API. Contributed by Xuan Gong."
This reverts commit 4e2ed34d20 .
|
2015-06-03 14:16:51 -07:00 |
Jason Lowe
|
5ecc647ae0
|
MAPREDUCE-6374. Distributed Cache File visibility should check permission of full path. Contributed by Chang Li
(cherry picked from commit 107da29ff9 )
|
2015-06-03 20:20:47 +00:00 |
Zhijie Shen
|
4e2ed34d20
|
YARN-1462. Made RM write application tags to timeline server and exposed them to users via generic history web UI and REST API. Contributed by Xuan Gong.
(cherry picked from commit a9f986bc5a41ab74171da1076d10e83c5adc284f)
|
2015-05-30 21:06:32 -07:00 |
Wangda Tan
|
7cd0874dfd
|
MAPREDUCE-6304. Specifying node labels when submitting MR jobs. (Naganarasimha G R via wangda)
(cherry picked from commit 3164e7d838 )
Conflicts:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/RMContainerAllocator.java
|
2015-05-27 14:43:20 -07:00 |
cnauroth
|
6ed8989a6f
|
YARN-3626. On Windows localized resources are not moved to the front of the classpath when they should be. Contributed by Craig Welch.
(cherry picked from commit 7bc33b63c78c6ee9a04c0c1511ef16e63f7f3074)
|
2015-05-27 14:21:15 -07:00 |
Colin Patrick Mccabe
|
3dec58dd78
|
HADOOP-11969. ThreadLocal initialization in several classes is not thread safe (Sean Busbey via Colin P. McCabe)
(cherry picked from commit 7dba7005b7 )
|
2015-05-26 12:40:41 -07:00 |
Tsuyoshi Ozawa
|
e694c3339e
|
MAPREDUCE-6364. Add a Kill link to Task Attempts page. Contributed by Ryu Kobayashi.
(cherry picked from commit 022f49d59e )
|
2015-05-26 23:59:20 +09:00 |
Tsuyoshi Ozawa
|
6042b53a74
|
MAPREDUCE-6204. TestJobCounters should use new properties instead of JobConf.MAPRED_TASK_JAVA_OPTS.
(cherry picked from commit b27ce3c531 )
|
2015-05-22 23:30:12 +09:00 |
Vinayakumar B
|
19895a41ad
|
HADOOP-11743. maven doesn't clean all the site files (Contributed by ramtin)
(cherry picked from commit 55ed6558ba )
Conflicts:
hadoop-common-project/hadoop-common/pom.xml
|
2015-05-22 16:46:50 +05:30 |
Wangda Tan
|
b5ba6979b7
|
YARN-3583. Support of NodeLabel object instead of plain String in YarnClient side. (Sunil G via wangda)
(cherry picked from commit 563eb1ad2a )
(cherry picked from commit b0d22b0c606fad6b4ab5443c0aed07c829b46726)
|
2015-05-19 17:37:24 -07:00 |
Devaraj K
|
b9865cbf3d
|
MAPREDUCE-6273. HistoryFileManager should check whether summaryFile exists
to avoid FileNotFoundException causing HistoryFileInfo into MOVE_FAILED
state. Contributed by zhihai xu.
(cherry picked from commit 1ea90144d5 )
|
2015-05-15 12:34:08 +05:30 |
Vinod Kumar Vavilapalli
|
87862970f1
|
Fixing MR intermediate spills. Contributed by Arun Suresh.
(cherry picked from commit 6b710a42e0 )
|
2015-05-14 16:56:56 -07:00 |
Devaraj K
|
454236ec19
|
MAPREDUCE-5708. Duplicate String.format in
YarnOutputFiles.getSpillFileForWrite. Contributed by Konstantin Weitz.
(cherry picked from commit 05ff54c66c )
|
2015-05-14 22:11:15 +05:30 |
Xuan
|
487d9b0f3f
|
YARN-3626. On Windows localized resources are not moved to the front of the classpath when they should be. Contributed by Craig Welch
(cherry picked from commit 0f95921447 )
|
2015-05-13 13:12:04 -07:00 |
Akira Ajisaka
|
345e62c6d5
|
Revert "MAPREDUCE-5762. Port MAPREDUCE-3223 (Remove MRv1 config from mapred-default.xml) to branch-2. (aajisaka)"
This reverts commit 853cc04668 .
|
2015-05-13 14:02:41 +09:00 |
Vinod Kumar Vavilapalli
|
d5755ba241
|
MAPREDUCE-6251. Added a new config for JobClient to retry JobStatus calls so that they don't fail on history-server backed by DFSes with not so strong guarantees. Contributed by Craig Welch.
(cherry picked from commit f24452d14e )
|
2015-05-12 12:13:23 -07:00 |
Tsuyoshi Ozawa
|
fb5b0ebb45
|
MAPREDUCE-6361. NPE issue in shuffle caused by concurrent issue between copySucceeded() in one thread and copyFailed() in another thread on the same host. Contributed by Junping Du.
(cherry picked from commit f4e2b3cc0b )
|
2015-05-13 00:28:36 +09:00 |
Vinayakumar B
|
cda1962996
|
MAPREDUCE-6360. TestMapreduceConfigFields is placed in wrong dir, introducing compile error (Contributed by Arshad Mohammad)
(cherry picked from commit 360dff5903 )
|
2015-05-12 12:50:44 +05:30 |
Jason Lowe
|
53e9973afc
|
MAPREDUCE-5465. Tasks are often killed before they exit on their own. Contributed by Ming Ma
|
2015-05-11 22:40:05 +00:00 |
Junping Du
|
a1a7deebf8
|
YARN-3587. Fix the javadoc of DelegationTokenSecretManager in yarn, etc. projects. Contributed by Gabor Liptak.
(cherry picked from commit 7e543c27fa )
|
2015-05-11 05:28:25 -07:00 |
Karthik Kambatla
|
52469b10dd
|
MAPREDUCE-6353. Divide by zero error in MR AM when calculating available containers. (Anubhav Dhoot via kasha)
(cherry picked from commit 1773aac780 )
|
2015-05-09 14:43:57 -07:00 |
Karthik Kambatla
|
e8dd0bc4fd
|
YARN-1287. Consolidate MockClocks. (Sebastian Wong and Anubhav Dhoot via kasha)
(cherry picked from commit 70fb37cd79 )
|
2015-05-09 14:35:13 -07:00 |
Junping Du
|
39c188449e
|
MAPREDUCE-6359. In RM HA setup, Cluster tab links populated with AM hostname instead of RM. Contributed by zhaoyunjiong.
(cherry picked from commit df36ad0a08 )
|
2015-05-09 06:12:01 -07:00 |
Ravi Prakash
|
23065e6051
|
MAPREDUCE-4750. Enable NNBenchWithoutMR in MapredTestDriver (Liang Xie and Jason Lowe via raviprak)
(cherry picked from commit 5aab014340 )
|
2015-05-08 15:58:29 -07:00 |
Jason Lowe
|
0f6c971282
|
MAPREDUCE-5248. Let NNBenchWithoutMR specify the replication factor for its test. Contributed by Erik Paulson
(cherry picked from commit 30099a36c6 )
|
2015-05-08 22:30:21 +00:00 |
Chris Douglas
|
4f301f92c1
|
MAPREDUCE-2094. LineRecordReader should not seek into non-splittable, compressed streams.
|
2015-05-08 14:30:56 -07:00 |
Jason Lowe
|
dfc4a62f7d
|
MAPREDUCE-3383. Duplicate job.getOutputValueGroupingComparator() in ReduceTask. Contributed by Binglin Chang
(cherry picked from commit c39012f4a0 )
|
2015-05-08 21:17:05 +00:00 |
Devaraj K
|
a957baeb71
|
MAPREDUCE-5981. Log levels of certain MR logs can be changed to DEBUG.
Contributed by Varun Saxena.
(cherry picked from commit dc2b2ae31f )
|
2015-05-08 21:28:52 +05:30 |
Devaraj K
|
ade5165ecf
|
MAPREDUCE-6342. Make POM project names consistent. Contributed by Rohith.
|
2015-05-08 15:20:35 +05:30 |
Akira Ajisaka
|
5cc036d473
|
MAPREDUCE-6079. Rename JobImpl#username to reporterUserName. Contributed by Tsuyoshi Ozawa.
(cherry picked from commit ecfa052274 )
|
2015-05-08 18:17:35 +09:00 |
Tsuyoshi Ozawa
|
1ae8bf5b21
|
MAPREDUCE-6284. Add Task Attempt State API to MapReduce Application Master REST API. Contributed by Ryu Kobayashi.
(cherry picked from commit d18f10ad1b )
|
2015-05-08 16:00:41 +09:00 |
Jason Lowe
|
976a3c1f9d
|
MAPREDUCE-6279. AM should explicity exit JVM after all services have stopped. Contributed by Eric Payne
(cherry picked from commit f30065c8b6 )
|
2015-05-07 22:06:54 +00:00 |
Akira Ajisaka
|
f7c011cbaa
|
MAPREDUCE-6356. Misspelling of threshold in log4j.properties for tests. Contributed by Brahma Reddy Battula.
(cherry picked from commit d335071398 )
|
2015-05-07 19:41:44 +09:00 |
Robert Kanter
|
bd207b6cc0
|
MAPREDUCE-6192. Create unit test to automatically compare MR related classes and mapred-default.xml (rchiang via rkanter)
|
2015-05-05 14:47:52 -07:00 |
Xuan
|
02cdcaec58
|
YARN-2123. Progress bars in Web UI always at 100% due to non-US locale.
Contributed by Akira AJISAKA
(cherry picked from commit b7dd3a4f04 )
|
2015-05-05 10:45:18 -07:00 |
Tsuyoshi Ozawa
|
4e96175b33
|
MAPREDUCE-6165. [JDK8] TestCombineFileInputFormat failed on JDK8. Contributed by Akira AJISAKA.
(cherry picked from commit 551615fa13 )
|
2015-05-05 10:23:25 +09:00 |
Jason Lowe
|
81f128f293
|
MAPREDUCE-6259. IllegalArgumentException due to missing job submit time. Contributed by zhihai xu
(cherry picked from commit bf70c5ae28 )
|
2015-05-04 20:40:16 +00:00 |
Jason Lowe
|
87c2d915f1
|
MAPREDUCE-5649. Reduce cannot use more than 2G memory for the final merge. Contributed by Gera Shegalov
(cherry picked from commit 7dc3c1203d )
|
2015-05-04 19:03:43 +00:00 |
Tsuyoshi Ozawa
|
7e03bda3e7
|
MAPREDUCE-6349. Fix typo in property org.apache.hadoop.mapreduce.lib.chain.Chain.REDUCER_INPUT_VALUE_CLASS. Contributed by Ray Chiang.
(cherry picked from commit bb6ef2984d )
|
2015-05-04 15:36:53 +09:00 |
Tsuyoshi Ozawa
|
1035f550b9
|
MAPREDUCE-5905. CountersStrings.toEscapedCompactStrings outputs unnecessary null strings. Contributed by Akira AJISAKA.
(cherry picked from commit 3ba18362f2 )
|
2015-05-04 15:02:40 +09:00 |
Gera Shegalov
|
ff6492d603
|
MAPREDUCE-6345. Documentation fix for when CRLA is enabled for MRAppMaster logs. (Rohit Agarwal via gera)
(cherry picked from commit f1a152cc0a )
|
2015-05-01 19:07:14 -07:00 |
Devaraj K
|
c3d083a9ff
|
MAPREDUCE-6339. Job history file is not flushed correctly because
isTimerActive flag is not set true when flushTimerTask is scheduled.
Contributed by zhihai xu.
(cherry picked from commit f5b38477f9 )
|
2015-04-30 12:36:00 +05:30 |
Jason Lowe
|
ea828578a3
|
MAPREDUCE-6334. Fetcher#copyMapOutput is leaking usedMemory upon IOException during InMemoryMapOutput shuffle handler. Contributed by Eric Payne
(cherry picked from commit bc1bd7e5c4 )
|
2015-04-28 20:19:52 +00:00 |
Vinod Kumar Vavilapalli
|
32dc13d907
|
MAPREDUCE-6324. Fixed MapReduce uber jobs to not fail the udpate of AM-RM tokens when they roll-over. Contributed by Jason Lowe.
(cherry picked from commit 9fc32c5c4d )
|
2015-04-27 14:59:57 -07:00 |
Tsuyoshi Ozawa
|
fa9def5a2a
|
MAPREDUCE-6341. Fix typo in mapreduce tutorial. Contributed by John Michael Luy.
(cherry picked from commit 9a3dda3d34 )
Conflicts:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/site/markdown/MapReduceTutorial.md
|
2015-04-28 01:58:12 +09:00 |