Jason Lowe
|
3f82f582e5
|
MAPREDUCE-5002. AM could potentially allocate a reduce container to a map attempt. Contributed by Chang Li
|
2015-09-17 18:17:29 +00:00 |
Karthik Kambatla
|
8dfec7a197
|
MAPREDUCE-6439. AM may fail instead of retrying if RM shuts down during the allocate call. (Anubhav Dhoot via kasha)
|
2015-08-15 00:52:11 -07:00 |
|
Karthik Kambatla
|
27d24f96ab
|
MAPREDUCE-5817. Mappers get rescheduled on node transition even after all reducers are completed. (Sangjin Lee via kasha)
|
2015-08-14 12:29:50 -07:00 |
|
Jason Lowe
|
d0e0ba8010
|
MAPREDUCE-6394. Speed up Task processing loop in HsTasksBlock#render(). Contributed by Ray Chiang
|
2015-07-31 18:17:54 +00:00 |
Zhihai Xu
|
93d50b7824
|
MAPREDUCE-6433. launchTime may be negative. Contributed by Zhihai Xu
|
2015-07-30 23:07:31 -07:00 |
Allen Wittenauer
|
cf74772064
|
MAPREDUCE-5801. Uber mode's log message is missing a vcore reason (Steven Wong via aw)
|
2015-07-21 10:58:52 -07:00 |
Chris Douglas
|
f4ccdb11dc
|
MAPREDUCE-6427. Fix typo in JobHistoryEventHandler. Contributed by Ray Chiang
|
2015-07-14 14:55:43 -07:00 |
Akira Ajisaka
|
19295b36d9
|
YARN-3381. Fix typo InvalidStateTransitonException. Contributed by Brahma Reddy Battula.
|
2015-07-13 17:52:13 +09:00 |
|
Jason Lowe
|
eac1d18943
|
MAPREDUCE-6418. MRApp should not shutdown LogManager during shutdown. Contributed by Chang Li
|
2015-07-01 18:01:22 +00:00 |
|
Jason Lowe
|
826715622e
|
MAPREDUCE-6420. Interrupted Exception in LocalContainerLauncher should be logged in warn/info level. Contributed by Chang Li
|
2015-07-01 17:50:02 +00:00 |
|
Jason Lowe
|
2ac87df578
|
MAPREDUCE-6376. Add avro binary support for jhist files. Contributed by Ray Chiang
|
2015-07-01 16:00:03 +00:00 |
|
Jason Lowe
|
b6ba56457c
|
MAPREDUCE-6384. Add the last reporting reducer info for too many fetch failure diagnostics. Contributed by Chang Li
|
2015-06-30 21:22:30 +00:00 |
Gera Shegalov
|
11ac848207
|
MAPREDUCE-6408. Queue name and user name should be printed on the job page. (Siqi Li via gera)
|
2015-06-22 14:40:32 -07:00 |
|
Gera Shegalov
|
63d40d5286
|
MAPREDUCE-6316. Task Attempt List entries should link to the task overview. (Siqi Li via gera)
|
2015-06-20 11:38:21 -07:00 |
Devaraj K
|
311a4179cc
|
MAPREDUCE-6405. NullPointerException in App Attempts page. Contributed by
Siqi Li and Gera Shegalov.
|
2015-06-20 10:35:04 +05:30 |
|
Gera Shegalov
|
10107243be
|
MAPREDUCE-6395. Improve the commit failure messages in MRAppMaster recovery. (Brahma Reddy Battula via gera)
|
2015-06-19 02:22:59 -07:00 |
|
Devaraj K
|
6785661e55
|
MAPREDUCE-6350. JobHistory doesn't support fully-functional search.
Contributed by Siqi Li.
|
2015-06-10 12:40:29 +05:30 |
Tsuyoshi Ozawa
|
6afe20a7a4
|
MAPREDUCE-6388. Remove deprecation warnings from JobHistoryServer classes. Contributed by Ray Chiang.
|
2015-06-08 15:06:10 -07:00 |
cnauroth
|
4102e5882e
|
YARN-3626. On Windows localized resources are not moved to the front of the classpath when they should be. Contributed by Craig Welch.
|
2015-05-27 14:31:49 -07:00 |
Wangda Tan
|
3164e7d838
|
MAPREDUCE-6304. Specifying node labels when submitting MR jobs. (Naganarasimha G R via wangda)
|
2015-05-27 14:26:03 -07:00 |
|
Tsuyoshi Ozawa
|
022f49d59e
|
MAPREDUCE-6364. Add a Kill link to Task Attempts page. Contributed by Ryu Kobayashi.
|
2015-05-26 23:59:02 +09:00 |
Vinod Kumar Vavilapalli
|
6b710a42e0
|
Fixing MR intermediate spills. Contributed by Arun Suresh.
|
2015-05-14 16:07:56 -07:00 |
|
Devaraj K
|
05ff54c66c
|
MAPREDUCE-5708. Duplicate String.format in
YarnOutputFiles.getSpillFileForWrite. Contributed by Konstantin Weitz.
|
2015-05-14 22:09:54 +05:30 |
Vinayakumar B
|
360dff5903
|
MAPREDUCE-6360. TestMapreduceConfigFields is placed in wrong dir, introducing compile error (Contributed by Arshad Mohammad)
|
2015-05-12 12:49:16 +05:30 |
|
Jason Lowe
|
444836b3dc
|
MAPREDUCE-5465. Tasks are often killed before they exit on their own. Contributed by Ming Ma
|
2015-05-11 22:37:35 +00:00 |
|
Karthik Kambatla
|
1773aac780
|
MAPREDUCE-6353. Divide by zero error in MR AM when calculating available containers. (Anubhav Dhoot via kasha)
|
2015-05-09 14:43:18 -07:00 |
|
Karthik Kambatla
|
70fb37cd79
|
YARN-1287. Consolidate MockClocks. (Sebastian Wong and Anubhav Dhoot via kasha)
|
2015-05-09 14:34:54 -07:00 |
Junping Du
|
df36ad0a08
|
MAPREDUCE-6359. In RM HA setup, Cluster tab links populated with AM hostname instead of RM. Contributed by zhaoyunjiong.
|
2015-05-09 06:11:13 -07:00 |
|
Devaraj K
|
2401ff76be
|
MAPREDUCE-6342. Make POM project names consistent. Contributed by Rohith.
|
2015-05-08 15:17:52 +05:30 |
|
Akira Ajisaka
|
ecfa052274
|
MAPREDUCE-6079. Rename JobImpl#username to reporterUserName. Contributed by Tsuyoshi Ozawa.
|
2015-05-08 18:16:58 +09:00 |
|
Tsuyoshi Ozawa
|
d18f10ad1b
|
MAPREDUCE-6284. Add Task Attempt State API to MapReduce Application Master REST API. Contributed by Ryu Kobayashi.
|
2015-05-08 15:59:46 +09:00 |
|
Jason Lowe
|
f30065c8b6
|
MAPREDUCE-6279. AM should explicity exit JVM after all services have stopped. Contributed by Eric Payne
|
2015-05-07 22:05:12 +00:00 |
|
Akira Ajisaka
|
d335071398
|
MAPREDUCE-6356. Misspelling of threshold in log4j.properties for tests. Contributed by Brahma Reddy Battula.
|
2015-05-07 19:39:24 +09:00 |
Robert Kanter
|
9809a16d3c
|
MAPREDUCE-6192. Create unit test to automatically compare MR related classes and mapred-default.xml (rchiang via rkanter)
|
2015-05-05 14:43:28 -07:00 |
Xuan
|
b7dd3a4f04
|
YARN-2123. Progress bars in Web UI always at 100% due to non-US locale.
Contributed by Akira AJISAKA
|
2015-05-05 10:40:16 -07:00 |
|
Jason Lowe
|
bf70c5ae28
|
MAPREDUCE-6259. IllegalArgumentException due to missing job submit time. Contributed by zhihai xu
|
2015-05-04 20:39:18 +00:00 |
|
Devaraj K
|
f5b38477f9
|
MAPREDUCE-6339. Job history file is not flushed correctly because
isTimerActive flag is not set true when flushTimerTask is scheduled.
Contributed by zhihai xu.
|
2015-04-30 12:33:22 +05:30 |
|
Vinod Kumar Vavilapalli
|
9fc32c5c4d
|
MAPREDUCE-6324. Fixed MapReduce uber jobs to not fail the udpate of AM-RM tokens when they roll-over. Contributed by Jason Lowe.
|
2015-04-27 14:58:16 -07:00 |
|
Gera Shegalov
|
78c6b46241
|
MAPREDUCE-6333. TestEvents,TestAMWebServicesTasks,TestAppController are broken due to MAPREDUCE-6297. (Siqi Li via gera)
|
2015-04-24 17:31:10 -07:00 |
|
Gera Shegalov
|
725eb52ddc
|
MAPREDUCE-6293. Set job classloader on uber-job's LocalContainerLauncher event thread. (Sangjin Lee via gera)
|
2015-04-21 13:57:22 -07:00 |
|
Akira Ajisaka
|
1fa8075794
|
MAPREDUCE-6300. Task list sort by task id broken. Contributed by Siqi Li.
|
2015-04-16 10:04:09 -05:00 |
|
Akira Ajisaka
|
2c17da4208
|
Revert "MAPREDUCE-6300. Task list sort by task id broken. Contributed by Siqi Li."
This reverts commit 6ac98b4804.
|
2015-04-11 12:37:12 +09:00 |
|
Akira Ajisaka
|
6ac98b4804
|
MAPREDUCE-6300. Task list sort by task id broken. Contributed by Siqi Li.
|
2015-04-11 01:31:31 +09:00 |
Hitesh Shah
|
265ed1fe80
|
YARN-2890. MiniYarnCluster should turn on timeline service if configured to do so. Contributed by Mit Desai.
|
2015-04-08 14:13:10 -07:00 |
|
Jason Lowe
|
30da99cbaf
|
MAPREDUCE-6277. Job can post multiple history files if attempt loses connection to the RM. Contributed by Chang Li
|
2015-03-18 19:30:37 +00:00 |
|
Tsuyoshi Ozawa
|
9d38520c8e
|
MAPREDUCE-6265. Make ContainerLauncherImpl.INITIAL_POOL_SIZE configurable to better control to launch/kill containers. Contributed by Zhihai Xu
|
2015-03-14 16:44:02 +09:00 |
Jonathan Eagles
|
8180e676ab
|
YARN-3267. Timelineserver applies the ACL rules after applying the limit on the number of records (Chang Li via jeagles)
|
2015-03-13 12:04:30 -05:00 |
|
Tsuyoshi Ozawa
|
348208014b
|
MAPREDUCE-6136. MRAppMaster doesn't shutdown file systems. Contributed by Brahma Reddy Battula.
|
2015-03-05 14:12:47 +09:00 |
|
Junping Du
|
4228de9402
|
MAPREDUCE-5583. Ability to limit running map and reduce tasks. Contributed by Jason Lowe.
|
2015-03-03 02:02:28 -08:00 |
|
Tsuyoshi Ozawa
|
9ae7f9eb7b
|
MAPREDUCE-5657. Fix Javadoc errors caused by incorrect or illegal tags in doc comments. Contributed by Akira AJISAKA.
|
2015-03-03 18:06:26 +09:00 |
|
Tsuyoshi Ozawa
|
d1c6accb6f
|
HADOOP-11602. Fix toUpperCase/toLowerCase to use Locale.ENGLISH. (ozawa)
|
2015-03-03 14:17:52 +09:00 |
|
Akira Ajisaka
|
0d7d508c82
|
MAPREDUCE-6264. Remove httpclient dependency from hadoop-mapreduce-client. Contributed by Brahma Reddy Battula.
|
2015-02-24 11:34:26 -08:00 |
|
Tsuyoshi Ozawa
|
9cedad11d8
|
Revert "HADOOP-11602. Fix toUpperCase/toLowerCase to use Locale.ENGLISH. (ozawa)"
This reverts commit 946456c6d8.
Conflicts:
hadoop-common-project/hadoop-common/CHANGES.txt
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/QuotaByStorageTypeEntry.java
|
2015-02-25 00:32:04 +09:00 |
|
Tsuyoshi Ozawa
|
946456c6d8
|
HADOOP-11602. Fix toUpperCase/toLowerCase to use Locale.ENGLISH. (ozawa)
|
2015-02-19 13:06:53 +09:00 |
|
Tsuyoshi Ozawa
|
ba3c80a5ca
|
MAPREDUCE-6255. Fix JobCounter's format to use grouping separator. Contributed by Ryu Kobayashi.
|
2015-02-13 16:11:00 +09:00 |
|
Devaraj K
|
76e309ead0
|
MAPREDUCE-6253. Update use of Iterator to Iterable. Contributed by Ray
Chiang.
|
2015-02-12 13:45:19 +05:30 |
|
Jason Lowe
|
e1990ab427
|
MAPREDUCE-6186. Redundant call to requireJob() while displaying the conf page. Contributed by Rohit Agarwal
|
2015-02-05 20:13:31 +00:00 |
|
Robert Kanter
|
8acc5e9b4b
|
MAPREDUCE-6143. add configuration for mapreduce speculative execution in MR2 (zxu via rkanter)
|
2015-02-02 13:51:08 -08:00 |
|
Akira Ajisaka
|
342efa110a
|
HADOOP-9907. Webapp http://hostname:port/metrics link is not working. (aajisaka)
|
2015-01-30 02:49:10 +09:00 |
Jian He
|
cff05bff1f
|
MAPREDUCE-6230. Fixed RMContainerAllocator to update the new AMRMToken service name properly. Contributed by Jason Lowe
|
2015-01-28 15:51:30 -08:00 |
|
Gera Shegalov
|
a003f71cac
|
MAPREDUCE-5785. Derive heap size or mapreduce.*.memory.mb automatically. (Gera Shegalov and Karthik Kambatla via gera)
|
2015-01-21 18:42:03 -08:00 |
|
Akira Ajisaka
|
d336d13678
|
MAPREDUCE-6210. Use getApplicationAttemptId() instead of getApplicationID() for logging AttemptId in RMContainerAllocator.java (Contributed by Leitao Guo)
|
2015-01-14 17:38:35 +09:00 |
|
Jian He
|
a4f2995b9e
|
Revert "YARN-2890. MiniYARNCluster should start the timeline server based on the configuration. Contributed by Mit Desai."
This reverts commit 51af8d367d.
Conflicts:
hadoop-yarn-project/CHANGES.txt
|
2014-12-15 11:04:09 -08:00 |
|
Devaraj K
|
0bd0229110
|
MAPREDUCE-6046. Change the class name for logs in RMCommunicator.
Contributed by Sahil Takiar.
|
2014-12-12 11:42:03 +05:30 |
Haohui Mai
|
d777a1e4ca
|
HADOOP-11369. Fix new findbugs warnings in hadoop-mapreduce-client, non-core directories. Contributed by Li Lu.
|
2014-12-09 10:46:13 -08:00 |
|
Jason Lowe
|
03ab24aa01
|
MAPREDUCE-5932. Provide an option to use a dedicated reduce-side shuffle log. Contributed by Gera Shegalov
|
2014-12-03 17:02:14 +00:00 |
Zhijie Shen
|
51af8d367d
|
YARN-2890. MiniYARNCluster should start the timeline server based on the configuration. Contributed by Mit Desai.
|
2014-12-01 19:04:04 -08:00 |
|
Jason Lowe
|
0c588904f8
|
MAPREDUCE-6160. Potential NullPointerException in MRClientProtocol interface implementation. Contributed by Rohith
|
2014-12-01 22:39:22 +00:00 |
|
Karthik Kambatla
|
a655973e78
|
Revert "MAPREDUCE-5785. Derive heap size or mapreduce.*.memory.mb automatically. (Gera Shegalov and Karthik Kambatla via kasha)"
This reverts commit a4df9eed05.
|
2014-11-25 16:24:26 -08:00 |
|
Karthik Kambatla
|
a4df9eed05
|
MAPREDUCE-5785. Derive heap size or mapreduce.*.memory.mb automatically. (Gera Shegalov and Karthik Kambatla via kasha)
|
2014-11-21 18:36:41 -08:00 |
|
Jonathan Eagles
|
c298a9a845
|
YARN-2375. Allow enabling/disabling timeline server per framework. (Mit Desai via jeagles)
|
2014-11-20 23:34:35 -06:00 |
|
Devaraj K
|
7250b0bf91
|
MAPREDUCE-6049. AM JVM does not exit if MRClientService graceful shutdown
fails. Contributed by Rohith.
|
2014-11-18 22:05:13 +05:30 |
|
Jason Lowe
|
09b3dee122
|
MAPREDUCE-6162. mapred hsadmin fails on a secure cluster. Contributed by Jason Lowe
|
2014-11-17 22:59:59 +00:00 |
Arun C. Murthy
|
43cd07b408
|
YARN-2830. Add backwords compatible ContainerId.newInstance constructor. Contributed by Jonathan Eagles.
|
2014-11-09 14:57:37 -08:00 |
|
Jason Lowe
|
10f9f5101c
|
MAPREDUCE-5960. JobSubmitter's check whether job.jar is local is incorrect with no authority in job jar path. Contributed by Gera Shegalov
|
2014-11-06 15:10:40 +00:00 |
|
Zhijie Shen
|
ed63b11646
|
MAPREDUCE-6052. Supported overriding the default container-log4j.properties file per job. Contributed by Junping Du.
|
2014-11-01 00:47:57 -07:00 |
|
Vinod Kumar Vavilapalli
|
3f1441245d
|
MAPREDUCE-6142. Fixed test failures in TestJobHistoryEventHandler and TestMRTimelineEventHandling. Contributed by Zhijie Shen.
|
2014-10-29 09:57:39 -07:00 |
|
Zhijie Shen
|
971e91c8c0
|
MAPREDUCE-6018. Added an MR specific config to enable emitting job history data to the timeline server. Contributed by Robert Kanter.
|
2014-10-27 21:03:53 -07:00 |
|
Zhijie Shen
|
6b2f11b54b
|
MAPREDUCE-5933. Enabled MR AM to post history events to the timeline server. Contributed by Robert Kanter.
|
2014-10-27 20:35:40 -07:00 |
|
Zhijie Shen
|
0f3b6900be
|
YARN-2209. Replaced AM resync/shutdown command with corresponding exceptions and made related MR changes. Contributed by Jian He.
|
2014-10-23 21:56:03 -07:00 |
|
Jian He
|
0af1a2b5bc
|
YARN-2312. Deprecated old ContainerId#getId API and updated MapReduce to use ContainerId#getContainerId instead. Contributed by Tsuyoshi OZAWA
|
2014-10-15 15:22:07 -07:00 |
|
Jason Lowe
|
bbe80cdc7b
|
MAPREDUCE-6125. TestContainerLauncherImpl sometimes fails. Contributed by Mit Desai
|
2014-10-13 15:08:23 +00:00 |
|
Karthik Kambatla
|
e8a31f2e1c
|
MAPREDUCE-5875. Make Counter limits consistent across JobClient, MRAppMaster, and YarnChild. (Gera Shegalov via kasha)
|
2014-10-11 22:49:06 -07:00 |
|
Jason Lowe
|
2e789eb226
|
MAPREDUCE-6029. TestCommitterEventHandler fails in trunk. Contributed by Mit Desai
|
2014-10-07 14:10:39 +00:00 |
|
Zhijie Shen
|
376233cdd4
|
MAPREDUCE-5279. Made MR headroom calculation honor cpu dimension when YARN scheduler resource type is memory plus cpu. Contributed by Peng Zhang and Varun Vasudev.
|
2014-09-22 09:28:47 -07:00 |
|
Jason Lowe
|
7039b98e1c
|
MAPREDUCE-6095. Enable DistributedCache for uber-mode Jobs. Contributed by Gera Shegalov
|
2014-09-22 15:20:59 +00:00 |
|
Zhijie Shen
|
6fe5c6b746
|
YARN-2568. Fixed the potential test failures due to race conditions when RM work-preserving recovery is enabled. Contributed by Jian He.
|
2014-09-18 21:56:56 -07:00 |
|
Vinod Kumar Vavilapalli
|
14e2639fd0
|
YARN-611. Added an API to let apps specify an interval beyond which AM failures should be ignored towards counting max-attempts. Contributed by Xuan Gong.
|
2014-09-13 18:04:05 -07:00 |
|
Jian He
|
3122daa802
|
YARN-2229. Changed the integer field of ContainerId to be long type. Contributed by Tsuyoshi OZAWA
|
2014-09-12 10:33:33 -07:00 |
|
Jason Lowe
|
45efc966ee
|
MAPREDUCE-6071. JobImpl#makeUberDecision doesn't log that Uber mode is disabled because of too much CPUs. Contributed by Tsuyoshi OZAWA
|
2014-09-05 13:42:00 +00:00 |
|
Chris Douglas
|
48aa3b7274
|
Fix typos in log messages. Contributed by Ray Chiang
|
2014-08-28 16:29:35 -07:00 |
|
Zhijie Shen
|
524a63e59e
|
MAPREDUCE-6044. Fully qualified intermediate done dir path breaks per-user dir creation on Windows. Contributed by Zhijie Shen.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619863 13f79535-47bb-0310-9956-ffa450edef68
|
2014-08-22 17:06:23 +00:00 |
|
Jason Darrell Lowe
|
d51f81c3b6
|
MAPREDUCE-6036. TestJobEndNotifier fails intermittently in branch-2. Contributed by chang li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618691 13f79535-47bb-0310-9956-ffa450edef68
|
2014-08-18 18:18:22 +00:00 |
|
Zhijie Shen
|
f8e871d01b
|
MAPREDUCE-6024. Shortened the time when Fetcher is stuck in retrying before concluding the failure by configuration. Contributed by Yunjiong Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618677 13f79535-47bb-0310-9956-ffa450edef68
|
2014-08-18 17:57:48 +00:00 |
Eric Yang
|
08d6201b34
|
MAPREDUCE-6033. Updated access check for displaying job information
(Yu Gao via Eric Yang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618648 13f79535-47bb-0310-9956-ffa450edef68
|
2014-08-18 16:13:56 +00:00 |
|
Zhijie Shen
|
84bc2fe402
|
MAPREDUCE-6032. Made MR jobs write job history files on the default FS when the current context’s FS is different. Contributed by Benjamin Zhitomirsky.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618269 13f79535-47bb-0310-9956-ffa450edef68
|
2014-08-15 20:17:45 +00:00 |
|
Xuan Gong
|
eeb4acd955
|
YARN-2212: ApplicationMaster needs to find a way to update the AMRMToken periodically. Contributed by Xuan Gong
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616892 13f79535-47bb-0310-9956-ffa450edef68
|
2014-08-08 21:38:24 +00:00 |
|
Jason Darrell Lowe
|
857d134fda
|
MAPREDUCE-6014. New task status field in task attempts table can lead to an empty web page. Contributed by Mit Desai
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616018 13f79535-47bb-0310-9956-ffa450edef68
|
2014-08-05 21:52:22 +00:00 |
|
Xuan Gong
|
e52f67e389
|
YARN-1994. Expose YARN/MR endpoints on multiple interfaces. Contributed by Craig Welch, Milan Potocnik,and Arpit Agarwal
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614981 13f79535-47bb-0310-9956-ffa450edef68
|
2014-07-31 20:06:02 +00:00 |
|
Zhijie Shen
|
549bcc2c02
|
MAPREDUCE-6002. Made MR task avoid reporting error to AM when the task process is shutting down. Contributed by Wangda Tan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613743 13f79535-47bb-0310-9956-ffa450edef68
|
2014-07-27 01:37:51 +00:00 |