Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
7,825 Commits 326 Branches 371 Tags
Commit Graph

1525 Commits

Author SHA1 Message Date
Jonathan Eagles
6570f7fd72 YARN-2375. Allow enabling/disabling timeline server per framework. (Mit Desai via jeagles) 
(cherry picked from commit c298a9a845f89317eb9efad332e6657c56736a4d)
 2014-11-20 23:40:26 -06:00
Karthik Kambatla
7ba5bb0c5b YARN-2315. FairScheduler: Set current capacity in addition to capacity. (Zhihai Xu via kasha) 
(cherry picked from commit a9a0cc3679432774154a07d3157ffa0a43e0bf01)
 2014-11-19 20:19:54 -08:00
Karthik Kambatla
564deb75a8 YARN-2802. ClusterMetrics to include AM launch and register delays. (Zhihai Xu via kasha) 
(cherry picked from commit f9f8e750edbe6db453f0a845e2ed49ede66e0e8a)
 2014-11-19 19:50:35 -08:00
Jian He
db31ef7e7f YARN-2865. Fixed RM to always create a new RMContext when transtions from StandBy to Active. Contributed by Rohith Sharmaks 
(cherry picked from commit 9cb8b75ba57f18639492bfa3b7e7c11c00bb3d3b)
 2014-11-19 19:49:44 -08:00
Jian He
c359e2a6a4 YARN-2878. Fix DockerContainerExecutor.apt.vm formatting. Contributed by Abin Shahab 
(cherry picked from commit bc4ee5e06f89b2037e0967f8ba91089ced4b7f0e)
 2014-11-19 14:45:01 -08:00
Zhijie Shen
610e123772 YARN-2870. Updated the command to run the timeline server it the document. Contributed by Masatake Iwasaki. 
(cherry picked from commit ef38fb9758f230c3021e70b749d7a11f8bac03f5)
 2014-11-18 16:17:07 -08:00
Jian He
1412e712b4 YARN-2157. Added YARN metrics in the documentaion. Contributed by Akira AJISAKA 
(cherry picked from commit 90a968d6757511b6d89538516db0e699129d854c)
 2014-11-18 16:13:08 -08:00
Karthik Kambatla
8df4c04c3a YARN-2690. [YARN-2574] Make ReservationSystem and its dependent classes independent of Scheduler type. (Anubhav Dhoot via kasha) 
(cherry picked from commit 2fce6d61412843f0447f60cfe02326f769edae25)
 2014-11-17 16:46:18 -08:00
Jason Lowe
242fd0e39a YARN-2414. RM web UI: app page will crash if app is failed before any attempt has been created. Contributed by Wangda Tan 
(cherry picked from commit 81c9d17af84ed87b9ded7057cb726a3855ddd32d)
 2014-11-17 21:16:54 +00:00
Vinod Kumar Vavilapalli
41275755c7 YARN-1703. Fixed ResourceManager web-proxy to close connections correctly. Contributed by Rohith Sharma. 
(cherry picked from commit 198fb58776ec02397af5ad83259535b0291b745c)
 2014-11-15 12:06:53 -08:00
Jian He
21054c5d14 YARN-2432. RMStateStore should process the pending events before close. Contributed by Varun Saxena 
(cherry picked from commit 9b860661a5754e829bd8c34ef092757421589bbe)
 2014-11-14 17:25:21 -08:00
Sandy Ryza
c4c77669f0 YARN-2811. In Fair Scheduler, reservation fulfillments shouldn't ignore max share (Siqi Li via Sandy Ryza) 2014-11-14 15:20:37 -08:00
Jason Lowe
ad140d1fc8 YARN-2816. NM fail to start with NPE during container recovery. Contributed by Zhihai Xu 
(cherry picked from commit 49c38898b0be64fc686d039ed2fb2dea1378df02)
 2014-11-14 21:27:16 +00:00
Jason Lowe
00d135d75a YARN-2857. ConcurrentModificationException in ContainerLogAppender. Contributed by Mohammad Kamrul Islam 
(cherry picked from commit f2fe8a800e5b0f3875931adba9ae20c6a95aa4ff)
 2014-11-14 20:48:51 +00:00
Jian He
beb184ac58 YARN-2856. Fixed RMAppImpl to handle ATTEMPT_KILLED event at ACCEPTED state on app recovery. Contributed by Rohith Sharmaks 
(cherry picked from commit d005404ef7211fe96ce1801ed267a249568540fd)
 2014-11-13 15:34:56 -08:00
Zhijie Shen
53d6c91df9 YARN-2766. Made ApplicationHistoryManager return a sorted list of apps, attempts and containers. Contributed by Robert Kanter. 
(cherry picked from commit 3648cb57c9f018a3a339c26f5a0ca2779485521a)
 2014-11-13 13:54:30 -08:00
Vinod Kumar Vavilapalli
d35bcf2074 Revert "YARN-2603. ApplicationConstants missing HADOOP_MAPRED_HOME (Ray Chiang via aw)" 
This reverts commit b0a9cd37ab9ef45ed9a71b04f1634fa54dd4c438.

Conflicts:
	hadoop-yarn-project/CHANGES.txt

(cherry picked from commit 4ae9780e6a05bfd6b93f1c871c22761ddd8b19cb)
 2014-11-13 13:21:46 -08:00
Arun C. Murthy
fc324d7062 Preparing to release hadoop-2.6.0-rc1. 
(cherry picked from commit 9ff7315cbe9804bebcd1ec093fac7828a72ddf59)
 2014-11-13 13:03:13 -08:00
Arun C. Murthy
d0285d1ad6 YARN-2635. Merging to branch-2.6 for hadoop-2.6.0-rc1. 
(cherry picked from commit 81dc0ac6dcf2f34ad607da815ea0144f178691a9)
 2014-11-13 10:28:10 -08:00
Arun C. Murthy
906e0a1862 YARN-2853. Merging to branch-2.6 for hadoop-2.6.0-rc1. 
(cherry picked from commit d648e60ebab7f1942dba92e9cd2cb62b8d70419b)
 2014-11-13 10:05:07 -08:00
Jason Lowe
6fd547da8f YARN-2846. Incorrect persist exit code for running containers in reacquireContainer() that interrupted by NodeManager restart. Contributed by Junping Du 
(cherry picked from commit 33ea5ae92b9dd3abace104903d9a94d17dd75af5)
 2014-11-13 16:17:08 +00:00
Vinod Kumar Vavilapalli
ed3e5cb164 YARN-2853. Fixed a bug in ResourceManager causing apps to hang when the user kill request races with ApplicationMaster finish. Contributed by Jian He. 
(cherry picked from commit 3651fe1b089851b38be351c00a9899817166bf3e)
 2014-11-13 08:13:57 -08:00
cnauroth
69a7780ee5 HADOOP-7984. Add hadoop --loglevel option to change log level. Contributed by Aikira AJISAKA. 2014-11-12 21:44:05 -08:00
Allen Wittenauer
a6de8f2e30 YARN-2603. ApplicationConstants missing HADOOP_MAPRED_HOME (Ray Chiang via aw) 2014-11-12 17:04:24 -08:00
Zhijie Shen
8405ec0895 YARN-2794. Fixed log messages about distributing system-credentials. Contributed by Jian He. 
(cherry picked from commit be7bf956e96dd0fd9b521ca71df9124b9cc5ebd0)
 2014-11-12 11:09:34 -08:00
Arun C. Murthy
f7f78cf934 YARN-2843. Merging to branch-2.6 for hadoop-2.6.0-rc1. 2014-11-12 10:41:44 -08:00
Arun C. Murthy
cd8559e099 YARN-2841. Merging to branch-2.6 for hadoop-2.6.0-rc1. 2014-11-12 10:37:40 -08:00
Karthik Kambatla
ff1b13ded5 YARN-2236. [YARN-1492] Shared Cache uploader service on the Node Manager. (Chris Trezzo and Sanjin Lee via kasha) 
(cherry picked from commit a04143039e7fe310d807f40584633096181cfada)
 2014-11-12 09:31:30 -08:00
Jason Lowe
6984d899e3 YARN-2780. Log aggregated resource allocation in rm-appsummary.log. Contributed by Eric Payne 
(cherry picked from commit f8aefa5e9c8c6d2817205b5ed8d914db31f56ae7)
 2014-11-12 17:02:30 +00:00
Ravi Prakash
d863f54f57 YARN-1964. Create Docker analog of the LinuxContainerExecutor in YARN 2014-11-11 21:29:27 -08:00
Karthik Kambatla
6cbd3aa2e8 YARN-570. Time strings are formated in different timezone. (Akira Ajisaka and Peng Zhang via kasha) 
(cherry picked from commit 840b13110d63d7e062cefd4b993cc7dea44aed8d)
 2014-11-11 13:23:29 -08:00
Vinod Kumar Vavilapalli
9d6c0d7c9f YARN-2843. Fixed NodeLabelsManager to trim inputs for hosts and labels so as to make them work correctly. Contributed by Wangda Tan. 
(cherry picked from commit 0fd97f9c1989a793b882e6678285607472a3f75a)
 2014-11-11 12:45:59 -08:00
Karthik Kambatla
f030959849 YARN-2735. diskUtilizationPercentageCutoff and diskUtilizationSpaceCutoff are initialized twice in DirectoryCollection. (Zhihai Xu via kasha) 
(cherry picked from commit 061bc293c8dd3e2605cf150568988bde18407af6)
 2014-11-11 10:31:56 -08:00
Xuan
b390579c15 YARN-2841: Correct fix version from branch-2.6 to branch-2.7 in the 
change log.

(cherry picked from commit 58e9bf4b908e0b21309006eba49899b092f38071)
 2014-11-10 18:35:59 -08:00
Xuan
b3badf935a YARN-2841. RMProxy should retry EOFException. Contributed by Jian He 
(cherry picked from commit 5c9a51f140ba76ddb25580aeb288db25e3f9653f)
 2014-11-10 18:26:32 -08:00
Karthik Kambatla
92de44c2c5 Set the release date for 2.5.2 
(cherry picked from commit 68a050872896f93582f95420dd6e2bdefa4fd7cc)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-11-10 15:23:43 -08:00
Arun C. Murthy
adfb830a2b Preparing to release hadoop-2.6.0: Set version in branch-2 to 2.7.0-SNAPSHOT. 2014-11-09 19:19:02 -08:00
Karthik Kambatla
569b7dae6c Fix broken download of directories 
(cherry picked from commit 745c9a01243b8eefc72d89d1164d7d010b80983b)
 2014-11-09 19:03:31 -08:00
Vinod Kumar Vavilapalli
d76fc94b21 YARN-2834. Fixed ResourceManager to ignore token-renewal failures on recovery consistent with the (somewhat incorrect) behaviour in the non-recovery case. Contributed by Jian He. 
(cherry picked from commit e76faebc9589654e83c8244ef9aff88391e56b80)
 2014-11-09 18:57:48 -08:00
Arun C. Murthy
cff08dab5e Updated CHANGES.txt to reflect hadoop-2.6.0 release dates. 
(cherry picked from commit 770cc144425b6188d9b93178c77a35cd830a60df)
 2014-11-09 18:48:01 -08:00
Arun C. Murthy
175d222bfc YARN-2830. Add backwords compatible ContainerId.newInstance constructor. Contributed by Jonathan Eagles. 
(cherry picked from commit 43cd07b408c6613d2c9aa89203cfa3110d830538)
 2014-11-09 15:03:59 -08:00
Vinod Kumar Vavilapalli
0a5d95f705 YARN-2607. Fixed issues in TestDistributedShell. Contributed by Wangda Tan. 
(cherry picked from commit 737d9284c109dac20ff423f30c62f6abe2db10f7)
 2014-11-08 11:02:17 -08:00
Zhijie Shen
1880a5a7c3 YARN-2505. Supported get/add/remove/change labels in RM REST API. Contributed by Craig Welch. 
(cherry picked from commit 9a4e0d343e9e891c10ef6682e7b2231a59e69ade)
 2014-11-07 20:39:53 -08:00
Vinod Kumar Vavilapalli
b865a95f06 YARN-2826. Fixed user-groups mappings' refresh bug caused by YARN-2826. Contributed by Wangda Tan. 
(cherry picked from commit df36edf751202db00d8f43103d7120ec56d70a04)
 2014-11-07 19:44:52 -08:00
Xuan
7d26cffb0c YARN-2819. NPE in ATS Timeline Domains when upgrading from 2.4 to 2.6. Contributed by Zhijie Shen 
(cherry picked from commit 4a114dd67aae83e5bb2d65470166de954acf36a2)
 2014-11-07 16:12:45 -08:00
Jason Lowe
9447235527 YARN-2632. Document NM Restart feature. Contributed by Junping Du and Vinod Kumar Vavilapalli 
(cherry picked from commit 1e215e8ba2e801eb26f16c307daee756d6b2ca66)
 2014-11-07 23:41:29 +00:00
Jason Lowe
a5764cb783 YARN-2825. Container leak on NM. Contributed by Jian He 
(cherry picked from commit c3d475070a1ec54c4b05923f4782cef204effd2c)
 2014-11-07 23:17:34 +00:00
Vinod Kumar Vavilapalli
a50345f654 YARN-2753. Fixed a bunch of bugs in the NodeLabelsManager classes. Contributed by Zhihai xu. 
(cherry picked from commit 4cfd5bc7c18bb9a828f573b5c4d2b13fa28e732a)
 2014-11-07 14:16:54 -08:00
cnauroth
c16f718293 YARN-2803. MR distributed cache not working correctly on Windows after NodeManager privileged account changes. Contributed by Craig Welch. 
(cherry picked from commit 06b797947c980d7d21864eb8b700cf565756aac1)
 2014-11-07 12:36:42 -08:00
Vinod Kumar Vavilapalli
7b19079657 YARN-2827. Fixed bugs in "yarn queue" CLI. Contributed by Wangda Tan. 2014-11-07 12:00:49 -08:00