Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,065 Commits 326 Branches 371 Tags
Commit Graph

1903 Commits

Author SHA1 Message Date
Karthik Kambatla
c981b040ba YARN-1393. SLS: Add how-to-use instructions. (Wei Yan via kasha) 
(cherry picked from commit c559df2219f4049f2412fba8ad031c434d9e82b6)
 2015-02-03 13:20:57 -08:00
Wangda Tan
205e15c4a3 YARN-3075. NodeLabelsManager implementation to retrieve label to node mapping (Varun Saxena via wangda) 
(cherry picked from commit 5bd984691b3e3df5d8aac910295138996e7a5839)
 2015-02-03 12:55:25 -08:00
Jian He
c0b1311a93 YARN-3098. Created common QueueCapacities class in Capacity Scheduler to track capacities-by-labels of queues. Contributed by Wangda Tan 
(cherry picked from commit 21d80b3dd90a8e33e51701887c8d9369ed4ab17d)
 2015-02-03 11:43:40 -08:00
Robert Kanter
410830fe8c YARN-3022. Expose Container resource information from NodeManager for monitoring (adhoot via ranter) 
(cherry picked from commit f7a77819a1e4ff394e110941c1f8dd80f47dd38f)
 2015-02-03 10:39:51 -08:00
Jason Lowe
3828fb5fab YARN-3085. Application summary should include the application type. Contributed by Rohith 
(cherry picked from commit a761bf8726cb6285a505f1773ea3403eb985a65f)
 2015-02-03 14:57:25 +00:00
Zhijie Shen
ebaf6220fe YARN-2216. Fixed the change log. 
(cherry picked from commit 5f9a0dd8d959e6c03f611c6f073b27a8d73ad418)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2015-02-02 12:16:07 -08:00
Zhijie Shen
b51c0288de YARN-2808. Made YARN CLI list attempt’s finished containers of a running application. Contributed by Naganarasimha G R. 
(cherry picked from commit c0ec4f4cc12208342d45236b8841887a20f7f88a)
 2015-02-02 12:05:05 -08:00
Kihwal Lee
05d831c4b7 YARN-3113. Release audit warning for Sorting icons.psd. Contributed by Steve Loughran. 
(cherry picked from commit f33c99ba3900f21901b479ad6e85f5cd95a9c657)
 2015-02-02 12:59:45 -06:00
Jian He
4941b8f30d YARN-3077. Fixed RM to create zk root path recursively. Contributed by Chun Chen 
(cherry picked from commit 054a947989d6ccbe54a803ca96dcebeba8328367)
 2015-01-30 17:35:26 -08:00
Jian He
cabf97ae4f YARN-3099. Capacity Scheduler LeafQueue/ParentQueue should use ResourceUsage to track used-resources-by-label. Contributed by Wangda Tan 
(cherry picked from commit 86358221fc85a7743052a0b4c1647353508bf308)
 2015-01-30 15:16:22 -08:00
Jonathan Eagles
d4ffca41d7 YARN-3108. ApplicationHistoryServer doesn't process -D arguments (Chang Li via jeagles) 
(cherry picked from commit 30a8778c632c0f57cdd005080a470065a60756a8)
 2015-01-29 16:52:37 -06:00
Tsuyoshi Ozawa
6efffc9cd8 YARN-3029. FSDownload.unpack() uses local locale for FS case conversion, may not work everywhere. Contributed by Varun Saxena. 
(cherry picked from commit 7acce7d3648d6f1e45ce280e2147e7dedf5693fc)
 2015-01-30 04:42:25 +09:00
Akira Ajisaka
1081b4c4a7 HADOOP-9907. Webapp http://hostname:port/metrics link is not working. (aajisaka) 
(cherry picked from commit 342efa110af9989829b8a8caa699658a2ba01607)
 2015-01-30 02:50:46 +09:00
Wangda Tan
58d7d1efc6 YARN-3079. Scheduler should also update maximumAllocation when updateNodeResource. (Zhihai Xu via wangda) 
(cherry picked from commit 7882bc0f1433ae73361cab4207eb0c15abee4586)
 2015-01-28 21:56:17 -08:00
Jian He
12522fd9cb YARN-3103. AMRMClientImpl does not update AMRM token properly. Contributed by Jason Lowe 
(cherry picked from commit 6d2bdbd7dab179dfb4f19bb41809e97f1db88c6b)
 2015-01-28 15:24:10 -08:00
Wangda Tan
4718af4352 YARN-2932. Add entry for preemptable status (enabled/disabled) to scheduler web UI and queue initialize/refresh logging. (Eric Payne via wangda) 
(cherry picked from commit 18741adf97f4fda5f8743318b59c440928e51297)
 2015-01-27 15:37:02 -08:00
Wangda Tan
12060cb9a6 YARN-3028. Better syntax for replaceLabelsOnNode in RMAdmin CLI. Contributed by Rohith Sharmaks 
(cherry picked from commit fd93e5387b554a78413bc0f14b729e58fea604ea)
 2015-01-27 15:25:47 -08:00
Jonathan Eagles
c95e8951f8 YARN-2897. CrossOriginFilter needs more log statements (Mit Desai via jeagles) 
(cherry picked from commit a8ad1e8089e4bf5854085d2d38d1c0133b5a41bc)
 2015-01-27 16:07:27 -06:00
Jian He
8100c8a68c YARN-3011. Possible IllegalArgumentException in ResourceLocalizationService might lead NM to crash. Contributed by Varun Saxena 
(cherry picked from commit 4e15fc08411318e11152fcd5a4648ed1d6fbb480)
 2015-01-27 13:31:48 -08:00
Tsuyoshi Ozawa
04ad500fac YARN-3086. Make NodeManager memory configurable in MiniYARNCluster. Contributed by Robert Metzger. 
(cherry picked from commit f56da3ce040b16582ce8153df0d7cea00becd843)
 2015-01-28 00:16:07 +09:00
Jian He
61b4116b4b YARN-3092. Created a common ResourceUsage class to track labeled resource usages in Capacity Scheduler. Contributed by Wangda Tan 
(cherry picked from commit 6f9fe76918bbc79109653edc6cde85df05148ba3)
 2015-01-26 15:38:27 -08:00
Jason Lowe
07fe6a36cb YARN-3088. LinuxContainerExecutor.deleteAsUser can throw NPE if native executor returns an error. Contributed by Eric Payne 
(cherry picked from commit 902c6ea7e4d3b49e49d9ce51ae9d12694ecfcf89)
 2015-01-26 15:41:23 +00:00
Xuan
a7696b3fbf YARN-3024. LocalizerRunner should give DIE action when all resources are 
localized. Contributed by Chengbing Liu

(cherry picked from commit 0d6bd62102f94c55d59f7a0a86a684e99d746127)
 2015-01-25 19:39:52 -08:00
Tsuyoshi Ozawa
25f2cf8a4e YARN-2800. Remove MemoryNodeLabelsStore and add a way to enable/disable node labels feature. Contributed by Wangda Tan. 
(cherry picked from commit 24aa462673d392fed859f8088acf9679ae62a129)
 2015-01-23 20:37:26 +09:00
Tsuyoshi Ozawa
ff627d94e7 YARN-3082. Non thread safe access to systemCredentials in NodeHeartbeatResponse processing. Contributed by Anubhav Dhoot. 
(cherry picked from commit 3aab354e664a3ce09e0d638bf0c1e7d273d40579)
 2015-01-23 16:05:05 +09:00
Tsuyoshi Ozawa
316eedb55f YARN-3078. LogCLIHelpers lacks of a blank space before string 'does not exist'. Contributed by Sam Liu. 
(cherry picked from commit 5712c9f96a2cf4ff63d36906ab3876444c0cddec)
 2015-01-22 12:25:29 +09:00
Wangda Tan
610aa71a10 YARN-2731. Fixed RegisterApplicationMasterResponsePBImpl to properly invoke maybeInitBuilder. (Contributed by Carlo Curino) 
(cherry picked from commit f250ad1773b19713d6aea81ae290ebb4c90fd44b)
 2015-01-20 14:49:06 -08:00
Wangda Tan
ef6fc24dfb YARN-2933. Capacity Scheduler preemption policy should only consider capacity without labels temporarily. Contributed by Mayank Bansal 
(cherry picked from commit 0a2d3e717d9c42090a32ff177991a222a1e34132)
 2015-01-19 16:57:17 -08:00
cnauroth
2c4abe9208 YARN-3015. yarn classpath command should support same options as hadoop classpath. Contributed by Varun Saxena. 2015-01-19 15:54:41 -08:00
Akira Ajisaka
401c7d72f5 YARN-3071. Remove invalid char from sample conf in doc of FairScheduler. (Contributed by Masatake Iwasaki) 
(cherry picked from commit 4a5c3a4cfee6b8008a722801821e64850582a985)
 2015-01-19 21:22:48 +09:00
Junping Du
ef4d7b73b9 YARN-3070. TestRMAdminCLI#testHelp fails for transitionToActive command. (Contributed by Junping Du) 
(cherry picked from commit 19cbce3898aeee7dd3b46e2c2ffeae25ff6ba88f)
 2015-01-18 23:09:24 -08:00
Karthik Kambatla
4d8fa9615f YARN-2984. Metrics for container's actual memory usage. (kasha) 
(cherry picked from commit 84198564ba6028d51c1fcf9cdcb87f6ae6e08513)
 2015-01-17 06:26:47 +05:30
Zhijie Shen
dcd6eed13a YARN-2815. Excluded transitive dependency of JLine in hadoop-yarn-server-common. Contributed by Ferdinand Xu. 
(cherry picked from commit 43302f6f44f97d67069eefdda986b6da2933393e)
 2015-01-16 16:38:36 -08:00
Junping Du
7cddec31d7 YARN-3064. TestRMRestart/TestContainerResourceUsage/TestNodeManagerResync failure with allocation timeout. (Contributed by Jian He) 
(cherry picked from commit 5d1cca34fa14706586f8bbe7f2a2264757fdcc11)
 2015-01-16 00:10:36 -08:00
Jian He
ed5a0d0aa8 YARN-2861. Fixed Timeline DT secret manager to not reuse RM's configs. Contributed by Zhijie Shen 
(cherry picked from commit 9e33116d1d8944a393937337b3963e192b9c74d1)
 2015-01-15 11:08:19 -08:00
Akira Ajisaka
b349cd9d0b YARN-3005. [JDK7] Use switch statement for String instead of if-else statement in RegistrySecurity.java (Contributed by Kengo Seki) 
(cherry picked from commit 533e551eb42af188535aeb0ab35f8ebf150a0da1)
 2015-01-15 21:30:26 +09:00
Karthik Kambatla
d98b8f4bd3 YARN-2217. [YARN-1492] Shared cache client side changes. (Chris Trezzo via kasha) 
(cherry picked from commit ba5116ec8e0c075096c6f84a8c8a1c6ce8297cf2)
 2015-01-15 14:32:35 +05:30
Xuan
79c8f4dcba YARN-2807. Option "--forceactive" not works as described in usage of 
"yarn rmadmin -transitionToActive". Contributed by Masatake Iwasaki

(cherry picked from commit d15cbae73c7ae22d5d60d8cba16cba565e8e8b20)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/YarnCommands.apt.vm
 2015-01-14 11:18:10 -08:00
Junping Du
0119e717ae YARN-3019. Make work-preserving-recovery the default mechanism for RM recovery. (Contributed by Jian He) 
(cherry picked from commit f92e5038000a012229c304bc6e5281411eff2883)
 2015-01-13 18:23:32 -08:00
Jian He
4931600030 YARN-2637. Fixed max-am-resource-percent calculation in CapacityScheduler when activating applications. Contributed by Craig Welch 
(cherry picked from commit c53420f58364b11fbda1dace7679d45534533382)
 2015-01-13 17:32:36 -08:00
Robert Kanter
13cdcf28e0 YARN-2643. Don't create a new DominantResourceCalculator on every FairScheduler.allocate call. (kasha via rkanter) 
(cherry picked from commit 51881535e659940b1b332d0c5952ee1f9958cc7f)
 2015-01-12 17:51:45 -08:00
Robert Kanter
7c4e5ff660 YARN-2957. Create unit test to automatically compare YarnConfiguration and yarn-default.xml. (rchiang via rkanter) 
(cherry picked from commit f45163191583eadcfbe0df233a3185fd1b2b78f3)
 2015-01-12 12:00:52 -08:00
Robert Kanter
e5059b91bb YARN-3027. Scheduler should use totalAvailable resource from node instead of availableResource for maxAllocation. (adhoot via rkanter) 
(cherry picked from commit ae7bf31fe1c63f323ba5271e50fd0e4425a7510f)
 2015-01-12 10:48:45 -08:00
Jian He
36b3dcaab2 YARN-3014. Replaces labels on a host should update all NM's labels on that host. Contributed by Wangda Tan 
(cherry picked from commit a2604062681230442eefae79815db5d77ccc4c2e)
 2015-01-09 17:50:18 -08:00
Jian He
68709cb9be YARN-2956. Added missing links in YARN documentation. Contributed by Masatake Iwasaki 
(cherry picked from commit 27a489cba63d9473e4cbcaef018b66108fb6c122)
 2015-01-09 17:47:00 -08:00
cnauroth
9a7c763b3f HADOOP-11464. Reinstate support for launching Hadoop processes on Windows using Cygwin. Contributed by Chris Nauroth. 2015-01-09 15:01:33 -08:00
Jian He
e7e6173049 YARN-2997. Fixed NodeStatusUpdater to not send alreay-sent completed container statuses on heartbeat. Contributed by Chengbing Liu 
(cherry picked from commit cc2a745f7e82c9fa6de03242952347c54c52dccc)
 2015-01-08 11:28:24 -08:00
Zhijie Shen
d2fbba790a YARN-2996. Improved synchronization and I/O operations of FS- and Mem- RMStateStore. Contributed by Yi Liu. 
(cherry picked from commit dc2eaa26b20cfbbcdd5784bb8761d08a42f29605)
 2015-01-08 09:49:27 -08:00
Jian He
9eb7611e81 Moved YARN-2880 to improvement section in CHANGES.txt 
(cherry picked from commit ef237bd52fc570292a7e608b373b51dd6d1590b8)
 2015-01-07 16:21:12 -08:00
Jian He
fe664b8b8d YARN-2936. Changed YARNDelegationTokenIdentifier to set proto fields on getProto method. Contributed by Varun Saxena 
(cherry picked from commit 2638f4d0f0da375b0dd08f3188057637ed0f32d5)
 2015-01-07 16:15:03 -08:00