Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,745 Commits 326 Branches 371 Tags
Commit Graph

2255 Commits

Author SHA1 Message Date
Jian He
b8955d81c5 YARN-1643. Make ContainersMonitor support changing monitoring size of an allocated container. Contributed by Meng Ding and Wangda Tan 
(cherry picked from commit c59ae4eeb17e52e8fc659b9962d20628719fc621)
 2015-09-24 10:23:55 -07:00
Jian He
fa0a554ae0 YARN-3867. ContainerImpl changes to support container resizing. Contributed by Meng Ding 
(cherry picked from commit 5f5a968d65c44a831176764439e00db9203999ed)
 2015-09-24 10:23:46 -07:00
Jian He
afe4afd0c9 YARN-1645. ContainerManager implementation to support container resizing. Contributed by Meng Ding & Wangda Tan 
(cherry picked from commit ffd820c27a4f8cf4676ad8758696ed89fde80218)
 2015-09-24 10:23:35 -07:00
Jian He
c19e8ffdc7 YARN-1449. AM-NM protocol changes to support container resizing. Contributed by Meng Ding & Wangda Tan) 
(cherry picked from commit 83a18add10ee937a04e833a66e0a4642e776e510)
 2015-09-24 10:23:25 -07:00
Jian He
89dc37450c YARN-3866. AM-RM protocol changes to support container resizing. Contributed by Meng Ding 
(cherry picked from commit dfe2cb849fcb273d32e840d8562eaaee904af054)
 2015-09-24 10:23:13 -07:00
Rohith Sharma K S
fbb1d923f4 YARN-4044. Running applications information changes such as movequeue is not published to TimeLine server. (Sunil G via rohithsharmaks) 2015-09-24 12:17:55 +05:30
Rohith Sharma K S
ace4d26936 YARN-4152. NodeManager crash with NPE when LogAggregationService#stopContainer called for absent container. (Bibin A Chundatt via rohithsharmaks) 2015-09-24 11:31:47 +05:30
Jason Lowe
b7111449a1 YARN-3975. WebAppProxyServlet should not redirect to RM page if AHS is enabled. Contributed by Mit Desai 
(cherry picked from commit 692d51c09d3668cde47cc297296d095ddfa933a3)
 2015-09-23 16:39:50 +00:00
Jason Lowe
c829be5133 YARN-4095. Avoid sharing AllocatorPerContext object in LocalDirAllocator between ShuffleHandler and LocalDirsHandlerService. Contributed by Zhihai Xu 
(cherry picked from commit c890c51a916894a985439497b8a44e8eee82d762)
 2015-09-23 15:44:13 +00:00
Tsuyoshi Ozawa
52cc2ca488 HADOOP-12428. Fix inconsistency between log-level guards and statements. Contributed by Jagadesh Kiran N and Jackie Chang. 
(cherry picked from commit dfd807afab0fae3839c9cc5d552aa0304444f956)
 2015-09-22 12:54:44 +09:00
Chris Douglas
b39b61e356 YARN-4188. Make MoveApplicationAcrossQueues abstract, newInstance static 
Contributed by Giovanni Matteo Fumarola
(cherry picked from commit 8e01b0d97ac3d74b049a801dfa1cc6e77d8f680a)
 2015-09-21 17:54:24 -07:00
Wangda Tan
fafcb4ac4e YARN-4113. RM should respect retry-interval when uses RetryPolicies.RETRY_FOREVER. (Sunil G via wangda) 
(cherry picked from commit b00392dd9cbb6778f2f3e669e96cf7133590dfe7)
 2015-09-21 11:15:02 -07:00
Rohith Sharma K S
52f343598e YARN-4167. NPE on RMActiveServices#serviceStop when store is null. (Bibin A Chundatt via rohithsharmaks) 
(cherry picked from commit c9cb6a5960ad335a3ee93a6ee219eae5aad372f9)
 2015-09-21 10:06:39 +05:30
Arun Suresh
b70c7b0e51 YARN-3920. FairScheduler container reservation on a node should be configurable to limit it to large containers (adhoot via asuresh) 
(cherry picked from commit 94dec5a9164cd9bc573fbf74e76bcff9e7c5c637)
 2015-09-18 14:04:03 -07:00
Wangda Tan
4a657e9326 YARN-3212. RMNode State Transition Update with DECOMMISSIONING state. (Junping Du via wangda) 
(cherry picked from commit 9bc913a35c46e65d373c3ae3f01a377e16e8d0ca)
 2015-09-18 10:05:04 -07:00
Steve Loughran
22dee29857 YARN-2597 MiniYARNCluster should propagate reason for AHS not starting 2015-09-18 09:45:17 +01:00
Rohith Sharma K S
d94c092ad1 YARN-4135. Improve the assertion message in MockRM while failing after waiting for the state.(Nijel S F via rohithsharmaks) 
(cherry picked from commit 723c31d45bc0f64b1d1a67350b108059d2a220a3)
 2015-09-18 08:46:36 +05:30
Jian He
5d2f85021f YARN-4034. Render cluster Max Priority in scheduler metrics in RM web UI. Contributed by Rohith Sharma K S 
(cherry picked from commit 6c6e734f0baaa7b0f8d6b85963e1ce87bac28b17)
 2015-09-17 14:56:32 +08:00
Steve Loughran
ab09573fcb YARN-3433. Jersey tests failing with Port in Use -again. (Brahma Reddy Battula) 2015-09-16 10:30:49 +01:00
Jian He
9eda3ce3fa YARN-4078. Add getPendingResourceRequestForAttempt in YarnScheduler interface. Contributed by Naganarasimha G R 
(cherry picked from commit 452079af8bc56195945e28b8cf76620f0aca01c3)
 2015-09-16 15:01:23 +08:00
Xuan
f3c0a210b6 YARN-4149. yarn logs -am should provide an option to fetch all the log 
files. Contributed by Varun Vasudev

(cherry picked from commit 34ef1a092bcab369bb845481efffb8c47adef53a)
 2015-09-15 14:37:59 -07:00
Jason Lowe
181bda0421 YARN-4158. Remove duplicate close for LogWriter in AppLogAggregatorImpl#uploadLogsForContainers. Contributed by Zhihai Xu 
(cherry picked from commit 8c1cdb17a03fec91bfab172fe92b67bdeb9ebfba)
 2015-09-15 20:22:23 +00:00
Wangda Tan
c31fe79979 YARN-3717. Expose app/am/queue's node-label-expression to RM web UI / CLI / REST-API. (Naganarasimha G R via wangda) 
(cherry picked from commit ae5308fe1d08479da0f3929cc6a57816411e9121)
 2015-09-15 11:41:57 -07:00
Junping Du
df714e25aa YARN-313. Add Admin API for supporting node resource configuration in command line. (Contributed by Inigo Goiri, Kenji Kikushima and Junping Du) 
(cherry picked from commit 73e3a49eb0d58f08549dc6b7054eb5c1f62819dc)
 2015-09-15 07:58:47 -07:00
Jian He
eacc18677a YARN-3635. Refactored current queue mapping implementation in CapacityScheduler to use a generic PlacementManager framework. Contributed by Wangda Tan 
(cherry picked from commit 5468baa80aa2a3e2a02e9a902deebafd734daf23)
 2015-09-15 19:02:17 +08:00
Wangda Tan
e552775545 YARN-4151. Fix findbugs errors in hadoop-yarn-server-common module. (Meng Ding via wangda) 
(cherry picked from commit e2a02702178db60150cc0c2253d48b8532a474c2)
 2015-09-14 16:04:08 -07:00
Jian He
b705d9d0ac YARN-4126. RM should not issue delegation tokens in unsecure mode. Contributed by Bibin A Chundatt 
(cherry picked from commit e1b1d7e4aebfed0dec4d7df21561ab37f73ef1d7)
 2015-09-14 14:15:04 +08:00
Karthik Kambatla
1f9f219062 YARN-3697. FairScheduler: ContinuousSchedulingThread can fail to shutdown. (Zhihai Xu via kasha) 
(cherry picked from commit 332b520a480994b7bd56c135f7941aad30b05e9c)
 2015-09-13 18:08:03 -07:00
Karthik Kambatla
11e2fa151c YARN-2005. Blacklisting support for scheduling AMs. (Anubhav Dhoot via kasha) 
(cherry picked from commit 81df7b586a16f8226c7b01c139c1c70c060399c3)
 2015-09-13 17:06:04 -07:00
Steve Loughran
988749e6ea HADOOP-12087. [JDK8] Fix javadoc errors caused by incorrect or illegal tags. (Akira AJISAKA via stevel). 2015-09-13 14:25:06 +01:00
Robert Kanter
43f051a09a YARN-4145. Make RMHATestBase abstract so its not run when running all tests under that namespace (adhoot via rkanter) 
(cherry picked from commit ea4bb2749f966a5eaf712d1dbb2c845df0f5ca67)
 2015-09-11 11:46:35 -07:00
Robert Kanter
d07eef8c87 YARN-4115. Reduce loglevel of ContainerManagementProtocolProxy to Debug (adhoot via rkanter) 
(cherry picked from commit b84fb41bb6ca2d69153cf5bd61f88492538ee713)
 2015-09-11 11:46:35 -07:00
Varun Vasudev
a4288f1262 YARN-4136. LinuxContainerExecutor loses info when forwarding ResourceHandlerException. Contributed by Bibin A Chundatt. 
(cherry picked from commit 486d5cb803efec7b4db445ee65a3df83392940a3)
 2015-09-11 14:39:01 +05:30
Wangda Tan
5decd8f9f7 YARN-4106. NodeLabels for NM in distributed mode is not updated even after clusterNodelabel addition in RM. (Bibin A Chundatt via wangda) 
(cherry picked from commit 77666105b4557d5706e5844a4ca286917d966c5f)
 2015-09-10 09:30:34 -07:00
Robert Kanter
ea64a9b277 YARN-4086. Allow Aggregated Log readers to handle HAR files (rkanter) 
(cherry picked from commit 6dd6ca442aba8612c3780399a42bb473e4483021)
 2015-09-09 18:03:47 -07:00
Zhihai Xu
214338bd68 YARN-4096. App local logs are leaked if log aggregation fails to initialize for the app. Contributed by Jason Lowe. 
(cherry picked from commit 16b9037dc1300b8bdbe54ba7cd47c53fe16e93d8)
 2015-09-08 12:33:29 -07:00
Varun Vasudev
1c53cd2b0d YARN-4121. Fix typos in capacity scheduler documentation. Contributed by Kai Sasaki. 
(cherry picked from commit 435f935ba7d8abb1a35796b72d1de906ded80592)
 2015-09-08 12:39:39 +05:30
Jian He
f23be93dd1 YARN-2884. Added a proxy service in NM to proxy the the communication between AM and RM. Contributed by Kishore Chaliparambil 
(cherry picked from commit 6f72f1e6003ab11679bebeb96f27f1f62b3b3e02)
 2015-09-08 11:24:07 +08:00
Xuan
a0b7ef15d0 YARN-4087. Followup fixes after YARN-2019 regarding RM behavior when 
state-store error occurs. Contributed by Jian He

(cherry picked from commit 9b78e6e33d8c117c1e909df414f20d9db56efe4b)
 2015-09-07 17:46:48 -07:00
Varun Vasudev
70575286b7 YARN-3591. Resource localization on a bad disk causes subsequent containers failure. Contributed by Lavkesh Lahngir. 
(cherry picked from commit 1dbd8e34a7d97c4d8586da79c980d8f2e0aad61d)
 2015-09-07 11:34:14 +05:30
Wangda Tan
9f97b86816 YARN-4024. YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat. (Hong Zhiguo via wangda) 
(cherry picked from commit bcc85e3bab78bcacd430eac23141774465b96ef9)
 2015-09-04 15:14:34 -07:00
Jason Lowe
6a5220cab3 YARN-4105. Capacity Scheduler headroom for DRF is wrong. Contributed by Chang Li 
(cherry picked from commit 6eaca2e3634a88dc55689e8960352d6248c424d9)
 2015-09-04 15:31:37 +00:00
Varun Vasudev
64c2e8011e YARN-4103. RM WebServices missing scheme for appattempts logLinks. Contributed by Jonathan Eagles. 
(cherry picked from commit 1b2e2ca9104dfc05e9aa7f93954ae2e00b3e62c4)
 2015-09-04 14:32:07 +05:30
Varun Vasudev
a53054c853 YARN-3970. Add REST api support for Application Priority. Contributed by Naganarasimha G R. 
(cherry picked from commit 223a306da925ad031bc398f2ea5e56f0e6521edf)
 2015-09-03 16:40:42 +05:30
Jian He
cd82fa2f83 YARN-4101. RM should print alert messages if Zookeeper and Resourcemanager gets connection issue. Contributed by Xuan Gong 
(cherry picked from commit 09c64ba1ba8be7a2ac31f4e42efb8c99b682399f)
 2015-09-02 17:46:04 -07:00
Rohith Sharma K S
6e41aa64a5 YARN-3893. Both RM in active state when Admin#transitionToActive failure from refeshAll() (Bibin A Chundatt via rohithsharmaks) 
(cherry picked from commit 7d6687fe76f6152a577ff2298c358dd30fce41fb)
 2015-09-02 15:27:33 +05:30
Rohith Sharma K S
7ecdf51441 YARN-4073. Removed unused ApplicationACLsManager in ContainerManagerImpl constructor. (Naganarasimha G R via rohithsharmaks) 
(cherry picked from commit 095ab9ab5fa5f415fba41fee81b6008cf0455af8)
 2015-09-02 14:28:50 +05:30
Andrew Wang
7d833a3058 HADOOP-12369. Point hadoop-project/pom.xml java.security.krb5.conf within target folder. 
(cherry picked from commit 0eb9b1932590ba6c60ac996d03269dffb4e095cc)
 2015-09-01 10:59:39 -07:00
Tsuyoshi Ozawa
d3d65f62b3 YARN-2801. Add documentation for node labels feature. Contributed by Wangda Tan and Naganarasimha G R. 
(cherry picked from commit faa38e1aa49907254bf981662a8aeb5dc52e75e3)
 2015-09-01 17:55:53 +09:00
Varun Vasudev
855e0f8b00 YARN-4082. Container shouldn't be killed when node's label updated. Contributed by Wangda Tan. 
(cherry picked from commit bf669b6d9f8ba165e30b8823218d625a49958925)
 2015-09-01 14:20:54 +05:30