Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,380 Commits 326 Branches 371 Tags
Commit Graph

1112 Commits

Author SHA1 Message Date
Rohith Sharma K S
fbb1d923f4 YARN-4044. Running applications information changes such as movequeue is not published to TimeLine server. (Sunil G via rohithsharmaks) 2015-09-24 12:17:55 +05:30
Tsuyoshi Ozawa
52cc2ca488 HADOOP-12428. Fix inconsistency between log-level guards and statements. Contributed by Jagadesh Kiran N and Jackie Chang. 
(cherry picked from commit dfd807afab0fae3839c9cc5d552aa0304444f956)
 2015-09-22 12:54:44 +09:00
Rohith Sharma K S
52f343598e YARN-4167. NPE on RMActiveServices#serviceStop when store is null. (Bibin A Chundatt via rohithsharmaks) 
(cherry picked from commit c9cb6a5960ad335a3ee93a6ee219eae5aad372f9)
 2015-09-21 10:06:39 +05:30
Arun Suresh
b70c7b0e51 YARN-3920. FairScheduler container reservation on a node should be configurable to limit it to large containers (adhoot via asuresh) 
(cherry picked from commit 94dec5a9164cd9bc573fbf74e76bcff9e7c5c637)
 2015-09-18 14:04:03 -07:00
Wangda Tan
4a657e9326 YARN-3212. RMNode State Transition Update with DECOMMISSIONING state. (Junping Du via wangda) 
(cherry picked from commit 9bc913a35c46e65d373c3ae3f01a377e16e8d0ca)
 2015-09-18 10:05:04 -07:00
Rohith Sharma K S
d94c092ad1 YARN-4135. Improve the assertion message in MockRM while failing after waiting for the state.(Nijel S F via rohithsharmaks) 
(cherry picked from commit 723c31d45bc0f64b1d1a67350b108059d2a220a3)
 2015-09-18 08:46:36 +05:30
Jian He
5d2f85021f YARN-4034. Render cluster Max Priority in scheduler metrics in RM web UI. Contributed by Rohith Sharma K S 
(cherry picked from commit 6c6e734f0baaa7b0f8d6b85963e1ce87bac28b17)
 2015-09-17 14:56:32 +08:00
Jian He
9eda3ce3fa YARN-4078. Add getPendingResourceRequestForAttempt in YarnScheduler interface. Contributed by Naganarasimha G R 
(cherry picked from commit 452079af8bc56195945e28b8cf76620f0aca01c3)
 2015-09-16 15:01:23 +08:00
Wangda Tan
c31fe79979 YARN-3717. Expose app/am/queue's node-label-expression to RM web UI / CLI / REST-API. (Naganarasimha G R via wangda) 
(cherry picked from commit ae5308fe1d08479da0f3929cc6a57816411e9121)
 2015-09-15 11:41:57 -07:00
Junping Du
df714e25aa YARN-313. Add Admin API for supporting node resource configuration in command line. (Contributed by Inigo Goiri, Kenji Kikushima and Junping Du) 
(cherry picked from commit 73e3a49eb0d58f08549dc6b7054eb5c1f62819dc)
 2015-09-15 07:58:47 -07:00
Jian He
eacc18677a YARN-3635. Refactored current queue mapping implementation in CapacityScheduler to use a generic PlacementManager framework. Contributed by Wangda Tan 
(cherry picked from commit 5468baa80aa2a3e2a02e9a902deebafd734daf23)
 2015-09-15 19:02:17 +08:00
Jian He
b705d9d0ac YARN-4126. RM should not issue delegation tokens in unsecure mode. Contributed by Bibin A Chundatt 
(cherry picked from commit e1b1d7e4aebfed0dec4d7df21561ab37f73ef1d7)
 2015-09-14 14:15:04 +08:00
Karthik Kambatla
1f9f219062 YARN-3697. FairScheduler: ContinuousSchedulingThread can fail to shutdown. (Zhihai Xu via kasha) 
(cherry picked from commit 332b520a480994b7bd56c135f7941aad30b05e9c)
 2015-09-13 18:08:03 -07:00
Karthik Kambatla
11e2fa151c YARN-2005. Blacklisting support for scheduling AMs. (Anubhav Dhoot via kasha) 
(cherry picked from commit 81df7b586a16f8226c7b01c139c1c70c060399c3)
 2015-09-13 17:06:04 -07:00
Steve Loughran
988749e6ea HADOOP-12087. [JDK8] Fix javadoc errors caused by incorrect or illegal tags. (Akira AJISAKA via stevel). 2015-09-13 14:25:06 +01:00
Robert Kanter
43f051a09a YARN-4145. Make RMHATestBase abstract so its not run when running all tests under that namespace (adhoot via rkanter) 
(cherry picked from commit ea4bb2749f966a5eaf712d1dbb2c845df0f5ca67)
 2015-09-11 11:46:35 -07:00
Jian He
f23be93dd1 YARN-2884. Added a proxy service in NM to proxy the the communication between AM and RM. Contributed by Kishore Chaliparambil 
(cherry picked from commit 6f72f1e6003ab11679bebeb96f27f1f62b3b3e02)
 2015-09-08 11:24:07 +08:00
Xuan
a0b7ef15d0 YARN-4087. Followup fixes after YARN-2019 regarding RM behavior when 
state-store error occurs. Contributed by Jian He

(cherry picked from commit 9b78e6e33d8c117c1e909df414f20d9db56efe4b)
 2015-09-07 17:46:48 -07:00
Wangda Tan
9f97b86816 YARN-4024. YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat. (Hong Zhiguo via wangda) 
(cherry picked from commit bcc85e3bab78bcacd430eac23141774465b96ef9)
 2015-09-04 15:14:34 -07:00
Jason Lowe
6a5220cab3 YARN-4105. Capacity Scheduler headroom for DRF is wrong. Contributed by Chang Li 
(cherry picked from commit 6eaca2e3634a88dc55689e8960352d6248c424d9)
 2015-09-04 15:31:37 +00:00
Varun Vasudev
64c2e8011e YARN-4103. RM WebServices missing scheme for appattempts logLinks. Contributed by Jonathan Eagles. 
(cherry picked from commit 1b2e2ca9104dfc05e9aa7f93954ae2e00b3e62c4)
 2015-09-04 14:32:07 +05:30
Varun Vasudev
a53054c853 YARN-3970. Add REST api support for Application Priority. Contributed by Naganarasimha G R. 
(cherry picked from commit 223a306da925ad031bc398f2ea5e56f0e6521edf)
 2015-09-03 16:40:42 +05:30
Jian He
cd82fa2f83 YARN-4101. RM should print alert messages if Zookeeper and Resourcemanager gets connection issue. Contributed by Xuan Gong 
(cherry picked from commit 09c64ba1ba8be7a2ac31f4e42efb8c99b682399f)
 2015-09-02 17:46:04 -07:00
Rohith Sharma K S
6e41aa64a5 YARN-3893. Both RM in active state when Admin#transitionToActive failure from refeshAll() (Bibin A Chundatt via rohithsharmaks) 
(cherry picked from commit 7d6687fe76f6152a577ff2298c358dd30fce41fb)
 2015-09-02 15:27:33 +05:30
Varun Vasudev
855e0f8b00 YARN-4082. Container shouldn't be killed when node's label updated. Contributed by Wangda Tan. 
(cherry picked from commit bf669b6d9f8ba165e30b8823218d625a49958925)
 2015-09-01 14:20:54 +05:30
Jian He
48f5161cd5 YARN-4092. Fixed UI redirection to print useful messages when both RMs are in standby mode. Contributed by Xuan Gong 
(cherry picked from commit a3fd2ccc869dfc1f04d1cf0a8678d4d90a43a80f)
 2015-08-31 17:34:49 -07:00
Junping Du
792b9c0eaf YARN-1556. NPE getting application report with a null appId. Contributed by Weiwei Yang. 
(cherry picked from commit beb65c9465806114237aa271b07b31ff3c1f4404)
 2015-08-28 05:58:45 -07:00
Jian He
306c535395 YARN-3250. Support admin cli interface in for Application Priority. Contributed by Rohith Sharma K S 
(cherry picked from commit a9c8ea71aa427ff5f25caec98be15bc880e578a7)
 2015-08-27 13:27:34 -07:00
Jian He
387076894f YARN-4014. Support user cli interface in for Application Priority. Contributed by Rohith Sharma K S 
(cherry picked from commit 57c7ae1affb2e1821fbdc3f47738d7e6fd83c7c1)
 2015-08-24 20:37:18 -07:00
Rohith Sharma K S
6dc732f2f7 YARN-3896. RMNode transitioned from RUNNING to REBOOTED because its response id has not been reset synchronously. (Jun Gong via rohithsharmaks) 
(cherry picked from commit feaf0349949e831ce3f25814c1bbff52f17bfe8f)
 2015-08-24 11:30:46 +05:30
Xuan
205b98c059 YARN-221. NM should provide a way for AM to tell it not to aggregate 
logs. Contributed by Ming Ma

(cherry picked from commit 37e1c3d82a96d781e1c9982988b7de4aa5242d0c)
 2015-08-22 16:26:39 -07:00
Rohith Sharma K S
27ced8253b YARN-3986. getTransferredContainers in AbstractYarnScheduler should be present in YarnScheduler interface 
(cherry picked from commit 22de7c1dca1be63d523de833163ae51bfe638a79)
 2015-08-21 10:56:45 +05:30
Xuan
fc6b176e70 YARN-4028. AppBlock page key update and diagnostics value null on 
recovery. Contributed by Bibin A Chundatt

(cherry picked from commit 22dc5fc20942a8d98333ed5470b5fb8c1d257f1a)
 2015-08-18 22:54:01 -07:00
Zhihai Xu
8f2eb99d71 YARN-3857: Memory leak in ResourceManager with SIMPLE mode. Contributed by mujunchao. 
(cherry picked from commit 3a76a010b85176f2bcb85ed6f74c25dcb8acfe4d)
 2015-08-18 10:53:16 -07:00
Jian He
b2e869f2a8 YARN-3987. Send AM container completed msg to NM once AM finishes. Contributed by sandflee 
(cherry picked from commit 0a030546e24c55662a603bb63c9029ad0ccf43fc)
 2015-08-13 16:23:30 -07:00
Jian He
703fa1b141 YARN-4047. ClientRMService getApplications has high scheduler lock contention. Contributed by Jason Lowe 
(cherry picked from commit 7a445fcfabcf9c6aae219051f65d3f6cb8feb87c)
 2015-08-13 16:13:28 -07:00
Jian He
65d22b3686 YARN-4026. Refactored ContainerAllocator to accept a list of priorites rather than a single priority. Contributed by Wangda Tan 
(cherry picked from commit e5003be907acef87c2770e3f2914953f62017b0e)
 2015-08-12 15:09:46 -07:00
rohithsharmaks
c5b20e0db6 YARN-4023. Publish Application Priority to TimelineServer. (Sunil G via rohithsharmaks) 
(cherry picked from commit 1c12adb71f32f24ec525313ff8dfcd2b738fc8e2)
 2015-08-12 14:47:23 +05:30
Xuan
2ebdf5bfce YARN-3999. RM hangs on draing events. Contributed by Jian He 
(cherry picked from commit 3ae716fa696b87e849dae40225dc59fb5ed114cb)
 2015-08-11 18:26:00 -07:00
Jian He
df97e3265b YARN-3887. Support changing Application priority during runtime. Contributed by Sunil G 
(cherry picked from commit fa1d84ae2739a1e76f58b9c96d1378f9453cc0d2)
 2015-08-10 20:52:18 -07:00
Wangda Tan
380d401da5 YARN-3873. PendingApplications in LeafQueue should also use OrderingPolicy. (Sunil G via wangda) 
(cherry picked from commit cf9d3c925608e8bc650d43975382ed3014081057)
 2015-08-10 14:58:19 -07:00
Wangda Tan
cdb61b5fb2 YARN-3966. Fix excessive loggings in CapacityScheduler. (Jian He via wangda) 
(cherry picked from commit 4bc42d76e7fa53cb268cab0f9fe1fd8d8dbb17fd)
 2015-08-07 09:53:42 -07:00
Rohith Sharma K S
a0da1ec010 YARN-3948. Display Application Priority in RM Web UI.(Sunil G via rohithsharmaks) 
(cherry picked from commit b6265d39c5d0fda21dfe55273f193d8a6a20c6a8)
 2015-08-07 10:47:08 +05:30
Carlo Curino
8e23a7997f YARN-3974. Refactor the reservation system test cases to use parameterized base test. (subru via curino) 
(cherry picked from commit 8572a5a14b999a866fa64ce32ee20078ffefdb1e)
 2015-08-02 02:06:06 -07:00
Junping Du
7af531d2e3 YARN-4019. Add JvmPauseMonitor to ResourceManager and NodeManager. Contributed by Robert Kanter. 
(cherry picked from commit cfee02b3bdd1117370200c9d8ce216676cff8888)
 2015-08-06 06:50:40 -07:00
Arun Suresh
84ea7cd408 YARN-3961. Expose pending, running and reserved containers of a queue in REST api and yarn top (adhoot via asuresh) 
(cherry picked from commit 154c9d2e421390c808dea3b2826cdaae492ea337)
 2015-08-05 23:15:33 -07:00
rohithsharmaks
dc76c4b035 YARN-3992. TestApplicationPriority.testApplicationPriorityAllocation fails intermittently. (Contributed by Sunil G) 
(cherry picked from commit df9e7280db58baddd02d6e23d3685efb8d5f1b97)
 2015-08-06 10:49:37 +05:30
Jian He
1466772827 YARN-3983. Refactored CapacityScheduleri#FiCaSchedulerApp to easier extend container allocation logic. Contributed by Wangda Tan 
(cherry picked from commit ba2313d6145a1234777938a747187373f4cd58d9)
 2015-08-05 13:51:08 -07:00
Arun Suresh
707b96fa58 YARN-3736. Add RMStateStore apis to store and load accepted reservations for failover (adhoot via asuresh) 
(cherry picked from commit f271d377357ad680924d19f07e6c8315e7c89bae)
 2015-08-05 12:58:37 -07:00
Xuan
8126fde884 YARN-3543. ApplicationReport should be able to tell whether the 
Application is AM managed or not. Contributed by Rohith Sharma K S

(cherry picked from commit 0306d902f53582320aa5895ca9f5c31f64aaaff6)
 2015-08-03 15:47:21 -07:00