Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,510 Commits 326 Branches 371 Tags
Commit Graph

4572 Commits

Author SHA1 Message Date
Sunil G
28e63f3d88 YARN-8004. Add unit tests for inter queue preemption for dominant resource calculator. Contributed by Zian Chen. 
(cherry picked from commit 71220d218db59cab0b03bbba427e5e9ef5b3003c)
 2018-04-27 10:42:59 +05:30
Sunil G
a1a2f1ddc1 YARN-8215. ATS v2 returns invalid YARN_CONTAINER_ALLOCATED_HOST_HTTP_ADDRESS from NM. Contributed by Rohith Sharma K S. 
(cherry picked from commit 7fc09c4f7255645025ddf902dff70a17092ea039)
 2018-04-27 10:34:29 +05:30
Sunil G
e2901d97ba YARN-8205. Application State is not updated to ATS if AM launching is delayed. Contributed by Rohith Sharma K S. 
(cherry picked from commit 1634de0fc1430d86b7688d16259a81462fba482f)
 2018-04-27 10:28:18 +05:30
Eric Yang
2253616064 YARN-8122. Added component health monitoring for YARN service. 
Contributed by Gour Saha
(cherry picked from commit 93979db8400186d6e557c46a2a1e2622821013c1)
 2018-04-26 19:19:29 -04:00
Billie Rinaldi
91b24278da YARN-8140. Improve log message when launch cmd is ran for stopped yarn service. Contributed by Eric Yang 
(cherry picked from commit ed4e0676c357d5d18c15998b1f6b5d305848cb04)
 2018-04-26 13:18:56 -07:00
Eric Yang
b39d183d92 YARN-7939. Added support to upgrade a component instance. 
Contributed by Chandni Singh

(cherry picked from commit 86ae380e55ca3b1b12744b9338d60b34e8c717a6)
 2018-04-26 15:54:12 -04:00
Eric Yang
050bd4cd2a YARN-8043. Added the exception message for failed launches running under LCE. 
Contributed by Shane Kumpf
 2018-04-26 08:26:10 -07:00
Wangda Tan
af286319fd YARN-8193. YARN RM hangs abruptly (stops allocating resources) when running successive applications. (Zian Chen via wangda) 
Change-Id: Ia83dd2499ee9000b9e09ae5a932f21a13c0ddee6
(cherry picked from commit af986b442b7be0f2fad1241ca9e267a15c20bf43)
 2018-04-25 22:16:07 -07:00
Sunil G
44d28692a8 YARN-8188. RM Nodes UI data table index for sorting column need to be corrected post Application tags display. Contributed by Weiwei Yang. 
(cherry picked from commit 626690612cd0957316628376744a8be62f891665)
 2018-04-25 14:58:07 +05:30
Wangda Tan
3043a93d46 YARN-8183. Fix ConcurrentModificationException inside RMAppAttemptMetrics#convertAtomicLongMaptoLongMap. (Suma Shivaprasad via wangda) 
Change-Id: I347871d672001653a3afe2e99adefd74e0d798cd
(cherry picked from commit bb3c504764f807fccba7f28298a12e2296f284cb)
 2018-04-24 17:44:58 -07:00
Eric Yang
678e599879 YARN-8196. Updated documentation for enabling YARN Service REST API. 
Contributed by Billie Rinaldi

(cherry picked from commit f64501fcdc9dfa2e9848db0fb4749c6bd4a54d7f)
 2018-04-24 19:17:15 -04:00
Junping Du
9209ebae18 YARN-7598. Document how to use classpath isolation for aux-services in YARN. Contributed by Xuan Gong. 
(cherry picked from commit 56788d759f47b4b158617701f543a9dcb4df69cd)
 2018-04-24 18:30:58 +08:00
Robert Kanter
ea7ad50499 HADOOP-15390. Yarn RM logs flooded by DelegationTokenRenewer trying to renew KMS tokens (xiaochen via rkanter) 
(cherry picked from commit 7ab08a9c37a76edbe02d556fcfb2e637f45afc21)
 2018-04-23 16:25:41 -07:00
Sunil G
74f181e5dd YARN-8177. Documentation changes for auto creation of Leaf Queues with node label. Contributed by Suma Shivaprasad. 
(cherry picked from commit 83e5f25d5e28a6975464953dc756a3f464d4be60)
 2018-04-23 13:37:13 +05:30
Sunil G
f53e5e000a YARN-7956. [UI2] Avoid duplicating Components link under Services/<ServiceName>/Components. Contributed by Yesha Vora. 
(cherry picked from commit b6d94fad0811c5b635476d03acea417b277d382b)
 2018-04-23 13:32:54 +05:30
Eric Yang
5556cf397c YARN-8064. Bugfix for clean up container-executor cmd helper file. 
Contributed by Eric Badger
 2018-04-20 19:12:06 -04:00
Konstantinos Karanasos
18c86a3fb6 YARN-8111. Simplify PlacementConstraints API by removing allocationTagToIntraApp. Contributed by Weiwei Yang. 
(cherry picked from commit 28e2244390c990877dc2ee2733cf9b8d2c75128e)
 2018-04-20 12:25:08 -07:00
Jason Lowe
71b0d52987 YARN-7786. NullPointerException while launching ApplicationMaster. Contributed by lujie 
(cherry picked from commit 766544c0b008da9e78bcea6285b2c478653df75a)
 2018-04-20 13:23:46 -05:00
Sunil G
25b91fa98d YARN-7830. [UI2] Post selecting grid view in Attempt page, attempt info page should also be opened with grid view. Contributed by Gergely Novák. 
(cherry picked from commit 55e4252fc5a30c5b1924208b824e44c4ec5bd140)
 2018-04-20 20:05:47 +05:30
Rohith Sharma K S
71661cec77 YARN-8182. [UI2] Proxy- Clicking on nodes under Nodes HeatMap gives 401 error. Contributed by Sunil G. 
(cherry picked from commit 87e09859f148c369b0ead6cdcf3293c39f2abc4a)
 2018-04-20 19:44:15 +05:30
Rohith Sharma K S
3f5b4276e5 YARN-8189. [UI2] Nodes page column headers are half truncated. Contributed by Sunil G. 
(cherry picked from commit b0753cc2c0536d1eed94ca6c6db2682e7e6aabc4)
 2018-04-20 19:44:06 +05:30
Sunil G
162db6e826 YARN-6827. [ATS1/1.5] NPE exception while publishing recovering applications into ATS during RM restart. Contributed by Rohith Sharma K S. 
(cherry picked from commit 7d06806dfdeb3252ac0defe23e8c468eabfa8b5e)
 2018-04-20 00:06:44 +05:30
Sunil G
aa64def228 YARN-5888. [UI2] Improve unit tests for new YARN UI. Contributed by Akhil PB. 
(cherry picked from commit c6d7d3eb059c7539db7d00586e181ec44da13557)
 2018-04-19 22:00:34 +05:30
Weiwei Yang
c3ca10c22a YARN-7734. Fix UT failure TestContainerLogsPage#testContainerLogPageAccess. Contributed by Tao Yang. 
(cherry picked from commit 411993f6e5723c8cba8100bff0269418e46f6367)
 2018-04-18 19:40:34 -07:00
Shashikant Banerjee
a13b3edfd8
HADOOP-15396. Some java source files are executable 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit e4c39f3247da77d03c6015de4f18be75924fcb22)
 2018-04-19 08:36:32 +09:00
Rohith Sharma K S
2e8053600e YARN-8171. [UI2] AM Node link from attempt page should not redirect to new tab. Contributed by Sunil G. 
(cherry picked from commit 034da8fc97f01b8207de945828a28f25cadd77b0)
 2018-04-18 13:40:42 +05:30
Rohith Sharma K S
fa007d986b YARN-8145. yarn rmadmin -getGroups doesn't return updated groups for user. Contributed by Sunil G. 
(cherry picked from commit 241d985467c4a318fa22a3f3007ee1827c94389c)
 2018-04-18 13:40:32 +05:30
Jason Lowe
42aef3b655 YARN-7996. Allow user supplied Docker client configurations with YARN native services. Contributed by Shane Kumpf 
(cherry picked from commit 1d6e43da51aaaab522325bdbe4b51e58934e03f1)
 2018-04-17 11:32:58 -05:00
Inigo Goiri
8f300c9ce1 YARN-8165. Incorrect queue name logging in AbstractContainerAllocator. Contributed by Weiwei Yan. 
(cherry picked from commit dd5e18c4aecba56f140c3cc11affc2cb5e61c79d)
 2018-04-17 15:28:13 +05:30
Sunil G
d5adc59017 YARN-8126. Support auto-spawning of admin configured services during bootstrap of RM. Contributed by Rohith Sharma K S. 
(cherry picked from commit 427ad7ecc4afbf2cc4acde22c29a7248c46fb22b)
 2018-04-17 15:25:31 +05:30
Eric Yang
2911b5406b YARN-8060. Added default readiness check for service components. 
Contributed by Billie Rinaldi

(cherry picked from 2d0662cfd57bd438421f912dc172e79a15835442)
 2018-04-16 14:53:42 -04:00
Eric Yang
20453488e8 YARN-8032. Added ability to configure failure validity interval for YARN service. 
Contributed by Chandni Singh

(cherry-picked from 647058efc0c7a4442b3e64b4d743df1a589f26bc)
 2018-04-16 14:52:09 -04:00
Eric Yang
148322ca72 YARN-8142. Improve SIGTERM handling for YARN Service Application Master. 
Contributed by Billie Rinaldi

(cherry picked from commit 9031a76d447f0c5eaa392144fd17c5b9812e1b20)
 2018-04-14 12:10:37 -07:00
Wangda Tan
6ee62e6b1c YARN-8138. Add unit test to validate queue priority preemption works under node partition. (Zian Chen via wangda) 
Change-Id: Ibebfab98a714c12c2dc643b6d7b9754a7f813632
 2018-04-14 11:04:49 -07:00
Wangda Tan
0b88683627 YARN-7142. Support placement policy in yarn native services. (Gour Saha via wangda) 
Change-Id: I166c67a7a34430627c17365f60bac75b6da1b434
(cherry picked from commit a0bde7d525911680f9e5fb0a939604865eb8e164)
 2018-04-14 11:01:59 -07:00
Rohith Sharma K S
eb1026dffa YARN-8156. Increase the default value of yarn.timeline-service.app-collector.linger-period.ms. Contributed by Charan Hebri. 
(cherry picked from commit 669eb7bdea34f26e9b9b8a2260ae4356791622e7)
 2018-04-14 10:57:02 +05:30
Wangda Tan
994c7d66e0 YARN-8091. Revisit checkUserAccessToQueue RM REST API. (wangda) 
Change-Id: I5fab3fe229c34e967487b7327c7b3c8ddf7cb795
 2018-04-13 10:19:10 -07:00
Wangda Tan
7031a853f4 YARN-8048. Support auto-spawning of admin configured services during bootstrap of RM (Rohith Sharma K S via wangda) 
Change-Id: I2d8d61ccad55e1118009294d7e17822df3cd0fd5
 2018-04-13 10:18:48 -07:00
Sunil G
d98c3ca5fd YARN-8040. [UI2] New YARN UI webapp does not respect current pathname for REST api. Contributed by Sunil G. 2018-04-13 10:18:39 -07:00
Sunil G
21717db6a0 YARN-8028. Support authorizeUserAccessToQueue in RMWebServices. Contributed by Wangda Tan. 2018-04-13 10:18:12 -07:00
Wangda Tan
c962371430 YARN-1151. Ability to configure auxiliary services from HDFS-based JAR files. (Xuan Gong via wangda) 
Change-Id: Ied37ff11e507fc86847753ba79486652c8fadfe9
 2018-04-13 10:17:47 -07:00
Weiwei Yang
84531ad9b6 YARN-8153. Guaranteed containers always stay in SCHEDULED on NM after restart. Contributed by Yang Wang. 2018-04-13 13:29:43 +08:00
Weiwei Yang
7be71ec55b YARN-8154. Fix missing titles in PlacementConstraints document. Contributed by Weiwei Yang. 2018-04-13 13:10:05 +08:00
Eric Yang
a375fe8263 YARN-7984. Improved YARN service stop/destroy and clean up. 
Contributed by Billie Rinaldi

(cherry picked from commit d553799030a5a64df328319aceb35734d0b2de20)
 2018-04-12 18:19:58 -07:00
Eric Yang
150085cc64 YARN-8018. Added support for initiating yarn service upgrade. 
Contributed by Chandni Singh

(cherry picked from commit 27d60a16342fd39973d43b61008f54a8815a6237)
 2018-04-12 17:08:27 -04:00
Billie Rinaldi
23179c06a3 YARN-7936. Add default service AM Xmx. Contributed by Jian He 
(cherry picked from commit 53b3e594732e7a567dda4e08b9a8af5f87a4472a)
 2018-04-12 12:43:30 -07:00
Eric E Payne
9693d8b99d YARN-8147. TestClientRMService#testGetApplications sporadically fails. Contributed by Jason Lowe 
(cherry picked from commit 18844599aef42f79d2af4500aa2eee472dda95cb)
 2018-04-12 17:58:41 +00:00
Eric E Payne
f955d52f39 YARN-8120. JVM can crash with SIGSEGV when exiting due to custom leveldb logger. Contributed by Jason Lowe. 
(cherry picked from commit 6bb128dfb893cf0e4aa2d3ecc65440668a1fc8d7)
 2018-04-12 16:11:57 +00:00
Billie Rinaldi
11f1d49823 YARN-7221. Add security check for privileged docker container. Contributed by Eric Yang 
(cherry picked from commit 933477e9e0526e2ed81ea454f8806de31981822a)
 2018-04-11 12:15:00 -07:00
Weiwei Yang
c2036af196 YARN-8127. Resource leak when async scheduling is enabled. Contributed by Tao Yang. 
(cherry picked from commit 7eb783e2634d8c11fb646f1f2fdf597336325312)
 2018-04-11 17:21:47 +08:00