Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,809 Commits 326 Branches 371 Tags
Commit Graph

4927 Commits

Author SHA1 Message Date
Sunil G
44d28692a8 YARN-8188. RM Nodes UI data table index for sorting column need to be corrected post Application tags display. Contributed by Weiwei Yang. 
(cherry picked from commit 626690612cd0957316628376744a8be62f891665)
 2018-04-25 14:58:07 +05:30
Wangda Tan
3043a93d46 YARN-8183. Fix ConcurrentModificationException inside RMAppAttemptMetrics#convertAtomicLongMaptoLongMap. (Suma Shivaprasad via wangda) 
Change-Id: I347871d672001653a3afe2e99adefd74e0d798cd
(cherry picked from commit bb3c504764f807fccba7f28298a12e2296f284cb)
 2018-04-24 17:44:58 -07:00
Eric Yang
678e599879 YARN-8196. Updated documentation for enabling YARN Service REST API. 
Contributed by Billie Rinaldi

(cherry picked from commit f64501fcdc9dfa2e9848db0fb4749c6bd4a54d7f)
 2018-04-24 19:17:15 -04:00
Junping Du
9209ebae18 YARN-7598. Document how to use classpath isolation for aux-services in YARN. Contributed by Xuan Gong. 
(cherry picked from commit 56788d759f47b4b158617701f543a9dcb4df69cd)
 2018-04-24 18:30:58 +08:00
Robert Kanter
ea7ad50499 HADOOP-15390. Yarn RM logs flooded by DelegationTokenRenewer trying to renew KMS tokens (xiaochen via rkanter) 
(cherry picked from commit 7ab08a9c37a76edbe02d556fcfb2e637f45afc21)
 2018-04-23 16:25:41 -07:00
Sunil G
74f181e5dd YARN-8177. Documentation changes for auto creation of Leaf Queues with node label. Contributed by Suma Shivaprasad. 
(cherry picked from commit 83e5f25d5e28a6975464953dc756a3f464d4be60)
 2018-04-23 13:37:13 +05:30
Sunil G
f53e5e000a YARN-7956. [UI2] Avoid duplicating Components link under Services/<ServiceName>/Components. Contributed by Yesha Vora. 
(cherry picked from commit b6d94fad0811c5b635476d03acea417b277d382b)
 2018-04-23 13:32:54 +05:30
Eric Yang
5556cf397c YARN-8064. Bugfix for clean up container-executor cmd helper file. 
Contributed by Eric Badger
 2018-04-20 19:12:06 -04:00
Konstantinos Karanasos
18c86a3fb6 YARN-8111. Simplify PlacementConstraints API by removing allocationTagToIntraApp. Contributed by Weiwei Yang. 
(cherry picked from commit 28e2244390c990877dc2ee2733cf9b8d2c75128e)
 2018-04-20 12:25:08 -07:00
Jason Lowe
71b0d52987 YARN-7786. NullPointerException while launching ApplicationMaster. Contributed by lujie 
(cherry picked from commit 766544c0b008da9e78bcea6285b2c478653df75a)
 2018-04-20 13:23:46 -05:00
Sunil G
25b91fa98d YARN-7830. [UI2] Post selecting grid view in Attempt page, attempt info page should also be opened with grid view. Contributed by Gergely Novák. 
(cherry picked from commit 55e4252fc5a30c5b1924208b824e44c4ec5bd140)
 2018-04-20 20:05:47 +05:30
Rohith Sharma K S
71661cec77 YARN-8182. [UI2] Proxy- Clicking on nodes under Nodes HeatMap gives 401 error. Contributed by Sunil G. 
(cherry picked from commit 87e09859f148c369b0ead6cdcf3293c39f2abc4a)
 2018-04-20 19:44:15 +05:30
Rohith Sharma K S
3f5b4276e5 YARN-8189. [UI2] Nodes page column headers are half truncated. Contributed by Sunil G. 
(cherry picked from commit b0753cc2c0536d1eed94ca6c6db2682e7e6aabc4)
 2018-04-20 19:44:06 +05:30
Sunil G
162db6e826 YARN-6827. [ATS1/1.5] NPE exception while publishing recovering applications into ATS during RM restart. Contributed by Rohith Sharma K S. 
(cherry picked from commit 7d06806dfdeb3252ac0defe23e8c468eabfa8b5e)
 2018-04-20 00:06:44 +05:30
Sunil G
aa64def228 YARN-5888. [UI2] Improve unit tests for new YARN UI. Contributed by Akhil PB. 
(cherry picked from commit c6d7d3eb059c7539db7d00586e181ec44da13557)
 2018-04-19 22:00:34 +05:30
Weiwei Yang
c3ca10c22a YARN-7734. Fix UT failure TestContainerLogsPage#testContainerLogPageAccess. Contributed by Tao Yang. 
(cherry picked from commit 411993f6e5723c8cba8100bff0269418e46f6367)
 2018-04-18 19:40:34 -07:00
Shashikant Banerjee
a13b3edfd8
HADOOP-15396. Some java source files are executable 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit e4c39f3247da77d03c6015de4f18be75924fcb22)
 2018-04-19 08:36:32 +09:00
Rohith Sharma K S
2e8053600e YARN-8171. [UI2] AM Node link from attempt page should not redirect to new tab. Contributed by Sunil G. 
(cherry picked from commit 034da8fc97f01b8207de945828a28f25cadd77b0)
 2018-04-18 13:40:42 +05:30
Rohith Sharma K S
fa007d986b YARN-8145. yarn rmadmin -getGroups doesn't return updated groups for user. Contributed by Sunil G. 
(cherry picked from commit 241d985467c4a318fa22a3f3007ee1827c94389c)
 2018-04-18 13:40:32 +05:30
Jason Lowe
42aef3b655 YARN-7996. Allow user supplied Docker client configurations with YARN native services. Contributed by Shane Kumpf 
(cherry picked from commit 1d6e43da51aaaab522325bdbe4b51e58934e03f1)
 2018-04-17 11:32:58 -05:00
Inigo Goiri
8f300c9ce1 YARN-8165. Incorrect queue name logging in AbstractContainerAllocator. Contributed by Weiwei Yan. 
(cherry picked from commit dd5e18c4aecba56f140c3cc11affc2cb5e61c79d)
 2018-04-17 15:28:13 +05:30
Sunil G
d5adc59017 YARN-8126. Support auto-spawning of admin configured services during bootstrap of RM. Contributed by Rohith Sharma K S. 
(cherry picked from commit 427ad7ecc4afbf2cc4acde22c29a7248c46fb22b)
 2018-04-17 15:25:31 +05:30
Eric Yang
2911b5406b YARN-8060. Added default readiness check for service components. 
Contributed by Billie Rinaldi

(cherry picked from 2d0662cfd57bd438421f912dc172e79a15835442)
 2018-04-16 14:53:42 -04:00
Eric Yang
20453488e8 YARN-8032. Added ability to configure failure validity interval for YARN service. 
Contributed by Chandni Singh

(cherry-picked from 647058efc0c7a4442b3e64b4d743df1a589f26bc)
 2018-04-16 14:52:09 -04:00
Eric Yang
148322ca72 YARN-8142. Improve SIGTERM handling for YARN Service Application Master. 
Contributed by Billie Rinaldi

(cherry picked from commit 9031a76d447f0c5eaa392144fd17c5b9812e1b20)
 2018-04-14 12:10:37 -07:00
Wangda Tan
6ee62e6b1c YARN-8138. Add unit test to validate queue priority preemption works under node partition. (Zian Chen via wangda) 
Change-Id: Ibebfab98a714c12c2dc643b6d7b9754a7f813632
 2018-04-14 11:04:49 -07:00
Wangda Tan
0b88683627 YARN-7142. Support placement policy in yarn native services. (Gour Saha via wangda) 
Change-Id: I166c67a7a34430627c17365f60bac75b6da1b434
(cherry picked from commit a0bde7d525911680f9e5fb0a939604865eb8e164)
 2018-04-14 11:01:59 -07:00
Rohith Sharma K S
eb1026dffa YARN-8156. Increase the default value of yarn.timeline-service.app-collector.linger-period.ms. Contributed by Charan Hebri. 
(cherry picked from commit 669eb7bdea34f26e9b9b8a2260ae4356791622e7)
 2018-04-14 10:57:02 +05:30
Wangda Tan
994c7d66e0 YARN-8091. Revisit checkUserAccessToQueue RM REST API. (wangda) 
Change-Id: I5fab3fe229c34e967487b7327c7b3c8ddf7cb795
 2018-04-13 10:19:10 -07:00
Wangda Tan
7031a853f4 YARN-8048. Support auto-spawning of admin configured services during bootstrap of RM (Rohith Sharma K S via wangda) 
Change-Id: I2d8d61ccad55e1118009294d7e17822df3cd0fd5
 2018-04-13 10:18:48 -07:00
Sunil G
d98c3ca5fd YARN-8040. [UI2] New YARN UI webapp does not respect current pathname for REST api. Contributed by Sunil G. 2018-04-13 10:18:39 -07:00
Sunil G
21717db6a0 YARN-8028. Support authorizeUserAccessToQueue in RMWebServices. Contributed by Wangda Tan. 2018-04-13 10:18:12 -07:00
Wangda Tan
c962371430 YARN-1151. Ability to configure auxiliary services from HDFS-based JAR files. (Xuan Gong via wangda) 
Change-Id: Ied37ff11e507fc86847753ba79486652c8fadfe9
 2018-04-13 10:17:47 -07:00
Weiwei Yang
84531ad9b6 YARN-8153. Guaranteed containers always stay in SCHEDULED on NM after restart. Contributed by Yang Wang. 2018-04-13 13:29:43 +08:00
Weiwei Yang
7be71ec55b YARN-8154. Fix missing titles in PlacementConstraints document. Contributed by Weiwei Yang. 2018-04-13 13:10:05 +08:00
Eric Yang
a375fe8263 YARN-7984. Improved YARN service stop/destroy and clean up. 
Contributed by Billie Rinaldi

(cherry picked from commit d553799030a5a64df328319aceb35734d0b2de20)
 2018-04-12 18:19:58 -07:00
Eric Yang
150085cc64 YARN-8018. Added support for initiating yarn service upgrade. 
Contributed by Chandni Singh

(cherry picked from commit 27d60a16342fd39973d43b61008f54a8815a6237)
 2018-04-12 17:08:27 -04:00
Billie Rinaldi
23179c06a3 YARN-7936. Add default service AM Xmx. Contributed by Jian He 
(cherry picked from commit 53b3e594732e7a567dda4e08b9a8af5f87a4472a)
 2018-04-12 12:43:30 -07:00
Eric E Payne
9693d8b99d YARN-8147. TestClientRMService#testGetApplications sporadically fails. Contributed by Jason Lowe 
(cherry picked from commit 18844599aef42f79d2af4500aa2eee472dda95cb)
 2018-04-12 17:58:41 +00:00
Eric E Payne
f955d52f39 YARN-8120. JVM can crash with SIGSEGV when exiting due to custom leveldb logger. Contributed by Jason Lowe. 
(cherry picked from commit 6bb128dfb893cf0e4aa2d3ecc65440668a1fc8d7)
 2018-04-12 16:11:57 +00:00
Billie Rinaldi
11f1d49823 YARN-7221. Add security check for privileged docker container. Contributed by Eric Yang 
(cherry picked from commit 933477e9e0526e2ed81ea454f8806de31981822a)
 2018-04-11 12:15:00 -07:00
Weiwei Yang
c2036af196 YARN-8127. Resource leak when async scheduling is enabled. Contributed by Tao Yang. 
(cherry picked from commit 7eb783e2634d8c11fb646f1f2fdf597336325312)
 2018-04-11 17:21:47 +08:00
Vrushali C
67cd7acf99 YARN-8073 TimelineClientImpl doesn't honor yarn.timeline-service.versions configuration. Contributed by Rohith Sharma K S 
(cherry picked from commit 345e7624d58a058a1bad666bd1e5ce4b346a9056)
 2018-04-11 09:41:04 +05:30
Rohith Sharma K S
c1b4c6adf4 YARN-7941. Transitive dependencies for component are not resolved. Contributed by Billie Rinaldi. 
(cherry picked from commit c0487110990958fa985d273eb178bdf76002cf3a)
 2018-04-11 09:19:48 +05:30
Wangda Tan
53abef4e30 YARN-8133. Doc link broken for yarn-service from overview page. (Rohith Sharma K S via wangda) 
Change-Id: Iacf9a004585dd59e1c0cd8f8c618a38f047cc0fe
(cherry picked from commit d919eb6efa1072517017c75fb323e391f4418dc8)
 2018-04-10 17:38:37 -07:00
Wangda Tan
f5dc7d1edf YARN-8116. Nodemanager fails with NumberFormatException: For input string: . (Chandni Singh via wangda) 
Change-Id: Idd30cfca59982d3fc6e47aa1b88f844a78fae94d
(cherry picked from commit 2bf9cc2c73944c9f7cde56714b8cf6995cfa539b)
 2018-04-10 17:38:31 -07:00
Sunil G
5387b3f066 YARN-7804. [UI2] Refresh action on Grid view page should not be redirected to graph view. Contributed by Gergely Novák. 
(cherry picked from commit 7c1e77dda4cb3ba8952328d142aafcf0366b5903)
 2018-04-10 16:09:49 +05:30
Wangda Tan
25bf1d3ac6 Updated branch-3.1 to track 3.1.1 
Change-Id: Idd55c79921b8acacc8a8a3258450e476f3abb706
 2018-04-09 10:58:50 -07:00
Sunil G
8311fcc75b YARN-7574. Add support for Node Labels on Auto Created Leaf Queue Template. Contributed by Suma Shivaprasad. 
(cherry picked from commit 821b0de4c59156d4a65112de03ba3e7e1c88e309)
 2018-04-09 21:17:56 +05:30
bibinchundatt
091db4d0eb YARN-7905. Parent directory permission incorrect during public localization. Contributed by Bilwa S T. 
(cherry picked from commit eb47c3de74ba4b8b3ef47eaf3a44e5562fd22fc9)
 2018-04-08 14:49:36 +05:30