Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,684 Commits 326 Branches 371 Tags
Commit Graph

4872 Commits

Author SHA1 Message Date
Sunil G
e7f2c9886a YARN-8455. Add basic ACL check for all ATS v2 REST APIs. Contributed by Rohith Sharma K S. 
(cherry picked from commit 469b29c0817b7bf1902c9195c4f8d031a909e1c9)
 2018-06-29 10:03:53 -07:00
Sunil G
122cb81b65 YARN-8379. Improve balancing resources in already satisfied queues by using Capacity Scheduler preemption. Contributed by Zian Chen. 
(cherry picked from commit 291194302cc1a875d6d94ea93cf1184a3f1fc2cc)
 2018-06-28 10:24:03 -07:00
Eric Yang
3ce3571a34 YARN-8409. Fixed NPE in ActiveStandbyElectorBasedElectorService. 
Contributed by Chandni Singh
 2018-06-28 13:11:56 -04:00
Sunil G
3c68d4ce45 YARN-8401. [UI2] new ui is not accessible with out internet connection. Contributed by Bibin A Chundatt. 
(cherry picked from commit fbaff369e9b9022723a7b2c6f25e71122a8f8a15)
 2018-06-27 10:35:50 -07:00
Wangda Tan
ec37e02bc9 YARN-8464. Async scheduling thread could be interrupted when there are no NodeManagers in cluster. (Sunil G via wangda) 
Change-Id: I4f5f856373378685713e77752ba6cf0988a66065
(cherry picked from commit bedc4fe0799cf3b161100acc521fc62a97793427)
 2018-06-26 19:34:15 -07:00
Wangda Tan
8f226f4f1d YARN-8423. GPU does not get released even though the application gets killed. (Sunil G via wangda) 
Change-Id: I570db7d60f8c6c21762dd618a9207d1107c486a0
(cherry picked from commit ada8f63d0b3739d245300461387b0516dc92ccf9)
 2018-06-26 19:34:10 -07:00
Sunil G
aa8db00fc3 HADOOP-15483. Upgrade jquery to version 3.3.1. Contributed by Lokesh Jain, Mukul Kumar Singh and Sunil Govindan. 2018-06-26 15:02:49 -07:00
Eric Yang
f6aa6a6981 YARN-8108. Added option to disable loading existing filters to prevent 
security filter from initialize twice.
            Contributed by Sunil Govindan

(cherry picked from commit b69ba0f3307a90500aeb0c5db9e582fcda60b501)
 2018-06-26 17:45:13 -04:00
Eric Yang
9e9530f505 YARN-8214. Change default RegistryDNS port. 
Contributed by Billie Rinaldi

(cherry picked from commit 3e586330eb2c7db0b884fe328b171fb27ce545fa)
 2018-06-26 14:26:26 -04:00
Rohith Sharma K S
e925de6483 YARN-8457. Compilation is broken with -Pyarn-ui. 
(cherry picked from commit 4ffe68a6f70ce01a5654da8991b4cdb35ae0bf1f)
 2018-06-25 10:39:26 -07:00
Weiwei Yang
bfdbc9dea2 YARN-8443. Total #VCores in cluster metrics is wrong when CapacityScheduler reserved some containers. Contributed by Tao Yang. 
(Cherry picked from commit 440140cea6718229094a3d2b97b9b9bd28b95d9b)
 2018-06-25 09:28:57 +08:00
Eric Yang
3b3a85002d YARN-8326. Removed exit code file check for launched container. 
Contributed by Shane Kumpf

(cherry picked from commit 8a32bc39eb210fca8052c472601e24c2446b4cc2)
 2018-06-22 19:23:57 -04:00
Eric Yang
63ce762959 YARN-8445. Improved error message for duplicated service and component names. 
Contributed by Chandni Singh

(cherry picked from commit 9f15483c5d7c94251f4c84e0155449188f202779)
 2018-06-21 11:21:34 -04:00
Eric Yang
d69c2e7867 YARN-8410. Fixed a bug in A record lookup by CNAME record. 
Contributed by Shane Kumpf

(cherry picked from commit 9591765040b85927ac69179ab46383eef9560a28)
 2018-06-14 15:55:33 -04:00
Rohith Sharma K S
1aa6c9407c YARN-8155. Improve ATSv2 client logging in RM and NM publisher. Contributed by Abhishek Modi. 
(cherry picked from commit 9119b3cf8f883aa2d5df534afc0c50249fed03c6)
 2018-06-14 13:51:13 +05:30
Eric Yang
934a005f72 YARN-8259. Improve privileged docker container liveliness checks. 
Contributed by Shane Kumpf

(cherry picked from commit 22994889dc449f966fb6462a3ac3d3bbaee3ac6a)
 2018-06-13 19:26:23 -04:00
Eric Yang
aba67c360c YARN-8411. Restart stopped system service during RM start. 
Contributed by Billie Rinaldi

(cherry picked from commit 69b05968974994c6e22d6562a67b9392d1700094)
 2018-06-13 19:10:13 -04:00
Sunil G
ed20c59d36 YARN-8404. Timeline event publish need to be async to avoid Dispatcher thread leak in case ATS is down. Contributed by Rohith Sharma K S 
(cherry picked from commit 6307962b932e0ee69ba61f5796388c175d79195a)
 2018-06-13 16:09:52 +05:30
Weiwei Yang
4488ad5297 YARN-8394. Improve data locality documentation for Capacity Scheduler. Contributed by Weiwei Yang. 2018-06-13 13:54:09 +08:00
Inigo Goiri
d5cd12c082 HADOOP-15529. ContainerLaunch#testInvalidEnvVariableSubstitutionType is not supported in Windows. Contributed by Giovanni Matteo Fumarola. 
(cherry picked from commit 6e756e8a620e4d6dc3192986679060c52063489b)
 2018-06-12 10:25:05 -07:00
Sunil G
6f67e4db51 YARN-8419. [UI2] User cannot submit a new service as submit button is always disabled. Contributed by Suma Shivaprasad. 
(cherry picked from commit b3612dd90c419c6ac5d59ab0793b4adec40ef5c6)
 2018-06-12 17:41:09 +05:30
Rohith Sharma K S
ba0a8f8792 YARN-8413. Flow activity page is failing with 'Timeline server failed with an error'. Contributed by Sunil Govindan. 
(cherry picked from commit 95303f50d3467fd9bc64e504c9e64a64f118b25f)
 2018-06-12 17:23:28 +05:30
Rohith Sharma K S
af0309d793 YARN-8405. RM zk-state-store.parent-path ACLs has been changed since HADOOP-14773. Contributed by Íñigo Goiri. 
(cherry picked from commit 2df73dace06cfd2b3193a14cd455297f8f989617)
 2018-06-12 17:23:22 +05:30
Inigo Goiri
65d2554ad8 YARN-8370. Some Node Manager tests fail on Windows due to improper path/file separator. Contributed by Anbang Hu. 
(cherry picked from commit 2b2f672022547e8c19658213ac5a4090bf5b6c72)
 2018-06-11 19:26:27 -07:00
Inigo Goiri
63c20f9021 YARN-8359. Exclude containermanager.linux test classes on Windows. Contributed by Jason Lowe. 
(cherry picked from commit 3492a1db2c0654ce5375360caa74a34f928f23be)
 2018-06-07 17:10:09 -07:00
Inigo Goiri
1fa51d4542 YARN-8400. Fix typos in YARN Federation documentation page. Contributed by Giovanni Matteo Fumarola. 
(cherry picked from commit 67fc70e09f941e9b43b022d9f42a9486ad759e6e)
 2018-06-07 16:10:51 -07:00
Rohith Sharma K S
e9367ccb41 YARN-8386. App log can not be viewed from Logs tab in secure cluster. Contributed by Sunil Govindan. 
(cherry picked from commit 377ea1bcdfd523f9353647388881b82699f2df12)
 2018-06-07 21:43:17 +05:30
Rohith Sharma K S
a95f216945 YARN-8399. NodeManager is giving 403 GSS exception post upgrade to 3.1 in secure mode. Contributed by Sunil Govindan. 
(cherry picked from commit 58bc34f1e347034af566d6968eb3b3439a91cc74)
 2018-06-07 10:27:08 +05:30
Rohith Sharma K S
e4eac4a9f3 YARN-8396. Click on an individual container continuously spins and doesn't load the page. Contributed by Sunil Govindan. 
(cherry picked from commit 745f3a244166c1e6a1aee81eb1d6c2c692053d04)
 2018-06-05 19:29:04 +05:30
Eric Yang
9dd79d1dcd YARN-8365. Set DNS query type according to client request. 
Contributed by Shane Kumpf

(cherry picked from commit 5889a3c0f931ebe1a9e6b8023c0557922b7d9e49)
 2018-06-04 19:03:07 -04:00
Robert Kanter
93d6ed859e YARN-4677. RMNodeResourceUpdateEvent update from scheduler can lead to race condition (wilfreds and gphillips via rkanter) 
(cherry picked from commit 0cd145a44390bc1a01113dce4be4e629637c3e8a)
 2018-06-04 15:32:47 -07:00
Miklos Szegedi
21948b048e YARN-8382. cgroup file leak in NM. Contributed by Hu Ziqian. 
(cherry picked from commit 925fdf761a513130e23c10575c7328c8681cff1d)
 2018-06-04 10:56:13 -07:00
Inigo Goiri
83d0964d82 YARN-8389. Improve the description of machine-list property in Federation docs. Contributed by Takanobu Asanuma. 
(cherry picked from commit 61fc7f73f21b0949e27ef3893efda757d91a03f9)
 2018-06-04 09:28:40 -07:00
Sunil G
ea2fa52d92 YARN-8276. [UI2] After version field became mandatory, form-based submission of new YARN service doesn't work. Contributed by Gergely Novák. 
(cherry picked from commit 9c4cbed8d19ec0f486af454de6b117d77a0a0b84)
 2018-06-04 00:09:44 +05:30
Billie Rinaldi
e59e9feefa YARN-8342. Enable untrusted docker image to run with launch command. Contributed by Eric Yang 
(cherry picked from commit 31998643a51f1e08f723f18dc5476ac1512d5b81)
 2018-06-02 14:49:21 -07:00
Rohith Sharma K S
f7d0ca71ac More YARN pages need to honor yarn.resourcemanager.display.per-user-apps(addendum). Contributed by Sunil G. 
(cherry picked from commit 8261f9e5710038ccbc475dbfcea3b9ae79b6f482)
 2018-06-02 09:43:08 +05:30
Wangda Tan
0be93a7973 YARN-8349. Remove YARN registry entries when a service is killed by the RM. (Billie Rinaldi via wangda) 
Change-Id: Ia58db3637789a8921482f564aa9bdf99c45cc36c
(cherry picked from commit ff583d3fa3325029bc691ec22d817aee37e5e85d)
 2018-06-01 15:53:26 -07:00
Wangda Tan
ed20576413 YARN-8372. Distributed shell app master should not release containers when shutdown if keep-container is true. (Suma Shivaprasad via wangda) 
Change-Id: Ief04d1ca865621f348fba4ac85fa78bc47465904
(cherry picked from commit 8956e5b8db3059e0872e49f59adc6affc76e2274)
 2018-06-01 15:47:59 -07:00
Wangda Tan
1cee85d8c4 YARN-7962. Race Condition When Stopping DelegationTokenRenewer causes RM crash during failover. (BELUGA BEHR via wangda) 
Change-Id: I617e2645f60a57080058ad5f06af860fb3f682c8
(cherry picked from commit 931f78718f3a09775bfa1f9a952c069c416d0914)
 2018-06-01 15:47:51 -07:00
Wangda Tan
cc460fea2d YARN-8384. stdout.txt, stderr.txt logs of a launched docker container is coming with primary group of submit user instead of hadoop. (Eric Yang via wangda) 
Change-Id: Idbb2cd250f4f62dc32993e0d3ca3ec5684616baa
(cherry picked from commit 3a6bd775500343632bad5f9c1a2bfacd408f7760)
 2018-06-01 15:47:45 -07:00
Eric Yang
4193892de6 YARN-8308. Fixed YARN Service AM failure with HDFS token renewal. 
Contributed by Gour Saha

(cherry picked from commit 7c7ac07f013f46db89c73681806300699ee534d6)
 2018-05-31 21:10:04 -04:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
a468400bad YARN-8197. Fixed AM IP Filter and Webapp proxy to redirect app tracking-URLs correctly when UI is secure. Contributed by Sunil Govindan. 
(cherry picked from commit 6b74f5d7fc509c55c331249256eec78b7e53b6ce)
 2018-05-31 17:04:45 -07:00
Billie Rinaldi
1bb112cd96 YARN-8333. Load balance YARN services using RegistryDNS multiple A records. Contributed by Eric Yang 
(cherry picked from commit 6bc92e304fe05e80f13830104d1fd2c59da8344b)
 2018-05-31 06:49:04 -07:00
Weiwei Yang
ec4240a7fa YARN-8367. Fix NPE in SingleConstraintAppPlacementAllocator when placement constraint in SchedulingRequest is null. Contributed by Weiwei Yang. 
(Cherry picked from commit 6468071f137e6d918a7b4799ad54558fa26b25ce)
 2018-05-31 21:04:41 +08:00
Billie Rinaldi
58e7d6c3c0 YARN-8350. NPE in service AM related to placement policy. Contributed by Gour Saha 
(cherry picked from commit 778a4a24be176382a5704f709c00bdfcfe6ddc8c)
 2018-05-30 13:21:17 -07:00
Billie Rinaldi
7bd5d79177 YARN-8368. yarn app start cli should print applicationId. Contributed by Rohith Sharma K S 
(cherry picked from commit 96eefcc84aacc4cc82ad7e3e72c5bdad56f4a7b7)
 2018-05-30 12:38:53 -07:00
Eric E Payne
3d06d75423 YARN-8377: Javadoc build failed in hadoop-yarn-server-nodemanager. Contributed by Takanobu Asanuma 
(cherry picked from commit e44c0849d7982c8f1ed43af25d2092090881d19f)
 2018-05-30 17:28:14 +00:00
Eric Yang
03209e8966 YARN-8362. Bugfix logic in container retries in node manager. 
Contributed by Chandni Singh

(cherry picked from commit 135941e00d762a417c3b4cc524cdc59b0d1810b1)
 2018-05-29 17:04:01 -04:00
Jason Lowe
a1fd04c4f4 YARN-8329. Docker client configuration can still be set incorrectly. Contributed by Shane Kumpf 
(cherry picked from commit 4827e9a9085b306bc379cb6e0b1fe4b92326edcd)
 2018-05-29 14:48:01 -05:00
Wangda Tan
3eb1cb18c7 YARN-8369. Javadoc build failed due to 'bad use of >'. (Takanobu Asanuma via wangda) 
Change-Id: I79a42154e8f86ab1c3cc939b3745024b8eebe5f4
(cherry picked from commit 17aa40f669f197d43387d67dc00040d14cd00948)
 2018-05-29 09:28:34 -07:00