Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
14,273 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

3851 Commits

Author SHA1 Message Date
bibinchundatt dc4132395e YARN-7489. ConcurrentModificationException in RMAppImpl#getRMAppMetrics. Contributed by Tao Yang. 
(cherry picked from commit 5c2986e58d)
 2017-11-20 23:29:14 +05:30
Sunil G 9eab9a25c6 YARN-7469. Capacity Scheduler Intra-queue preemption: User can starve if newest app is exactly at user limit. Contributed by Eric Payne. 
(cherry picked from commit 61ace174cd)
 2017-11-17 19:42:00 +05:30
Varun Vasudev f23f49d4ee YARN-7430. Enable user re-mapping for Docker containers by default. Contributed by Eric Yang. 
(cherry picked from commit 5f0b238a11)
(cherry picked from commit 9cf9627e20)
 2017-11-17 12:05:55 +05:30
Jason Lowe e4344d45cb YARN-7361. Improve the docker container runtime documentation. Contributed by Shane Kumpf 
(cherry picked from commit fac72eef23)
 2017-11-15 12:34:22 -06:00
Junping Du 9229fb3523 YARN-6078. Containers stuck in Localizing state. Contributed by Billie Rinaldi. 
(cherry picked from commit a72dcb9cad)
 2017-11-14 12:50:21 -08:00
Arun Suresh 238a70c6c3 YARN-5049. Addendum patch for branch-2. (asuresh) 
(cherry picked from commit c153bed6e3)
 2017-11-12 10:17:01 -08:00
Eric Yang 45c5b7f71d YARN-7412. Fix unit test for docker mount check on ubuntu. (Contributed by Eric Badger) 
(cherry picked from commit 7a49ddfdde)
(cherry picked from commit 90ac8cd5a1)
 2017-11-12 10:13:49 -08:00
Subru Krishnan 8bcd1d62c8 YARN-7476. Fix miscellaneous issues in ATSv2 after merge to branch-2. (Varun Saxena via Subru). 
(cherry picked from commit 0282efab14)
 2017-11-12 09:25:12 -08:00
Subru Krishnan 8251601003 YARN-7475. Fix Container log link in new YARN UI. (Sunil G via Subru). 
(cherry picked from commit 3c5b46c2ed)
 2017-11-12 09:25:12 -08:00
Arun Suresh 45aabb3c8d YARN-6627. Addendum patch for branch-2. (Sunil G via asuresh) 
(cherry picked from commit 5cd92ed555)
 2017-11-11 09:11:43 -08:00
Arun Suresh dc65df2a1a YARN-6102. Addendum patch for branch-2. (Rohith Sharma K S via asuresh) 
(cherry picked from commit 0411c710d2)
 2017-11-10 13:45:14 -08:00
Haibo Chen 288d9506f0 YARN-7388. TestAMRestart should be scheduler agnostic. 
(cherry picked from commit a1382a18df)
(cherry picked from commit 91a7f8d246)
(cherry picked from commit 3fbe67d3e1)
 2017-11-09 11:02:05 -08:00
Arun Suresh 1ddd0a7958 YARN-7453. Fix issue where RM fails to switch to active after first successful start. (Rohith Sharma K S via asuresh) 
(cherry picked from commit a9c70b0e84)
(cherry picked from commit 5486542074)
 2017-11-08 08:08:26 -08:00
Subru Krishnan 8746a65e78 YARN-6932. Fix TestFederationRMFailoverProxyProvider test case failure. 
(cherry picked from commit 0542e6f86e)
 2017-11-03 11:15:48 -07:00
Arun Suresh bb6a1aa5fa Preparing for 2.9.1 development 2017-11-02 22:49:38 -07:00
Inigo Goiri 6f5a95ff98 YARN-7434. Router getApps REST invocation fails with multiple RMs. Contributed by Inigo Goiri. 
(cherry picked from commit 6e2259264ad9525eeec2a14055d53236711659d7)
 2017-11-02 21:35:45 -07:00
Subru Krishnan a60bb3b36f YARN-7432. Fix DominantResourceFairnessPolicy serializable findbugs issues. (Daniel Templeton via Subru). 
(cherry picked from commit ad0fff2b41)
 2017-11-02 17:42:38 -07:00
Eric Payne 9a61d12c03 YARN-7370: Preemption properties should be refreshable. Contrubted by Gergely Novák. 
(cherry picked from commit e6ec02001f)
 2017-11-02 13:09:27 -05:00
Wangda Tan 7a658363d9 YARN-7364. Queue dash board in new YARN UI has incorrect values. (Sunil G via wangda) 
Change-Id: Ia5336f407147d2985a61b5f9f1e69b5b35f398a4
(cherry picked from commit 752f000e0f)
 2017-11-02 09:53:20 -07:00
Jason Lowe cfef479b73 YARN-7286. Add support for docker to have no capabilities. Contributed by Eric Badger 
(cherry picked from commit b7dee1f060)
(cherry picked from commit 6ad6882343)
 2017-11-02 11:02:37 -05:00
Arun Suresh da6ea5c144 Add missing 2.8.2 jdiff for YARN API 2017-11-02 07:09:54 -07:00
Rohith Sharma K S 6005f0a3ee addendum patch for YARN-7289. 
(cherry picked from commit 940ffe3f9c)
 2017-11-02 14:11:33 +05:30
Junping Du d1accde1cd YARN-7400. Incorrect log preview displayed in jobhistory server ui. Contributed by Xuan Gong. 
(cherry picked from commit d57dba9942)
(cherry picked from commit d1f8854a1b)
 2017-11-01 15:01:55 -07:00
Haibo Chen 955f3c30e4 YARN-7389. Make TestResourceManager Scheduler agnostic. (Robert Kanter via Haibo Chen) 
(cherry picked from commit d7f3737f3b)
(cherry picked from commit 32a712a740)
 2017-11-01 14:22:53 -07:00
Daniel Templeton 951d5a46f4 YARN-7146. Many RM unit tests failing with FairScheduler 
(Contributed by Robert Kanter via Daniel Templeton)

(cherry picked from commit 956d814034)
 2017-11-01 14:13:42 -07:00
Inigo Goiri d6a5f8a06d YARN-7276. Federation Router Web Service fixes. Contributed by Inigo Goiri. 
(cherry picked from commit 8180ab436a)
 2017-11-01 13:22:26 -07:00
Arun Suresh efa708f546 Updating jdiff version in anticipation of 2.9.0 release. 2017-10-31 12:56:11 -07:00
Subru Krishnan ac41107423 YARN-6413. FileSystem based Yarn Registry implementation. (Ellen Hui via Subru). 
(cherry picked from commit ed24da3dd7)
 2017-10-31 12:11:40 -07:00
Junping Du 76ec5eab12 HADOOP-14990. Clean up jdiff xml files added for 2.8.2 release. 
(cherry picked from commit a8083aaa6f)
 2017-10-30 15:17:30 -07:00
Vrushali C 3454c02c96 YARN-7378 Documentation changes post branch-2 merge (Vrushali C with Varun Saxena) 2017-10-30 14:09:29 -07:00
Yufei Gu 243b70eca8 YARN-6747. TestFSAppStarvation.testPreemptionEnable fails intermittently. (Contributed by Miklos Szegedi) 
(cherry picked from commit d4811c8cfa)
 2017-10-29 16:47:22 -07:00
Varun Saxena e1b3bbde60 YARN-7380. Fix findbugs warning in timeline service on branch-2 (Vrushali C via Varun Saxena). 2017-10-29 16:38:20 +05:30
Arun Suresh 2654d9973e YARN-7299. Fix TestDistributedScheduler. (asuresh) 
(cherry picked from commit 9c5c68745e)
 2017-10-27 23:11:34 -07:00
Arun Suresh 519aa0e804 YARN-7178. Add documentation for Container Update API. (asuresh) 
(cherry picked from commit 24f8c5cce3)
 2017-10-27 22:57:46 -07:00
Jason Lowe 9093ad6168 YARN-7244. ShuffleHandler is not aware of disks that are added. Contributed by Kuhu Shukla 
(cherry picked from commit 665bb147aa)
 2017-10-27 17:09:29 -05:00
Rohith Sharma K S 548116c3f5 YARN-7289. Application lifetime does not work with FairScheduler. Contributed by Miklos Szegedi. 
(cherry picked from commit 5c799ecf09)
 2017-10-27 22:51:41 +05:30
Sunil G 88c3b444bd YARN-7375. Possible NPE in RMWebapp when HA is enabled and the active RM fails. Contributed by Chandni Singh. 
(cherry picked from commit 792388e1c0)
 2017-10-27 21:11:48 +05:30
Junping Du 1f2a2ba2be Add several jdiff xml files for 2.8.2 release. 
(cherry picked from commit a25b5aa0cf)
 2017-10-26 23:20:24 -07:00
Subru Krishnan a0dceec586 YARN-5516. Add REST API for supporting recurring reservations. (Sean Po via Subru). 
(cherry picked from commit 25932da6d1)
 2017-10-26 20:16:01 -07:00
Arun Suresh f6fde85c5c YARN-4823. Refactor the nested reservation id field in listReservation to simple string field. (subru via asuresh) 
(cherry picked from commit 00bebb7e58)
 2017-10-26 20:04:33 -07:00
Arun Suresh 098a6b8f19 YARN-4825. Remove redundant code in ClientRMService::listReservations. (subru via asuresh) 
(cherry picked from commit d82e797b65)
 2017-10-26 20:04:19 -07:00
Robert Kanter 7c26ae506a YARN-7262. Add a hierarchy into the ZKRMStateStore for delegation token znodes to prevent jute buffer overflow (rkanter) 
(cherry picked from commit b1de78619f)
 2017-10-26 17:51:05 -07:00
Robert Kanter 46783158f8 YARN-7358. TestZKConfigurationStore and TestLeveldbConfigurationStore should explicitly set capacity scheduler (haibochen via rkanter) 
(cherry picked from commit 2da654e34a)
 2017-10-26 10:49:57 -07:00
Subru Krishnan 74aee8673f YARN-4827. Document configuration of ReservationSystem for FairScheduler. (Yufei Gu via Subru). 
(cherry picked from commit 3fae675383)
 2017-10-25 15:32:03 -07:00
Arun Suresh 774a575363 YARN-4687. Document Reservation ACLs (Contributed by Sean Po) 
(cherry picked from commit 2e1d0ff4e9)
 2017-10-25 15:29:32 -07:00
Carlo Curino fa86fdc3cc YARN-7339. LocalityMulticastAMRMProxyPolicy should handle cancel request properly. (Botong Huang via curino) 
Edited cherry-pick from 1c5c2b5dde
 2017-10-25 13:56:35 -07:00
Eric Yang f6d3c101a6 YARN-7353. Improved volume mount check for directories and unit test compatibility on RHEL7. Contributed by Eric Badger. 2017-10-24 17:01:08 -04:00
Inigo Goiri 89ad6adab3 YARN-3661. Basic Federation UI. Contributed by Inigo Goiri. 2017-10-24 13:55:13 -07:00
Robert Kanter 85eadec67b YARN-7385. TestFairScheduler#testUpdateDemand and TestFSLeafQueue#testUpdateDemand are failing with NPE (yufeigu via rkanter) 
(cherry picked from commit 03af442e76)
 2017-10-24 13:43:27 -07:00
Robert Kanter 1d34a4805e YARN-7382. NoSuchElementException in FairScheduler after failover causes RM crash (rkanter) 
(cherry picked from commit 025c656572)
 2017-10-24 10:29:36 -07:00
Daniel Templeton 08cfd010a3 YARN-7357. Several methods in TestZKRMStateStore.TestZKRMStateStoreTester.TestZKRMStateStoreInternal should have @Override annotations 
(Contributed by Sen Zhao via Daniel Templeton)

(cherry picked from commit 0553f5a012e14c8ceb40a16161440384f9f3a9a8)
(cherry picked from commit 9da9023371)
 2017-10-23 13:52:15 -07:00
Eric Payne ef0d6ff2e6 YARN-4163: Audit getQueueInfo and getApplications calls 
(cherry picked from commit 921338cd86)
 2017-10-23 11:58:04 -05:00
Subru Krishnan 9bd77a6d9d YARN-6871. Add additional deSelects params in RMWebServices#getAppReport. (Tanuj Nayak via Subru). 2017-10-20 17:19:29 -07:00
Yufei Gu 93d71d97d4 YARN-7355. TestDistributedShell should be scheduler agnostic. (Contributed by Haibo) 
(cherry picked from commit 6b7c87c945)
 2017-10-20 11:49:34 -07:00
Yufei Gu 378fa3ac7d YARN-7261. Add debug message for better download latency monitoring. (Yufei Gu) 
(cherry picked from commit 0799fde35e)
 2017-10-20 11:49:34 -07:00
Yufei Gu 4c4f28c9e7 YARN-4090. Make Collections.sort() more efficient by caching resource usage. (Contributed by Yufei Gu, Shilong Zhang and Xianyin Xin) 
(cherry picked from commit 1f4cdf1068)
(cherry picked from commit 96106b8f5f)
 2017-10-20 11:49:33 -07:00
Yufei Gu f462461d4e YARN-7359. TestAppManager.testQueueSubmitWithNoPermission() should be scheduler agnostic. (Contributed by Haibo Chen) 
(cherry picked from commit 7b4b018780)
 2017-10-20 11:22:28 -07:00
Yufei Gu 1000811bcb YARN-7294. TestSignalContainer#testSignalRequestDeliveryToNM fails intermittently with Fair Scheduler. (Contributed by Miklos Szegedi) 
(cherry picked from commit cbd2b73ef8)
 2017-10-20 11:22:28 -07:00
Wangda Tan 2f476f4b2c YARN-6623. Add support to turn off launching privileged containers in the container-executor. (Varun Vasudev via wangda) 2017-10-20 11:22:28 -07:00
Wangda Tan 6a3929f2b2 YARN-6608. Backport all SLS improvements from trunk to branch-2. (Carlo Curino via wangda) 2017-10-20 11:22:26 -07:00
Wangda Tan bc2326f5f0 YARN-7170. Improve bower dependencies for YARN UI v2. (Sunil G via wangda) 2017-10-19 22:20:36 -07:00
vrushali 28c54989d6 Ensuring right apis are called as per jetty version in branch2 (trunk has different jetty) 2017-10-19 22:18:17 -07:00
Wangda Tan 017ac560f0 YARN-7338. Support same origin policy for cross site scripting prevention. (Sunil G via wangda) 2017-10-19 21:48:11 -07:00
vrushali 3a5f1a6c26 Fixing checktyle warnings during rebase 2017-10-18 02:06:49 +05:30
Sunil G ec3fb45772 YARN-7022. Improve click interaction in queue topology in new YARN UI. Contributed by Abdullah Yousufi. 2017-10-18 02:06:49 +05:30
Sunil G da104a3e78 YARN-7075. Better styling for donut charts in new YARN UI. Contributed by Da Ding. 2017-10-18 02:06:49 +05:30
Sunil G 1cf7ed8a28 YARN-7071. Add vcores and number of containers in new YARN UI node heat map. Contributed by Abdullah Yousufi. 2017-10-18 02:06:49 +05:30
Sunil G 65b90e1e1c YARN-6386. Show decommissioning nodes in new YARN UI. Contributed by Elek Marton. 2017-10-18 02:06:49 +05:30
Sunil G 1a1f39c98c YARN-5146. Support for Fair Scheduler in new YARN UI. Contributed by Abdullah Yousufi. 2017-10-18 02:06:49 +05:30
Sunil G 1635741390 YARN-6631. Refactor loader.js in new Yarn UI. Contributed by Akhil P B. 2017-10-18 02:06:49 +05:30
vrushali 6232c3aef3 Updating dependencies to work on branch-2 2017-10-18 02:06:49 +05:30
Sunil G 3aa8111594 YARN-6458. Use yarn package manager to lock down dependency versions for new web UI. Contributed by Sreenath Somarajapuram. 2017-10-18 02:06:49 +05:30
Sunil G 9e4e218ff0 YARN-6635. Refactor yarn-app pages in new YARN UI. Contributed by Akhil PB. 2017-10-18 02:06:49 +05:30
Sunil G dd40f6f0cc YARN-5705. Show timeline data from ATS v2 in new web UI. Contributed by Akhil PB. 2017-10-18 02:06:49 +05:30
Sunil G 458ba54ea5 YARN-6291. Introduce query parameters (sort, filter, etc.) for tables to keep state on refresh/navigation in new YARN UI. Contributed by Gergely Novák. 2017-10-18 02:06:48 +05:30
Sunil G c069f4f937 YARN-6402. Move 'Long Running Services' to an independent tab at top level for new Yarn UI. Contributed by Akhil PB. 2017-10-18 02:06:48 +05:30
Sunil G bef6b2f030 YARN-5153. Add a toggle button to switch between timeline view / table view for containers and application-attempts in new YARN UI. Contributed by Akhil PB. 2017-10-18 02:06:48 +05:30
Sunil G deef8d5446 YARN-6258. localBaseAddress for CORS proxy configuration is not working when suffixed with forward slash in new YARN UI. Contributed by Gergely Novák. 2017-10-18 02:06:48 +05:30
Sunil G 16cc282725 YARN-5496. Make Node Heatmap Chart categories clickable in new YARN UI. Contributed by Gergely Novák. 2017-10-18 02:06:48 +05:30
Sunil G bbd98cb019 YARN-6196. Improve Resource Donut chart with better label in Node page of new YARN UI. Contributed by Akhil PB. 2017-10-18 02:06:48 +05:30
Sunil G 03511fdaf8 YARN-5335. Use em-table in app/nodes pages for new YARN UI. Contributed by Sunil G. 2017-10-18 02:06:48 +05:30
Sunil G 148c7b8689 YARN-6184. Introduce loading icon in each page of new YARN UI. Contributed by Akhil PB. 2017-10-18 02:06:48 +05:30
Sunil G 981ccd9d90 YARN-6183. Few missing informations in Application and Application Attempt pages for new YARN UI. Contributed by Akhil PB. 2017-10-18 02:06:48 +05:30
Sunil G 9071c712d9 YARN-5912. Fix breadcrumb issues for various pages in new YARN UI. Contributed by Akhil P B. 2017-10-18 02:06:48 +05:30
Sunil G 2c93e8ee13 YARN-5917. Make navigation link active when selecting sub tabs in 'Applications' and 'Nodes' page for new UI. Contributed by Kai Sasaki. 2017-10-18 02:06:48 +05:30
Sunil G 0d1a53ad8e YARN-5866. Fix few issues reported by jshint in new YARN UI. Contributed by Akhil P B. 2017-10-18 02:06:48 +05:30
Sunil G d5271b03d3 YARN-5650. Render Application Timeout value in web UI. Contributed by Akhil PB. 2017-10-18 02:06:48 +05:30
sunilg 011402e304 YARN-4849. Addendum patch to improve pom for yarn-ui. (Wangda Tan via Sunil G) 2017-10-18 02:06:48 +05:30
sunilg 4fba66c28e YARN-5785. [YARN-3368] Accessing applications and containers list from Node page is throwing few exceptions in console. (Akhil P B and Sreenath Somarajapuram via Sunil G) 2017-10-18 02:06:48 +05:30
Sreenath Somarajapuram 6c68032291 YARN-5779. [YARN-3368] Addendum patch to document limits/notes of the new YARN UI . (Sunil G via Sreenath Somarajapuram) 2017-10-18 02:06:48 +05:30
sunilg 9ebb57dfc8 YARN-5490. [YARN-3368] Fix various alignment issues and broken breadcrumb link in Node page. (Akhil P B Tan via Sunil G) 2017-10-18 02:06:48 +05:30
sunilg 36f5091d6c YARN-5497. [YARN-3368] Use different color for Undefined and Succeeded for Final State in applications page. (Akhil P B Tan via Sunil G) 2017-10-18 02:06:47 +05:30
sunilg 94c53e7985 YARN-5500. [YARN-3368] ‘Master node' link under application tab is broken. (Akhil P B Tan via Sunil G) 2017-10-18 02:06:47 +05:30
sunilg addc399e8b YARN-5772. [YARN-3368] Replace old Hadoop logo with new one (Akhil P B Tan via Sunil G) 2017-10-18 02:06:47 +05:30
sunilg 43f0627a8e YARN-5779. [YARN-3368] Document limits/notes of the new YARN UI (Wangda Tan via Sunil G) 2017-10-18 02:06:47 +05:30
sunilg 29fc43e5a4 YARN-5741. [YARN-3368] Update UI2 documentation for new UI2 path (Kai Sasaki and Wangda Tan via Sunil G) 2017-10-18 02:06:47 +05:30
Wangda Tan 7513315758 YARN-5145. [YARN-3368] Move new YARN UI configuration to HADOOP_CONF_DIR. (Sunil G and Kai Sasaki via wangda) 2017-10-18 02:06:47 +05:30
sunilg f1de967c67 YARN-4849. Addendum patch to remove unwanted files from rat exclusions. (Wangda Tan via Sunil G) 2017-10-18 02:06:47 +05:30
Wangda Tan c0c124c2bf YARN-5698. [YARN-3368] Launch new YARN UI under hadoop web app port. (Sunil G via wangda) 2017-10-18 02:06:47 +05:30
sunilg 8222307c30 YARN-5682. [YARN-3368] Fix maven build to keep all generated or downloaded files in target folder (Wangda Tan via Sunil G) 2017-10-18 02:06:47 +05:30