Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
16,948 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

3995 Commits

Author SHA1 Message Date
Eric Yang 107afed848 YARN-7353. Improved volume mount check for directories and unit test compatibility on RHEL7. Contributed by Eric Badger. 2017-10-24 16:59:17 -04:00
Yufei Gu 6e953eb6a3 YARN-7045. Remove FSLeafQueue#addAppSchedulable. (Contributed by Sen Zhao via Yufei Gu) 
(cherry picked from commit a92ef030a2)
 2017-10-24 13:52:02 -07:00
Robert Kanter c5eeb2e4ce YARN-7385. TestFairScheduler#testUpdateDemand and TestFSLeafQueue#testUpdateDemand are failing with NPE (yufeigu via rkanter) 
(cherry picked from commit 03af442e76)
 2017-10-24 13:40:06 -07:00
Carlo Curino 8b200ab395 YARN-7339. LocalityMulticastAMRMProxyPolicy should handle cancel request properly. (Botong Huang via curino) 
(cherry picked from commit 1c5c2b5dde)
 2017-10-24 10:53:08 -07:00
Robert Kanter 4bae02a97d YARN-7382. NoSuchElementException in FairScheduler after failover causes RM crash (rkanter) 
(cherry picked from commit 025c656572)
 2017-10-24 10:25:43 -07:00
Robert Kanter 61aba4f0c1 YARN-7320. Duplicate LiteralByteStrings in SystemCredentialsForAppsProto.credentialsForApp_ (misha@cloudera.com via rkanter) 
(cherry picked from commit 5da295a34e)
 2017-10-23 18:02:11 -07:00
Daniel Templeton 9da9023371 YARN-7357. Several methods in TestZKRMStateStore.TestZKRMStateStoreTester.TestZKRMStateStoreInternal should have @Override annotations 
(Contributed by Sen Zhao via Daniel Templeton)

(cherry picked from commit 0553f5a012e14c8ceb40a16161440384f9f3a9a8)
 2017-10-23 13:51:39 -07:00
Eric Payne 3f315a526b YARN-4163: Audit getQueueInfo and getApplications calls 
(cherry picked from commit 921338cd86)
 2017-10-23 11:48:41 -05:00
Sunil G 4b872e5e9f YARN-6871. Add additional deSelects params in RMWebServices#getAppReport. Contributed by Tanuj Nayak. 
(cherry picked from commit 8facf1f976)
 2017-10-20 17:20:39 -07:00
Yufei Gu d375645d50 YARN-7355. TestDistributedShell should be scheduler agnostic. (Contributed by Haibo) 
(cherry picked from commit 6b7c87c945)
 2017-10-20 11:17:05 -07:00
Yufei Gu 2a0ef092d3 YARN-7261. Add debug message for better download latency monitoring. (Yufei Gu) 
(cherry picked from commit 0799fde35e)
 2017-10-20 10:01:52 -07:00
Yufei Gu 96106b8f5f YARN-4090. Make Collections.sort() more efficient by caching resource usage. (Contributed by Yufei Gu, Shilong Zhang and Xianyin Xin) 
(cherry picked from commit 1f4cdf1068)
 2017-10-20 01:34:05 -07:00
Wangda Tan dc2ae3f20b YARN-7170. Improve bower dependencies for YARN UI v2. (Sunil G via wangda) 
(cherry picked from commit 4afd308b62)
 2017-10-19 21:59:28 -07:00
Yufei Gu b2f516118c YARN-7359. TestAppManager.testQueueSubmitWithNoPermission() should be scheduler agnostic. (Contributed by Haibo Chen) 
(cherry picked from commit 7b4b018780)
 2017-10-19 16:53:10 -07:00
Yufei Gu 288d2fc309 YARN-7294. TestSignalContainer#testSignalRequestDeliveryToNM fails intermittently with Fair Scheduler. (Contributed by Miklos Szegedi) 
(cherry picked from commit cbd2b73ef8)
 2017-10-19 16:40:36 -07:00
Wangda Tan 73cbc373e0 YARN-7345. GPU Isolation: Incorrect minor device numbers written to devices.deny file. (Jonathan Hung via wangda) 
(cherry picked from commit c1b08ba720)
 2017-10-19 14:51:22 -07:00
Wangda Tan 03fee4de9e YARN-7338. Support same origin policy for cross site scripting prevention. (Sunil G via wangda) 
(cherry picked from commit 298b174f66)
 2017-10-19 14:51:14 -07:00
Subru Krishnan 81a86860bf YARN-7311. Fix TestRMWebServicesReservation parametrization for fair scheduler. (Yufei Gu via Subru). 
(cherry picked from commit 75323394fb)
 2017-10-17 12:39:40 -07:00
Haibo Chen 5334deb089 YARN-7341. TestRouterWebServiceUtil#testMergeMetrics is flakey. (Robert Kanter via Haibo Chen) 
(cherry picked from commit acabc657ff)
 2017-10-17 10:26:02 -07:00
Robert Kanter 6971699099 YARN-7308. TestApplicationACLs fails with FairScheduler (rkanter) 
(cherry picked from commit 8a61525928)
 2017-10-16 15:34:50 -07:00
Nathan Roberts a809ce8f50 YARN-7333. container-executor fails to remove entries from a directory that is not writable or executable. Contributed by Jason Lowe. 
(cherry picked from commit 8620140a6a3ec0117675ede06d92d830da3da551)
 2017-10-16 16:41:42 -05:00
Junping Du 26da4045aa YARN-7124. LogAggregationTFileController deletes/renames while file is open. Contributed by Jason Lowe. 
(cherry picked from commit 1fcbe7cf5f)
 2017-10-16 13:57:41 -07:00
Arun Suresh 2fdffbd8c7 YARN-7275. NM Statestore cleanup for Container updates. (Kartheek Muthyala via asuresh) 
(cherry picked from commit a50be1b8f4)
 2017-10-16 13:23:58 -07:00
Wangda Tan 41e8ed7e98 Addendum fix for: YARN-7269. Tracking URL in the app state does not get redirected to ApplicationMaster for Running applications. (Wangda Tan) 
Change-Id: If1fe4a62e07b25e6f1b8ba803495da87e2cb2df6
(cherry picked from commit 87ea1dff9c)
 2017-10-14 10:45:12 -07:00
Haibo Chen 1134060678 YARN-7310. TestAMRMProxy#testAMRMProxyE2E fails with FairScheduler. (Robert Kanter via Haibo Chen) 
(cherry picked from commit 3fb4718886)
 2017-10-13 15:52:09 -07:00
Robert Kanter b7cef4e934 YARN-7309. TestClientRMService#testUpdateApplicationPriorityRequest and TestClientRMService#testUpdatePriorityAndKillAppWithZeroClusterResource test functionality not supported by FairScheduler (rkanter) 
(cherry picked from commit ec8bf9e48a)
 2017-10-13 13:57:40 -07:00
Yufei Gu dbf6c48af9 YARN-7270. Fix unsafe casting from long to int for class Resource and its sub-classes. (Yufei) 
(cherry picked from commit 7a27c2c367)
 2017-10-13 13:06:16 -07:00
Carlo Curino 97b7d39a5f YARN-7317. Fix overallocation resulted from ceiling in LocalityMulticastAMRMProxyPolicy. (contributed by Botong Huang via curino) 
(cherry picked from commit 13fcfb3d46)
 2017-10-12 10:40:44 -07:00
Jason Lowe 44f8b2a630 YARN-7082. TestContainerManagerSecurity failing in trunk. Contributed by Akira Ajisaka 
(cherry picked from commit ebb34c7053)
 2017-10-11 10:32:23 -05:00
Jonathan Hung 043a217017 YARN-7252. Removing queue then failing over results in exception 2017-10-09 14:54:57 -07:00
Jonathan Hung 168a3df8e6 YARN-7251. Misc changes to YARN-5734 2017-10-09 14:54:57 -07:00
Jonathan Hung d35f544020 YARN-7238. Documentation for API based scheduler configuration management 2017-10-09 14:54:56 -07:00
Jonathan Hung 5105bc4721 YARN-7046. Add closing logic to configuration store 2017-10-09 14:54:56 -07:00
Wangda Tan e6827a9121 YARN-6840. Implement zookeeper based store for scheduler configuration updates. (Jonathan Hung via wangda) 
Change-Id: I9debea674fe8c7e4109d4ca136965a1ea4c48bcc
 2017-10-09 14:54:56 -07:00
Xuan 4bf38062a5 YARN-7024: Fix issues on recovery in LevelDB store. Contributed by Jonathan Hung 2017-10-09 14:54:56 -07:00
Xuan 0b546420da YARN-6322: Disable queue refresh when configuration mutation is enabled. Contributed by Jonathan Hung 2017-10-09 14:54:55 -07:00
Xuan 793476e4b7 YARN-5947: Create LeveldbConfigurationStore class using Leveldb as backing store. Contributed by Jonathan Hung 2017-10-09 14:54:55 -07:00
Xuan 09b7c8766e YARN-5953 addendum: Move QueueConfigInfo and SchedConfUpdateInfo to package org.apache.hadoop.yarn.webapp.dao 2017-10-09 14:54:54 -07:00
Xuan e09f0d64ac YARN-5953:Create CLI for changing YARN configurations. (Jonathan Hung via xgong) 2017-10-09 14:54:54 -07:00
Xuan 3f29c1585b YARN-6575. Support global configuration mutation in MutableConfProvider. (Jonathan Hung via Xuan Gong) 2017-10-09 14:54:54 -07:00
Wangda Tan 5fd1668a27 YARN-5949. Add pluggable configuration ACL policy interface and implementation. (Jonathan Hung via wangda) 
Change-Id: Ib98e82ff753bede21fcab2e6ca9ec1e7a5a2008f
 2017-10-09 14:54:53 -07:00
Wangda Tan d1514bacd1 YARN-5952. Create REST API for changing YARN scheduler configurations. (Jonathan Hung via wangda) 2017-10-09 14:54:53 -07:00
Jonathan Hung 28754646e5 YARN-5948. Implement MutableConfigurationManager for handling storage into configuration store 2017-10-09 14:54:53 -07:00
Xuan c4c2feeccf YARN-5946: Create YarnConfigurationStore interface and 
InMemoryConfigurationStore class. Contributed by Jonathan Hung
 2017-10-09 14:54:52 -07:00
Jonathan Hung 72169a0281 YARN-5951. Changes to allow CapacityScheduler to use configuration store 2017-10-09 14:54:52 -07:00
Daniel Templeton bec03f7060 YARN-2612 addendum: fixed javadoc error. 
(cherry picked from commit 6d6ca4c923)
 2017-10-09 14:15:52 +02:00
Sunil G 84e2e2a6f6 YARN-7245. Max AM Resource column in Active Users Info section of Capacity Scheduler UI page should be updated per-user. Contributed by Eric Payne. 
(cherry picked from commit 8137254a1f)
 2017-10-09 14:40:44 +05:30
Yufei Gu 4cfc7d0af6 YARN-7207. Cache the RM proxy server address. (Yufei Gu) 
(cherry picked from commit 72d22b753a)

# Conflicts:
#	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMContext.java
#	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMContextImpl.java
 2017-10-06 10:03:48 -07:00
Yufei Gu 9bb9831347 YARN-2162. Add ability in Fair Scheduler to optionally configure maxResources in terms of percentage. (Yufei Gu) 2017-10-06 00:29:15 -07:00
Haibo Chen c021c8a19f YARN-7009. TestNMClient.testNMClientNoCleanupOnStop is flaky by design. (Miklos Szegedi via Haibo Chen) 
(cherry picked from commit c071aad5da)
 2017-10-05 15:51:08 -07:00