Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
16,995 Commits 326 Branches 371 Tags
Commit Graph

4017 Commits

Author SHA1 Message Date
Arun Suresh
92ca475fdc YARN-4829. Add support for binary units in Resource class.(vvasudev via asuresh) 
(cherry picked from commit 7ba698997b6845b664b2f8c82e384b457c30d176)
 2017-10-31 15:06:16 -07:00
Varun Vasudev
f1f9b83e4c YARN-4715. Add support to read resource types from a config file. Contributed by Varun Vasudev. 
(cherry picked from commit ceb12c59a34677518a198e19acb4e29cdfc8a0e1)
 2017-10-31 15:06:15 -07:00
Wangda Tan
33fabe1e10 YARN-4172. Extend DominantResourceCalculator to account for all resources. (Varun Vasudev via wangda) 
(cherry picked from commit 32c91223f1bd06561ea4ce2d1944e8d9a847f18c)
 2017-10-31 15:06:15 -07:00
Wangda Tan
68da5218b7 YARN-4081. Add support for multiple resource types in the Resource class. (Varun Vasudev via wangda) 
(cherry picked from commit 1bbab7c1570a2438b2fa6da70397dd1d5211a137)
 2017-10-31 15:06:15 -07:00
Carlo Curino
1fbc72704e YARN-3661. Basic Federation UI. (Contributed by Inigo Goiri via curino) 
(cherry picked from commit ceca9694f9a0c78d07cab2c382036f175183e67b)
 2017-10-31 13:42:36 -07:00
Haibo Chen
e785e83270 YARN-7389. Make TestResourceManager Scheduler agnostic. (Robert Kanter via Haibo Chen) 
(cherry picked from commit d7f3737f3b3236fbf8c25fdd4656251ed63a2be9)
 2017-10-31 13:41:44 -07:00
Subru Krishnan
0d9503d6b5 YARN-6413. FileSystem based Yarn Registry implementation. (Ellen Hui via Subru). 
(cherry picked from commit ed24da3dd73c137b44235e525112056ace6d3843)
 2017-10-31 12:08:32 -07:00
Akira Ajisaka
da6ab7727c
YARN-7379. Moving logging APIs over to slf4j in hadoop-yarn-client. Contributed by Yeliang Cang. 
(cherry picked from commit c02d2ba50db8a355ea03081c3984b2ea0c375a3f)
 2017-10-31 17:11:18 +09:00
Akira Ajisaka
6bbfa158d7
YARN-7407. Moving logging APIs over to slf4j in hadoop-yarn-applications. Contributed by Yeliang Cang. 
(cherry picked from commit 785f1b0d11a3bf0af9851c080ff0acc34539f17b)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/Client.java
 2017-10-31 16:45:12 +09:00
Junping Du
b9a4bf0c46 HADOOP-14990. Clean up jdiff xml files added for 2.8.2 release. 
(cherry picked from commit a8083aaa6f4bcc7287f2b65018a946a840123c50)
 2017-10-30 15:28:58 -07:00
Yufei Gu
d9f027adbc YARN-6747. TestFSAppStarvation.testPreemptionEnable fails intermittently. (Contributed by Miklos Szegedi) 
(cherry picked from commit d4811c8cfae02f42a7aae1f775e87b6726caa3c9)
 2017-10-29 16:48:07 -07:00
Arun Suresh
6b4319cc50 YARN-7299. Fix TestDistributedScheduler. (asuresh) 
(cherry picked from commit 9c5c68745ed18883ce8bdbdca379025b23f17f60)
 2017-10-27 23:15:37 -07:00
Arun Suresh
b30eb17c75 YARN-7178. Add documentation for Container Update API. (asuresh) 
(cherry picked from commit 24f8c5cce3adb88e5af84b3e48c4c447ac91e6d3)
 2017-10-27 22:58:34 -07:00
Jason Lowe
00345eed50 YARN-7244. ShuffleHandler is not aware of disks that are added. Contributed by Kuhu Shukla 
(cherry picked from commit 665bb147aa3fc198e53335931562dd69f9f0e345)
 2017-10-27 17:00:31 -05:00
Rohith Sharma K S
d9b636f2f4 YARN-7289. Application lifetime does not work with FairScheduler. Contributed by Miklos Szegedi. 
(cherry picked from commit 5c799ecf09617f634c41bba26d341b2ad45ee852)
 2017-10-27 23:14:55 +05:30
Sunil G
e084d43550 YARN-7375. Possible NPE in RMWebapp when HA is enabled and the active RM fails. Contributed by Chandni Singh. 
(cherry picked from commit 792388e1c0ebaeb01db194412e30c08c0144b77c)
 2017-10-27 20:54:58 +05:30
Junping Du
ce10c1ef05 Add several jdiff xml files for 2.8.2 release. 
(cherry picked from commit a25b5aa0cf5189247fa38e7b0a188d568eba1b6c)
 2017-10-26 23:18:50 -07:00
Robert Kanter
aa65f6c1ad YARN-7262. Add a hierarchy into the ZKRMStateStore for delegation token znodes to prevent jute buffer overflow (rkanter) 
(cherry picked from commit b1de78619f3e5e25d6f9d5eaf41925f22d212fb9)
 2017-10-26 17:47:51 -07:00
Robert Kanter
cd9078df68 YARN-7320. Duplicate LiteralByteStrings in SystemCredentialsForAppsProto.credentialsForApp_ Addendum (misha@cloudera.com via rkanter) 
(cherry picked from commit 088ffee7165d0e2e4fb9af7fb8f33626b0ed8ed3)
 2017-10-26 15:55:23 -07:00
Subru Krishnan
9665971a65 YARN-5516. Add REST API for supporting recurring reservations. (Sean Po via Subru). 
(cherry picked from commit 25932da6d1ee56299c8f9911576a42792c435407)
 2017-10-26 12:11:08 -07:00
Robert Kanter
d92dddaf7c YARN-7358. TestZKConfigurationStore and TestLeveldbConfigurationStore should explicitly set capacity scheduler (haibochen via rkanter) 
(cherry picked from commit 2da654e34a436aae266c1fbdec5c1067da8d854e)
 2017-10-26 10:45:23 -07:00
Subru Krishnan
926b188871 YARN-4827. Document configuration of ReservationSystem for FairScheduler. (Yufei Gu via Subru). 
(cherry picked from commit 3fae675383489129b3ca3c66683a1215d0c6edf0)
 2017-10-25 15:08:19 -07:00
Eric Yang
107afed848 YARN-7353. Improved volume mount check for directories and unit test compatibility on RHEL7. Contributed by Eric Badger. 2017-10-24 16:59:17 -04:00
Yufei Gu
6e953eb6a3 YARN-7045. Remove FSLeafQueue#addAppSchedulable. (Contributed by Sen Zhao via Yufei Gu) 
(cherry picked from commit a92ef030a2707182e90acee644e47c8ef7e1fd8d)
 2017-10-24 13:52:02 -07:00
Robert Kanter
c5eeb2e4ce YARN-7385. TestFairScheduler#testUpdateDemand and TestFSLeafQueue#testUpdateDemand are failing with NPE (yufeigu via rkanter) 
(cherry picked from commit 03af442e7608db2f8e6eb85a15aa0ba42781edab)
 2017-10-24 13:40:06 -07:00
Carlo Curino
8b200ab395 YARN-7339. LocalityMulticastAMRMProxyPolicy should handle cancel request properly. (Botong Huang via curino) 
(cherry picked from commit 1c5c2b5dde6f2cffc587ca8f79a18828e1b1faf9)
 2017-10-24 10:53:08 -07:00
Robert Kanter
4bae02a97d YARN-7382. NoSuchElementException in FairScheduler after failover causes RM crash (rkanter) 
(cherry picked from commit 025c6565725c1819566377632753e8b9055617a6)
 2017-10-24 10:25:43 -07:00
Robert Kanter
61aba4f0c1 YARN-7320. Duplicate LiteralByteStrings in SystemCredentialsForAppsProto.credentialsForApp_ (misha@cloudera.com via rkanter) 
(cherry picked from commit 5da295a34e39b507e8291073782e0576cd06896a)
 2017-10-23 18:02:11 -07:00
Daniel Templeton
9da9023371 YARN-7357. Several methods in TestZKRMStateStore.TestZKRMStateStoreTester.TestZKRMStateStoreInternal should have @Override annotations 
(Contributed by Sen Zhao via Daniel Templeton)

(cherry picked from commit 0553f5a012e14c8ceb40a16161440384f9f3a9a8)
 2017-10-23 13:51:39 -07:00
Eric Payne
3f315a526b YARN-4163: Audit getQueueInfo and getApplications calls 
(cherry picked from commit 921338cd86e7215b0c4b1efdf2daf9449fb12c7b)
 2017-10-23 11:48:41 -05:00
Sunil G
4b872e5e9f YARN-6871. Add additional deSelects params in RMWebServices#getAppReport. Contributed by Tanuj Nayak. 
(cherry picked from commit 8facf1f976d7e12a846f12baabf54be1b7a49f9d)
 2017-10-20 17:20:39 -07:00
Yufei Gu
d375645d50 YARN-7355. TestDistributedShell should be scheduler agnostic. (Contributed by Haibo) 
(cherry picked from commit 6b7c87c94592606966a4229313b3d0da48f16158)
 2017-10-20 11:17:05 -07:00
Yufei Gu
2a0ef092d3 YARN-7261. Add debug message for better download latency monitoring. (Yufei Gu) 
(cherry picked from commit 0799fde35e7f3b9e8a85284ac0b30f6bdcbffad1)
 2017-10-20 10:01:52 -07:00
Yufei Gu
96106b8f5f YARN-4090. Make Collections.sort() more efficient by caching resource usage. (Contributed by Yufei Gu, Shilong Zhang and Xianyin Xin) 
(cherry picked from commit 1f4cdf10681b6903207a63fb5c306c9665ed9464)
 2017-10-20 01:34:05 -07:00
Wangda Tan
dc2ae3f20b YARN-7170. Improve bower dependencies for YARN UI v2. (Sunil G via wangda) 
(cherry picked from commit 4afd308b62d2335f31064c05bfefaf2294d874b0)
 2017-10-19 21:59:28 -07:00
Yufei Gu
b2f516118c YARN-7359. TestAppManager.testQueueSubmitWithNoPermission() should be scheduler agnostic. (Contributed by Haibo Chen) 
(cherry picked from commit 7b4b0187806601e33f5a88d48991e7c12ee4419f)
 2017-10-19 16:53:10 -07:00
Yufei Gu
288d2fc309 YARN-7294. TestSignalContainer#testSignalRequestDeliveryToNM fails intermittently with Fair Scheduler. (Contributed by Miklos Szegedi) 
(cherry picked from commit cbd2b73ef81a7e275c5d4f842cac5b81ff2f8c84)
 2017-10-19 16:40:36 -07:00
Wangda Tan
73cbc373e0 YARN-7345. GPU Isolation: Incorrect minor device numbers written to devices.deny file. (Jonathan Hung via wangda) 
(cherry picked from commit c1b08ba720486e74461f0ec94a204c1ba4014c06)
 2017-10-19 14:51:22 -07:00
Wangda Tan
03fee4de9e YARN-7338. Support same origin policy for cross site scripting prevention. (Sunil G via wangda) 
(cherry picked from commit 298b174f663a06e67098f7b5cd645769c1a98a80)
 2017-10-19 14:51:14 -07:00
Subru Krishnan
81a86860bf YARN-7311. Fix TestRMWebServicesReservation parametrization for fair scheduler. (Yufei Gu via Subru). 
(cherry picked from commit 75323394fbc4211596a2c8fbb5e584f3183f742f)
 2017-10-17 12:39:40 -07:00
Haibo Chen
5334deb089 YARN-7341. TestRouterWebServiceUtil#testMergeMetrics is flakey. (Robert Kanter via Haibo Chen) 
(cherry picked from commit acabc657ff5433f36ce1b238cecd3a3b5bbe87ae)
 2017-10-17 10:26:02 -07:00
Robert Kanter
6971699099 YARN-7308. TestApplicationACLs fails with FairScheduler (rkanter) 
(cherry picked from commit 8a615259281511de639c1f9aa719a842e34a523f)
 2017-10-16 15:34:50 -07:00
Nathan Roberts
a809ce8f50 YARN-7333. container-executor fails to remove entries from a directory that is not writable or executable. Contributed by Jason Lowe. 
(cherry picked from commit 8620140a6a3ec0117675ede06d92d830da3da551)
 2017-10-16 16:41:42 -05:00
Junping Du
26da4045aa YARN-7124. LogAggregationTFileController deletes/renames while file is open. Contributed by Jason Lowe. 
(cherry picked from commit 1fcbe7cf5f2f7c609cd4158912f151848268ca9e)
 2017-10-16 13:57:41 -07:00
Arun Suresh
2fdffbd8c7 YARN-7275. NM Statestore cleanup for Container updates. (Kartheek Muthyala via asuresh) 
(cherry picked from commit a50be1b8f432f50c940b66d12c7de87b95ea47c0)
 2017-10-16 13:23:58 -07:00
Wangda Tan
41e8ed7e98 Addendum fix for: YARN-7269. Tracking URL in the app state does not get redirected to ApplicationMaster for Running applications. (Wangda Tan) 
Change-Id: If1fe4a62e07b25e6f1b8ba803495da87e2cb2df6
(cherry picked from commit 87ea1dff9c431fb88e064e497b35fc17c65f1d53)
 2017-10-14 10:45:12 -07:00
Haibo Chen
1134060678 YARN-7310. TestAMRMProxy#testAMRMProxyE2E fails with FairScheduler. (Robert Kanter via Haibo Chen) 
(cherry picked from commit 3fb47188867124bf18fb798b460928b3557ab9a1)
 2017-10-13 15:52:09 -07:00
Robert Kanter
b7cef4e934 YARN-7309. TestClientRMService#testUpdateApplicationPriorityRequest and TestClientRMService#testUpdatePriorityAndKillAppWithZeroClusterResource test functionality not supported by FairScheduler (rkanter) 
(cherry picked from commit ec8bf9e48ac4dc675516a57c06a29890b5138548)
 2017-10-13 13:57:40 -07:00
Yufei Gu
dbf6c48af9 YARN-7270. Fix unsafe casting from long to int for class Resource and its sub-classes. (Yufei) 
(cherry picked from commit 7a27c2c367518e1bf6ee393391a2f9b412113819)
 2017-10-13 13:06:16 -07:00
Carlo Curino
97b7d39a5f YARN-7317. Fix overallocation resulted from ceiling in LocalityMulticastAMRMProxyPolicy. (contributed by Botong Huang via curino) 
(cherry picked from commit 13fcfb3d46ee7a0d606b4bb221d1cd66ef2a5a7c)
 2017-10-12 10:40:44 -07:00