Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,814 Commits 326 Branches 371 Tags
Commit Graph

2802 Commits

Author SHA1 Message Date
Varun Vasudev
19d894538d YARN-5459. Add support for docker rm. Contributed by Shane Kumpf. 
(cherry picked from commit 08e33381f5342590a68c65504c79c296b40fe5af)
 2016-08-04 14:18:01 +05:30
Jason Lowe
65a91c8527 YARN-5469. Increase timeout of TestAmFilter.testFilter. Contributed by Eric Badger 
(cherry picked from commit db4a61dc617954cf448a0d44cb4ac79f2abf9db3)
 2016-08-03 19:53:28 +00:00
Jason Lowe
1ea03411c2 YARN-5462. TestNodeStatusUpdater.testNodeStatusUpdaterRetryAndNMShutdown fails intermittently. Contributed by Eric Badger 
(cherry picked from commit db646540f094077941b56ed681a4f3e5853f5b7f)
 2016-08-03 19:18:50 +00:00
Jason Lowe
9a0ac56a5c YARN-4280. CapacityScheduler reservations may not prevent indefinite postponement on a busy cluster. Contributed by Kuhu Shukla 
(cherry picked from commit 4d92aefd35d4517d9435d81bafdec0d77905a7a0)
 2016-08-03 19:00:06 +00:00
Varun Vasudev
1087745d79 YARN-5460. Change container runtime type logging in DelegatingLinuxContainerRuntime to debug. Contributed by Shane Kumpf. 
(cherry picked from commit d848184e905d70835293ceac7a01b5a0ca21cc0a)
 2016-08-03 12:03:31 +05:30
Junping Du
7e213844a7 YARN-5226. Remove AHS enable check from LogsCLI#fetchAMContainerLogs. Contributed by Xuan Gong. 
(cherry picked from commit 3818393297c7b337e380e8111a55f2ac4745cb83)
 2016-08-02 10:42:31 -07:00
Varun Vasudev
b63e6c8027 YARN-5458. Rename DockerStopCommandTest to TestDockerStopCommand. Contributed by Shane Kumpf. 
(cherry picked from commit 7fc70c6422da3602ad9d4364493f25454a1de50c)
 2016-08-02 17:02:17 +05:30
Varun Vasudev
4e5409a2bb YARN-5443. Add support for docker inspect command. Contributed by Shane Kumpf. 
(cherry picked from commit 2e7c2a13a853b8195bc4f51f6c3c1f61656c2b33)
 2016-08-02 17:01:59 +05:30
Varun Vasudev
7ecb1635b4 YARN-5444. Fix failing unit tests in TestLinuxContainerExecutorWithMocks. Contributed by Yufei Gu. 
(cherry picked from commit 4455aa7c86a36b6e017e288479a7d4ced889faa0)
 2016-08-01 16:01:10 +05:30
Arun Suresh
f197378f81 YARN-5113. Refactoring and other clean-up for distributed scheduling. (Konstantinos Karanasos via asuresh) 
(cherry picked from commit e5766b1dbee02ae0ef89618e172f3fb227af19e8)
 2016-07-31 11:49:09 -07:00
Junping Du
47dd871f96 YARN-5434. Add -client|server argument for graceful decommmission. Contributed by Robert Kanter. 
(cherry picked from commit 95f2b9859718eca12fb3167775cdd2dad25dde25)
 2016-07-29 10:27:11 -07:00
Li Lu
0b5d96abb5 YARN-5436. Race in AsyncDispatcher can cause random test failures in Tez (probably YARN also). (Zhiyuan Yang via gtcarrera9) 
(cherry picked from commit 7086fc72eebc41fd174d91839ed703c014aac920)
 2016-07-28 16:52:21 -07:00
Subru Krishnan
2f4df2b851 YARN-5203.Return ResourceRequest JAXB object in ResourceManager Cluster Applications REST API. Contributed by Ellen Hui. 
(cherry picked from commit 4e756d72719ec3c6d64a1e3daccbc0b8e8de998c)
 2016-07-28 16:04:30 -07:00
Jason Lowe
2f854b8386 YARN-5438. TimelineClientImpl leaking FileSystem Instances causing Long running services like HiverServer2 daemon going OOM. Contributed by Rohith Sharma K S 
(cherry picked from commit a1890c32c52fed69ec09efad0fccf49ed8c2e21e)
 2016-07-28 21:48:40 +00:00
Li Lu
310245063b YARN-5440. Use AHSClient in YarnClient when TimelineServer is running. (Xuan Gong via gtcarrera9) 
(cherry picked from commit 26de4f0de789f58736d1dc383125cffb54debdd0)
 2016-07-28 10:25:55 -07:00
Junping Du
932bf79244 YARN-5432. Lock already held by another process while LevelDB cache store creation for dag. Contributed by Li Lu. 
(cherry picked from commit 7f3c306e2ed9e865171324898decb9b587d90e73)
 2016-07-28 06:36:31 -07:00
Subru Krishnan
4ecfd05095 YARN-5441. Fixing minor Scheduler test case failures 
(cherry picked from commit d2cbfd7de33fde526089a395550deafb4628fc6f)
 2016-07-27 18:26:29 -07:00
Wangda Tan
77e0b6d1bf YARN-5195. RM intermittently crashed with NPE while handling APP_ATTEMPT_REMOVED event when async-scheduling enabled in CapacityScheduler. (sandflee via wangda) 
(cherry picked from commit d62e121ffc0239e7feccc1e23ece92c5fac685f6)
 2016-07-26 21:36:37 -07:00
Wangda Tan
55fa19d576 YARN-5342. Improve non-exclusive node partition resource allocation in Capacity Scheduler. (Sunil G via wangda) 
(cherry picked from commit 49969b16cdba0f251b9f8bf3d8df9906e38b5c61)
 2016-07-26 21:16:12 -07:00
Arun Suresh
0f6ff20652 YARN-5351. ResourceRequest should take ExecutionType into account during comparison. (Konstantinos Karanasos via asuresh) 
(cherry picked from commit 2d8d183b1992b82c4d8dd3d6b41a1964685d909e)
 2016-07-26 19:09:22 -07:00
Arun Suresh
df509a8066 YARN-5392. Replace use of Priority in the Scheduling infrastructure with an opaque ShedulerRequestKey. (asuresh and subru) 
(cherry picked from commit 5aace38b748ba71aaadd2c4d64eba8dc1f816828)
 2016-07-26 14:58:54 -07:00
mattf-horton
ea10e1384f HADOOP-13382. Remove unneeded commons-httpclient dependencies from POM files in Hadoop and sub-projects, while adding it in to the only place it is still needed, hadoop-openstack. Contributed by Matt Foley. 2016-07-21 15:58:05 -07:00
Rohith Sharma K S
eff65463de YARN-5092. TestRMDelegationTokens fails intermittently. Contributed by Jason Lowe. 
(cherry picked from commit 557a245d83c358211f51b3ab1950d707a70679d9)
 2016-07-21 12:49:06 +05:30
Rohith Sharma K S
d9ed29e8c6 YARN-1126. Add validation of users input nodes-states options to nodes CLI. Contributed by Wei Yan. 
(cherry picked from commit be34b2a8fd30a1a0e803ac8b2198c695600a9e46)
 2016-07-21 12:22:34 +05:30
Akira Ajisaka
2bf5c4eb1a YARN-4883. Make consistent operation name in AdminService. Contributed by Kai Sasaki. 
(cherry picked from commit c63afdbe14df7359841aa4b213252a8a275e8c4b)
 2016-07-20 16:51:44 -07:00
Vinod Kumar Vavilapalli
5641c28c1c YARN-5340. Fixed a race condition in RollingLevelDBTimelineStore that caused loss of Timeline events. Contributed by Li Lu. 
(cherry picked from commit 1c9d2ab503ea5a3f16757351af9603041059b390)
 2016-07-20 08:38:56 -07:00
Varun Vasudev
9e326f4eeb YARN-5309. Fix SSLFactory truststore reloader thread leak in TimelineClientImpl. Contributed by Weiwei Yang. 
(cherry picked from commit 9ccf935b2cba5ac8a3e8124360d2203931397391)

 Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/client/api/impl/TimelineClientImpl.java
 2016-07-20 12:55:38 +05:30
Arun Suresh
586cd0daa1 YARN-5350. Distributed Scheduling: Ensure sort order of allocatable nodes returned by the RM is not lost. (asuresh) 
(cherry picked from commit 8fbe6ece24e38ee24fee0abdbed5f7dc5d3c16da)
 2016-07-19 23:22:47 -07:00
Junping Du
ad8180fc6c YARN-5213. Fix a bug in LogCLIHelpers which cause TestLogsCLI#testFetchApplictionLogs fails intermittently. Contributed by Xuan Gong. 
(cherry picked from commit dc2f4b6ac8a6f8848457046cf9e1362d8f48495d)
 2016-07-19 07:19:17 -07:00
Varun Saxena
2153c9f04c YARN-4996. Make TestNMReconnect.testCompareRMNodeAfterReconnect() scheduler agnostic (Kai Sasaki via Varun Saxena) 2016-07-19 16:07:56 +05:30
Ray Chiang
66a501be5e YARN-5272. Handle queue names consistently in FairScheduler. (Wilfred Spiegelenburg via rchiang) 
(cherry picked from commit 2df1b1e72b18422606e38a9fbe311988637cb9a5)
 2016-07-15 14:39:28 -07:00
Arun Suresh
9d31c0b53f YARN-5181. ClusterNodeTracker: add method to get list of nodes matching a specific resourceName. (kasha via asuresh) 
(cherry picked from commit e905a42a2c6c88210b5c2120d7daf0bb3739cd1d)
 2016-07-15 14:38:26 -07:00
Wangda Tan
e34e1aa4fe YARN-4484. Available Resource calculation for a queue is not correct when used with labels. (Sunil G via wangda) 
(cherry picked from commit 24db9167f16ba643a186624b33a6b9b80020f476)
 2016-07-15 11:41:35 -07:00
Varun Saxena
8b0337b499 YARN-5383. Fix findbugs and checkstyle issues in ContainerExecutor. (Vrushali C via Varun Saxena) 2016-07-15 23:30:36 +05:30
Junping Du
e3bc4faa96 YARN-5339. Passing file to -out for YARN log CLI doesnt give warning or error code. Contributed by Xuan Gong. 
(cherry picked from commit 7e5355c14e55fd6540f7f070df4b78fa94a81618)
 2016-07-15 09:24:03 -07:00
Akira Ajisaka
6664077727 YARN-5159. Wrong Javadoc tag in MiniYarnCluster. Contributed by Andras Bokor. 
(cherry picked from commit 6cf017558a3d06240b95d1b56c953591ece97c92)
 2016-07-14 10:45:39 -07:00
Xuan
58088d27e6 YARN-5363. For AM containers, or for containers of running-apps, "yarn logs" incorrectly only (tries to) shows syslog file-type by default. (Contributed by Vinod Kumar Vavilapalli) 
(cherry picked from commit 429347289c7787364e654334cd84115ae40bb22d)
 2016-07-14 10:21:55 -07:00
Varun Vasudev
d5d68d98c6 YARN-5303. Clean up ContainerExecutor JavaDoc. Contributed by Daniel Templeton. 
(cherry picked from commit 54bf14f80bcb2cafd1d30b77f2e02cd40b9515d9)
 2016-07-14 19:32:09 +05:30
Varun Vasudev
b4124c6a5a YARN-4759. Fix signal handling for docker containers. Contributed by Shane Kumpf. 
(cherry picked from commit e5e558b0a34968eaffdd243ce605ef26346c5e85)
 2016-07-14 19:32:00 +05:30
Varun Vasudev
abfaf0e0e7 YARN-5298. Mount usercache and NM filecache directories into Docker container. Contributed by Sidharta Seethana. 
(cherry-picked from commit 58e18508018081b5b5aa7c12cc5af386146cd26b)
 2016-07-14 16:48:22 +05:30
Rohith Sharma K S
356c09a509 YARN-5299. Log Docker run command when container fails. Contributed by Varun Vasudev. 
(cherry picked from commit dbe97aa768e2987209811c407969fea47641418c)
 2016-07-14 11:49:48 +05:30
Vinod Kumar Vavilapalli
cbd2970be7 YARN-5339. Fixed "yarn logs" to fail when a file is passed to -out option instead of a directory. Contributed by Xuan Gong. 
(cherry picked from commit d18050522c5c6bd9e32eb9a1be4ffe2288624c40)
 2016-07-13 14:55:44 -07:00
Vinod Kumar Vavilapalli
4a6cef8c91 YARN-5200. Enhanced "yarn logs" to be able to get a list of containers whose logs are aggregated via a "show_container_log_info" option. Contributed by Xuan Gong. 
(cherry picked from commit eb471632349deac4b62f8dec853c8ceb64c9617a)
 2016-07-13 10:55:18 -07:00
Rohith Sharma K S
694b4abbc0 YARN-5362. TestRMRestart#testFinishedAppRemovalAfterRMRestart can fail. Contributed by sandflee. 
(cherry picked from commit d6d41e820ac7b3ba73f5e4ea1ee72715dc1ffc9f)
 2016-07-13 19:15:41 +05:30
Varun Saxena
dc3e077301 YARN-5353. ResourceManager can leak delegation tokens when they are shared across apps. (Jason Lowe via Varun Saxena). 2016-07-13 07:46:00 +05:30
Robert Kanter
7aaf82d469 YARN-4366. Fix Lint Warnings in YARN Common (templedf via rkanter) 
(cherry picked from commit bf6f4a3b980a07d0b268eeb984a649a362877734)
 2016-07-12 15:13:00 -07:00
Jason Lowe
1f96baf4ad YARN-5317. testAMRestartNotLostContainerCompleteMsg may fail. Contributed by sandflee 
(cherry picked from commit 10b704c5946afe7bfd4a6be40192ce7ca745d817)
 2016-07-12 20:38:26 +00:00
Junping Du
54812841e2 New addendum to YARN-5080. Cannot obtain logs using YARN CLI -am for either KILLED or RUNNING AM. 
(cherry picked from commit 7705812c7e3a9f3f774130e25443fda249c08c9c)
 2016-07-12 08:32:26 -07:00
Jian He
e94e6be772 YARN-5270. Solve miscellaneous issues caused by YARN-4844. Contributed by Wangda Tan 2016-07-11 22:37:52 -07:00
Varun Saxena
5ef27b65b9 YARN-5037. Fix random failure of TestRMRestart#testQueueMetricsOnRMRestart (sandflee via Varun Saxena). 2016-07-10 22:13:53 +05:30