Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,817 Commits 326 Branches 371 Tags
Commit Graph

2283 Commits

Author SHA1 Message Date
Jason Lowe
b12f16ab73 YARN-4594. container-executor fails to remove directory tree when chmod required. Contributed by Colin Patrick McCabe 
(cherry picked from commit fa328e2d39eda1c479389b99a5c121e640a1e0ad)
 2016-02-03 17:22:12 +00:00
Varun Vasudev
e211ab777e YARN-4625. Make ApplicationSubmissionContext and ApplicationSubmissionContextInfo more consistent. Contributed by Xuan Gong. 
(cherry picked from commit 1adb64e09bd453f97e83d31b1587079e30b4b274)
 2016-02-03 16:28:31 +05:30
Devaraj K
43131af1e2 YARN-4100. Add Documentation for Distributed and Delegated-Centralized 
Node Labels feature. Contributed by Naganarasimha G R.

(cherry picked from commit db144eb1c51c1f37bdd1e0c18e9a5b0969c82e33)
 2016-02-02 12:07:49 +05:30
Varun Vasudev
bbda446889 YARN-4649. Add additional logging to some NM state store operations. Contributed by Sidharta Seethana 
(cherry picked from commit 1cd55e0c171f7c4dec6f843931285557d59cd5ea)
 2016-02-02 09:26:22 +05:30
Wangda Tan
9591363ad8 YARN-4340. Add list API to reservation system. (Sean Po via wangda) 
(cherry picked from commit 9875325d5c63f343809907d06bf48a298035a611)
 2016-02-02 10:19:19 +08:00
Jason Lowe
36aae8050e YARN-3102. Decommisioned Nodes not listed in Web UI. Contributed by Kuhu Shukla 
(cherry picked from commit ed55950164a66e08fa34e30dba1030c5a986d1f1)
 2016-02-01 23:16:18 +00:00
Rohith Sharma K S
676f215595 YARN-4615. Fix random test failure in TestAbstractYarnScheduler#testResourceRequestRecoveryToTheRightAppAttempt. (Sunil G via rohithsharmaks) 
(cherry picked from commit 2673cbaf556eb4d0e44519cdbb8c6f0f02412a21)
 2016-02-01 10:45:05 +05:30
Jason Lowe
016c685135 YARN-4428. Redirect RM page to AHS page when AHS turned on and RM page is not available. Contributed by Chang Li 
(cherry picked from commit 772ea7b41b06beaa1f4ac4fa86eac8d6e6c8cd36)
 2016-01-29 21:54:56 +00:00
Jian He
885c76d85f YARN-4617. LeafQueue#pendingOrderingPolicy should always use fixed ordering policy instead of using same as active applications ordering policy. Contributed by Rohith Sharma K S 2016-01-29 12:22:44 -08:00
Karthik Kambatla
9d1371d390 YARN-4647. Make RegisterNodeManagerRequestPBImpl thread-safe. (kasha) 
(cherry picked from commit c9a09d6926b258e205a4ff7998ce5a86bf5dbe3b)
 2016-01-29 08:19:34 -08:00
Devaraj K
123269c07f YARN-4411. RMAppAttemptImpl#createApplicationAttemptReport throws 
IllegalArgumentException. Contributed by Bibin A Chundatt and yarntime.

(cherry picked from commit a277bdc9edc66bef419fcd063b832073e512f234)
 2016-01-29 13:52:47 +05:30
Rohith Sharma K S
b8d5df06f2 YARN-4543. Fix random test failure in TestNodeStatusUpdater.testStopReentrant. (Akihiro Suda via rohithsharmaks) 
(cherry picked from commit ac686668031ee9837deed3f3566f09f33c437870)
 2016-01-29 12:30:53 +05:30
Rohith Sharma K S
0466743afb YARN-4219. addendum patch to fix javadoc errors 
(cherry picked from commit 09d831c95ba18e2892cddd749f6e06f112dda7f5)
 2016-01-29 11:53:06 +05:30
Jian He
36f0e73882 YARN-4519. Potential deadlock of CapacityScheduler between decrease container and assign containers. Contributed by Meng Ding 2016-01-28 14:52:00 -08:00
Xuan
2f00d8d3a7 YARN-4219. New levelDB cache storage for timeline v1.5. Contributed by 
Li Lu

(cherry picked from commit 9fab22b36673e7f1a0bb629d2c07966ac2482e99)
 2016-01-28 14:36:58 -08:00
Jason Lowe
29195c7668 YARN-4643. Container recovery is broken with delegating container runtime. Contributed by Sidharta Seethana 
(cherry picked from commit 61382ff8fabc76b3a51f227646573cdf367fea1a)
 2016-01-28 19:00:51 +00:00
Rohith Sharma K S
6947a5d4be YARN-4633. Fix random test failure in TestRMRestart#testRMRestartAfterPreemption. (Bibin A Chundatt via rohithsharmaks) 
(cherry picked from commit ef343be82b4268ebd52f6a11e1a1ce53a5d232a9)
 2016-01-28 21:55:12 +05:30
Karthik Kambatla
c25154576b YARN-4462. FairScheduler: Disallow preemption from a queue. (Tao Jie via kasha) 
(cherry picked from commit fb238d7e5dcd96466c8938b13ca7f13cedecb08a)
 2016-01-27 12:29:25 -08:00
Rohith Sharma K S
0b8767e01a YARN-4573. Fix test failure in TestRMAppTransitions#testAppRunningKill and testAppKilledKilled. (Takashi Ohnishi via rohithsharmaks) 
(cherry picked from commit c01bee010832ca31d8e60e5461181cdf05140602)
 2016-01-27 08:24:37 +05:30
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
47b20d0c74 YARN-3542. Refactored existing CPU cgroups support to use the newer and integrated ResourceHandler mechanism, and also deprecated the old LCEResourceHandler inteface hierarchy. Contributed by Varun Vasudev. 
(cherry picked from commit 2085e60a9655b59aa2ba8917acdc511ab71ff6e4)
 2016-01-25 16:22:47 -08:00
Jian He
2d236c9de2 YARN-4520. Finished app info is unnecessarily persisted in NM state-store if container is acquired but not lunched on this node. Contributed by sandflee 2016-01-25 15:36:40 -08:00
Akira Ajisaka
02d4a1fce3 YARN-4592. Remove unused GetContainerStatus proto. Contributed by Chang Li. 
(cherry picked from commit 56a0c175082b2b62698f65c1769a64224b3fb821)
 2016-01-25 15:20:45 +09:00
rohithsharmaks
7e66b2f22c YARN-4613. Fix test failure in TestClientRMService#testGetClusterNodes. (Takashi Ohnishi via rohithsharmaks) 
(cherry picked from commit 10dc2c049304671f0ed9fd737a30cd843427b53e)
 2016-01-24 23:37:11 +05:30
rohithsharmaks
280c9b8401 YARN-4614. Fix random failure in TestApplicationPriority#testApplicationPriorityAllocationWithChangeInPriority. (Sunil G via rohithsharmaks) 
(cherry picked from commit 99829eb221482928d8a1b148ae3c802cc7c9253e)
 2016-01-23 07:58:16 +05:30
Xuan
1d19557dda YARN-4496. Improve HA ResourceManager Failover detection on the client. 
Contributed by Jian He

(cherry picked from commit 618bfd6ac2a5b62d39e9bed80f75362bafc0ef28)
 2016-01-22 18:21:50 -08:00
Jason Lowe
635849fa45 YARN-4598. Invalid event: RESOURCE_FAILED at CONTAINER_CLEANEDUP_AFTER_KILL. Contributed by tangshangwen 
(cherry picked from commit 46e5ea81e0e41646ba02391aea31481ead28aaf8)
 2016-01-22 21:55:59 +00:00
Jason Lowe
ad84f90e88 YARN-4371. "yarn application -kill" should take multiple application ids. Contributed by Sunil G 
(cherry picked from commit e91e8b711c68273460b36557fc37fdfc86be097b)
 2016-01-22 21:37:08 +00:00
rohithsharmaks
1cec12d95a YARN-4574. Fix random failure in TestAMRMClientOnRMRestart. (Takashi Ohnishi via rohithsharmaks) 
(cherry picked from commit 34a3900773df6d9075dcf5476e8fe5208cd8f806)
 2016-01-22 21:18:42 +05:30
rohithsharmaks
493275b27b YARN-4497. RM might fail to restart when recovering apps whose attempts are missing. (Jun Gong via rohithsharmaks) 
(cherry picked from commit d6258b33a7428a0725ead96bc43f4dd444c7c8f1)
 2016-01-22 20:29:10 +05:30
Akira Ajisaka
ddc22bbcb1 YARN-4605. Spelling mistake in the help message of "yarn applicationattempt" command. Contributed by Weiwei Yang. 
(cherry picked from commit 8f58f742aea87b2b46b9741ffeaebfa36af3573f)
 2016-01-22 19:43:37 +09:00
Varun Vasudev
85561207f9 YARN-4578. Directories that are mounted in docker containers need to be more restrictive/container-specific. Contributed by Sidharta Seethana. 
(cherry picked from commit b41a7e89d1eb8650975ac7092532ed9563ac60f2)
 2016-01-22 14:44:22 +05:30
Rohith Sharma K S
844a8e3771 YARN-4584. RM startup failure when AM attempts greater than max-attempts. (Bibin A Chundatt via rohithsharmaks) 
(cherry picked from commit e30668106dc246f68db36fbd1f2db6ec08cd96f2)
 2016-01-22 10:20:09 +05:30
Jason Lowe
d051200a62 YARN-4610. Reservations continue looking for one app causes other apps to starve. Contributed by Jason Lowe 
(cherry picked from commit 468a53b22f4ac5bb079dff986ba849a687d709fe)
 2016-01-21 18:32:47 +00:00
Akira Ajisaka
bf4901c609 YARN-4608. Redundant code statement in WritingYarnApplications. Contributed by Kai Sasaki. 
(cherry picked from commit d3224e2d6274daf73a103c0dbe21ba69add7ca26)
 2016-01-22 02:14:53 +09:00
Karthik Kambatla
5c2f495fcc YARN-4603. FairScheduler should mention user requested queuename in error message when failed in queue ACL check. (Tao Jie via kasha) 
(cherry picked from commit 4992398aeeb213ce59e068b0226e22e49ce559eb)
 2016-01-21 17:43:49 +01:00
Jason Lowe
4e6fc3ca18 YARN-4492. Add documentation for preemption supported in Capacity scheduler. Contributed by Naganarasimha G R 
(cherry picked from commit f858ac24269c101bdee1f7b7b2566bdbda2b4ecd)
 2016-01-21 15:39:51 +00:00
Wangda Tan
9512866740 YARN-4557. Fix improper Queues sorting in PartitionedQueueComparator when accessible-node-labels=*. (Naganarasimha G R via wangda) 
(cherry picked from commit c9fe0371a8ab40c0d3437fadd32788b320788a7a)
 2016-01-21 11:16:58 +08:00
Xuan
be3322792f YARN-4559. Make leader elector and zk store share the same curator 
client. Contributed by Jian He

(cherry picked from commit 890a2ebd1af51d24ccbbc5d1d65d17b24ad8ab9b)
 2016-01-20 14:49:04 -08:00
Wangda Tan
23deeb4230 HADOOP-12356. Fix computing CPU usage statistics on Windows. (Inigo Goiri via wangda) 
(cherry picked from commit 89d1fd5dac4bccf42d82686e146b02eb60d14736)
 2016-01-19 21:28:51 +08:00
Jian He
bb2a9a78c0 YARN-4565. Fix a bug that leads to AM resource limit not hornored when sizeBasedWeight enabled for FairOrderingPolicy. Contributed by Wangda Tan 2016-01-18 21:05:03 -08:00
Wangda Tan
704b37d0e1 YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda) 
(cherry picked from commit a44ce3f14fd940601f984fbf7980aa6fdc8f23b7)
 2016-01-19 09:31:13 +08:00
Wangda Tan
1625281ccb Revert "YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda)" 
This reverts commit 3fe57285635e8058c34aa40a103845b49ca7d6ff.

Conflicts:
	hadoop-yarn-project/CHANGES.txt

(cherry picked from commit 150f5ae0343e872ee8bef39c57008c1389f0ba9e)
 2016-01-19 09:31:07 +08:00
Jian He
6db022fc48 YARN-4596. SystemMetricPublisher should not swallow error messages from TimelineClient#putEntities. Contributed by Li Lu 2016-01-18 16:59:04 -08:00
rohithsharmaks
da887e4252 YARN-4265 Addendum patch to fix compilation issue caused by project version number 2016-01-18 16:38:41 +05:30
Karthik Kambatla
ef59521094 YARN-4526. Make SystemClock singleton so AppSchedulingInfo could use it. (kasha) 
(cherry picked from commit d40859fab1ad977636457a6cc96b6a4f9b903afc)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapred/TestTaskAttemptListenerImpl.java
 2016-01-18 10:59:34 +01:00
Wangda Tan
552f15739c YARN-4304. AM max resource configuration per partition to be displayed/updated correctly in UI and in various partition related metrics. (Sunil G via wangda) 
(cherry picked from commit b08ecf5c7589b055e93b2907413213f36097724d)
 2016-01-18 11:16:04 +08:00
Wangda Tan
6dab78c71a YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda) 
(cherry picked from commit 805a9ed85eb34c8125cfb7d26d07cdfac12b3579)
 2016-01-18 11:15:59 +08:00
Wangda Tan
c1193b46d4 YARN-4538. QueueMetrics pending cores and memory metrics wrong. (Bibin A Chundatt via wangda) 
(cherry picked from commit 9523648d57ebc71cf5c57f3f8c52c4a63265b61c)
 2016-01-18 11:15:53 +08:00
Junping Du
4a30a44b11 YARN-4265. Provide new timeline plugin storage to support fine-grained entity caching. Contributed by Li Lu and Jason Lowe 
(cherry picked from commit 02f597c5db36ded385413958bdee793ad7eda40e)
 2016-01-17 17:38:42 -08:00
Colin Patrick Mccabe
48b8c99479 HADOOP-12712. Fix some cmake plugin and native build warnings (cmccabe) 
(cherry picked from commit b2c155f810888480d058512a326a5083e1bb4eaa)
 2016-01-15 13:22:14 -08:00