Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,204 Commits 326 Branches 371 Tags
Commit Graph

1842 Commits

Author SHA1 Message Date
Jian He
023c2d2e56 YARN-4671. There is no need to acquire CS lock when completing a container. Contributed by Meng Ding 2016-03-01 13:14:51 -08:00
Jian He
589b537631 YARN-4748. ApplicationHistoryManagerOnTimelineStore should not swallow exceptions on generateApplicationReport. Contributed by Li Lu 
(cherry picked from commit d93c22ec274b1a0f29609217039b80732886fed7)
 2016-02-29 18:19:34 -08:00
Karthik Kambatla
84172b047b YARN-4704. TestResourceManager#testResourceAllocation() fails when using FairScheduler. (Yufei Gu via kasha) 
(cherry picked from commit 9dafaaaf0de68ce7f5e495ea4b8e0ce036dc35a2)
 2016-02-29 16:10:26 -08:00
Haohui Mai
c5db4ab0b4 HADOOP-12813. Migrate TestRPC and related codes to rebase on ProtobufRpcEngine. Contributed by Kai Zheng. 2016-02-29 14:10:18 -08:00
Jason Lowe
bd0f5085e3 YARN-4731. container-executor should not follow symlinks in recursive_unlink_children. Contributed by Colin Patrick McCabe 
(cherry picked from commit c58a6d53c58209a8f78ff64e04e9112933489fb5)
 2016-02-29 15:26:26 +00:00
Rohith Sharma K S
2a1bb6cb67 YARN-4566. Fix test failure in TestMiniYarnClusterNodeUtilization. (Takashi Ohnishi via rohithsharmaks) 
(cherry picked from commit e0b14f26f5201a149218276469434df511697acc)
 2016-02-29 10:50:23 +08:00
Karthik Kambatla
f3b37d8020 YARN-4718. Rename variables in SchedulerNode to reduce ambiguity post YARN-1011. (Inigo Goiri via kasha) 
(cherry picked from commit f9692770a58af0ab082eb7f15da9cbdcd177605b)
 2016-02-28 10:01:48 -08:00
Jason Lowe
0bd7ba4ea8 YARN-4723. NodesListManager$UnknownNodeId ClassCastException. Contributed by Kuhu Shukla 
(cherry picked from commit 6b0f813e898cbd14b2ae52ecfed6d30bce8cb6b7)
 2016-02-26 20:25:56 +00:00
Ming Ma
1656bcec5f YARN-4720. Skip unnecessary NN operations in log aggregation. (Jun Gong via mingma) 
(cherry picked from commit 7f3139e54da2c496327446a5eac43f8421fc8839)
 2016-02-26 08:43:14 -08:00
Robert Kanter
872b8d90a6 YARN-4579. Allow DefaultContainerExecutor container log directory permissions to be configurable (rchiang via rkanter) 
(cherry picked from commit d7fdec1e6b465395d2faca6e404e329d20f6c3d8)
 2016-02-25 16:40:05 -08:00
Karthik Kambatla
6a75c5af09 YARN-4729. SchedulerApplicationAttempt#getTotalRequiredResources can throw an NPE. (kasha) 
(cherry picked from commit c684f2b007a4808dafbe1c1d3ce01758e281d329)
 2016-02-24 18:34:21 -08:00
Robert Kanter
c2098d2470 YARN-4697. NM aggregation thread pool is not bound by limits (haibochen via rkanter) 
(cherry picked from commit 954dd57043d2de4f962876c1b89753bfc7e4ce55)
 2016-02-24 15:00:48 -08:00
Sangjin Lee
432a2367ce YARN-4722. AsyncDispatcher logs redundant event queue sizes (Jason Lowe via sjlee) 
(cherry picked from commit 553b591ba06bbf0b18dca674d25a48218fed0a26)
 2016-02-24 09:30:37 -08:00
Jason Lowe
acffe82353 YARN-2046. Out of band heartbeats are sent only on container kill and possibly too early. Contributed by Ming Ma 
(cherry picked from commit d284e187b8db43056236032ebc2114ee462c27f6)
 2016-02-23 20:51:01 +00:00
Junping Du
e3ce0ffdc3 YARN-3223. Resource update during NM graceful decommission. Contributed by Brook Zhou. 
(cherry picked from commit 9ed17f181d96b8719a0ef54a129081948781d57e)
 2016-02-23 03:35:47 -08:00
Tsuyoshi Ozawa
4ee55d0322 YARN-4648. Move preemption related tests from TestFairScheduler to TestFairSchedulerPreemption. Contributed by Kai Sasaki. 
(cherry picked from commit 0e12114c9ccb0c6b16c258227a433b075418796e)
 2016-02-23 19:50:40 +09:00
Varun Vasudev
2c218ca8a8 YARN-4709. NMWebServices produces incorrect JSON for containers. Contributed by Varun Saxena. 
(cherry picked from commit 140cb5d74565aad848b40a251ec02b597a3a20d4)
 2016-02-23 12:32:16 +05:30
Junping Du
7402448387 YARN-4386. refreshNodesGracefully() should send recommission event to active RMNodes only. Contributed by Kuhu Shukla. 
(cherry picked from commit 3fab88540f079591e5dae1c9184f8b26bb843427)
 2016-02-22 07:38:40 -08:00
Sangjin Lee
23b5c71729 YARN-4690. Skip object allocation in FSAppAttempt#getResourceUsage when possible (Ming Ma via sjlee) 
(cherry picked from commit 7de70680fe44967e2afc92ba4c92f8e7afa7b151)
 2016-02-17 21:05:10 -08:00
Karthik Kambatla
33c1988595 YARN-4689. FairScheduler: Cleanup preemptContainer to be more readable. (Kai Sasaki via kasha) 
(cherry picked from commit 2ab4c476ed22d3ccf15b215710b67e32bbc7e5f0)
 2016-02-17 18:28:08 -08:00
Arun Suresh
6a238e4a6b YARN-2575. Create separate ACLs for Reservation create/update/delete/list ops (Sean Po via asuresh) 
(cherry picked from commit 23f937e3b718f607d4fc975610ab3a03265f0f7e)
 2016-02-11 10:49:11 -08:00
Varun Vasudev
3a5b39e931 YARN-4655. Log uncaught exceptions/errors in various thread pools in YARN. Contributed by Sidharta Seethana. 
(cherry picked from commit fa00d3e20560bee412b49e5792595749a247a8ab)
 2016-02-11 12:09:29 +05:30
Jian He
358cfcf9ea YARN-4138. Roll back container resource allocation after resource increase token expires. Contributed by Meng Ding 2016-02-11 10:09:04 +08:00
=
fc9eb4577c YARN-4420. Add REST API for List Reservations. (Sean Po via curino) 2016-02-10 14:26:38 -08:00
Arun Suresh
17f83c8803 YARN-4360. Improve GreedyReservationAgent to support "early" allocations, and performance improvements (curino via asuresh) 
(cherry picked from commit 5cf5c41a895f5ab8bf6270089f8cfdea50573a97)
 2016-02-10 09:13:04 -08:00
Devaraj K
329df98f49 YARN-4667. RM Admin CLI for refreshNodesResources throws NPE when nothing 
is configured. Contributed by Naganarasimha G R.

(cherry picked from commit 565af873d5e9bc4178f1221805765a417f065192)
 2016-02-08 15:03:11 +05:30
Varun Vasudev
be04535f1a YARN-4669. Fix logging statements in resource manager's Application class. Contributed by Sidharta Seethana. 
(cherry picked from commit a4a30c789146c4e824fcc6ebcf10405711120eaa)
 2016-02-04 13:51:08 +05:30
Varun Vasudev
99966b1912 YARN-4307. Display blacklisted nodes for AM container in the RM web UI. Contributed by Naganarasimha G R. 
(cherry picked from commit 308d63f382e1992ea2b8ccf3130edaaa751c644d)
 2016-02-04 13:33:38 +05:30
Jason Lowe
b12f16ab73 YARN-4594. container-executor fails to remove directory tree when chmod required. Contributed by Colin Patrick McCabe 
(cherry picked from commit fa328e2d39eda1c479389b99a5c121e640a1e0ad)
 2016-02-03 17:22:12 +00:00
Varun Vasudev
e211ab777e YARN-4625. Make ApplicationSubmissionContext and ApplicationSubmissionContextInfo more consistent. Contributed by Xuan Gong. 
(cherry picked from commit 1adb64e09bd453f97e83d31b1587079e30b4b274)
 2016-02-03 16:28:31 +05:30
Varun Vasudev
bbda446889 YARN-4649. Add additional logging to some NM state store operations. Contributed by Sidharta Seethana 
(cherry picked from commit 1cd55e0c171f7c4dec6f843931285557d59cd5ea)
 2016-02-02 09:26:22 +05:30
Wangda Tan
9591363ad8 YARN-4340. Add list API to reservation system. (Sean Po via wangda) 
(cherry picked from commit 9875325d5c63f343809907d06bf48a298035a611)
 2016-02-02 10:19:19 +08:00
Jason Lowe
36aae8050e YARN-3102. Decommisioned Nodes not listed in Web UI. Contributed by Kuhu Shukla 
(cherry picked from commit ed55950164a66e08fa34e30dba1030c5a986d1f1)
 2016-02-01 23:16:18 +00:00
Rohith Sharma K S
676f215595 YARN-4615. Fix random test failure in TestAbstractYarnScheduler#testResourceRequestRecoveryToTheRightAppAttempt. (Sunil G via rohithsharmaks) 
(cherry picked from commit 2673cbaf556eb4d0e44519cdbb8c6f0f02412a21)
 2016-02-01 10:45:05 +05:30
Jason Lowe
016c685135 YARN-4428. Redirect RM page to AHS page when AHS turned on and RM page is not available. Contributed by Chang Li 
(cherry picked from commit 772ea7b41b06beaa1f4ac4fa86eac8d6e6c8cd36)
 2016-01-29 21:54:56 +00:00
Jian He
885c76d85f YARN-4617. LeafQueue#pendingOrderingPolicy should always use fixed ordering policy instead of using same as active applications ordering policy. Contributed by Rohith Sharma K S 2016-01-29 12:22:44 -08:00
Karthik Kambatla
9d1371d390 YARN-4647. Make RegisterNodeManagerRequestPBImpl thread-safe. (kasha) 
(cherry picked from commit c9a09d6926b258e205a4ff7998ce5a86bf5dbe3b)
 2016-01-29 08:19:34 -08:00
Devaraj K
123269c07f YARN-4411. RMAppAttemptImpl#createApplicationAttemptReport throws 
IllegalArgumentException. Contributed by Bibin A Chundatt and yarntime.

(cherry picked from commit a277bdc9edc66bef419fcd063b832073e512f234)
 2016-01-29 13:52:47 +05:30
Rohith Sharma K S
b8d5df06f2 YARN-4543. Fix random test failure in TestNodeStatusUpdater.testStopReentrant. (Akihiro Suda via rohithsharmaks) 
(cherry picked from commit ac686668031ee9837deed3f3566f09f33c437870)
 2016-01-29 12:30:53 +05:30
Rohith Sharma K S
0466743afb YARN-4219. addendum patch to fix javadoc errors 
(cherry picked from commit 09d831c95ba18e2892cddd749f6e06f112dda7f5)
 2016-01-29 11:53:06 +05:30
Jian He
36f0e73882 YARN-4519. Potential deadlock of CapacityScheduler between decrease container and assign containers. Contributed by Meng Ding 2016-01-28 14:52:00 -08:00
Xuan
2f00d8d3a7 YARN-4219. New levelDB cache storage for timeline v1.5. Contributed by 
Li Lu

(cherry picked from commit 9fab22b36673e7f1a0bb629d2c07966ac2482e99)
 2016-01-28 14:36:58 -08:00
Jason Lowe
29195c7668 YARN-4643. Container recovery is broken with delegating container runtime. Contributed by Sidharta Seethana 
(cherry picked from commit 61382ff8fabc76b3a51f227646573cdf367fea1a)
 2016-01-28 19:00:51 +00:00
Rohith Sharma K S
6947a5d4be YARN-4633. Fix random test failure in TestRMRestart#testRMRestartAfterPreemption. (Bibin A Chundatt via rohithsharmaks) 
(cherry picked from commit ef343be82b4268ebd52f6a11e1a1ce53a5d232a9)
 2016-01-28 21:55:12 +05:30
Karthik Kambatla
c25154576b YARN-4462. FairScheduler: Disallow preemption from a queue. (Tao Jie via kasha) 
(cherry picked from commit fb238d7e5dcd96466c8938b13ca7f13cedecb08a)
 2016-01-27 12:29:25 -08:00
Rohith Sharma K S
0b8767e01a YARN-4573. Fix test failure in TestRMAppTransitions#testAppRunningKill and testAppKilledKilled. (Takashi Ohnishi via rohithsharmaks) 
(cherry picked from commit c01bee010832ca31d8e60e5461181cdf05140602)
 2016-01-27 08:24:37 +05:30
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
47b20d0c74 YARN-3542. Refactored existing CPU cgroups support to use the newer and integrated ResourceHandler mechanism, and also deprecated the old LCEResourceHandler inteface hierarchy. Contributed by Varun Vasudev. 
(cherry picked from commit 2085e60a9655b59aa2ba8917acdc511ab71ff6e4)
 2016-01-25 16:22:47 -08:00
Jian He
2d236c9de2 YARN-4520. Finished app info is unnecessarily persisted in NM state-store if container is acquired but not lunched on this node. Contributed by sandflee 2016-01-25 15:36:40 -08:00
rohithsharmaks
7e66b2f22c YARN-4613. Fix test failure in TestClientRMService#testGetClusterNodes. (Takashi Ohnishi via rohithsharmaks) 
(cherry picked from commit 10dc2c049304671f0ed9fd737a30cd843427b53e)
 2016-01-24 23:37:11 +05:30
rohithsharmaks
280c9b8401 YARN-4614. Fix random failure in TestApplicationPriority#testApplicationPriorityAllocationWithChangeInPriority. (Sunil G via rohithsharmaks) 
(cherry picked from commit 99829eb221482928d8a1b148ae3c802cc7c9253e)
 2016-01-23 07:58:16 +05:30