Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,993 Commits 326 Branches 371 Tags
Commit Graph

1569 Commits

Author SHA1 Message Date
Devaraj K
5fceebd696 YARN-3629. NodeID is always printed as "null" in node manager 
initialization log. Contributed by nijel.

(cherry picked from commit 5c2f05cd9bad9bf9beb0f4ca18f4ae1bc3e84499)
 2015-05-12 22:22:40 +05:30
Devaraj K
f887243f88 YARN-3513. Remove unused variables in ContainersMonitorImpl and add debug 
log for overall resource usage by all containers.  Contributed by
Naganarasimha G R.

(cherry picked from commit 8badd82ce256e4dc8c234961120d62a88358ab39)
 2015-05-12 16:56:26 +05:30
Wangda Tan
d06d2a96f5 YARN-3489. RMServerUtils.validateResourceRequests should only obtain queue info once. (Varun Saxena via wangda) 
(cherry picked from commit d6f6741296639a73f5306e3ebefec84a40ca03e5)
 2015-05-11 17:35:01 -07:00
Junping Du
a1a7deebf8 YARN-3587. Fix the javadoc of DelegationTokenSecretManager in yarn, etc. projects. Contributed by Gabor Liptak. 
(cherry picked from commit 7e543c27fa2881aa65967be384a6203bd5b2304f)
 2015-05-11 05:28:25 -07:00
Karthik Kambatla
3cf4f24a9f YARN-3395. FairScheduler: Trim whitespaces when using username for queuename. (Zhihai Xu via kasha) 
(cherry picked from commit a60f78e98ed73ab320576c652c577f119ce70901)
 2015-05-09 15:41:49 -07:00
Karthik Kambatla
e8dd0bc4fd YARN-1287. Consolidate MockClocks. (Sebastian Wong and Anubhav Dhoot via kasha) 
(cherry picked from commit 70fb37cd79a7eba6818313960624380bacfe0bb2)
 2015-05-09 14:35:13 -07:00
Xuan
acb342b77c YARN-1912. ResourceLocalizer started without any jvm memory control. 
Contributed by Masatake Iwasaki

(cherry picked from commit 6471d18bc72bc6c83ce31a03b5c5f5737847bb6d)
 2015-05-08 20:02:23 -07:00
Xuan
fc980247a6 YARN-3602. TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IOException from cleanup. Contributed by zhihai xu 
(cherry picked from commit 333f9a896d8a4407ce69cfd0dc8314587a339233)
 2015-05-08 17:54:46 -07:00
Karthik Kambatla
a7d8f21630 YARN-3271. FairScheduler: Move tests related to max-runnable-apps from TestFairScheduler to TestAppRunnability. (nijel via kasha) 
(cherry picked from commit 2fb44c8aaf7f35f425d80b133a28b1c1f305c3e6)
 2015-05-08 16:40:36 -07:00
Robert Kanter
453488cff2 YARN-3473. Fix RM Web UI configuration for some properties (rchiang via rkanter) 
(cherry picked from commit 5658998845bbeb3f09037a891f6b254585848de7)
 2015-05-08 16:23:20 -07:00
Jason Lowe
743ca1a056 YARN-3476. Nodemanager can fail to delete local logs if log aggregation fails. Contributed by Rohith 
(cherry picked from commit 25e2b02122c4ed760227ab33c49d3445c23b9276)
 2015-05-08 22:46:34 +00:00
Jian He
5a1c2fed34 YARN-3604. Fixed ZKRMStateStore#removeApplication to also disable watch. Contributed Zhihai Xu 
(cherry picked from commit d0b73287c26983f32b0efe01862150e9fd28086f)
 2015-05-08 15:13:43 -07:00
Xuan
8d07116266 YARN-2331. Distinguish shutdown during supervision vs. shutdown for 
rolling upgrade. Contributed by Jason Lowe

(cherry picked from commit 088156de43abb07bec590a3fcd1a5af2feb02cd2)
 2015-05-08 15:11:55 -07:00
Vinod Kumar Vavilapalli
24c8d3e54b YARN-3018. Unified the default value for the configuration property yarn.scheduler.capacity.node-locality-delay in code and default xml file. Contributed by Nijel SF. 
(cherry picked from commit f7a74d249173292035839810a1595d7a028bfdda)
 2015-05-08 14:45:55 -07:00
Wangda Tan
f8807839c6 YARN-3593. Add label-type and Improve "DEFAULT_PARTITION" in Node Labels Page. (Naganarasimha G R via wangda) 
(cherry picked from commit f55d21d89448b81eba6ecbaa4d57bf535461ce73)
 2015-05-08 12:05:25 -07:00
Thomas Graves
547b069887 YARN-3600. AM container link is broken (Naganarasimha G R via tgraves 
(cherry picked from commit 5d708a4725529cf09d2dd8b5b4aa3542cc8610b0)
 2015-05-08 16:37:20 +00:00
Robert (Bobby) Evans
28e0593b96 YARN-644: Basic null check is not performed on passed in arguments before using them in ContainerManagerImpl.startContainer 
(cherry picked from commit bcf2890502fbd11dd394048fe30d67c92aeec4fa)
 2015-05-08 11:11:53 -05:00
Devaraj K
bf8be56292 YARN-2784. Make POM project names consistent. Contributed by Rohith. 2015-05-08 19:26:11 +05:30
Tsuyoshi Ozawa
1ae8bf5b21 MAPREDUCE-6284. Add Task Attempt State API to MapReduce Application Master REST API. Contributed by Ryu Kobayashi. 
(cherry picked from commit d18f10ad1b3e497fa1aaaeb85ba055f87d9849f7)
 2015-05-08 16:00:41 +09:00
Devaraj K
0d286d1041 YARN-3358. Audit log not present while refreshing Service ACLs. 
Contributed by Varun Saxena.

(cherry picked from commit ef3d66d4624d360e75c016e36824a6782d6a9746)
 2015-05-08 12:15:45 +05:30
Devaraj K
dce2381dc4 YARN-3592. Fix typos in RMNodeLabelsManager. Contributed by Sunil G. 
(cherry picked from commit a28cd02ba026733e409807f3ea1b36f7d57bc273)
 2015-05-08 10:55:53 +05:30
Akira Ajisaka
170f1b0afd YARN-1832. Fix wrong MockLocalizerStatus#equals implementation. Contributed by Hong Zhiguo. 
(cherry picked from commit b167fe7605deb29ec533047d79d036eb65328853)
 2015-05-08 11:15:28 +09:00
Jian He
d817fbb34d YARN-2918. RM should not fail on startup if queue's configured labels do not exist in cluster-node-labels. Contributed by Wangda Tan 
(cherry picked from commit f489a4ec969f3727d03c8e85d51af1018fc0b2a1)
 2015-05-07 17:36:24 -07:00
Jian He
c35114a1e6 YARN-3584. Fixed attempt diagnostics format shown on the UI. Contributed by nijel 
(cherry picked from commit b88700dcd0b9aa47662009241dfb83bc4446548d)
 2015-05-07 13:56:25 -07:00
Zhijie Shen
bb035ff087 YARN-3448. Added a rolling time-to-live LevelDB timeline store implementation. Contributed by Jonathan Eagles. 
(cherry picked from commit daf3e4ef8bf73cbe4a799d51b4765809cd81089f)
 2015-05-07 10:10:13 -07:00
Akira Ajisaka
67bebabb21 YARN-3577. Misspelling of threshold in log4j.properties for tests. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 995f1b5831fc33042de90267a689333dc110c4c3)
 2015-05-07 13:33:17 +09:00
Vinod Kumar Vavilapalli
d127dd64a7 YARN-3385. Fixed a race-condition in ResourceManager's ZooKeeper based state-store to avoid crashing on duplicate deletes. Contributed by Zhihai Xu. 
(cherry picked from commit 4c7b9b6abe2452c9752a11214762be2e7665fb32)
 2015-05-06 17:52:13 -07:00
Junping Du
79babc4bd2 YARN-3580. [JDK8] TestClientRMService.testGetLabelsToNodes fails. Contributed by Robert Kanter. 
(cherry picked from commit 31b627b2a8755dec0820d01f6f7ac96e4c6194e2)
 2015-05-06 16:51:56 -07:00
Robert Kanter
28b40aca98 YARN-3491. PublicLocalizer#addResource is too slow. (zxu via rkanter) 
(cherry picked from commit b72507810aece08e17ab4b5aae1f7eae1fe98609)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2015-05-06 14:20:08 -07:00
Jian He
f8488b5aeb YARN-3301. Fixed the format issue of the new RM attempt web page. Contributed by Xuan Gong 
(cherry picked from commit 0d3188fd25f31b83caf16b77773620f4ee237409)
 2015-05-06 13:51:44 -07:00
Xuan
a0445eae5c YARN-3582. NPE in WebAppProxyServlet. Contributed by Jian He 
(cherry picked from commit a583a40693f5c56c40b39fd12cfa0bb7174fc526)
 2015-05-05 21:43:35 -07:00
Jian He
eb0c6d2ee7 YARN-3343. Increased TestCapacitySchedulerNodeLabelUpdate#testNodeUpdate timeout. Contributed by Rohith Sharmaks 
(cherry picked from commit e4c3b52c896291012f869ebc0a21e85e643fadd1)
 2015-05-05 11:34:11 -07:00
Xuan
02cdcaec58 YARN-2123. Progress bars in Web UI always at 100% due to non-US locale. 
Contributed by Akira AJISAKA

(cherry picked from commit b7dd3a4f04f712b7594c4e6e7ce50fd314f7c342)
 2015-05-05 10:45:18 -07:00
Junping Du
6ea007ba91 YARN-3396. Handle URISyntaxException in ResourceLocalizationService. (Contributed by Brahma Reddy Battula) 
(cherry picked from commit 38102420621308f5ba91cdeb6a18a63aa5acf640)
 2015-05-05 10:19:16 -07:00
Jason Lowe
0f30913ea8 YARN-3552. RM Web UI shows -1 running containers for completed apps. Contributed by Rohith 
(cherry picked from commit 9356cf8676fd18f78655e8a6f2e6c946997dbd40)
 2015-05-05 13:43:57 +00:00
Jian He
f71c49c5e3 YARN-2725. Added test cases of retrying creating znode in ZKRMStateStore. Contributed by Tsuyoshi Ozawa 
(cherry picked from commit d701acc9c67adc578ba18035edde1166eedaae98)
 2015-05-04 16:17:01 -07:00
Wangda Tan
4e77ee2f6f YARN-3375. NodeHealthScriptRunner.shouldRun() check is performing 3 times for starting NodeHealthScriptRunner (Devaraj K via wangda) 
(cherry picked from commit 71f4de220c74bf2c90630bd0442979d92380d304)
 2015-05-04 16:02:57 -07:00
Allen Wittenauer
02e650248d YARN-2980. Move health check script related functionality to hadoop-common (Varun Saxena via aw) 
(cherry picked from commit d4ac6822e1c5dfac504ced48f10ab57a55b49e93)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeManager.java
 2015-05-04 16:00:20 -07:00
Jason Lowe
99b49a8181 YARN-3097. Logging of resource recovery on NM restart has redundancies. Contributed by Eric Payne 
(cherry picked from commit 8f65c793f2930bfd16885a2ab188a9970b754974)
 2015-05-04 10:32:33 -05:00
Gera Shegalov
9325dd863c YARN-2893. AMLaucher: sporadic job failures due to EOFException in readTokenStorageStream. (Zhihai Xu via gera) 
(cherry picked from commit f8204e241d9271497defd4d42646fb89c61cefe3)
 2015-05-01 19:04:48 -07:00
Robert Kanter
32b3b8e2ef YARN-3363. add localization and container launch time to ContainerMetrics at NM to show these timing information for each active container. (zxu via rkanter) 
(cherry picked from commit ac7d152901e29b1f444507fe4e421eb6e1402b5a)
 2015-05-01 16:39:59 -07:00
Vinod Kumar Vavilapalli
90f6e8c90f YARN-2619. Added NodeManager support for disk io isolation through cgroups. Contributed by Varun Vasudev and Wei Yan. 
(cherry picked from commit 1b3b9e5c31c38388c1ce4208c65e8dd5f956da82)
 2015-04-30 21:43:22 -07:00
Zhijie Shen
c9ee316045 YARN-3544. Got back AM logs link on the RM web UI for a completed app. Contributed by Xuan Gong. 
(cherry picked from commit 21bf2cdcb77f69abc906e6cd401a8fb221f250e9)
 2015-04-30 13:06:46 -07:00
Wangda Tan
100b41add6 YARN-3564. Fix TestContainerAllocation.testAMContainerAllocationWhenDNSUnavailable fails randomly. (Jian He via wangda) 
(cherry picked from commit e2e8f771183df798e926abc97116316a05b19c9a)
 2015-04-30 11:06:47 -07:00
Jian He
a7a5737bc4 YARN-3533. Test: Fix launchAM in MockRM to wait for attempt to be scheduled. Contributed by Anubhav Dhoot 
(cherry picked from commit 4c1af156aef4f3bb1d9823d5980c59b12007dc77)
 2015-04-29 14:51:04 -07:00
tgraves
2e13183f60 YARN-3517. RM web ui for dumping scheduler logs should be for admins only (Varun Vasudev via tgraves) 
(cherry picked from commit 2e215484bd05cd5e3b7a81d3558c6879a05dd2d2)
 2015-04-29 21:27:16 +00:00
Karthik Kambatla
4cc38df7de YARN-3485. FairScheduler headroom calculation doesn't consider maxResources for Fifo and FairShare policies. (kasha) 
(cherry picked from commit 8f82970e0c247b37b2bf33aa21f6a39afa07efde)
 2015-04-28 21:03:12 -07:00
Wangda Tan
8ee632caa7 YARN-2740. Fix NodeLabelsManager to properly handle node label modifications when distributed node label configuration enabled. (Naganarasimha G R via wangda) 
(cherry picked from commit db1b674b50ddecf2774f4092d677c412722bdcb1)
 2015-04-27 16:42:36 -07:00
Xuan
0e8af401d7 YARN-3530. ATS throws exception on trying to filter results without 
otherinfo. Contributed by zhijie shen

(cherry picked from commit 7f07c4d81023e3bf4bf8980e64cc9420ec31cf55)
 2015-04-27 10:37:40 -07:00
Karthik Kambatla
4045c41afe YARN-3464. Race condition in LocalizerRunner kills localizer before localizing all resources. (Zhihai Xu via kasha) 
(cherry picked from commit 47279c3228185548ed09c36579b420225e4894f5)
 2015-04-26 09:14:12 -07:00