Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,187 Commits 326 Branches 371 Tags
Commit Graph

1945 Commits

Author SHA1 Message Date
Vinod Kumar Vavilapalli
ad3196e016 Fixing HDFS state-store. Contributed by Arun Suresh. 
(cherry picked from commit 9a2a9553eee454ecd18120535d3e845f86fc3584)
 2015-05-14 16:57:03 -07:00
Ravi Prakash
4caadaa8bb YARN-1519. Check in container-executor if sysconf is implemented before using it (Radim Kolar and Eric Payne via raviprak) 
(cherry picked from commit 53fe4eff09fdaeed75a8cad3a26156bf963a8d37)
 2015-05-14 15:56:36 -07:00
Junping Du
bc13c7d84b YARN-3505. Node's Log Aggregation Report with SUCCEED should not cached in RMApps. Contributed by Xuan Gong. 
(cherry picked from commit 15ccd967ee3e7046a50522089f67ba01f36ec76a)
 2015-05-14 10:59:48 -07:00
Wangda Tan
3a11baa15f YARN-3362. Add node label usage in RM CapacityScheduler web UI. (Naganarasimha G R via wangda) 
(cherry picked from commit 0e85044e26da698c45185585310ae0e99448cd80)
 2015-05-13 17:01:23 -07:00
Jason Lowe
a81ad81461 YARN-3641. NodeManager: stopRecoveryStore() shouldn't be skipped when exceptions happen in stopping NM's sub-services. Contributed by Junping Du 
(cherry picked from commit 711d77cc54a64b2c3db70bdacc6bf2245c896a4b)
 2015-05-13 21:08:45 +00:00
Jason Lowe
aefc2bae9e Update fix version for YARN-3457 and YARN-3537. 
(cherry picked from commit f7de6198da030cb9cd62dcfd3c378dbbf857e017)
 2015-05-13 20:54:21 +00:00
Wangda Tan
d49262a172 YARN-3521. Support return structured NodeLabel objects in REST API (Sunil G via wangda) 
(cherry picked from commit 7f19e7a2549a098236d06b29b7076bb037533f05)
 2015-05-13 13:43:57 -07:00
Wangda Tan
8555a5146d YARN-3579. CommonNodeLabelsManager should support NodeLabel instead of string label name when getting node-to-label/label-to-label mappings. (Sunil G via wangda) 
(cherry picked from commit d4f53fc9631d682cd79ba440aefa6750dcc898be)
 2015-05-13 13:33:38 -07:00
Xuan
487d9b0f3f YARN-3626. On Windows localized resources are not moved to the front of the classpath when they should be. Contributed by Craig Welch 
(cherry picked from commit 0f95921447ea547bdf9caf18f7fde46bc66031f8)
 2015-05-13 13:12:04 -07:00
Wangda Tan
3df8880bbe YARN-2921. Fix MockRM/MockAM#waitForState sleep too long. (Tsuyoshi Ozawa via wangda) 
(cherry picked from commit 341a476812015d0d584b198b451ea9458645a47c)
 2015-05-13 13:07:05 -07:00
cnauroth
ddc4afeff2 HADOOP-11966. Variable cygwin is undefined in hadoop-config.sh when executed through hadoop-daemon.sh. Contributed by Chris Nauroth. 2015-05-13 12:25:49 -07:00
Zhijie Shen
6043224458 YARN-3539. Updated timeline server documentation and marked REST APIs evolving. Contributed by Steve Loughran. 
(cherry picked from commit fcd0702c10ce574b887280476aba63d6682d5271)
 2015-05-12 21:13:47 -07:00
Karthik Kambatla
9d6c63f8be YARN-3613. TestContainerManagerSecurity should init and start Yarn cluster in setup instead of individual methods. (nijel via kasha) 
(cherry picked from commit fe0df596271340788095cb43a1944e19ac4c2cf7)
 2015-05-12 10:45:51 -07:00
Devaraj K
5fceebd696 YARN-3629. NodeID is always printed as "null" in node manager 
initialization log. Contributed by nijel.

(cherry picked from commit 5c2f05cd9bad9bf9beb0f4ca18f4ae1bc3e84499)
 2015-05-12 22:22:40 +05:30
Devaraj K
f887243f88 YARN-3513. Remove unused variables in ContainersMonitorImpl and add debug 
log for overall resource usage by all containers.  Contributed by
Naganarasimha G R.

(cherry picked from commit 8badd82ce256e4dc8c234961120d62a88358ab39)
 2015-05-12 16:56:26 +05:30
Wangda Tan
12584ac10e Move YARN-3493 from 2.8 to 2.7.1 in CHANGES.txt 2015-05-11 18:08:25 -07:00
Wangda Tan
d06d2a96f5 YARN-3489. RMServerUtils.validateResourceRequests should only obtain queue info once. (Varun Saxena via wangda) 
(cherry picked from commit d6f6741296639a73f5306e3ebefec84a40ca03e5)
 2015-05-11 17:35:01 -07:00
Wangda Tan
2c80a3fe19 Moved YARN-3434. (Interaction between reservations and userlimit can result in significant ULF violation.) From 2.8.0 to 2.7.1 
(cherry picked from commit 1952f88889395870e7b631d43418e075e774b9d2)
 2015-05-11 15:22:25 -07:00
Junping Du
a1a7deebf8 YARN-3587. Fix the javadoc of DelegationTokenSecretManager in yarn, etc. projects. Contributed by Gabor Liptak. 
(cherry picked from commit 7e543c27fa2881aa65967be384a6203bd5b2304f)
 2015-05-11 05:28:25 -07:00
Karthik Kambatla
3cf4f24a9f YARN-3395. FairScheduler: Trim whitespaces when using username for queuename. (Zhihai Xu via kasha) 
(cherry picked from commit a60f78e98ed73ab320576c652c577f119ce70901)
 2015-05-09 15:41:49 -07:00
Karthik Kambatla
e8dd0bc4fd YARN-1287. Consolidate MockClocks. (Sebastian Wong and Anubhav Dhoot via kasha) 
(cherry picked from commit 70fb37cd79a7eba6818313960624380bacfe0bb2)
 2015-05-09 14:35:13 -07:00
Xuan
acb342b77c YARN-1912. ResourceLocalizer started without any jvm memory control. 
Contributed by Masatake Iwasaki

(cherry picked from commit 6471d18bc72bc6c83ce31a03b5c5f5737847bb6d)
 2015-05-08 20:02:23 -07:00
Xuan
fc980247a6 YARN-3602. TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IOException from cleanup. Contributed by zhihai xu 
(cherry picked from commit 333f9a896d8a4407ce69cfd0dc8314587a339233)
 2015-05-08 17:54:46 -07:00
Zhijie Shen
ef096599c3 YARN-2206. Updated document for applications REST API response examples. Contributed by Kenji Kikushima and Brahma Reddy Battula. 
(cherry picked from commit 08f0ae403c649b28925d3b339b7b6de1d7ec2c0c)
 2015-05-08 16:41:29 -07:00
Karthik Kambatla
a7d8f21630 YARN-3271. FairScheduler: Move tests related to max-runnable-apps from TestFairScheduler to TestAppRunnability. (nijel via kasha) 
(cherry picked from commit 2fb44c8aaf7f35f425d80b133a28b1c1f305c3e6)
 2015-05-08 16:40:36 -07:00
Karthik Kambatla
21a07769d4 YARN-1050. Document the Fair Scheduler REST API. (Kenji Kikushima and Roman Shaposhnik via kasha) 
(cherry picked from commit 96473bdc2b090c13708fd467fd626621ef1d47eb)
 2015-05-08 16:31:30 -07:00
Robert Kanter
453488cff2 YARN-3473. Fix RM Web UI configuration for some properties (rchiang via rkanter) 
(cherry picked from commit 5658998845bbeb3f09037a891f6b254585848de7)
 2015-05-08 16:23:20 -07:00
Jason Lowe
743ca1a056 YARN-3476. Nodemanager can fail to delete local logs if log aggregation fails. Contributed by Rohith 
(cherry picked from commit 25e2b02122c4ed760227ab33c49d3445c23b9276)
 2015-05-08 22:46:34 +00:00
Jian He
5a1c2fed34 YARN-3604. Fixed ZKRMStateStore#removeApplication to also disable watch. Contributed Zhihai Xu 
(cherry picked from commit d0b73287c26983f32b0efe01862150e9fd28086f)
 2015-05-08 15:13:43 -07:00
Xuan
8d07116266 YARN-2331. Distinguish shutdown during supervision vs. shutdown for 
rolling upgrade. Contributed by Jason Lowe

(cherry picked from commit 088156de43abb07bec590a3fcd1a5af2feb02cd2)
 2015-05-08 15:11:55 -07:00
Vinod Kumar Vavilapalli
24c8d3e54b YARN-3018. Unified the default value for the configuration property yarn.scheduler.capacity.node-locality-delay in code and default xml file. Contributed by Nijel SF. 
(cherry picked from commit f7a74d249173292035839810a1595d7a028bfdda)
 2015-05-08 14:45:55 -07:00
Wangda Tan
f8807839c6 YARN-3593. Add label-type and Improve "DEFAULT_PARTITION" in Node Labels Page. (Naganarasimha G R via wangda) 
(cherry picked from commit f55d21d89448b81eba6ecbaa4d57bf535461ce73)
 2015-05-08 12:05:25 -07:00
Thomas Graves
638feaaa35 YARN-20. More information for yarn.resourcemanager.webapp.address in yarn-default.xml (Bartosz Ługowski vai tgraves) 
(cherry picked from commit f0f5e3c0751bcadcacd6d91e2c5504803ec3d0a5)
 2015-05-08 17:22:33 +00:00
Thomas Graves
547b069887 YARN-3600. AM container link is broken (Naganarasimha G R via tgraves 
(cherry picked from commit 5d708a4725529cf09d2dd8b5b4aa3542cc8610b0)
 2015-05-08 16:37:20 +00:00
Robert (Bobby) Evans
28e0593b96 YARN-644: Basic null check is not performed on passed in arguments before using them in ContainerManagerImpl.startContainer 
(cherry picked from commit bcf2890502fbd11dd394048fe30d67c92aeec4fa)
 2015-05-08 11:11:53 -05:00
Devaraj K
bf8be56292 YARN-2784. Make POM project names consistent. Contributed by Rohith. 2015-05-08 19:26:11 +05:30
Jason Lowe
bcb863b156 YARN-3554. Default value for maximum nodemanager connect wait time is too high. Contributed by Naganarasimha G R 
(cherry picked from commit 9757864fd662b69445e0c600aedbe307a264982e)
 2015-05-08 13:47:48 +00:00
Tsuyoshi Ozawa
5ddc3adb0d YARN-3169. Drop YARN's overview document. Contributed by Brahma Reddy Battula. 
(cherry picked from commit b419c1b2ec452c2632274e93240b595161fb023b)
 2015-05-08 19:58:47 +09:00
Tsuyoshi Ozawa
b1f3590b22 YARN-3589. RM and AH web UI display DOCTYPE wrongly. Contbituted by Rohith. 
(cherry picked from commit f26700f2878f4374c68e97ee00205eda5a6d022c)
 2015-05-08 17:13:56 +09:00
Tsuyoshi Ozawa
1ae8bf5b21 MAPREDUCE-6284. Add Task Attempt State API to MapReduce Application Master REST API. Contributed by Ryu Kobayashi. 
(cherry picked from commit d18f10ad1b3e497fa1aaaeb85ba055f87d9849f7)
 2015-05-08 16:00:41 +09:00
Devaraj K
0d286d1041 YARN-3358. Audit log not present while refreshing Service ACLs. 
Contributed by Varun Saxena.

(cherry picked from commit ef3d66d4624d360e75c016e36824a6782d6a9746)
 2015-05-08 12:15:45 +05:30
Devaraj K
dce2381dc4 YARN-3592. Fix typos in RMNodeLabelsManager. Contributed by Sunil G. 
(cherry picked from commit a28cd02ba026733e409807f3ea1b36f7d57bc273)
 2015-05-08 10:55:53 +05:30
Akira Ajisaka
c7f3dd1eb3 YARN-3572. Correct typos in WritingYarnApplications.md. Contributed by Gabor Liptak. 
(cherry picked from commit a521b509551e092dfeb38cdf29bb96556d3e0266)
 2015-05-08 13:25:07 +09:00
Akira Ajisaka
170f1b0afd YARN-1832. Fix wrong MockLocalizerStatus#equals implementation. Contributed by Hong Zhiguo. 
(cherry picked from commit b167fe7605deb29ec533047d79d036eb65328853)
 2015-05-08 11:15:28 +09:00
Jian He
d817fbb34d YARN-2918. RM should not fail on startup if queue's configured labels do not exist in cluster-node-labels. Contributed by Wangda Tan 
(cherry picked from commit f489a4ec969f3727d03c8e85d51af1018fc0b2a1)
 2015-05-07 17:36:24 -07:00
Jian He
c35114a1e6 YARN-3584. Fixed attempt diagnostics format shown on the UI. Contributed by nijel 
(cherry picked from commit b88700dcd0b9aa47662009241dfb83bc4446548d)
 2015-05-07 13:56:25 -07:00
Zhijie Shen
bb035ff087 YARN-3448. Added a rolling time-to-live LevelDB timeline store implementation. Contributed by Jonathan Eagles. 
(cherry picked from commit daf3e4ef8bf73cbe4a799d51b4765809cd81089f)
 2015-05-07 10:10:13 -07:00
Junping Du
684a5a6aeb YARN-3523. Cleanup ResourceManagerAdministrationProtocol interface audience. Contributed by Naganarasimha G R 
(cherry picked from commit 8e991f4b1d7226fdcd75c5dc9fe6e5ce721679b9)
 2015-05-07 05:40:13 -07:00
Akira Ajisaka
67bebabb21 YARN-3577. Misspelling of threshold in log4j.properties for tests. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 995f1b5831fc33042de90267a689333dc110c4c3)
 2015-05-07 13:33:17 +09:00
Vinod Kumar Vavilapalli
d127dd64a7 YARN-3385. Fixed a race-condition in ResourceManager's ZooKeeper based state-store to avoid crashing on duplicate deletes. Contributed by Zhihai Xu. 
(cherry picked from commit 4c7b9b6abe2452c9752a11214762be2e7665fb32)
 2015-05-06 17:52:13 -07:00