Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,010 Commits 326 Branches 371 Tags
Commit Graph

2496 Commits

Author SHA1 Message Date
Xuan
3127b86492 YARN-4886. Add HDFS caller context for EntityGroupFSTimelineStore. Contributed by Li Lu 
(cherry picked from commit e0cb426758b3d716ff143f723fc16ef2f1e4971b)
(cherry picked from commit 5bc64dafc3b20b31a6175dd556a730d197e0e737)
 2016-04-13 10:40:04 -07:00
Junping Du
c85a63aba1 YARN-4928. Some yarn.server.timeline.* tests fail on Windows attempting to use a test root path containing a colon. Contributed by Gergely Novák. 
(cherry picked from commit 08ddb3ac6da634c293c638d76b53af163ede3057)
(cherry picked from commit a3f8491410c5c8b50640904c95cc78d65410ce04)
 2016-04-13 09:05:09 -07:00
Rohith Sharma K S
9d4dedd65f YARN-4794. Deadlock in NMClientImpl. Contributed by Jian He. 
(cherry picked from commit ff722bbbdfaf9715643507628e94ece26d904b9d)
 2016-04-12 10:05:35 +05:30
Vinod Kumar Vavilapalli
3589b9e10e YARN-4168. Fixed a failing test TestLogAggregationService.testLocalFileDeletionOnDiskFull. Contributed by Takashi Ohnishi. 
(cherry picked from commit 44bbc50d919388e4ad08be2e9ba80ac7502d2579)
 2016-04-11 12:13:37 -07:00
Jason Lowe
3cf7856878 Revert "YARN-4311. Removing nodes from include and exclude lists will not remove them from decommissioned nodes list. Contributed by Kuhu Shukla" 
This reverts commit 9d3c51eb5a701ae4ba296e2fd3fba154fa0097c0.
 2016-04-11 15:57:56 +00:00
Akira Ajisaka
13be7a849d YARN-4630. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta. 
(cherry picked from commit 1ff27f9d12e8124c1b9a722708264c5b07fd0fde)
(cherry picked from commit 8cf6630fc6cedbd86eff9da6f35ce1da4ed7ed2f)
 2016-04-11 14:55:54 +09:00
Akira Ajisaka
35fd4d4124 YARN-4938. MiniYarnCluster should not request transitionToActive to RM on non-HA environment. Contributed by Eric Badger. 
(cherry picked from commit 1b78b2ba17cffdd19ae056555dd7f89b7a3eb06a)
(cherry picked from commit 88556294e20f118ecd8295f492b9617da413c83d)
 2016-04-11 01:33:02 +09:00
Wangda Tan
67ee302723 YARN-4826. Document configuration of ReservationSystem for CapacityScheduler. (Subru Krishnan via wangda) 
(cherry picked from commit fcb3fcd4c674d58e5f40b17eff7048e8ae45d151)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/CapacityScheduler.md

(cherry picked from commit dac2021f870af674ab1a64e937c4f2a388dcc692)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/CapacityScheduler.md
 2016-04-08 16:33:55 -07:00
Jian He
4cf0b1932f YARN-4740. AM may not receive the container complete msg when it restarts. Contributed by Jun Gong 2016-04-08 11:21:34 -07:00
Karthik Kambatla
ddb1407980 YARN-4756. Unnecessary wait in Node Status Updater during reboot. (Eric Badger via kasha) 
(cherry picked from commit e82f961a3925aadf9e53a009820a48ba9e4f78b6)
(cherry picked from commit 2b97a50eec8e9f7167a44b8ca0391fce0aae571c)
 2016-04-07 17:35:06 -07:00
Wangda Tan
b7c83d4883 YARN-4699. Scheduler UI and REST o/p is not in sync when -replaceLabelsOnNode is used to change label of a node. (Sunil G via wangda) 
(cherry picked from commit 21eb4284487d6f8e4beedb8a0c3168e952f224fc)
 2016-04-05 16:30:56 -07:00
Masatake Iwasaki
deef54b261 YARN-4917. Fix typos in documentation of Capacity Scheduler. (Takashi Ohnishi via iwasakims) 
(cherry picked from commit 500e5a5952f8f34bf0e1e2653fa01b357d68cc8f)
 2016-04-06 04:01:48 +09:00
Masatake Iwasaki
90adda5da5 YARN-4915. Fix typo in YARN Secure Containers documentation (Takashi Ohnishi via iwasakims) 
(cherry picked from commit 30206346cf13fe1b7267f86e7c210b77c86b88c9)
 2016-04-06 03:47:53 +09:00
Junping Du
3df56a97df Small addendum to YARN-4893 to fix build failure. 2016-04-05 08:41:48 -07:00
Junping Du
9c2dc1a194 YARN-4893. Fix some intermittent test failures in TestRMAdminService. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 6be28bcc461292b24589dae17a235b3eaadc07ed)
(cherry picked from commit eeff2e35f8a2b35568e57846b66f602845c3bbe1)
 2016-04-05 08:41:48 -07:00
Jason Lowe
9d3c51eb5a YARN-4311. Removing nodes from include and exclude lists will not remove them from decommissioned nodes list. Contributed by Kuhu Shukla 
(cherry picked from commit 1cbcd4a491e6a57d466c2897335614dc6770b475)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/yarn-default.xml
 2016-04-05 13:47:05 +00:00
Li Lu
3574b4559c YARN-4706. UI Hosting Configuration in TimelineServer doc is broken. (Akira AJISAKA via gtcarrera9) 
(cherry picked from commit f61de4173684aa1767cef20b3cb4d54df20273cd)
 2016-04-04 14:43:37 -07:00
naganarasimha
9bd089ac64 YARN-4746. yarn web services should convert parse failures of appId, appAttemptId and containerId to 400. Contributed by Bibin A Chundatt 
(cherry picked from commit 5092c94195a63bd2c3e36d5a74b4c061cea1b847)
 2016-04-04 18:16:23 +05:30
Allen Wittenauer
608223b51b YARN-4850. test-fair-scheduler.xml isn't valid xml (Yufei Gu via aw) 
(cherry picked from commit b1394d6307425a41d388c71e39f0880babb2c7a9)
(cherry picked from commit 92a3dbe44ffb113dead560fc179c2bc15fd6fce8)
 2016-04-01 16:58:00 -07:00
Arun Suresh
82d1f858ee Missing file for YARN-4895. 
(cherry picked from commit 5686caa9fcb59759c9286385575f31e407a97c16)
 2016-04-01 15:58:54 -07:00
Arun Suresh
9def4d4d39 YARN-4895. Add subtractFrom method to ResourceUtilization class. Contributed by Konstantinos Karanasos. 
(cherry picked from commit 82621e38a0445832998bc00693279e23a98605c1)
 2016-04-01 15:00:30 -07:00
Wangda Tan
6d454a5d6e YARN-4634. Scheduler UI/Metrics need to consider cases like non-queue label mappings. (Sunil G via wangda) 
(cherry picked from commit 12b11e2e688158404feeb3ded37eb6cccad4ea5c)
 2016-03-31 14:36:34 -07:00
Sangjin Lee
5e94e539e0 YARN-4183. Clarify the behavior of timeline service config properties (Naganarasimha G R via sjlee) 
(cherry picked from commit 6d67420dbc5c6097216fa40fcec8ed626b2bae14)
 2016-03-31 10:50:18 -07:00
Xuan
d5ea2462c2 YARN-4863. AHS Security login should be in serviceInit() instead of serviceStart(). Contributed by Junping Du 
(cherry picked from commit 80182809aed76fb9522d25db9bf5e445395dd573)
(cherry picked from commit ffe01e05cdfe0c1484de0f2116014a63cdc51364)
 2016-03-28 22:21:31 -07:00
Jason Lowe
35f9cfda61 YARN-4773. Log aggregation performs extraneous filesystem operations when rolling log aggregation is disabled. Contributed by Jun Gong 
(cherry picked from commit 948b75807068c304ffe789e32f2b850c0d653e0a)
 2016-03-28 23:03:16 +00:00
Jian He
7c81e374da YARN-4117. End to end unit test with mini YARN cluster for AMRMProxy Service. Contributed by Giovanni Matteo Fumarola 2016-03-28 13:23:53 -07:00
Jian He
0c84f9aee2 YARN-998. Keep NM resource updated through dynamic resource config for RM/NM restart. Contributed by Junping Du 
(cherry picked from commit c7d843af3b1adde602fe0335f52ffa28b0371bf4)
 2016-03-28 11:28:59 -07:00
Arun Suresh
1a194f8751 YARN-4823. Refactor the nested reservation id field in listReservation to simple string field. (subru via asuresh) 
(cherry picked from commit 00bebb7e58ba6899904e1619d151aa1b2f5b6acd)
 2016-03-25 15:57:11 -07:00
Jason Lowe
e06446be74 YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. Contributed by Xuan Gong 
(cherry picked from commit e8fc81f9c812b0c167411de7f1789a9a433a0d57)
 2016-03-25 20:20:01 +00:00
Arun Suresh
945e3cd55c YARN-4687. Document Reservation ACLs (Contributed by Sean Po) 
(cherry picked from commit 2e1d0ff4e901b8313c8d71869735b94ed8bc40a0)
 2016-03-24 10:42:07 -07:00
Arun Suresh
2399e1e46a YARN-4683. Document the List Reservations REST API. (Contributed by Sean Po) 
(cherry picked from commit d820975c1aadd74e79ed6c7da02a4124abcc1172)
 2016-03-24 10:32:13 -07:00
Arun Suresh
3c2b610b68 YARN-4825. Remove redundant code in ClientRMService::listReservations. (subru via asuresh) 
(cherry picked from commit d82e797b652f248e238bdf1818e6b4a5b91cea7a)
 2016-03-24 10:02:17 -07:00
Junping Du
782db43d18 YARN-4820. ResourceManager web redirects in HA mode drops query parameters. Contributed by Varun Vasudev. 
(cherry picked from commit 19b645c93801a53d4486f9a7639186525e51f723)
(cherry picked from commit c722262c759d5cddf97de4249c563c8d165b7c9f)
 2016-03-23 19:39:09 -07:00
Junping Du
762c7d4361 YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. Contributed by Xuan Gong. 
(cherry picked from commit af1d125f9ce35ec69a610674a1c5c60cc17141a7)
(cherry picked from commit 76602161c006ddc9cf2404ac762f127f107d14cd)
 2016-03-23 09:02:56 -07:00
Eric Payne
878e1cfc77 YARN-4686. MiniYARNCluster.start() returns before cluster is completely started. Contributed by Eric Badger. 
(cherry picked from commit 92b7e0d41302b6b110927f99de5c2b4a4a93c5fd)
 2016-03-18 17:19:06 +00:00
Junping Du
52ce763a54 YARN-4785. inconsistent value type of the type field for LeafQueueInfo in response of RM REST API. 
(cherry picked from commit ca8106d2dd03458944303d93679daa03b1d82ad5)
(cherry picked from commit 66257613b420ea8e0754f6ea8fc2d6816f0741e0)
 2016-03-17 09:30:43 -07:00
Xuan
d21bee170b Revert "YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. (Xuan Gong via gtcarrera9)" 
This reverts commit 3a0b69544183f71c4683bc477656473494fc09d0.

(cherry picked from commit a888b5bc533bb91a3394f15a69879be1d7838592)
(cherry picked from commit 398dbde538e0bda2ec8a3b9f21c52526dfa90754)
 2016-03-15 22:12:05 -07:00
Li Lu
8640a9c45f YARN-4817. Change Log Level to DEBUG for putDomain call in ATS 1.5. (Xuan Gong via gtcarrera9) 
(cherry-picked from commit 5176a69868484f864c977a6cd13923167082407c)
 2016-03-15 11:49:09 -07:00
Li Lu
0ebc947140 YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. (Xuan Gong via gtcarrera9) 
(cherry picked from commit 3a0b69544183f71c4683bc477656473494fc09d0)
 2016-03-15 11:43:39 -07:00
Junping Du
4f5b496b8a YARN-4545. Allow YARN distributed shell to use ATS v1.5 APIs. Li Lu via junping_du 
(cherry picked from commit f291d82cd49c04a81380bc45c97c279d791b571c)
(cherry picked from commit 3d5ac829da9946ec0de0309e39f5b7269ee7b0c0)
 2016-03-14 08:34:08 -07:00
Li Lu
92e86ff0cb YARN-4696. Improving EntityGroupFSTimelineStore on exception handling, test setup, and concurrency. 
This commit amends commit d49cfb350454c2dfa2f3eb70f79b6d5030ce7bec with a missed test file.

(cherry picked from commit 017d2c127b9cbd75d3e31467172ed832f27ef826)
 2016-03-10 13:06:02 -08:00
Li Lu
8e89bb9d38 YARN-4696. Improving EntityGroupFSTimelineStore on exception handling, test setup, and concurrency. (Steve Loughran via gtcarrera9) 
(cherry-picked from commit d49cfb350454c2dfa2f3eb70f79b6d5030ce7bec)
 2016-03-10 10:58:51 -08:00
Allen Wittenauer
8b4a8ff1b2 Revert "HADOOP-12366. expose calculated paths (aw)" 
This reverts commit 81a7ad45c9b3f38a4b99e897bb304c362fb1bdf5.
 2016-03-09 09:59:33 -08:00
Chris Nauroth
a3cd43990c HADOOP-12905. Clean up CHANGES.txt RAT exclusions from pom.xml files. Contributed by Chris Nauroth. 
(cherry picked from commit 89b16d27e26216fc4e5153683105b323c310a0af)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/pom.xml
	hadoop-mapreduce-project/pom.xml

(cherry picked from commit 38a031ce68c65956b3dd69b6a93baab1be2beac7)
 2016-03-08 21:23:07 -08:00
Wangda Tan
06088c4c67 YARN-4465. SchedulerUtils#validateRequest for Label check should happen only when nodelabel enabled. (Bibin A Chundatt via wangda) 
(cherry picked from commit 0233d4e0ee9947a95c018b1539310fc0bff6c44e)
 2016-03-08 14:31:40 -08:00
Akira Ajisaka
2acd4c3bd2 HADOOP-12860. Expand section "Data Encryption on HTTP" in SecureMode documentation. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit f86850b544dcb34ee3c9336fad584309e886dbed)
(cherry picked from commit 0586386472dddf68826a8d2b6aa647c86d1f18ad)
 2016-03-08 14:30:01 +09:00
Jason Lowe
0d734cea44 YARN-4760. proxy redirect to history server uses wrong URL. Contributed by Eric Badger 
(cherry picked from commit 4163e36c2be2f562545aba93c1d47643a9ff4741)
 2016-03-07 15:58:01 +00:00
Jason Lowe
53ec7c9243 YARN-4744. Too many signal to container failure in case of LCE. Contributed by Sidharta Seethana 
(cherry picked from commit 059caf99891943d9587cac19b48e82efbed06b2d)
 2016-03-07 15:48:06 +00:00
Zhihai Xu
1a99d5ab97 YARN-4761. NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations on fair scheduler. Contributed by Sangjin Lee 
(cherry picked from commit e1ccc9622b2f1fbefea1862fa74d1fb56d8eb264)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/TestAbstractYarnScheduler.java
 2016-03-06 20:03:55 -08:00
Masatake Iwasaki
9d551a3adf HADOOP-12470. In-page TOC of documentation should be automatically generated by doxia macro (iwasakims) 
(cherry picked from commit cbd31328a61252f253aa2bcdb9cad70f7876d231)

 Conflicts:
	hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md
	hadoop-common-project/hadoop-common/src/site/markdown/UnixShellGuide.md

(cherry picked from commit 722182fdfbb654be655fbca42f34bba5a05c2f6d)
 2016-03-04 14:13:30 +09:00