Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,829 Commits 326 Branches 371 Tags
Commit Graph

2477 Commits

Author SHA1 Message Date
rohithsharmaks
9ea567da42 YARN-4109. Exception on RM scheduler page loading with labels. (Mohammad Shahid Khan via rohithsharmaks) 
(cherry picked from commit 8c180a13c82ab9d60f595e6942e35d51024dab53)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2016-05-03 10:31:32 +05:30
Robert Kanter
3c3d003402 Remove parent's env vars from child processes 
(cherry picked from commit ac8fb579c6058fec60caf30682f902413d68edf3)
 2016-04-29 15:30:06 -07:00
Jian He
5ba79d77fb YARN-5009. NMLeveldbStateStoreService database can grow substantially leading to longer recovery times. Contributed by Jason Lowe 
(cherry picked from commit 4a8508501bc753858693dacdafba61d604702f71)
 2016-04-28 21:54:53 -07:00
Jian He
e62162db46 YARN-5008. LeveldbRMStateStore database can grow substantially leading to long recovery times. Contributed by Jason Lowe 
(cherry picked from commit dd80042c42aadaa347db93028724f69c9aca69c6)
 2016-04-28 21:36:23 -07:00
Li Lu
76b4ec32e6 YARN-4956. findbug issue on LevelDBCacheTimelineStore. (Zhiyuan Yang via gtcarrera9) 
(cherry picked from commit f16722d2ef31338a57a13e2c8d18c1c62d58bbaf)
 2016-04-27 10:58:50 -07:00
Wangda Tan
358b54d063 YARN-3215. Respect labels in CapacityScheduler when computing headroom. (Naganarasimha G R via wangda) 2016-04-22 15:59:49 -07:00
Eric Payne
b726ae0876 YARN-4556. TestFifoScheduler.testResourceOverCommit fails. Contributed by Akihiro Suda 
(cherry picked from commit 3dce486d88895dcdf443f4d0064d1fb6e9116045)
 2016-04-21 22:01:07 +00:00
Vinod Kumar Vavilapalli
92e45b8321 Fixed TimelineClient to retry SocketTimeoutException too. Contributed by Xuan Gong. 
(cherry picked from commit 477003730e6a7c7eff11892f5cedf74073ca867b)
 2016-04-18 11:51:21 -07:00
Xuan
84ab382939 YARN-4965. Distributed shell AM failed due to ClientHandlerException thrown by jersey. Contributed by Junping Du 
(cherry picked from commit e6c0742012ffeacad2bcaf712d86a7e5d1420b26)
(cherry picked from commit 94e4d349b018496ab25afc164e2f25c780010cfd)
 2016-04-16 19:40:46 -07:00
Arun Suresh
aa457912ca YARN-4468. Document the general ReservationSystem functionality, and the REST API. (subru and carlo via asuresh) 
(cherry picked from commit 8460a323ce454c99e690728bc3a045513c1142e4)
 2016-04-15 17:24:44 -07:00
Jason Lowe
d389afb3da YARN-4940. yarn node -list -all failed if RM start with decommissioned node. Contributed by sandflee 
(cherry picked from commit 69f3d428d5c3ab0c79cacffc22b1f59408622ae7)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestClientRMService.java
 2016-04-15 20:45:20 +00:00
Naganarasimha
3e223d5dc0 YARN-4909. Fix intermittent failures of TestRMWebServices And TestRMWithCSRFFilter. Contributed by Bibin A Chundatt 
(cherry picked from commit fdbafbc9e59314d9f9f75e615de9d2dfdced017b)
 2016-04-16 00:00:03 +05:30
Jason Lowe
9b5c5bd42f YARN-4924. NM recovery race can lead to container not cleaned up. Contributed by sandflee 
(cherry picked from commit 3150ae8108a1fc40a67926be6254824c1e37cb38)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/ContainerManagerImpl.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/recovery/NMLeveldbStateStoreService.java
 2016-04-14 19:40:10 +00:00
Xuan
3127b86492 YARN-4886. Add HDFS caller context for EntityGroupFSTimelineStore. Contributed by Li Lu 
(cherry picked from commit e0cb426758b3d716ff143f723fc16ef2f1e4971b)
(cherry picked from commit 5bc64dafc3b20b31a6175dd556a730d197e0e737)
 2016-04-13 10:40:04 -07:00
Junping Du
c85a63aba1 YARN-4928. Some yarn.server.timeline.* tests fail on Windows attempting to use a test root path containing a colon. Contributed by Gergely Novák. 
(cherry picked from commit 08ddb3ac6da634c293c638d76b53af163ede3057)
(cherry picked from commit a3f8491410c5c8b50640904c95cc78d65410ce04)
 2016-04-13 09:05:09 -07:00
Rohith Sharma K S
9d4dedd65f YARN-4794. Deadlock in NMClientImpl. Contributed by Jian He. 
(cherry picked from commit ff722bbbdfaf9715643507628e94ece26d904b9d)
 2016-04-12 10:05:35 +05:30
Vinod Kumar Vavilapalli
3589b9e10e YARN-4168. Fixed a failing test TestLogAggregationService.testLocalFileDeletionOnDiskFull. Contributed by Takashi Ohnishi. 
(cherry picked from commit 44bbc50d919388e4ad08be2e9ba80ac7502d2579)
 2016-04-11 12:13:37 -07:00
Jason Lowe
3cf7856878 Revert "YARN-4311. Removing nodes from include and exclude lists will not remove them from decommissioned nodes list. Contributed by Kuhu Shukla" 
This reverts commit 9d3c51eb5a701ae4ba296e2fd3fba154fa0097c0.
 2016-04-11 15:57:56 +00:00
Akira Ajisaka
13be7a849d YARN-4630. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta. 
(cherry picked from commit 1ff27f9d12e8124c1b9a722708264c5b07fd0fde)
(cherry picked from commit 8cf6630fc6cedbd86eff9da6f35ce1da4ed7ed2f)
 2016-04-11 14:55:54 +09:00
Akira Ajisaka
35fd4d4124 YARN-4938. MiniYarnCluster should not request transitionToActive to RM on non-HA environment. Contributed by Eric Badger. 
(cherry picked from commit 1b78b2ba17cffdd19ae056555dd7f89b7a3eb06a)
(cherry picked from commit 88556294e20f118ecd8295f492b9617da413c83d)
 2016-04-11 01:33:02 +09:00
Wangda Tan
67ee302723 YARN-4826. Document configuration of ReservationSystem for CapacityScheduler. (Subru Krishnan via wangda) 
(cherry picked from commit fcb3fcd4c674d58e5f40b17eff7048e8ae45d151)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/CapacityScheduler.md

(cherry picked from commit dac2021f870af674ab1a64e937c4f2a388dcc692)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/CapacityScheduler.md
 2016-04-08 16:33:55 -07:00
Jian He
4cf0b1932f YARN-4740. AM may not receive the container complete msg when it restarts. Contributed by Jun Gong 2016-04-08 11:21:34 -07:00
Karthik Kambatla
ddb1407980 YARN-4756. Unnecessary wait in Node Status Updater during reboot. (Eric Badger via kasha) 
(cherry picked from commit e82f961a3925aadf9e53a009820a48ba9e4f78b6)
(cherry picked from commit 2b97a50eec8e9f7167a44b8ca0391fce0aae571c)
 2016-04-07 17:35:06 -07:00
Wangda Tan
b7c83d4883 YARN-4699. Scheduler UI and REST o/p is not in sync when -replaceLabelsOnNode is used to change label of a node. (Sunil G via wangda) 
(cherry picked from commit 21eb4284487d6f8e4beedb8a0c3168e952f224fc)
 2016-04-05 16:30:56 -07:00
Masatake Iwasaki
deef54b261 YARN-4917. Fix typos in documentation of Capacity Scheduler. (Takashi Ohnishi via iwasakims) 
(cherry picked from commit 500e5a5952f8f34bf0e1e2653fa01b357d68cc8f)
 2016-04-06 04:01:48 +09:00
Masatake Iwasaki
90adda5da5 YARN-4915. Fix typo in YARN Secure Containers documentation (Takashi Ohnishi via iwasakims) 
(cherry picked from commit 30206346cf13fe1b7267f86e7c210b77c86b88c9)
 2016-04-06 03:47:53 +09:00
Junping Du
3df56a97df Small addendum to YARN-4893 to fix build failure. 2016-04-05 08:41:48 -07:00
Junping Du
9c2dc1a194 YARN-4893. Fix some intermittent test failures in TestRMAdminService. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 6be28bcc461292b24589dae17a235b3eaadc07ed)
(cherry picked from commit eeff2e35f8a2b35568e57846b66f602845c3bbe1)
 2016-04-05 08:41:48 -07:00
Jason Lowe
9d3c51eb5a YARN-4311. Removing nodes from include and exclude lists will not remove them from decommissioned nodes list. Contributed by Kuhu Shukla 
(cherry picked from commit 1cbcd4a491e6a57d466c2897335614dc6770b475)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/yarn-default.xml
 2016-04-05 13:47:05 +00:00
Li Lu
3574b4559c YARN-4706. UI Hosting Configuration in TimelineServer doc is broken. (Akira AJISAKA via gtcarrera9) 
(cherry picked from commit f61de4173684aa1767cef20b3cb4d54df20273cd)
 2016-04-04 14:43:37 -07:00
naganarasimha
9bd089ac64 YARN-4746. yarn web services should convert parse failures of appId, appAttemptId and containerId to 400. Contributed by Bibin A Chundatt 
(cherry picked from commit 5092c94195a63bd2c3e36d5a74b4c061cea1b847)
 2016-04-04 18:16:23 +05:30
Allen Wittenauer
608223b51b YARN-4850. test-fair-scheduler.xml isn't valid xml (Yufei Gu via aw) 
(cherry picked from commit b1394d6307425a41d388c71e39f0880babb2c7a9)
(cherry picked from commit 92a3dbe44ffb113dead560fc179c2bc15fd6fce8)
 2016-04-01 16:58:00 -07:00
Arun Suresh
82d1f858ee Missing file for YARN-4895. 
(cherry picked from commit 5686caa9fcb59759c9286385575f31e407a97c16)
 2016-04-01 15:58:54 -07:00
Arun Suresh
9def4d4d39 YARN-4895. Add subtractFrom method to ResourceUtilization class. Contributed by Konstantinos Karanasos. 
(cherry picked from commit 82621e38a0445832998bc00693279e23a98605c1)
 2016-04-01 15:00:30 -07:00
Wangda Tan
6d454a5d6e YARN-4634. Scheduler UI/Metrics need to consider cases like non-queue label mappings. (Sunil G via wangda) 
(cherry picked from commit 12b11e2e688158404feeb3ded37eb6cccad4ea5c)
 2016-03-31 14:36:34 -07:00
Sangjin Lee
5e94e539e0 YARN-4183. Clarify the behavior of timeline service config properties (Naganarasimha G R via sjlee) 
(cherry picked from commit 6d67420dbc5c6097216fa40fcec8ed626b2bae14)
 2016-03-31 10:50:18 -07:00
Xuan
d5ea2462c2 YARN-4863. AHS Security login should be in serviceInit() instead of serviceStart(). Contributed by Junping Du 
(cherry picked from commit 80182809aed76fb9522d25db9bf5e445395dd573)
(cherry picked from commit ffe01e05cdfe0c1484de0f2116014a63cdc51364)
 2016-03-28 22:21:31 -07:00
Jason Lowe
35f9cfda61 YARN-4773. Log aggregation performs extraneous filesystem operations when rolling log aggregation is disabled. Contributed by Jun Gong 
(cherry picked from commit 948b75807068c304ffe789e32f2b850c0d653e0a)
 2016-03-28 23:03:16 +00:00
Jian He
7c81e374da YARN-4117. End to end unit test with mini YARN cluster for AMRMProxy Service. Contributed by Giovanni Matteo Fumarola 2016-03-28 13:23:53 -07:00
Jian He
0c84f9aee2 YARN-998. Keep NM resource updated through dynamic resource config for RM/NM restart. Contributed by Junping Du 
(cherry picked from commit c7d843af3b1adde602fe0335f52ffa28b0371bf4)
 2016-03-28 11:28:59 -07:00
Arun Suresh
1a194f8751 YARN-4823. Refactor the nested reservation id field in listReservation to simple string field. (subru via asuresh) 
(cherry picked from commit 00bebb7e58ba6899904e1619d151aa1b2f5b6acd)
 2016-03-25 15:57:11 -07:00
Jason Lowe
e06446be74 YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. Contributed by Xuan Gong 
(cherry picked from commit e8fc81f9c812b0c167411de7f1789a9a433a0d57)
 2016-03-25 20:20:01 +00:00
Arun Suresh
945e3cd55c YARN-4687. Document Reservation ACLs (Contributed by Sean Po) 
(cherry picked from commit 2e1d0ff4e901b8313c8d71869735b94ed8bc40a0)
 2016-03-24 10:42:07 -07:00
Arun Suresh
2399e1e46a YARN-4683. Document the List Reservations REST API. (Contributed by Sean Po) 
(cherry picked from commit d820975c1aadd74e79ed6c7da02a4124abcc1172)
 2016-03-24 10:32:13 -07:00
Arun Suresh
3c2b610b68 YARN-4825. Remove redundant code in ClientRMService::listReservations. (subru via asuresh) 
(cherry picked from commit d82e797b652f248e238bdf1818e6b4a5b91cea7a)
 2016-03-24 10:02:17 -07:00
Junping Du
782db43d18 YARN-4820. ResourceManager web redirects in HA mode drops query parameters. Contributed by Varun Vasudev. 
(cherry picked from commit 19b645c93801a53d4486f9a7639186525e51f723)
(cherry picked from commit c722262c759d5cddf97de4249c563c8d165b7c9f)
 2016-03-23 19:39:09 -07:00
Junping Du
762c7d4361 YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. Contributed by Xuan Gong. 
(cherry picked from commit af1d125f9ce35ec69a610674a1c5c60cc17141a7)
(cherry picked from commit 76602161c006ddc9cf2404ac762f127f107d14cd)
 2016-03-23 09:02:56 -07:00
Eric Payne
878e1cfc77 YARN-4686. MiniYARNCluster.start() returns before cluster is completely started. Contributed by Eric Badger. 
(cherry picked from commit 92b7e0d41302b6b110927f99de5c2b4a4a93c5fd)
 2016-03-18 17:19:06 +00:00
Junping Du
52ce763a54 YARN-4785. inconsistent value type of the type field for LeafQueueInfo in response of RM REST API. 
(cherry picked from commit ca8106d2dd03458944303d93679daa03b1d82ad5)
(cherry picked from commit 66257613b420ea8e0754f6ea8fc2d6816f0741e0)
 2016-03-17 09:30:43 -07:00
Xuan
d21bee170b Revert "YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. (Xuan Gong via gtcarrera9)" 
This reverts commit 3a0b69544183f71c4683bc477656473494fc09d0.

(cherry picked from commit a888b5bc533bb91a3394f15a69879be1d7838592)
(cherry picked from commit 398dbde538e0bda2ec8a3b9f21c52526dfa90754)
 2016-03-15 22:12:05 -07:00