Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,147 Commits 326 Branches 371 Tags
Commit Graph

2244 Commits

Author SHA1 Message Date
Jian He
2862057f11 YARN-4000. RM crashes with NPE if leaf queue becomes parent queue during restart. Contributed by Varun Saxena 
(cherry picked from commit cf23f2c2b5b4eb9e51de1a66b7aa57dee7ff30b5)
 2015-10-15 17:13:09 -07:00
Varun Vasudev
342870b70f YARN-4258. Add support for controlling capabilities for docker containers. Contributed by Sidharta Seethana. 
(cherry picked from commit 63020c54c12dffe03a1b3712759ec65c49df3e64)
 2015-10-15 13:41:58 +05:30
Steve Loughran
0e4fb329ed HADOOP-12478. Shell.getWinUtilsPath() has been renamed Shell.getWinutilsPath(). (stevel) 2015-10-14 20:25:33 +01:00
rohithsharmaks
526be695c0 YARN-4250. NPE in AppSchedulingInfo#isRequestLabelChanged. (Brahma Reddy Battula via rohithsharmaks) 
(cherry picked from commit d6c8bad86964dbad3cc810914f786c7c4722227a)
 2015-10-14 16:13:26 +05:30
Varun Vasudev
2dd9c475c4 YARN-4255. container-executor does not clean up docker operation command files. Contributed by Sidharta Seethana. 
(cherry picked from commit da1ee078f9d3c2c25c51d0b392b0925821c42ad3)
 2015-10-14 15:27:18 +05:30
Varun Vasudev
0aeedfd572 YARN-4252. Log container-executor invocation details when exit code is non-zero. Contributed by Sidharta Seethana. 
(cherry picked from commit fb9c1519b30cf8113cf9b8deed9b9901db5e9693)
 2015-10-14 15:19:19 +05:30
Varun Vasudev
a9b03b5afb YARN-4253. Standardize on using PrivilegedOperationExecutor for all invocations of container-executor in LinuxContainerExecutor. Contributed by Sidharta Seethana. 
(cherry picked from commit  8d5929308998869933982bd425102c3a9488ee8f)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/LinuxContainerExecutor.java
 2015-10-14 15:04:22 +05:30
Steve Loughran
5eab51a24f HADOOP-10775. Shell operations to fail with meaningful errors on windows if winutils.exe not found. (stevel) 2015-10-13 21:47:54 +01:00
Varun Vasudev
34b8142802 YARN-4017. container-executor overuses PATH_MAX. Contributed by Sidharta Seethana 
(cherry picked from commit 5b6bae00942c495e4be6ea2b8eb0676a48468dc6)
 2015-10-13 12:50:28 +05:30
Jian He
ee1ce393f5 YARN-4230. RM crashes with NPE when increasing container resource if there is no headroom left. Contributed by Meng Ding 
(cherry picked from commit 9849c8b3865c7c9c9be81ae0ef8f29caa1d5f881)
 2015-10-12 11:52:04 -07:00
Zhihai Xu
9988b57e71 YARN-4201. AMBlacklist does not work for minicluster. Contributed by Jun Gong. 
(cherry picked from commit 049c6e8dc0f952b5ff7d394aa564ab7db13e4f26)
 2015-10-12 00:16:40 -07:00
Devaraj K
28edc7b129 YARN-3964. Support NodeLabelsProvider at Resource Manager side. 
Contributed by Dian Fu.

(cherry picked from commit db9304788187c700647c4d84caeb3b5ad6d868d8)
 2015-10-11 11:24:05 +05:30
Wangda Tan
37642abb83 YARN-4140. RM container allocation delayed incase of app submitted to Nodelabel partition. (Bibin A Chundatt via wangda) 
(cherry picked from commit def374e666ed0c1d665aeb1b7307e09769448138)
 2015-10-09 16:40:10 -07:00
Karthik Kambatla
2d8f9e3fd9 MAPREDUCE-6302. Incorrect headroom can lead to a deadlock between map and reduce allocations. (kasha) 
(cherry picked from commit 4aa9b3e75ca86917125e56e1b438668273a5d87f)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/RMContainerAllocator.java
 2015-10-09 07:54:47 -07:00
Jason Lowe
0139517811 YARN-261. Ability to fail AM attempts. Contributed by Andrey Klochkov and Rohith Sharma K S 
(cherry picked from commit a0bca2b5ad2344fda5411d910a3730c85f12a0df)
 2015-10-09 14:19:41 +00:00
Rohith Sharma K S
21609e8e9a YARN-4235. FairScheduler PrimaryGroup does not handle empty groups returned for a user. (Anubhav Dhoot via rohithsharmaks) 
(cherry picked from commit 8f195387a4a4a5a278119bf4c2f15cad61f0e2c7)
 2015-10-09 10:11:53 +05:30
Jason Lowe
ec74b0cd4e YARN-3943. Use separate threshold configurations for disk-full detection and disk-not-full detection. Contributed by Zhihai Xu 
(cherry picked from commit 8d226225d030253152494bda32708377ad0f7af7)
 2015-10-08 22:26:35 +00:00
Jason Lowe
1caa05de4a Fixup CHANGES.txt to reflect recent commits to 2.7.2 and 2.6.2 
(cherry picked from commit 0841940a21737890e01731e66bc403786a78a922)
 2015-10-08 16:47:30 +00:00
Rohith Sharma K S
99126714a3 YARN-4228. FileSystemRMStateStore use IOUtils#close instead of fs#close. (Bibin A Chundatt via rohithsharmaks) 
(cherry picked from commit 3793cbe4c3cce5d03c4a18d562cbcb7cacd8f743)
 2015-10-07 10:20:36 +05:30
Rohith Sharma K S
053fcf4c0d YARN-4209. RMStateStore FENCED state doesn’t work due to updateFencedState called by stateMachine.doTransition. (Zhihai Xu via rohithsharmaks) 
(cherry picked from commit 9156fc60c654e9305411686878acb443f3be1e67)
 2015-10-07 09:37:14 +05:30
Wangda Tan
5453a63612 YARN-4215. RMNodeLabels Manager Need to verify and replace node labels for the only modified Node Label Mappings in the request. (Naganarasimha G R via wangda) 
(cherry picked from commit 29a582ada0fe195989eca25e5a995895e178f4ea)
 2015-10-06 11:59:10 -07:00
Wangda Tan
d24a3b9a3c YARN-4176. Resync NM nodelabels with RM periodically for distributed nodelabels. (Bibin A Chundatt via wangda) 
(cherry picked from commit 30ac69c6bd3db363248d6c742561371576006dab)
 2015-10-05 15:48:40 -07:00
Vinod Kumar Vavilapalli
b876babdc7 HADOOP-12441. Fixed shell-kill command behaviour to work correctly on some Linux distributions after HADOOP-12317. Contributed by Wangda Tan. 
(cherry picked from commit f1c19b9365cbac88e45a9eed516fbfc6c9aa9947)
 2015-10-05 10:57:55 -07:00
Harsh J
21b4ba48ce HADOOP-12458. Retries is typoed to spell Retires in parts of hadoop-yarn and hadoop-common. Contributed by Neelesh Srinivas Salian. 
(cherry picked from commit c918f7be5e6aecaa3cb0c23a95819329802d32d4)
 2015-10-03 18:39:22 +05:30
Xuan
53bddc410f YARN-1897. CLI and core support for signal container functionality. Contributed by Ming Ma 
(cherry picked from commit 8f08532bde153811368e1b8336446fba4743f9d2)
 2015-10-02 18:53:04 -07:00
Jason Lowe
3e3733437f YARN-3619. ContainerMetrics unregisters during getMetrics and leads to ConcurrentModificationException. Contributed by Zhihai Xu 
(cherry picked from commit fdf02d1f26cea372bf69e071f57b8bfc09c092c4)
 2015-10-02 20:21:32 +00:00
Jason Lowe
d645ee1d62 YARN-3727. For better error recovery, check if the directory exists before using it for localization. Contributed by Zhihai Xu 
(cherry picked from commit 854d25b0c30fd40f640c052e79a8747741492042)
 2015-09-30 15:01:01 +00:00
Karthik Kambatla
64a7617eb9 YARN-4066. Large number of queues choke fair scheduler. (Johan Gustavsson via kasha) 
(cherry picked from commit a0b5a0a419dfc07b7ac45c06b11b4c8dc7e79958)
 2015-09-29 08:13:25 -07:00
Anubhav Dhoot
22f2501476 YARN-4180. AMLauncher does not retry on failures when talking to NM. (adhoot) 
(cherry picked from commit 9735afe967a660f356e953348cb6c34417f41055)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestApplicationMasterLauncher.java
 2015-09-28 16:54:06 -07:00
Jason Lowe
600022ae69 YARN-4141. Runtime Application Priority change should not throw exception for applications at finishing states. Contributed by Sunil G 
(cherry picked from commit 9f53a95ff624f66a774fe3defeea4a3454f4c4af)
 2015-09-28 22:56:07 +00:00
Anubhav Dhoot
4d8b99423e YARN-4204. ConcurrentModificationException in FairSchedulerQueueInfo. (adhoot) 
(cherry picked from commit fb2e525c0775ccf218c8980676e9fb4005a406a6)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2015-09-28 09:39:52 -07:00
Xuan
bf3f08cc63 YARN-3624. ApplicationHistoryServer should not reverse the order of the 
filters it gets. Contributed by Mit Desai

(cherry picked from commit d1b9b852442cb93b413eff8a137db6213e730d9c)
 2015-09-24 15:03:05 -07:00
Jian He
ea2b6ee9e9 YARN-4171. Fix findbugs warnings in YARN-1197 branch. Contributed by Wangda Tan 
(cherry picked from commit b3f6b641dccb0d59df78855e2951d2cae7dff8ad)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2015-09-24 10:30:49 -07:00
Jian He
d458805690 YARN-1651. CapacityScheduler side changes to support container resize. Contributed by Wangda Tan 
(cherry picked from commit 89cab1ba5f0671f8ef30dbe7432079c18362b434)

Conflicts:
	hadoop-tools/hadoop-sls/src/main/java/org/apache/hadoop/yarn/sls/scheduler/SLSCapacityScheduler.java
 2015-09-24 10:30:04 -07:00
Jian He
d592aa115b YARN-3868. Recovery support for container resizing. Contributed by Meng Ding 
(cherry picked from commit c57eac5dfe277845ab4522a1188023a73ee41539)
 2015-09-24 10:24:13 -07:00
Jian He
b6c594c6ea YARN-1644. RM-NM protocol changes and NodeStatusUpdater implementation to support container resizing. Contributed by Meng Ding 
(cherry picked from commit c3dc1af072574f5890a8d43e4d60526951b4b8bc)
 2015-09-24 10:24:04 -07:00
Jian He
b8955d81c5 YARN-1643. Make ContainersMonitor support changing monitoring size of an allocated container. Contributed by Meng Ding and Wangda Tan 
(cherry picked from commit c59ae4eeb17e52e8fc659b9962d20628719fc621)
 2015-09-24 10:23:55 -07:00
Jian He
fa0a554ae0 YARN-3867. ContainerImpl changes to support container resizing. Contributed by Meng Ding 
(cherry picked from commit 5f5a968d65c44a831176764439e00db9203999ed)
 2015-09-24 10:23:46 -07:00
Jian He
afe4afd0c9 YARN-1645. ContainerManager implementation to support container resizing. Contributed by Meng Ding & Wangda Tan 
(cherry picked from commit ffd820c27a4f8cf4676ad8758696ed89fde80218)
 2015-09-24 10:23:35 -07:00
Jian He
c19e8ffdc7 YARN-1449. AM-NM protocol changes to support container resizing. Contributed by Meng Ding & Wangda Tan) 
(cherry picked from commit 83a18add10ee937a04e833a66e0a4642e776e510)
 2015-09-24 10:23:25 -07:00
Jian He
89dc37450c YARN-3866. AM-RM protocol changes to support container resizing. Contributed by Meng Ding 
(cherry picked from commit dfe2cb849fcb273d32e840d8562eaaee904af054)
 2015-09-24 10:23:13 -07:00
Rohith Sharma K S
fbb1d923f4 YARN-4044. Running applications information changes such as movequeue is not published to TimeLine server. (Sunil G via rohithsharmaks) 2015-09-24 12:17:55 +05:30
Rohith Sharma K S
ace4d26936 YARN-4152. NodeManager crash with NPE when LogAggregationService#stopContainer called for absent container. (Bibin A Chundatt via rohithsharmaks) 2015-09-24 11:31:47 +05:30
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
f48af332a7 Release process for 2.6.1: Set the release date for 2.6.1 
(cherry picked from commit 1f707ecffd80142c25ef0dee8708da49920646bc)
 2015-09-23 15:12:30 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
48eb28e7e2 YARN-3248. Moving it to improvements section in CHANGES.txt. 
(cherry picked from commit df52ff92ae42977bc743630191d1cbe1e17d00cf)
 2015-09-23 15:02:23 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
23f4cd1c5a CHANGES.txt: Moving YARN-1884, YARN-3171, YARN-3740, YARN-3248, YARN-3544 to 2.6.1 given the backport. 
(cherry picked from commit f3e5bc67661ebc7e14509f2a267131ae314699dc)
 2015-09-23 13:46:00 -07:00
Jason Lowe
b7111449a1 YARN-3975. WebAppProxyServlet should not redirect to RM page if AHS is enabled. Contributed by Mit Desai 
(cherry picked from commit 692d51c09d3668cde47cc297296d095ddfa933a3)
 2015-09-23 16:39:50 +00:00
Jason Lowe
c829be5133 YARN-4095. Avoid sharing AllocatorPerContext object in LocalDirAllocator between ShuffleHandler and LocalDirsHandlerService. Contributed by Zhihai Xu 
(cherry picked from commit c890c51a916894a985439497b8a44e8eee82d762)
 2015-09-23 15:44:13 +00:00
Tsuyoshi Ozawa
52cc2ca488 HADOOP-12428. Fix inconsistency between log-level guards and statements. Contributed by Jagadesh Kiran N and Jackie Chang. 
(cherry picked from commit dfd807afab0fae3839c9cc5d552aa0304444f956)
 2015-09-22 12:54:44 +09:00
Chris Douglas
b39b61e356 YARN-4188. Make MoveApplicationAcrossQueues abstract, newInstance static 
Contributed by Giovanni Matteo Fumarola
(cherry picked from commit 8e01b0d97ac3d74b049a801dfa1cc6e77d8f680a)
 2015-09-21 17:54:24 -07:00