1489 Commits

Author SHA1 Message Date
Karthik Kambatla
5913c5143b Update release date for 2.5.2
(cherry picked from commit 1e9a3f42ff49be788ac99e5f06a7984d1d0638cc)
2014-11-21 14:35:06 -08:00
Jonathan Eagles
a9b76813a2 YARN-2375. Allow enabling/disabling timeline server per framework. (Mit Desai via jeagles)
(cherry picked from commit c298a9a845f89317eb9efad332e6657c56736a4d)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
2014-11-20 23:54:59 -06:00
Arun C. Murthy
98a4538cf4 Preparing to release hadoop-2.6.0-rc1.
(cherry picked from commit 9ff7315cbe9804bebcd1ec093fac7828a72ddf59)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-mapreduce-project/CHANGES.txt
	hadoop-yarn-project/CHANGES.txt
2014-11-13 13:05:50 -08:00
Arun C. Murthy
4e9b46da11 YARN-1964. Adding changelog back in. 2014-11-13 11:39:35 -08:00
Arun C. Murthy
32032ace21 YARN-2853. Merging to branch-2.6 for hadoop-2.6.0-rc1.
(cherry picked from commit d648e60ebab7f1942dba92e9cd2cb62b8d70419b)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
2014-11-13 10:40:33 -08:00
Vinod Kumar Vavilapalli
56020955fd YARN-2853. Fixed a bug in ResourceManager causing apps to hang when the user kill request races with ApplicationMaster finish. Contributed by Jian He.
(cherry picked from commit 3651fe1b089851b38be351c00a9899817166bf3e)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
2014-11-13 10:40:09 -08:00
Arun C. Murthy
f8892660a8 YARN-2635. Merging to branch-2.6 for hadoop-2.6.0-rc1.
(cherry picked from commit 81dc0ac6dcf2f34ad607da815ea0144f178691a9)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
2014-11-13 10:36:58 -08:00
Karthik Kambatla
b579c3d405 YARN-2635. TestRM, TestRMRestart, TestClientToAMTokens should run with both CS and FS. (Wei Yan and kasha via kasha)
(cherry picked from commit 80d11eb68e60f88e16d7d41edecbddfc935a6b10)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/security/TestClientToAMTokens.java
2014-11-13 10:36:13 -08:00
Jason Lowe
685790e027 YARN-2846. Incorrect persist exit code for running containers in reacquireContainer() that interrupted by NodeManager restart. Contributed by Junping Du
(cherry picked from commit 33ea5ae92b9dd3abace104903d9a94d17dd75af5)
2014-11-13 16:12:30 +00:00
Zhijie Shen
1535e7211e YARN-2794. Fixed log messages about distributing system-credentials. Contributed by Jian He.
(cherry picked from commit be7bf956e96dd0fd9b521ca71df9124b9cc5ebd0)
2014-11-12 11:10:47 -08:00
Arun C. Murthy
de0073cbc4 YARN-2843. Merging to branch-2.6 for hadoop-2.6.0-rc1.
(cherry picked from commit 51957ca81886ac3553c44848631fdf53766a25ae)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
2014-11-12 10:44:43 -08:00
Vinod Kumar Vavilapalli
7a8a413eb2 YARN-2843. Fixed NodeLabelsManager to trim inputs for hosts and labels so as to make them work correctly. Contributed by Wangda Tan.
(cherry picked from commit 0fd97f9c1989a793b882e6678285607472a3f75a)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
2014-11-12 10:44:08 -08:00
Xuan
a690629ffc YARN-2841. RMProxy should retry EOFException. Contributed by Jian He 2014-11-12 10:28:55 -08:00
Ravi Prakash
9613a57e83 YARN-1964. Create Docker analog of the LinuxContainerExecutor in YARN 2014-11-12 09:33:42 -08:00
Karthik Kambatla
ba01844260 Set the release date for 2.5.2
(cherry picked from commit 68a050872896f93582f95420dd6e2bdefa4fd7cc)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt

(cherry picked from commit 92de44c2c58321c12bd8796859d54638e3cba9bd)
2014-11-10 15:24:14 -08:00
Arun C. Murthy
60584c732f Preparing to release hadoop-2.6.0: Set version in branch-2.6 to 2.6.1-SNAPSHOT. 2014-11-09 19:21:11 -08:00
Vinod Kumar Vavilapalli
6a9534e9cf YARN-2834. Fixed ResourceManager to ignore token-renewal failures on recovery consistent with the (somewhat incorrect) behaviour in the non-recovery case. Contributed by Jian He.
Fixed a minor import issue in the test during cherry-pick from trunk.

(cherry picked from commit e76faebc9589654e83c8244ef9aff88391e56b80)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestWorkPreservingRMRestart.java
2014-11-09 19:09:48 -08:00
Arun C. Murthy
be31db82f7 Updated CHANGES.txt to reflect hadoop-2.6.0 release dates.
(cherry picked from commit 770cc144425b6188d9b93178c77a35cd830a60df)
2014-11-09 18:53:55 -08:00
Karthik Kambatla
e9f7079c58 Fix broken download of directories
(cherry picked from commit 745c9a01243b8eefc72d89d1164d7d010b80983b)
2014-11-09 18:38:57 -08:00
Arun C. Murthy
c2cc879f01 YARN-2830. Add backwords compatible ContainerId.newInstance constructor. Contributed by Jonathan Eagles.
(cherry picked from commit 43cd07b408c6613d2c9aa89203cfa3110d830538)
2014-11-09 15:04:55 -08:00
Vinod Kumar Vavilapalli
f098b261fe YARN-2607. Fixed issues in TestDistributedShell. Contributed by Wangda Tan.
(cherry picked from commit 737d9284c109dac20ff423f30c62f6abe2db10f7)
2014-11-08 11:02:55 -08:00
Zhijie Shen
33da0f8ecf YARN-2505. Supported get/add/remove/change labels in RM REST API. Contributed by Craig Welch.
(cherry picked from commit 9a4e0d343e9e891c10ef6682e7b2231a59e69ade)
2014-11-07 20:40:56 -08:00
Vinod Kumar Vavilapalli
6ff765bea2 YARN-2826. Fixed user-groups mappings' refresh bug caused by YARN-2826. Contributed by Wangda Tan.
(cherry picked from commit df36edf751202db00d8f43103d7120ec56d70a04)
2014-11-07 19:45:23 -08:00
Xuan
629274c09b YARN-2819. NPE in ATS Timeline Domains when upgrading from 2.4 to 2.6. Contributed by Zhijie Shen
(cherry picked from commit 4a114dd67aae83e5bb2d65470166de954acf36a2)
(cherry picked from commit 7d26cffb0cb21c16b335e8ae9b02523565ad3b5d)
2014-11-07 16:13:38 -08:00
Jason Lowe
dcc1ab15ab YARN-2632. Document NM Restart feature. Contributed by Junping Du and Vinod Kumar Vavilapalli
(cherry picked from commit 1e215e8ba2e801eb26f16c307daee756d6b2ca66)
2014-11-07 23:42:26 +00:00
Jason Lowe
e5c0fa2c95 YARN-2825. Container leak on NM. Contributed by Jian He
(cherry picked from commit c3d475070a1ec54c4b05923f4782cef204effd2c)
2014-11-07 23:17:49 +00:00
Vinod Kumar Vavilapalli
6593aaf117 YARN-2753. Fixed a bunch of bugs in the NodeLabelsManager classes. Contributed by Zhihai xu.
(cherry picked from commit 4cfd5bc7c18bb9a828f573b5c4d2b13fa28e732a)
2014-11-07 14:17:23 -08:00
cnauroth
9adb31b6a8 YARN-2803. MR distributed cache not working correctly on Windows after NodeManager privileged account changes. Contributed by Craig Welch.
(cherry picked from commit 06b797947c980d7d21864eb8b700cf565756aac1)
(cherry picked from commit c16f7182937dc4e8bbf46dfedd9db427a0a33357)
2014-11-07 12:45:25 -08:00
Vinod Kumar Vavilapalli
326c722eb7 YARN-2827. Fixed bugs in "yarn queue" CLI. Contributed by Wangda Tan.
(cherry picked from commit 7b190796578c55d1f282188a53ccfa2abd8cab21)
2014-11-07 12:01:33 -08:00
Vinod Kumar Vavilapalli
71a18a5303 YARN-2824. Fixed Capacity Scheduler to not crash when some node-labels are not mapped to queues by making default capacities per label to be zero. Contributed by Wangda Tan.
(cherry picked from commit 2ac1be7dec4aef001e3162e364249933b2c4a6c4)
2014-11-07 10:45:01 -08:00
Xuan
09955ea2c3 YARN-2810. TestRMProxyUsersConf fails on Windows VMs. Contributed by Varun Vasudev
(cherry picked from commit 1e97f2f09464e871773188f642f3a01b744c580f)
(cherry picked from commit bf795418686e1559db4c37c0b107bb5c08bbf525)
2014-11-07 09:46:53 -08:00
Vinod Kumar Vavilapalli
9f7396be55 YARN-2823. Fixed ResourceManager app-attempt state machine to inform schedulers about previous finished attempts of a running appliation to avoid expectation mismatch w.r.t transferred containers. Contributed by Jian He.
(cherry picked from commit a5657182a7accebe08cd86e46b4cdeb163d4d1f2)
2014-11-07 09:30:31 -08:00
Vinod Kumar Vavilapalli
8c3a0d5a98 YARN-2647. Added a queue CLI for getting queue information. Contributed by Sunil Govind.
(cherry picked from commit 61effcbebc819ee1bd3d60f5444c39c972494a32)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/bin/yarn

(cherry picked from commit b1521c7c3ce7dfaabdb3fc1d74c10970dda57fe5)
2014-11-06 22:22:16 -08:00
Vinod Kumar Vavilapalli
21ef5afafa YARN-2744. Fixed CapacityScheduler to validate node-labels correctly against queues. Contributed by Wangda Tan.
(cherry picked from commit a3839a9fbfb8eec396b9bf85472d25e0ffc3aab2)
2014-11-06 17:29:39 -08:00
Steve Loughran
e333584ca6 YARN-2768 Improved Yarn Registry service record structure (stevel) 2014-11-06 20:21:49 +00:00
Vinod Kumar Vavilapalli
b557f689b4 YARN-2818. Removed the now unnecessary user entity injection from Timeline service given we now have domains. Contributed by Zhijie Shen.
(cherry picked from commit f5b19bed7d71979dc8685b03152188902b6e45e9)
2014-11-06 11:50:12 -08:00
Xuan
43854764a9 YARN-2812. TestApplicationHistoryServer is likely to fail on less powerful machine. Contributed by Zhijie Shen
(cherry picked from commit b0b52c4e11336ca2ad6a02d64c0b5d5a8f1339ae)
(cherry picked from commit 4aa98d599194a444c9d2e1fe95262e32bf744d35)
2014-11-05 20:45:09 -08:00
Xuan
888fc4af4e YARN-2813. Fixed NPE from MemoryTimelineStore.getDomains. Contributed by Zhijie Shen 2014-11-05 18:27:41 -08:00
Jian He
e29e864c51 YARN-2579. Fixed a deadlock issue when EmbeddedElectorService and FatalEventDispatcher try to transition RM to StandBy at the same time. Contributed by Rohith Sharmaks
(cherry picked from commit 395275af8622c780b9071c243422b0780e096202)
2014-11-05 17:03:26 -08:00
Vinod Kumar Vavilapalli
812ddc3991 YARN-2805. Fixed ResourceManager to load HA configs correctly before kerberos login. Contributed by Wangda Tan.
(cherry picked from commit 834e931d8efe4d806347b266e7e62929ce05389b)
2014-11-05 15:32:49 -08:00
Zhijie Shen
a1764e4d33 YARN-2767. Added a test case to verify that http static user cannot kill or submit apps in the secure mode. Contributed by Varun Vasudev.
(cherry picked from commit 7a4c92a9d55fcecef066053ac30dff0fcd4ec90c)
2014-11-05 11:04:38 -08:00
Vinod Kumar Vavilapalli
87e880b580 YARN-2804. Fixed Timeline service to not fill the logs with JAXB bindings exceptions. Contributed by Zhijie Shen.
(cherry picked from commit b76179895dd2ef4d56e8de31e9f673375faa2afa)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
2014-11-04 18:04:37 -08:00
Karthik Kambatla
36993e39d0 YARN-2010. Handle app-recovery failures gracefully. (Jian He and Karthik Kambatla via kasha)
(cherry picked from commit b2cd2698028118b6384904732dbf94942f644732)
2014-11-04 17:49:56 -08:00
Karthik Kambatla
d76756dfe1 Adding release 2.5.2 to CHANGES.txt
(cherry picked from commit 4de56d27fbed566f143b286aa74b16ef94260190)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
2014-11-04 16:52:56 -08:00
Zhijie Shen
1550617e48 YARN-2752. Made ContainerExecutor append "nice -n" arg only when priority adjustment flag is set. Contributed by Xuan Gong.
(cherry picked from commit e06c23a6c92ef783cdb45447fa2abd1ab48d166f)
2014-11-04 15:54:28 -08:00
Vinod Kumar Vavilapalli
0b73606b1c YARN-1922. Fixed NodeManager to kill process-trees correctly in the presence of races between the launch and the stop-container call and when root processes crash. Contributed by Billie Rinaldi.
(cherry picked from commit c5a46d4c8ca236ff641a309f256bbbdf4dd56db5)
2014-11-03 16:41:21 -08:00
Vinod Kumar Vavilapalli
f2ef8c7b48 YARN-2795. Fixed ResourceManager to not crash loading node-label data from HDFS in secure mode. Contributed by Wangda Tan.
(cherry picked from commit ec6cbece8e7772868ce8ad996135d3136bd32245)
2014-11-03 13:46:05 -08:00
Vinod Kumar Vavilapalli
c205841d49 YARN-2788. Fixed backwards compatiblity issues with log-aggregation feature that were caused when adding log-upload-time via YARN-2703. Contributed by Xuan Gong.
(cherry picked from commit 58e9f24e0f06efede21085b7ffe36af042fa7b38)
2014-11-03 13:20:01 -08:00
Vinod Kumar Vavilapalli
dd82a1eb75 YARN-2798. Fixed YarnClient to populate the renewer correctly for Timeline delegation tokens. Contributed by Zhijie Shen.
(cherry picked from commit 71fbb474f531f60c5d908cf724f18f90dfd5fa9f)
2014-11-03 12:51:30 -08:00
Jason Lowe
2098c68acb YARN-2730. DefaultContainerExecutor runs only one localizer at a time. Contributed by Siqi Li
(cherry picked from commit 6157ace5475fff8d2513fd3cd99134b532b0b406)
2014-11-03 20:40:02 +00:00