Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
7,846 Commits 326 Branches 371 Tags
Commit Graph

7846 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Arun C. Murthy
de0073cbc4 YARN-2843. Merging to branch-2.6 for hadoop-2.6.0-rc1. 
(cherry picked from commit 51957ca81886ac3553c44848631fdf53766a25ae)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2014-11-12 10:44:43 -08:00
Vinod Kumar Vavilapalli
7a8a413eb2 YARN-2843. Fixed NodeLabelsManager to trim inputs for hosts and labels so as to make them work correctly. Contributed by Wangda Tan. 
(cherry picked from commit 0fd97f9c1989a793b882e6678285607472a3f75a)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2014-11-12 10:44:08 -08:00
Xuan
a690629ffc YARN-2841. RMProxy should retry EOFException. Contributed by Jian He 2014-11-12 10:28:55 -08:00
Arun C. Murthy
dc04b33768 HADOOP-9576. Merging to branch-2.6 for hadoop-2.6.0-rc1. 2014-11-12 10:01:09 -08:00
Jian He
aa2f87caaf HADOOP-9576. Changed NetUtils#wrapException to throw EOFException instead of wrapping it as IOException. Contributed by Steve Loughran 
Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2014-11-12 10:00:17 -08:00
Ravi Prakash
9613a57e83 YARN-1964. Create Docker analog of the LinuxContainerExecutor in YARN 2014-11-12 09:33:42 -08:00
Karthik Kambatla
ba01844260 Set the release date for 2.5.2 
(cherry picked from commit 68a050872896f93582f95420dd6e2bdefa4fd7cc)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt

(cherry picked from commit 92de44c2c58321c12bd8796859d54638e3cba9bd)
 2014-11-10 15:24:14 -08:00
Arun C. Murthy
60584c732f Preparing to release hadoop-2.6.0: Set version in branch-2.6 to 2.6.1-SNAPSHOT. 2014-11-09 19:21:11 -08:00
Arun C. Murthy
0ac7424534 Release Notes for hadoop-2.6.0. 2014-11-09 19:16:02 -08:00
Vinod Kumar Vavilapalli
6a9534e9cf YARN-2834. Fixed ResourceManager to ignore token-renewal failures on recovery consistent with the (somewhat incorrect) behaviour in the non-recovery case. Contributed by Jian He. 
Fixed a minor import issue in the test during cherry-pick from trunk.

(cherry picked from commit e76faebc9589654e83c8244ef9aff88391e56b80)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestWorkPreservingRMRestart.java
 2014-11-09 19:09:48 -08:00
Arun C. Murthy
be31db82f7 Updated CHANGES.txt to reflect hadoop-2.6.0 release dates. 
(cherry picked from commit 770cc144425b6188d9b93178c77a35cd830a60df)
 2014-11-09 18:53:55 -08:00
Karthik Kambatla
e9f7079c58 Fix broken download of directories 
(cherry picked from commit 745c9a01243b8eefc72d89d1164d7d010b80983b)
 2014-11-09 18:38:57 -08:00
Suresh Srinivas
c98fcd1d3b HDFS-7383. DataNode.requestShortCircuitFdsForRead may throw NullPointerException. Contributed by Tsz Wo Nicholas Sze. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-11-09 18:18:58 -08:00
Arun C. Murthy
e1608c28d5 Revert "HADOOP-10786. Fix UGI#reloginFromKeytab on Java 8. Contributed by Stephen Chu." 
Moving this to 2.7 only.
 2014-11-09 18:16:02 -08:00
Haohui Mai
35bd0f3b20 HADOOP-10786. Fix UGI#reloginFromKeytab on Java 8. Contributed by Stephen Chu. 2014-11-09 17:48:50 -08:00
Arun C. Murthy
c2cc879f01 YARN-2830. Add backwords compatible ContainerId.newInstance constructor. Contributed by Jonathan Eagles. 
(cherry picked from commit 43cd07b408c6613d2c9aa89203cfa3110d830538)
 2014-11-09 15:04:55 -08:00
Arun C. Murthy
85531834b3 HADOOP-11286. Copied LimitInputStream from guava-0.14 to hadoop to avoid issues with newer versions of guava in applications. Contributed by Christopher Tubbs. 
(cherry picked from commit 6caa8100d5d2547e34356dc279fd5e65b81a925a)
 2014-11-09 05:25:01 -08:00
cnauroth
539ef7fc13 HDFS-7382. DataNode in secure mode may throw NullPointerException if client connects before DataNode registers itself with NameNode. Contributed by Chris Nauroth. 
(cherry picked from commit 9ba8d8c7eb65eeb6fe673f04e493d9eedd95a822)
(cherry picked from commit 98b81c662419d5e136fddee87d18b48b4b969ef2)
 2014-11-08 22:31:22 -08:00
Vinod Kumar Vavilapalli
f098b261fe YARN-2607. Fixed issues in TestDistributedShell. Contributed by Wangda Tan. 
(cherry picked from commit 737d9284c109dac20ff423f30c62f6abe2db10f7)
 2014-11-08 11:02:55 -08:00
Zhijie Shen
33da0f8ecf YARN-2505. Supported get/add/remove/change labels in RM REST API. Contributed by Craig Welch. 
(cherry picked from commit 9a4e0d343e9e891c10ef6682e7b2231a59e69ade)
 2014-11-07 20:40:56 -08:00
Vinod Kumar Vavilapalli
6ff765bea2 YARN-2826. Fixed user-groups mappings' refresh bug caused by YARN-2826. Contributed by Wangda Tan. 
(cherry picked from commit df36edf751202db00d8f43103d7120ec56d70a04)
 2014-11-07 19:45:23 -08:00
Xuan
629274c09b YARN-2819. NPE in ATS Timeline Domains when upgrading from 2.4 to 2.6. Contributed by Zhijie Shen 
(cherry picked from commit 4a114dd67aae83e5bb2d65470166de954acf36a2)
(cherry picked from commit 7d26cffb0cb21c16b335e8ae9b02523565ad3b5d)
 2014-11-07 16:13:38 -08:00
Jason Lowe
dcc1ab15ab YARN-2632. Document NM Restart feature. Contributed by Junping Du and Vinod Kumar Vavilapalli 
(cherry picked from commit 1e215e8ba2e801eb26f16c307daee756d6b2ca66)
 2014-11-07 23:42:26 +00:00
Jason Lowe
e5c0fa2c95 YARN-2825. Container leak on NM. Contributed by Jian He 
(cherry picked from commit c3d475070a1ec54c4b05923f4782cef204effd2c)
 2014-11-07 23:17:49 +00:00
cnauroth
a07f478b40 HADOOP-11282. Skip NFS TestShellBasedIdMapping tests that are irrelevant on Windows. Contributed by Chris Nauroth. 
(cherry picked from commit 68db5b3736287ef218acc861368c6b95b72fa2f4)
(cherry picked from commit 3ef876712c389391784068fe05f724d84957bbec)
 2014-11-07 14:33:39 -08:00
Vinod Kumar Vavilapalli
6593aaf117 YARN-2753. Fixed a bunch of bugs in the NodeLabelsManager classes. Contributed by Zhihai xu. 
(cherry picked from commit 4cfd5bc7c18bb9a828f573b5c4d2b13fa28e732a)
 2014-11-07 14:17:23 -08:00
Haohui Mai
9fe9ee1c16 HDFS-7379. TestBalancer#testBalancerWithRamDisk creates test files incorrectly. Contributed by Xiaoyu Yao. 2014-11-07 13:39:33 -08:00
cnauroth
9adb31b6a8 YARN-2803. MR distributed cache not working correctly on Windows after NodeManager privileged account changes. Contributed by Craig Welch. 
(cherry picked from commit 06b797947c980d7d21864eb8b700cf565756aac1)
(cherry picked from commit c16f7182937dc4e8bbf46dfedd9db427a0a33357)
 2014-11-07 12:45:25 -08:00
Vinod Kumar Vavilapalli
326c722eb7 YARN-2827. Fixed bugs in "yarn queue" CLI. Contributed by Wangda Tan. 
(cherry picked from commit 7b190796578c55d1f282188a53ccfa2abd8cab21)
 2014-11-07 12:01:33 -08:00
Vinod Kumar Vavilapalli
71a18a5303 YARN-2824. Fixed Capacity Scheduler to not crash when some node-labels are not mapped to queues by making default capacities per label to be zero. Contributed by Wangda Tan. 
(cherry picked from commit 2ac1be7dec4aef001e3162e364249933b2c4a6c4)
 2014-11-07 10:45:01 -08:00
Xuan
09955ea2c3 YARN-2810. TestRMProxyUsersConf fails on Windows VMs. Contributed by Varun Vasudev 
(cherry picked from commit 1e97f2f09464e871773188f642f3a01b744c580f)
(cherry picked from commit bf795418686e1559db4c37c0b107bb5c08bbf525)
 2014-11-07 09:46:53 -08:00
Vinod Kumar Vavilapalli
9f7396be55 YARN-2823. Fixed ResourceManager app-attempt state machine to inform schedulers about previous finished attempts of a running appliation to avoid expectation mismatch w.r.t transferred containers. Contributed by Jian He. 
(cherry picked from commit a5657182a7accebe08cd86e46b4cdeb163d4d1f2)
 2014-11-07 09:30:31 -08:00
cnauroth
e398048035 HADOOP-11280. TestWinUtils#testChmod fails after removal of NO_PROPAGATE_INHERIT_ACE. Contributed by Chris Nauroth. 
(cherry picked from commit 42bbe3794e4a8edef020e08111dbd7f1058938e2)
(cherry picked from commit a3496b7e01d2c7a928170b94ce0b763e63e64e98)
 2014-11-07 00:05:54 -08:00
Jing Zhao
92337e1dce HDFS-7228. Fix TestDNFencing.testQueueingWithAppend. Contributed by Yongjun Zhang. 
(cherry picked from commit 75a9c894b3e53d34341e918c70ba7868d074e0fb)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-11-06 23:12:08 -08:00
Andrew Wang
a2b46a7340 HDFS-7221. TestDNFencingWithReplication fails consistently. Contributed by Charles Lamb. 
(cherry picked from commit ac56b0637e55465d3b7f7719c8689bff2a572dc0)
(cherry picked from commit 2d0996ae6d6bdfa01cff790f5ed7198d791de62b)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-11-06 22:49:28 -08:00
Vinod Kumar Vavilapalli
8c3a0d5a98 YARN-2647. Added a queue CLI for getting queue information. Contributed by Sunil Govind. 
(cherry picked from commit 61effcbebc819ee1bd3d60f5444c39c972494a32)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/bin/yarn

(cherry picked from commit b1521c7c3ce7dfaabdb3fc1d74c10970dda57fe5)
 2014-11-06 22:22:16 -08:00
Jing Zhao
a081bdcf63 Revert "HADOOP-11274. ConcurrentModificationException in Configuration Copy Constructor. Contributed by Junping Du." 
This reverts commit 16b34824673f5a50d464727b8fad98470e5e984a.
 2014-11-06 18:31:18 -08:00
Jing Zhao
a9b0436132 HDFS-7364. Balancer always shows zero Bytes Already Moved. Contributed by Tsz Wo Nicholas Sze. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/NameNodeConnector.java
 2014-11-06 17:56:15 -08:00
Vinod Kumar Vavilapalli
21ef5afafa YARN-2744. Fixed CapacityScheduler to validate node-labels correctly against queues. Contributed by Wangda Tan. 
(cherry picked from commit a3839a9fbfb8eec396b9bf85472d25e0ffc3aab2)
 2014-11-06 17:29:39 -08:00
Jing Zhao
bc6bc80251 HADOOP-11274. ConcurrentModificationException in Configuration Copy Constructor. Contributed by Junping Du. 2014-11-06 17:00:42 -08:00
Kihwal Lee
c38c5752e4 MAPREDUCE-5958. Wrong reduce task progress if map output is compressed. Contributed by Emilio Coppa and Jason Lowe. 
(cherry picked from commit 8f701ae07a0b1dc70b8e1eb8d4a5c35c0a1e76da)
 2014-11-06 15:56:50 -06:00
Steve Loughran
e333584ca6 YARN-2768 Improved Yarn Registry service record structure (stevel) 2014-11-06 20:21:49 +00:00
Vinod Kumar Vavilapalli
b557f689b4 YARN-2818. Removed the now unnecessary user entity injection from Timeline service given we now have domains. Contributed by Zhijie Shen. 
(cherry picked from commit f5b19bed7d71979dc8685b03152188902b6e45e9)
 2014-11-06 11:50:12 -08:00
Jason Lowe
7be74ea09a MAPREDUCE-5960. JobSubmitter's check whether job.jar is local is incorrect with no authority in job jar path. Contributed by Gera Shegalov 
(cherry picked from commit 10f9f5101c44be7c675a44ded4aad212627ecdee)
 2014-11-06 15:12:37 +00:00
Xuan
43854764a9 YARN-2812. TestApplicationHistoryServer is likely to fail on less powerful machine. Contributed by Zhijie Shen 
(cherry picked from commit b0b52c4e11336ca2ad6a02d64c0b5d5a8f1339ae)
(cherry picked from commit 4aa98d599194a444c9d2e1fe95262e32bf744d35)
 2014-11-05 20:45:09 -08:00
Haohui Mai
83ed42fa6b HDFS-7367. HDFS short-circuit read cannot negotiate shared memory slot and file descriptors when SASL is enabled on DataTransferProtocol. Contributed by Chris Nauroth. 2014-11-05 20:34:25 -08:00
Xuan
888fc4af4e YARN-2813. Fixed NPE from MemoryTimelineStore.getDomains. Contributed by Zhijie Shen 2014-11-05 18:27:41 -08:00
Jian He
e29e864c51 YARN-2579. Fixed a deadlock issue when EmbeddedElectorService and FatalEventDispatcher try to transition RM to StandBy at the same time. Contributed by Rohith Sharmaks 
(cherry picked from commit 395275af8622c780b9071c243422b0780e096202)
 2014-11-05 17:03:26 -08:00
Vinod Kumar Vavilapalli
812ddc3991 YARN-2805. Fixed ResourceManager to load HA configs correctly before kerberos login. Contributed by Wangda Tan. 
(cherry picked from commit 834e931d8efe4d806347b266e7e62929ce05389b)
 2014-11-05 15:32:49 -08:00
cnauroth
e041de4492 HDFS-7359. NameNode in secured HA cluster fails to start if dfs.namenode.secondary.http-address cannot be interpreted as a network address. Contributed by Chris Nauroth. 
(cherry picked from commit ba1d4ad25b301f7247f3f23df15e7f800e50feed)
(cherry picked from commit f172a0823844cdf7fbb0f821cba23fc67ba4ff43)
 2014-11-05 15:29:40 -08:00