7124 Commits

Author SHA1 Message Date
Alejandro Abdelnur
16a4558fda HDFS-6776. Using distcp to copy data between insecure and secure cluster via webdhfs doesn't work. (yzhangal via tucu) 2014-09-09 22:20:36 -07:00
cnauroth
7d9c45f778 HADOOP-11057. checknative command to probe for winutils.exe on windows. Contributed by Xiaoyu Yao.
(cherry picked from commit 6dae4b430c342f9ad44ad8659c372e519f3931c9)
2014-09-09 21:39:11 -07:00
Konstantin V Shvachko
c1df6f3b40 Revert HDFS-6940. 2014-09-09 17:34:25 -07:00
Karthik Kambatla
fe9d1ee96f YARN-2526. SLS can deadlock when all the threads are taken by AMSimulators. (Wei Yan via kasha)
(cherry picked from commit 28d99db99236ff2a6e4a605802820e2b512225f9)
2014-09-09 15:15:42 -07:00
cnauroth
ba44099f8e HADOOP-10925. Change attribution in CHANGES.txt from trunk to 2.6.0.
(cherry picked from commit 3e8f353c8e36b1467af4a8a421097afa512b324c)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2014-09-09 14:17:44 -07:00
cnauroth
c6fabbb9e9 Newly moved block replica been invalidated and deleted in TestBalancer. Contributed by Binglin Chang.
(cherry picked from commit 2749fc677c295e4ac5f4b1ebd5dbd6092370a857)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2014-09-09 11:43:21 -07:00
Chris Nauroth
b601e69d9d HADOOP-10925 Compilation fails in native link0 function on Windows. 2014-09-09 16:25:14 +01:00
arp
e736018601 HDFS-6981. Fix DN upgrade with layout version change. (Arpit Agarwal)
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2014-09-08 22:06:51 -07:00
arp
3259e8954f HDFS-6800. Support Datanode layout changes with rolling upgrade. (Contributed by James Thomas)
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2014-09-08 22:06:12 -07:00
Colin McCabe
da118bb113 HDFS-6482. Use block ID-based block layout on datanodes (James Thomas via Colin Patrick McCabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615223 13f79535-47bb-0310-9956-ffa450edef68

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/BlockPoolSlice.java
2014-09-08 22:00:51 -07:00
Andrew Wang
176b07b480 Update CHANGES.txt for HDFS-6951
(cherry picked from commit 7498dd790eca39c142229a75c2801b5bf4b94983)
2014-09-08 17:01:53 -07:00
Andrew Wang
dc4da242f2 HDFS-6951. Correctly persist raw namespace xattrs to edit log and fsimage. Contributed by Charles Lamb.
(cherry picked from commit 04915a08141bbe71bdef26e3f539aa8b76f89ac7)
2014-09-08 17:01:47 -07:00
Colin Patrick Mccabe
bdcf5e940f HDFS-6036. Forcibly timeout misbehaving DFSClients that try to do no-checksum reads that extend too long. (cmccabe)
(cherry picked from commit cad14aa9168112ef1ceae80b94d9aae3ba293578)
2014-09-08 13:02:54 -07:00
Kihwal Lee
d20047edda HDFS-7005. DFS input streams do not timeout. Contributed by Daryn Sharp.
(cherry picked from commit 6a84f88c1190a8fecadd81deb6e7b8a69675fa91)
2014-09-08 14:44:47 -05:00
Alejandro Abdelnur
d510cefd14 HADOOP-11071. KMSClientProvider should drain the local generated EEK cache on key rollover. (tucu) 2014-09-08 11:32:20 -07:00
Haohui Mai
876062ac20 HDFS-6943. Improve NN allocateBlock log to include replicas' datanode IPs. Contributed by Ming Ma. 2014-09-08 11:07:56 -07:00
cnauroth
17b44f11f8 Credential Provider related Unit Test Failure on Windows. Contributed by Xiaoyu Yao.
(cherry picked from commit 302d9a0a0dac721775a88f804a18d5224c0cd497)
2014-09-08 09:31:32 -07:00
Jian He
c17810a84c YARN-2515. Updated ConverterUtils#toContainerId to parse epoch. Contributed by Tsuyoshi OZAWA
(cherry picked from commit 0974f434c47ffbf4b77a8478937fd99106c8ddbd)
2014-09-07 18:31:07 -07:00
Zhijie Shen
0974400b74 YARN-2507. Documented CrossOriginFilter configurations for the timeline server. Contributed by Jonathan Eagles.
(cherry picked from commit 56dc496a1031621d2b701801de4ec29179d75f2e)
2014-09-07 18:25:13 -07:00
Zhijie Shen
f2a5a5d4aa YARN-2512. Allowed pattern matching for origins in CrossOriginFilter. Contributed by Jonathan Eagles.
(cherry picked from commit a092cdf32de4d752456286a9f4dda533d8a62bca)
2014-09-07 17:52:38 -07:00
cnauroth
b87d1d7d0a HDFS Credential Provider related Unit Test Failure. Contributed by Xiaoyu Yao.
(cherry picked from commit a23144fd8a1e399e431f2f272388ec109df37ab1)
2014-09-07 08:41:08 -07:00
arp
eba06e61ce HDFS-6898. DN must reserve space for a full block when an RBW block is created. (Contributed by Arpit Agarwal)
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/BlockPoolSlice.java
2014-09-06 21:04:21 -07:00
cnauroth
af1d389157 YARN-2519. Credential Provider related unit tests failed on Windows. Contributed by Xiaoyu Yao.
(cherry picked from commit cbea1b10efd871d04c648af18449dc724685db74)
2014-09-06 20:06:44 -07:00
Konstantin V Shvachko
1ea3883553 HDFS-6940. Refactoring to allow ConsensusNode implementation.
Contributed by Konstantin Shvachko.
2014-09-06 12:04:49 -07:00
Alejandro Abdelnur
035112f251 HDFS-6986. DistributedFileSystem must get delegation tokens from configured KeyProvider. (zhz via tucu) 2014-09-05 22:33:58 -07:00
Alejandro Abdelnur
8bf2a0de69 HADOOP-11069. KMSClientProvider should use getAuthenticationMethod() to determine if in proxyuser mode or not. (tucu) 2014-09-05 22:01:13 -07:00
Alejandro Abdelnur
e98c244730 HADOOP-11070. Create MiniKMS for testing. (tucu) 2014-09-05 22:01:06 -07:00
Jonathan Eagles
c47d72d8d2 YARN-2508. Cross Origin configuration parameters prefix are not honored (Mit Desai via jeagles)
(cherry picked from commit e6420fec0af9b8d4f424098688ae4926ff527fcf)
2014-09-05 19:45:02 -05:00
Karthik Kambatla
e392229676 HADOOP-11065. Rat check should exclude **/build/**. (kasha)
(cherry picked from commit 0571b4561bad7e0230920e52d3758a3658fcf20d)
2014-09-05 13:10:12 -07:00
arp
27c53a1d67 HADOOP-11067 [HDFS-6998]. Fix CHANGES.txt 2014-09-05 11:18:30 -07:00
arp
624e793ad6 HDFS-6998. warning message 'ssl.client.truststore.location has not been set' gets printed for hftp command. (Contributed by Xiaoyu Yao) 2014-09-05 11:14:24 -07:00
arp
34a3faf180 HDFS-6862. Add missing timeout annotations to tests. (Contributed by Xiaoyu Yao) 2014-09-05 11:09:47 -07:00
cnauroth
df2ab4c76f HDFS-6979. Fix minor error in CHANGES.txt. Contributed by Chris Nauroth.
(cherry picked from commit b051327ab6a01774e1dad59e1e547dd16f603789)
2014-09-05 11:08:16 -07:00
cnauroth
ac218d4dac HDFS-6979. hdfs.dll not produce .pdb files. Contributed by Chris Nauroth.
(cherry picked from commit fab9bc58ec03ea81cd5ce8a8746a4ee588f7bb08)
2014-09-05 11:04:57 -07:00
arp
be7e5837a9 HDFS-6831. Inconsistency between 'hdfs dfsadmin' and 'hdfs dfsadmin -help'. (Contributed by Xiaoyu Yao) 2014-09-05 10:46:33 -07:00
Jing Zhao
a074342b4c HDFS-6376. Distcp data between two HA clusters requires another configuration. Contributed by Dave Marion and Haohui Mai. 2014-09-05 10:40:50 -07:00
Jason Lowe
0b3f918b3b MAPREDUCE-6071. JobImpl#makeUberDecision doesn't log that Uber mode is disabled because of too much CPUs. Contributed by Tsuyoshi OZAWA
(cherry picked from commit 45efc966ee1a1bda0271464dcee2564862d53b1f)
2014-09-05 13:48:16 +00:00
Vinayakumar B
0bd0423ff5 HDFS-6714. TestBlocksScheduledCounter#testBlocksScheduledCounter should shutdown cluster (vinayakumarb)
(cherry picked from commit 772d1fb01e65ca42ef4365d2a9307da6c2448c3f)
2014-09-05 10:26:51 +05:30
Jing Zhao
b675f3f150 HDFS-6886. Use single editlog record for creating file + overwrite. Contributed by Yi Liu.
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2014-09-04 18:56:51 -07:00
Jing Zhao
2363bad793 HDFS-6996. SnapshotDiff report can hit IndexOutOfBoundsException when there are nested renamed directory/file. Contributed by Jing Zhao. 2014-09-04 16:40:51 -07:00
arp
0bbeb80931 HDFS-6848. Lack of synchronization on access to datanodeUuid in DataStorage#format. (Contributed by Xiaoyu Yao) 2014-09-04 16:19:52 -07:00
Zhijie Shen
1e40cbba7f YARN-2511. Allowed all origins by default when CrossOriginFilter is enabled. Contributed by Jonathan Eagles.
(cherry picked from commit 51a4faf52199b181471d591a9fde900fc166fc48)
2014-09-04 15:03:50 -07:00
Jason Lowe
04d325afff YARN-2431. NM restart: cgroup is not removed for reacquired containers. Contributed by Jason Lowe
(cherry picked from commit 3fa5f728c4d6944302621965d6a0376827af5b51)
2014-09-04 21:14:20 +00:00
cnauroth
c035365338 HADOOP-11063. KMS cannot deploy on Windows, because class names are too long. Contributed by Chris Nauroth.
(cherry picked from commit b44b2ee4adb78723c221a7da8fd35ed011d0905c)
2014-09-04 12:09:34 -07:00
Alejandro Abdelnur
5dc45d529b HDFS-6905. fs-encryption merge triggered release audit failures. (clamb via tucu) 2014-09-04 11:06:58 -07:00
Jonathan Eagles
7e76039278 YARN-2509. Enable Cross Origin Filter for timeline server only and not all Yarn servers (Mit Desai via jeagles)
(cherry picked from commit 91d45f0f017281c8ab7ac858aa5d618accb9ea44)
2014-09-04 11:54:43 -05:00
Alejandro Abdelnur
2267ba1af7 HADOOP-11060. Create a CryptoCodec test that verifies interoperability between the JCE and OpenSSL implementations. (hitliuyi via tucu) 2014-09-04 09:22:10 -07:00
Alejandro Abdelnur
dc2e38780b HADOOP-11015. Http server/client utils to propagate and recreate Exceptions from server to client. (tucu) 2014-09-04 09:14:07 -07:00
Alejandro Abdelnur
dd55461cda HADOOP-11054. Add a KeyProvider instantiation based on a URI. (tucu) 2014-09-04 09:14:02 -07:00
Haohui Mai
b68818c4f0 HDFS-6609. Use DirectorySnapshottableFeature to represent a snapshottable directory. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608631 13f79535-47bb-0310-9956-ffa450edef68
2014-09-03 23:11:31 -07:00