7459 Commits

Author SHA1 Message Date
Haohui Mai
876062ac20 HDFS-6943. Improve NN allocateBlock log to include replicas' datanode IPs. Contributed by Ming Ma. 2014-09-08 11:07:56 -07:00
cnauroth
17b44f11f8 Credential Provider related Unit Test Failure on Windows. Contributed by Xiaoyu Yao.
(cherry picked from commit 302d9a0a0dac721775a88f804a18d5224c0cd497)
2014-09-08 09:31:32 -07:00
Jian He
c17810a84c YARN-2515. Updated ConverterUtils#toContainerId to parse epoch. Contributed by Tsuyoshi OZAWA
(cherry picked from commit 0974f434c47ffbf4b77a8478937fd99106c8ddbd)
2014-09-07 18:31:07 -07:00
Zhijie Shen
0974400b74 YARN-2507. Documented CrossOriginFilter configurations for the timeline server. Contributed by Jonathan Eagles.
(cherry picked from commit 56dc496a1031621d2b701801de4ec29179d75f2e)
2014-09-07 18:25:13 -07:00
Zhijie Shen
f2a5a5d4aa YARN-2512. Allowed pattern matching for origins in CrossOriginFilter. Contributed by Jonathan Eagles.
(cherry picked from commit a092cdf32de4d752456286a9f4dda533d8a62bca)
2014-09-07 17:52:38 -07:00
cnauroth
b87d1d7d0a HDFS Credential Provider related Unit Test Failure. Contributed by Xiaoyu Yao.
(cherry picked from commit a23144fd8a1e399e431f2f272388ec109df37ab1)
2014-09-07 08:41:08 -07:00
arp
eba06e61ce HDFS-6898. DN must reserve space for a full block when an RBW block is created. (Contributed by Arpit Agarwal)
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/BlockPoolSlice.java
2014-09-06 21:04:21 -07:00
cnauroth
af1d389157 YARN-2519. Credential Provider related unit tests failed on Windows. Contributed by Xiaoyu Yao.
(cherry picked from commit cbea1b10efd871d04c648af18449dc724685db74)
2014-09-06 20:06:44 -07:00
Konstantin V Shvachko
1ea3883553 HDFS-6940. Refactoring to allow ConsensusNode implementation.
Contributed by Konstantin Shvachko.
2014-09-06 12:04:49 -07:00
Alejandro Abdelnur
035112f251 HDFS-6986. DistributedFileSystem must get delegation tokens from configured KeyProvider. (zhz via tucu) 2014-09-05 22:33:58 -07:00
Alejandro Abdelnur
8bf2a0de69 HADOOP-11069. KMSClientProvider should use getAuthenticationMethod() to determine if in proxyuser mode or not. (tucu) 2014-09-05 22:01:13 -07:00
Alejandro Abdelnur
e98c244730 HADOOP-11070. Create MiniKMS for testing. (tucu) 2014-09-05 22:01:06 -07:00
Jonathan Eagles
c47d72d8d2 YARN-2508. Cross Origin configuration parameters prefix are not honored (Mit Desai via jeagles)
(cherry picked from commit e6420fec0af9b8d4f424098688ae4926ff527fcf)
2014-09-05 19:45:02 -05:00
Karthik Kambatla
e392229676 HADOOP-11065. Rat check should exclude **/build/**. (kasha)
(cherry picked from commit 0571b4561bad7e0230920e52d3758a3658fcf20d)
2014-09-05 13:10:12 -07:00
arp
27c53a1d67 HADOOP-11067 [HDFS-6998]. Fix CHANGES.txt 2014-09-05 11:18:30 -07:00
arp
624e793ad6 HDFS-6998. warning message 'ssl.client.truststore.location has not been set' gets printed for hftp command. (Contributed by Xiaoyu Yao) 2014-09-05 11:14:24 -07:00
arp
34a3faf180 HDFS-6862. Add missing timeout annotations to tests. (Contributed by Xiaoyu Yao) 2014-09-05 11:09:47 -07:00
cnauroth
df2ab4c76f HDFS-6979. Fix minor error in CHANGES.txt. Contributed by Chris Nauroth.
(cherry picked from commit b051327ab6a01774e1dad59e1e547dd16f603789)
2014-09-05 11:08:16 -07:00
cnauroth
ac218d4dac HDFS-6979. hdfs.dll not produce .pdb files. Contributed by Chris Nauroth.
(cherry picked from commit fab9bc58ec03ea81cd5ce8a8746a4ee588f7bb08)
2014-09-05 11:04:57 -07:00
arp
be7e5837a9 HDFS-6831. Inconsistency between 'hdfs dfsadmin' and 'hdfs dfsadmin -help'. (Contributed by Xiaoyu Yao) 2014-09-05 10:46:33 -07:00
Jing Zhao
a074342b4c HDFS-6376. Distcp data between two HA clusters requires another configuration. Contributed by Dave Marion and Haohui Mai. 2014-09-05 10:40:50 -07:00
Jason Lowe
0b3f918b3b MAPREDUCE-6071. JobImpl#makeUberDecision doesn't log that Uber mode is disabled because of too much CPUs. Contributed by Tsuyoshi OZAWA
(cherry picked from commit 45efc966ee1a1bda0271464dcee2564862d53b1f)
2014-09-05 13:48:16 +00:00
Vinayakumar B
0bd0423ff5 HDFS-6714. TestBlocksScheduledCounter#testBlocksScheduledCounter should shutdown cluster (vinayakumarb)
(cherry picked from commit 772d1fb01e65ca42ef4365d2a9307da6c2448c3f)
2014-09-05 10:26:51 +05:30
Jing Zhao
b675f3f150 HDFS-6886. Use single editlog record for creating file + overwrite. Contributed by Yi Liu.
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2014-09-04 18:56:51 -07:00
Jing Zhao
2363bad793 HDFS-6996. SnapshotDiff report can hit IndexOutOfBoundsException when there are nested renamed directory/file. Contributed by Jing Zhao. 2014-09-04 16:40:51 -07:00
arp
0bbeb80931 HDFS-6848. Lack of synchronization on access to datanodeUuid in DataStorage#format. (Contributed by Xiaoyu Yao) 2014-09-04 16:19:52 -07:00
Zhijie Shen
1e40cbba7f YARN-2511. Allowed all origins by default when CrossOriginFilter is enabled. Contributed by Jonathan Eagles.
(cherry picked from commit 51a4faf52199b181471d591a9fde900fc166fc48)
2014-09-04 15:03:50 -07:00
Jason Lowe
04d325afff YARN-2431. NM restart: cgroup is not removed for reacquired containers. Contributed by Jason Lowe
(cherry picked from commit 3fa5f728c4d6944302621965d6a0376827af5b51)
2014-09-04 21:14:20 +00:00
cnauroth
c035365338 HADOOP-11063. KMS cannot deploy on Windows, because class names are too long. Contributed by Chris Nauroth.
(cherry picked from commit b44b2ee4adb78723c221a7da8fd35ed011d0905c)
2014-09-04 12:09:34 -07:00
Alejandro Abdelnur
5dc45d529b HDFS-6905. fs-encryption merge triggered release audit failures. (clamb via tucu) 2014-09-04 11:06:58 -07:00
Jonathan Eagles
7e76039278 YARN-2509. Enable Cross Origin Filter for timeline server only and not all Yarn servers (Mit Desai via jeagles)
(cherry picked from commit 91d45f0f017281c8ab7ac858aa5d618accb9ea44)
2014-09-04 11:54:43 -05:00
Alejandro Abdelnur
2267ba1af7 HADOOP-11060. Create a CryptoCodec test that verifies interoperability between the JCE and OpenSSL implementations. (hitliuyi via tucu) 2014-09-04 09:22:10 -07:00
Alejandro Abdelnur
dc2e38780b HADOOP-11015. Http server/client utils to propagate and recreate Exceptions from server to client. (tucu) 2014-09-04 09:14:07 -07:00
Alejandro Abdelnur
dd55461cda HADOOP-11054. Add a KeyProvider instantiation based on a URI. (tucu) 2014-09-04 09:14:02 -07:00
Haohui Mai
b68818c4f0 HDFS-6609. Use DirectorySnapshottableFeature to represent a snapshottable directory. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608631 13f79535-47bb-0310-9956-ffa450edef68
2014-09-03 23:11:31 -07:00
Colin Patrick Mccabe
7b287d5ba6 HADOOP-11056. OsSecureRandom.setConf() might leak file descriptors. Contributed by Yongjun Zhang.
(cherry picked from commit 8f1a668575d35bee11f4cd8173335be5352ec620)
2014-09-03 19:39:37 -07:00
Colin Patrick Mccabe
23c41897cb HDFS-6959 Make the HDFS home directory location customizable. Contributed by Yongjun Zhang
(cherry picked from commit f4caedfcbfeae7e2fe7c0e812ddbb087608a5ffd)
2014-09-03 19:33:30 -07:00
Chris Douglas
69ee11dc93 MAPREDUCE-6063. Correct spill size calculation for spills wrapping the circular buffer. Contributed by zhihai xu. 2014-09-03 17:02:17 -07:00
Alejandro Abdelnur
a7d8ede309 HADOOP-10863. KMS should have a blacklist for decrypting EEKs. (asuresh via tucu)
Conflicts:
	hadoop-common-project/hadoop-kms/src/main/java/org/apache/hadoop/crypto/key/kms/server/KMS.java
2014-09-03 15:20:28 -07:00
Karthik Kambatla
96a13c6d0c YARN-2394. FairScheduler: Configure fairSharePreemptionThreshold per queue. (Wei Yan via kasha)
(cherry picked from commit 1dcaba9a7aa27f7ca4ba693e3abb56ab3c59c8a7)
2014-09-03 10:27:47 -07:00
Karthik Kambatla
9855e884cb HADOOP-10956. Fix create-release script to include docs and necessary txt files. (kasha)
(cherry picked from commit ce0462129fe09898fd9b169cae0564cb6d9bc419)
2014-09-03 09:39:32 -07:00
Uma Maheswara Rao G
3f9c31c873 HDFS-2975. Rename with overwrite flag true can make NameNode to stuck in safemode on NN (crash + restart). (Yi Liu via umamahesh)
(cherry picked from commit 3425ae5d7eaa27b2526d0e0c07bdfea9440359f8)
2014-09-03 19:02:11 +05:30
Haohui Mai
786b43c7a3 HDFS-6942. Fix typos in log messages. Contributed by Ray Chiang. 2014-09-02 16:24:11 -07:00
Colin Patrick Mccabe
4c17d4d975 HDFS-4257. The ReplaceDatanodeOnFailure policies could have a forgiving option. Contributed by szetszwo.
(cherry picked from commit 727331becc3902cb4e60ee04741e79703238e782)
2014-09-02 15:20:50 -07:00
Andrew Wang
9daf035fbc HDFS-6954. With crypto, no native lib systems are too verbose. Contributed by Charles Lamb.
(cherry picked from commit a0ccf83dfd6bff81944d6855652eae7f7f7b0ba9)
2014-09-02 14:22:46 -07:00
Andrew Wang
958c9b5080 HDFS-6634. inotify in HDFS. Contributed by James Thomas.
(cherry picked from commit faa4455be512e070fa420084be8d1be5c72f3b08)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/qjournal/client/IPCLoggerChannel.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLog.java
2014-09-02 14:17:51 -07:00
Steve Loughran
c50371c8b5 Fix hadoop-common-project/hadoop-common/src/main/native/README to current mail list and URL 2014-09-02 20:28:11 +01:00
Brandon Li
ee3e812605 HADOOP-10990. Add missed NFSv3 request and response classes. Contributed by Brandon Li
(cherry picked from commit bad5f38d47f5e93c21641931ac92595c71b05bd7)
2014-09-02 11:29:35 -07:00
Jason Lowe
0a582c77ef HADOOP-11012. hadoop fs -text of zero-length file causes EOFException. Contributed by Eric Payne
(cherry picked from commit 01e8f056d9b7245193e6050f9830ca058db02a6e)
2014-09-02 18:25:03 +00:00
Allen Wittenauer
a96696bdc3 HADOOP-11036. Add build directory to .gitignore (Tsuyoshi OZAWA via aw)
(cherry picked from commit e1109fb65608a668cd53dc324dadc6f63a74eeb9)
2014-09-02 10:12:09 -07:00