Commit Graph

8760 Commits

Author SHA1 Message Date
Harsh J 274db918c3 MAPREDUCE-6291. Correct mapred queue usage command. Contributed by Brahma Reddy Battula.
(cherry picked from commit f5432cb47dfacaa57faed32a29d00bbeff8a5385)
2015-03-28 11:58:44 +05:30
Arpit Agarwal d0bc2eff1a HDFS-7700. Document quota support for storage types. (Contributed by Xiaoyu Yao) 2015-03-27 19:49:33 -07:00
Arun Suresh dadda2edca HDFS-8004. Use KeyProviderCryptoExtension#warmUpEncryptedKeys when creating an encryption zone. (awang via asuresh)
(cherry picked from commit e97f8e44af)
2015-03-27 19:25:32 -07:00
cnauroth eb7068c2c9 HADOOP-11639. Clean up Windows native code compilation warnings related to Windows Secure Container Executor. Contributed by Remus Rusanu.
(cherry picked from commit 3836ad6c0b)
2015-03-27 15:03:52 -07:00
Akira Ajisaka 853cc04668 MAPREDUCE-5762. Port MAPREDUCE-3223 (Remove MRv1 config from mapred-default.xml) to branch-2. (aajisaka) 2015-03-28 03:35:03 +09:00
Tsuyoshi Ozawa f0aa2a7466 MAPREDUCE-6294. Remove an extra parameter described in Javadoc of TockenCache. Contributed by Brahma Reddy Battula.
(cherry picked from commit 05499b1093)
2015-03-28 00:08:56 +09:00
Tsuyoshi Ozawa 24b60a7d1a HADOOP-11760. Fix typo of javadoc in DistCp. Contributed by Brahma Reddy Battula.
(cherry picked from commit e074952bd6)
2015-03-27 23:16:37 +09:00
Kihwal Lee 577ea08865 HDFS-7990. IBR delete ack should not be delayed. Contributed by Daryn Sharp.
(cherry picked from commit 60882ab26d)
2015-03-27 09:06:23 -05:00
cnauroth 36371cddd1 HADOOP-11691. X86 build of libwinutils is broken. Contributed by Kiran Kumar M R.
(cherry picked from commit af618f23a7)
2015-03-26 21:57:13 -07:00
cnauroth 1fd350fa8e HADOOP-11257. Update "hadoop jar" documentation to warn against using it for launching yarn jars, addendum to print warning to stderr. Contributed by Masatake Iwasaki. 2015-03-26 21:48:27 -07:00
Haohui Mai c261d35b75 HADOOP-11748. The secrets of auth cookies should not be specified in configuration in clear text. Contributed by Li Lu and Haohui Mai. 2015-03-26 17:35:28 -07:00
Colin Patrick Mccabe 2a750c9aa6 HDFS-7410. Support CreateFlags with append() to support hsync() for appending streams (Vinayakumar B via Colin P. McCabe)
(cherry picked from commit 61df1b27a7)
2015-03-26 13:28:58 -07:00
Robert Kanter 6f0e864d61 YARN-3400. [JDK 8] Build Failure due to unreported exceptions in RPCUtil (rkanter)
(cherry picked from commit 87130bf6b2)
2015-03-26 11:00:37 -07:00
Arpit Agarwal c035106c05 HDFS-7824. GetContentSummary API and its namenode implementation for Storage Type Quota/Usage. (Contributed by Xiaoyu Yao) 2015-03-26 10:47:43 -07:00
Kihwal Lee 071277b9ce HDFS-7963. Fix expected tracing spans in TestTracing. Contributed by Masatake Iwasaki. 2015-03-26 08:42:45 -05:00
Harsh J c33ecd83e4 HADOOP-11719.[Fsshell] Remove bin/hadoop reference from GenericOptionsParser default help text. Contributed by Brahma Reddy Battula.
(cherry picked from commit 1ede5e6e1e7f51cf13d0488bb1b0e126c865656c)
2015-03-26 11:28:32 +05:30
Haohui Mai 6e9202c802 HDFS-7918. Clean up unused code for old web UI in branch-2. Contributed by Brahma Reddy Battula. 2015-03-25 17:46:36 -07:00
Yongjun Zhang be0d228ed1 HADOOP-11724. DistCp throws NPE when the target directory is root. (Lei Eddy Xu via Yongjun Zhang)
(cherry-picked from commit 65ee02d9ed50e026c2d37ec80babd4176075ff84)
2015-03-25 15:50:28 -07:00
Kihwal Lee be4eabdcd4 HDFS-7928. Scanning blocks from disk during rolling upgrade startup takes a lot of time if disks are busy. Contributed by Rushabh Shah.
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/BlockPoolSlice.java
2015-03-25 14:51:00 -05:00
Haohui Mai c62840d531 Addendum for HADOOP-10670. 2015-03-25 12:30:12 -07:00
Haohui Mai 17f17dac4e HADOOP-10670. Allow AuthenticationFilters to load secret from signature secret files. Contributed by Kai Zheng. 2015-03-25 11:13:04 -07:00
Karthik Kambatla 2158cd2bef YARN-3397. yarn rmadmin should skip -failover. (J.Andreina via kasha)
(cherry picked from commit c906a1de72)
2015-03-25 07:42:45 -07:00
Xuan 0c4fa872be YARN-2213. Change proxy-user cookie log in AmIpFilter to DEBUG.
Contributed by Varun Saxena

(cherry picked from commit e556198e71)
2015-03-25 04:51:55 -07:00
Akira Ajisaka 2e509908ee MAPREDUCE-6292. Use org.junit package instead of junit.framework in TestCombineFileInputFormat. (aajisaka)
(cherry picked from commit c770df49b4)
2015-03-25 19:01:38 +09:00
Harsh J d85c14afbf MAPREDUCE-579. Streaming slowmatch documentation.
(cherry picked from commit a2e42d2deee715f6255d6fd2c95f34e80888dc5f)
2015-03-25 14:39:46 +05:30
Tsuyoshi Ozawa ee824cafe7 HADOOP-11738. Fix a link of Protocol Buffers 2.5 for download in BUILDING.txt. (ozawa)
(cherry picked from commit 323945b33a)
2015-03-25 18:02:52 +09:00
Tsuyoshi Ozawa e4da690547 HADOOP-11014. Potential resource leak in JavaKeyStoreProvider due to unclosed stream. (ozawa)
(cherry picked from commit b351086ff6)
2015-03-25 16:59:55 +09:00
Tsuyoshi Ozawa 77024aada9 HADOOP-11741. Add LOG.isDebugEnabled() guard for some LOG.debug(). Contributed by Walter Su.
(cherry picked from commit 5582b0f1d4)
2015-03-25 16:36:26 +09:00
Jitendra Pandey 456cec127b HDFS-6826. Plugin interface to enable delegation of HDFS authorization assertions. Contributed by Arun Suresh.
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
2015-03-24 16:02:21 -07:00
Haohui Mai 161dae898f HDFS-7713. Implement mkdirs in the HDFS Web UI. Contributed by Ravi Prakash. 2015-03-24 15:49:08 -07:00
Jing Zhao 483f77b75b HDFS-7854. Separate class DataStreamer out of DFSOutputStream. Contributed by Li Bo.
(cherry picked from commit a16bfff71b)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java
2015-03-24 11:21:10 -07:00
Brandon Li 260dbe96c3 HDFS-7977. NFS couldn't take percentile intervals. Contributed by Brandon Li
(cherry picked from commit 570a83ae80)
2015-03-24 10:50:50 -07:00
Wangda Tan 29629020c1 YARN-3383. AdminService should use warn instead of info to log exception when operation fails. (Li Lu via wangda)
(cherry picked from commit 97a7277a2d)
2015-03-24 10:39:45 -07:00
Harsh J 608ad6c2cd HDFS-7875. Improve log message when wrong value configured for dfs.datanode.failed.volumes.tolerated. Contributed by Nijel.
(cherry picked from commit 2da3d2ed2ff2e9b48dbda7e029aa58261c729d35)
2015-03-24 23:03:56 +05:30
Brandon Li 95bde88986 HDFS-7976. Update NFS user guide for mount option 'sync' to minimize or avoid reordered writes. Contributed by Brandon Li
(cherry picked from commit 51f1f49374)
2015-03-24 10:29:27 -07:00
Andrew Wang e39c58fd9d HDFS-7961. Trigger full block report after hot swapping disk. Contributed by Eddy Xu.
(cherry picked from commit 6413d34986)
2015-03-24 09:07:24 -07:00
Tsuyoshi Ozawa 94eb8e5b3d MAPREDUCE-6285. ClientServiceDelegate should not retry upon AuthenticationException. Contributed by Jonathan Eagles.
(cherry picked from commit 4170c99147)
2015-03-25 00:57:08 +09:00
Tsuyoshi Ozawa a732b58beb HADOOP-11609. Correct credential commands info in CommandsManual.html#credential. Contributed by Varun Saxena.
(cherry picked from commit 6e891a921e)
2015-03-24 20:57:56 +09:00
Vinayakumar B c3e2c20c99 HDFS-3325. When configuring 'dfs.namenode.safemode.threshold-pct' to a value greater or equal to 1 there is mismatch in the UI report (Contributed by J.Andreina)
(cherry picked from commit c6c396fcd6)
2015-03-24 12:13:21 +05:30
Harsh J e7702ac6a1 YARN-1880. Cleanup TestApplicationClientProtocolOnHA. Contributed by ozawa.
(cherry picked from commit 8a9bbf548dad82598354c24fcd4dc80a715da7ac)
2015-03-24 11:58:16 +05:30
Plamen Jeliazkov 75d6d9e022 HDFS-7956. Improve logging for DatanodeRegistration. Contributed by Plamen Jeliazkov. 2015-03-23 23:07:01 -07:00
Andrew Wang 2f46ee50bd HDFS-7960. The full block report should prune zombie storages even if they're not empty. Contributed by Colin McCabe and Eddy Xu.
(cherry picked from commit 50ee8f4e67)
2015-03-23 22:00:44 -07:00
Tsz-Wo Nicholas Sze fe693b72de HDFS-7884. Fix NullPointerException in BlockSender when the generation stamp provided by the client is larger than the one stored in the datanode. Contributed by Brahma Reddy Battula 2015-03-24 13:51:31 +09:00
Xuan cbdcdfad6d YARN-3393. Getting application(s) goes wrong when app finishes before
starting the attempt. Contributed by Zhijie Shen

(cherry picked from commit 9fae455e26)
2015-03-23 20:34:29 -07:00
cnauroth 01c0bcb176 HDFS-7917. Use file to replace data dirs in test to simulate a disk failure. Contributed by Lei (Eddy) Xu.
(cherry picked from commit 2c238ae4e0)
2015-03-23 16:30:33 -07:00
Akira Ajisaka fad8c78173 HDFS-7881. TestHftpFileSystem#testSeek fails in branch-2. Contributed by Brahma Reddy Battula. 2015-03-24 06:24:29 +09:00
Karthik Kambatla 4e0c48703e YARN-2868. FairScheduler: Metric for latency to allocate first container for an application. (Ray Chiang via kasha)
(cherry picked from commit 972f1f1ab9)
2015-03-23 14:10:23 -07:00
Karthik Kambatla 75591e4131 YARN-3241. FairScheduler handles invalid queue names inconsistently. (Zhihai Xu via kasha)
(cherry picked from commit 2bc097cd14)
2015-03-23 13:24:22 -07:00
cnauroth 342c525eaa YARN-3336. FileSystem memory leak in DelegationTokenRenewer.
(cherry picked from commit 6ca1f12024)
2015-03-23 10:46:06 -07:00
Devaraj K 943d9ee603 MAPREDUCE-6242. Progress report log is incredibly excessive in application
master. Contributed by Varun Saxena.
2015-03-23 22:48:00 +05:30