Commit Graph

8900 Commits

Author SHA1 Message Date
Haohui Mai c261d35b75 HADOOP-11748. The secrets of auth cookies should not be specified in configuration in clear text. Contributed by Li Lu and Haohui Mai. 2015-03-26 17:35:28 -07:00
Colin Patrick Mccabe 2a750c9aa6 HDFS-7410. Support CreateFlags with append() to support hsync() for appending streams (Vinayakumar B via Colin P. McCabe)
(cherry picked from commit 61df1b27a7)
2015-03-26 13:28:58 -07:00
Robert Kanter 6f0e864d61 YARN-3400. [JDK 8] Build Failure due to unreported exceptions in RPCUtil (rkanter)
(cherry picked from commit 87130bf6b2)
2015-03-26 11:00:37 -07:00
Arpit Agarwal c035106c05 HDFS-7824. GetContentSummary API and its namenode implementation for Storage Type Quota/Usage. (Contributed by Xiaoyu Yao) 2015-03-26 10:47:43 -07:00
Kihwal Lee 071277b9ce HDFS-7963. Fix expected tracing spans in TestTracing. Contributed by Masatake Iwasaki. 2015-03-26 08:42:45 -05:00
Harsh J c33ecd83e4 HADOOP-11719.[Fsshell] Remove bin/hadoop reference from GenericOptionsParser default help text. Contributed by Brahma Reddy Battula.
(cherry picked from commit 1ede5e6e1e7f51cf13d0488bb1b0e126c865656c)
2015-03-26 11:28:32 +05:30
Haohui Mai 6e9202c802 HDFS-7918. Clean up unused code for old web UI in branch-2. Contributed by Brahma Reddy Battula. 2015-03-25 17:46:36 -07:00
Yongjun Zhang be0d228ed1 HADOOP-11724. DistCp throws NPE when the target directory is root. (Lei Eddy Xu via Yongjun Zhang)
(cherry-picked from commit 65ee02d9ed50e026c2d37ec80babd4176075ff84)
2015-03-25 15:50:28 -07:00
Kihwal Lee be4eabdcd4 HDFS-7928. Scanning blocks from disk during rolling upgrade startup takes a lot of time if disks are busy. Contributed by Rushabh Shah.
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/BlockPoolSlice.java
2015-03-25 14:51:00 -05:00
Haohui Mai c62840d531 Addendum for HADOOP-10670. 2015-03-25 12:30:12 -07:00
Haohui Mai 17f17dac4e HADOOP-10670. Allow AuthenticationFilters to load secret from signature secret files. Contributed by Kai Zheng. 2015-03-25 11:13:04 -07:00
Karthik Kambatla 2158cd2bef YARN-3397. yarn rmadmin should skip -failover. (J.Andreina via kasha)
(cherry picked from commit c906a1de72)
2015-03-25 07:42:45 -07:00
Xuan 0c4fa872be YARN-2213. Change proxy-user cookie log in AmIpFilter to DEBUG.
Contributed by Varun Saxena

(cherry picked from commit e556198e71)
2015-03-25 04:51:55 -07:00
Akira Ajisaka 2e509908ee MAPREDUCE-6292. Use org.junit package instead of junit.framework in TestCombineFileInputFormat. (aajisaka)
(cherry picked from commit c770df49b4)
2015-03-25 19:01:38 +09:00
Harsh J d85c14afbf MAPREDUCE-579. Streaming slowmatch documentation.
(cherry picked from commit a2e42d2deee715f6255d6fd2c95f34e80888dc5f)
2015-03-25 14:39:46 +05:30
Tsuyoshi Ozawa ee824cafe7 HADOOP-11738. Fix a link of Protocol Buffers 2.5 for download in BUILDING.txt. (ozawa)
(cherry picked from commit 323945b33a)
2015-03-25 18:02:52 +09:00
Tsuyoshi Ozawa e4da690547 HADOOP-11014. Potential resource leak in JavaKeyStoreProvider due to unclosed stream. (ozawa)
(cherry picked from commit b351086ff6)
2015-03-25 16:59:55 +09:00
Tsuyoshi Ozawa 77024aada9 HADOOP-11741. Add LOG.isDebugEnabled() guard for some LOG.debug(). Contributed by Walter Su.
(cherry picked from commit 5582b0f1d4)
2015-03-25 16:36:26 +09:00
Jitendra Pandey 456cec127b HDFS-6826. Plugin interface to enable delegation of HDFS authorization assertions. Contributed by Arun Suresh.
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
2015-03-24 16:02:21 -07:00
Haohui Mai 161dae898f HDFS-7713. Implement mkdirs in the HDFS Web UI. Contributed by Ravi Prakash. 2015-03-24 15:49:08 -07:00
Jing Zhao 483f77b75b HDFS-7854. Separate class DataStreamer out of DFSOutputStream. Contributed by Li Bo.
(cherry picked from commit a16bfff71b)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java
2015-03-24 11:21:10 -07:00
Brandon Li 260dbe96c3 HDFS-7977. NFS couldn't take percentile intervals. Contributed by Brandon Li
(cherry picked from commit 570a83ae80)
2015-03-24 10:50:50 -07:00
Wangda Tan 29629020c1 YARN-3383. AdminService should use warn instead of info to log exception when operation fails. (Li Lu via wangda)
(cherry picked from commit 97a7277a2d)
2015-03-24 10:39:45 -07:00
Harsh J 608ad6c2cd HDFS-7875. Improve log message when wrong value configured for dfs.datanode.failed.volumes.tolerated. Contributed by Nijel.
(cherry picked from commit 2da3d2ed2ff2e9b48dbda7e029aa58261c729d35)
2015-03-24 23:03:56 +05:30
Brandon Li 95bde88986 HDFS-7976. Update NFS user guide for mount option 'sync' to minimize or avoid reordered writes. Contributed by Brandon Li
(cherry picked from commit 51f1f49374)
2015-03-24 10:29:27 -07:00
Andrew Wang e39c58fd9d HDFS-7961. Trigger full block report after hot swapping disk. Contributed by Eddy Xu.
(cherry picked from commit 6413d34986)
2015-03-24 09:07:24 -07:00
Tsuyoshi Ozawa 94eb8e5b3d MAPREDUCE-6285. ClientServiceDelegate should not retry upon AuthenticationException. Contributed by Jonathan Eagles.
(cherry picked from commit 4170c99147)
2015-03-25 00:57:08 +09:00
Tsuyoshi Ozawa a732b58beb HADOOP-11609. Correct credential commands info in CommandsManual.html#credential. Contributed by Varun Saxena.
(cherry picked from commit 6e891a921e)
2015-03-24 20:57:56 +09:00
Vinayakumar B c3e2c20c99 HDFS-3325. When configuring 'dfs.namenode.safemode.threshold-pct' to a value greater or equal to 1 there is mismatch in the UI report (Contributed by J.Andreina)
(cherry picked from commit c6c396fcd6)
2015-03-24 12:13:21 +05:30
Harsh J e7702ac6a1 YARN-1880. Cleanup TestApplicationClientProtocolOnHA. Contributed by ozawa.
(cherry picked from commit 8a9bbf548dad82598354c24fcd4dc80a715da7ac)
2015-03-24 11:58:16 +05:30
Plamen Jeliazkov 75d6d9e022 HDFS-7956. Improve logging for DatanodeRegistration. Contributed by Plamen Jeliazkov. 2015-03-23 23:07:01 -07:00
Andrew Wang 2f46ee50bd HDFS-7960. The full block report should prune zombie storages even if they're not empty. Contributed by Colin McCabe and Eddy Xu.
(cherry picked from commit 50ee8f4e67)
2015-03-23 22:00:44 -07:00
Tsz-Wo Nicholas Sze fe693b72de HDFS-7884. Fix NullPointerException in BlockSender when the generation stamp provided by the client is larger than the one stored in the datanode. Contributed by Brahma Reddy Battula 2015-03-24 13:51:31 +09:00
Xuan cbdcdfad6d YARN-3393. Getting application(s) goes wrong when app finishes before
starting the attempt. Contributed by Zhijie Shen

(cherry picked from commit 9fae455e26)
2015-03-23 20:34:29 -07:00
cnauroth 01c0bcb176 HDFS-7917. Use file to replace data dirs in test to simulate a disk failure. Contributed by Lei (Eddy) Xu.
(cherry picked from commit 2c238ae4e0)
2015-03-23 16:30:33 -07:00
Akira Ajisaka fad8c78173 HDFS-7881. TestHftpFileSystem#testSeek fails in branch-2. Contributed by Brahma Reddy Battula. 2015-03-24 06:24:29 +09:00
Karthik Kambatla 4e0c48703e YARN-2868. FairScheduler: Metric for latency to allocate first container for an application. (Ray Chiang via kasha)
(cherry picked from commit 972f1f1ab9)
2015-03-23 14:10:23 -07:00
Karthik Kambatla 75591e4131 YARN-3241. FairScheduler handles invalid queue names inconsistently. (Zhihai Xu via kasha)
(cherry picked from commit 2bc097cd14)
2015-03-23 13:24:22 -07:00
cnauroth 342c525eaa YARN-3336. FileSystem memory leak in DelegationTokenRenewer.
(cherry picked from commit 6ca1f12024)
2015-03-23 10:46:06 -07:00
Devaraj K 943d9ee603 MAPREDUCE-6242. Progress report log is incredibly excessive in application
master. Contributed by Varun Saxena.
2015-03-23 22:48:00 +05:30
Brandon Li 503d8e4164 HDFS-7942. NFS: support regexp grouping in nfs.exports.allowed.hosts. Contributed by Brandon Li
(cherry picked from commit 36af4a913c)
2015-03-23 10:09:43 -07:00
Tsuyoshi Ozawa cbacf20755 YARN-3384. TestLogAggregationService.verifyContainerLogs fails after YARN-2777. Contributed by Naganarasimha G R.
(cherry picked from commit 82eda771e0)
2015-03-24 00:25:52 +09:00
Tsuyoshi Ozawa 4fee662944 HADOOP-11737. mockito's version in hadoop-nfs’ pom.xml shouldn't be specified. Contributed by Kengo Seki.
(cherry picked from commit 0b9f12c847)
2015-03-23 13:56:38 +09:00
Harsh J 2cd2431289 MAPREDUCE-6287. Deprecated methods in org.apache.hadoop.examples.Sort. Contributed by Chao Zhang.
(cherry picked from commit b375d1fc93)
2015-03-23 03:48:55 +05:30
Harsh J 6e6e0e4a37 MAPREDUCE-5448. Addendum fix to remove deprecation warning by junit.Assert import in TestFileOutputCommitter.
(cherry picked from commit 4cd54d9a29)
2015-03-22 10:33:29 +05:30
Harsh J 40682a4aad MAPREDUCE-6286. Amend commit to CHANGES.txt for backport into 2.7.0.
(cherry picked from commit 8770c82acc)
2015-03-22 10:16:12 +05:30
Harsh J d43c0da7d7 MAPREDUCE-5190. Unnecessary condition test in RandomSampler. Contributed by Jingguo Yao.
(cherry picked from commit 1d5c796d65)
2015-03-22 10:04:19 +05:30
Harsh J a7f1c1b993 MAPREDUCE-5448. MapFileOutputFormat#getReaders bug with invisible files/folders. Contributed by Maysam Yabandeh.
(cherry picked from commit b46c2bb51a)
2015-03-22 09:46:54 +05:30
Harsh J 7c72c7f529 MAPREDUCE-6286. A typo in HistoryViewer makes some code useless, which causes counter limits are not reset correctly. Contributed by Zhihai Xu.
(cherry picked from commit 433542904a)
2015-03-22 02:51:17 +05:30
Harsh J 418d078bc5 MAPREDUCE-6213. NullPointerException caused by job history server addr not resolvable. Contributed by Peng Zhang.
(cherry picked from commit e1e09052e8)
2015-03-22 02:45:01 +05:30