Commit Graph

8633 Commits

Author SHA1 Message Date
Jason Lowe cabe676d67 MAPREDUCE-6275. Race condition in FileOutputCommitter v2 for user-specified task output subdirs. Contributed by Gera Shegalov and Siqi Li
(cherry picked from commit 91baca145a)
2015-03-19 21:40:51 +00:00
Kihwal Lee 2b9173059d HDFS-7932. Speed up the shutdown of datanode during rolling upgrade. Contributed by Kihwal Lee.
(cherry picked from commit 61a4c7fc98)
2015-03-19 12:28:36 -05:00
Tsuyoshi Ozawa ef9aa7c34b MAPREDUCE-6281. Fix javadoc in Terasort. Contributed by Albert Chu.
(cherry picked from commit 1ccbc29708)
2015-03-20 00:59:43 +09:00
Tsuyoshi Ozawa 0eeb760c55 HADOOP-11729. Fix link to cgroups doc in site.xml. Contributed by Masatake Iwasaki.
(cherry picked from commit 522c897146)
2015-03-19 23:08:41 +09:00
Vinayakumar B 786ba9784d HDFS.7849. Update documentation for enabling a new feature in rolling upgrade ( Contributed by J.Andreina )
(cherry picked from commit 5be5129d93)
2015-03-19 19:06:47 +05:30
Kihwal Lee ceb39c1cc6 HDFS-7816. Unable to open webhdfs paths with "+". Contributed by Haohui Mai
(cherry picked from commit e79be0ee12)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2015-03-19 08:03:47 -05:00
Devaraj K a888dac344 YARN-3357. Move TestFifoScheduler to FIFO package. Contributed by Rohith
Sharmaks.

(cherry picked from commit 93d0f4acc8)
2015-03-19 12:18:08 +05:30
Vinayakumar B 25515d1421 HDFS-7867. Update action param from 'start' to 'prepare' in rolling upgrade ( Contributed by J.Andreina) Updated JIRA id.
(cherry picked from commit 355e008ffb)
2015-03-19 12:11:34 +05:30
Vinayakumar B 4527aa6f77 HDFS-7869. Update action param from 'start' to 'prepare' in rolling upgrade ( Contributed by J.Andreina)
(cherry picked from commit 338b477ff7)
2015-03-19 12:01:05 +05:30
Haohui Mai b36fc6bc9c HADOOP-10703. HttpServer2 creates multiple authentication filters. Contributed by Benoy Antony. 2015-03-18 22:32:19 -07:00
Colin Patrick Mccabe b02f77540c HADOOP-9329. document native build dependencies in BUILDING.txt (Vijay Bhat via Colin P. McCabe)
(cherry picked from commit bf6295bed8)
2015-03-18 19:14:58 -07:00
Colin Patrick Mccabe 219eb22c15 HDFS-7929. inotify unable fetch pre-upgrade edit log segments once upgrade starts (Zhe Zhang via Colin P. McCabe)
(cherry picked from commit 43b41f2241)
2015-03-18 19:08:30 -07:00
Jing Zhao 5a5b244648 HDFS-7587. Edit log corruption can happen if append fails with a quota violation. Contributed by Jing Zhao.
(cherry picked from commit c7c71cdba5)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2015-03-18 18:56:56 -07:00
Jing Zhao 6dcc79507d HDFS-7943. Append cannot handle the last block with length greater than the preferred block size. Contributed by Jing Zhao.
(cherry picked from commit bee5a6a64a)
2015-03-18 18:45:01 -07:00
Colin Patrick Mccabe 79c07bbaca HDFS-7054. Make DFSOutputStream tracing more fine-grained (cmccabe)
(cherry picked from commit 8234fd0e10)
2015-03-18 18:15:17 -07:00
Karthik Kambatla 05627dd96d YARN-3351. AppMaster tracking URL is broken in HA. (Anubhav Dhoot via kasha)
(cherry picked from commit 20b49224eb)
2015-03-18 16:33:57 -07:00
Haohui Mai 8eb97ea14e HDFS-7945. The WebHdfs system on DN does not honor the length parameter. Contributed by Haohui Mai. 2015-03-18 16:19:57 -07:00
Arpit Agarwal ca629f4579 HDFS-7914. TestJournalNode#testFailToStartWithBadConfig fails when the default dfs.journalnode.http-address port 8480 is in use. (Contributed by Xiaoyu Yao) 2015-03-18 14:05:24 -07:00
Haohui Mai 572555c9f9 HDFS-7697. Mark the PB OIV tool as experimental. Contributed by Lei (Eddy) Xu. 2015-03-18 13:34:03 -07:00
Arpit Agarwal e7ceb434d0 Fix CHANGES.txt for HDFS-7722. 2015-03-18 12:52:50 -07:00
Arpit Agarwal 6b7cf6e096 HDFS-7951. Fix NPE for TestFsDatasetImpl#testAddVolumeFailureReleasesInUseLock on Linux. (Contributed by Xiaoyu Yao) 2015-03-18 12:46:09 -07:00
Arpit Agarwal 97341a4a1d HDFS-7950. Fix TestFsDatasetImpl#testAddVolumes failure on Windows. (Contributed by Xiaoyu Yao) 2015-03-18 12:35:35 -07:00
Jason Lowe 24d8c6f355 MAPREDUCE-6277. Job can post multiple history files if attempt loses connection to the RM. Contributed by Chang Li
(cherry picked from commit 30da99cbaf)
2015-03-18 19:31:32 +00:00
Arpit Agarwal a08b1b5703 HDFS-7948. TestDataNodeHotSwapVolumes#testAddVolumeFailures failed on Windows. (Contributed by Xiaoyu Yao) 2015-03-18 12:26:11 -07:00
Haohui Mai b547e6d6e0 HDFS-7953. NN Web UI fails to navigate to paths that contain #. Contributed by kanaka kumar avvaru. 2015-03-18 11:08:29 -07:00
Harsh J 4e80c4cd5e MAPREDUCE-5807. Print usage for TeraSort job. Contributed by Rohith.
(cherry picked from commit 9d72f93975)
2015-03-18 17:31:25 +05:30
Akira Ajisaka 18740f9383 HADOOP-11659. o.a.h.FileSystem.Cache#remove should use a single hash map lookup. Contributed by Brahma Reddy Battula.
(cherry picked from commit 34117325b2)
2015-03-18 15:44:13 +09:00
Arpit Agarwal 7d0f84bd8d HDFS-7946. TestDataNodeVolumeFailureReporting NPE on Windows. (Contributed by Xiaoyu Yao) 2015-03-17 21:34:35 -07:00
Jian He 15ebacf03a YARN-3273. Improve scheduler UI to facilitate scheduling analysis and debugging. Contributed Rohith Sharmaks
(cherry picked from commit 658097d6da)
2015-03-17 21:31:20 -07:00
Tsuyoshi Ozawa b00b216a91 YARN-3205. FileSystemRMStateStore should disable FileSystem Cache to avoid get a Filesystem with an old configuration. Contributed by Zhihai Xu.
(cherry picked from commit 3bc72cc16d)
2015-03-18 11:53:40 +09:00
Aaron T. Myers 85473cd61a HADOOP-11722. Some Instances of Services using ZKDelegationTokenSecretManager go down when old token cannot be deleted. Contributed by Arun Suresh.
(cherry picked from commit fc90bf7b27)
2015-03-17 19:42:31 -07:00
Jian He ab34e6975b YARN-3305. Normalize AM resource request on app submission. Contributed by Rohith Sharmaks
(cherry picked from commit 968425e9f7)
2015-03-17 13:50:44 -07:00
Karthik Kambatla 1e77d92d62 Revert "YARN-3181. FairScheduler: Fix up outdated findbugs issues. (kasha)"
This reverts commit c2b185def8.

(cherry picked from commit 32b4330456)
2015-03-17 12:31:44 -07:00
Colin Patrick Mccabe 455d4aa8a1 HDFS-7940. Add tracing to DFSClient#setQuotaByStorageType (Rakesh R via Colin P. McCabe)
(cherry picked from commit d8846707c5)
2015-03-17 11:01:42 -07:00
Jian He 1c601e492f YARN-3243. CapacityScheduler should pass headroom from parent to children to make sure ParentQueue obey its capacity limits. Contributed by Wangda Tan.
(cherry picked from commit 487374b7fe)
2015-03-17 10:25:07 -07:00
Devaraj K 895588b439 YARN-3197. Confusing log generated by CapacityScheduler. Contributed by
Varun Saxena.

(cherry picked from commit 7179f94f9d)
2015-03-17 15:59:19 +05:30
Vinayakumar B 6ddb1bc857 HDFS-5356. MiniDFSCluster should close all open FileSystems when shutdown() (Contributed by Rakesh R)
(cherry picked from commit 018893e81e)
2015-03-17 15:34:48 +05:30
Harsh J c58786794b MAPREDUCE-4653. TestRandomAlgorithm has an unused import statement. Contributed by Amir Sanjar.
(cherry picked from commit 75e4670408a058efa95eaa768fedbe614008658f)
2015-03-17 14:13:23 +05:30
yliu 991ac04afc HDFS-7838. Expose truncate API for libhdfs. (yliu) 2015-03-17 07:24:20 +08:00
Tsuyoshi Ozawa 77297017d8 HADOOP-11720. [JDK8] Fix javadoc errors caused by incorrect or illegal tags in hadoop-tools. Contributed by Akira AJISAKA.
(cherry picked from commit ef9946cd52)
2015-03-17 16:09:38 +09:00
Tsuyoshi Ozawa bb828565f8 MAPREDUCE-5755. MapTask.MapOutputBuffer#compare/swap should have @Override annotation. (ozawa)
(cherry picked from commit bb243cea93)
2015-03-17 14:55:33 +09:00
Harsh J 5e403e8b8d MAPREDUCE-6100. replace mapreduce.job.credentials.binary with MRJobConfig.MAPREDUCE_JOB_CREDENTIALS_BINARY for better readability. Contributed by Zhihai Xu.
(cherry picked from commit f222bde273)
2015-03-17 11:08:32 +05:30
Harsh J cbb8858367 HDFS-2360. Ugly stacktrce when quota exceeds. (harsh)
(cherry picked from commit 046521cd65)
2015-03-17 10:28:52 +05:30
Ravi Prakash 9f227ad696 YARN-3339. TestDockerContainerExecutor should pull a single image and not the entire centos repository. (Ravindra Kumar Naik via raviprak)
(cherry picked from commit 56085203c4)
2015-03-16 16:18:42 -07:00
Tsuyoshi Ozawa a20427d339 YARN-3349. Treat all exceptions as failure in TestFSRMStateStore#testFSRMStateStoreClientRetry. Contributed by Zhihai Xu.
(cherry picked from commit 7522a643fa)
2015-03-17 08:10:12 +09:00
cnauroth ef2a66b246 Revert "HADOOP-11449 / HADOOP-10320 ; reverting patch 6cda3a7 which triggered regression in javadocs on some java8 compilers (stevel on behalf of cnauroth)"
This reverts commit fe7df5b4d8.

Conflicts:
	hadoop-common-project/hadoop-annotations/src/main/java/org/apache/hadoop/classification/InterfaceStability.java
2015-03-16 14:31:35 -07:00
Suresh Srinivas 3a783fe38d HADOOP-8059. Add javadoc to InterfaceAudience and InterfaceStability. Contributed by Brandon Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354684 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 24c4216bf0)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2015-03-16 14:21:15 -07:00
Yongjun Zhang d684b21ada HADOOP-11692. Amendment to CHANGES.txt. 2015-03-16 14:11:58 -07:00
cnauroth f492fc7b2c HADOOP-11638. OpensslSecureRandom.c pthreads_thread_id should support FreeBSD and Solaris in addition to Linux. Contributed by Kiran Kumar M R.
(cherry picked from commit 72cd4e4a4e)
2015-03-16 14:05:05 -07:00
Harsh J 0e9f78dda2 MAPREDUCE-6105. nconsistent configuration in property mapreduce.reduce.shuffle.merge.percent. Contributed by Ray Chiang.
(cherry picked from commit 26a23b11598b3757ed4973781890e2cd2fc270df)
2015-03-17 02:27:33 +05:30