8624 Commits

Author SHA1 Message Date
Haohui Mai
b36fc6bc9c HADOOP-10703. HttpServer2 creates multiple authentication filters. Contributed by Benoy Antony. 2015-03-18 22:32:19 -07:00
Colin Patrick Mccabe
b02f77540c HADOOP-9329. document native build dependencies in BUILDING.txt (Vijay Bhat via Colin P. McCabe)
(cherry picked from commit bf6295bed8b58432ede44e074fa7998d55c4b821)
2015-03-18 19:14:58 -07:00
Colin Patrick Mccabe
219eb22c15 HDFS-7929. inotify unable fetch pre-upgrade edit log segments once upgrade starts (Zhe Zhang via Colin P. McCabe)
(cherry picked from commit 43b41f22411439c5e23629197fb2fde45dcf0f0f)
2015-03-18 19:08:30 -07:00
Jing Zhao
5a5b244648 HDFS-7587. Edit log corruption can happen if append fails with a quota violation. Contributed by Jing Zhao.
(cherry picked from commit c7c71cdba50cb7d8282622cd496cc913c80cff54)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2015-03-18 18:56:56 -07:00
Jing Zhao
6dcc79507d HDFS-7943. Append cannot handle the last block with length greater than the preferred block size. Contributed by Jing Zhao.
(cherry picked from commit bee5a6a64a1c037308fa4d52249be39c82791590)
2015-03-18 18:45:01 -07:00
Colin Patrick Mccabe
79c07bbaca HDFS-7054. Make DFSOutputStream tracing more fine-grained (cmccabe)
(cherry picked from commit 8234fd0e1087e0e49aa1d6f286f292b7f70b368e)
2015-03-18 18:15:17 -07:00
Karthik Kambatla
05627dd96d YARN-3351. AppMaster tracking URL is broken in HA. (Anubhav Dhoot via kasha)
(cherry picked from commit 20b49224eb90c796f042ac4251508f3979fd4787)
2015-03-18 16:33:57 -07:00
Haohui Mai
8eb97ea14e HDFS-7945. The WebHdfs system on DN does not honor the length parameter. Contributed by Haohui Mai. 2015-03-18 16:19:57 -07:00
Arpit Agarwal
ca629f4579 HDFS-7914. TestJournalNode#testFailToStartWithBadConfig fails when the default dfs.journalnode.http-address port 8480 is in use. (Contributed by Xiaoyu Yao) 2015-03-18 14:05:24 -07:00
Haohui Mai
572555c9f9 HDFS-7697. Mark the PB OIV tool as experimental. Contributed by Lei (Eddy) Xu. 2015-03-18 13:34:03 -07:00
Arpit Agarwal
e7ceb434d0 Fix CHANGES.txt for HDFS-7722. 2015-03-18 12:52:50 -07:00
Arpit Agarwal
6b7cf6e096 HDFS-7951. Fix NPE for TestFsDatasetImpl#testAddVolumeFailureReleasesInUseLock on Linux. (Contributed by Xiaoyu Yao) 2015-03-18 12:46:09 -07:00
Arpit Agarwal
97341a4a1d HDFS-7950. Fix TestFsDatasetImpl#testAddVolumes failure on Windows. (Contributed by Xiaoyu Yao) 2015-03-18 12:35:35 -07:00
Jason Lowe
24d8c6f355 MAPREDUCE-6277. Job can post multiple history files if attempt loses connection to the RM. Contributed by Chang Li
(cherry picked from commit 30da99cbaf36aeef38a858251ce8ffa5eb657b38)
2015-03-18 19:31:32 +00:00
Arpit Agarwal
a08b1b5703 HDFS-7948. TestDataNodeHotSwapVolumes#testAddVolumeFailures failed on Windows. (Contributed by Xiaoyu Yao) 2015-03-18 12:26:11 -07:00
Haohui Mai
b547e6d6e0 HDFS-7953. NN Web UI fails to navigate to paths that contain #. Contributed by kanaka kumar avvaru. 2015-03-18 11:08:29 -07:00
Harsh J
4e80c4cd5e MAPREDUCE-5807. Print usage for TeraSort job. Contributed by Rohith.
(cherry picked from commit 9d72f939759f407796ecb4715c2dc2f0d36d5578)
2015-03-18 17:31:25 +05:30
Akira Ajisaka
18740f9383 HADOOP-11659. o.a.h.FileSystem.Cache#remove should use a single hash map lookup. Contributed by Brahma Reddy Battula.
(cherry picked from commit 34117325b29f0f1bdbe21343e7fd07e9ad0af907)
2015-03-18 15:44:13 +09:00
Arpit Agarwal
7d0f84bd8d HDFS-7946. TestDataNodeVolumeFailureReporting NPE on Windows. (Contributed by Xiaoyu Yao) 2015-03-17 21:34:35 -07:00
Jian He
15ebacf03a YARN-3273. Improve scheduler UI to facilitate scheduling analysis and debugging. Contributed Rohith Sharmaks
(cherry picked from commit 658097d6da1b1aac8e01db459f0c3b456e99652f)
2015-03-17 21:31:20 -07:00
Tsuyoshi Ozawa
b00b216a91 YARN-3205. FileSystemRMStateStore should disable FileSystem Cache to avoid get a Filesystem with an old configuration. Contributed by Zhihai Xu.
(cherry picked from commit 3bc72cc16d8c7b8addd8f565523001dfcc32b891)
2015-03-18 11:53:40 +09:00
Aaron T. Myers
85473cd61a HADOOP-11722. Some Instances of Services using ZKDelegationTokenSecretManager go down when old token cannot be deleted. Contributed by Arun Suresh.
(cherry picked from commit fc90bf7b27cc20486f2806670a14fd7d654b0a31)
2015-03-17 19:42:31 -07:00
Jian He
ab34e6975b YARN-3305. Normalize AM resource request on app submission. Contributed by Rohith Sharmaks
(cherry picked from commit 968425e9f7b850ff9c2ab8ca37a64c3fdbe77dbf)
2015-03-17 13:50:44 -07:00
Karthik Kambatla
1e77d92d62 Revert "YARN-3181. FairScheduler: Fix up outdated findbugs issues. (kasha)"
This reverts commit c2b185def846f5577a130003a533b9c377b58fab.

(cherry picked from commit 32b43304563c2430c00bc3e142a962d2bc5f4d58)
2015-03-17 12:31:44 -07:00
Colin Patrick Mccabe
455d4aa8a1 HDFS-7940. Add tracing to DFSClient#setQuotaByStorageType (Rakesh R via Colin P. McCabe)
(cherry picked from commit d8846707c58c5c3ec542128df13a82ddc05fb347)
2015-03-17 11:01:42 -07:00
Jian He
1c601e492f YARN-3243. CapacityScheduler should pass headroom from parent to children to make sure ParentQueue obey its capacity limits. Contributed by Wangda Tan.
(cherry picked from commit 487374b7fe0c92fc7eb1406c568952722b5d5b15)
2015-03-17 10:25:07 -07:00
Devaraj K
895588b439 YARN-3197. Confusing log generated by CapacityScheduler. Contributed by
Varun Saxena.

(cherry picked from commit 7179f94f9d000fc52bd9ce5aa9741aba97ec3ee8)
2015-03-17 15:59:19 +05:30
Vinayakumar B
6ddb1bc857 HDFS-5356. MiniDFSCluster should close all open FileSystems when shutdown() (Contributed by Rakesh R)
(cherry picked from commit 018893e81ec1c43e6c79c77adec92c2edfb20cab)
2015-03-17 15:34:48 +05:30
Harsh J
c58786794b MAPREDUCE-4653. TestRandomAlgorithm has an unused import statement. Contributed by Amir Sanjar.
(cherry picked from commit 75e4670408a058efa95eaa768fedbe614008658f)
2015-03-17 14:13:23 +05:30
yliu
991ac04afc HDFS-7838. Expose truncate API for libhdfs. (yliu) 2015-03-17 07:24:20 +08:00
Tsuyoshi Ozawa
77297017d8 HADOOP-11720. [JDK8] Fix javadoc errors caused by incorrect or illegal tags in hadoop-tools. Contributed by Akira AJISAKA.
(cherry picked from commit ef9946cd52d54200c658987c1dbc3e6fce133f77)
2015-03-17 16:09:38 +09:00
Tsuyoshi Ozawa
bb828565f8 MAPREDUCE-5755. MapTask.MapOutputBuffer#compare/swap should have @Override annotation. (ozawa)
(cherry picked from commit bb243cea93b6872ef8956311a2290ca0b83ebb22)
2015-03-17 14:55:33 +09:00
Harsh J
5e403e8b8d MAPREDUCE-6100. replace mapreduce.job.credentials.binary with MRJobConfig.MAPREDUCE_JOB_CREDENTIALS_BINARY for better readability. Contributed by Zhihai Xu.
(cherry picked from commit f222bde273cc10a38945dc31e85206a0c4f06a12)
2015-03-17 11:08:32 +05:30
Harsh J
cbb8858367 HDFS-2360. Ugly stacktrce when quota exceeds. (harsh)
(cherry picked from commit 046521cd6511b7fc6d9478cb2bed90d8e75fca20)
2015-03-17 10:28:52 +05:30
Ravi Prakash
9f227ad696 YARN-3339. TestDockerContainerExecutor should pull a single image and not the entire centos repository. (Ravindra Kumar Naik via raviprak)
(cherry picked from commit 56085203c43b8f2561bf3745910e03f8ac176a67)
2015-03-16 16:18:42 -07:00
Tsuyoshi Ozawa
a20427d339 YARN-3349. Treat all exceptions as failure in TestFSRMStateStore#testFSRMStateStoreClientRetry. Contributed by Zhihai Xu.
(cherry picked from commit 7522a643faeea2d8a8e2c7409ae60e0973e7cf38)
2015-03-17 08:10:12 +09:00
cnauroth
ef2a66b246 Revert "HADOOP-11449 / HADOOP-10320 ; reverting patch 6cda3a7 which triggered regression in javadocs on some java8 compilers (stevel on behalf of cnauroth)"
This reverts commit fe7df5b4d87298571da45562402976810899b6a9.

Conflicts:
	hadoop-common-project/hadoop-annotations/src/main/java/org/apache/hadoop/classification/InterfaceStability.java
2015-03-16 14:31:35 -07:00
Suresh Srinivas
3a783fe38d HADOOP-8059. Add javadoc to InterfaceAudience and InterfaceStability. Contributed by Brandon Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354684 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 24c4216bf0d75006fb218d743183f96658bea65c)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2015-03-16 14:21:15 -07:00
Yongjun Zhang
d684b21ada HADOOP-11692. Amendment to CHANGES.txt. 2015-03-16 14:11:58 -07:00
cnauroth
f492fc7b2c HADOOP-11638. OpensslSecureRandom.c pthreads_thread_id should support FreeBSD and Solaris in addition to Linux. Contributed by Kiran Kumar M R.
(cherry picked from commit 72cd4e4a4eb2a9f8695d4c67eb55dd2be36c52dc)
2015-03-16 14:05:05 -07:00
Harsh J
0e9f78dda2 MAPREDUCE-6105. nconsistent configuration in property mapreduce.reduce.shuffle.merge.percent. Contributed by Ray Chiang.
(cherry picked from commit 26a23b11598b3757ed4973781890e2cd2fc270df)
2015-03-17 02:27:33 +05:30
Konstantin V Shvachko
4568acaa62 HDFS-7886. Fix TestFileTruncate falures. Contributed by Plamen Jeliazkov and Konstantin Shvachko. 2015-03-16 12:55:16 -07:00
Harsh J
2684b0b440 MAPREDUCE-4414. Add main methods to JobConf and YarnConfiguration, for debug purposes. Contributed by Plamen Jeliazkov.
(cherry picked from commit 571f75b468a4412be2178466cb5d3888b05cd076)
2015-03-17 01:02:21 +05:30
Colin Patrick Mccabe
eb4eb63de3 HADOOP-11714. Add more trace log4j messages to SpanReceiverHost (cmccabe)
(cherry picked from commit bf3275dbaa99105d49520e25f5a6eadd6fd5b7ed)
2015-03-16 12:03:10 -07:00
Zhijie Shen
fbe811d904 YARN-2854. Updated the documentation of the timeline service and the generic history service. Contributed by Naganarasimha G R. 2015-03-16 10:52:32 -07:00
Tsuyoshi Ozawa
d6e3ef2506 YARN-1453. [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments. Contributed by Akira AJISAKA, Andrew Purtell, and Allen Wittenauer.
(cherry picked from commit 3da9a97cfbcc3a1c50aaf85b1a129d4d269cd5fd)
2015-03-16 23:20:17 +09:00
Xuan
b6eb36dbdc YARN-3171. Sort by Application id, AppAttempt and ContainerID doesn't
work in ATS / RM web ui. Contributed by Naganarasimha G R

(cherry picked from commit 3ff1ba2a7b00fdf06270d00b2193bde4b56b06b3)
2015-03-15 20:27:44 -07:00
Colin Patrick Mccabe
c71b54fa32 HDFS-7915. The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error (cmccabe)
(cherry picked from commit bc9cb3e271b22069a15ca110cd60c860250aaab2)
2015-03-14 22:41:50 -07:00
Tsuyoshi Ozawa
4489a02634 HADOOP-11558. Fix dead links to doc of hadoop-tools. Contributed by Jean-Pierre Matsumoto.
(cherry picked from commit 79426f3334ade5850fbf169764f540ede00fe366)
2015-03-15 14:30:12 +09:00
Tsuyoshi Ozawa
1802df8373 Revert "HADOOP-11558. Fix dead links to doc of hadoop-tools. Contributed by Masatake Iwasaki."
This reverts commit 54a73a6b5fd085456020d3564187e03a0ef41033.
2015-03-15 14:27:56 +09:00