Commit Graph

9131 Commits

Author SHA1 Message Date
Xiaoyu Yao e68e8b3b5c HDFS-8219. setStoragePolicy with folder behavior is different after cluster restart. (surendra singh lilhore via Xiaoyu Yao)
(cherry picked from commit 0100b15501)
2015-05-05 13:42:22 -07:00
Jian He eb0c6d2ee7 YARN-3343. Increased TestCapacitySchedulerNodeLabelUpdate#testNodeUpdate timeout. Contributed by Rohith Sharmaks
(cherry picked from commit e4c3b52c89)
2015-05-05 11:34:11 -07:00
Allen Wittenauer 50a5d0b62b HADOOP-11917. test-patch.sh should work with ${BASEDIR}/patchprocess setups (aw) 2015-05-05 11:28:16 -07:00
Colin Patrick Mccabe 1f6bcf94cc HDFS-7758. Retire FsDatasetSpi#getVolumes() and use FsDatasetSpi#getVolumeRefs() instead (Lei (Eddy) Xu via Colin P. McCabe)
(cherry picked from commit 24d3a2d4fd)
2015-05-05 11:09:28 -07:00
Colin Patrick Mccabe 1f01d8347a HDFS-8305: HDFS INotify: the destination field of RenameOp should always end with the file name (cmccabe)
(cherry picked from commit fcd4cb7516)
2015-05-05 11:06:47 -07:00
Allen Wittenauer 51df9e8379 HADOOP-11904. test-patch.sh goes into an infinite loop on non-maven builds (aw) 2015-05-05 11:05:56 -07:00
Xuan 02cdcaec58 YARN-2123. Progress bars in Web UI always at 100% due to non-US locale.
Contributed by Akira AJISAKA

(cherry picked from commit b7dd3a4f04)
2015-05-05 10:45:18 -07:00
Allen Wittenauer 02892f674b HADOOP-11911. test-patch should allow configuration of default branch (Sean Busbey via aw) 2015-05-05 10:03:22 -07:00
Junping Du 6ea007ba91 YARN-3396. Handle URISyntaxException in ResourceLocalizationService. (Contributed by Brahma Reddy Battula)
(cherry picked from commit 3810242062)
2015-05-05 10:19:16 -07:00
Andrew Wang 84d8ba4f72 HADOOP-11120. hadoop fs -rmr gives wrong advice. Contributed by Juliet Houghland.
(cherry picked from commit 05adc76ace)
2015-05-05 08:37:41 -07:00
Jason Lowe 0f30913ea8 YARN-3552. RM Web UI shows -1 running containers for completed apps. Contributed by Rohith
(cherry picked from commit 9356cf8676)
2015-05-05 13:43:57 +00:00
Vinayakumar B 01bdfd794c HDFS-7916. 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop (Contributed by Vinayakumar B)
Reverted earlier commit

(cherry picked from commit 318081ccd7)
2015-05-05 11:06:44 +05:30
Tsuyoshi Ozawa aefadb838c HADOOP-11916. TestStringUtils#testLowerAndUpperStrings failed on MAC due to a JVM bug. Contributed by Ming Ma.
(cherry picked from commit 338e88a19e)
2015-05-05 12:39:43 +09:00
Tsuyoshi Ozawa 4e96175b33 MAPREDUCE-6165. [JDK8] TestCombineFileInputFormat failed on JDK8. Contributed by Akira AJISAKA.
(cherry picked from commit 551615fa13)
2015-05-05 10:23:25 +09:00
Jian He f71c49c5e3 YARN-2725. Added test cases of retrying creating znode in ZKRMStateStore. Contributed by Tsuyoshi Ozawa
(cherry picked from commit d701acc9c6)
2015-05-04 16:17:01 -07:00
Wangda Tan 4e77ee2f6f YARN-3375. NodeHealthScriptRunner.shouldRun() check is performing 3 times for starting NodeHealthScriptRunner (Devaraj K via wangda)
(cherry picked from commit 71f4de220c)
2015-05-04 16:02:57 -07:00
Allen Wittenauer 02e650248d YARN-2980. Move health check script related functionality to hadoop-common (Varun Saxena via aw)
(cherry picked from commit d4ac6822e1)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeManager.java
2015-05-04 16:00:20 -07:00
Haohui Mai db0bd6dca8 HDFS-8237. Move all protocol classes used by ClientProtocol to hdfs-client. Contributed by Haohui Mai. 2015-05-04 15:02:49 -07:00
Jason Lowe 81f128f293 MAPREDUCE-6259. IllegalArgumentException due to missing job submit time. Contributed by zhihai xu
(cherry picked from commit bf70c5ae28)
2015-05-04 20:40:16 +00:00
Colin Patrick Mccabe 8efcf5bdbd HDFS-7397. Add more detail to the documentation for the conf key "dfs.client.read.shortcircuit.streams.cache.size" (Brahma Reddy Battula via Colin P. McCabe)
(cherry picked from commit 3fe79e1db8)
2015-05-04 12:50:59 -07:00
Jason Lowe 87c2d915f1 MAPREDUCE-5649. Reduce cannot use more than 2G memory for the final merge. Contributed by Gera Shegalov
(cherry picked from commit 7dc3c1203d)
2015-05-04 19:03:43 +00:00
cnauroth a43080a2cf HDFS-8290. WebHDFS calls before namesystem initialization can cause NullPointerException. Contributed by Chris Nauroth.
(cherry picked from commit c4578760b6)
2015-05-04 11:35:18 -07:00
Jason Lowe 99b49a8181 YARN-3097. Logging of resource recovery on NM restart has redundancies. Contributed by Eric Payne
(cherry picked from commit 8f65c793f2)
2015-05-04 10:32:33 -05:00
Tsuyoshi Ozawa c64309f6ab HADOOP-11328. ZKFailoverController does not log Exception when doRun raises errors. Contributed by Tianyin Xu.
(cherry picked from commit bb9ddef0e7)
2015-05-04 17:47:52 +09:00
Tsuyoshi Ozawa 1e1ebbb42b HADOOP-9658. SnappyCodec#checkNativeCodeLoaded may unexpectedly fail when native code is not loaded. Contributed by Zhijie Shen.
(cherry picked from commit 76fa606e2d)
2015-05-04 17:05:53 +09:00
Tsuyoshi Ozawa 7e03bda3e7 MAPREDUCE-6349. Fix typo in property org.apache.hadoop.mapreduce.lib.chain.Chain.REDUCER_INPUT_VALUE_CLASS. Contributed by Ray Chiang.
(cherry picked from commit bb6ef2984d)
2015-05-04 15:36:53 +09:00
Tsuyoshi Ozawa 1035f550b9 MAPREDUCE-5905. CountersStrings.toEscapedCompactStrings outputs unnecessary null strings. Contributed by Akira AJISAKA.
(cherry picked from commit 3ba18362f2)
2015-05-04 15:02:40 +09:00
Xiaoyu Yao 5b27d9e076 HDFS-8309. Skip unit test using DataNodeTestUtils#injectDataDirFailure() on Windows. (xyao)
(cherry picked from commit a319771d1d)
2015-05-02 22:32:28 -07:00
Tsuyoshi Ozawa f382602de1 YARN-1993. Cross-site scripting vulnerability in TextView.java. Contributed byKenji Kikushima.
(cherry picked from commit e8d0ee5fc9)
2015-05-03 10:51:39 +09:00
Haohui Mai 65a19fbc30 HDFS-8249. Separate HdfsConstants into the client and the server side class. Contributed by Haohui Mai. 2015-05-02 10:03:04 -07:00
Junping Du 8068e79989 YARN-2454. Fix compareTo of variable UNBOUNDED in o.a.h.y.util.resource.Resources. Contributed by Xu Yang.
(cherry picked from commit 57d9a972cb)
2015-05-02 10:20:30 -07:00
Gera Shegalov ff6492d603 MAPREDUCE-6345. Documentation fix for when CRLA is enabled for MRAppMaster logs. (Rohit Agarwal via gera)
(cherry picked from commit f1a152cc0a)
2015-05-01 19:07:14 -07:00
Gera Shegalov 8564927a4e HADOOP-11900. Add failIfNoTests=false to hadoop-build-tools pom. (gera)
(cherry picked from commit 3ddb260e30)

Conflicts:
	hadoop-build-tools/pom.xml
2015-05-01 19:07:04 -07:00
Gera Shegalov 58970d69de HADOOP-11491. HarFs incorrectly declared as requiring an authority. (Brahma Reddy Battula via gera)
(cherry picked from commit f343f8657e)
2015-05-01 19:04:49 -07:00
Gera Shegalov 9325dd863c YARN-2893. AMLaucher: sporadic job failures due to EOFException in readTokenStorageStream. (Zhihai Xu via gera)
(cherry picked from commit f8204e241d)
2015-05-01 19:04:48 -07:00
Jonathan Eagles 9ed6b77da1 HADOOP-11889. Make checkstyle runnable from root project (Gera Shegalov via jeagles)
(cherry picked from commit 2d7363b273)

Conflicts:
	pom.xml
2015-05-01 19:04:41 -07:00
Wangda Tan 4151e5729a YARN-3006. Improve the error message when attempting manual failover with auto-failover enabled. (Akira AJISAKA via wangda)
(cherry picked from commit 7d46a806e7)
2015-05-01 16:44:49 -07:00
Arpit Agarwal 8e3fdd0a40 HDFS-8229. LAZY_PERSIST file gets deleted after NameNode restart. (Contributed by Surendra Singh Lilhore) 2015-05-01 16:42:35 -07:00
Robert Kanter 32b3b8e2ef YARN-3363. add localization and container launch time to ContainerMetrics at NM to show these timing information for each active container. (zxu via rkanter)
(cherry picked from commit ac7d152901)
2015-05-01 16:39:59 -07:00
Tsz-Wo Nicholas Sze 72751b957c HDFS-8086. Move LeaseRenewer to the hdfs.client.impl package. Contributed by Takanobu 2015-05-01 15:14:01 -07:00
Arun Suresh 8b6fc83ef4 Updating CHANGES.txt - Pulling in HDFS-8091 to branch-2.7 (for 2.7.1)
(cherry picked from commit 3393461197)
2015-05-01 11:49:38 -07:00
Colin Patrick Mccabe 9edea9507d HDFS-8213. DFSClient should use hdfs.client.htrace HTrace configuration prefix rather than hadoop.htrace (cmccabe)
(cherry picked from commit b82567d455)
2015-05-01 11:47:28 -07:00
Arpit Agarwal aa81b86898 HDFS-8276. LazyPersistFileScrubber should be disabled if scrubber interval configured zero. (Contributed by Surendra Singh Lilhore) 2015-05-01 11:11:56 -07:00
Vinod Kumar Vavilapalli 90f6e8c90f YARN-2619. Added NodeManager support for disk io isolation through cgroups. Contributed by Varun Vasudev and Wei Yan.
(cherry picked from commit 1b3b9e5c31)
2015-04-30 21:43:22 -07:00
Jing Zhao ec7b392965 HDFS-8300. Fix unit test failures and findbugs warning caused by HDFS-8283. Contributed by Jing Zhao.
(cherry picked from commit 98a6176628)
2015-04-30 19:29:11 -07:00
Andrew Wang 34d686e6e9 HDFS-8292. Move conditional in fmt_time from dfs-dust.js to status.html. Contributed by Charles Lamb.
(cherry picked from commit 87e9978235)
2015-04-30 18:23:21 -07:00
Allen Wittenauer 4195b10860 HADOOP-11866. increase readability and reliability of checkstyle, shellcheck, and whitespace reports (aw) 2015-04-30 15:16:42 -07:00
Arun Suresh 5670b542b8 HADOOP-11891. OsSecureRandom should lazily fill its reservoir (asuresh)
(cherry picked from commit f0db797be2)
2015-04-30 14:02:33 -07:00
Haohui Mai 01acf3a3af HDFS-8200. Refactor FSDirStatAndListingOp. Contributed by Haohui Mai. 2015-04-30 13:41:55 -07:00
Zhijie Shen c9ee316045 YARN-3544. Got back AM logs link on the RM web UI for a completed app. Contributed by Xuan Gong.
(cherry picked from commit 21bf2cdcb77f69abc906e6cd401a8fb221f250e9)
2015-04-30 13:06:46 -07:00