Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,027 Commits 326 Branches 371 Tags
Commit Graph

9027 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Colin Patrick Mccabe
1f01d8347a HDFS-8305: HDFS INotify: the destination field of RenameOp should always end with the file name (cmccabe) 
(cherry picked from commit fcd4cb751665adb241081e42b3403c3856b6c6fe)
 2015-05-05 11:06:47 -07:00
Allen Wittenauer
51df9e8379 HADOOP-11904. test-patch.sh goes into an infinite loop on non-maven builds (aw) 2015-05-05 11:05:56 -07:00
Xuan
02cdcaec58 YARN-2123. Progress bars in Web UI always at 100% due to non-US locale. 
Contributed by Akira AJISAKA

(cherry picked from commit b7dd3a4f04f712b7594c4e6e7ce50fd314f7c342)
 2015-05-05 10:45:18 -07:00
Allen Wittenauer
02892f674b HADOOP-11911. test-patch should allow configuration of default branch (Sean Busbey via aw) 2015-05-05 10:03:22 -07:00
Junping Du
6ea007ba91 YARN-3396. Handle URISyntaxException in ResourceLocalizationService. (Contributed by Brahma Reddy Battula) 
(cherry picked from commit 38102420621308f5ba91cdeb6a18a63aa5acf640)
 2015-05-05 10:19:16 -07:00
Andrew Wang
84d8ba4f72 HADOOP-11120. hadoop fs -rmr gives wrong advice. Contributed by Juliet Houghland. 
(cherry picked from commit 05adc76ace6bf28e4a3ff874044c2c41e3eba63f)
 2015-05-05 08:37:41 -07:00
Jason Lowe
0f30913ea8 YARN-3552. RM Web UI shows -1 running containers for completed apps. Contributed by Rohith 
(cherry picked from commit 9356cf8676fd18f78655e8a6f2e6c946997dbd40)
 2015-05-05 13:43:57 +00:00
Vinayakumar B
01bdfd794c HDFS-7916. 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop (Contributed by Vinayakumar B) 
Reverted earlier commit

(cherry picked from commit 318081ccd7af1ec02ec18f35ea95c579326be728)
 2015-05-05 11:06:44 +05:30
Tsuyoshi Ozawa
aefadb838c HADOOP-11916. TestStringUtils#testLowerAndUpperStrings failed on MAC due to a JVM bug. Contributed by Ming Ma. 
(cherry picked from commit 338e88a19eeb01364c7f5bcdc5f4b5c35d53852d)
 2015-05-05 12:39:43 +09:00
Tsuyoshi Ozawa
4e96175b33 MAPREDUCE-6165. [JDK8] TestCombineFileInputFormat failed on JDK8. Contributed by Akira AJISAKA. 
(cherry picked from commit 551615fa13f65ae996bae9c1bacff189539b6557)
 2015-05-05 10:23:25 +09:00
Jian He
f71c49c5e3 YARN-2725. Added test cases of retrying creating znode in ZKRMStateStore. Contributed by Tsuyoshi Ozawa 
(cherry picked from commit d701acc9c67adc578ba18035edde1166eedaae98)
 2015-05-04 16:17:01 -07:00
Wangda Tan
4e77ee2f6f YARN-3375. NodeHealthScriptRunner.shouldRun() check is performing 3 times for starting NodeHealthScriptRunner (Devaraj K via wangda) 
(cherry picked from commit 71f4de220c74bf2c90630bd0442979d92380d304)
 2015-05-04 16:02:57 -07:00
Allen Wittenauer
02e650248d YARN-2980. Move health check script related functionality to hadoop-common (Varun Saxena via aw) 
(cherry picked from commit d4ac6822e1c5dfac504ced48f10ab57a55b49e93)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeManager.java
 2015-05-04 16:00:20 -07:00
Haohui Mai
db0bd6dca8 HDFS-8237. Move all protocol classes used by ClientProtocol to hdfs-client. Contributed by Haohui Mai. 2015-05-04 15:02:49 -07:00
Jason Lowe
81f128f293 MAPREDUCE-6259. IllegalArgumentException due to missing job submit time. Contributed by zhihai xu 
(cherry picked from commit bf70c5ae2824a9139c1aa9d7c14020018881cec2)
 2015-05-04 20:40:16 +00:00
Colin Patrick Mccabe
8efcf5bdbd HDFS-7397. Add more detail to the documentation for the conf key "dfs.client.read.shortcircuit.streams.cache.size" (Brahma Reddy Battula via Colin P. McCabe) 
(cherry picked from commit 3fe79e1db84391cb17dbed6b579fe9c803b3d1c2)
 2015-05-04 12:50:59 -07:00
Jason Lowe
87c2d915f1 MAPREDUCE-5649. Reduce cannot use more than 2G memory for the final merge. Contributed by Gera Shegalov 
(cherry picked from commit 7dc3c1203d1ab14c09d0aaf0869a5bcdfafb0a5a)
 2015-05-04 19:03:43 +00:00
cnauroth
a43080a2cf HDFS-8290. WebHDFS calls before namesystem initialization can cause NullPointerException. Contributed by Chris Nauroth. 
(cherry picked from commit c4578760b67d5b5169949a1b059f4472a268ff1b)
 2015-05-04 11:35:18 -07:00
Jason Lowe
99b49a8181 YARN-3097. Logging of resource recovery on NM restart has redundancies. Contributed by Eric Payne 
(cherry picked from commit 8f65c793f2930bfd16885a2ab188a9970b754974)
 2015-05-04 10:32:33 -05:00
Tsuyoshi Ozawa
c64309f6ab HADOOP-11328. ZKFailoverController does not log Exception when doRun raises errors. Contributed by Tianyin Xu. 
(cherry picked from commit bb9ddef0e7603b60d25250bb53a7ae9f147cd3cd)
 2015-05-04 17:47:52 +09:00
Tsuyoshi Ozawa
1e1ebbb42b HADOOP-9658. SnappyCodec#checkNativeCodeLoaded may unexpectedly fail when native code is not loaded. Contributed by Zhijie Shen. 
(cherry picked from commit 76fa606e2d3d04407f2f6b4ea276cce0f60db4be)
 2015-05-04 17:05:53 +09:00
Tsuyoshi Ozawa
7e03bda3e7 MAPREDUCE-6349. Fix typo in property org.apache.hadoop.mapreduce.lib.chain.Chain.REDUCER_INPUT_VALUE_CLASS. Contributed by Ray Chiang. 
(cherry picked from commit bb6ef2984d8f117711b806c4ebdc757bd182c06e)
 2015-05-04 15:36:53 +09:00
Tsuyoshi Ozawa
1035f550b9 MAPREDUCE-5905. CountersStrings.toEscapedCompactStrings outputs unnecessary null strings. Contributed by Akira AJISAKA. 
(cherry picked from commit 3ba18362f2a4b83635b89aa0adc5ebaf27d9ca83)
 2015-05-04 15:02:40 +09:00
Xiaoyu Yao
5b27d9e076 HDFS-8309. Skip unit test using DataNodeTestUtils#injectDataDirFailure() on Windows. (xyao) 
(cherry picked from commit a319771d1d9eebaf8e4165dba73383a229cb1525)
 2015-05-02 22:32:28 -07:00
Tsuyoshi Ozawa
f382602de1 YARN-1993. Cross-site scripting vulnerability in TextView.java. Contributed byKenji Kikushima. 
(cherry picked from commit e8d0ee5fc9af612d7abc9ab2c201434e7102d092)
 2015-05-03 10:51:39 +09:00
Haohui Mai
65a19fbc30 HDFS-8249. Separate HdfsConstants into the client and the server side class. Contributed by Haohui Mai. 2015-05-02 10:03:04 -07:00
Junping Du
8068e79989 YARN-2454. Fix compareTo of variable UNBOUNDED in o.a.h.y.util.resource.Resources. Contributed by Xu Yang. 
(cherry picked from commit 57d9a972cbd62aae0ab010d38a0973619972edd6)
 2015-05-02 10:20:30 -07:00
Gera Shegalov
ff6492d603 MAPREDUCE-6345. Documentation fix for when CRLA is enabled for MRAppMaster logs. (Rohit Agarwal via gera) 
(cherry picked from commit f1a152cc0adc071277c80637ea6f5faa0bf06a1a)
 2015-05-01 19:07:14 -07:00
Gera Shegalov
8564927a4e HADOOP-11900. Add failIfNoTests=false to hadoop-build-tools pom. (gera) 
(cherry picked from commit 3ddb260e30e7424363bcde68176bcea1ad8d6392)

Conflicts:
	hadoop-build-tools/pom.xml
 2015-05-01 19:07:04 -07:00
Gera Shegalov
58970d69de HADOOP-11491. HarFs incorrectly declared as requiring an authority. (Brahma Reddy Battula via gera) 
(cherry picked from commit f343f8657e2b01773a32c2c7d960dc368954b42e)
 2015-05-01 19:04:49 -07:00
Gera Shegalov
9325dd863c YARN-2893. AMLaucher: sporadic job failures due to EOFException in readTokenStorageStream. (Zhihai Xu via gera) 
(cherry picked from commit f8204e241d9271497defd4d42646fb89c61cefe3)
 2015-05-01 19:04:48 -07:00
Jonathan Eagles
9ed6b77da1 HADOOP-11889. Make checkstyle runnable from root project (Gera Shegalov via jeagles) 
(cherry picked from commit 2d7363b27360e36fdd62546c0f9d0b1d78133f29)

Conflicts:
	pom.xml
 2015-05-01 19:04:41 -07:00
Wangda Tan
4151e5729a YARN-3006. Improve the error message when attempting manual failover with auto-failover enabled. (Akira AJISAKA via wangda) 
(cherry picked from commit 7d46a806e71de6692cd230e64e7de18a8252019d)
 2015-05-01 16:44:49 -07:00
Arpit Agarwal
8e3fdd0a40 HDFS-8229. LAZY_PERSIST file gets deleted after NameNode restart. (Contributed by Surendra Singh Lilhore) 2015-05-01 16:42:35 -07:00
Robert Kanter
32b3b8e2ef YARN-3363. add localization and container launch time to ContainerMetrics at NM to show these timing information for each active container. (zxu via rkanter) 
(cherry picked from commit ac7d152901e29b1f444507fe4e421eb6e1402b5a)
 2015-05-01 16:39:59 -07:00
Tsz-Wo Nicholas Sze
72751b957c HDFS-8086. Move LeaseRenewer to the hdfs.client.impl package. Contributed by Takanobu 2015-05-01 15:14:01 -07:00
Arun Suresh
8b6fc83ef4 Updating CHANGES.txt - Pulling in HDFS-8091 to branch-2.7 (for 2.7.1) 
(cherry picked from commit 3393461197da869c3f1e47888e03670106bda023)
 2015-05-01 11:49:38 -07:00
Colin Patrick Mccabe
9edea9507d HDFS-8213. DFSClient should use hdfs.client.htrace HTrace configuration prefix rather than hadoop.htrace (cmccabe) 
(cherry picked from commit b82567d45507c50d2f28eff4bbdf3b1a69d4bf1b)
 2015-05-01 11:47:28 -07:00
Arpit Agarwal
aa81b86898 HDFS-8276. LazyPersistFileScrubber should be disabled if scrubber interval configured zero. (Contributed by Surendra Singh Lilhore) 2015-05-01 11:11:56 -07:00
Vinod Kumar Vavilapalli
90f6e8c90f YARN-2619. Added NodeManager support for disk io isolation through cgroups. Contributed by Varun Vasudev and Wei Yan. 
(cherry picked from commit 1b3b9e5c31c38388c1ce4208c65e8dd5f956da82)
 2015-04-30 21:43:22 -07:00
Jing Zhao
ec7b392965 HDFS-8300. Fix unit test failures and findbugs warning caused by HDFS-8283. Contributed by Jing Zhao. 
(cherry picked from commit 98a61766286321468bf801a9f17a843d7eae8d9e)
 2015-04-30 19:29:11 -07:00
Andrew Wang
34d686e6e9 HDFS-8292. Move conditional in fmt_time from dfs-dust.js to status.html. Contributed by Charles Lamb. 
(cherry picked from commit 87e997823581790cce8d82d20e5e82ef9dd80670)
 2015-04-30 18:23:21 -07:00
Allen Wittenauer
4195b10860 HADOOP-11866. increase readability and reliability of checkstyle, shellcheck, and whitespace reports (aw) 2015-04-30 15:16:42 -07:00
Arun Suresh
5670b542b8 HADOOP-11891. OsSecureRandom should lazily fill its reservoir (asuresh) 
(cherry picked from commit f0db797be28ca221d540c6a3accd6bff9a7996fa)
 2015-04-30 14:02:33 -07:00
Haohui Mai
01acf3a3af HDFS-8200. Refactor FSDirStatAndListingOp. Contributed by Haohui Mai. 2015-04-30 13:41:55 -07:00
Zhijie Shen
c9ee316045 YARN-3544. Got back AM logs link on the RM web UI for a completed app. Contributed by Xuan Gong. 
(cherry picked from commit 21bf2cdcb77f69abc906e6cd401a8fb221f250e9)
 2015-04-30 13:06:46 -07:00
Wangda Tan
100b41add6 YARN-3564. Fix TestContainerAllocation.testAMContainerAllocationWhenDNSUnavailable fails randomly. (Jian He via wangda) 
(cherry picked from commit e2e8f771183df798e926abc97116316a05b19c9a)
 2015-04-30 11:06:47 -07:00
Akira Ajisaka
fdb886d656 HDFS-7770. Need document for storage type label of data node storage locations under dfs.data.dir. Contributed by Xiaoyu Yao. 
(cherry picked from commit de9404f02f36bf9a1100c67f41db907d494bb9ed)
 2015-04-30 20:13:18 +09:00
Akira Ajisaka
47ba08a119 HADOOP-11821. Fix findbugs warnings in hadoop-sls. Contributed by Brahma Reddy Battula. 
(cherry picked from commit f384a063a653b33d69f7d2c7d4fd45c24b5aa46a)
 2015-04-30 19:49:32 +09:00
Akira Ajisaka
2f2d0aa990 HDFS-5574. Remove buffer copy in BlockReader.skip. Contributed by Binglin Chang. 
(cherry picked from commit fd06186071bb369ee045b57a82419566e87257ec)
 2015-04-30 19:11:46 +09:00