Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,008 Commits 326 Branches 371 Tags
Commit Graph

9008 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Tsuyoshi Ozawa
c64309f6ab HADOOP-11328. ZKFailoverController does not log Exception when doRun raises errors. Contributed by Tianyin Xu. 
(cherry picked from commit bb9ddef0e7603b60d25250bb53a7ae9f147cd3cd)
 2015-05-04 17:47:52 +09:00
Tsuyoshi Ozawa
1e1ebbb42b HADOOP-9658. SnappyCodec#checkNativeCodeLoaded may unexpectedly fail when native code is not loaded. Contributed by Zhijie Shen. 
(cherry picked from commit 76fa606e2d3d04407f2f6b4ea276cce0f60db4be)
 2015-05-04 17:05:53 +09:00
Tsuyoshi Ozawa
7e03bda3e7 MAPREDUCE-6349. Fix typo in property org.apache.hadoop.mapreduce.lib.chain.Chain.REDUCER_INPUT_VALUE_CLASS. Contributed by Ray Chiang. 
(cherry picked from commit bb6ef2984d8f117711b806c4ebdc757bd182c06e)
 2015-05-04 15:36:53 +09:00
Tsuyoshi Ozawa
1035f550b9 MAPREDUCE-5905. CountersStrings.toEscapedCompactStrings outputs unnecessary null strings. Contributed by Akira AJISAKA. 
(cherry picked from commit 3ba18362f2a4b83635b89aa0adc5ebaf27d9ca83)
 2015-05-04 15:02:40 +09:00
Xiaoyu Yao
5b27d9e076 HDFS-8309. Skip unit test using DataNodeTestUtils#injectDataDirFailure() on Windows. (xyao) 
(cherry picked from commit a319771d1d9eebaf8e4165dba73383a229cb1525)
 2015-05-02 22:32:28 -07:00
Tsuyoshi Ozawa
f382602de1 YARN-1993. Cross-site scripting vulnerability in TextView.java. Contributed byKenji Kikushima. 
(cherry picked from commit e8d0ee5fc9af612d7abc9ab2c201434e7102d092)
 2015-05-03 10:51:39 +09:00
Haohui Mai
65a19fbc30 HDFS-8249. Separate HdfsConstants into the client and the server side class. Contributed by Haohui Mai. 2015-05-02 10:03:04 -07:00
Junping Du
8068e79989 YARN-2454. Fix compareTo of variable UNBOUNDED in o.a.h.y.util.resource.Resources. Contributed by Xu Yang. 
(cherry picked from commit 57d9a972cbd62aae0ab010d38a0973619972edd6)
 2015-05-02 10:20:30 -07:00
Gera Shegalov
ff6492d603 MAPREDUCE-6345. Documentation fix for when CRLA is enabled for MRAppMaster logs. (Rohit Agarwal via gera) 
(cherry picked from commit f1a152cc0adc071277c80637ea6f5faa0bf06a1a)
 2015-05-01 19:07:14 -07:00
Gera Shegalov
8564927a4e HADOOP-11900. Add failIfNoTests=false to hadoop-build-tools pom. (gera) 
(cherry picked from commit 3ddb260e30e7424363bcde68176bcea1ad8d6392)

Conflicts:
	hadoop-build-tools/pom.xml
 2015-05-01 19:07:04 -07:00
Gera Shegalov
58970d69de HADOOP-11491. HarFs incorrectly declared as requiring an authority. (Brahma Reddy Battula via gera) 
(cherry picked from commit f343f8657e2b01773a32c2c7d960dc368954b42e)
 2015-05-01 19:04:49 -07:00
Gera Shegalov
9325dd863c YARN-2893. AMLaucher: sporadic job failures due to EOFException in readTokenStorageStream. (Zhihai Xu via gera) 
(cherry picked from commit f8204e241d9271497defd4d42646fb89c61cefe3)
 2015-05-01 19:04:48 -07:00
Jonathan Eagles
9ed6b77da1 HADOOP-11889. Make checkstyle runnable from root project (Gera Shegalov via jeagles) 
(cherry picked from commit 2d7363b27360e36fdd62546c0f9d0b1d78133f29)

Conflicts:
	pom.xml
 2015-05-01 19:04:41 -07:00
Wangda Tan
4151e5729a YARN-3006. Improve the error message when attempting manual failover with auto-failover enabled. (Akira AJISAKA via wangda) 
(cherry picked from commit 7d46a806e71de6692cd230e64e7de18a8252019d)
 2015-05-01 16:44:49 -07:00
Arpit Agarwal
8e3fdd0a40 HDFS-8229. LAZY_PERSIST file gets deleted after NameNode restart. (Contributed by Surendra Singh Lilhore) 2015-05-01 16:42:35 -07:00
Robert Kanter
32b3b8e2ef YARN-3363. add localization and container launch time to ContainerMetrics at NM to show these timing information for each active container. (zxu via rkanter) 
(cherry picked from commit ac7d152901e29b1f444507fe4e421eb6e1402b5a)
 2015-05-01 16:39:59 -07:00
Tsz-Wo Nicholas Sze
72751b957c HDFS-8086. Move LeaseRenewer to the hdfs.client.impl package. Contributed by Takanobu 2015-05-01 15:14:01 -07:00
Arun Suresh
8b6fc83ef4 Updating CHANGES.txt - Pulling in HDFS-8091 to branch-2.7 (for 2.7.1) 
(cherry picked from commit 3393461197da869c3f1e47888e03670106bda023)
 2015-05-01 11:49:38 -07:00
Colin Patrick Mccabe
9edea9507d HDFS-8213. DFSClient should use hdfs.client.htrace HTrace configuration prefix rather than hadoop.htrace (cmccabe) 
(cherry picked from commit b82567d45507c50d2f28eff4bbdf3b1a69d4bf1b)
 2015-05-01 11:47:28 -07:00
Arpit Agarwal
aa81b86898 HDFS-8276. LazyPersistFileScrubber should be disabled if scrubber interval configured zero. (Contributed by Surendra Singh Lilhore) 2015-05-01 11:11:56 -07:00
Vinod Kumar Vavilapalli
90f6e8c90f YARN-2619. Added NodeManager support for disk io isolation through cgroups. Contributed by Varun Vasudev and Wei Yan. 
(cherry picked from commit 1b3b9e5c31c38388c1ce4208c65e8dd5f956da82)
 2015-04-30 21:43:22 -07:00
Jing Zhao
ec7b392965 HDFS-8300. Fix unit test failures and findbugs warning caused by HDFS-8283. Contributed by Jing Zhao. 
(cherry picked from commit 98a61766286321468bf801a9f17a843d7eae8d9e)
 2015-04-30 19:29:11 -07:00
Andrew Wang
34d686e6e9 HDFS-8292. Move conditional in fmt_time from dfs-dust.js to status.html. Contributed by Charles Lamb. 
(cherry picked from commit 87e997823581790cce8d82d20e5e82ef9dd80670)
 2015-04-30 18:23:21 -07:00
Allen Wittenauer
4195b10860 HADOOP-11866. increase readability and reliability of checkstyle, shellcheck, and whitespace reports (aw) 2015-04-30 15:16:42 -07:00
Arun Suresh
5670b542b8 HADOOP-11891. OsSecureRandom should lazily fill its reservoir (asuresh) 
(cherry picked from commit f0db797be28ca221d540c6a3accd6bff9a7996fa)
 2015-04-30 14:02:33 -07:00
Haohui Mai
01acf3a3af HDFS-8200. Refactor FSDirStatAndListingOp. Contributed by Haohui Mai. 2015-04-30 13:41:55 -07:00
Zhijie Shen
c9ee316045 YARN-3544. Got back AM logs link on the RM web UI for a completed app. Contributed by Xuan Gong. 
(cherry picked from commit 21bf2cdcb77f69abc906e6cd401a8fb221f250e9)
 2015-04-30 13:06:46 -07:00
Wangda Tan
100b41add6 YARN-3564. Fix TestContainerAllocation.testAMContainerAllocationWhenDNSUnavailable fails randomly. (Jian He via wangda) 
(cherry picked from commit e2e8f771183df798e926abc97116316a05b19c9a)
 2015-04-30 11:06:47 -07:00
Akira Ajisaka
fdb886d656 HDFS-7770. Need document for storage type label of data node storage locations under dfs.data.dir. Contributed by Xiaoyu Yao. 
(cherry picked from commit de9404f02f36bf9a1100c67f41db907d494bb9ed)
 2015-04-30 20:13:18 +09:00
Akira Ajisaka
47ba08a119 HADOOP-11821. Fix findbugs warnings in hadoop-sls. Contributed by Brahma Reddy Battula. 
(cherry picked from commit f384a063a653b33d69f7d2c7d4fd45c24b5aa46a)
 2015-04-30 19:49:32 +09:00
Akira Ajisaka
2f2d0aa990 HDFS-5574. Remove buffer copy in BlockReader.skip. Contributed by Binglin Chang. 
(cherry picked from commit fd06186071bb369ee045b57a82419566e87257ec)
 2015-04-30 19:11:46 +09:00
Devaraj K
c3d083a9ff MAPREDUCE-6339. Job history file is not flushed correctly because 
isTimerActive flag is not set true when flushTimerTask is scheduled.
Contributed by zhihai xu.

(cherry picked from commit f5b38477f9d0827b238fadd260c1dd2889531fd4)
 2015-04-30 12:36:00 +05:30
Andrew Wang
9f8412ac6e HDFS-8214. Secondary NN Web UI shows wrong date for Last Checkpoint. Contributed by Charles Lamb. 
(cherry picked from commit aa22450442ebe39916a6fd460fe97e347945526d)
 2015-04-29 17:38:09 -07:00
Jian He
a7a5737bc4 YARN-3533. Test: Fix launchAM in MockRM to wait for attempt to be scheduled. Contributed by Anubhav Dhoot 
(cherry picked from commit 4c1af156aef4f3bb1d9823d5980c59b12007dc77)
 2015-04-29 14:51:04 -07:00
tgraves
2e13183f60 YARN-3517. RM web ui for dumping scheduler logs should be for admins only (Varun Vasudev via tgraves) 
(cherry picked from commit 2e215484bd05cd5e3b7a81d3558c6879a05dd2d2)
 2015-04-29 21:27:16 +00:00
Haohui Mai
460127e6f2 HDFS-8269. getBlockLocations() does not resolve the .reserved path and generates incorrect edit logs when updating the atime. Contributed by Haohui Mai. 2015-04-29 11:12:54 -07:00
Jing Zhao
ecdebb7369 HDFS-8283. DataStreamer cleanup and some minor improvement. Contributed by Tsz Wo Nicholas Sze. 
(cherry picked from commit 7947e5b53b9ac9524b535b0384c1c355b74723ff)
 2015-04-29 10:43:52 -07:00
Karthik Kambatla
4cc38df7de YARN-3485. FairScheduler headroom calculation doesn't consider maxResources for Fifo and FairShare policies. (kasha) 
(cherry picked from commit 8f82970e0c247b37b2bf33aa21f6a39afa07efde)
 2015-04-28 21:03:12 -07:00
Haohui Mai
fc9e7d7a24 HDFS-8280. Code Cleanup in DFSInputStream. Contributed by Jing Zhao. 2015-04-28 18:12:05 -07:00
Haohui Mai
7bbe9495c4 HDFS-8273. FSNamesystem#Delete() should not call logSync() when holding the lock. Contributed by Haohui Mai. 2015-04-28 18:06:08 -07:00
Jason Lowe
ea828578a3 MAPREDUCE-6334. Fetcher#copyMapOutput is leaking usedMemory upon IOException during InMemoryMapOutput shuffle handler. Contributed by Eric Payne 
(cherry picked from commit bc1bd7e5c4047b374420683d36a8c30eda6d75b6)
 2015-04-28 20:19:52 +00:00
Tsz-Wo Nicholas Sze
9b62a8ed77 HDFS-8204. Mover/Balancer should not schedule two replicas to the same datanode. Contributed by Walter Su 2015-04-28 13:06:30 -07:00
Allen Wittenauer
d149af0539 HADOOP-11881. test-patch.sh javac result is wildly wrong (Kengo Seki via aw) 2015-04-28 10:43:43 -07:00
Devaraj K
1d03ac3533 Moving MAPREDUCE-6252 to the 2.7.1 CHANGES.txt 
(cherry picked from commit 99fe03e439b0f9afd01754d998c6eb64f0f70300)
 2015-04-28 12:44:07 +05:30
cnauroth
a82addd614 HDFS-8232. Missing datanode counters when using Metrics2 sink interface. Contributed by Anu Engineer. 
(cherry picked from commit feb68cb5470dc3e6c16b6bc1549141613e360601)
 2015-04-27 16:48:25 -07:00
Wangda Tan
8ee632caa7 YARN-2740. Fix NodeLabelsManager to properly handle node label modifications when distributed node label configuration enabled. (Naganarasimha G R via wangda) 
(cherry picked from commit db1b674b50ddecf2774f4092d677c412722bdcb1)
 2015-04-27 16:42:36 -07:00
Vinod Kumar Vavilapalli
32dc13d907 MAPREDUCE-6324. Fixed MapReduce uber jobs to not fail the udpate of AM-RM tokens when they roll-over. Contributed by Jason Lowe. 
(cherry picked from commit 9fc32c5c4d1d5f50c605bdb0e3b13f44c86660c8)
 2015-04-27 14:59:57 -07:00
Karthik Kambatla
d2d8bc243b Update CHANGES.txt - Pulled in YARN-3465, YARN-3516, and YARN-3464 to branch-2.7 (for 2.7.1) 
(cherry picked from commit 32cd2c8d429ddb87348299c00b7d851246a25b4e)
 2015-04-27 13:44:06 -07:00
Robert Kanter
f00815ac8a HADOOP-11870. [JDK8] AuthenticationFilter, CertificateUtil, SignerSecretProviders, KeyAuthorizationKeyProvider Javadoc issues (rkanter) 
(cherry picked from commit 9fec02c069f9bb24b5ee99031917075b4c7a7682)
 2015-04-27 13:26:00 -07:00
Arpit Agarwal
de85ff58dc HDFS-8205. Fix CHANGES.txt 2015-04-27 12:30:55 -07:00