Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,890 Commits 326 Branches 371 Tags
Commit Graph

9890 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Chris Douglas
5fbf91b453 MAPREDUCE-6038. A boolean may be set error in the Word Count v2.0 in MapReduce Tutorial. Contributed by Tsuyoshi Ozawa 
(cherry picked from commit 4990ccfdc742be9c0517557a6256fefcae0df67d)
 2015-07-07 10:26:57 -07:00
Jing Zhao
bed74b620a Revert "HDFS-8652. Track BlockInfo instead of Block in CorruptReplicasMap. Contributed by Jing Zhao." 
This reverts commit d62b63d297bff12d93de560dd50ddd48743b851d.

(cherry picked from commit bc99aaffe7b0ed13b1efc37b6a32cdbd344c2d75)
 2015-07-07 10:14:17 -07:00
Chris Douglas
62424b5d99 HADOOP-5732. Add SFTPFileSystem. Contributed by Ramtin Boustani and Inigo Goiri 
(cherry picked from commit 559425dcb9302861c3c28b759492a68f8d597092)
 2015-07-07 10:09:29 -07:00
Colin Patrick Mccabe
4da63e5f5f HADOOP-11974. Fix FIONREAD #include on Solaris (Alan Burlison via Colin P. McCabe) 
(cherry picked from commit 81f364437608b21e85fc393f63546bf8b425ac71)
 2015-07-07 08:36:52 -07:00
Vinayakumar B
2b99310c32 HADOOP-12186. ActiveStandbyElector shouldn't call monitorLockNodeAsync multiple times (Contributed by zhihai xu) 
Moved CHANGES.txt entry to 2.7.2

(cherry picked from commit e0febce0e74ec69597376774f771da46834c42b1)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2015-07-07 18:16:14 +05:30
Varun Vasudev
16ca0fcf99 YARN-2194. Fix bug causing CGroups functionality to fail on RHEL7. Contributed by Wei Yan. 
(cherry-picked from commit 7e3ebc0fc59dbd1d7768b5a6c05af18b8c8fea4d)
 2015-07-07 17:05:06 +05:30
Vinayakumar B
c5c0577248 HADOOP-12117. Potential NPE from Configuration#loadProperty with allowNullValueProperties set. (Contributed by zhihai xu) 
(cherry picked from commit 99c8c5839b65666e6099116e4d7024e0eb4682b9)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/conf/TestConfiguration.java
 2015-07-07 16:18:54 +05:30
Devaraj K
f558429efe YARN-3837. javadocs of TimelineAuthenticationFilterInitializer give wrong 
prefix for auth options. Contributed by Bibin A Chundatt.

(cherry picked from commit af63427c6d7d2fc251eafb1f152b7a90c5bd07e5)
 2015-07-07 12:08:03 +05:30
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
a8bf34cad8 Release process for 2.7.1: Set the release date for 2.7.1. 
(cherry picked from commit bf89ddb9b8ca27a34074b415f85599dd48b8fc50)
 2015-07-06 16:41:00 -07:00
Jing Zhao
3d73d2027f HDFS-8652. Track BlockInfo instead of Block in CorruptReplicasMap. Contributed by Jing Zhao. 
(cherry picked from commit d62b63d297bff12d93de560dd50ddd48743b851d)
 2015-07-06 15:55:03 -07:00
Chris Douglas
360164e41e HADOOP-12185. NetworkTopology is not efficient adding/getting/removing nodes. Contributed by Inigo Goiri 
(cherry picked from commit 47a69ec7a5417cb56b75d07184dd6888ff068302)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/net/NetworkTopology.java
 2015-07-06 15:15:45 -07:00
cnauroth
d01eaef40f HADOOP-12045. Enable LocalFileSystem#setTimes to change atime. Contributed by Kazuho Fujii. 
(cherry picked from commit ed1e3ce482f679ae2fad43a203f6578d7af59327)
 2015-07-06 13:40:26 -07:00
Vinayakumar B
9a774dfae5 HDFS-8686. WebHdfsFileSystem#getXAttr(Path p, final String name) doesn't work if namespace is in capitals (Contributed by kanaka kumar avvaru) 
(cherry picked from commit fc92d3e6515a391847cb6170244b3d911712d96a)
 2015-07-06 16:09:42 +05:30
Vinayakumar B
91d2c59968 HADOOP-12186. ActiveStandbyElector shouldn't call monitorLockNodeAsync multiple times (Contributed by zhihai xu) 
(cherry picked from commit 233cab89adb6bae21d7e171f2af516b92266242c)
 2015-07-06 15:40:16 +05:30
Devaraj K
415dd64461 MAPREDUCE-6425. ShuffleHandler passes wrong "base" parameter to 
getMapOutputInfo if mapId is not in the cache. Contributed by zhihai xu.

(cherry picked from commit bff67dfe2f811654ffb1bbcbd87509c185f452b6)
 2015-07-06 13:47:54 +05:30
Xuan
09639ac6b4 YARN-3882. AggregatedLogFormat should close aclScanner and ownerScanner 
after create them. Contributed by zhihai xu

(cherry picked from commit 688617d6d7e6377a37682b5676b805cc6e8cf3f0)
 2015-07-04 21:54:22 -07:00
Vinayakumar B
b963ca84bc HDFS-8577. Avoid retrying to recover lease on a file which does not exist (Contributed by J.Andreina) 
(cherry picked from commit 2eae130ab9edd318c82503c2306f610f2b5a3e51)
 2015-07-03 13:36:07 +05:30
Chris Douglas
f2c0539d38 HADOOP-12173. NetworkTopology::add calls toString always. Contributed by Inigo Goiri 
(cherry picked from commit e59f6fad6a8849cfab6acbf012f338d9cc7dd63c)
 2015-07-02 21:49:43 -07:00
Andrew Wang
efe9ae9fc6 HDFS-8709. Clarify automatic sync in FSEditLog#logEdit. 
(cherry picked from commit 5fddc5177ddad07a735d49c15a63cfc5f74d0891)
 2015-07-02 10:26:43 -07:00
Vinayakumar B
55bf014a07 HDFS-8703. Merge refactor of DFSInputStream from ErasureCoding branch (Contributed by Vinayakumar B) 
(cherry picked from commit bff5999d07e9416a22846c849487e509ede55040)
 2015-07-02 16:12:13 +05:30
Devaraj K
e1ca886419 YARN-3875. FSSchedulerNode#reserveResource() doesn't print Application Id 
properly in log. Contributed by Bibin A Chundatt.

(cherry picked from commit 37d7395773b5bb24aa522db38a2602df9a5ac184)
 2015-07-02 10:21:32 +05:30
cnauroth
0d94a293a8 HADOOP-12172. FsShell mkdir -p makes an unnecessary check for the existence of the parent. Contributed by Chris Nauroth. 
(cherry picked from commit f3796224bfdfd88e2428cc8a9915bdfdc62b48f3)
 2015-07-01 19:48:17 -07:00
Colin Patrick Mccabe
490bef0856 HADOOP-12171. Shorten overly-long htrace span names for server (cmccabe) 
(cherry picked from commit a78d5074fb3da4779a6b5fd9947e60b9d755ee14)
 2015-07-01 17:57:33 -07:00
Wangda Tan
d61dd10b50 YARN-3508. Prevent processing preemption events on the main RM dispatcher. (Varun Saxena via wangda) 
(cherry picked from commit 0e4b06690ff51fbde3ab26f68fde8aeb32af69af)
 2015-07-01 17:32:57 -07:00
Jing Zhao
ff7562cc99 HDFS-8666. Speedup the TestMover test. Contributed by Walter Su. 
(cherry picked from commit 152e5df3b65394c2939d6de3c4a649a207bb58d3)
 2015-07-01 15:00:16 -07:00
Jason Lowe
a721b9d812 YARN-3793. Several NPEs when deleting local files on NM recovery. Contributed by Varun Saxena 
(cherry picked from commit b5cdf78e8e6cd6c5c1fb7286207dac72be32c0d6)
 2015-07-01 21:14:35 +00:00
Jason Lowe
8a4970e845 MAPREDUCE-6418. MRApp should not shutdown LogManager during shutdown. Contributed by Chang Li 
(cherry picked from commit eac1d1894354e90d314087af8e7fb168ddef9a3d)
 2015-07-01 18:02:17 +00:00
Jason Lowe
f3195eda27 MAPREDUCE-6420. Interrupted Exception in LocalContainerLauncher should be logged in warn/info level. Contributed by Chang Li 
(cherry picked from commit 826715622e6937887a4e20b3ce327d7e2fd89009)
 2015-07-01 17:50:47 +00:00
Arpit Agarwal
d38f377cd3 HDFS-8706. Fix typo in datanode startup options in HDFSCommands.html. (Controibuted by Brahma Reddy Battula) 2015-07-01 10:36:10 -07:00
Jason Lowe
df4e1e4965 MAPREDUCE-6376. Add avro binary support for jhist files. Contributed by Ray Chiang 
(cherry picked from commit 2ac87df578accb6e612f70ded76271cb5082ee10)

Conflicts:

	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
 2015-07-01 16:07:54 +00:00
Devaraj K
c343250657 YARN-3830. AbstractYarnScheduler.createReleaseCache may try to clean a 
null attempt. Contributed by nijel.

(cherry picked from commit 80a68d60560e505b5f8e01969dc3c168a1e5a7f3)
 2015-07-01 19:05:27 +05:30
Devaraj K
3432017de0 YARN-3823. Fix mismatch in default values for 
yarn.scheduler.maximum-allocation-vcores property. Contributed by Ray
Chiang.

(cherry picked from commit 7405c59799ed1b8ad1a7c6f1b18fabf49d0b92b2)
 2015-07-01 11:12:43 +05:30
Lei Xu
fad478e7ce HADOOP-12164. Fix TestMove and TestFsShellReturnCode failed to get command name using reflection. (Lei Xu) 
(cherry picked from commit 47fab573bcb7b1129648499571b518f7b9773f89)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShellReturnCode.java
 2015-06-30 17:37:52 -07:00
cnauroth
f7ba3c0045 HADOOP-12116. Fix unrecommended syntax usages in hadoop/hdfs/yarn script for cygwin in branch-2. Contributed by Li Lu. 2015-06-30 16:55:10 -07:00
Robert Kanter
e5b0439bc1 MAPREDUCE-6121. JobResourceUpdater#compareFs() doesn't handle HA namespaces (rchiang via rkanter) 
(cherry picked from commit 3a72bfd08281fd271bef4f41289125d39c41928c)
 2015-06-30 16:50:48 -07:00
Robert Kanter
3f79ee7494 HADOOP-12159. Move DistCpUtils#compareFs() to org.apache.hadoop.fs.FileUtil and fix for HA namespaces (rchiang via rkanter) 
(cherry picked from commit aaafa0b2ee64f6cfb7fdc717500e1c483b9df8cc)
 2015-06-30 16:50:42 -07:00
Colin Patrick Mccabe
016c794e75 HADOOP-12124. Add HTrace support for FsShell (cmccabe) 
(cherry picked from commit ad60807238c4f7779cb0685e7d39ca0c50e01b2f)
 2015-06-30 16:47:14 -07:00
Colin Patrick Mccabe
7c698bc350 HADOOP-10798. globStatus() should always return a sorted list of files (cmccabe) 
(cherry picked from commit 68e588cbee660d55dba518892d064bee3795a002)
 2015-06-30 16:42:36 -07:00
Colin Patrick Mccabe
b1da58d23d YARN-3827. Migrate YARN native build to new CMake framework (Alan Burlison via Colin P. McCabe) 
(cherry picked from commit d0cc0380b57db5fdeb41775bb9ca42dac65928b8)
 2015-06-30 16:24:44 -07:00
Colin Patrick Mccabe
604d1bbdb7 HDFS-8635. Migrate HDFS native build to new CMake framework (Alan Burlison via Colin P. McCabe) 
(cherry picked from commit 29df73dc0572cf8e450568f1d0301e8d55d64b48)
 2015-06-30 16:01:48 -07:00
Gera Shegalov
f9b98082b8 YARN-3768. ArrayIndexOutOfBoundsException with empty environment variables. (Zhihai Xu via gera) 
(cherry picked from commit 6f2a41e37d0b36cdafcfff75125165f212c612a6)
 2015-06-30 15:05:01 -07:00
Andrew Wang
1204140baa HADOOP-12158. Improve error message in TestCryptoStreamsWithOpensslAesCtrCryptoCodec when OpenSSL is not installed. 
(cherry picked from commit b088bc6c8c36ce3fe8b69bc0280fd4ea80ca6328)
 2015-06-30 15:04:23 -07:00
Jason Lowe
fdfd5be2b3 MAPREDUCE-6384. Add the last reporting reducer info for too many fetch failure diagnostics. Contributed by Chang Li 
(cherry picked from commit b6ba56457c6b01dae795c11d587c3fe3855ee707)
 2015-06-30 21:24:38 +00:00
Steve Loughran
6719fc94e1 Revert "HADOOP-12009 Clarify FileSystem.listStatus() sorting order & fix FileSystemContractBaseTest:testListStatus. (J.Andreina via stevel)" 
This reverts commit f02c06965c7caecb64c56c65b03648e998643c67.
 2015-06-30 11:53:03 +01:00
Vinayakumar B
bc06d5b041 HADOOP-12154. FileSystem#getUsed() returns the file length only from root '/' (Contributed by J.Andreina) 
(cherry picked from commit 6d99017f38f5a158b5cb65c74688b4c833e4e35f)
 2015-06-30 15:25:58 +05:30
Vinayakumar B
3c632c80a2 HDFS-8579. Update HDFS usage with missing options (Contributed by J.Andreina) 
(cherry picked from commit 77588e1d32cc465e6b0699bb3564a4c7c6df16fa)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs
 2015-06-30 15:02:46 +05:30
Haohui Mai
eccd4f273e HDFS-8493. Consolidate truncate() related implementation in a single class. Contributed by Rakesh R. 2015-06-29 16:44:58 -07:00
Arpit Agarwal
ff78e611c0 HDFS-8687. Remove the duplicate usage message from Dfsck.java. (Contributed by Brahma Reddy Battula) 2015-06-29 14:56:49 -07:00
Yongjun Zhang
11bdcb754a HDFS-8659. Block scanner INFO message is spamming logs. Contributed by Yongjun Zhang. 
(cherry picked from commit 43a1288fff5e323895fde66b9e3eb31a7412fcc2)
 2015-06-29 14:48:17 -07:00
Jian He
484a6c0f01 YARN-3770. SerializedException should also handle java.lang.Error on de-serialization. Contributed by Lavkesh Lahngir 
(cherry picked from commit 4672315e2d6abe1cee0210cf7d3e8ab114ba933c)
 2015-06-29 14:32:22 -07:00