Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,629 Commits 326 Branches 371 Tags
Commit Graph

9629 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
cnauroth
d01eaef40f HADOOP-12045. Enable LocalFileSystem#setTimes to change atime. Contributed by Kazuho Fujii. 
(cherry picked from commit ed1e3ce482f679ae2fad43a203f6578d7af59327)
 2015-07-06 13:40:26 -07:00
Vinayakumar B
9a774dfae5 HDFS-8686. WebHdfsFileSystem#getXAttr(Path p, final String name) doesn't work if namespace is in capitals (Contributed by kanaka kumar avvaru) 
(cherry picked from commit fc92d3e6515a391847cb6170244b3d911712d96a)
 2015-07-06 16:09:42 +05:30
Vinayakumar B
91d2c59968 HADOOP-12186. ActiveStandbyElector shouldn't call monitorLockNodeAsync multiple times (Contributed by zhihai xu) 
(cherry picked from commit 233cab89adb6bae21d7e171f2af516b92266242c)
 2015-07-06 15:40:16 +05:30
Devaraj K
415dd64461 MAPREDUCE-6425. ShuffleHandler passes wrong "base" parameter to 
getMapOutputInfo if mapId is not in the cache. Contributed by zhihai xu.

(cherry picked from commit bff67dfe2f811654ffb1bbcbd87509c185f452b6)
 2015-07-06 13:47:54 +05:30
Xuan
09639ac6b4 YARN-3882. AggregatedLogFormat should close aclScanner and ownerScanner 
after create them. Contributed by zhihai xu

(cherry picked from commit 688617d6d7e6377a37682b5676b805cc6e8cf3f0)
 2015-07-04 21:54:22 -07:00
Vinayakumar B
b963ca84bc HDFS-8577. Avoid retrying to recover lease on a file which does not exist (Contributed by J.Andreina) 
(cherry picked from commit 2eae130ab9edd318c82503c2306f610f2b5a3e51)
 2015-07-03 13:36:07 +05:30
Chris Douglas
f2c0539d38 HADOOP-12173. NetworkTopology::add calls toString always. Contributed by Inigo Goiri 
(cherry picked from commit e59f6fad6a8849cfab6acbf012f338d9cc7dd63c)
 2015-07-02 21:49:43 -07:00
Andrew Wang
efe9ae9fc6 HDFS-8709. Clarify automatic sync in FSEditLog#logEdit. 
(cherry picked from commit 5fddc5177ddad07a735d49c15a63cfc5f74d0891)
 2015-07-02 10:26:43 -07:00
Vinayakumar B
55bf014a07 HDFS-8703. Merge refactor of DFSInputStream from ErasureCoding branch (Contributed by Vinayakumar B) 
(cherry picked from commit bff5999d07e9416a22846c849487e509ede55040)
 2015-07-02 16:12:13 +05:30
Devaraj K
e1ca886419 YARN-3875. FSSchedulerNode#reserveResource() doesn't print Application Id 
properly in log. Contributed by Bibin A Chundatt.

(cherry picked from commit 37d7395773b5bb24aa522db38a2602df9a5ac184)
 2015-07-02 10:21:32 +05:30
cnauroth
0d94a293a8 HADOOP-12172. FsShell mkdir -p makes an unnecessary check for the existence of the parent. Contributed by Chris Nauroth. 
(cherry picked from commit f3796224bfdfd88e2428cc8a9915bdfdc62b48f3)
 2015-07-01 19:48:17 -07:00
Colin Patrick Mccabe
490bef0856 HADOOP-12171. Shorten overly-long htrace span names for server (cmccabe) 
(cherry picked from commit a78d5074fb3da4779a6b5fd9947e60b9d755ee14)
 2015-07-01 17:57:33 -07:00
Wangda Tan
d61dd10b50 YARN-3508. Prevent processing preemption events on the main RM dispatcher. (Varun Saxena via wangda) 
(cherry picked from commit 0e4b06690ff51fbde3ab26f68fde8aeb32af69af)
 2015-07-01 17:32:57 -07:00
Jing Zhao
ff7562cc99 HDFS-8666. Speedup the TestMover test. Contributed by Walter Su. 
(cherry picked from commit 152e5df3b65394c2939d6de3c4a649a207bb58d3)
 2015-07-01 15:00:16 -07:00
Jason Lowe
a721b9d812 YARN-3793. Several NPEs when deleting local files on NM recovery. Contributed by Varun Saxena 
(cherry picked from commit b5cdf78e8e6cd6c5c1fb7286207dac72be32c0d6)
 2015-07-01 21:14:35 +00:00
Jason Lowe
8a4970e845 MAPREDUCE-6418. MRApp should not shutdown LogManager during shutdown. Contributed by Chang Li 
(cherry picked from commit eac1d1894354e90d314087af8e7fb168ddef9a3d)
 2015-07-01 18:02:17 +00:00
Jason Lowe
f3195eda27 MAPREDUCE-6420. Interrupted Exception in LocalContainerLauncher should be logged in warn/info level. Contributed by Chang Li 
(cherry picked from commit 826715622e6937887a4e20b3ce327d7e2fd89009)
 2015-07-01 17:50:47 +00:00
Arpit Agarwal
d38f377cd3 HDFS-8706. Fix typo in datanode startup options in HDFSCommands.html. (Controibuted by Brahma Reddy Battula) 2015-07-01 10:36:10 -07:00
Jason Lowe
df4e1e4965 MAPREDUCE-6376. Add avro binary support for jhist files. Contributed by Ray Chiang 
(cherry picked from commit 2ac87df578accb6e612f70ded76271cb5082ee10)

Conflicts:

	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
 2015-07-01 16:07:54 +00:00
Devaraj K
c343250657 YARN-3830. AbstractYarnScheduler.createReleaseCache may try to clean a 
null attempt. Contributed by nijel.

(cherry picked from commit 80a68d60560e505b5f8e01969dc3c168a1e5a7f3)
 2015-07-01 19:05:27 +05:30
Devaraj K
3432017de0 YARN-3823. Fix mismatch in default values for 
yarn.scheduler.maximum-allocation-vcores property. Contributed by Ray
Chiang.

(cherry picked from commit 7405c59799ed1b8ad1a7c6f1b18fabf49d0b92b2)
 2015-07-01 11:12:43 +05:30
Lei Xu
fad478e7ce HADOOP-12164. Fix TestMove and TestFsShellReturnCode failed to get command name using reflection. (Lei Xu) 
(cherry picked from commit 47fab573bcb7b1129648499571b518f7b9773f89)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShellReturnCode.java
 2015-06-30 17:37:52 -07:00
cnauroth
f7ba3c0045 HADOOP-12116. Fix unrecommended syntax usages in hadoop/hdfs/yarn script for cygwin in branch-2. Contributed by Li Lu. 2015-06-30 16:55:10 -07:00
Robert Kanter
e5b0439bc1 MAPREDUCE-6121. JobResourceUpdater#compareFs() doesn't handle HA namespaces (rchiang via rkanter) 
(cherry picked from commit 3a72bfd08281fd271bef4f41289125d39c41928c)
 2015-06-30 16:50:48 -07:00
Robert Kanter
3f79ee7494 HADOOP-12159. Move DistCpUtils#compareFs() to org.apache.hadoop.fs.FileUtil and fix for HA namespaces (rchiang via rkanter) 
(cherry picked from commit aaafa0b2ee64f6cfb7fdc717500e1c483b9df8cc)
 2015-06-30 16:50:42 -07:00
Colin Patrick Mccabe
016c794e75 HADOOP-12124. Add HTrace support for FsShell (cmccabe) 
(cherry picked from commit ad60807238c4f7779cb0685e7d39ca0c50e01b2f)
 2015-06-30 16:47:14 -07:00
Colin Patrick Mccabe
7c698bc350 HADOOP-10798. globStatus() should always return a sorted list of files (cmccabe) 
(cherry picked from commit 68e588cbee660d55dba518892d064bee3795a002)
 2015-06-30 16:42:36 -07:00
Colin Patrick Mccabe
b1da58d23d YARN-3827. Migrate YARN native build to new CMake framework (Alan Burlison via Colin P. McCabe) 
(cherry picked from commit d0cc0380b57db5fdeb41775bb9ca42dac65928b8)
 2015-06-30 16:24:44 -07:00
Colin Patrick Mccabe
604d1bbdb7 HDFS-8635. Migrate HDFS native build to new CMake framework (Alan Burlison via Colin P. McCabe) 
(cherry picked from commit 29df73dc0572cf8e450568f1d0301e8d55d64b48)
 2015-06-30 16:01:48 -07:00
Gera Shegalov
f9b98082b8 YARN-3768. ArrayIndexOutOfBoundsException with empty environment variables. (Zhihai Xu via gera) 
(cherry picked from commit 6f2a41e37d0b36cdafcfff75125165f212c612a6)
 2015-06-30 15:05:01 -07:00
Andrew Wang
1204140baa HADOOP-12158. Improve error message in TestCryptoStreamsWithOpensslAesCtrCryptoCodec when OpenSSL is not installed. 
(cherry picked from commit b088bc6c8c36ce3fe8b69bc0280fd4ea80ca6328)
 2015-06-30 15:04:23 -07:00
Jason Lowe
fdfd5be2b3 MAPREDUCE-6384. Add the last reporting reducer info for too many fetch failure diagnostics. Contributed by Chang Li 
(cherry picked from commit b6ba56457c6b01dae795c11d587c3fe3855ee707)
 2015-06-30 21:24:38 +00:00
Steve Loughran
6719fc94e1 Revert "HADOOP-12009 Clarify FileSystem.listStatus() sorting order & fix FileSystemContractBaseTest:testListStatus. (J.Andreina via stevel)" 
This reverts commit f02c06965c7caecb64c56c65b03648e998643c67.
 2015-06-30 11:53:03 +01:00
Vinayakumar B
bc06d5b041 HADOOP-12154. FileSystem#getUsed() returns the file length only from root '/' (Contributed by J.Andreina) 
(cherry picked from commit 6d99017f38f5a158b5cb65c74688b4c833e4e35f)
 2015-06-30 15:25:58 +05:30
Vinayakumar B
3c632c80a2 HDFS-8579. Update HDFS usage with missing options (Contributed by J.Andreina) 
(cherry picked from commit 77588e1d32cc465e6b0699bb3564a4c7c6df16fa)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs
 2015-06-30 15:02:46 +05:30
Haohui Mai
eccd4f273e HDFS-8493. Consolidate truncate() related implementation in a single class. Contributed by Rakesh R. 2015-06-29 16:44:58 -07:00
Arpit Agarwal
ff78e611c0 HDFS-8687. Remove the duplicate usage message from Dfsck.java. (Contributed by Brahma Reddy Battula) 2015-06-29 14:56:49 -07:00
Yongjun Zhang
11bdcb754a HDFS-8659. Block scanner INFO message is spamming logs. Contributed by Yongjun Zhang. 
(cherry picked from commit 43a1288fff5e323895fde66b9e3eb31a7412fcc2)
 2015-06-29 14:48:17 -07:00
Jian He
484a6c0f01 YARN-3770. SerializedException should also handle java.lang.Error on de-serialization. Contributed by Lavkesh Lahngir 
(cherry picked from commit 4672315e2d6abe1cee0210cf7d3e8ab114ba933c)
 2015-06-29 14:32:22 -07:00
cnauroth
399df10c58 HADOOP-12089. StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASB. Contributed by Duo Xu. 
(cherry picked from commit 460e98f7b3ec84f3c5afcb2aad4f4e7031d16e3a)
 2015-06-29 13:49:12 -07:00
Jian He
0100995c5e YARN-3695. ServerProxy (NMProxy, etc.) shouldn't retry forever for non network exception. Contributed by Raju Bairishetti 
(cherry picked from commit 62e583c7dcbb30d95d8b32a4978fbdb3b98d67cc)
 2015-06-29 13:38:04 -07:00
Colin Patrick Mccabe
5ff14f2342 HADOOP-12112. Make hadoop-common-project Native code -Wall-clean (alanburlison via cmccabe) 2015-06-29 12:34:47 -07:00
Colin Patrick Mccabe
df58fdaf21 HADOOP-12104. Migrate Hadoop Pipes native build to new CMake framework (Alan Burlison via Colin P. McCabe) 
(cherry picked from commit 5a27c3fd7616215937264c2b1f015205e60f2d73)
 2015-06-29 12:31:43 -07:00
Andrew Wang
ada7f66e12 HDFS-8653. Code cleanup for DatanodeManager, DatanodeDescriptor and DatanodeStorageInfo. Contributed by Zhe Zhang. 
(cherry picked from commit 2ffd84273ac490724fe7e7825664bb6d09ef0e99)
 2015-06-29 12:12:54 -07:00
Benoy Antony
e40e9fc7f4 HDFS-7390. Provide JMX metrics per storage type. (Benoy Antony) 
(cherry picked from commit d3fed8e653ed9e18d3a29a11c4b24a628ac770bb)
 2015-06-29 11:02:43 -07:00
Vinayakumar B
438bb25d43 HDFS-8628. Update missing command option for fetchdt (Contributed by J.Andreina) 
(cherry picked from commit fde20ffcef6dcd477f501b5f80c86665296711c5)
 2015-06-29 16:51:15 +05:30
Vinayakumar B
e4adb191aa HADOOP-12119. hadoop fs -expunge does not work for federated namespace (Contributed by J.Andreina) 
(cherry picked from commit c815344e2e68d78f6587b65bc2db25e151aa4364)
 2015-06-29 15:59:21 +05:30
Vinayakumar B
beab746177 HDFS-8586. Dead Datanode is allocated for write when client is from deadnode (Contributed by Brahma Reddy Battula) 
(cherry picked from commit 88ceb382ef45bd09cf004cf44aedbabaf3976759)
 2015-06-29 15:25:54 +05:30
Junping Du
dbd2b18205 YARN-3860. rmadmin -transitionToActive should check the state of non-target node. (Contributed by Masatake Iwasaki) 
(cherry picked from commit a95d39f9d08b3b215a1b33e77e9ab8a2ee59b3a9)
 2015-06-28 22:28:35 -07:00
Vinod Kumar Vavilapalli
4155bb565e Adding release 2.7.2 to CHANGES.txt. 
(cherry picked from commit aad6a7d5dba5858d6e9845f18c4baec16c91911d)
 2015-06-28 16:30:27 -07:00