Commit Graph

11241 Commits

Author SHA1 Message Date
Xuan 688617d6d7 YARN-3882. AggregatedLogFormat should close aclScanner and ownerScanner
after create them. Contributed by zhihai xu
2015-07-04 21:51:58 -07:00
Vinayakumar B 2eae130ab9 HDFS-8577. Avoid retrying to recover lease on a file which does not exist (Contributed by J.Andreina) 2015-07-03 13:35:48 +05:30
Chris Douglas e59f6fad6a HADOOP-12173. NetworkTopology::add calls toString always. Contributed by Inigo Goiri 2015-07-02 21:39:48 -07:00
Andrew Wang 5fddc5177d HDFS-8709. Clarify automatic sync in FSEditLog#logEdit. 2015-07-02 10:26:40 -07:00
Vinayakumar B bff5999d07 HDFS-8703. Merge refactor of DFSInputStream from ErasureCoding branch (Contributed by Vinayakumar B) 2015-07-02 16:11:50 +05:30
Devaraj K 37d7395773 YARN-3875. FSSchedulerNode#reserveResource() doesn't print Application Id
properly in log. Contributed by Bibin A Chundatt.
2015-07-02 10:20:31 +05:30
cnauroth f3796224bf HADOOP-12172. FsShell mkdir -p makes an unnecessary check for the existence of the parent. Contributed by Chris Nauroth. 2015-07-01 19:47:58 -07:00
Colin Patrick Mccabe a78d5074fb HADOOP-12171. Shorten overly-long htrace span names for server (cmccabe) 2015-07-01 17:57:11 -07:00
Wangda Tan 0e4b06690f YARN-3508. Prevent processing preemption events on the main RM dispatcher. (Varun Saxena via wangda) 2015-07-01 17:32:22 -07:00
Jing Zhao 152e5df3b6 HDFS-8666. Speedup the TestMover test. Contributed by Walter Su. 2015-07-01 14:59:50 -07:00
Jason Lowe b5cdf78e8e YARN-3793. Several NPEs when deleting local files on NM recovery. Contributed by Varun Saxena 2015-07-01 21:13:32 +00:00
Jason Lowe eac1d18943 MAPREDUCE-6418. MRApp should not shutdown LogManager during shutdown. Contributed by Chang Li 2015-07-01 18:01:22 +00:00
Jason Lowe 826715622e MAPREDUCE-6420. Interrupted Exception in LocalContainerLauncher should be logged in warn/info level. Contributed by Chang Li 2015-07-01 17:50:02 +00:00
Arpit Agarwal ec0dc71cab HDFS-8706. Fix typo in datanode startup options in HDFSCommands.html. (Controibuted by Brahma Reddy Battula) 2015-07-01 10:36:04 -07:00
Jason Lowe 2ac87df578 MAPREDUCE-6376. Add avro binary support for jhist files. Contributed by Ray Chiang 2015-07-01 16:00:03 +00:00
Devaraj K 80a68d6056 YARN-3830. AbstractYarnScheduler.createReleaseCache may try to clean a
null attempt. Contributed by nijel.
2015-07-01 19:03:44 +05:30
Devaraj K 7405c59799 YARN-3823. Fix mismatch in default values for
yarn.scheduler.maximum-allocation-vcores property. Contributed by Ray
Chiang.
2015-07-01 11:11:26 +05:30
Lei Xu 532e38cb7f HADOOP-12164. Fix TestMove and TestFsShellReturnCode failed to get command name using reflection. (Lei Xu) 2015-06-30 17:41:59 -07:00
cnauroth b8e792cba2 HADOOP-12116. Fix unrecommended syntax usages in hadoop/hdfs/yarn script for cygwin in branch-2. Contributed by Li Lu. 2015-06-30 16:54:30 -07:00
Robert Kanter 3a72bfd082 MAPREDUCE-6121. JobResourceUpdater#compareFs() doesn't handle HA namespaces (rchiang via rkanter) 2015-06-30 16:49:27 -07:00
Robert Kanter aaafa0b2ee HADOOP-12159. Move DistCpUtils#compareFs() to org.apache.hadoop.fs.FileUtil and fix for HA namespaces (rchiang via rkanter) 2015-06-30 16:49:27 -07:00
Colin Patrick Mccabe ad60807238 HADOOP-12124. Add HTrace support for FsShell (cmccabe) 2015-06-30 16:46:25 -07:00
Colin Patrick Mccabe 68e588cbee HADOOP-10798. globStatus() should always return a sorted list of files (cmccabe) 2015-06-30 16:40:21 -07:00
Colin Patrick Mccabe d0cc0380b5 YARN-3827. Migrate YARN native build to new CMake framework (Alan Burlison via Colin P. McCabe) 2015-06-30 16:24:19 -07:00
Colin Patrick Mccabe 9c63825f10 MAPREDUCE-6407. Migrate MAPREDUCE native build to new CMake framework (Alan Burlison via Colin P. McCabe) 2015-06-30 16:17:06 -07:00
Colin Patrick Mccabe 29df73dc05 HDFS-8635. Migrate HDFS native build to new CMake framework (Alan Burlison via Colin P. McCabe) 2015-06-30 15:54:38 -07:00
Andrew Wang 9ee7b6e6c4 HADOOP-12158. Improve error message in TestCryptoStreamsWithOpensslAesCtrCryptoCodec when OpenSSL is not installed. 2015-06-30 15:04:33 -07:00
Gera Shegalov 6f2a41e37d YARN-3768. ArrayIndexOutOfBoundsException with empty environment variables. (Zhihai Xu via gera) 2015-06-30 14:59:33 -07:00
Jason Lowe b6ba56457c MAPREDUCE-6384. Add the last reporting reducer info for too many fetch failure diagnostics. Contributed by Chang Li 2015-06-30 21:22:30 +00:00
Allen Wittenauer 147e020c7a HADOOP-12149. copy all of test-patch BINDIR prior to re-exec (aw) 2015-06-30 11:31:26 -07:00
Steve Loughran 076948d9a4 Revert "HADOOP-12009 Clarify FileSystem.listStatus() sorting order & fix FileSystemContractBaseTest:testListStatus. (J.Andreina via stevel)"
This reverts commit 3dfa8161f9.
2015-06-30 11:54:12 +01:00
Vinayakumar B 7ba5bbac02 HDFS-8627. NPE thrown if unable to fetch token from Namenode (Contributed by J.Andreina) 2015-06-30 15:42:59 +05:30
Vinayakumar B 6d99017f38 HADOOP-12154. FileSystem#getUsed() returns the file length only from root '/' (Contributed by J.Andreina) 2015-06-30 15:25:20 +05:30
Vinayakumar B 77588e1d32 HDFS-8579. Update HDFS usage with missing options (Contributed by J.Andreina) 2015-06-30 15:00:22 +05:30
Haohui Mai d3797f9f3c HDFS-8493. Consolidate truncate() related implementation in a single class. Contributed by Rakesh R. 2015-06-29 16:45:35 -07:00
Arpit Agarwal 8e333720e1 HDFS-8687. Remove the duplicate usage message from Dfsck.java. (Contributed by Brahma Reddy Battula) 2015-06-29 14:56:42 -07:00
Yongjun Zhang 43a1288fff HDFS-8659. Block scanner INFO message is spamming logs. Contributed by Yongjun Zhang. 2015-06-29 14:43:56 -07:00
Ming Ma 34ee0b9b47 Merge branch 'trunk' of https://git-wip-us.apache.org/repos/asf/hadoop into trunk 2015-06-29 14:37:44 -07:00
Ming Ma 8e1bdc17d9 HADOOP-12107. long running apps may have a huge number of StatisticsData instances under FileSystem (Sangjin Lee via Ming Ma) 2015-06-29 14:37:38 -07:00
Jian He 4672315e2d YARN-3770. SerializedException should also handle java.lang.Error on de-serialization. Contributed by Lavkesh Lahngir 2015-06-29 14:31:49 -07:00
cnauroth 460e98f7b3 HADOOP-12089. StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASB. Contributed by Duo Xu. 2015-06-29 13:48:02 -07:00
Jian He 62e583c7dc YARN-3695. ServerProxy (NMProxy, etc.) shouldn't retry forever for non network exception. Contributed by Raju Bairishetti 2015-06-29 13:37:32 -07:00
Colin Patrick Mccabe fad291ea6d HADOOP-12112. Make hadoop-common-project Native code -Wall-clean (alanburlison via cmccabe) 2015-06-29 12:35:16 -07:00
Colin Patrick Mccabe 5a27c3fd76 HADOOP-12104. Migrate Hadoop Pipes native build to new CMake framework (Alan Burlison via Colin P. McCabe) 2015-06-29 12:31:26 -07:00
Andrew Wang 2ffd84273a HDFS-8653. Code cleanup for DatanodeManager, DatanodeDescriptor and DatanodeStorageInfo. Contributed by Zhe Zhang. 2015-06-29 12:12:41 -07:00
Benoy Antony d3fed8e653 HDFS-7390. Provide JMX metrics per storage type. (Benoy Antony) 2015-06-29 11:00:22 -07:00
Vinayakumar B fde20ffcef HDFS-8628. Update missing command option for fetchdt (Contributed by J.Andreina) 2015-06-29 16:50:48 +05:30
Vinayakumar B c815344e2e HADOOP-12119. hadoop fs -expunge does not work for federated namespace (Contributed by J.Andreina) 2015-06-29 15:58:54 +05:30
Vinayakumar B 88ceb382ef HDFS-8586. Dead Datanode is allocated for write when client is from deadnode (Contributed by Brahma Reddy Battula) 2015-06-29 15:25:03 +05:30
Junping Du a95d39f9d0 YARN-3860. rmadmin -transitionToActive should check the state of non-target node. (Contributed by Masatake Iwasaki) 2015-06-28 22:26:47 -07:00