Commit Graph

10020 Commits

Author SHA1 Message Date
Colin Patrick Mccabe 3b9d32627f HDFS-9080. Update htrace version to 4.0.1 (cmccabe)
(cherry picked from commit 892ade689f)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSClient.java
        hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/BlockStorageLocationUtil.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
2015-09-28 08:15:00 -07:00
Harsh J 03e370e306 MAPREDUCE-6471. Document distcp incremental copy. Contributed by Neelesh Srinivas Salian.
(cherry picked from commit 66dad854c0)
2015-09-28 13:14:20 +05:30
Haohui Mai 504d6fd950 HDFS-8740. Move DistributedFileSystem to hadoop-hdfs-client. Contributed by Mingliang Liu. 2015-09-27 10:54:53 -07:00
Vinayakumar B 1c7b3b98c1 HADOOP-11984. Enable parallel JUnit tests in pre-commit (Contributed by Chris Nauroth)
(cherry picked from commit f0f984e4e6)
2015-09-27 14:12:34 +05:30
Colin Patrick Mccabe 2dca55be00 HDFS-9087. Add some jitter to DataNode.checkDiskErrorThread (Elliott Clark via Colin P. McCabe)
(cherry picked from commit 0b31c237f2)
2015-09-26 20:37:54 -07:00
Haohui Mai 94cbb6d164 HDFS-8053. Move DFSIn/OutputStream and related classes to hadoop-hdfs-client. Contributed by Mingliang Liu. 2015-09-26 11:16:50 -07:00
Vinayakumar B b46e4ceafd HADOOP-12442. Display help if the command option to 'hdfs dfs' is not valid (Contributed by nijel)
(cherry picked from commit 861b52db24)
2015-09-26 21:37:24 +05:30
Colin Patrick Mccabe e5dc723d48 HDFS-8873. Allow the directoryScanner to be rate-limited (Daniel Templeton via Colin P. McCabe)
(cherry picked from commit 7a3c381b39)
2015-09-26 04:21:23 -07:00
cnauroth 85c0cb0075 HADOOP-11918. Listing an empty s3a root directory throws FileNotFound. Contributed by Lei (Eddy) Xu.
(cherry picked from commit 7fe521b1dd)
2015-09-25 22:34:10 -07:00
Lei Xu 82d4c05b2d HDFS-9133. ExternalBlockReader and ReplicaAccessor need to return -1 on read when at EOF. (Colin Patrick McCabe via Lei (Eddy) Xu)
(cherry picked from commit 67b0e967f0)
2015-09-25 16:02:27 -07:00
Lei Xu 1a2870f6ff HDFS-9132. Pass genstamp to ReplicaAccessorBuilder. (Colin Patrick McCabe via Lei (Eddy) Xu) 2015-09-25 15:51:29 -07:00
Colin Patrick Mccabe a6166aa552 HDFS-9107. Prevent NN's unrecoverable death spiral after full GC (Daryn Sharp via Colin P. McCabe)
(cherry-picked from 4e7c6a653f)
2015-09-25 15:33:02 -07:00
Robert Kanter d8a5d2b2fc MAPREDUCE-6480. archive-logs tool may miss applications (rkanter)
(cherry picked from commit 8fec882cfaac047af1892615fe32d8c3ca02e7f9)
2015-09-25 15:00:07 -07:00
Jing Zhao aca014ea67 HDFS-9112. Improve error message for Haadmin when multiple name service IDs are configured. Contributed by Anu Engineer.
(cherry picked from commit 83e99d06d0)
2015-09-25 14:21:52 -07:00
Yongjun Zhang bc5ee80794 HDFS-5795. RemoteBlockReader2#checkSuccess() shoud print error status. (Xiao Chen via Yongjun Zhang)
(cherry picked from commit 83e65c5fe8)
2015-09-24 22:15:28 -07:00
Yongjun Zhang 16ae3f5d46 HDFS-9123. Copying from the root to a subdirectory should be forbidden. (Wei-Chiu Chuang via Yongjun Zhang)
(cherry picked from commit 3187dbd7a8)
2015-09-24 21:41:48 -07:00
Haohui Mai 85c73d159e HDFS-9134. Move LEASE_{SOFTLIMIT,HARDLIMIT}_PERIOD constants from HdfsServerConstants to HdfsConstants. Contributed by Mingliang Liu. 2015-09-24 20:29:52 -07:00
Xuan bf3f08cc63 YARN-3624. ApplicationHistoryServer should not reverse the order of the
filters it gets. Contributed by Mit Desai

(cherry picked from commit d1b9b85244)
2015-09-24 15:03:05 -07:00
Zhihai Xu 4ba0febd58 HADOOP-12252. LocalDirAllocator should not throw NPE with empty string configuration. Contributed by Zhihai Xu
(cherry picked from commit 52c1f272ec)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2015-09-24 12:40:39 -07:00
Harsh J 9bb6fba759 HADOOP-8436. NPE In getLocalPathForWrite ( path, conf ) when the required context item is not configured. Contributed by Brahma Reddy Battula. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389799 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit a7e450c7cc)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2015-09-24 12:30:55 -07:00
Arpit Agarwal 3c06162259 HADOOP-12437. Allow SecurityUtil to lookup alternate hostnames. (Contributed by Arpit Agarwal) 2015-09-24 11:41:58 -07:00
Jian He ea2b6ee9e9 YARN-4171. Fix findbugs warnings in YARN-1197 branch. Contributed by Wangda Tan
(cherry picked from commit b3f6b641dc)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
2015-09-24 10:30:49 -07:00
Jian He d458805690 YARN-1651. CapacityScheduler side changes to support container resize. Contributed by Wangda Tan
(cherry picked from commit 89cab1ba5f)

Conflicts:
	hadoop-tools/hadoop-sls/src/main/java/org/apache/hadoop/yarn/sls/scheduler/SLSCapacityScheduler.java
2015-09-24 10:30:04 -07:00
Jian He d592aa115b YARN-3868. Recovery support for container resizing. Contributed by Meng Ding
(cherry picked from commit c57eac5dfe)
2015-09-24 10:24:13 -07:00
Jian He b6c594c6ea YARN-1644. RM-NM protocol changes and NodeStatusUpdater implementation to support container resizing. Contributed by Meng Ding
(cherry picked from commit c3dc1af072)
2015-09-24 10:24:04 -07:00
Jian He b8955d81c5 YARN-1643. Make ContainersMonitor support changing monitoring size of an allocated container. Contributed by Meng Ding and Wangda Tan
(cherry picked from commit c59ae4eeb1)
2015-09-24 10:23:55 -07:00
Jian He fa0a554ae0 YARN-3867. ContainerImpl changes to support container resizing. Contributed by Meng Ding
(cherry picked from commit 5f5a968d65)
2015-09-24 10:23:46 -07:00
Jian He afe4afd0c9 YARN-1645. ContainerManager implementation to support container resizing. Contributed by Meng Ding & Wangda Tan
(cherry picked from commit ffd820c27a)
2015-09-24 10:23:35 -07:00
Jian He c19e8ffdc7 YARN-1449. AM-NM protocol changes to support container resizing. Contributed by Meng Ding & Wangda Tan)
(cherry picked from commit 83a18add10)
2015-09-24 10:23:25 -07:00
Jian He 89dc37450c YARN-3866. AM-RM protocol changes to support container resizing. Contributed by Meng Ding
(cherry picked from commit dfe2cb849f)
2015-09-24 10:23:13 -07:00
Haohui Mai 13bdc20d2b HDFS-7529. Consolidate encryption zone related implementation into a single class. Contributed by Rakesh R. 2015-09-24 08:46:44 -07:00
Zhihai Xu e5ba1a0521 MAPREDUCE-6484. Yarn Client uses local address instead of RM address as token renewer in a secure cluster when RM HA is enabled. Contributed by Zhihai Xu
(cherry picked from commit 97a08807ec)
2015-09-24 08:14:11 -07:00
Vinayakumar B a0ff9af827 HDFS-9076. Log full path instead of inodeId in DFSClient#closeAllFilesBeingWritten() (Contributed by Surendra Singh Lilhore)
(cherry picked from commit e52bc697f8)
2015-09-24 17:44:18 +05:30
Haohui Mai d148b6a234 HDFS-9131. Move config keys used by hdfs-client to HdfsClientConfigKeys. Contributed by Mingliang Liu. 2015-09-24 00:30:17 -07:00
Haohui Mai 7e4bd11b5b HDFS-9130. Use GenericTestUtils#setLogLevel to the logging level. Contributed by Mingliang Liu. 2015-09-24 00:12:29 -07:00
Rohith Sharma K S fbb1d923f4 YARN-4044. Running applications information changes such as movequeue is not published to TimeLine server. (Sunil G via rohithsharmaks) 2015-09-24 12:17:55 +05:30
Rohith Sharma K S ace4d26936 YARN-4152. NodeManager crash with NPE when LogAggregationService#stopContainer called for absent container. (Bibin A Chundatt via rohithsharmaks) 2015-09-24 11:31:47 +05:30
Haohui Mai 3d8f6b9d48 HDFS-9128. TestWebHdfsFileContextMainOperations and TestSWebHdfsFileContextMainOperations fail due to invalid HDFS path on Windows. Contributed by Chris Nauroth. 2015-09-23 19:38:21 -07:00
Haohui Mai 75c70339ab HADOOP-12438. Reset RawLocalFileSystem.useDeprecatedFileStatus in TestLocalFileSystem. Contributed by Chris Nauroth. 2015-09-23 19:34:19 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) f48af332a7 Release process for 2.6.1: Set the release date for 2.6.1
(cherry picked from commit 1f707ecffd)
2015-09-23 15:12:30 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) 48eb28e7e2 YARN-3248. Moving it to improvements section in CHANGES.txt.
(cherry picked from commit df52ff92ae)
2015-09-23 15:02:23 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) 23f4cd1c5a CHANGES.txt: Moving YARN-1884, YARN-3171, YARN-3740, YARN-3248, YARN-3544 to 2.6.1 given the backport.
(cherry picked from commit f3e5bc6766)
2015-09-23 13:46:00 -07:00
Jason Lowe b7111449a1 YARN-3975. WebAppProxyServlet should not redirect to RM page if AHS is enabled. Contributed by Mit Desai
(cherry picked from commit 692d51c09d)
2015-09-23 16:39:50 +00:00
Jason Lowe c829be5133 YARN-4095. Avoid sharing AllocatorPerContext object in LocalDirAllocator between ShuffleHandler and LocalDirsHandlerService. Contributed by Zhihai Xu
(cherry picked from commit c890c51a91)
2015-09-23 15:44:13 +00:00
Vinayakumar B 017dff9877 HDFS-9013. Deprecate NameNodeMXBean#getNNStarted in branch2 and remove from trunk (Contributed by Surendra Singh Lilhore)
(cherry picked from commit a2c76e5f26)
2015-09-23 15:45:21 +05:30
Haohui Mai 090b1f6398 HDFS-8733. Keep server related definition in hdfs.proto on server side. Contributed by Mingliang Liu. 2015-09-22 20:57:11 -07:00
Haohui Mai ed7211563c HDFS-9039. Separate client and server side methods of o.a.h.hdfs.NameNodeProxies. Contributed by Mingliang Liu. 2015-09-22 20:52:46 -07:00
Harsh J 38420754f5 MAPREDUCE-5045. UtilTest#isCygwin method appears to be unused. Contributed by Neelesh Srinivas Salian.
(cherry picked from commit de1322aa76007832698af682a3b76042116043b9)
2015-09-22 21:38:31 +05:30
Vinayakumar B 96e3fbf401 HDFS-9043. Doc updation for commands in HDFS Federation (Contributed by J.Andreina)
(cherry picked from commit 57003fa971)
2015-09-22 16:33:41 +05:30
Vinayakumar B 2893da4f53 HDFS-8780. Fetching live/dead datanode list with arg true for removeDecommissionNode,returns list with decom node. (Contributed by J.Andreina)
(cherry picked from commit 10ab7d595e)
2015-09-22 12:31:02 +05:30