Commit Graph

9703 Commits

Author SHA1 Message Date
Karthik Kambatla 4227fff3c6 HADOOP-11878. FileContext#fixRelativePart should check for not null for a more informative exception. (Brahma Reddy Battula via kasha)
(cherry picked from commit 2e3d83f97b)
2015-07-08 11:35:09 -07:00
Andrew Wang cc73f23713 HADOOP-12194. Support for incremental generation in the protoc plugin.
(cherry picked from commit 625d7ed9eb)
2015-07-08 11:11:07 -07:00
Haohui Mai 981fe4cfaa HDFS-8726. Move protobuf files that define the client-sever protocols to hdfs-client. Contributed by Haohui Mai. 2015-07-08 10:37:31 -07:00
Arpit Agarwal e519df47b2 HDFS-8642. Make TestFileTruncate more reliable. (Contributed by Rakesh R) 2015-07-08 09:31:17 -07:00
Vinayakumar B 6fe2e7c3f3 HDFS-8712. Remove 'public' and 'abstract' modifiers in FsVolumeSpi and FsDatasetSpi (Contributed by Lei (Eddy) Xu)
(cherry picked from commit bd4e10900c)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/FsDatasetSpi.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/FsVolumeSpi.java
2015-07-08 17:03:18 +05:30
Vinayakumar B 01e12b7d69 Revert "HDFS-8712. Remove 'public' and 'abstract' modifiers in FsVolumeSpi and FsDatasetSpi (Contributed by Lei (Eddy) Xu)"
This reverts commit 38ee9247cd.
2015-07-08 16:59:22 +05:30
Vinayakumar B 38ee9247cd HDFS-8712. Remove 'public' and 'abstract' modifiers in FsVolumeSpi and FsDatasetSpi (Contributed by Lei (Eddy) Xu)
(cherry picked from commit bd4e10900c)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/FsDatasetSpi.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/FsVolumeSpi.java
2015-07-08 16:36:12 +05:30
Xiaoyu Yao 907abdca73 HDFS-8711. setSpaceQuota command should print the available storage type when input storage type is wrong. Contributed by Brahma Reddy Battula.
(cherry picked from commit b68701b7b2)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestQuota.java
2015-07-08 16:25:47 +05:30
Akira Ajisaka d260478d3a YARN-3690. [JDK8] 'mvn site' fails. Contributed by Brahma Reddy Battula.
(cherry picked from commit d6325745e2)
2015-07-08 15:43:04 +09:00
Jian He fa59b224b8 YARN-3892. Fixed NPE on RMStateStore#serviceStop when CapacityScheduler#serviceInit fails. Contributed by Bibin A Chundatt
(cherry picked from commit c9dd2cada0)
2015-07-07 14:18:16 -07:00
Haohui Mai b181c13cbf HDFS-8620. Clean up the checkstyle warinings about ClientProtocol. Contributed by Takanobu Asanuma. 2015-07-07 14:04:12 -07:00
Andrew Wang 9bbc3e4ad4 HADOOP-12195. Add annotation to package-info.java file to workaround MCOMPILER-205.
(cherry picked from commit 3dc92e84c2)
2015-07-07 11:14:30 -07:00
Andrew Wang 54e9b904c4 HADOOP-12193. Rename Touchz.java to Touch.java.
(cherry picked from commit aa96a8c0c5)
2015-07-07 11:14:28 -07:00
Chris Douglas 5fbf91b453 MAPREDUCE-6038. A boolean may be set error in the Word Count v2.0 in MapReduce Tutorial. Contributed by Tsuyoshi Ozawa
(cherry picked from commit 4990ccfdc742be9c0517557a6256fefcae0df67d)
2015-07-07 10:26:57 -07:00
Jing Zhao bed74b620a Revert "HDFS-8652. Track BlockInfo instead of Block in CorruptReplicasMap. Contributed by Jing Zhao."
This reverts commit d62b63d297.

(cherry picked from commit bc99aaffe7)
2015-07-07 10:14:17 -07:00
Chris Douglas 62424b5d99 HADOOP-5732. Add SFTPFileSystem. Contributed by Ramtin Boustani and Inigo Goiri
(cherry picked from commit 559425dcb9)
2015-07-07 10:09:29 -07:00
Colin Patrick Mccabe 4da63e5f5f HADOOP-11974. Fix FIONREAD #include on Solaris (Alan Burlison via Colin P. McCabe)
(cherry picked from commit 81f3644376)
2015-07-07 08:36:52 -07:00
Vinayakumar B 2b99310c32 HADOOP-12186. ActiveStandbyElector shouldn't call monitorLockNodeAsync multiple times (Contributed by zhihai xu)
Moved CHANGES.txt entry to 2.7.2

(cherry picked from commit e0febce0e7)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2015-07-07 18:16:14 +05:30
Varun Vasudev 16ca0fcf99 YARN-2194. Fix bug causing CGroups functionality to fail on RHEL7. Contributed by Wei Yan.
(cherry-picked from commit 7e3ebc0fc59dbd1d7768b5a6c05af18b8c8fea4d)
2015-07-07 17:05:06 +05:30
Vinayakumar B c5c0577248 HADOOP-12117. Potential NPE from Configuration#loadProperty with allowNullValueProperties set. (Contributed by zhihai xu)
(cherry picked from commit 99c8c5839b)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/conf/TestConfiguration.java
2015-07-07 16:18:54 +05:30
Devaraj K f558429efe YARN-3837. javadocs of TimelineAuthenticationFilterInitializer give wrong
prefix for auth options. Contributed by Bibin A Chundatt.

(cherry picked from commit af63427c6d)
2015-07-07 12:08:03 +05:30
Vinod Kumar Vavilapalli (I am also known as @tshooter.) a8bf34cad8 Release process for 2.7.1: Set the release date for 2.7.1.
(cherry picked from commit bf89ddb9b8)
2015-07-06 16:41:00 -07:00
Jing Zhao 3d73d2027f HDFS-8652. Track BlockInfo instead of Block in CorruptReplicasMap. Contributed by Jing Zhao.
(cherry picked from commit d62b63d297)
2015-07-06 15:55:03 -07:00
Chris Douglas 360164e41e HADOOP-12185. NetworkTopology is not efficient adding/getting/removing nodes. Contributed by Inigo Goiri
(cherry picked from commit 47a69ec7a5)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/net/NetworkTopology.java
2015-07-06 15:15:45 -07:00
cnauroth d01eaef40f HADOOP-12045. Enable LocalFileSystem#setTimes to change atime. Contributed by Kazuho Fujii.
(cherry picked from commit ed1e3ce482)
2015-07-06 13:40:26 -07:00
Vinayakumar B 9a774dfae5 HDFS-8686. WebHdfsFileSystem#getXAttr(Path p, final String name) doesn't work if namespace is in capitals (Contributed by kanaka kumar avvaru)
(cherry picked from commit fc92d3e651)
2015-07-06 16:09:42 +05:30
Vinayakumar B 91d2c59968 HADOOP-12186. ActiveStandbyElector shouldn't call monitorLockNodeAsync multiple times (Contributed by zhihai xu)
(cherry picked from commit 233cab89ad)
2015-07-06 15:40:16 +05:30
Devaraj K 415dd64461 MAPREDUCE-6425. ShuffleHandler passes wrong "base" parameter to
getMapOutputInfo if mapId is not in the cache. Contributed by zhihai xu.

(cherry picked from commit bff67dfe2f)
2015-07-06 13:47:54 +05:30
Xuan 09639ac6b4 YARN-3882. AggregatedLogFormat should close aclScanner and ownerScanner
after create them. Contributed by zhihai xu

(cherry picked from commit 688617d6d7)
2015-07-04 21:54:22 -07:00
Vinayakumar B b963ca84bc HDFS-8577. Avoid retrying to recover lease on a file which does not exist (Contributed by J.Andreina)
(cherry picked from commit 2eae130ab9)
2015-07-03 13:36:07 +05:30
Chris Douglas f2c0539d38 HADOOP-12173. NetworkTopology::add calls toString always. Contributed by Inigo Goiri
(cherry picked from commit e59f6fad6a)
2015-07-02 21:49:43 -07:00
Andrew Wang efe9ae9fc6 HDFS-8709. Clarify automatic sync in FSEditLog#logEdit.
(cherry picked from commit 5fddc5177d)
2015-07-02 10:26:43 -07:00
Vinayakumar B 55bf014a07 HDFS-8703. Merge refactor of DFSInputStream from ErasureCoding branch (Contributed by Vinayakumar B)
(cherry picked from commit bff5999d07)
2015-07-02 16:12:13 +05:30
Devaraj K e1ca886419 YARN-3875. FSSchedulerNode#reserveResource() doesn't print Application Id
properly in log. Contributed by Bibin A Chundatt.

(cherry picked from commit 37d7395773)
2015-07-02 10:21:32 +05:30
cnauroth 0d94a293a8 HADOOP-12172. FsShell mkdir -p makes an unnecessary check for the existence of the parent. Contributed by Chris Nauroth.
(cherry picked from commit f3796224bf)
2015-07-01 19:48:17 -07:00
Colin Patrick Mccabe 490bef0856 HADOOP-12171. Shorten overly-long htrace span names for server (cmccabe)
(cherry picked from commit a78d5074fb)
2015-07-01 17:57:33 -07:00
Wangda Tan d61dd10b50 YARN-3508. Prevent processing preemption events on the main RM dispatcher. (Varun Saxena via wangda)
(cherry picked from commit 0e4b06690f)
2015-07-01 17:32:57 -07:00
Jing Zhao ff7562cc99 HDFS-8666. Speedup the TestMover test. Contributed by Walter Su.
(cherry picked from commit 152e5df3b6)
2015-07-01 15:00:16 -07:00
Jason Lowe a721b9d812 YARN-3793. Several NPEs when deleting local files on NM recovery. Contributed by Varun Saxena
(cherry picked from commit b5cdf78e8e)
2015-07-01 21:14:35 +00:00
Jason Lowe 8a4970e845 MAPREDUCE-6418. MRApp should not shutdown LogManager during shutdown. Contributed by Chang Li
(cherry picked from commit eac1d18943)
2015-07-01 18:02:17 +00:00
Jason Lowe f3195eda27 MAPREDUCE-6420. Interrupted Exception in LocalContainerLauncher should be logged in warn/info level. Contributed by Chang Li
(cherry picked from commit 826715622e)
2015-07-01 17:50:47 +00:00
Arpit Agarwal d38f377cd3 HDFS-8706. Fix typo in datanode startup options in HDFSCommands.html. (Controibuted by Brahma Reddy Battula) 2015-07-01 10:36:10 -07:00
Jason Lowe df4e1e4965 MAPREDUCE-6376. Add avro binary support for jhist files. Contributed by Ray Chiang
(cherry picked from commit 2ac87df578)

Conflicts:

	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
2015-07-01 16:07:54 +00:00
Devaraj K c343250657 YARN-3830. AbstractYarnScheduler.createReleaseCache may try to clean a
null attempt. Contributed by nijel.

(cherry picked from commit 80a68d6056)
2015-07-01 19:05:27 +05:30
Devaraj K 3432017de0 YARN-3823. Fix mismatch in default values for
yarn.scheduler.maximum-allocation-vcores property. Contributed by Ray
Chiang.

(cherry picked from commit 7405c59799)
2015-07-01 11:12:43 +05:30
Lei Xu fad478e7ce HADOOP-12164. Fix TestMove and TestFsShellReturnCode failed to get command name using reflection. (Lei Xu)
(cherry picked from commit 47fab573bcb7b1129648499571b518f7b9773f89)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShellReturnCode.java
2015-06-30 17:37:52 -07:00
cnauroth f7ba3c0045 HADOOP-12116. Fix unrecommended syntax usages in hadoop/hdfs/yarn script for cygwin in branch-2. Contributed by Li Lu. 2015-06-30 16:55:10 -07:00
Robert Kanter e5b0439bc1 MAPREDUCE-6121. JobResourceUpdater#compareFs() doesn't handle HA namespaces (rchiang via rkanter)
(cherry picked from commit 3a72bfd082)
2015-06-30 16:50:48 -07:00
Robert Kanter 3f79ee7494 HADOOP-12159. Move DistCpUtils#compareFs() to org.apache.hadoop.fs.FileUtil and fix for HA namespaces (rchiang via rkanter)
(cherry picked from commit aaafa0b2ee)
2015-06-30 16:50:42 -07:00
Colin Patrick Mccabe 016c794e75 HADOOP-12124. Add HTrace support for FsShell (cmccabe)
(cherry picked from commit ad60807238)
2015-06-30 16:47:14 -07:00