2718 Commits

Author SHA1 Message Date
Zhihai Xu
b9ec7f15d0 HADOOP-12268. AbstractContractAppendTest#testRenameFileBeingAppended misses rename operation. Contributed by Zhihai Xu
(cherry picked from commit a628a6f126473a99f9370ba642994ce2909a2d9e)
2015-07-31 21:47:34 -07:00
Colin Patrick Mccabe
7d68f17731 HADOOP-12183. Annotate the HTrace span created by FsShell with the command-line arguments passed by the user (Masatake Iwasaki via Colin P. McCabe)
(cherry picked from commit 454da959c726528ac98dbca1b935a83ed4b9e235)
2015-07-31 15:14:35 -07:00
Colin Patrick Mccabe
07a042aa3c HADOOP-7824. NativeIO.java flags and identifiers must be set correctly for each platform, not hardcoded to their Linux values (Martin Walsh via Colin P. McCabe)
(cherry picked from commit 21d10ccc6e463cf250414264c78acb4a6e7c83e3)
2015-07-31 15:02:01 -07:00
Harsh J
68034bd6c2 HADOOP-12271. Hadoop Jar Error Should Be More Explanatory. Contributed by Josh Elser.
(cherry picked from commit 2087eaf684d9fb14b5390e21bf17e93ac8fea7f8)
2015-07-31 10:13:07 +05:30
Jason Lowe
e6b4714d0b HADOOP-10945. 4-digit octal umask permissions throws a parse error. Contributed by Chang Li
(cherry picked from commit 6f0a35724f0da80146dbae4b6f6c341e1d3101f5)
2015-07-29 15:25:59 +00:00
Akira Ajisaka
dff49aee08 Revert "HDFS-6682. Add a metric to expose the timestamp of the oldest under-replicated block. (aajisaka)"
This reverts commit 17319c4a659dd150ccfe80da81fbaee69ca8ef1e.
2015-07-29 16:52:54 +09:00
Jakob Homan
71a5aa267d HDFS-8180. AbstractFileSystem Implementation for WebHdfs. Contributed by Sathosh G Nayak.
(cherry picked from commit 0712a8103fec6e9a9ceba335e3c3800b85b2c7ca)
2015-07-28 21:11:02 -07:00
Colin Patrick Mccabe
5875935669 HADOOP-12175. FsShell must load SpanReceierHost to support tracing (Masatake Iwasaki via Colin P. McCabe)
(cherry picked from commit 69b095730bd87706ddcbabeea6c513290ee4cdf5)
2015-07-28 12:56:36 -07:00
Arun Suresh
ffe6a34d5b HDFS-7858. Improve HA Namenode Failover detection on the client. (asuresh)
(cherry picked from commit 030fcfa99c345ad57625486eeabedebf2fd4411f)
2015-07-27 23:03:34 -07:00
Akira Ajisaka
c650ab0037 HADOOP-12245. References to misspelled REMAINING_QUATA in FileSystemShell.md. Contributed by Gabor Liptak.
(cherry picked from commit e21dde501aa9323b7f34b4bc4ba9d282ec4f2707)
2015-07-28 11:34:16 +09:00
Allen Wittenauer
cf348f2eb8 HADOOP-11807. add a lint mode to releasedocmaker (ramtin via aw)
(cherry picked from commit 8e657fba2fd33f7550597ea9c4c6e9a87aa1ef1c)
(cherry picked from commit 098ba450cc98475b84d60bb5ac3bd7b558b2a67c)
2015-07-24 18:32:05 -07:00
Colin Patrick Mccabe
2419711369 HADOOP-12170. hadoop-common's JNIFlags.cmake is redundant and can be removed (Alan Burlison via Colin P. McCabe)
(cherry picked from commit e4b0c74434b82c25256a59b03d62b1a66bb8ac69)
2015-07-24 13:23:51 -07:00
Allen Wittenauer
fed9f767b1 HADOOP-11813. releasedocmaker.py should use today's date instead of unreleased (Darrell Taylor via aw)
(cherry picked from commit f325522c1423f89dced999a16d49a004b2879743)
2015-07-24 11:55:57 -07:00
Allen Wittenauer
2a0688fdb8 HADOOP-11797. releasedocmaker.py needs to put ASF headers on output (aw)
(cherry picked from commit 8d3c0f601d549a22648050bcc9a0e4acf37edc81)
2015-07-24 11:55:56 -07:00
Robert Kanter
731ed9cad8 HADOOP-12259. Utility to Dynamic port allocation (brahmareddy via rkanter)
(cherry picked from commit ee233ec95ce8cfc8309d3adc072d926cd85eba08)
2015-07-24 09:42:04 -07:00
Akira Ajisaka
17319c4a65 HDFS-6682. Add a metric to expose the timestamp of the oldest under-replicated block. (aajisaka)
(cherry picked from commit 02c01815eca656814febcdaca6115e5f53b9c746)
2015-07-24 11:39:16 +09:00
Andrew Wang
cf258b6d98 HADOOP-12189. Improve CallQueueManager#swapQueue to make queue elements drop nearly impossible. Contributed by Zhihai Xu.
(cherry picked from commit 6736a1ab7033523ed5f304fdfed46d7f348665b4)
2015-07-23 14:42:44 -07:00
Allen Wittenauer
a37285620d HADOOP-11731. Rework the changelog and releasenotes (aw)
(cherry picked from commit f383fd9b6caf4557613250c5c218b1a1b65a212b)

 Conflicts:
	hadoop-project/src/site/site.xml
2015-07-23 14:08:10 -07:00
Arpit Agarwal
601b503895 HADOOP-12161. Add getStoragePolicy API to the FileSystem interface. (Contributed by Brahma Reddy Battula) 2015-07-23 10:14:01 -07:00
Colin Patrick Mccabe
d9876e69ee HADOOP-12184. Remove unused Linux-specific constants in NativeIO (Martin Walsh via Colin P. McCabe)
(cherry picked from commit 1b3bceb58c8e536a75fa3f99cc3ceeaba91a07de)
2015-07-22 11:35:14 -07:00
cnauroth
bb080b32d4 HADOOP-12239. StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASB. Contributed by Duo Xu.
(cherry picked from commit efa97243ecb84b3b468e732897cd685e3869f480)
2015-07-22 11:17:00 -07:00
Vinayakumar B
03d68b5575 HADOOP-12017. Hadoop archives command should use configurable replication factor when closing (Contributed by Bibin A Chundatt)
(cherry picked from commit 94c6a4aa85e7d98e9b532b330f30783315f4334b)
2015-07-22 10:27:03 +05:30
cnauroth
aab1c14df6 HDFS-8773. Few FSNamesystem metrics are not documented in the Metrics page. Contributed by Rakesh R.
(cherry picked from commit a26cc66f38daec2342215a66b599bf59cee1112c)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2015-07-21 14:13:15 -07:00
cnauroth
57d55d40dd HDFS-8721. Add a metric for number of encryption zones. Contributed by Rakesh R.
(cherry picked from commit cb03768b1b2250b9b5a7944cf6ef918e8a974e20)
2015-07-21 13:56:07 -07:00
Vinayakumar B
8ef3821356 HADOOP-12214. Parse 'HadoopArchive' commandline using cli Options. (Contributed by Vinayakumar B)
(cherry picked from commit 87f29c6b8acc07cc011713a79554d51945e265ac)
2015-07-21 13:13:31 +05:30
Akira Ajisaka
d591f2af5d HADOOP-12081. Fix UserGroupInformation.java to support 64-bit zLinux. (aajisaka)
(cherry picked from commit 773c670943757681feeafb227a2d0c29d48f38f1)
2015-07-21 11:22:36 +09:00
Steve Loughran
d3c23c7b18 HADOOP-11893. Mark org.apache.hadoop.security.token.Token as @InterfaceAudience.Public. (Brahma Reddy Battula via stevel) 2015-07-20 13:22:03 +01:00
Steve Loughran
577acf89f8 HADOOP-12051. ProtobufRpcEngine.invoke() should use Exception.toString() over getMessage() in logging/span events. (Varun Saxena via stevel) 2015-07-20 13:13:09 +01:00
Steve Loughran
d68b044f0f HADOOP-12088. KMSClientProvider uses equalsIgnoreCase("application/json"). (Brahma Reddy Battula via stevel) 2015-07-20 13:02:51 +01:00
Steve Loughran
208b9eed9e HADOOP-12209 Comparable type should be in FileStatus. (Yong Zhang via stevel) 2015-07-20 12:32:32 +01:00
Steve Loughran
f3296a1984 HADOOP-12235 hadoop-openstack junit & mockito dependencies should be "provided". (Ted Yu via stevel) 2015-07-20 11:22:22 +01:00
Haohui Mai
391d2d88f2 HDFS-8767. RawLocalFileSystem.listStatus() returns null for UNIX pipefile. Contributed by kanaka kumar avvaru. 2015-07-16 15:22:11 -07:00
Tsuyoshi Ozawa
90c5bf0605 HADOOP-12240. Fix tests requiring native library to be skipped in non-native profile. Contributed by Masatake Iwasaki.
(cherry picked from commit 90bda9c6110f0344104b8ae96ea6999770ebb391)
2015-07-16 16:05:11 +09:00
Tsuyoshi Ozawa
f3f7872fbf HADOOP-10615. FileInputStream in JenkinsHash#main() is never closed. Contributed by Chen He.
(cherry picked from commit 111e6a3fdf613767782817836c42810bf2bda5e8)
2015-07-16 14:09:22 +09:00
Tsuyoshi Ozawa
59ba845a2f HADOOP-12153. ByteBufferReadable doesn't declare @InterfaceAudience and @InterfaceStability. Contributed by Brahma Reddy Battula.
(cherry picked from commit cec1d43db026e66a9e84b5c3e8476dfd33f17ecb)
2015-07-15 14:19:29 +09:00
cnauroth
5e8c01e7a2 HADOOP-12232. Upgrade Tomcat dependency to 6.0.44. Contributed by Chris Nauroth.
(cherry picked from commit 6b56f05b9ea3ee45abd5d00b14fab93a353b1332)
2015-07-14 15:22:39 -07:00
Tsuyoshi Ozawa
64059d8884 HADOOP-12191. Bzip2Factory is not thread safe. Contributed by Brahma Reddy Battula.
(cherry picked from commit 4084eaf94347042d9b8cb1e86ba831036621dfdd)
2015-07-14 19:15:36 +09:00
Chris Douglas
c6b0bbabc7 HADOOP-12211. Collect disk usage on the node. Contributed by Robert Grandl
(cherry picked from commit a431ed9075cf6f467be5ff10f4ffb131cb1d3216)
2015-07-13 15:36:25 -07:00
Akira Ajisaka
ad6787aa43 YARN-3069. Document missing properties in yarn-default.xml. Contributed by Ray Chiang.
(cherry picked from commit d6675606dc5f141c9af4f76a37128f8de4cfedad)
2015-07-13 12:57:29 +09:00
Ming Ma
5e6bbe6031 HADOOP-12107. long running apps may have a huge number of StatisticsData instances under FileSystem (Sangjin Lee via Ming Ma)
(cherry picked from commit 8e1bdc17d9134e01115ae7c929503d8ac0325207)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2015-07-10 08:32:27 -07:00
Chris Douglas
66419d3672 HADOOP-12210. Collect network usage on the node. Contributed by Robert Grandl
(cherry picked from commit 1a0752d85a15499d120b4a79af9bd740fcd1f8e0)
2015-07-09 17:48:56 -07:00
Karthik Kambatla
fc989ebe16 HADOOP-12180. Move ResourceCalculatorPlugin from YARN to Common. (Chris Douglas via kasha)
(cherry picked from commit ac6048372a58b3a3b57cd5f2702b44a3d4667f3d)
2015-07-09 09:59:02 -07:00
Akira Ajisaka
ee07df688a HADOOP-12200. TestCryptoStreamsWithOpensslAesCtrCryptoCodec should be skipped in non-native profile. Contributed by Masatake Iwasaki.
(cherry picked from commit 6b7692c468931215ec0de7e11f0bdf15b80e68ce)
2015-07-09 13:15:37 +09:00
Colin Patrick Mccabe
016d661caf HADOOP-12201. Add tracing to FileSystem#createFileSystem and Globber#glob (cmccabe)
(cherry picked from commit b8832fcf1e2ae1e43d5e4523016731af40ab58d7)
2015-07-08 20:12:11 -07:00
Karthik Kambatla
4227fff3c6 HADOOP-11878. FileContext#fixRelativePart should check for not null for a more informative exception. (Brahma Reddy Battula via kasha)
(cherry picked from commit 2e3d83f97b85c015f16f1c162b8ef0e7fee1ddf2)
2015-07-08 11:35:09 -07:00
Andrew Wang
cc73f23713 HADOOP-12194. Support for incremental generation in the protoc plugin.
(cherry picked from commit 625d7ed9eb65f0df204b506ce92c11803fbce273)
2015-07-08 11:11:07 -07:00
Andrew Wang
9bbc3e4ad4 HADOOP-12195. Add annotation to package-info.java file to workaround MCOMPILER-205.
(cherry picked from commit 3dc92e84c2a530483c6a7693817b67d86f9c97aa)
2015-07-07 11:14:30 -07:00
Andrew Wang
54e9b904c4 HADOOP-12193. Rename Touchz.java to Touch.java.
(cherry picked from commit aa96a8c0c5d82a21e9b511517bc621c41841bc53)
2015-07-07 11:14:28 -07:00
Chris Douglas
62424b5d99 HADOOP-5732. Add SFTPFileSystem. Contributed by Ramtin Boustani and Inigo Goiri
(cherry picked from commit 559425dcb9302861c3c28b759492a68f8d597092)
2015-07-07 10:09:29 -07:00
Colin Patrick Mccabe
4da63e5f5f HADOOP-11974. Fix FIONREAD #include on Solaris (Alan Burlison via Colin P. McCabe)
(cherry picked from commit 81f364437608b21e85fc393f63546bf8b425ac71)
2015-07-07 08:36:52 -07:00