2213 Commits

Author SHA1 Message Date
Tsuyoshi Ozawa
7739f819a6 HADOOP-11283. SequenceFile.Writer can leak file descriptors in DistCpV1#setup(). (Contributed by Varun Saxena via ozawa)
(cherry picked from commit a164ce2ac985ecac957362fc717640ad45449371)
2014-12-25 23:32:34 +09:00
Robert Kanter
653b3fada2 HADOOP-11399. Java Configuration file and .xml files should be automatically cross-compared (rchiang via rkanter)
(cherry picked from commit 66cfe1dc73af1f8e3accebb1fa4c1bde19c78b0e)
2014-12-23 14:31:07 -08:00
Jing Zhao
9aa9455dab HDFS-7484. Make FSDirectory#addINode take existing INodes as its parameter. Contributed by Jing Zhao. 2014-12-22 23:20:18 -08:00
Tsuyoshi Ozawa
370a137c19 HADOOP-11414. FileBasedIPList#readLines() can leak file descriptors. (ozawa)
(cherry picked from commit ecf1469fa51f9977f70652fac313d4a9ec1eb86f)
2014-12-22 13:10:46 +09:00
Haohui Mai
e6662ec6a4 HADOOP-11429. Findbugs warnings in hadoop extras. Contributed by Varun Saxena. 2014-12-21 14:57:41 -08:00
Haohui Mai
db2984b044 HDFS-7555. Remove the support of unmanaged connectors in HttpServer2. Contributed by Haohui Mai. 2014-12-21 14:50:42 -08:00
arp
0a5b28605f HADOOP-11395. Add site documentation for Azure Storage FileSystem integration. (Contributed by Chris Nauroth) 2014-12-19 18:54:35 -08:00
Karthik Kambatla
e6c73a1c1a HADOOP-11213. Typos in html pages: SecureMode and EncryptedShuffle. (Wei Yan via kasha)
(cherry picked from commit 6f1e3667cff3e95f33ba14a3cb7d1e99518d502a)
2014-12-19 15:07:39 -08:00
Colin Patrick Mccabe
c60e3bdc4b HADOOP-11422. Check CryptoCodec is AES-CTR for Crypto input/output stream (Yi Liu via Colin P. McCabe)
(cherry picked from commit e369d98ba24906abcb35c0906cd57750c0d21fdb)
2014-12-19 13:12:20 -08:00
Colin Patrick Mccabe
fe38ed2ee7 HADOOP-11430. Add GenericTestUtils#disableLog, GenericTestUtils#setLogLevel (cmccabe)
(cherry picked from commit 6635ccd21766faf8f6a15d937dc8919a9075c988)
2014-12-18 19:41:59 -08:00
Haohui Mai
99c176ea6a HADOOP-11431. Clean up redundant maven-site-plugin configuration. Contributed by Herve Boutemy. 2014-12-18 16:24:17 -08:00
Haohui Mai
27ef6e4a6e HADOOP-11428. Remove obsolete reference to Cygwin in BUILDING.txt. Contributed by Arpit Agarwal. 2014-12-18 13:38:15 -08:00
Jason Lowe
84ea92879c HADOOP-11409. FileContext.getFileContext can stack overflow if default fs misconfigured. Contributed by Gera Shegalov
(cherry picked from commit b9d49761f72078a0a83137ba8197d08b71f385e0)
2014-12-18 21:28:57 +00:00
Haohui Mai
a508001ddd HADOOP-11385. Prevent cross site scripting attack on JMXJSONServlet. Contributed by Haohui Mai. 2014-12-18 11:39:17 -08:00
Colin Patrick Mccabe
2743b94c27 HADOOP-11427. ChunkedArrayList: fix removal via iterator and implement get (cmccabe)
(cherry picked from commit 07619aa516deb9094a18e0c64ce66ff9c8b05e92)
2014-12-18 11:05:33 -08:00
Haohui Mai
8854c78015 HADOOP-11125. Remove redundant tests in TestOsSecureRandom. Contributed by Masanori Oyama. 2014-12-18 10:59:48 -08:00
yliu
2d1ddbe58e HADOOP-11358. Tests for encryption/decryption with IV calculation overflow. (yliu) 2014-12-18 00:43:31 +08:00
Colin Patrick Mccabe
883ad3bf5a HADOOP-11421. Add IOUtils#listDirectory (cmccabe)
(cherry picked from commit 9937eef7f7f04a7dd3d504ae7ec5852d488a1f6a)
2014-12-17 15:18:35 -08:00
cnauroth
535d98bbb3 HADOOP-11248. Add hadoop configuration to disable Azure Filesystem metrics collection. Contributed by Shanyu Zhao.
(cherry picked from commit 734eeb4f357ad3210355a0d3fdbc80706a770d61)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2014-12-17 14:57:13 -08:00
cnauroth
1646cc9f29 HADOOP-11188. hadoop-azure: automatically expand page blobs when they become full. Contributed by Eric Hanson.
(cherry picked from commit f4b7e99f4ebac5b0295b7f7f42eb5705af41f079)
2014-12-17 14:57:13 -08:00
cnauroth
5a737026cc HADOOP-10809. hadoop-azure: page blob support. Contributed by Dexter Bradshaw, Mostafa Elhemali, Eric Hanson, and Mike Liddell.
(cherry picked from commit 2217e2f8ff418b88eac6ad36cafe3a9795a11f40)
2014-12-17 14:57:13 -08:00
Allen Wittenauer
9a2e4f4f98 HADOOP-10946. Fix a bunch of typos in log messages (Ray Chiang via aw)
(cherry picked from commit 9f03a7c018bb2c497cd0ef758f1a3e08e8163d06)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2014-12-17 14:57:13 -08:00
cnauroth
156e78c1da HADOOP-10690. Correct CHANGES.txt. 2014-12-17 14:57:13 -08:00
Chris Nauroth
cb6eb5931f HADOOP-10690. Lack of synchronization on access to InputStream in NativeAzureFileSystem#NativeAzureFsInputStream#close(). Contributed by Chen He.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604236 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 61bf9f779919206296d2ce84a8a6b2d912709a59)
2014-12-17 14:57:12 -08:00
Chris Nauroth
02a3bf8bda HADOOP-10840. Fix OutOfMemoryError caused by metrics system in Azure File System. Contributed by Shanyu Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611247 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 0a02b5a19bcca8d0c49d2adfc3909aebdf9d606e)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2014-12-17 14:57:12 -08:00
Chris Nauroth
b928b8c775 HADOOP-10728. Metrics system for Windows Azure Storage Filesystem. Contributed by Dexter Bradshaw, Mostafa Elhemali, Xi Fang, Johannes Klein, David Lao, Mike Liddell, Chuan Liu, Lengning Liu, Ivan Mitic, Michael Rys, Alexander Stojanovic, Brian Swan, and Min Wei.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605187 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 0d91576ec31f63402f2db6107a04155368e2632d)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2014-12-17 14:57:12 -08:00
Chris Nauroth
80d005c66f HADOOP-10689. InputStream is not closed in AzureNativeFileSystemStore#retrieve(). Contributed by Chen He.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604233 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 8300b9fb385b47672d98ea62ab291991424f3cce)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2014-12-17 14:57:12 -08:00
Chris Nauroth
82268d87bc HADOOP-9629. Support Windows Azure Storage - Blob as a file system in Hadoop. Contributed by Dexter Bradshaw, Mostafa Elhemali, Xi Fang, Johannes Klein, David Lao, Mike Liddell, Chuan Liu, Lengning Liu, Ivan Mitic, Michael Rys, Alexander Stojanovic, Brian Swan, and Min Wei.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601781 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 81bc395deb3ba00567dc067d6ca71bacf9e3bc82)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-project/pom.xml
	hadoop-tools/hadoop-tools-dist/pom.xml
	hadoop-tools/pom.xml
2014-12-17 14:56:05 -08:00
Haohui Mai
e869276005 HADOOP-11420. Use latest maven-site-plugin and replace link to svn with link to git. Contributed by Hervé Boutemy. 2014-12-17 14:05:59 -08:00
Colin Patrick Mccabe
89d6ac498a HADOOP-11416. Move ChunkedArrayList into hadoop-common (cmccabe)
(cherry picked from commit 4281c96e24739387bc2084f819c0176d0051a5e9)
2014-12-17 10:36:59 -08:00
cnauroth
36068768d8 HADOOP-11321. copyToLocal cannot save a file to an SMB share unless the user has Full Control permissions. Contributed by Chris Nauroth.
(cherry picked from commit e996a1bfd4f3ada6cbd9633fe68fda1e0c910bdf)
2014-12-16 15:32:23 -08:00
Haohui Mai
ba0969fb0e Revert HADOOP-11356 in branch-2. 2014-12-16 13:21:58 -08:00
Steve Loughran
a1b8b9ca59 HADOOP-11412 POMs mention "The Apache Software License" rather than "Apache License". (Herve Boutemy via stevel) 2014-12-16 11:03:02 +00:00
Colin Patrick Mccabe
19c8f7b72c HADOOP-11410. Make the rpath of libhadoop.so configurable (cmccabe)
(cherry picked from commit fb20797b6237054f3d16ff94a665cbad4cbe3293)
2014-12-15 18:55:38 -08:00
Benoy Antony
2eabbae292 HADOOP-10852 Fix thread safety issues in NetgroupCache. (Benoy Antony)
(cherry picked from commit a095622f36c5e9fff3ec02b14b800038a81f6286)
2014-12-15 14:02:15 -08:00
cnauroth
b9f1e88df7 HADOOP-11396. Provide navigation in the site documentation linking to the Hadoop Compatible File Systems. Contributed by Chris Nauroth.
(cherry picked from commit cbfb996fb4787e9d4bbaee1d01e3eca2caf0ce55)
2014-12-12 23:32:55 -08:00
cnauroth
21347a05f5 HADOOP-11394. hadoop-aws documentation missing. Contributed by Chris Nauroth.
(cherry picked from commit 9458cd5bce20358e31c0cfb594bc545c7824b10d)
2014-12-12 23:29:40 -08:00
Colin Patrick Mccabe
b521d91c0f HADOOP-11238. Update the NameNode's Group Cache in the background when possible (Chris Li via Colin P. McCabe)
(cherry picked from commit e5a692519956aefb3a540ed0137b63cf598ac10d)
2014-12-12 16:32:04 -08:00
Haohui Mai
5bc3aae6fb HADOOP-11389. Clean up byte to string encoding issues in hadoop-common. Contributed by Haohui Mai. 2014-12-11 16:51:46 -08:00
Gera Shegalov
8437c31b67 HADOOP-11211. mapreduce.job.classloader.system.classes semantics should be order-independent. (Yitong Zhou via gera)
(cherry picked from commit 0bcea111e5daa9a4315346cf6919a4cfc8d90e0d)
2014-12-11 13:29:40 -08:00
Haohui Mai
38afeb5f12 HADOOP-11386. Replace \n by %n in format hadoop-common format strings. Contributed by Li Lu. 2014-12-10 14:37:39 -08:00
Haohui Mai
df5af744ad HADOOP-11388. Remove deprecated o.a.h.metrics.file.FileContext. Contributed by Li Lu. 2014-12-10 12:49:26 -08:00
Haohui Mai
7e51350d9a HADOOP-10482. Fix various findbugs warnings in hadoop-common. Contributed by Haohui Mai. 2014-12-10 12:44:32 -08:00
Haohui Mai
a1e4a12dc0 HADOOP-11381. Fix findbugs warnings in hadoop-distcp, hadoop-aws, hadoop-azure, and hadoop-openstack. Contributed by Li Lu. 2014-12-09 20:46:44 -08:00
Colin Patrick Mccabe
3637bc8cd9 HADOOP-11349. RawLocalFileSystem leaks file descriptor while creating a file if creat succeeds but chmod fails. (Varun Saxena via Colin P. McCabe)
(cherry picked from commit 03867eb1bb173c66b5eb3bebf2fe03a1188635b5)
2014-12-09 14:32:25 -08:00
Haohui Mai
784f481473 HADOOP-11378. Fix new findbugs warnings in hadoop-kms. Contributed by Li Lu. 2014-12-09 13:10:09 -08:00
Haohui Mai
b68d51e898 HADOOP-11379. Fix new findbugs warnings in hadoop-auth*. Contributed by Li Lu. 2014-12-09 13:09:01 -08:00
Jing Zhao
e8e86e3ec7 HDFS-7498. Simplify the logic in INodesInPath. Contributed by Jing Zhao. 2014-12-09 11:38:07 -08:00
Haohui Mai
fa9ca25019 HADOOP-11273. TestMiniKdc failure: login options not compatible with IBM JDK. Contributed by Gao Zhong Liang. 2014-12-09 10:57:41 -08:00
Haohui Mai
49aacee2cb HADOOP-11372. Fix new findbugs warnings in mapreduce-examples. Contributed by Li Lu. 2014-12-09 10:49:11 -08:00