1826 Commits

Author SHA1 Message Date
Steve Loughran
15865587ec HADOOP-11171 Enable using a proxy server to connect to S3a. (Thomas Demoor via stevel) 2015-01-17 18:40:30 +00:00
Steve Loughran
ed2f8a1ba0 HADOOP-10542 Potential null pointer dereference in Jets3tFileSystemStore retrieveBlock(). (Ted Yu via stevel) 2015-01-17 18:26:03 +00:00
Steve Loughran
651c7debe4 HADOOP-11261 Set custom endpoint for S3A. (Thomas Demoor via stevel) 2015-01-16 10:15:22 +00:00
Haohui Mai
2e4df87104 HADOOP-11350. The size of header buffer of HttpServer is too small when HTTPS is enabled. Contributed by Benoy Antony. 2015-01-15 16:22:20 -08:00
Allen Wittenauer
c060d60a40 HADOOP-8989. hadoop fs -find feature (Jonathan Allen via aw) 2015-01-15 11:56:16 -08:00
Robert Kanter
24a8b8e5a7 HADOOP-8757. Metrics should disallow names with invalid characters (rchiang via rkanter)
(cherry picked from commit b6ff9c03a4f8aba945e562a7ff60b0fc6a1cd040)
2015-01-15 11:42:15 -08:00
Akira Ajisaka
8682382c16 HADOOP-11318. Update the document for hadoop fs -stat
(cherry picked from commit ce29074685abaa88ae9586fe8277aca23f9d54d6)

Conflicts:
	hadoop-common-project/hadoop-common/src/site/apt/FileSystemShell.apt.vm
2015-01-16 01:09:37 +09:00
Akira Ajisaka
0f33d45948 HADOOP-11483. HardLink.java should use the jdk7 createLink method
(cherry picked from commit db51548f706ccd2d0200745ab89e27610c6d10bc)
2015-01-15 21:01:59 +09:00
Colin Patrick Mccabe
e6a251ff68 HDFS-7067. ClassCastException while using a key created by keytool to create encryption zone. (Charles Lamb via Colin P. McCabe)
(cherry picked from commit a5a033c7ca130528f8c509b035fc090ad4eb981a)
2015-01-14 18:04:32 -08:00
Arpit Agarwal
7a75f4eed9 HADOOP-11465. Fix findbugs warnings in hadoop-gridmix. (Contributed by Varun Saxena) 2015-01-12 21:23:13 -08:00
Ravi Prakash
619fbf1fa4 HADOOP-11400. GraphiteSink does not reconnect to Graphite after 'broken pipe'
(Kamil Gorlo via raviprak)

(cherry picked from commit 4d2914210053f28c95094aa59e48f8e84c55a2c7)
2015-01-10 08:37:35 -08:00
Brandon Li
d847363821 HADOOP-9992. Modify the NN loadGenerator to optionally run as a MapReduce job. Contributed by Akshay Radia
(cherry picked from commit 09d31bc63035a71620657ab3f787047799bdcd14)
2015-01-09 17:25:19 -08:00
cnauroth
9a7c763b3f HADOOP-11464. Reinstate support for launching Hadoop processes on Windows using Cygwin. Contributed by Chris Nauroth. 2015-01-09 15:01:33 -08:00
Tsuyoshi Ozawa
132fd6ba58 HADOOP-11032. Replace use of Guava's Stopwatch with Hadoop's StopWatch. (ozawa)
(cherry picked from commit a6ed4894b518351bf1b3290e725a475570a21296)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-nativetask/src/test/java/org/apache/hadoop/mapred/nativetask/kvtest/KVJob.java
2015-01-08 15:00:02 +09:00
cnauroth
adf49e4b94 HADOOP-11462. TestSocketIOWithTimeout needs change for PowerPC platform. Contributed by Ayappan.
(cherry picked from commit 3ed0aed3cc4c2c7f96d3c5dd95d8dcd4eb8e888a)
2015-01-07 12:24:25 -08:00
Jason Lowe
2b408d8dc7 HADOOP-11445. Bzip2Codec: Data block is skipped when position of newly created stream is equal to start of split. Contributed by Ankit Kamboj
(cherry picked from commit d02fb53750bc592c23ba470ae82eb6f47d9a00ec)
2015-01-06 21:20:31 +00:00
Vinayakumar B
383e1c5f73 HADOOP-11459. Fix recent findbugs in ActiveStandbyElector, NetUtils and ShellBasedIdMapping (Contributed by Vinayakumar B)
(cherry picked from commit 9803ae374f69942aec82ec6eeeb9722523a1ade0)
2015-01-06 09:16:44 +05:30
Steve Loughran
4446512e9e HADOOP-11390 Metrics 2 ganglia provider to include hostname in unresolved address problems. (Varun Saxena via stevel) 2015-01-05 16:09:25 +00:00
Steve Loughran
2800e73c27 HADOOP-11446 S3AOutputStream should use shared thread pool to avoid OutOfMemoryError 2015-01-05 12:59:48 +00:00
yliu
5782f9e392 HADOOP-11455. KMS and Credential CLI should request confirmation for deletion by default. (Charles Lamb via yliu) 2015-01-05 06:51:23 +08:00
Colin Patrick Mccabe
e25b789b19 HADOOP-11039. ByteBufferReadable API doc is inconsistent with the implementations. (Yi Liu via Colin P. McCabe)
(cherry picked from commit 249cc905017948d64aab3d14d7a64df3b7b35a13)
2014-12-29 13:38:20 -08:00
Tsuyoshi Ozawa
1e0cfb9278 HADOOP-11448. Fix findbugs warnings in FileBasedIPList. (ozawa)
(cherry picked from commit 399d25884a99f3e0b2ef65eaf9f3149d0d523f13)
2014-12-26 15:23:28 +09:00
Tsuyoshi Ozawa
7739f819a6 HADOOP-11283. SequenceFile.Writer can leak file descriptors in DistCpV1#setup(). (Contributed by Varun Saxena via ozawa)
(cherry picked from commit a164ce2ac985ecac957362fc717640ad45449371)
2014-12-25 23:32:34 +09:00
Robert Kanter
653b3fada2 HADOOP-11399. Java Configuration file and .xml files should be automatically cross-compared (rchiang via rkanter)
(cherry picked from commit 66cfe1dc73af1f8e3accebb1fa4c1bde19c78b0e)
2014-12-23 14:31:07 -08:00
Tsuyoshi Ozawa
370a137c19 HADOOP-11414. FileBasedIPList#readLines() can leak file descriptors. (ozawa)
(cherry picked from commit ecf1469fa51f9977f70652fac313d4a9ec1eb86f)
2014-12-22 13:10:46 +09:00
Haohui Mai
e6662ec6a4 HADOOP-11429. Findbugs warnings in hadoop extras. Contributed by Varun Saxena. 2014-12-21 14:57:41 -08:00
Haohui Mai
db2984b044 HDFS-7555. Remove the support of unmanaged connectors in HttpServer2. Contributed by Haohui Mai. 2014-12-21 14:50:42 -08:00
arp
0a5b28605f HADOOP-11395. Add site documentation for Azure Storage FileSystem integration. (Contributed by Chris Nauroth) 2014-12-19 18:54:35 -08:00
Karthik Kambatla
e6c73a1c1a HADOOP-11213. Typos in html pages: SecureMode and EncryptedShuffle. (Wei Yan via kasha)
(cherry picked from commit 6f1e3667cff3e95f33ba14a3cb7d1e99518d502a)
2014-12-19 15:07:39 -08:00
Colin Patrick Mccabe
c60e3bdc4b HADOOP-11422. Check CryptoCodec is AES-CTR for Crypto input/output stream (Yi Liu via Colin P. McCabe)
(cherry picked from commit e369d98ba24906abcb35c0906cd57750c0d21fdb)
2014-12-19 13:12:20 -08:00
Colin Patrick Mccabe
fe38ed2ee7 HADOOP-11430. Add GenericTestUtils#disableLog, GenericTestUtils#setLogLevel (cmccabe)
(cherry picked from commit 6635ccd21766faf8f6a15d937dc8919a9075c988)
2014-12-18 19:41:59 -08:00
Haohui Mai
99c176ea6a HADOOP-11431. Clean up redundant maven-site-plugin configuration. Contributed by Herve Boutemy. 2014-12-18 16:24:17 -08:00
Haohui Mai
27ef6e4a6e HADOOP-11428. Remove obsolete reference to Cygwin in BUILDING.txt. Contributed by Arpit Agarwal. 2014-12-18 13:38:15 -08:00
Jason Lowe
84ea92879c HADOOP-11409. FileContext.getFileContext can stack overflow if default fs misconfigured. Contributed by Gera Shegalov
(cherry picked from commit b9d49761f72078a0a83137ba8197d08b71f385e0)
2014-12-18 21:28:57 +00:00
Haohui Mai
a508001ddd HADOOP-11385. Prevent cross site scripting attack on JMXJSONServlet. Contributed by Haohui Mai. 2014-12-18 11:39:17 -08:00
Colin Patrick Mccabe
2743b94c27 HADOOP-11427. ChunkedArrayList: fix removal via iterator and implement get (cmccabe)
(cherry picked from commit 07619aa516deb9094a18e0c64ce66ff9c8b05e92)
2014-12-18 11:05:33 -08:00
Haohui Mai
8854c78015 HADOOP-11125. Remove redundant tests in TestOsSecureRandom. Contributed by Masanori Oyama. 2014-12-18 10:59:48 -08:00
yliu
2d1ddbe58e HADOOP-11358. Tests for encryption/decryption with IV calculation overflow. (yliu) 2014-12-18 00:43:31 +08:00
Colin Patrick Mccabe
883ad3bf5a HADOOP-11421. Add IOUtils#listDirectory (cmccabe)
(cherry picked from commit 9937eef7f7f04a7dd3d504ae7ec5852d488a1f6a)
2014-12-17 15:18:35 -08:00
cnauroth
535d98bbb3 HADOOP-11248. Add hadoop configuration to disable Azure Filesystem metrics collection. Contributed by Shanyu Zhao.
(cherry picked from commit 734eeb4f357ad3210355a0d3fdbc80706a770d61)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2014-12-17 14:57:13 -08:00
cnauroth
1646cc9f29 HADOOP-11188. hadoop-azure: automatically expand page blobs when they become full. Contributed by Eric Hanson.
(cherry picked from commit f4b7e99f4ebac5b0295b7f7f42eb5705af41f079)
2014-12-17 14:57:13 -08:00
cnauroth
5a737026cc HADOOP-10809. hadoop-azure: page blob support. Contributed by Dexter Bradshaw, Mostafa Elhemali, Eric Hanson, and Mike Liddell.
(cherry picked from commit 2217e2f8ff418b88eac6ad36cafe3a9795a11f40)
2014-12-17 14:57:13 -08:00
Allen Wittenauer
9a2e4f4f98 HADOOP-10946. Fix a bunch of typos in log messages (Ray Chiang via aw)
(cherry picked from commit 9f03a7c018bb2c497cd0ef758f1a3e08e8163d06)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2014-12-17 14:57:13 -08:00
cnauroth
156e78c1da HADOOP-10690. Correct CHANGES.txt. 2014-12-17 14:57:13 -08:00
Chris Nauroth
cb6eb5931f HADOOP-10690. Lack of synchronization on access to InputStream in NativeAzureFileSystem#NativeAzureFsInputStream#close(). Contributed by Chen He.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604236 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 61bf9f779919206296d2ce84a8a6b2d912709a59)
2014-12-17 14:57:12 -08:00
Chris Nauroth
02a3bf8bda HADOOP-10840. Fix OutOfMemoryError caused by metrics system in Azure File System. Contributed by Shanyu Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611247 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 0a02b5a19bcca8d0c49d2adfc3909aebdf9d606e)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2014-12-17 14:57:12 -08:00
Chris Nauroth
b928b8c775 HADOOP-10728. Metrics system for Windows Azure Storage Filesystem. Contributed by Dexter Bradshaw, Mostafa Elhemali, Xi Fang, Johannes Klein, David Lao, Mike Liddell, Chuan Liu, Lengning Liu, Ivan Mitic, Michael Rys, Alexander Stojanovic, Brian Swan, and Min Wei.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605187 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 0d91576ec31f63402f2db6107a04155368e2632d)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2014-12-17 14:57:12 -08:00
Chris Nauroth
80d005c66f HADOOP-10689. InputStream is not closed in AzureNativeFileSystemStore#retrieve(). Contributed by Chen He.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604233 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 8300b9fb385b47672d98ea62ab291991424f3cce)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2014-12-17 14:57:12 -08:00
Chris Nauroth
82268d87bc HADOOP-9629. Support Windows Azure Storage - Blob as a file system in Hadoop. Contributed by Dexter Bradshaw, Mostafa Elhemali, Xi Fang, Johannes Klein, David Lao, Mike Liddell, Chuan Liu, Lengning Liu, Ivan Mitic, Michael Rys, Alexander Stojanovic, Brian Swan, and Min Wei.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601781 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 81bc395deb3ba00567dc067d6ca71bacf9e3bc82)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-project/pom.xml
	hadoop-tools/hadoop-tools-dist/pom.xml
	hadoop-tools/pom.xml
2014-12-17 14:56:05 -08:00
Haohui Mai
e869276005 HADOOP-11420. Use latest maven-site-plugin and replace link to svn with link to git. Contributed by Hervé Boutemy. 2014-12-17 14:05:59 -08:00