Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,253 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

2394 Commits

Author SHA1 Message Date
cnauroth 196443318f HADOOP-11547. hadoop-common native compilation fails on Windows due to missing support for __attribute__ declaration. Contributed by Chris Nauroth. 
(cherry picked from commit a35e86c670)
 2015-02-04 12:07:13 -08:00
Andrew Wang 696266e99c HDFS-7734. Class cast exception in NameNode#main. Contributed by Yi Liu. 
(cherry picked from commit 9175105eea)
 2015-02-04 11:31:49 -08:00
cnauroth 85b2739508 HADOOP-11548. checknative should display a nicer error message when openssl support is not compiled in. Contributed by Anu Engineer. 
(cherry picked from commit 064e0770a0)
 2015-02-04 10:01:39 -08:00
Tsuyoshi Ozawa f92d4fa20f HADOOP-11546. Checkstyle failing: Unable to instantiate DoubleCheckedLockingCheck. (ozawa) 
(cherry picked from commit ba58da29f4)
 2015-02-05 00:51:40 +09:00
Akira Ajisaka 5c5139d35f HADOOP-11544. Remove unused configuration keys for tracing. Contributed by Masatake Iwasaki. 
(cherry picked from commit 42548f4dc2)
 2015-02-04 04:20:08 -08:00
Haohui Mai 6c5ae1571c HADOOP-11529. Fix findbugs warnings in hadoop-archives. Contributed by Masatake Iwasaki. 2015-02-03 10:53:26 -08:00
Robert Kanter 410830fe8c YARN-3022. Expose Container resource information from NodeManager for monitoring (adhoot via ranter) 
(cherry picked from commit f7a77819a1)
 2015-02-03 10:39:51 -08:00
Tsuyoshi Ozawa b396d2e8d8 HADOOP-11045. Introducing a tool to detect flaky tests of hadoop jenkins testing job. Contributed by Yongjun Zhang and Todd Lipcon. 
(cherry picked from commit 80705e034b)
 2015-02-04 01:26:44 +09:00
cnauroth dedfb982f1 HADOOP-11442. hadoop-azure: Create test jar. Contributed by Shashank Khandelwal. 
(cherry picked from commit 1c09ca2ba4)
 2015-02-02 11:51:01 -08:00
cnauroth aee297ccea HADOOP-10181. GangliaContext does not work with multicast ganglia setup. Contributed by Andrew Johnson. 
(cherry picked from commit 8004a00230)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics/ganglia/GangliaContext.java
 2015-02-02 11:16:13 -08:00
Benoy Antony f3ed5b68ca HADOOP-11494. Lock acquisition on WrappedInputStream#unwrappedRpcBuffer may race with another thread. Contributed by Ted Yu. 
(cherry picked from commit 3472e3bd6c)
 2015-02-02 10:46:54 -08:00
Harsh J 648510e031 HADOOP-11488. Difference in default connection timeout for S3A FS. Contributed by Daisuke Kobayashi. 
(cherry picked from commit ffc75d6ebe)
 2015-02-01 00:17:24 +05:30
Gera Shegalov 151e147e64 HADOOP-11432. Fix SymlinkBaseTest#testCreateLinkUsingPartQualPath2. (Liang Xie via gera) 
(cherry picked from commit 26c2de36e2)
 2015-01-30 18:47:03 -08:00
Colin Patrick Mccabe 80381b62aa HADOOP-11498. Bump the version of HTrace to 3.1.0-incubating (Masatake Iwasaki via Colin P. McCabe) 
(cherry picked from commit 09ad9a868a)
 2015-01-30 16:02:36 -08:00
Kihwal Lee 3a01984bda HADOOP-9137. Support connection limiting in IPC server. Contributed by Kihwal Lee. 
(cherry picked from commit 8dc59cb9e0)
 2015-01-30 17:22:48 -06:00
cnauroth 4607ca2854 HADOOP-11523. StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASB. Contributed by Duo Xu. 
(cherry picked from commit f2c91098c4)
 2015-01-29 17:02:48 -08:00
Colin Patrick Mccabe e8d154baea HADOOP-11403. Avoid using sys_errlist on Solaris, which lacks support for it (Malcolm Kavalsky via Colin P. McCabe) 
(cherry picked from commit e36ef3b402)
 2015-01-29 15:48:59 -08:00
cnauroth fa2378d866 HADOOP-11441. Hadoop-azure: Change few methods scope to public. Contributed by Shashank Khandelwal. 
(cherry picked from commit ad55083f75)
 2015-01-29 13:07:59 -08:00
Akira Ajisaka 1081b4c4a7 HADOOP-9907. Webapp http://hostname:port/metrics link is not working. (aajisaka) 
(cherry picked from commit 342efa110a)
 2015-01-30 02:50:46 +09:00
Akira Ajisaka 7411c74b11 HADOOP-10574. Bump the maven plugin versions too -moving the numbers into properties. (aajisaka) 
(cherry picked from commit 57b8950f37)

Conflicts:
	pom.xml
 2015-01-30 02:27:36 +09:00
Akira Ajisaka 71c60af84e HADOOP-10525. Remove DRFA.MaxBackupIndex config from log4j.properties (aajisaka) 
(cherry picked from commit 03a5e04d5b)
 2015-01-29 16:18:07 +09:00
Tsuyoshi Ozawa 71db37266b HADOOP-11316. "mvn package -Pdist,docs -DskipTests -Dtar" fails because of non-ascii characters. (ozawa) 
(cherry picked from commit 9850e1584b)
 2015-01-28 22:01:38 +09:00
Tsuyoshi Ozawa 235a77fe1c HADOOP-11317. Increment SLF4J version to 1.7.10. Contributed by Tim Robertson. 
(cherry picked from commit 20a4768397)
 2015-01-28 21:55:33 +09:00
yliu 3ac8f88989 HADOOP-11469. KMS should skip default.key.acl and whitelist.key.acl when loading key acl. (Dian Fu via yliu) 2015-01-27 23:55:52 +08:00
Aaron T. Myers 3c8d3816c6 HADOOP-10626. Limit Returning Attributes for LDAP search. Contributed by Jason Hubbard. 
(cherry picked from commit 8709751e1ee9a2c5553823dcd715bd077052ad7f)
 2015-01-27 13:51:19 -08:00
Haohui Mai 3d6318b51b HADOOP-4297. Enable Java assertions when running tests. Contributed by Tsz Wo Nicholas Sze. 2015-01-27 11:06:15 -08:00
Xuan f93fa39384 HADOOP-11509. Change parsing sequence in GenericOptionsParser to parse 
-D parameters before -files. Contributed by Xuan Gong

(cherry picked from commit 0bf333911c)
 2015-01-26 15:37:14 -08:00
Steve Loughran 0ada35c912 HADOOP-6221 RPC Client operations cannot be interrupted (stevel) 2015-01-26 22:04:45 +00:00
Colin Patrick Mccabe 7f1441291d HADOOP-11466: move to 2.6.1 2015-01-26 11:28:02 -08:00
Jason Lowe a389056afa HADOOP-11499. Check of executorThreadsStarted in ValueQueue#submitRefillTask() evades lock acquisition. Contributed by Ted Yu 
(cherry picked from commit 7574df1bba)
 2015-01-26 16:57:12 +00:00
Tsuyoshi Ozawa 2551cc6e6f HADOOP-11450. Cleanup DistCpV1 not to use deprecated methods and fix javadocs. Contributed by Varun Saxena. 
(cherry picked from commit 7b82c4ab4e)
 2015-01-26 13:02:00 +09:00
Steve Loughran d46738ca5c HADOOP-11419 improve hadoop-maven-plugins. (Hervé Boutemy via stevel) 2015-01-25 16:12:58 +00:00
Konstantin V Shvachko de66227a57 HADOOP-11490. Expose truncate API via FileSystem and shell command. Contributed by Milan Desai. 2015-01-24 17:28:34 -08:00
Andrew Wang 7b69719455 HADOOP-11482. Use correct UGI when KMSClientProvider is called by a proxy user. Contributed by Arun Suresh. 
(cherry picked from commit 4b00935643)
 2015-01-23 12:11:29 -08:00
Steve Loughran 28d165d9a5 HADOOP-11507 Hadoop RPC Authentication problem with different user locale. (Talat UYARER via stevel) 2015-01-23 19:36:37 +00:00
Akira Ajisaka 13067cf4b1 HADOOP-11493. Fix some typos in kms-acls.xml description. (Contributed by Charles Lamb) 
(cherry picked from commit aee4500612)
 2015-01-23 11:49:37 +09:00
Allen Wittenauer 03ee9e344f HADOOP-11008. Remove duplicated description about proxy-user in site documents (Masatake Iwasaki via aw) 2015-01-22 14:30:35 -08:00
Tsuyoshi Ozawa 7191efe25f HADOOP-11500. InputStream is left unclosed in ApplicationClassLoader. Contributed by Ted Yu. 
(cherry picked from commit 825923f7b9)
 2015-01-23 00:50:43 +09:00
Tsuyoshi Ozawa 1435b2002b HADOOP-11209. Configuration#updatingResource/finalParameters are not thread-safe. Contributed by Varun Saxena. 
(cherry picked from commit 786dbdfad8)
 2015-01-22 14:16:52 +09:00
Colin Patrick Mccabe 2c69f8cf81 HADOOP-11466. FastByteComparisons: do not use UNSAFE_COMPARER on the SPARC architecture because it is slower there (Suman Somasundar via Colin P. McCabe) 
(cherry picked from commit ee7d22e90c)
 2015-01-21 17:06:38 -08:00
cnauroth 2a69775610 HADOOP-10668. Addendum patch to fix TestZKFailoverController. Contributed by Ming Ma. 
(cherry picked from commit 925c9fed33)
 2015-01-21 11:53:02 -08:00
Jason Lowe 57a53acad4 HADOOP-11327. BloomFilter#not() omits the last bit, resulting in an incorrect filter. Contributed by Eric Payne 
(cherry picked from commit 07b0806036)
 2015-01-21 19:07:26 +00:00
Allen Wittenauer 683cc18bba HADOOP-11256. Some site docs have inconsistent appearance (Masatake Iwasaki via aw) 2015-01-21 08:46:19 -08:00
yliu 3f37354daa HDFS-7623. Add htrace configuration properties to core-default.xml and update user doc about how to enable htrace. (yliu) 2015-01-21 00:57:51 +08:00
Tsuyoshi Ozawa 09eee9bbc1 HADOOP-11489. Dropping dependency on io.netty from hadoop-nfs' pom.xml. Contributed by Ted Yu. 
(cherry picked from commit c94c0d2c56)
 2015-01-20 15:27:41 +09:00
cnauroth a70e2c15be HADOOP-10668. TestZKFailoverControllerStress#testExpireBackAndForth occasionally fails. Contributed by Ming Ma. 
(cherry picked from commit 7fc1f2f5cf)
 2015-01-19 11:28:42 -08:00
Steve Loughran 15865587ec HADOOP-11171 Enable using a proxy server to connect to S3a. (Thomas Demoor via stevel) 2015-01-17 18:40:30 +00:00
Steve Loughran ed2f8a1ba0 HADOOP-10542 Potential null pointer dereference in Jets3tFileSystemStore retrieveBlock(). (Ted Yu via stevel) 2015-01-17 18:26:03 +00:00
Karthik Kambatla 4d8fa9615f YARN-2984. Metrics for container's actual memory usage. (kasha) 
(cherry picked from commit 84198564ba)
 2015-01-17 06:26:47 +05:30
Arpit Agarwal f72e2bfedd HDFS-7591. hdfs classpath command should support same options as hadoop classpath. (Contributed by Varun Saxena) 2015-01-16 09:37:54 -08:00
Steve Loughran 651c7debe4 HADOOP-11261 Set custom endpoint for S3A. (Thomas Demoor via stevel) 2015-01-16 10:15:22 +00:00
Haohui Mai 2e4df87104 HADOOP-11350. The size of header buffer of HttpServer is too small when HTTPS is enabled. Contributed by Benoy Antony. 2015-01-15 16:22:20 -08:00
Allen Wittenauer 450561a934 HADOOP-8989. hadoop fs -find feature (Jonathan Allen via aw) (missed some files) 2015-01-15 11:57:48 -08:00
Allen Wittenauer c060d60a40 HADOOP-8989. hadoop fs -find feature (Jonathan Allen via aw) 2015-01-15 11:56:16 -08:00
Robert Kanter 24a8b8e5a7 HADOOP-8757. Metrics should disallow names with invalid characters (rchiang via rkanter) 
(cherry picked from commit b6ff9c03a4)
 2015-01-15 11:42:15 -08:00
Akira Ajisaka 8682382c16 HADOOP-11318. Update the document for hadoop fs -stat 
(cherry picked from commit ce29074685)

Conflicts:
	hadoop-common-project/hadoop-common/src/site/apt/FileSystemShell.apt.vm
 2015-01-16 01:09:37 +09:00
Akira Ajisaka 0f33d45948 HADOOP-11483. HardLink.java should use the jdk7 createLink method 
(cherry picked from commit db51548f70)
 2015-01-15 21:01:59 +09:00
Colin Patrick Mccabe e6a251ff68 HDFS-7067. ClassCastException while using a key created by keytool to create encryption zone. (Charles Lamb via Colin P. McCabe) 
(cherry picked from commit a5a033c7ca)
 2015-01-14 18:04:32 -08:00
Xuan 79c8f4dcba YARN-2807. Option "--forceactive" not works as described in usage of 
"yarn rmadmin -transitionToActive". Contributed by Masatake Iwasaki

(cherry picked from commit d15cbae73c)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/YarnCommands.apt.vm
 2015-01-14 11:18:10 -08:00
Arpit Agarwal 7a75f4eed9 HADOOP-11465. Fix findbugs warnings in hadoop-gridmix. (Contributed by Varun Saxena) 2015-01-12 21:23:13 -08:00
Ravi Prakash 619fbf1fa4 HADOOP-11400. GraphiteSink does not reconnect to Graphite after 'broken pipe' 
(Kamil Gorlo via raviprak)

(cherry picked from commit 4d29142100)
 2015-01-10 08:37:35 -08:00
Brandon Li d847363821 HADOOP-9992. Modify the NN loadGenerator to optionally run as a MapReduce job. Contributed by Akshay Radia 
(cherry picked from commit 09d31bc630)
 2015-01-09 17:25:19 -08:00
cnauroth 9a7c763b3f HADOOP-11464. Reinstate support for launching Hadoop processes on Windows using Cygwin. Contributed by Chris Nauroth. 2015-01-09 15:01:33 -08:00
Benoy Antony 832ae27f83 HADOOP-10651. Add ability to restrict service access using IP addresses and hostnames. (Benoy Antony) 
(cherry picked from commit 20625c8f04)
 2015-01-08 10:09:55 -08:00
Tsuyoshi Ozawa 132fd6ba58 HADOOP-11032. Replace use of Guava's Stopwatch with Hadoop's StopWatch. (ozawa) 
(cherry picked from commit a6ed4894b5)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-nativetask/src/test/java/org/apache/hadoop/mapred/nativetask/kvtest/KVJob.java
 2015-01-08 15:00:02 +09:00
cnauroth adf49e4b94 HADOOP-11462. TestSocketIOWithTimeout needs change for PowerPC platform. Contributed by Ayappan. 
(cherry picked from commit 3ed0aed3cc)
 2015-01-07 12:24:25 -08:00
Brandon Li 36367209a1 HDFS-7564. NFS gateway dynamically reload UID/GID mapping file /etc/nfs.map. Contributed by Yongjun Zhang 
(cherry picked from commit 788ee35e2b)
 2015-01-06 16:20:39 -08:00
Jason Lowe 2b408d8dc7 HADOOP-11445. Bzip2Codec: Data block is skipped when position of newly created stream is equal to start of split. Contributed by Ankit Kamboj 
(cherry picked from commit d02fb53750)
 2015-01-06 21:20:31 +00:00
Vinayakumar B 383e1c5f73 HADOOP-11459. Fix recent findbugs in ActiveStandbyElector, NetUtils and ShellBasedIdMapping (Contributed by Vinayakumar B) 
(cherry picked from commit 9803ae374f)
 2015-01-06 09:16:44 +05:30
Benoy Antony 0c2d996c2c HADOOP-11402. Negative user-to-group cache entries are never cleared for never-again-accessed users. Contributed by Varun Saxena. 
(cherry picked from commit 53caeaa16b)
 2015-01-05 15:09:19 -08:00
Steve Loughran 4446512e9e HADOOP-11390 Metrics 2 ganglia provider to include hostname in unresolved address problems. (Varun Saxena via stevel) 2015-01-05 16:09:25 +00:00
Steve Loughran 2800e73c27 HADOOP-11446 S3AOutputStream should use shared thread pool to avoid OutOfMemoryError 2015-01-05 12:59:48 +00:00
yliu 5782f9e392 HADOOP-11455. KMS and Credential CLI should request confirmation for deletion by default. (Charles Lamb via yliu) 2015-01-05 06:51:23 +08:00
Brandon Li 05df432fab HDFS-7563. NFS gateway parseStaticMap NumberFormatException. Contributed by Yongjun Zhang 
(cherry picked from commit 892b1bb746)
 2015-01-02 10:50:51 -08:00
Colin Patrick Mccabe e25b789b19 HADOOP-11039. ByteBufferReadable API doc is inconsistent with the implementations. (Yi Liu via Colin P. McCabe) 
(cherry picked from commit 249cc90501)
 2014-12-29 13:38:20 -08:00
Tsuyoshi Ozawa 1e0cfb9278 HADOOP-11448. Fix findbugs warnings in FileBasedIPList. (ozawa) 
(cherry picked from commit 399d25884a)
 2014-12-26 15:23:28 +09:00
Tsuyoshi Ozawa 7739f819a6 HADOOP-11283. SequenceFile.Writer can leak file descriptors in DistCpV1#setup(). (Contributed by Varun Saxena via ozawa) 
(cherry picked from commit a164ce2ac9)
 2014-12-25 23:32:34 +09:00
Robert Kanter 653b3fada2 HADOOP-11399. Java Configuration file and .xml files should be automatically cross-compared (rchiang via rkanter) 
(cherry picked from commit 66cfe1dc73)
 2014-12-23 14:31:07 -08:00
Jing Zhao 9aa9455dab HDFS-7484. Make FSDirectory#addINode take existing INodes as its parameter. Contributed by Jing Zhao. 2014-12-22 23:20:18 -08:00
Tsuyoshi Ozawa 370a137c19 HADOOP-11414. FileBasedIPList#readLines() can leak file descriptors. (ozawa) 
(cherry picked from commit ecf1469fa5)
 2014-12-22 13:10:46 +09:00
Haohui Mai e6662ec6a4 HADOOP-11429. Findbugs warnings in hadoop extras. Contributed by Varun Saxena. 2014-12-21 14:57:41 -08:00
Haohui Mai db2984b044 HDFS-7555. Remove the support of unmanaged connectors in HttpServer2. Contributed by Haohui Mai. 2014-12-21 14:50:42 -08:00
arp 0a5b28605f HADOOP-11395. Add site documentation for Azure Storage FileSystem integration. (Contributed by Chris Nauroth) 2014-12-19 18:54:35 -08:00
Karthik Kambatla e6c73a1c1a HADOOP-11213. Typos in html pages: SecureMode and EncryptedShuffle. (Wei Yan via kasha) 
(cherry picked from commit 6f1e3667cf)
 2014-12-19 15:07:39 -08:00
Colin Patrick Mccabe c60e3bdc4b HADOOP-11422. Check CryptoCodec is AES-CTR for Crypto input/output stream (Yi Liu via Colin P. McCabe) 
(cherry picked from commit e369d98ba2)
 2014-12-19 13:12:20 -08:00
Colin Patrick Mccabe fe38ed2ee7 HADOOP-11430. Add GenericTestUtils#disableLog, GenericTestUtils#setLogLevel (cmccabe) 
(cherry picked from commit 6635ccd217)
 2014-12-18 19:41:59 -08:00
Haohui Mai 99c176ea6a HADOOP-11431. Clean up redundant maven-site-plugin configuration. Contributed by Herve Boutemy. 2014-12-18 16:24:17 -08:00
Haohui Mai 27ef6e4a6e HADOOP-11428. Remove obsolete reference to Cygwin in BUILDING.txt. Contributed by Arpit Agarwal. 2014-12-18 13:38:15 -08:00
Jason Lowe 84ea92879c HADOOP-11409. FileContext.getFileContext can stack overflow if default fs misconfigured. Contributed by Gera Shegalov 
(cherry picked from commit b9d49761f7)
 2014-12-18 21:28:57 +00:00
Haohui Mai a508001ddd HADOOP-11385. Prevent cross site scripting attack on JMXJSONServlet. Contributed by Haohui Mai. 2014-12-18 11:39:17 -08:00
Colin Patrick Mccabe 2743b94c27 HADOOP-11427. ChunkedArrayList: fix removal via iterator and implement get (cmccabe) 
(cherry picked from commit 07619aa516)
 2014-12-18 11:05:33 -08:00
Haohui Mai 8854c78015 HADOOP-11125. Remove redundant tests in TestOsSecureRandom. Contributed by Masanori Oyama. 2014-12-18 10:59:48 -08:00
yliu 2d1ddbe58e HADOOP-11358. Tests for encryption/decryption with IV calculation overflow. (yliu) 2014-12-18 00:43:31 +08:00
Colin Patrick Mccabe 883ad3bf5a HADOOP-11421. Add IOUtils#listDirectory (cmccabe) 
(cherry picked from commit 9937eef7f7)
 2014-12-17 15:18:35 -08:00
cnauroth 535d98bbb3 HADOOP-11248. Add hadoop configuration to disable Azure Filesystem metrics collection. Contributed by Shanyu Zhao. 
(cherry picked from commit 734eeb4f35)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2014-12-17 14:57:13 -08:00
cnauroth 1646cc9f29 HADOOP-11188. hadoop-azure: automatically expand page blobs when they become full. Contributed by Eric Hanson. 
(cherry picked from commit f4b7e99f4e)
 2014-12-17 14:57:13 -08:00
cnauroth 5a737026cc HADOOP-10809. hadoop-azure: page blob support. Contributed by Dexter Bradshaw, Mostafa Elhemali, Eric Hanson, and Mike Liddell. 
(cherry picked from commit 2217e2f8ff)
 2014-12-17 14:57:13 -08:00
Allen Wittenauer 9a2e4f4f98 HADOOP-10946. Fix a bunch of typos in log messages (Ray Chiang via aw) 
(cherry picked from commit 9f03a7c018)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2014-12-17 14:57:13 -08:00
cnauroth 156e78c1da HADOOP-10690. Correct CHANGES.txt. 2014-12-17 14:57:13 -08:00
Chris Nauroth cb6eb5931f HADOOP-10690. Lack of synchronization on access to InputStream in NativeAzureFileSystem#NativeAzureFsInputStream#close(). Contributed by Chen He. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604236 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 61bf9f7799)
 2014-12-17 14:57:12 -08:00
Chris Nauroth 02a3bf8bda HADOOP-10840. Fix OutOfMemoryError caused by metrics system in Azure File System. Contributed by Shanyu Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611247 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 0a02b5a19b)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2014-12-17 14:57:12 -08:00
Chris Nauroth b928b8c775 HADOOP-10728. Metrics system for Windows Azure Storage Filesystem. Contributed by Dexter Bradshaw, Mostafa Elhemali, Xi Fang, Johannes Klein, David Lao, Mike Liddell, Chuan Liu, Lengning Liu, Ivan Mitic, Michael Rys, Alexander Stojanovic, Brian Swan, and Min Wei. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605187 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 0d91576ec3)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2014-12-17 14:57:12 -08:00
Chris Nauroth 80d005c66f HADOOP-10689. InputStream is not closed in AzureNativeFileSystemStore#retrieve(). Contributed by Chen He. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604233 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 8300b9fb38)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2014-12-17 14:57:12 -08:00
Chris Nauroth 82268d87bc HADOOP-9629. Support Windows Azure Storage - Blob as a file system in Hadoop. Contributed by Dexter Bradshaw, Mostafa Elhemali, Xi Fang, Johannes Klein, David Lao, Mike Liddell, Chuan Liu, Lengning Liu, Ivan Mitic, Michael Rys, Alexander Stojanovic, Brian Swan, and Min Wei. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601781 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 81bc395deb)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-project/pom.xml
	hadoop-tools/hadoop-tools-dist/pom.xml
	hadoop-tools/pom.xml
 2014-12-17 14:56:05 -08:00
Haohui Mai e869276005 HADOOP-11420. Use latest maven-site-plugin and replace link to svn with link to git. Contributed by Hervé Boutemy. 2014-12-17 14:05:59 -08:00
Colin Patrick Mccabe 89d6ac498a HADOOP-11416. Move ChunkedArrayList into hadoop-common (cmccabe) 
(cherry picked from commit 4281c96e24)
 2014-12-17 10:36:59 -08:00
cnauroth 36068768d8 HADOOP-11321. copyToLocal cannot save a file to an SMB share unless the user has Full Control permissions. Contributed by Chris Nauroth. 
(cherry picked from commit e996a1bfd4)
 2014-12-16 15:32:23 -08:00
Haohui Mai ba0969fb0e Revert HADOOP-11356 in branch-2. 2014-12-16 13:21:58 -08:00
Steve Loughran a1b8b9ca59 HADOOP-11412 POMs mention "The Apache Software License" rather than "Apache License". (Herve Boutemy via stevel) 2014-12-16 11:03:02 +00:00
Colin Patrick Mccabe 19c8f7b72c HADOOP-11410. Make the rpath of libhadoop.so configurable (cmccabe) 
(cherry picked from commit fb20797b62)
 2014-12-15 18:55:38 -08:00
Benoy Antony 2eabbae292 HADOOP-10852 Fix thread safety issues in NetgroupCache. (Benoy Antony) 
(cherry picked from commit a095622f36)
 2014-12-15 14:02:15 -08:00
Brandon Li 781a1e352c HDFS-7516. Fix findbugs warnings in hdfs-nfs project. Contributed by Brandon Li 
(cherry picked from commit 42d8858c5d)
 2014-12-15 11:29:37 -08:00
cnauroth b9f1e88df7 HADOOP-11396. Provide navigation in the site documentation linking to the Hadoop Compatible File Systems. Contributed by Chris Nauroth. 
(cherry picked from commit cbfb996fb4)
 2014-12-12 23:32:55 -08:00
cnauroth 21347a05f5 HADOOP-11394. hadoop-aws documentation missing. Contributed by Chris Nauroth. 
(cherry picked from commit 9458cd5bce)
 2014-12-12 23:29:40 -08:00
Colin Patrick Mccabe b521d91c0f HADOOP-11238. Update the NameNode's Group Cache in the background when possible (Chris Li via Colin P. McCabe) 
(cherry picked from commit e5a6925199)
 2014-12-12 16:32:04 -08:00
Haohui Mai 5bc3aae6fb HADOOP-11389. Clean up byte to string encoding issues in hadoop-common. Contributed by Haohui Mai. 2014-12-11 16:51:46 -08:00
Gera Shegalov 8437c31b67 HADOOP-11211. mapreduce.job.classloader.system.classes semantics should be order-independent. (Yitong Zhou via gera) 
(cherry picked from commit 0bcea111e5)
 2014-12-11 13:29:40 -08:00
Haohui Mai 38afeb5f12 HADOOP-11386. Replace \n by %n in format hadoop-common format strings. Contributed by Li Lu. 2014-12-10 14:37:39 -08:00
Haohui Mai df5af744ad HADOOP-11388. Remove deprecated o.a.h.metrics.file.FileContext. Contributed by Li Lu. 2014-12-10 12:49:26 -08:00
Haohui Mai 7e51350d9a HADOOP-10482. Fix various findbugs warnings in hadoop-common. Contributed by Haohui Mai. 2014-12-10 12:44:32 -08:00
Haohui Mai a1e4a12dc0 HADOOP-11381. Fix findbugs warnings in hadoop-distcp, hadoop-aws, hadoop-azure, and hadoop-openstack. Contributed by Li Lu. 2014-12-09 20:46:44 -08:00
Colin Patrick Mccabe 3637bc8cd9 HADOOP-11349. RawLocalFileSystem leaks file descriptor while creating a file if creat succeeds but chmod fails. (Varun Saxena via Colin P. McCabe) 
(cherry picked from commit 03867eb1bb)
 2014-12-09 14:32:25 -08:00
Haohui Mai 784f481473 HADOOP-11378. Fix new findbugs warnings in hadoop-kms. Contributed by Li Lu. 2014-12-09 13:10:09 -08:00
Haohui Mai b68d51e898 HADOOP-11379. Fix new findbugs warnings in hadoop-auth*. Contributed by Li Lu. 2014-12-09 13:09:01 -08:00
Jing Zhao e8e86e3ec7 HDFS-7498. Simplify the logic in INodesInPath. Contributed by Jing Zhao. 2014-12-09 11:38:07 -08:00
Haohui Mai fa9ca25019 HADOOP-11273. TestMiniKdc failure: login options not compatible with IBM JDK. Contributed by Gao Zhong Liang. 2014-12-09 10:57:41 -08:00
Haohui Mai 49aacee2cb HADOOP-11372. Fix new findbugs warnings in mapreduce-examples. Contributed by Li Lu. 2014-12-09 10:49:11 -08:00
Andrew Wang deaa172e7a HADOOP-11368. Fix SSLFactory truststore reloader thread leak in KMSClientProvider. Contributed by Arun Suresh. 
(cherry picked from commit 74d4bfded9)
 2014-12-09 10:47:33 -08:00
Haohui Mai 759179e631 HADOOP-11369. Fix new findbugs warnings in hadoop-mapreduce-client, non-core directories. Contributed by Li Lu. 2014-12-09 10:46:25 -08:00
Haohui Mai 1b8b51704a HADOOP-11367. Fix warnings from findbugs 3.0 in hadoop-streaming. Contributed by Li Lu. 2014-12-09 10:42:17 -08:00
Haohui Mai c9e9f82ec6 HADOOP-10476. Bumping the findbugs version to 3.0.0. Contributed by Haohui Mai. 2014-12-09 10:38:43 -08:00
Steve Loughran 2bc3f1064f HADOOP-10134 [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments. 2014-12-09 11:15:19 +00:00
Steve Loughran a7be36384a HADOOP-11363 Hadoop maven surefire-plugin uses must set heap size. 2014-12-09 11:04:59 +00:00
Haohui Mai e2c1ef4deb HADOOP-11287. Simplify UGI#reloginFromKeytab for Java 7+. Contributed by Li Lu. 2014-12-08 21:10:49 -08:00
Andrew Wang 46a7365164 HADOOP-11329. Add JAVA_LIBRARY_PATH to KMS startup options. Contributed by Arun Suresh. 
(cherry picked from commit ddffcd8fac)
 2014-12-08 13:45:34 -08:00
Jing Zhao 582f96e41d HADOOP-11354. ThrottledInputStream doesn't perform effective throttling. Contributed by Ted Yu. 2014-12-08 11:09:34 -08:00
cnauroth 143a5b67d8 HDFS-7384. getfacl command and getAclStatus output should be in sync. Contributed by Vinayakumar B. 
(cherry picked from commit ffe942b82c)
 2014-12-08 10:28:25 -08:00
Steve Loughran 275561d848 HADOOP-10530 Make hadoop build on Java7+ only (stevel) 2014-12-08 15:30:34 +00:00
cnauroth 308b75571b HADOOP-11313. Adding a document about NativeLibraryChecker. Contributed by Tsuyoshi OZAWA. 
(cherry picked from commit 1b3bb9e7a3)
 2014-12-06 20:12:56 -08:00
Andrew Wang dabdd2d746 HADOOP-11343. Overflow is not properly handled in caclulating final iv for AES CTR. Contributed by Jerry Chen. 
(cherry picked from commit 0707e4eca9)
 2014-12-05 18:20:23 -08:00
Andrew Wang b8e4fffa49 HADOOP-11355. When accessing data in HDFS and the key has been deleted, a Null Pointer Exception is shown. Contributed by Arun Suresh. 
(cherry picked from commit 9cdaec6a6f)
 2014-12-05 12:01:32 -08:00
Haohui Mai 4f612f148b HADOOP-11356. Removed deprecated o.a.h.fs.permission.AccessControlException. Contributed by Li Lu. 2014-12-05 10:50:03 -08:00
Colin Patrick Mccabe a0976152e6 HADOOP-11348. Remove unused variable from CMake error message for finding openssl (Dian Fu via Colin P. McCabe) 
(cherry picked from commit 565b0e60a8)
 2014-12-04 12:54:59 -08:00
Aaron T. Myers 534a021e70 HADOOP-11332. KerberosAuthenticator#doSpnegoSequence should check if kerberos TGT is available in the subject. Contributed by Dian Fu. 
(cherry picked from commit 9d1a8f5897)
 2014-12-03 18:54:26 -08:00
Andrew Wang 696e15f0d1 HADOOP-11342. KMS key ACL should ignore ALL operation for default key ACL and whitelist key ACL. Contributed by Dian Fu. 
(cherry picked from commit 1812241ee1)
 2014-12-03 12:00:29 -08:00
Andrew Wang c962eef533 HADOOP-11344. KMS kms-config.sh sets a default value for the keystore password even in non-ssl setup. Contributed by Arun Suresh. 
(cherry picked from commit 3d48ad7eb4)
 2014-12-02 19:04:33 -08:00
stack 6d904985e8 HADOOP-11301. [optionally] update jmx cache to drop old metrics (Maysam Yabandeh via stack) 
(cherry picked from commit b36f292982)
 2014-12-01 23:08:16 -08:00
stack 76245dfccd Revert "HBASE-11301 [optionally] update jmx cache to drop old metrics (Maysam Yabandeh via stack)" 
This reverts commit fd6a801ddb.

Refers to an HBASE rather than HADOOP issue.
 2014-12-01 23:02:32 -08:00
stack fd6a801ddb HBASE-11301 [optionally] update jmx cache to drop old metrics (Maysam Yabandeh via stack) 
(cherry picked from commit 74f4d8590d)
 2014-12-01 22:55:12 -08:00
Andrew Wang 881c77107e HADOOP-11341. KMS support for whitelist key ACLs. Contributed by Arun Suresh. 
(cherry picked from commit 31b4d2daa1)
 2014-12-01 21:58:21 -08:00
Colin Patrick Mccabe f9c5dec152 CHANGES.txt: add HADOOP-11257 
(cherry picked from commit c1f2bb2d31)
 2014-12-01 21:58:15 -08:00
Andrew Wang 084667aad9 HADOOP-11337. KeyAuthorizationKeyProvider access checks need to be done atomically. Contributed by Dian Fu. 
(cherry picked from commit 9fa2990257)
 2014-12-01 21:22:03 -08:00
Colin Patrick Mccabe f6d1bf5ed1 HADOOP-11333. Fix deadlock in DomainSocketWatcher when the notification pipe is full (zhaoyunjiong via cmccabe) 
(cherry picked from commit 86e3993def)
 2014-12-01 11:48:53 -08:00
Colin Patrick Mccabe 8f98225418 HADOOP-11257. Update "hadoop jar" documentation to warn against using it for launching yarn jars (iwasakims via cmccabe) 2014-11-26 13:42:07 -08:00
Steve Loughran 6a01497d7c HDFS-6803 Document DFSClient#DFSInputStream expectations reading and preading in concurrent context. (stack via stevel) 2014-11-26 11:43:46 +00:00
Andrew Wang 8018d1af58 HADOOP-11173. Improve error messages for some KeyShell commands. 
(cherry picked from commit fae266bbf1)
 2014-11-25 16:13:37 -08:00
Andrew Wang aad16f8f5c HADOOP-11300. KMS startup scripts must not display the keystore / truststore passwords. Contributed by Arun Suresh. 
(cherry picked from commit 56f3eecc12)
 2014-11-25 15:12:09 -08:00
yliu 4b62d6d2fd HADOOP-11322. key based ACL check in KMS always check KeyOpType.MANAGEMENT even actual KeyOpType is not MANAGEMENT. (Dian Fu via yliu) 2014-11-25 01:12:31 +08:00
Colin Patrick Mccabe 4435ac9af5 HDFS-7419. Improve error messages for DataNode hot swap drive feature (Lei Xu via Colin P. Mccabe) 
(cherry picked from commit f636f9d943)
 2014-11-24 10:58:05 -08:00
Karthik Kambatla e0df934ed1 Update release date for 2.5.2 
(cherry picked from commit 1e9a3f42ff)
 2014-11-21 14:34:47 -08:00
Andrew Wang 85bdc3a013 HADOOP-11323. WritableComparator#compare keeps reference to byte array. Contributed by Wilfred Spiegelenburg. 
(cherry picked from commit eb4045e765)
 2014-11-20 11:05:50 -08:00
cnauroth 00a06e28d4 HADOOP-11201. Hadoop Archives should support globs resolving to files. Contributed by Gera Shegalov. 
(cherry picked from commit 79301e80d7)
 2014-11-18 17:10:24 -08:00
Jian He 1412e712b4 YARN-2157. Added YARN metrics in the documentaion. Contributed by Akira AJISAKA 
(cherry picked from commit 90a968d675)
 2014-11-18 16:13:08 -08:00
Andrew Wang 1e14792be6 HADOOP-11312. Fix unit tests to not use uppercase key names. 
(cherry picked from commit bcd402ae38)
 2014-11-18 10:48:10 -08:00
Jason Lowe 5125a8e59e HADOOP-11309. System class pattern package.Foo should match package.Foo$Bar, too. Contributed by Gera Shegalov 
(cherry picked from commit b4ca727690)
 2014-11-18 17:23:37 +00:00
Andrew Wang 541172f2ee HDFS-6982. nntop: top­-like tool for name node users. (Maysam Yabandeh via wang) 
(cherry picked from commit dcb8e24427)
 2014-11-17 17:34:02 -08:00
Andrew Wang 1deefa6cf1 HADOOP-11311. Restrict uppercase key names from being created with JCEKS. 
(cherry picked from commit 48d62fad80)
 2014-11-17 13:59:55 -08:00
Brandon Li 7b2a884077 HDFS-7146. NFS ID/Group lookup requires SSSD enumeration on the server. Contributed by Yongjun Zhang 
(cherry picked from commit 351c5561c2)
 2014-11-17 13:25:43 -08:00
Aaron T. Myers d35eba7b1f HADOOP-11157. ZKDelegationTokenSecretManager never shuts down listenerThreadPool. Contributed by Arun Suresh. 
(cherry picked from commit 07d489e6230682e0553840bb1a0e446acb9f8d19)
 2014-11-17 13:02:59 -08:00
Haohui Mai 6eb88c278c HDFS-7279. Use netty to implement DatanodeWebHdfsMethods. Contributed by Haohui Mai. 2014-11-17 12:56:03 -08:00
cnauroth 72207f65aa HDFS-7386. Replace check "port number < 1024" with shared isPrivilegedPort method. Contributed by Yongjun Zhang. 
(cherry picked from commit 1925e2a4ae)
 2014-11-14 16:46:24 -08:00
Karthik Kambatla 8e524e8d60 HADOOP-11307. create-release script should run git clean first (kasha) 
(cherry picked from commit 4fb96dbe3b)
 2014-11-14 15:37:46 -08:00
Colin Patrick Mccabe 5b90e428a5 Revert HADOOP-11257 because it didn't get a jenkins run yet 2014-11-14 13:06:41 -08:00
Colin Patrick Mccabe 490df57fa2 HADOOP-11257. Update "hadoop jar" documentation to warn against using it for launching yarn jars (iwasakims via cmccabe) 
(cherry picked from commit 10c98aed38)
 2014-11-14 12:56:31 -08:00
Ravi Prakash 45692effe4 MAPREDUCE-5918. LineRecordReader can return the same decompressor to CodecPool multiple times (Sergey Murylev via raviprak) 2014-11-14 03:48:28 -08:00
Arun C. Murthy fc324d7062 Preparing to release hadoop-2.6.0-rc1. 
(cherry picked from commit 9ff7315cbe)
 2014-11-13 13:03:13 -08:00
cnauroth 9c94945fe9 HADOOP-11291. Log the cause of SASL connection failures. Contributed by Stephen Chu. 
(cherry picked from commit 7dae5b5a88)
 2014-11-12 21:54:40 -08:00
cnauroth 69a7780ee5 HADOOP-7984. Add hadoop --loglevel option to change log level. Contributed by Aikira AJISAKA. 2014-11-12 21:44:05 -08:00
Karthik Kambatla 6e64390627 HADOOP-11217. (Addendum to allow SSLv2Hello) Disable SSLv3 in KMS. (Robert Kanter via kasha) 
(cherry picked from commit 87818ef4e7)
 2014-11-12 18:39:21 -08:00
Arun C. Murthy 3ee522abb1 HADOOP-9576. Merging to branch-2.6 for hadoop-2.6.0-rc1. 2014-11-12 09:56:17 -08:00
Jian He 2b125b3a39 HADOOP-9576. Changed NetUtils#wrapException to throw EOFException instead of wrapping it as IOException. Contributed by Steve Loughran 
(cherry picked from commit 86bf8c7193)
 2014-11-10 17:26:12 -08:00
Haohui Mai d47a34fc66 HADOOP-11296. Nfs3FileAttributes should not change the values of rdev, nlink and size in the constructor. Contributed by Brandon Li. 2014-11-10 15:43:16 -08:00
Karthik Kambatla 92de44c2c5 Set the release date for 2.5.2 
(cherry picked from commit 68a0508728)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-11-10 15:23:43 -08:00
Haohui Mai ebb0636c9d HADOOP-11289. Fix typo in RpcUtil log message. Contributed by Charles Lamb. 2014-11-10 11:05:37 -08:00
Arun C. Murthy adfb830a2b Preparing to release hadoop-2.6.0: Set version in branch-2 to 2.7.0-SNAPSHOT. 2014-11-09 19:19:02 -08:00
Arun C. Murthy d827b7a013 Release Notes for hadoop-2.6.0. 2014-11-09 19:15:37 -08:00
Arun C. Murthy cff08dab5e Updated CHANGES.txt to reflect hadoop-2.6.0 release dates. 
(cherry picked from commit 770cc14442)
 2014-11-09 18:48:01 -08:00
Arun C. Murthy e3877e8051 HADOOP-10786. Moved to hadoop-2.7.X. 
(cherry picked from commit 14b87b70a8)
 2014-11-09 18:19:47 -08:00
Haohui Mai 9e63cb4492 HADOOP-10786. Fix UGI#reloginFromKeytab on Java 8. Contributed by Stephen Chu. 2014-11-09 17:48:40 -08:00
Arun C. Murthy 1f5bad04ce HADOOP-11286. Copied LimitInputStream from guava-0.14 to hadoop to avoid issues with newer versions of guava in applications. Contributed by Christopher Tubbs. 
(cherry picked from commit 6caa8100d5)
 2014-11-09 05:23:10 -08:00
Arun C. Murthy 242404b025 HADOOP-10563. Fix bad merge which messed up hadoop-common/CHANGES.txt. 2014-11-09 05:23:05 -08:00
cnauroth 3ef876712c HADOOP-11282. Skip NFS TestShellBasedIdMapping tests that are irrelevant on Windows. Contributed by Chris Nauroth. 
(cherry picked from commit 68db5b3736)
 2014-11-07 14:32:04 -08:00
cnauroth a3496b7e01 HADOOP-11280. TestWinUtils#testChmod fails after removal of NO_PROPAGATE_INHERIT_ACE. Contributed by Chris Nauroth. 
(cherry picked from commit 42bbe3794e)
 2014-11-07 00:04:13 -08:00
Jing Zhao 7a91ea32e1 Revert "HADOOP-11274. ConcurrentModificationException in Configuration Copy Constructor. Contributed by Junping Du." 
This reverts commit 16b3482467.
 2014-11-06 18:30:35 -08:00
Jing Zhao 22ecbd4ab3 HADOOP-11274. ConcurrentModificationException in Configuration Copy Constructor. Contributed by Junping Du. 2014-11-06 17:00:11 -08:00
Jason Lowe c0bbb72912 MAPREDUCE-5960. JobSubmitter's check whether job.jar is local is incorrect with no authority in job jar path. Contributed by Gera Shegalov 
(cherry picked from commit 10f9f5101c)
 2014-11-06 15:12:06 +00:00
Aaron T. Myers d698ed1d6f HADOOP-11187 NameNode - KMS communication fails after a long period of inactivity. Contributed by Arun Suresh. 
(cherry picked from commit d593035d50e9997f31ddd67275b6e68504f9ca3c)
 2014-11-05 18:17:43 -08:00
Aaron T. Myers e96f0c6aae HADOOP-11272. Allow ZKSignerSecretProvider and ZKDelegationTokenSecretManager to use the same curator client. Contributed by Arun Suresh. 
(cherry picked from commit 8a261e68e4)
 2014-11-05 17:47:49 -08:00
Aaron T. Myers 9082fe4e20 HADOOP-10714. AmazonS3Client.deleteObjects() need to be limited to 1000 entries per call. Contributed by Juan Yu. 
(cherry picked from commit 6ba52d88ec)
 2014-11-05 17:24:55 -08:00
Haohui Mai 1857623634 HADOOP-11267. TestSecurityUtil fails when run with JDK8 because of empty principal names. Contributed by Stephen Chu. 2014-11-05 15:25:46 -08:00
Haohui Mai 44f9790247 HADOOP-11266. Remove no longer supported activation properties for packaging from pom. Contributed by Masatake Iwasaki. 2014-11-05 11:15:47 -08:00
cnauroth a339fd3646 HADOOP-11265. Credential and Key Shell Commands not available on Windows. Contributed by Larry McCay. 
(cherry picked from commit a7fbd4e633)
 2014-11-05 08:44:16 -08:00
Vinayakumar B 2d0c56e898 HADOOP-11271. Use Time.monotonicNow() in Shell.java instead of Time.now() (Contributed by Vinayakumar B) 
(cherry picked from commit 8e9502e05d)
 2014-11-05 14:49:19 +05:30
Haohui Mai ab07fef5b7 HADOOP-11269. Add java 8 profile for hadoop-annotations. Contributed by Li Lu. 2014-11-04 18:01:02 -08:00
Haohui Mai fa92b40f09 HADOOP-11230. Add missing dependency of bouncycastle for kms, httpfs, hdfs, MR and YARN. Contributed by Robert Kanter. 2014-11-04 17:53:00 -08:00
Haohui Mai bfcf0c83a2 HADOOP-11268. Update BUILDING.txt to remove the workaround for tools.jar. Contributed by Li Lu. 2014-11-04 17:47:17 -08:00
Karthik Kambatla 6f9484221e Adding release 2.5.2 to CHANGES.txt 
(cherry picked from commit 4de56d27fb)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2014-11-04 16:51:54 -08:00
Karthik Kambatla 395d4ba766 HADOOP-11260. Patch up Jetty to disable SSLv3. (Mike Yoder via kasha) 
(cherry picked from commit dbf30e3c0e)
 2014-11-04 16:22:09 -08:00
Haohui Mai 7e2bdd5255 HADOOP-10717. HttpServer2 should load jsp DTD from local jars instead of going remote. Contributed by Dapeng Sun. 2014-11-04 15:02:25 -08:00
Haohui Mai 06bc026c21 Addendum patch for HADOOP-10563 in branch-2. 2014-11-04 14:54:59 -08:00
Haohui Mai aa09c4c342 HADOOP-10563. Remove the dependency of jsp in trunk. Contributed by Haohui Mai. 2014-11-04 14:52:51 -08:00
Haohui Mai 3bdfd6e58e HADOOP-10847. Remove the usage of sun.security.x509.* in testing code. Contributed by Pascal Oliva. 2014-11-04 10:52:22 -08:00
cnauroth f4ed787669 HADOOP-11165. TestUTF8 fails when run against java 8. Contributed by Stephen Chu. 
(cherry picked from commit 85da71c2d3)
 2014-11-04 10:29:29 -08:00
Kihwal Lee c8648bd27e HADOOP-10987. Provide an iterator-based listing API for FileSystem. Contributed by Kihwal Lee. 2014-11-03 08:23:34 -06:00
Vinod Kumar Vavilapalli 0cbc115704 HADOOP-11254. Changed visibility of AccessControlList to be public for consumption by ecosystem. Contributed by Zhijie Shen. 
(cherry picked from commit b18e8a272e)
 2014-11-01 11:11:04 -07:00
Zhijie Shen e286ae90b7 HADOOP-11241. Fixed intermittent TestNMSimulator failure due to timing issue. Contributed by Varun Vasudev. 
(cherry picked from commit 260ab6d5f4)
 2014-10-31 18:04:05 -07:00
Jian He a87f827ae4 YARN-2770. Added functionality to renew/cancel TimeLineDelegationToken. Contributed by Zhijie Shen 
(cherry picked from commit 1b4be91866)
 2014-10-31 13:17:19 -07:00
Haohui Mai 5e5585a7e0 HADOOP-11253. Hadoop streaming test TestStreamXmlMultipleRecords fails on Windows. Contributed by Varun Vasudev. 2014-10-31 11:54:18 -07:00
cnauroth 57fa43ab0a HDFS-7313. Support optional configuration of AES cipher suite on DataTransferProtocol. Contributed by Chris Nauroth. 
(cherry picked from commit 5573b3476a)
 2014-10-30 22:52:33 -07:00
Brandon Li cc900b213c update CHANGES.txt to move HADOOP-11247 to 2.6 2014-10-30 13:31:40 -07:00
Tsz-Wo Nicholas Sze 2b5baa6714 HADOOP-11221. IdentityHashStore assumes System.identityHashCode() is non-negative. Contributed by Jinghui Wang 2014-10-30 11:00:24 -07:00
Colin Patrick Mccabe e107ea5177 HADOOP-11250. fix endmacro of set_find_shared_library_without_version in CMakeLists (Yi Liu via Colin P. McCabe) 
(cherry picked from commit e488f0d93b)
 2014-10-30 10:38:17 -07:00
yliu 51f621c01c HADOOP-11216. Improve Openssl library finding. (cmccabe via yliu) 2014-10-30 10:38:52 +08:00
Haohui Mai c7d1db7495 HADOOP-11247. Fix a couple javac warnings in NFS. Contributed by Brandon Li. 2014-10-29 17:54:37 -07:00
Jason Lowe 0c15130db2 HADOOP-9740. Fix FsShell '-text' command to be able to read Avro files stored in HDFS and other filesystems. Contributed by Allan Yan 2014-10-29 20:23:17 +00:00
Colin Patrick Mccabe f6102831bc HADOOP-11186: documentation should talk about hadoop.htrace.spanreceiver.classes, not hadoop.trace.spanreceiver.classes (cmccabe) 
(cherry picked from commit c2575fb046)
 2014-10-29 12:14:30 -07:00
cnauroth b4446cb370 HADOOP-11068. Match hadoop.auth cookie format to jetty output. Contributed by Gregory Chanan. 
(cherry picked from commit 5c900b522e)
 2014-10-29 11:21:37 -07:00
Brandon Li 6caf36f9eb HADOOP-11195. Move Id-Name mapping in NFS to the hadoop-common area for better maintenance. Contributed by Yongjun Zhang 
(cherry picked from commit 72a556d3b0)
 2014-10-29 11:06:44 -07:00
Kihwal Lee 45b6dea95f MAPREDUCE-6022. map_input_file is missing from streaming job 
environment. Contributed by Jason Lowe.
(cherry picked from commit b056048114)
 2014-10-29 12:30:08 -05:00
Karthik Kambatla 160aebcae2 HADOOP-11243. SSLFactory shouldn't allow SSLv3. (Wei Yan via kasha) 
(cherry picked from commit 3c5f5af118)
 2014-10-28 18:08:00 -07:00
Karthik Kambatla 0aec884704 HADOOP-11217. Disable SSLv3 in KMS. (Robert Kanter via kasha) 
(cherry picked from commit 1a78082338)
 2014-10-28 17:31:55 -07:00
cnauroth c2790932bd HDFS-7291. Persist in-memory replicas with appropriate unbuffered copy API on POSIX and Windows. Contributed by Xiaoyu Yao. 
(cherry picked from commit c6f04f391b)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-10-28 14:17:35 -07:00
yliu 8b812a35b8 HDFS-6606. Optimize HDFS Encrypted Transport performance. (yliu) 2014-10-28 21:16:34 +08:00
yliu 2e156f01a2 HADOOP-11233. hadoop.security.kms.client.encrypted.key.cache.expiry property spelled wrong in core-default. (Stephen Chu via yliu) 2014-10-28 14:44:13 +08:00
cnauroth 5dbd27f8b4 HDFS-6934. Revert files accidentally committed. 
(cherry picked from commit 5b1dfe78b8)
 2014-10-27 12:15:47 -07:00
cnauroth 3d67da502a HDFS-6934. Move checksum computation off the hot path when writing to RAM disk. Contributed by Chris Nauroth. 
(cherry picked from commit 463aec1171)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java
 2014-10-27 11:50:47 -07:00
Jian He 2d3c64943d YARN-2591. Fixed AHSWebServices to return FORBIDDEN(403) if the request user doesn't have access to the history data. Contributed by Zhijie Shen 
(cherry picked from commit c05b581a55)
 2014-10-27 10:46:37 -07:00
Harsh J c88ac8a738 HADOOP-11236. NFS: Fix javadoc warning in RpcProgram.java. Contributed by Abhiraj Butala. (harsh) 2014-10-27 19:13:50 +05:30
Vinod Kumar Vavilapalli b1e17d2dab HADOOP-11170. Pulling into branch-2.6 also, fixing CHANGES.txt. 
(cherry picked from commit 9ada9284d8)
 2014-10-26 11:26:18 -07:00
Vinod Kumar Vavilapalli 36d3f1fcca YARN-2743. Fixed a bug in ResourceManager that was causing RMDelegationToken identifiers to be tampered and thus causing app submission failures in secure mode. Contributed by Jian He. 
(cherry picked from commit 0186645505)
 2014-10-26 11:15:45 -07:00
Byron Wong d991cd52d8 HADOOP-6857. FsShell should report raw disk usage including replication factor. Contributed by Byron Wong. 2014-10-25 12:39:03 -07:00
Jian He 299c9b456d HADOOP-11228. Winutils task: unsecure path should not call AddNodeManagerAndUserACEsToObject. Contributed by Remus Rusanu 
(cherry picked from commit f7e89bb349)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2014-10-24 12:54:00 -07:00
Colin Patrick Mccabe caa658a015 HDFS-7223. Tracing span description of IPC client is too long (iwasakims via cmccabe) 
(cherry picked from commit 5b56ac4c72)
 2014-10-23 19:15:08 -07:00
Karthik Kambatla c99d89f2c6 HADOOP-11170. ZKDelegationTokenSecretManager fails to renewToken created by a peer. (Arun Suresh and Gregory Chanan via kasha) 
(cherry picked from commit db45f047ab)
 2014-10-23 17:06:36 -07:00
Colin Patrick Mccabe a36fd88671 HDFS-7227. Fix findbugs warning about NP_DEREFERENCE_OF_READLINE_VALUE in SpanReceiverHost (cmccabe) 
(cherry picked from commit 7ab754545d)
 2014-10-23 13:26:10 -07:00
Jian He 1c235a4448 YARN-2198. Remove the need to run NodeManager as privileged account for Windows Secure Container Executor. Contributed by Remus Rusanu 
(cherry picked from commit 3b12fd6cfb)
 2014-10-22 15:58:26 -07:00
Karthik Kambatla b3bb4fdc7c HADOOP-11122. Fix findbugs in ZK DelegationTokenSecretManagers. (Arun Suresh via kasha) 
(cherry picked from commit 70719e5c62)
 2014-10-22 14:33:56 -07:00
Haohui Mai 3476b9630f HADOOP-10748. HttpServer2 should not load JspServlet. Contributed by Haohui Mai. 2014-10-22 14:26:57 -07:00
cnauroth a066134277 YARN-2720. Windows: Wildcard classpath variables not expanded against resources contained in archives. Contributed by Craig Welch. 
(cherry picked from commit 6637e3cf95)
 2014-10-21 12:34:58 -07:00
Brandon Li c800e058ea HDFS-7215.Add JvmPauseMonitor to NFS gateway. Contributed by Brandon Li 
(cherry picked from commit 4e134a02a4)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-10-21 11:55:18 -07:00
Brandon Li 33e020cb19 HDFS-7259. Unresponseive NFS mount point due to deferred COMMIT response. Contributed by Brandon Li 2014-10-21 11:01:27 -07:00
Karthik Kambatla f8e4cec08a HADOOP-11194. Ignore .keep files (kasha) 
(cherry picked from commit d5084b9fa3)
 2014-10-20 11:29:49 -04:00
Vinod Kumar Vavilapalli 5e239640f9 HADOOP-11207. Enhanced common DelegationTokenAuthenticationHandler to support proxy-users on Delegation-token management operations. Contributed by Zhijie Shen. 
(cherry picked from commit 1137557816)
 2014-10-17 15:57:08 -07:00
arp 0ee251ea26 HDFS-6921. Add LazyPersist flag to FileStatus. (Arpit Agarwal) 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocol/HdfsFileStatus.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocol/HdfsLocatedFileStatus.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/JsonUtil.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/proto/hdfs.proto
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFsck.java
 2014-10-17 13:42:04 -07:00
cnauroth a181daf458 HDFS-7090. Use unbuffered writes when persisting in-memory replicas. Contributed by Xiaoyu Yao. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-10-17 13:42:03 -07:00
arp 6916d41fe6 HDFS-7159. Use block storage policy to set lazy persist preference. (Arpit Agarwal) 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES-HDFS-6581.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockStoragePolicySuite.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLogLoader.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImageFormat.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImageFormatPBINode.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeFile.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeFileAttributes.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeLayoutVersion.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/snapshot/FSImageFormatPBSnapshot.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/JsonUtil.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFsck.java
 2014-10-17 13:42:03 -07:00
arp e4ef0023b8 HDFS-7079. Few more unit test fixes for HDFS-6581. (Arpit Agarwal) 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES-HDFS-6581.txt
 2014-10-17 13:42:02 -07:00
arp 5f86ce7ea9 HDFS-7064. Fix unit test failures in HDFS-6581 branch. (Contributed by Xiaoyu Yao) 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES-HDFS-6581.txt
 2014-10-17 13:42:02 -07:00
arp 08cc08adb3 HDFS-6928. 'hdfs put' command should accept lazyPersist flag for testing. (Arpit Agarwal) 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES-HDFS-6581.txt
 2014-10-17 13:42:01 -07:00
Ravi Prakash a85767f376 HADOOP-11182. GraphiteSink emits wrong timestamps (Sascha Coenen via raviprak) Fix CHANGES.txt 2014-10-16 16:53:38 -07:00
Ravi Prakash 08eeb3e5b6 HADOOP-11181. GraphiteSink emits wrong timestamps (Sascha Coenen via raviprak) 
(cherry picked from commit 466f08792f)
 2014-10-15 15:52:46 -07:00
Zhijie Shen bec165e163 YARN-2656. Made RM web services authentication filter support proxy user. Contributed by Varun Vasudev and Zhijie Shen. 
(cherry picked from commit 1220bb72d4)
 2014-10-14 21:56:44 -07:00
Zhijie Shen 8aeda20b25 HADOOP-11181. Generalized o.a.h.s.t.d.DelegationTokenManager to handle all sub-classes of AbstractDelegationTokenIdentifier. Contributed by Zhijie Shen. 
(cherry picked from commit cdce88376a)
 2014-10-14 11:37:28 -07:00
Haohui Mai 262fef119e HADOOP-11198. Fix typo in javadoc for FileSystem#listStatus(). Contributed by Li Lu. 2014-10-13 20:43:17 -07:00
Aaron T. Myers f3132eee10 HADOOP-11176. KMSClientProvider authentication fails when both currentUgi and loginUgi are a proxied user. Contributed by Arun Suresh. 
(cherry picked from commit 0e57aa3bf6)
 2014-10-13 18:10:23 -07:00
Karthik Kambatla 88455173e8 YARN-2566. DefaultContainerExecutor should pick a working directory randomly. (Zhihai Xu via kasha) 
(cherry picked from commit cc93e7e683)
 2014-10-13 16:32:42 -07:00
Haohui Mai 16710758f1 HADOOP-11193. Fix uninitialized variables in NativeIO.c. Contributed by Xiaoyu Yao. 2014-10-10 23:02:41 -07:00
Haohui Mai f11c8eb096 HDFS-6252. Phase out the old web UI in HDFS. Contributed by Haohui Mai. 2014-10-10 17:10:54 -07:00
Andrew Wang 217c0405d9 HDFS-7209. Populate EDEK cache when creating encryption zone. (Yi Liu via wang) 
(cherry picked from commit d3d3d47202)
 2014-10-10 13:40:53 -07:00
Colin Patrick Mccabe 4c0bc45978 HDFS-7198. Fix "unchecked conversion" warning in DFSClient#getPathTraceScope (cmccabe) 
(cherry picked from commit 1ceb326933)
 2014-10-10 13:04:16 -07:00
Aaron T. Myers 8cbacb37e9 HDFS-7026. Introduce a string constant for "Failed to obtain user group info...". Contributed by Yongjun Zhang. 
(cherry picked from commit cbd21fd13b)
 2014-10-09 18:53:03 -07:00
Colin Patrick Mccabe 8addbe2b8e HADOOP-11184. Update Hadoop's lz4 to r123 (cmccabe) 
(cherry picked from commit d8d628d1e0)
 2014-10-09 17:12:24 -07:00
Andrew Wang 6cc8ec980c HADOOP-11174. Delegation token for KMS should only be got once if it already exists. (Yi Liu via wang) 
(cherry picked from commit 8d94114495)
 2014-10-09 13:21:32 -07:00
Andrew Wang 971eb31d28 HADOOP-11178. Fix findbugs exclude file. (Arun Suresh via wang) 
(cherry picked from commit d7b647f0ee)
 2014-10-09 11:58:51 -07:00
cnauroth 4e544c84e9 HDFS-7195. Update user doc of secure mode about Datanodes don't require root or jsvc. Contributed by Chris Nauroth. 2014-10-09 11:55:59 -07:00
cnauroth 5af4c021cc HADOOP-11175. Fix several issues of hadoop security configuration in user doc. Contributed by Yi Liu. 
(cherry picked from commit 1123a06e36)
 2014-10-09 11:11:13 -07:00
Uma Maheswara Rao G 7d63b4f273 HADOOP-11133. Should trim the content of keystore password file for JavaKeyStoreProvider (Yi Liu via umamahesh) 
(cherry picked from commit 8d7c54967d)
 2014-10-09 20:20:27 +05:30
Aaron T. Myers afaadd6535 HADOOP-11161. Expose close method in KeyProvider to give clients of Provider implementations a hook to release resources. Contribued by Arun Suresh. 
(cherry picked from commit d9556e873ef4d3e68c4f0c991f856d1faa747f07)
 2014-10-08 18:02:00 -07:00
Colin Patrick Mccabe f1feaae1dd HDFS-7202. Should be able to omit package name of SpanReceiver on "hadoop trace -add" (iwasakims via cmccabe) 
(cherry picked from commit d996235285)
 2014-10-08 18:01:22 -07:00
Zhijie Shen f27a88562e HADOOP-11179. Java untar should handle the case that the file entry comes without its parent directory entry. Contributed by Craig Welch. 
(cherry picked from commit a169051931)
 2014-10-08 15:37:57 -07:00
Colin Patrick Mccabe 19c307f36a CHANGES.txt: move HADOOP-10404 underneath branch 2.6 2014-10-08 14:01:50 -07:00
Andrew Wang d9aa0f8333 HADOOP-11166. Remove ulimit from test-patch.sh. 
(cherry picked from commit 60f0f6fcde)
 2014-10-07 17:30:16 -07:00
Andrew Wang 6546c59745 Fixup for CHANGES.txt 
(cherry picked from commit 0263656247)
 2014-10-07 14:59:17 -07:00
Andrew Wang 52c8ac90ea HADOOP-11172. Improve error message in Shell#runCommand on OutOfMemoryError. (Yongjun Zhang via wang) 
(cherry picked from commit 4b2834898c)
 2014-10-07 14:57:09 -07:00
Andrew Wang 3e897da5fc HADOOP-11169. Fix DelegationTokenAuthenticatedURL to pass the connection Configurator to the authenticator. (Arun Suresh via wang) 
(cherry picked from commit b2f6197523)
 2014-10-07 14:47:14 -07:00
Kihwal Lee 7910c6d035 HADOOP-11007. Reinstate building of ant tasks support. Contributed by 
Jason Lowe.
(cherry picked from commit 99d7a452be)
 2014-10-07 16:23:52 -05:00
Colin Patrick Mccabe 2a8f824fb7 HDFS-7186. Document the "hadoop trace" command. (Masatake Iwasaki via Colin P. McCabe) 
(cherry picked from commit 9196db9a08)
 2014-10-07 11:57:09 -07:00
Haohui Mai 70c8cb5614 HADOOP-11168. Remove duplicated entry dfs.webhdfs.enabled in the user doc. Contributed by Yi Liu. 2014-10-06 22:07:29 -06:00
Colin Patrick Mccabe b5158c8d24 HADOOP-10404. Commit correct version of patch (cmccabe) 
(cherry picked from commit 687d83c9e1)
 2014-10-06 14:45:04 -07:00
Colin Patrick Mccabe c97134d054 HADOOP-10404. Some accesses to DomainSocketWatcher#closed are not protected by the lock (cmccabe) 
(cherry picked from commit 8099de259f)
 2014-10-06 14:41:14 -07:00
Arun C. Murthy c5828c624f HADOOP-10731. Sync-ing CHANGES.txt across branches. 2014-10-05 07:51:27 -07:00
Arun C. Murthy 7dd508b880 HADOOP-10681. Remove unnecessary synchronization from Snappy & Zlib codecs. Contributed by Gopal Vijayaraghavan. 
(cherry picked from commit 8f9ab998e2)
 2014-10-05 07:42:10 -07:00
cnauroth 1329d1e701 HADOOP-11163. Correct CHANGES.txt. 
(cherry picked from commit bbb3b1acc0)
 2014-10-03 21:07:40 -07:00
cnauroth a828ef15b0 HADOOP-11163. MetricsSystemImpl may miss a registered source. Contributed by Chuan Liu. 
(cherry picked from commit 69c9af9103)
 2014-10-03 21:05:05 -07:00
Colin Patrick Mccabe b335df9a9b HDFS-7055. Add tracing to DFSInputStream (cmccabe) 
(cherry picked from commit 7f6ed7fe36)
 2014-10-03 13:38:15 -07:00
Andrew Wang 9ebff016c2 HADOOP-11151. Automatically refresh auth token and retry on auth failure. Contributed by Arun Suresh. 
(cherry picked from commit 2d8e6e2c4a)
 2014-10-02 19:59:56 -07:00
Haohui Mai ebeb9da80c HADOOP-11160. Fix typo in nfs3 server duplicate entry reporting. Contributed by Charles Lamb. 2014-10-02 14:08:01 -07:00
Andrew Wang 6dbba19469 HDFS-7181. Remove incorrect precondition check on key length in FileEncryptionInfo. (wang) 
(cherry picked from commit 6ac10516e7)
 2014-10-02 13:54:56 -07:00
Haohui Mai 63ad22be48 HDFS-6894. Add XDR parser method for each NFS response. Contributed by Brandon Li. 2014-10-01 13:19:05 -07:00
Vinod Kumar Vavilapalli 64bed0460e YARN-1063. Augmented Hadoop common winutils to have the ability to create containers as domain users. Contributed by Remus Rusanu. 
Committed as a YARN patch even though all the code changes are in common.

(cherry picked from commit 5ca97f1e60)
 2014-10-01 09:55:57 -07:00