Commit Graph

2899 Commits

Author SHA1 Message Date
Colin Patrick Mccabe 56ab796094 HDFS-9835. OIV: add ReverseXML processor which reconstructs an fsimage from an XML file (cmccabe)
(cherry picked from commit 700b0e4019)
(cherry picked from commit 5998b20d63)
2016-03-09 16:38:15 -08:00
Allen Wittenauer 8b4a8ff1b2 Revert "HADOOP-12366. expose calculated paths (aw)"
This reverts commit 81a7ad45c9.
2016-03-09 09:59:33 -08:00
Arpit Agarwal 0f15eb6a40 HADOOP-12903. IPC Server should allow suppressing exception logging by type, not log 'server too busy' messages. (Arpit Agarwal) 2016-03-08 23:30:52 -08:00
Akira Ajisaka 65769fbf3c HADOOP-12688. Fix deadlinks in Compatibility.md. Contributed by Gabor Liptak.
(cherry picked from commit 4cbefafcac4e7b20a23b7b416af1a2efe71e1080)
(cherry picked from commit 0d8ad99e0d)
2016-03-09 15:33:25 +09:00
Chris Nauroth a3cd43990c HADOOP-12905. Clean up CHANGES.txt RAT exclusions from pom.xml files. Contributed by Chris Nauroth.
(cherry picked from commit 89b16d27e2)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/pom.xml
	hadoop-mapreduce-project/pom.xml

(cherry picked from commit 38a031ce68)
2016-03-08 21:23:07 -08:00
Akira Ajisaka 2acd4c3bd2 HADOOP-12860. Expand section "Data Encryption on HTTP" in SecureMode documentation. Contributed by Wei-Chiu Chuang.
(cherry picked from commit f86850b544)
(cherry picked from commit 0586386472)
2016-03-08 14:30:01 +09:00
Arpit Agarwal a63f1039f9 HDFS-9882. Add heartbeatsTotal in Datanode metrics. (Contributed by Hua Liu) 2016-03-07 21:10:42 -08:00
Ming Ma 47f884e06a HADOOP-12789. log classpath of ApplicationClassLoader at INFO level. (Sangjin Lee via mingma)
(cherry picked from commit 49eedc7ff0)
2016-03-07 20:32:32 -08:00
Andrew Wang 352d5a7e88 HADOOP-12901. Add warning log when KMSClientProvider cannot create a connection to the KMS server. (Xiao Chen via wang)
(cherry picked from commit 391da36d93)
(cherry picked from commit fed2339e28)
2016-03-07 14:00:15 -08:00
Chris Nauroth d5134dadbc HDFS-9239. DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness. Contributed by Chris Nauroth.
(cherry picked from commit 2759689d7d)
(cherry picked from commit 592f161e13)
2016-03-04 15:30:37 -08:00
Masatake Iwasaki 9d551a3adf HADOOP-12470. In-page TOC of documentation should be automatically generated by doxia macro (iwasakims)
(cherry picked from commit cbd31328a6)

 Conflicts:
	hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md
	hadoop-common-project/hadoop-common/src/site/markdown/UnixShellGuide.md

(cherry picked from commit 722182fdfb)
2016-03-04 14:13:30 +09:00
Andrew Wang c6e37f6782 HADOOP-11792. Remove all of the CHANGES.txt files. 2016-03-03 21:03:13 -08:00
Allen Wittenauer a9f041d694 HADOOP-12651. Replace dev-support with wrappers to Yetus (aw)
(cherry picked from commit 8cecad2d56)

 Conflicts:
	dev-support/test-patch.sh
	hadoop-common-project/hadoop-common/pom.xml

(cherry picked from commit b0d3b0c1f8)
2016-03-03 20:58:56 -08:00
Akira Ajisaka 833d84ab58 HADOOP-12872. Fix formatting in ServiceLevelAuth.md. Contributed by Brahma Reddy Battula.
(cherry picked from commit 0a9f00af5e)
(cherry picked from commit 899715a15e)
2016-03-03 23:33:01 +09:00
Akira Ajisaka b4710b5052 HADOOP-12871. Fix dead link to NativeLibraries.html in CommandsManual.md. Contributed by Brahma Reddy Battula.
(cherry picked from commit 1c3136cbd8)
(cherry picked from commit 96a0939d5b)
2016-03-03 23:23:27 +09:00
Akira Ajisaka 85a62dcb5b HADOOP-12870. Fix typo admininistration in CommandsManual.md. Contributed by John Zhuge.
(cherry picked from commit eb864d35d6)
(cherry picked from commit 9e87f59dea)
2016-03-03 18:52:05 +09:00
Masatake Iwasaki 64213b5278 HADOOP-12793. Write a new group mapping service guide (Wei-Chiu Chuang via iwasakims)
(cherry picked from commit f70e317ccc)
2016-03-03 17:15:09 +09:00
Chris Nauroth f563c53535 HADOOP-12853. Change WASB documentation regarding page blob support. Contributed by Madhumita Chakraborty.
(cherry picked from commit f98dff329b)
(cherry picked from commit bce33b5179)
2016-03-01 13:19:03 -08:00
Akira Ajisaka aa896c767c HADOOP-12843. Fix findbugs warnings in hadoop-common (branch-2). (aajisaka)
(cherry picked from commit 67e8489ac6)
2016-03-02 00:22:29 +09:00
Chris Nauroth f1236c5d7c HADOOP-12851. S3AFileSystem Uptake of ProviderUtils.excludeIncompatibleCredentialProviders. Contributed by Larry McCay.
(cherry picked from commit d251e55415)
(cherry picked from commit e402371b6a)
2016-02-29 22:00:41 -08:00
Jian He 07623aa941 HADOOP-12622. Improve the loggings in RetryPolicies and RetryInvocationHandler. Contributed by Junping Du
(cherry picked from commit d8f390d015)
2016-02-29 16:25:00 -08:00
Haohui Mai 69b195d619 HADOOP-12813. Migrate TestRPC and related codes to rebase on ProtobufRpcEngine. Contributed by Kai Zheng. 2016-02-29 14:15:25 -08:00
Masatake Iwasaki c7824e8e9e HADOOP-12552. Fix undeclared/unused dependency to httpclient (iwasakims)
(cherry picked from commit 809ebc0b14)
2016-02-29 18:26:09 +09:00
Suresh Srinivas 2cb1fd3bd3 HADOOP-9121. InodeTree.java has redundant check for vName while throwing exception. Contributed by Arup Malakar.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418005 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit a5331eeead)
(cherry picked from commit fca24fbbaa)
2016-02-29 11:36:18 +09:00
Chris Nauroth 60611c9c75 HADOOP-12846. Credential Provider Recursive Dependencies. Contributed by Larry McCay.
(cherry picked from commit 7634d404b7)
(cherry picked from commit 2e761dabd8)
2016-02-28 11:23:09 -08:00
Li Lu 8324199e5c HADOOP-12831. LocalFS/FSOutputSummer NPEs in constructor if bytes per checksum set to 0 (Mingliang Liu via gtcarrera9)
(cherry-picked from commit 7545ce6636)
2016-02-27 22:04:23 -08:00
Steve Loughran 6218008591 HADOOP-12825. Log slow name resolutions. (Sidharta Seethana via stevel) 2016-02-27 20:05:35 +00:00
Chris Nauroth d55863de0f HADOOP-12849. TestSymlinkLocalFSFileSystem fails intermittently. Contributed by Mingliang Liu.
(cherry picked from commit 798babf661)
(cherry picked from commit c692d7c52f)
2016-02-26 21:59:20 -08:00
Suresh Srinivas cf8bcc73c2 HADOOP-8818. Use equals instead == in MD5MD5CRC32FileChecksum and TFileDumper. Contributed by Brandon Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1385374 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 0c53ed4cd1)
(cherry picked from commit 7b64e5805747f7be8ad1b8cbcefc7a312350a199)
2016-02-27 01:26:31 +09:00
Masatake Iwasaki 7140a02122 HADOOP-12711. Remove dependency on commons-httpclient for ServletUtil (Wei-Chiu Chuang via iwasakims)
(cherry picked from commit b0091338f2)
2016-02-26 15:33:21 +09:00
Xiaoyu Yao 6e9a4c598d HADOOP-12824. Collect network and disk usage on the node running Windows. Contributed by Inigo Goiri. 2016-02-25 15:49:26 -08:00
cnauroth d4bbdd9d28 HADOOP-12716. KerberosAuthenticator#doSpnegoSequence use incorrect class to determine isKeyTab in JDK8. Contributed by Xiaoyu Yao.
(cherry picked from commit d6b181c6fa)
(cherry picked from commit ef9131fbcddc01a9d8cb3dfd0a729ed9d17d788e)
2016-02-24 13:56:12 -08:00
cnauroth 8ad907f06a HADOOP-12535. Run FileSystem contract tests with hadoop-azure. Contributed by Madhumita Chakraborty.
(cherry picked from commit 3369a4f691)
(cherry picked from commit 9ea19a861f)
2016-02-23 21:38:01 -08:00
cnauroth 606547dbd2 HADOOP-12555. WASB to read credentials from a credential provider. Contributed by Larry McCay.
(cherry picked from commit 27b77751c1)
(cherry picked from commit a5511debdb)
2016-02-22 17:30:53 -08:00
Zhe Zhang 6d4a4e785b HADOOP-12668. Support excluding weak Ciphers in HttpServer2 through ssl-server.conf. Contributed by Vijay Singh.
Change-Id: Ie46a5427d29188935427f67e55203c19fcd83335
2016-02-22 14:15:11 -08:00
cnauroth 746d669847 HADOOP-11613. Remove commons-httpclient dependency from hadoop-azure. Contributed by Masatake Iwasaki.
(cherry picked from commit d4f5fc23b2)
(cherry picked from commit 3f14eed580)
2016-02-22 13:39:57 -08:00
Junping Du e3ed99cfe0 Support additional compression levels for GzipCodec. Contributed by Ravi Mutyala.
(cherry picked from commit 18f9b77a32)
(cherry picked from commit e38c2ef6c5)
(cherry picked from commit 78a4c34894)
2016-02-19 14:34:56 -08:00
Yongjun Zhang 62ba1e415a HADOOP-12828. Print user when services are started. (Wei-Chiu Chuang via Yongjun Zhang)
(cherry picked from commit a963baba10)
2016-02-19 09:58:09 -08:00
cnauroth 49602ef580 HADOOP-11031. Design Document for Credential Provider API. Contributed by Larry McCay.
(cherry picked from commit 8ab7658025)
(cherry picked from commit b4c4f30fa4)
2016-02-18 14:07:15 -08:00
Tsz-Wo Nicholas Sze 207ed9601f HADOOP-10865. Add a Crc32 chunked verification benchmark for both directly and non-directly buffer cases. 2016-02-18 11:59:58 -08:00
cnauroth e5c8a34446 HDFS-9711. Integrate CSRF prevention filter in WebHDFS. Contributed by Chris Nauroth.
(cherry picked from commit 5d1889a66d)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/web/DatanodeHttpServer.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java

(cherry picked from commit 779a69e28d)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
2016-02-18 10:16:06 -08:00
cnauroth 2e047429be HADOOP-12691. Move files to correct location.
(cherry picked from commit da77f423d1)
(cherry picked from commit 2b9ea68ef8)
2016-02-18 10:15:31 -08:00
Xiaoyu Yao 5ff2012f64 HDFS-8855. Webhdfs client leaks active NameNode connections. Contributed by Xiaobing Zhou.
(cherry picked from commit fe5624b85d)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/web/DatanodeHttpServer.java

(cherry picked from commit ad4fcd1f9f)
2016-02-17 16:05:24 -08:00
Zhe Zhang 64d39b83cc HDFS-9799. Reimplement getCurrentTrashDir to remove incompatibility. (zhz)
Change-Id: I7834bcebffed38cb384db5395ddb8b6dd9e79a0b
2016-02-17 13:32:18 -08:00
cnauroth 26ce37a1a6 HADOOP-12548. Read s3a creds from a Credential Provider. Contributed by Larry McCay.
(cherry picked from commit 76fab26c5c)

Conflicts:
	hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java

(cherry picked from commit 6731bb468d)
2016-02-17 12:20:49 -08:00
Xiaoyu Yao 5953421544 HADOOP-12878. KMS SPNEGO sequence does not work with WEBHDFS. Contributed by Xiaoyu Yao.
(cherry picked from commit fd1befb6ba)
2016-02-17 08:47:30 -08:00
Vinayakumar B e88c01fa58 HADOOP-12810. FileSystem#listLocatedStatus causes unnecessary RPC calls (Contributed by Ryan Blue)
(cherry picked from commit 96ea309431)
(cherry picked from commit 2bf5a005fa)
2016-02-17 10:15:43 +05:30
Vinayakumar B 8d6fb15b03 HADOOP-12805. Annotate CanUnbuffer with @InterfaceAudience.Public (Contributed by Ted Yu)
(cherry picked from commit 4b0e59fdc0)
(cherry picked from commit e79a5e4460)
2016-02-16 17:33:44 +05:30
Akira Ajisaka bb02c3c803 HADOOP-12786. "hadoop key" command usage is not documented. Contributed by Xiao Chen.
(cherry picked from commit 1c48e50ce7)
(cherry picked from commit a670165bbd)
2016-02-15 11:39:09 +09:00
Junping Du aed60ae0bf Set the release date for 2.6.4.
(cherry picked from commit ec12ce8f48)
(cherry picked from commit a28be9edc7)

Conflicts:

	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2016-02-13 01:48:50 -08:00
Masatake Iwasaki e0fccc9c94 HADOOP-12589. Fix intermittent test failure of TestCopyPreserveFlag (iwasakims)
(cherry picked from commit 36ba5cac37)
2016-02-13 15:02:15 +09:00
cnauroth b846401307 HADOOP-12780. During WASB atomic rename handle crash when one directory has been renamed but not file under it. Contributed by Madhumita Chakraborty.
(cherry picked from commit 91a96eaa53)
(cherry picked from commit ac5a793590)
2016-02-12 15:50:28 -08:00
Arpit Agarwal 8c1cf718aa HDFS-9801. ReconfigurableBase should update the cached configuration. (Arpit Agarwal) 2016-02-12 12:41:20 -08:00
Vinayakumar B 26934cf6c7 HADOOP-12776. Remove getaclstatus call for non-acl commands in getfacl. (Contributed by Brahma Reddy Battula)
(cherry picked from commit c78740a979)
(cherry picked from commit 488e6cbe16)
2016-02-12 11:56:00 +05:30
Andrew Wang 9afa321fd2 HADOOP-12699. TestKMS#testKMSProvider intermittently fails during 'test rollover draining'. Contributed by Xiao Chen.
(cherry picked from commit 8fdef0bd9d)
(cherry picked from commit fb57c01eaa)
2016-02-11 17:21:55 -08:00
cnauroth ddd82d24be HADOOP-12795. KMS does not log detailed stack trace for unexpected errors. Contributed by Chris Nauroth.
(cherry picked from commit 70c756d35e)
(cherry picked from commit 25dcb88630)
2016-02-11 16:53:21 -08:00
Zhe Zhang 66a19d675e Add HADOOP-12764 to CHANGES.txt.
Change-Id: Ie32b71b7bd8892a3bb434aec12cdf2c43c61b897
2016-02-11 09:35:06 -08:00
Uma Maheswara Rao G 4324a3d012 HADOOP-12788. OpensslAesCtrCryptoCodec should log which random number generator is used. Contributed by Wei-Chiu Chuang.
(cherry picked from commit df4dcd3e75)
2016-02-10 15:07:33 -08:00
Jason Lowe cad1436570 HADOOP-12792. TestUserGroupInformation#testGetServerSideGroups fails in chroot. Contributed by Eric Badger
(cherry picked from commit 6f03959e4d)
2016-02-10 21:55:53 +00:00
Sangjin Lee 13bb016ba9 HADOOP-12773. HBase classes fail to load with client/job classloader enabled (sjlee)
(cherry picked from commit 58acbf940a)
2016-02-08 13:59:10 -08:00
cnauroth 44c6277d01 HADOOP-12752. Improve diagnostics/use of envvar/sysprop credential propagation. Contributed by Steve Loughran.
(cherry picked from commit cf3261570a)
(cherry picked from commit a76611d4ec)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2016-02-08 09:36:58 -08:00
Steve Loughran f4bcc76df6 HADOOP-12292. Make use of DeleteObjects optional. (Thomas Demoor via stevel) 2016-02-06 18:17:30 +00:00
cnauroth be115634f2 HADOOP-12426. Add Entry point for Kerberos health check. Contributed by Steve Loughran.
(cherry picked from commit cfa8513890)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/conf/hadoop-env.sh

(cherry picked from commit 4db6cc44cd)
2016-02-05 15:52:26 -08:00
cnauroth e01d8393b6 HADOOP-12758. Extend CSRF Filter with UserAgent Checks. Contributed by Larry McCay.
(cherry picked from commit a37e423e84)
(cherry picked from commit 5752df2362)
2016-02-05 14:38:40 -08:00
Kihwal Lee 150240cce0 HADOOP-12772. NetworkTopologyWithNodeGroup.getNodeGroup() can loop infinitely for invalid 'loc' values. Contributed by Kuhu Shukla.
(cherry picked from commit 49e176c29f)
2016-02-05 15:48:32 -06:00
Colin Patrick Mccabe 4fb2a098f4 HADOOP-12766. The default value of "hadoop.workaround.non.threadsafe.getpwuid" is different between core-default.xml and NativeIO.java (Akira AJISAKA via cmccabe)
(cherry picked from commit 9086dd58c3)
(cherry picked from commit 86760c0f52)
2016-02-05 10:58:39 -08:00
Xiaoyu Yao 740a1385d2 HADOOP-12771. Fix typo in JvmPauseMonitor#getNumGcWarnThreadholdExceeded. Contributed by Xiaobing Zhou.
(cherry picked from commit 5d00067ca7)
2016-02-05 10:41:02 -08:00
Xuan acd90c6819 YARN-4662. Document some newly added metrics. Contributed by Jian He
(cherry picked from commit 63c63e298c)
(cherry picked from commit dfad608b22)
2016-02-03 20:06:57 -08:00
Sangjin Lee b49ac969bc HADOOP-12761. incremental maven build is not really incremental (sjlee)
(cherry picked from commit 4dc0a39493)
2016-02-03 09:02:02 -08:00
Junping Du 847158811b Adding release 2.6.5 to CHANGES.txt 2016-02-02 18:36:39 -08:00
Andrew Wang 1d15c90233 HADOOP-12755. Fix typo in defaultFS warning message.
(cherry picked from commit 8171874dd1)
(cherry picked from commit b4ad58796b)
2016-02-02 11:57:00 -08:00
Colin Patrick Mccabe bc00b8ce9e HADOOP-12735. core-default.xml misspells hadoop.workaround.non.threadsafe.getpwuid (Ray Chiang via cmccabe)
(cherry picked from commit 2e8ab3d465)
(cherry picked from commit b94fbdf6f0)
2016-01-27 11:40:59 -08:00
Yongjun Zhang 62206dd2ed HADOOP-12718. Incorrect error message by fs -put local dir without permission. (John Zhuge via Yongjun Zhang)
(cherry picked from commit 97056c3355)
2016-01-27 08:05:33 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) 3efc72ccd5 Release process for 2.7.2: Set the release date for 2.7.2
(cherry picked from commit ec4d2d9f40)
2016-01-25 15:47:39 -08:00
Walter Su 26673b312d HADOOP-12715. TestValueQueue#testgetAtMostPolicyALL fails intermittently. Contributed by Xiao Chen.
(cherry picked from commit 6eacdea0e4)
2016-01-25 19:43:21 +08:00
Akira Ajisaka c25ab5814c HADOOP-12736. TestTimedOutTestsListener#testThreadDumpAndDeadlocks sometimes times out. Contributed by Xiao Chen.
(cherry picked from commit 643227927a)
(cherry picked from commit 38ec290455)
2016-01-25 14:00:03 +09:00
Akira Ajisaka d228bf1de3 HADOOP-12731. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta.
(cherry picked from commit 736eb17a79)
(cherry picked from commit 4edd7bd820)
2016-01-25 13:48:46 +09:00
Kihwal Lee 330876689b HDFS-8898. Create API and command-line argument to get quota and quota usage without detailed content summary. Contributed by Ming Ma.
(cherry picked from commit b5db1d4410)
2016-01-22 09:20:39 -06:00
Akira Ajisaka 2097016ab1 HADOOP-12730. Hadoop streaming -mapper and -reducer options are wrongly documented as required. Contributed by Kengo Seki.
(cherry picked from commit 0bae506c22)
(cherry picked from commit 6368d102b9)
2016-01-22 21:09:23 +09:00
Xiaoyu Yao 67f711edba HADOOP-12659. Incorrect usage of config parameters in token manager of KMS. Contributed by Mingliang Liu.
(cherry picked from commit f3427d3766)
2016-01-21 13:56:09 -08:00
Akira Ajisaka 68509ae839 HADOOP-7161. Remove unnecessary oro package from dependency management section. Contributed by Sean Busbey.
(cherry picked from commit 2ac39ca762)
(cherry picked from commit cd5c66b080)
2016-01-22 02:46:04 +09:00
Vinayakumar B a02fab85ee HADOOP-12423. Handle failure of registering shutdownhook by ShutdownHookManager in static block (Contributed by Abhishek Agarwal)
(cherry picked from commit 446987e20a)
(cherry picked from commit c13929b385)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2016-01-21 20:14:31 +05:30
Colin Patrick Mccabe de5175d216 HADOOP-12712. Fix some cmake plugin and native build warnings (cmccabe)
(cherry picked from commit b2c155f810)

 Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-maven-plugins/src/main/java/org/apache/hadoop/maven/plugin/cmakebuilder/CompileMojo.java
	hadoop-maven-plugins/src/main/java/org/apache/hadoop/maven/plugin/cmakebuilder/TestMojo.java
	hadoop-maven-plugins/src/main/java/org/apache/hadoop/maven/plugin/util/Exec.java
2016-01-21 16:04:05 +05:30
Lei Xu b4b5468152 HDFS-9655. NN should start JVM pause monitor before loading fsimage. (John Zhuge via Lei (Eddy) Xu)
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNode.java
2016-01-20 14:35:59 -08:00
Ravi Prakash a359dc87d4 HADOOP-12696. Add tests for S3FileSystem Contract. Contributed by Matt Paduano
(cherry picked from commit 1acc509b45)
(cherry picked from commit 2cbb8bbd72)
2016-01-19 14:01:51 -08:00
Wangda Tan 5dc2e78c97 HADOOP-12356. Fix computing CPU usage statistics on Windows. (Inigo Goiri via wangda)
(cherry picked from commit 89d1fd5dac)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2016-01-19 21:31:35 +08:00
Akira Ajisaka ca22066582 HDFS-9623. Update example configuration of block state change log in log4j.properties. Contributed by Masatake Iwasaki.
(cherry picked from commit 92c5f565fd)
(cherry picked from commit 3a8d372518)
2016-01-19 13:32:54 +09:00
cnauroth ffc0d98886 HADOOP-12635. Adding Append API support for WASB. Contributed by Dushyanth.
(cherry picked from commit 8bc93db2e7)
(cherry picked from commit 62d6166211)
2016-01-18 09:13:31 -08:00
cnauroth 23d729f841 HADOOP-12691. Add CSRF Filter for REST APIs to Hadoop Common. Contributed by Larry McCay.
(cherry picked from commit 06f4ac0ccd)
(cherry picked from commit 9600736d89)
2016-01-18 09:09:56 -08:00
Ravi Prakash 5468c40fe7 HADOOP-12689. S3 filesystem operations stopped working correctly
(cherry picked from commit 2d16f40dab)
(cherry picked from commit 6330683778)
2016-01-15 15:19:15 -08:00
Akira Ajisaka 8a23379283 HADOOP-12700. Remove unused import in TestCompressorDecompressor.java. Contributed by John Zhuge.
(cherry picked from commit f977366d9522ee31080e16db90972729fcfe256f)
(cherry picked from commit f0b1b53173)
2016-01-15 10:58:20 +09:00
Akira Ajisaka 91c1736b7a Correct the section of HADOOP-12590 in CHANGES.txt. 2016-01-15 10:53:16 +09:00
Steve Loughran 1fc36b824c HADOOP-12590. TestCompressorDecompressor failing without stack traces (John Zhuge via stevel)
(cherry picked from commit 80734bc346)
2016-01-15 10:41:56 +09:00
Jason Lowe 4ab508ead4 HADOOP-12706. TestLocalFsFCStatistics#testStatisticsThreadLocalDataCleanUp times out occasionally. Contributed by Sangjin Lee and Colin Patrick McCabe
(cherry picked from commit cdf8895259)
2016-01-14 23:48:12 +00:00
Jason Lowe fe77cb1df0 Update CHANGES.txt for commit of HADOOP-12107 to branch-2.7 and branch-2.6
(cherry picked from commit 651c23e8ef)
2016-01-14 23:43:09 +00:00
Benoy Antony 6cfeb84a36 HADOOP-12587. Hadoop AuthToken refuses to work without a maxinactive attribute in issued token. (Benoy Antony) 2016-01-14 14:42:04 -08:00
Yongjun Zhang a7d33b934a Revert "HADOOP-12700. Remove unused import in TestCompressorDecompressor.java. Contributed by John Zhuge."
This reverts commit b3fa190297.
2016-01-14 13:06:03 -08:00
Akira Ajisaka b3fa190297 HADOOP-12700. Remove unused import in TestCompressorDecompressor.java. Contributed by John Zhuge.
(cherry picked from commit f977366d9522ee31080e16db90972729fcfe256f)
(cherry picked from commit 722d9e569ee6891e71274e758474063f25f5babf)
2016-01-15 00:32:07 +09:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) 7eb63d4e7c HADOOP-5323. Trash documentation should describe its directory structure and configurations. (Weiwei Yang via ozawa)
Moved entry from HDFS CHANGES.txt to that of common.

(cherry picked from commit cb73c753da)
2016-01-13 14:56:35 -08:00
cnauroth c3f4cb927a HADOOP-12603. TestSymlinkLocalFSFileContext#testSetTimesSymlinkToDir occasionally fail. Contributed by Wei-Chiu Chuang.
(cherry picked from commit d64cec0fdaddbb892d66ecff358f547b939005f1)
(cherry picked from commit 2605e78e44)
2016-01-12 15:42:00 -08:00
Lei Xu 39f07295fb HADOOP-11262. Enable YARN to use S3A. (Pieter Reuse via lei)
(cherry picked from commit 126705f67e)
2016-01-12 12:21:00 -08:00
Akira Ajisaka 3fced13eae HADOOP-12584. Disable browsing the static directory in HttpServer2. Contributed by Robert Kanter.
(cherry picked from commit 9c89bcd04212543ae279d34938ec2ad319e5ba6d)
(cherry picked from commit 6f80be98758ff5d53a192f86ada6cc4062fcdef8)
2016-01-12 13:35:03 +09:00
cnauroth e26f702866 HADOOP-12551. Introduce FileNotFoundException for WASB FileSystem API. Contributed by Dushyanth.
(cherry picked from commit 0e76f1fcea)
(cherry picked from commit 813841e10b)
2016-01-09 22:18:30 -08:00
cnauroth f0f8e3ee7c HADOOP-12678. Handle empty rename pending metadata file during atomic rename in redo path. Contributed by Madhumita Chakraborty.
(cherry picked from commit f0fa6d869b)
(cherry picked from commit debd13387d)
2016-01-08 20:19:18 -08:00
Steve Loughran 092901345e HADOOP-12675. Fix description about retention period in usage of expunge command. (Masatake Iwasaki via stevel) 2016-01-07 14:39:36 +00:00
cnauroth 506a517f9f HADOOP-12634. Change Lazy Rename Pending Operation Completion of WASB to address case of potential data loss due to partial copy. Contributed by Gaurav Kanade.
(cherry picked from commit 978bbdfeb2)
(cherry picked from commit 4753676a34)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2016-01-06 11:17:01 -08:00
Yongjun Zhang f372d3faae HADOOP-12604. Exception may be swallowed in KMSClientProvider. (Yongjun Zhang)
(cherry picked from commit 28bd138018)
2016-01-05 11:19:39 -08:00
Uma Mahesh 68ee13e4f5 HADOOP-12658. Clear javadoc and check style issues around DomainSocket. Contributed by Kai Zheng
(cherry picked from commit 778146eaae)
2016-01-04 15:14:14 -08:00
Akira Ajisaka a319df412f HADOOP-12686. Update FileSystemShell documentation to mention the meaning of each columns of fs -du. Contributed by Daisuke Kobayashi.
(cherry picked from commit 1af2917856)
(cherry picked from commit 40b41ac8fc)
2016-01-04 20:33:57 +09:00
Akira Ajisaka 22ac1a1ac0 Set release date for 2.6.3
(cherry picked from commit db99e30f67)
(cherry picked from commit 247ab92464)
2016-01-04 16:13:06 +09:00
Akira Ajisaka 13a48f6256 HADOOP-11252. RPC client does not time out by default. Contributed by Wilfred Spiegelenburg and Masatake Iwasaki.
(cherry picked from commit 64ae85fd2e)
(cherry picked from commit d98cfe611f)
2016-01-04 14:32:21 +09:00
Xiaoyu Yao c16e126d16 HADOOP-12608. Fix exception message in WASB when connecting with anonymous credential. Contributed by Dushyanth.
(cherry picked from commit 007a8decc61750720033e06b6d08861ac3788e41)
2015-12-30 11:16:06 -08:00
Xiaoyu Yao a48fdc1907 HADOOP-12682. Fix TestKMS#testKMSRestart* failure. Contributed by Wei-Chiu Chuang.
(cherry picked from commit ab725cff66)
2015-12-30 10:44:13 -08:00
Xiaoyu Yao beec7a2efb HADOOP-12559. KMS connection failures should trigger TGT renewal. Contributed by Zhe Zhang.
(cherry picked from commit 993311e547)
2015-12-28 10:47:20 -08:00
Akira Ajisaka c60792e6e5 HADOOP-12681. start-build-env.sh fails in branch-2. Contributed by Kengo Seki.
(cherry picked from commit babe025fb0)
2015-12-28 14:39:51 +09:00
Akira Ajisaka 1cd85efd71 HDFS-9505. HDFS Architecture documentation needs to be refreshed. Contributed by Masatake Iwasaki.
(cherry picked from commit fa544020f6)
(cherry picked from commit 7526a2a005)
2015-12-21 21:23:40 +09:00
Chris Douglas 4150d08a4b HADOOP-12636. Prevent ServiceLoader failure init for unused FileSystems. Contributed by Inigo Goiri
(cherry picked from commit 8652cce5b2)
(cherry picked from commit d984ba4fd7)
2015-12-18 18:31:36 -08:00
cnauroth d6f1d3b6ca HADOOP-12570. HDFS Secure Mode Documentation updates. Contributed by Arpit Agarwal.
(cherry picked from commit 932956458d)
(cherry picked from commit dd91cf9fa5)
2015-12-18 16:54:36 -08:00
Xiaoyu Yao f3ee0e7857 HDFS-8831. Trash Support for deletion in HDFS encryption zone. Contributed by Xiaoyu Yao.
(cherry picked from commit cbc7b6bf97)
(cherry picked from commit eb7f9901b4)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2015-12-18 16:34:43 -08:00
Jian He f355645ca4 YARN-4405. Support node label store in non-appendable file system. Contributed by Wangda Tan
(cherry picked from commit 755dda8dd8)

(cherry picked from commit be404e1680)
2015-12-18 16:34:42 -08:00
Arpit Agarwal cef21b7aaa HADOOP-12656. MiniKdc throws "address in use" BindException. (Contributed by Wei-Chiu Chuang) 2015-12-18 16:08:22 -08:00
Zhe Zhang 65effb76d9 HDFS-9347. Invariant assumption in TestQuorumJournalManager.shutdown() is wrong. Contributed by Wei-Chiu Chuang.
Change-Id: Idde8522e11c77f82b376e0c90a9bf33d163d5cb9
2015-12-18 16:06:42 -08:00
Akira Ajisaka e09d026105 HADOOP-12657. Add a option to skip newline on empty files with getMerge -nl. Contributed by Kanaka Kumar Avvaru.
(cherry picked from commit 061c05cc05)
(cherry picked from commit af49823499)
2015-12-18 14:00:42 +09:00
Akira Ajisaka c18bf20154 HADOOP-12588. Fix intermittent test failure of TestGangliaMetrics. Contributed by Masatake Iwasaki.
(cherry picked from commit bd5e207432)
(cherry picked from commit e06c291245)
2015-12-18 13:13:12 +09:00
Vinod Kumar Vavilapalli 753c9292c2 HADOOP-12415. Fixed pom files to correctly include compile-time dependency on netty. (Tom Zeng via cos)
Addendum commit to include CHANGES.txt entry.

(cherry picked from commit ce16541c62)
2015-12-16 14:42:09 -08:00
Uma Mahesh 58cc106378 HADOOP-12639. Improve JavaDoc for getTrimmedStrings. (BELUGA BEHR via umamahesh)
(cherry picked from commit ae67c8424c)
2015-12-15 15:21:58 -08:00
Akira Ajisaka 028f66b8a2 HADOOP-12602. TestMetricsSystemImpl#testQSize occasionally fails. Contributed by Masatake Iwasaki.
(cherry picked from commit eee0cf4611)
(cherry picked from commit 5047ee56af)
2015-12-11 16:19:12 +09:00
Uma Mahesh 9c5650cf03 HADOOP-12618. Fix NPE in TestSequenceFile. (Brahma Reddy Battula via umamahesh)
(cherry picked from commit ad53c52063)
2015-12-08 23:03:19 -08:00
mattf 05a7fb3a9a HADOOP-12617. SPNEGO authentication request to non-default realm gets default realm name inserted in target server principal. (mattf) 2015-12-08 17:46:36 -08:00
Haohui Mai 274af9b579 HADOOP-10729. Add tests for PB RPC in case version mismatch of client and server. Contributed by Junping Du. 2015-12-09 05:44:36 +08:00
Akira Ajisaka 78552d8857 HADOOP-12565. Replace DSA with RSA for SSH key type in SingleCluster.md. Contributed by Mingliang Liu.
(cherry picked from commit 3857fed2c8)
(cherry picked from commit 15c2f709c6)
2015-12-03 11:52:11 +08:00
Junping Du 12fb8b4cc5 Add 2.6.4 as release entry to CHANGES.txt 2015-12-02 07:38:03 -08:00
Arpit Agarwal a99274ea96 HADOOP-12609. Fix intermittent failure of TestDecayRpcScheduler. (Contributed by Masatake Iwasaki) 2015-12-01 15:29:39 -08:00
Yongjun Zhang 3b9043348a HADOOP-12468. Partial group resolution failure should not result in user lockout. (Wei-Chiu Chuang via Yongjun Zhang)
(cherry picked from commit 0348e769ab)
(cherry picked from commit 165abe6c4f)
2015-12-01 15:01:56 -08:00
Allen Wittenauer 81a7ad45c9 HADOOP-12366. expose calculated paths (aw) 2015-12-01 08:15:57 -08:00
cnauroth 6417121ddb HADOOP-12600. FileContext and AbstractFileSystem should be annotated as a Stable interface. Contributed by Chris Nauroth.
(cherry picked from commit b2c78536cb)
(cherry picked from commit 669743ce11)
2015-11-28 15:40:25 -08:00
Vinod Kumar Vavilapalli efaef45a24 Reverting previous commit which added 2.9.0 entries. Don't need that in branch-2.8.
Revert "Adding release 2.8.0 to CHANGES.txt"

This reverts commit 767815f317.
2015-11-25 17:49:48 -08:00
Vinod Kumar Vavilapalli 767815f317 Adding release 2.8.0 to CHANGES.txt
(cherry picked from commit d57fd181c7)
2015-11-25 17:37:47 -08:00
Robert Kanter 8c6273d117 MAPREDUCE-6549. multibyte delimiters with LineRecordReader cause duplicate records (wilfreds via rkanter)
(cherry picked from commit 7fd00b3db4)
2015-11-25 17:03:52 -08:00
Akira Ajisaka 4257991257 HADOOP-12598. Add XML namespace declarations for some hadoop/tools modules. Contributed by Xin Wang.
(cherry picked from commit b53f20135599cc7825b6213794e2f999bc43e2ad)
2015-11-26 01:21:32 +09:00
Allen Wittenauer 38f8952c4d HADOOP-11954. Solaris does not support RLIMIT_MEMLOCK as in Linux (Alan Burlison via aw) 2015-11-24 12:48:02 -08:00
Jason Lowe 7923130114 Revert "HADOOP-11361. Fix a race condition in MetricsSourceAdapter.updateJmxCache. Contributed by Brahma Reddy Battula."
This reverts commit 4356e8a5ef.

Conflicts:

	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics2/impl/MetricsSourceAdapter.java
(cherry picked from commit 17b1a5482b)
2015-11-24 19:13:26 +00:00
Jian He b339a4b8d6 YARN-4349. Support CallerContext in YARN. Contributed by Wangda Tan
(cherry picked from commit 8676a118a1)
2015-11-23 17:20:24 -08:00
Haohui Mai 75b007260b Revert "HADOOP-12572. Update Hadoop's lz4 to r131. Contributed by Kevin Bowling."
This reverts commit 74d67b2250.
2015-11-23 14:59:55 -08:00
Haohui Mai 1cdf422ba8 HADOOP-9822. create constant MAX_CAPACITY in RetryCache rather than hard-coding 16 in RetryCache constructor. Contributed by Tsuyoshi Ozawa. 2015-11-23 13:23:14 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) c824920527 HADOOP-12577. Bumped up commons-collections version to 3.2.2 to address a security flaw. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 70c26703f4)
2015-11-23 10:00:40 -08:00
Haohui Mai f826195ee5 HADOOP-12313. NPE in JvmPauseMonitor when calling stop() before start(). Contributed by Gabor Liptak. 2015-11-22 23:07:51 -08:00
Haohui Mai c07fab5f6f HDFS-9024. Deprecate the TotalFiles metric. Contributed by Akira Ahisaka. 2015-11-22 23:03:05 -08:00
Haohui Mai 16bcf66c1b HADOOP-11677. Add cookie flags for logs and static contexts. Contributed by nijel. 2015-11-22 19:53:19 -08:00
Haohui Mai 579f9030da HADOOP-11149. Increase the timeout of TestZKFailoverController. Contributed by Steve Loughran. 2015-11-22 19:46:13 -08:00