Commit Graph

2948 Commits

Author SHA1 Message Date
Colin Patrick Mccabe b67b5b09a7 HDFS-9942. Add an HTrace span when refreshing the groups for a username (cmccabe)
(cherry picked from commit 6e9a582eb1)
2016-03-11 12:27:12 -08:00
Steve Loughran 1c96fd0a23 Revert "HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims)"
This reverts commit 7994ab3fa0.
2016-03-11 16:59:42 +00:00
Masatake Iwasaki 7994ab3fa0 HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims)
(cherry picked from commit 682adc6ba9)
2016-03-11 15:05:34 +09:00
Li Lu 92125e6057 HADOOP-12906. AuthenticatedURL should convert a 404/Not Found into an FileNotFoundException. (Steve Loughran via gtcarrera9)
(cherry-picked from commit 9a79b738c5)
2016-03-10 11:39:44 -08:00
Harsh J 2e32aa5475 HADOOP-11404. Clarify the "expected client Kerberos principal is null" authorization message. Contributed by Stephen Chu
(cherry picked from commit 318c9b68b0)
2016-03-10 17:09:56 +05:30
Allen Wittenauer 95d30a6ec6 HADOOP-12798. Update changelog and release notes (2016-03-04) (aw)
(cherry picked from commit 55f73a1cbd)
2016-03-09 19:39:13 -08:00
Allen Wittenauer 140a33df9b HADOOP-11791. Update src/site/markdown/releases to include old versions of Hadoop (aw)
(cherry picked from commit d759b4bd74)
2016-03-09 19:39:05 -08:00
Allen Wittenauer 9f4b3eaac0 Revert "HADOOP-12366. expose calculated paths (aw)"
This reverts commit 45bb467918.
2016-03-09 09:59:19 -08:00
Arpit Agarwal a06ecb085e HADOOP-12903. IPC Server should allow suppressing exception logging by type, not log 'server too busy' messages. (Arpit Agarwal) 2016-03-08 23:30:36 -08:00
Akira Ajisaka 0d8ad99e0d HADOOP-12688. Fix deadlinks in Compatibility.md. Contributed by Gabor Liptak.
(cherry picked from commit 4cbefafcac4e7b20a23b7b416af1a2efe71e1080)
2016-03-09 15:33:14 +09:00
Chris Nauroth 38a031ce68 HADOOP-12905. Clean up CHANGES.txt RAT exclusions from pom.xml files. Contributed by Chris Nauroth.
(cherry picked from commit 89b16d27e2)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/pom.xml
	hadoop-mapreduce-project/pom.xml
2016-03-08 21:22:57 -08:00
Andrew Wang 7e29d732ee HADOOP-12895. SSLFactory#createSSLSocketFactory exception message is wrong. Contributed by Wei-Chiu Chuang.
(cherry picked from commit a3cc6e2511)
2016-03-08 13:52:01 -08:00
Akira Ajisaka 0586386472 HADOOP-12860. Expand section "Data Encryption on HTTP" in SecureMode documentation. Contributed by Wei-Chiu Chuang.
(cherry picked from commit f86850b544)
2016-03-08 14:29:46 +09:00
Arpit Agarwal 9d67f98e05 HDFS-9882. Add heartbeatsTotal in Datanode metrics. (Contributed by Hua Liu) 2016-03-07 21:10:34 -08:00
Ming Ma aae39ff973 HADOOP-12789. log classpath of ApplicationClassLoader at INFO level. (Sangjin Lee via mingma)
(cherry picked from commit 49eedc7ff0)
2016-03-07 20:27:10 -08:00
Andrew Wang fed2339e28 HADOOP-12901. Add warning log when KMSClientProvider cannot create a connection to the KMS server. (Xiao Chen via wang)
(cherry picked from commit 391da36d93)
2016-03-07 14:00:08 -08:00
Chris Nauroth 592f161e13 HDFS-9239. DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness. Contributed by Chris Nauroth.
(cherry picked from commit 2759689d7d)
2016-03-04 15:30:28 -08:00
Masatake Iwasaki 722182fdfb HADOOP-12470. In-page TOC of documentation should be automatically generated by doxia macro (iwasakims)
(cherry picked from commit cbd31328a6)

 Conflicts:
	hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md
	hadoop-common-project/hadoop-common/src/site/markdown/UnixShellGuide.md
2016-03-04 14:12:44 +09:00
Andrew Wang 670944810c HADOOP-11792. Remove all of the CHANGES.txt files. 2016-03-03 21:02:58 -08:00
Allen Wittenauer b0d3b0c1f8 HADOOP-12651. Replace dev-support with wrappers to Yetus (aw)
(cherry picked from commit 8cecad2d56)

 Conflicts:
	dev-support/test-patch.sh
	hadoop-common-project/hadoop-common/pom.xml
2016-03-03 20:54:08 -08:00
Akira Ajisaka 899715a15e HADOOP-12872. Fix formatting in ServiceLevelAuth.md. Contributed by Brahma Reddy Battula.
(cherry picked from commit 0a9f00af5e)
2016-03-03 23:32:51 +09:00
Akira Ajisaka 96a0939d5b HADOOP-12871. Fix dead link to NativeLibraries.html in CommandsManual.md. Contributed by Brahma Reddy Battula.
(cherry picked from commit 1c3136cbd8)
2016-03-03 23:23:12 +09:00
Akira Ajisaka 9e87f59dea HADOOP-12870. Fix typo admininistration in CommandsManual.md. Contributed by John Zhuge.
(cherry picked from commit eb864d35d6)
2016-03-03 18:51:50 +09:00
Masatake Iwasaki 69e024f8fa HADOOP-12793. Write a new group mapping service guide (Wei-Chiu Chuang via iwasakims)
(cherry picked from commit f70e317ccc)
2016-03-03 17:14:53 +09:00
Arpit Agarwal 7b4a1001ea HDFS-9534. Add CLI command to clear storage policy from a path. (Contributed by Xiaobing Zhou) 2016-03-02 18:35:38 -08:00
Colin Patrick Mccabe 5998b20d63 HDFS-9835. OIV: add ReverseXML processor which reconstructs an fsimage from an XML file (cmccabe)
(cherry picked from commit 700b0e4019)
2016-03-02 18:18:45 -08:00
Andrew Wang 3fecfe1352 HADOOP-12859. Disable hiding field style checks in class setters. Contributed by Kai Zheng.
(cherry picked from commit 480302b4ba)
2016-03-02 09:40:33 -08:00
Chris Nauroth bce33b5179 HADOOP-12853. Change WASB documentation regarding page blob support. Contributed by Madhumita Chakraborty.
(cherry picked from commit f98dff329b)
2016-03-01 13:18:57 -08:00
Akira Ajisaka 67e8489ac6 HADOOP-12843. Fix findbugs warnings in hadoop-common (branch-2). (aajisaka) 2016-03-02 00:20:57 +09:00
Chris Nauroth e402371b6a HADOOP-12851. S3AFileSystem Uptake of ProviderUtils.excludeIncompatibleCredentialProviders. Contributed by Larry McCay.
(cherry picked from commit d251e55415)
2016-02-29 22:00:27 -08:00
Karthik Kambatla c1855a33eb HADOOP-10321. TestCompositeService should cover all enumerations of adding a service to a parent service. (Ray Chiang via kasha)
(cherry picked from commit 680f3fc02d)
2016-02-29 19:00:22 -08:00
Jian He 3e842de1d5 HADOOP-12622. Improve the loggings in RetryPolicies and RetryInvocationHandler. Contributed by Junping Du 2016-02-29 16:24:30 -08:00
Haohui Mai c5db4ab0b4 HADOOP-12813. Migrate TestRPC and related codes to rebase on ProtobufRpcEngine. Contributed by Kai Zheng. 2016-02-29 14:10:18 -08:00
Masatake Iwasaki 32c7791a6c HADOOP-12552. Fix undeclared/unused dependency to httpclient (iwasakims)
(cherry picked from commit 809ebc0b14)
2016-02-29 18:23:33 +09:00
Suresh Srinivas fca24fbbaa HADOOP-9121. InodeTree.java has redundant check for vName while throwing exception. Contributed by Arup Malakar.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418005 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit a5331eeead)
2016-02-29 11:35:19 +09:00
Chris Nauroth 2e761dabd8 HADOOP-12846. Credential Provider Recursive Dependencies. Contributed by Larry McCay.
(cherry picked from commit 7634d404b7)
2016-02-28 11:23:02 -08:00
Li Lu 090f74c741 HADOOP-12831. LocalFS/FSOutputSummer NPEs in constructor if bytes per checksum set to 0 (Mingliang Liu via gtcarrera9)
(cherry-picked from commit 7545ce6636)
2016-02-27 22:03:49 -08:00
Steve Loughran 4d870b1faa HADOOP-12825. Log slow name resolutions. (Sidharta Seethana via stevel) 2016-02-27 20:05:53 +00:00
Chris Nauroth c692d7c52f HADOOP-12849. TestSymlinkLocalFSFileSystem fails intermittently. Contributed by Mingliang Liu.
(cherry picked from commit 798babf661)
2016-02-26 21:59:14 -08:00
Lei Xu 49a10a3cec HADOOP-12841. Update s3-related properties in core-default.xml. (Wei-Chiu Chuang via lei)
(cherry picked from commit 2093acf6b6)
2016-02-26 10:48:35 -08:00
Suresh Srinivas b1d497a7de HADOOP-8818. Use equals instead == in MD5MD5CRC32FileChecksum and TFileDumper. Contributed by Brandon Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1385374 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 0c53ed4cd1)
2016-02-27 01:27:00 +09:00
Masatake Iwasaki b0091338f2 HADOOP-12711. Remove dependency on commons-httpclient for ServletUtil (Wei-Chiu Chuang via iwasakims) 2016-02-26 15:32:07 +09:00
Karthik Kambatla 6722e17f6d HDFS-9858. RollingFileSystemSink can throw an NPE on non-secure clusters. (Daniel Templeton via kasha)
(cherry picked from commit c2460dad64)
2016-02-25 16:36:07 -08:00
Xiaoyu Yao 7ad6ca1eb2 HADOOP-12824. Collect network and disk usage on the node running Windows. Contributed by Inigo Goiri. 2016-02-25 15:50:36 -08:00
cnauroth 92e49cdd04 HADOOP-12716. KerberosAuthenticator#doSpnegoSequence use incorrect class to determine isKeyTab in JDK8. Contributed by Xiaoyu Yao.
(cherry picked from commit d6b181c6fa)
2016-02-24 14:05:55 -08:00
cnauroth 9ea19a861f HADOOP-12535. Run FileSystem contract tests with hadoop-azure. Contributed by Madhumita Chakraborty.
(cherry picked from commit 3369a4f691)
2016-02-23 21:37:56 -08:00
Colin Patrick Mccabe 7dfcf40352 HADOOP-12829. StatisticsDataReferenceCleaner swallows interrupt exceptions (Gregory Chanan via cmccabe)
(cherry picked from commit d9c409a428)
2016-02-23 11:27:55 -08:00
cnauroth a5511debdb HADOOP-12555. WASB to read credentials from a credential provider. Contributed by Larry McCay.
(cherry picked from commit 27b77751c1)
2016-02-22 17:30:32 -08:00
Zhe Zhang 56b7f2c2c1 HADOOP-12668. Support excluding weak Ciphers in HttpServer2 through ssl-server.conf. Contributed by Vijay Singh.
Change-Id: Ie46a5427d29188935427f67e55203c19fcd83335
2016-02-22 14:14:39 -08:00
cnauroth 3f14eed580 HADOOP-11613. Remove commons-httpclient dependency from hadoop-azure. Contributed by Masatake Iwasaki.
(cherry picked from commit d4f5fc23b2)
2016-02-22 13:39:45 -08:00
Junping Du e38c2ef6c5 Support additional compression levels for GzipCodec. Contributed by Ravi Mutyala.
(cherry picked from commit 18f9b77a32)
2016-02-19 14:22:39 -08:00
Yongjun Zhang 36c08f793a HADOOP-12828. Print user when services are started. (Wei-Chiu Chuang via Yongjun Zhang)
(cherry picked from commit a963baba10)
2016-02-19 09:57:45 -08:00
cnauroth b4c4f30fa4 HADOOP-11031. Design Document for Credential Provider API. Contributed by Larry McCay.
(cherry picked from commit 8ab7658025)
2016-02-18 14:07:09 -08:00
Tsz-Wo Nicholas Sze 38fc086940 HADOOP-10865. Add a Crc32 chunked verification benchmark for both directly and non-directly buffer cases. 2016-02-18 12:02:00 -08:00
Robert Kanter f864faaafa HADOOP-12817. Enable TLS v1.1 and 1.2 (rkanter)
(cherry picked from commit a365a3941c)
2016-02-18 11:11:32 -08:00
cnauroth 779a69e28d HDFS-9711. Integrate CSRF prevention filter in WebHDFS. Contributed by Chris Nauroth.
(cherry picked from commit 5d1889a66d)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/web/DatanodeHttpServer.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java
2016-02-18 10:09:33 -08:00
Xiaoyu Yao ad4fcd1f9f HDFS-8855. Webhdfs client leaks active NameNode connections. Contributed by Xiaobing Zhou.
(cherry picked from commit fe5624b85d)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/web/DatanodeHttpServer.java
2016-02-17 16:05:07 -08:00
Zhe Zhang e226dbbc8a HDFS-9799. Reimplement getCurrentTrashDir to remove incompatibility. (zhz)
Change-Id: I7834bcebffed38cb384db5395ddb8b6dd9e79a0b
2016-02-17 13:31:48 -08:00
cnauroth 6731bb468d HADOOP-12548. Read s3a creds from a Credential Provider. Contributed by Larry McCay.
(cherry picked from commit 76fab26c5c)

Conflicts:
	hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java
2016-02-17 12:20:41 -08:00
Xiaoyu Yao 91c4a3a816 HADOOP-12878. KMS SPNEGO sequence does not work with WEBHDFS. Contributed by Xiaoyu Yao.
(cherry picked from commit fd1befb6ba)
2016-02-17 08:44:37 -08:00
Masatake Iwasaki 3e80aece2e HADOOP-12710. Remove dependency on commons-httpclient for TestHttpServerLogs (Wei-Chiu Chuang via iwasakims)
(cherry picked from commit 1a1c2f5bab)
2016-02-18 00:25:20 +09:00
Vinayakumar B 2bf5a005fa HADOOP-12810. FileSystem#listLocatedStatus causes unnecessary RPC calls (Contributed by Ryan Blue)
(cherry picked from commit 96ea309431)
2016-02-17 10:15:08 +05:30
Vinayakumar B e79a5e4460 HADOOP-12805. Annotate CanUnbuffer with @InterfaceAudience.Public (Contributed by Ted Yu)
(cherry picked from commit 4b0e59fdc0)
2016-02-16 17:32:35 +05:30
Akira Ajisaka a670165bbd HADOOP-12786. "hadoop key" command usage is not documented. Contributed by Xiao Chen.
(cherry picked from commit 1c48e50ce7)
2016-02-15 11:38:54 +09:00
Junping Du a28be9edc7 Set the release date for 2.6.4.
(cherry picked from commit ec12ce8f48)
2016-02-13 01:44:12 -08:00
Masatake Iwasaki 7a67f8f709 HADOOP-12589. Fix intermittent test failure of TestCopyPreserveFlag (iwasakims)
(cherry picked from commit 36ba5cac37)
2016-02-13 15:01:08 +09:00
cnauroth ac5a793590 HADOOP-12780. During WASB atomic rename handle crash when one directory has been renamed but not file under it. Contributed by Madhumita Chakraborty.
(cherry picked from commit 91a96eaa53)
2016-02-12 15:50:19 -08:00
Arpit Agarwal 63f51208a8 HDFS-9801. ReconfigurableBase should update the cached configuration. (Arpit Agarwal) 2016-02-12 12:41:12 -08:00
Vinayakumar B 488e6cbe16 HADOOP-12776. Remove getaclstatus call for non-acl commands in getfacl. (Contributed by Brahma Reddy Battula)
(cherry picked from commit c78740a979)
2016-02-12 11:55:16 +05:30
Karthik Kambatla 383f3ff28c HDFS-9780. RollingFileSystemSink doesn't work on secure clusters. (Daniel Templeton via kasha)
(cherry picked from commit 33ce7f6c07)
2016-02-11 20:45:23 -08:00
Andrew Wang fb57c01eaa HADOOP-12699. TestKMS#testKMSProvider intermittently fails during 'test rollover draining'. Contributed by Xiao Chen.
(cherry picked from commit 8fdef0bd9d)
2016-02-11 17:21:50 -08:00
cnauroth 25dcb88630 HADOOP-12795. KMS does not log detailed stack trace for unexpected errors. Contributed by Chris Nauroth.
(cherry picked from commit 70c756d35e)
2016-02-11 16:53:12 -08:00
Zhe Zhang dfd49a027e Add HADOOP-12764 to CHANGES.txt.
Change-Id: Ie32b71b7bd8892a3bb434aec12cdf2c43c61b897
2016-02-11 09:34:32 -08:00
Zhe Zhang 84dcd1a802 HADOOP-12764. Increase default value of KMS maxHttpHeaderSize and make it configurable. (zhz)
Change-Id: Iabb766f6311b83a1ac03093b0ba26a0284b74d70
2016-02-11 09:29:14 -08:00
Uma Maheswara Rao G e90f7ef988 HADOOP-12788. OpensslAesCtrCryptoCodec should log which random number generator is used. Contributed by Wei-Chiu Chuang.
(cherry picked from commit df4dcd3e75)
2016-02-10 15:04:42 -08:00
Jason Lowe fa9b3e6302 HADOOP-12792. TestUserGroupInformation#testGetServerSideGroups fails in chroot. Contributed by Eric Badger
(cherry picked from commit 6f03959e4d)
2016-02-10 21:54:50 +00:00
Sangjin Lee 463195dbe6 HADOOP-12773. HBase classes fail to load with client/job classloader enabled (sjlee)
(cherry picked from commit 58acbf940a)
2016-02-08 13:57:44 -08:00
cnauroth a76611d4ec HADOOP-12752. Improve diagnostics/use of envvar/sysprop credential propagation. Contributed by Steve Loughran.
(cherry picked from commit cf3261570a)
2016-02-08 09:36:18 -08:00
Varun Vasudev 2451a0a8e0 HADOOP-12749. Create a threadpoolexecutor that overrides afterExecute to log uncaught exceptions/errors. Contributed by Sidharta Seethana.
(cherry picked from commit d37eb828ff)
2016-02-08 20:19:51 +05:30
Varun Vasudev 368a11f3dd Revert "HADOOP-12749. Create a threadpoolexecutor that overrides afterExecute to log uncaught exceptions/errors. Contributed by Sidharta Seethana."
This reverts commit f3bbe0bd02.

(cherry picked from commit af218101e5)
2016-02-08 20:17:10 +05:30
Varun Vasudev fd971debee HADOOP-12749. Create a threadpoolexecutor that overrides afterExecute to log uncaught exceptions/errors. Contributed by Sidharta Seethana.
(cherry picked from commit f3bbe0bd02)
2016-02-08 14:23:19 +05:30
Andrew Wang 915ce5d960 HADOOP-12759. RollingFileSystemSink should eagerly rotate directories. Contributed by Daniel Templeton.
(cherry picked from commit 5b59a0ea85)
2016-02-06 20:52:49 -08:00
Steve Loughran 60474a769e HADOOP-12292. Make use of DeleteObjects optional. (Thomas Demoor via stevel) 2016-02-06 18:20:24 +00:00
cnauroth 4db6cc44cd HADOOP-12426. Add Entry point for Kerberos health check. Contributed by Steve Loughran.
(cherry picked from commit cfa8513890)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/conf/hadoop-env.sh
2016-02-05 15:52:14 -08:00
cnauroth 5752df2362 HADOOP-12758. Extend CSRF Filter with UserAgent Checks. Contributed by Larry McCay.
(cherry picked from commit a37e423e84)
2016-02-05 14:38:31 -08:00
Kihwal Lee 51a705432c HADOOP-12772. NetworkTopologyWithNodeGroup.getNodeGroup() can loop infinitely for invalid 'loc' values. Contributed by Kuhu Shukla.
(cherry picked from commit 49e176c29f)
2016-02-05 15:47:56 -06:00
Colin Patrick Mccabe 86760c0f52 HADOOP-12766. The default value of "hadoop.workaround.non.threadsafe.getpwuid" is different between core-default.xml and NativeIO.java (Akira AJISAKA via cmccabe)
(cherry picked from commit 9086dd58c3)
2016-02-05 10:57:47 -08:00
Xiaoyu Yao e0a356fee3 HADOOP-12771. Fix typo in JvmPauseMonitor#getNumGcWarnThreadholdExceeded. Contributed by Xiaobing Zhou.
(cherry picked from commit 5d00067ca7)
2016-02-05 10:38:02 -08:00
Xuan dfad608b22 YARN-4662. Document some newly added metrics. Contributed by Jian He
(cherry picked from commit 63c63e298c)
2016-02-03 20:06:25 -08:00
Sangjin Lee b0ab6df079 HADOOP-12761. incremental maven build is not really incremental (sjlee)
(cherry picked from commit 4dc0a39493)
2016-02-03 09:00:41 -08:00
Junping Du 3583c77ee8 Adding release 2.6.5 to CHANGES.txt 2016-02-02 18:09:17 -08:00
Andrew Wang b4ad58796b HADOOP-12755. Fix typo in defaultFS warning message.
(cherry picked from commit 8171874dd1)
2016-02-02 11:56:47 -08:00
Karthik Kambatla 363a8212ec HADOOP-12702. Add an HDFS metrics sink. (Daniel Templeton via kasha)
(cherry picked from commit ee005e010c)
2016-01-28 17:45:50 -08:00
Colin Patrick Mccabe b94fbdf6f0 HADOOP-12735. core-default.xml misspells hadoop.workaround.non.threadsafe.getpwuid (Ray Chiang via cmccabe)
(cherry picked from commit 2e8ab3d465)
2016-01-27 11:40:42 -08:00
Yongjun Zhang a1f913fb6e HADOOP-12718. Incorrect error message by fs -put local dir without permission. (John Zhuge via Yongjun Zhang)
(cherry picked from commit 97056c3355)
2016-01-27 08:05:17 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) 97f6cfa94b Release process for 2.7.2: Set the release date for 2.7.2
(cherry picked from commit ec4d2d9f40)
2016-01-25 15:47:02 -08:00
Walter Su 75b83af20e HADOOP-12715. TestValueQueue#testgetAtMostPolicyALL fails intermittently. Contributed by Xiao Chen.
(cherry picked from commit 6eacdea0e4)
2016-01-25 19:42:56 +08:00
Akira Ajisaka 38ec290455 HADOOP-12736. TestTimedOutTestsListener#testThreadDumpAndDeadlocks sometimes times out. Contributed by Xiao Chen.
(cherry picked from commit 643227927a)
2016-01-25 13:59:48 +09:00
Akira Ajisaka 4edd7bd820 HADOOP-12731. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta.
(cherry picked from commit 736eb17a79)
2016-01-25 13:48:28 +09:00
Kihwal Lee b5db1d4410 HDFS-8898. Create API and command-line argument to get quota and quota usage without detailed content summary. Contributed by Ming Ma. 2016-01-22 09:19:23 -06:00