2862 Commits

Author SHA1 Message Date
Li Lu
090f74c741 HADOOP-12831. LocalFS/FSOutputSummer NPEs in constructor if bytes per checksum set to 0 (Mingliang Liu via gtcarrera9)
(cherry-picked from commit 7545ce6636066a05763744a817878e03ee87f456)
2016-02-27 22:03:49 -08:00
Steve Loughran
4d870b1faa HADOOP-12825. Log slow name resolutions. (Sidharta Seethana via stevel) 2016-02-27 20:05:53 +00:00
Chris Nauroth
c692d7c52f HADOOP-12849. TestSymlinkLocalFSFileSystem fails intermittently. Contributed by Mingliang Liu.
(cherry picked from commit 798babf661311264fa895c89a33d0f2da927da33)
2016-02-26 21:59:14 -08:00
Lei Xu
49a10a3cec HADOOP-12841. Update s3-related properties in core-default.xml. (Wei-Chiu Chuang via lei)
(cherry picked from commit 2093acf6b659d5a271b7e97f9b64652d7cf01eef)
2016-02-26 10:48:35 -08:00
Suresh Srinivas
b1d497a7de HADOOP-8818. Use equals instead == in MD5MD5CRC32FileChecksum and TFileDumper. Contributed by Brandon Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1385374 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 0c53ed4cd122f87b2b041d670b9b59e27da5439c)
2016-02-27 01:27:00 +09:00
Masatake Iwasaki
b0091338f2 HADOOP-12711. Remove dependency on commons-httpclient for ServletUtil (Wei-Chiu Chuang via iwasakims) 2016-02-26 15:32:07 +09:00
Karthik Kambatla
6722e17f6d HDFS-9858. RollingFileSystemSink can throw an NPE on non-secure clusters. (Daniel Templeton via kasha)
(cherry picked from commit c2460dad642feee1086442d33c30c24ec77236b9)
2016-02-25 16:36:07 -08:00
Xiaoyu Yao
7ad6ca1eb2 HADOOP-12824. Collect network and disk usage on the node running Windows. Contributed by Inigo Goiri. 2016-02-25 15:50:36 -08:00
cnauroth
92e49cdd04 HADOOP-12716. KerberosAuthenticator#doSpnegoSequence use incorrect class to determine isKeyTab in JDK8. Contributed by Xiaoyu Yao.
(cherry picked from commit d6b181c6faa56e43c9f05d2cc860a0aeb940fd90)
2016-02-24 14:05:55 -08:00
cnauroth
9ea19a861f HADOOP-12535. Run FileSystem contract tests with hadoop-azure. Contributed by Madhumita Chakraborty.
(cherry picked from commit 3369a4f6916f12e9d6b97072badd1b176be443bd)
2016-02-23 21:37:56 -08:00
Colin Patrick Mccabe
7dfcf40352 HADOOP-12829. StatisticsDataReferenceCleaner swallows interrupt exceptions (Gregory Chanan via cmccabe)
(cherry picked from commit d9c409a4286e36387fb39e7d622e850c13315465)
2016-02-23 11:27:55 -08:00
cnauroth
a5511debdb HADOOP-12555. WASB to read credentials from a credential provider. Contributed by Larry McCay.
(cherry picked from commit 27b77751c1163ab4a1ce081a426e5190d1b8aff4)
2016-02-22 17:30:32 -08:00
Zhe Zhang
56b7f2c2c1 HADOOP-12668. Support excluding weak Ciphers in HttpServer2 through ssl-server.conf. Contributed by Vijay Singh.
Change-Id: Ie46a5427d29188935427f67e55203c19fcd83335
2016-02-22 14:14:39 -08:00
cnauroth
3f14eed580 HADOOP-11613. Remove commons-httpclient dependency from hadoop-azure. Contributed by Masatake Iwasaki.
(cherry picked from commit d4f5fc23b208635e8f9a14c375d4101141aefa4a)
2016-02-22 13:39:45 -08:00
Junping Du
e38c2ef6c5 Support additional compression levels for GzipCodec. Contributed by Ravi Mutyala.
(cherry picked from commit 18f9b77a321b225677ce23c503b41d21478fc4a7)
2016-02-19 14:22:39 -08:00
Yongjun Zhang
36c08f793a HADOOP-12828. Print user when services are started. (Wei-Chiu Chuang via Yongjun Zhang)
(cherry picked from commit a963baba10648859ad88d4ed9a4325b66b1af0d5)
2016-02-19 09:57:45 -08:00
cnauroth
b4c4f30fa4 HADOOP-11031. Design Document for Credential Provider API. Contributed by Larry McCay.
(cherry picked from commit 8ab7658025616d154decd97578de3327ec6f9109)
2016-02-18 14:07:09 -08:00
Tsz-Wo Nicholas Sze
38fc086940 HADOOP-10865. Add a Crc32 chunked verification benchmark for both directly and non-directly buffer cases. 2016-02-18 12:02:00 -08:00
Robert Kanter
f864faaafa HADOOP-12817. Enable TLS v1.1 and 1.2 (rkanter)
(cherry picked from commit a365a3941cf96a31c289cb22678a602738880f74)
2016-02-18 11:11:32 -08:00
cnauroth
779a69e28d HDFS-9711. Integrate CSRF prevention filter in WebHDFS. Contributed by Chris Nauroth.
(cherry picked from commit 5d1889a66d91608d34ca9411fb6e9161e637e9d3)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/web/DatanodeHttpServer.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java
2016-02-18 10:09:33 -08:00
Xiaoyu Yao
ad4fcd1f9f HDFS-8855. Webhdfs client leaks active NameNode connections. Contributed by Xiaobing Zhou.
(cherry picked from commit fe5624b85d71720ae9da90a01cad9a3d1ea41160)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/web/DatanodeHttpServer.java
2016-02-17 16:05:07 -08:00
Zhe Zhang
e226dbbc8a HDFS-9799. Reimplement getCurrentTrashDir to remove incompatibility. (zhz)
Change-Id: I7834bcebffed38cb384db5395ddb8b6dd9e79a0b
2016-02-17 13:31:48 -08:00
cnauroth
6731bb468d HADOOP-12548. Read s3a creds from a Credential Provider. Contributed by Larry McCay.
(cherry picked from commit 76fab26c5c02cef38924d04136407489fd9457d9)

Conflicts:
	hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java
2016-02-17 12:20:41 -08:00
Xiaoyu Yao
91c4a3a816 HADOOP-12878. KMS SPNEGO sequence does not work with WEBHDFS. Contributed by Xiaoyu Yao.
(cherry picked from commit fd1befb6ba450e45b1fcb3fb28b0da6c48daf6b3)
2016-02-17 08:44:37 -08:00
Masatake Iwasaki
3e80aece2e HADOOP-12710. Remove dependency on commons-httpclient for TestHttpServerLogs (Wei-Chiu Chuang via iwasakims)
(cherry picked from commit 1a1c2f5bab522ed39a35edbca30e6bed5a990992)
2016-02-18 00:25:20 +09:00
Vinayakumar B
2bf5a005fa HADOOP-12810. FileSystem#listLocatedStatus causes unnecessary RPC calls (Contributed by Ryan Blue)
(cherry picked from commit 96ea3094315bb1e1a5e268e3817c7fdedc3e9462)
2016-02-17 10:15:08 +05:30
Vinayakumar B
e79a5e4460 HADOOP-12805. Annotate CanUnbuffer with @InterfaceAudience.Public (Contributed by Ted Yu)
(cherry picked from commit 4b0e59fdc010be517dd67ddf35c962da204df547)
2016-02-16 17:32:35 +05:30
Akira Ajisaka
a670165bbd HADOOP-12786. "hadoop key" command usage is not documented. Contributed by Xiao Chen.
(cherry picked from commit 1c48e50ce71fd0e38740d69ce1e03119dca97a38)
2016-02-15 11:38:54 +09:00
Junping Du
a28be9edc7 Set the release date for 2.6.4.
(cherry picked from commit ec12ce8f48944c38271399a6e452aa2c2a9f5b80)
2016-02-13 01:44:12 -08:00
Masatake Iwasaki
7a67f8f709 HADOOP-12589. Fix intermittent test failure of TestCopyPreserveFlag (iwasakims)
(cherry picked from commit 36ba5cac37dee6b60e607401ac06d263e4ac5d8f)
2016-02-13 15:01:08 +09:00
cnauroth
ac5a793590 HADOOP-12780. During WASB atomic rename handle crash when one directory has been renamed but not file under it. Contributed by Madhumita Chakraborty.
(cherry picked from commit 91a96eaa534dbb27e81b6c24bbb8138200a80a83)
2016-02-12 15:50:19 -08:00
Arpit Agarwal
63f51208a8 HDFS-9801. ReconfigurableBase should update the cached configuration. (Arpit Agarwal) 2016-02-12 12:41:12 -08:00
Vinayakumar B
488e6cbe16 HADOOP-12776. Remove getaclstatus call for non-acl commands in getfacl. (Contributed by Brahma Reddy Battula)
(cherry picked from commit c78740a979c1b434c6595b302bd376fc3d432509)
2016-02-12 11:55:16 +05:30
Karthik Kambatla
383f3ff28c HDFS-9780. RollingFileSystemSink doesn't work on secure clusters. (Daniel Templeton via kasha)
(cherry picked from commit 33ce7f6c072144f55be30c66099eef5bc736405e)
2016-02-11 20:45:23 -08:00
Andrew Wang
fb57c01eaa HADOOP-12699. TestKMS#testKMSProvider intermittently fails during 'test rollover draining'. Contributed by Xiao Chen.
(cherry picked from commit 8fdef0bd9d1ece560ab4e1a1ec7fc77c46a034bb)
2016-02-11 17:21:50 -08:00
cnauroth
25dcb88630 HADOOP-12795. KMS does not log detailed stack trace for unexpected errors. Contributed by Chris Nauroth.
(cherry picked from commit 70c756d35e6ed5608ce82d1a6fbfb02e19af5ecf)
2016-02-11 16:53:12 -08:00
Zhe Zhang
dfd49a027e Add HADOOP-12764 to CHANGES.txt.
Change-Id: Ie32b71b7bd8892a3bb434aec12cdf2c43c61b897
2016-02-11 09:34:32 -08:00
Zhe Zhang
84dcd1a802 HADOOP-12764. Increase default value of KMS maxHttpHeaderSize and make it configurable. (zhz)
Change-Id: Iabb766f6311b83a1ac03093b0ba26a0284b74d70
2016-02-11 09:29:14 -08:00
Uma Maheswara Rao G
e90f7ef988 HADOOP-12788. OpensslAesCtrCryptoCodec should log which random number generator is used. Contributed by Wei-Chiu Chuang.
(cherry picked from commit df4dcd3e75f1f935bd9a537e63758fee71cf4e02)
2016-02-10 15:04:42 -08:00
Jason Lowe
fa9b3e6302 HADOOP-12792. TestUserGroupInformation#testGetServerSideGroups fails in chroot. Contributed by Eric Badger
(cherry picked from commit 6f03959e4dc0bc11030fd7e30a025447a4d6948a)
2016-02-10 21:54:50 +00:00
Sangjin Lee
463195dbe6 HADOOP-12773. HBase classes fail to load with client/job classloader enabled (sjlee)
(cherry picked from commit 58acbf940a92ef8a761208a7a743175ee7b3377d)
2016-02-08 13:57:44 -08:00
cnauroth
a76611d4ec HADOOP-12752. Improve diagnostics/use of envvar/sysprop credential propagation. Contributed by Steve Loughran.
(cherry picked from commit cf3261570ae139c177225af165557038a9280a5d)
2016-02-08 09:36:18 -08:00
Varun Vasudev
2451a0a8e0 HADOOP-12749. Create a threadpoolexecutor that overrides afterExecute to log uncaught exceptions/errors. Contributed by Sidharta Seethana.
(cherry picked from commit d37eb828ffa09d55936964f555ea351b946d286e)
2016-02-08 20:19:51 +05:30
Varun Vasudev
368a11f3dd Revert "HADOOP-12749. Create a threadpoolexecutor that overrides afterExecute to log uncaught exceptions/errors. Contributed by Sidharta Seethana."
This reverts commit f3bbe0bd020b9efe05d5918ad042d9d4d4b1ca57.

(cherry picked from commit af218101e50de0260ab74e5d2f96227a0541e121)
2016-02-08 20:17:10 +05:30
Varun Vasudev
fd971debee HADOOP-12749. Create a threadpoolexecutor that overrides afterExecute to log uncaught exceptions/errors. Contributed by Sidharta Seethana.
(cherry picked from commit f3bbe0bd020b9efe05d5918ad042d9d4d4b1ca57)
2016-02-08 14:23:19 +05:30
Andrew Wang
915ce5d960 HADOOP-12759. RollingFileSystemSink should eagerly rotate directories. Contributed by Daniel Templeton.
(cherry picked from commit 5b59a0ea85c923384e36ad7c036e751551774142)
2016-02-06 20:52:49 -08:00
Steve Loughran
60474a769e HADOOP-12292. Make use of DeleteObjects optional. (Thomas Demoor via stevel) 2016-02-06 18:20:24 +00:00
cnauroth
4db6cc44cd HADOOP-12426. Add Entry point for Kerberos health check. Contributed by Steve Loughran.
(cherry picked from commit cfa8513890ec1cd7f71258ff3c3083f6d89a4fc4)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/conf/hadoop-env.sh
2016-02-05 15:52:14 -08:00
cnauroth
5752df2362 HADOOP-12758. Extend CSRF Filter with UserAgent Checks. Contributed by Larry McCay.
(cherry picked from commit a37e423e8407c42988577d87907d13ce0432dda1)
2016-02-05 14:38:31 -08:00
Kihwal Lee
51a705432c HADOOP-12772. NetworkTopologyWithNodeGroup.getNodeGroup() can loop infinitely for invalid 'loc' values. Contributed by Kuhu Shukla.
(cherry picked from commit 49e176c29f95c179c0f6b07d4d582e6a771a96bd)
2016-02-05 15:47:56 -06:00