2885 Commits

Author SHA1 Message Date
Li Lu
8324199e5c HADOOP-12831. LocalFS/FSOutputSummer NPEs in constructor if bytes per checksum set to 0 (Mingliang Liu via gtcarrera9)
(cherry-picked from commit 7545ce6636066a05763744a817878e03ee87f456)
2016-02-27 22:04:23 -08:00
Steve Loughran
6218008591 HADOOP-12825. Log slow name resolutions. (Sidharta Seethana via stevel) 2016-02-27 20:05:35 +00:00
Chris Nauroth
d55863de0f HADOOP-12849. TestSymlinkLocalFSFileSystem fails intermittently. Contributed by Mingliang Liu.
(cherry picked from commit 798babf661311264fa895c89a33d0f2da927da33)
(cherry picked from commit c692d7c52fa83da28ae69da164b4177456e21d76)
2016-02-26 21:59:20 -08:00
Suresh Srinivas
cf8bcc73c2 HADOOP-8818. Use equals instead == in MD5MD5CRC32FileChecksum and TFileDumper. Contributed by Brandon Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1385374 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 0c53ed4cd122f87b2b041d670b9b59e27da5439c)
(cherry picked from commit 7b64e5805747f7be8ad1b8cbcefc7a312350a199)
2016-02-27 01:26:31 +09:00
Masatake Iwasaki
7140a02122 HADOOP-12711. Remove dependency on commons-httpclient for ServletUtil (Wei-Chiu Chuang via iwasakims)
(cherry picked from commit b0091338f2ffea0fb16fed01c44f911490d94c70)
2016-02-26 15:33:21 +09:00
Xiaoyu Yao
6e9a4c598d HADOOP-12824. Collect network and disk usage on the node running Windows. Contributed by Inigo Goiri. 2016-02-25 15:49:26 -08:00
cnauroth
d4bbdd9d28 HADOOP-12716. KerberosAuthenticator#doSpnegoSequence use incorrect class to determine isKeyTab in JDK8. Contributed by Xiaoyu Yao.
(cherry picked from commit d6b181c6faa56e43c9f05d2cc860a0aeb940fd90)
(cherry picked from commit ef9131fbcddc01a9d8cb3dfd0a729ed9d17d788e)
2016-02-24 13:56:12 -08:00
cnauroth
8ad907f06a HADOOP-12535. Run FileSystem contract tests with hadoop-azure. Contributed by Madhumita Chakraborty.
(cherry picked from commit 3369a4f6916f12e9d6b97072badd1b176be443bd)
(cherry picked from commit 9ea19a861f10ca6281eaed2ee5032af21eaa53b3)
2016-02-23 21:38:01 -08:00
cnauroth
606547dbd2 HADOOP-12555. WASB to read credentials from a credential provider. Contributed by Larry McCay.
(cherry picked from commit 27b77751c1163ab4a1ce081a426e5190d1b8aff4)
(cherry picked from commit a5511debdb63770b58e406926343a1a189225d78)
2016-02-22 17:30:53 -08:00
Zhe Zhang
6d4a4e785b HADOOP-12668. Support excluding weak Ciphers in HttpServer2 through ssl-server.conf. Contributed by Vijay Singh.
Change-Id: Ie46a5427d29188935427f67e55203c19fcd83335
2016-02-22 14:15:11 -08:00
cnauroth
746d669847 HADOOP-11613. Remove commons-httpclient dependency from hadoop-azure. Contributed by Masatake Iwasaki.
(cherry picked from commit d4f5fc23b208635e8f9a14c375d4101141aefa4a)
(cherry picked from commit 3f14eed58055d30b7c2dcb9240355920ff48af7e)
2016-02-22 13:39:57 -08:00
Junping Du
e3ed99cfe0 Support additional compression levels for GzipCodec. Contributed by Ravi Mutyala.
(cherry picked from commit 18f9b77a321b225677ce23c503b41d21478fc4a7)
(cherry picked from commit e38c2ef6c54521a74cc2b787d78211f629aa07d8)
(cherry picked from commit 78a4c348940cd98548650c0a5adb981895cef201)
2016-02-19 14:34:56 -08:00
Yongjun Zhang
62ba1e415a HADOOP-12828. Print user when services are started. (Wei-Chiu Chuang via Yongjun Zhang)
(cherry picked from commit a963baba10648859ad88d4ed9a4325b66b1af0d5)
2016-02-19 09:58:09 -08:00
cnauroth
49602ef580 HADOOP-11031. Design Document for Credential Provider API. Contributed by Larry McCay.
(cherry picked from commit 8ab7658025616d154decd97578de3327ec6f9109)
(cherry picked from commit b4c4f30fa4fdb3bd9adcf669932b8633ab11fd25)
2016-02-18 14:07:15 -08:00
Tsz-Wo Nicholas Sze
207ed9601f HADOOP-10865. Add a Crc32 chunked verification benchmark for both directly and non-directly buffer cases. 2016-02-18 11:59:58 -08:00
cnauroth
e5c8a34446 HDFS-9711. Integrate CSRF prevention filter in WebHDFS. Contributed by Chris Nauroth.
(cherry picked from commit 5d1889a66d91608d34ca9411fb6e9161e637e9d3)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/web/DatanodeHttpServer.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java

(cherry picked from commit 779a69e28dfb6e520e7ebe08cfa76f2b03a0cee7)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
2016-02-18 10:16:06 -08:00
cnauroth
2e047429be HADOOP-12691. Move files to correct location.
(cherry picked from commit da77f423d142c4dda8810d4668edde3c7d2999e8)
(cherry picked from commit 2b9ea68ef8fbca524571eae27672323b4910464f)
2016-02-18 10:15:31 -08:00
Xiaoyu Yao
5ff2012f64 HDFS-8855. Webhdfs client leaks active NameNode connections. Contributed by Xiaobing Zhou.
(cherry picked from commit fe5624b85d71720ae9da90a01cad9a3d1ea41160)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/web/DatanodeHttpServer.java

(cherry picked from commit ad4fcd1f9f84cfef8dc8bb48ef7fbdd5c7c20c6a)
2016-02-17 16:05:24 -08:00
Zhe Zhang
64d39b83cc HDFS-9799. Reimplement getCurrentTrashDir to remove incompatibility. (zhz)
Change-Id: I7834bcebffed38cb384db5395ddb8b6dd9e79a0b
2016-02-17 13:32:18 -08:00
cnauroth
26ce37a1a6 HADOOP-12548. Read s3a creds from a Credential Provider. Contributed by Larry McCay.
(cherry picked from commit 76fab26c5c02cef38924d04136407489fd9457d9)

Conflicts:
	hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java

(cherry picked from commit 6731bb468dab743e0546e8e0fbbefaf46a1729c2)
2016-02-17 12:20:49 -08:00
Xiaoyu Yao
5953421544 HADOOP-12878. KMS SPNEGO sequence does not work with WEBHDFS. Contributed by Xiaoyu Yao.
(cherry picked from commit fd1befb6ba450e45b1fcb3fb28b0da6c48daf6b3)
2016-02-17 08:47:30 -08:00
Vinayakumar B
e88c01fa58 HADOOP-12810. FileSystem#listLocatedStatus causes unnecessary RPC calls (Contributed by Ryan Blue)
(cherry picked from commit 96ea3094315bb1e1a5e268e3817c7fdedc3e9462)
(cherry picked from commit 2bf5a005fab287689a148c1928f3b04c0a8dcedf)
2016-02-17 10:15:43 +05:30
Vinayakumar B
8d6fb15b03 HADOOP-12805. Annotate CanUnbuffer with @InterfaceAudience.Public (Contributed by Ted Yu)
(cherry picked from commit 4b0e59fdc010be517dd67ddf35c962da204df547)
(cherry picked from commit e79a5e4460b5199eebb0d788fdc1eaa36d6b0ac4)
2016-02-16 17:33:44 +05:30
Akira Ajisaka
bb02c3c803 HADOOP-12786. "hadoop key" command usage is not documented. Contributed by Xiao Chen.
(cherry picked from commit 1c48e50ce71fd0e38740d69ce1e03119dca97a38)
(cherry picked from commit a670165bbd743f8271375b67236b00e95ae238a1)
2016-02-15 11:39:09 +09:00
Junping Du
aed60ae0bf Set the release date for 2.6.4.
(cherry picked from commit ec12ce8f48944c38271399a6e452aa2c2a9f5b80)
(cherry picked from commit a28be9edc72cc4fe42fab107c17bcac6789af4e5)

Conflicts:

	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2016-02-13 01:48:50 -08:00
Masatake Iwasaki
e0fccc9c94 HADOOP-12589. Fix intermittent test failure of TestCopyPreserveFlag (iwasakims)
(cherry picked from commit 36ba5cac37dee6b60e607401ac06d263e4ac5d8f)
2016-02-13 15:02:15 +09:00
cnauroth
b846401307 HADOOP-12780. During WASB atomic rename handle crash when one directory has been renamed but not file under it. Contributed by Madhumita Chakraborty.
(cherry picked from commit 91a96eaa534dbb27e81b6c24bbb8138200a80a83)
(cherry picked from commit ac5a7935901255e5fc56b88574e72f875942b906)
2016-02-12 15:50:28 -08:00
Arpit Agarwal
8c1cf718aa HDFS-9801. ReconfigurableBase should update the cached configuration. (Arpit Agarwal) 2016-02-12 12:41:20 -08:00
Vinayakumar B
26934cf6c7 HADOOP-12776. Remove getaclstatus call for non-acl commands in getfacl. (Contributed by Brahma Reddy Battula)
(cherry picked from commit c78740a979c1b434c6595b302bd376fc3d432509)
(cherry picked from commit 488e6cbe16140f8e93bbf9a4c512211680c21777)
2016-02-12 11:56:00 +05:30
Andrew Wang
9afa321fd2 HADOOP-12699. TestKMS#testKMSProvider intermittently fails during 'test rollover draining'. Contributed by Xiao Chen.
(cherry picked from commit 8fdef0bd9d1ece560ab4e1a1ec7fc77c46a034bb)
(cherry picked from commit fb57c01eaaf572dee59e91e75d59237cf540d6d1)
2016-02-11 17:21:55 -08:00
cnauroth
ddd82d24be HADOOP-12795. KMS does not log detailed stack trace for unexpected errors. Contributed by Chris Nauroth.
(cherry picked from commit 70c756d35e6ed5608ce82d1a6fbfb02e19af5ecf)
(cherry picked from commit 25dcb88630eb4a6c30db4f20323beeb7fd2584cc)
2016-02-11 16:53:21 -08:00
Zhe Zhang
66a19d675e Add HADOOP-12764 to CHANGES.txt.
Change-Id: Ie32b71b7bd8892a3bb434aec12cdf2c43c61b897
2016-02-11 09:35:06 -08:00
Zhe Zhang
9023751de6 HADOOP-12764. Increase default value of KMS maxHttpHeaderSize and make it configurable. (zhz)
Change-Id: Iabb766f6311b83a1ac03093b0ba26a0284b74d70
2016-02-11 09:29:45 -08:00
Uma Maheswara Rao G
4324a3d012 HADOOP-12788. OpensslAesCtrCryptoCodec should log which random number generator is used. Contributed by Wei-Chiu Chuang.
(cherry picked from commit df4dcd3e75f1f935bd9a537e63758fee71cf4e02)
2016-02-10 15:07:33 -08:00
Jason Lowe
cad1436570 HADOOP-12792. TestUserGroupInformation#testGetServerSideGroups fails in chroot. Contributed by Eric Badger
(cherry picked from commit 6f03959e4dc0bc11030fd7e30a025447a4d6948a)
2016-02-10 21:55:53 +00:00
Sangjin Lee
13bb016ba9 HADOOP-12773. HBase classes fail to load with client/job classloader enabled (sjlee)
(cherry picked from commit 58acbf940a92ef8a761208a7a743175ee7b3377d)
2016-02-08 13:59:10 -08:00
cnauroth
44c6277d01 HADOOP-12752. Improve diagnostics/use of envvar/sysprop credential propagation. Contributed by Steve Loughran.
(cherry picked from commit cf3261570ae139c177225af165557038a9280a5d)
(cherry picked from commit a76611d4ec8f78faae436d7bdff31f4ae6d0d6fd)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2016-02-08 09:36:58 -08:00
Steve Loughran
f4bcc76df6 HADOOP-12292. Make use of DeleteObjects optional. (Thomas Demoor via stevel) 2016-02-06 18:17:30 +00:00
cnauroth
be115634f2 HADOOP-12426. Add Entry point for Kerberos health check. Contributed by Steve Loughran.
(cherry picked from commit cfa8513890ec1cd7f71258ff3c3083f6d89a4fc4)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/conf/hadoop-env.sh

(cherry picked from commit 4db6cc44cd1f1b2692ad3fdc18798cf5f32250ec)
2016-02-05 15:52:26 -08:00
cnauroth
e01d8393b6 HADOOP-12758. Extend CSRF Filter with UserAgent Checks. Contributed by Larry McCay.
(cherry picked from commit a37e423e8407c42988577d87907d13ce0432dda1)
(cherry picked from commit 5752df23622495cd288747e61b3644c4137251db)
2016-02-05 14:38:40 -08:00
Kihwal Lee
150240cce0 HADOOP-12772. NetworkTopologyWithNodeGroup.getNodeGroup() can loop infinitely for invalid 'loc' values. Contributed by Kuhu Shukla.
(cherry picked from commit 49e176c29f95c179c0f6b07d4d582e6a771a96bd)
2016-02-05 15:48:32 -06:00
Colin Patrick Mccabe
4fb2a098f4 HADOOP-12766. The default value of "hadoop.workaround.non.threadsafe.getpwuid" is different between core-default.xml and NativeIO.java (Akira AJISAKA via cmccabe)
(cherry picked from commit 9086dd58c3fc391ffdc017a913e56d1801040c7a)
(cherry picked from commit 86760c0f528ed50cf6211ba6592f6f226b085b90)
2016-02-05 10:58:39 -08:00
Xiaoyu Yao
740a1385d2 HADOOP-12771. Fix typo in JvmPauseMonitor#getNumGcWarnThreadholdExceeded. Contributed by Xiaobing Zhou.
(cherry picked from commit 5d00067ca7f1460bbda1330e7329205a7b1ce019)
2016-02-05 10:41:02 -08:00
Xuan
acd90c6819 YARN-4662. Document some newly added metrics. Contributed by Jian He
(cherry picked from commit 63c63e298cf9ff252532297deedde15e77323809)
(cherry picked from commit dfad608b22b5b90f4a13a14fc8786c24c7dacbb9)
2016-02-03 20:06:57 -08:00
Sangjin Lee
b49ac969bc HADOOP-12761. incremental maven build is not really incremental (sjlee)
(cherry picked from commit 4dc0a3949386ce2961356143a5a843dd537829dc)
2016-02-03 09:02:02 -08:00
Junping Du
847158811b Adding release 2.6.5 to CHANGES.txt 2016-02-02 18:36:39 -08:00
Andrew Wang
1d15c90233 HADOOP-12755. Fix typo in defaultFS warning message.
(cherry picked from commit 8171874dd198a6d10f48211f311595b222e6b930)
(cherry picked from commit b4ad58796b70954804ad96f0c15381ad13e7a8ea)
2016-02-02 11:57:00 -08:00
Colin Patrick Mccabe
bc00b8ce9e HADOOP-12735. core-default.xml misspells hadoop.workaround.non.threadsafe.getpwuid (Ray Chiang via cmccabe)
(cherry picked from commit 2e8ab3d46568162af6aa90b612ed61d487e7c7b0)
(cherry picked from commit b94fbdf6f080a95ad8f2d787bc8e219e8eeea0f6)
2016-01-27 11:40:59 -08:00
Yongjun Zhang
62206dd2ed HADOOP-12718. Incorrect error message by fs -put local dir without permission. (John Zhuge via Yongjun Zhang)
(cherry picked from commit 97056c3355810a803f07baca89b89e2bf6bb7201)
2016-01-27 08:05:33 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
3efc72ccd5 Release process for 2.7.2: Set the release date for 2.7.2
(cherry picked from commit ec4d2d9f40c1cb52ca4561b3d010ffc046a73495)
2016-01-25 15:47:39 -08:00