2968 Commits

Author SHA1 Message Date
Xiaoyu Yao
5ff2012f64 HDFS-8855. Webhdfs client leaks active NameNode connections. Contributed by Xiaobing Zhou.
(cherry picked from commit fe5624b85d71720ae9da90a01cad9a3d1ea41160)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/web/DatanodeHttpServer.java

(cherry picked from commit ad4fcd1f9f84cfef8dc8bb48ef7fbdd5c7c20c6a)
2016-02-17 16:05:24 -08:00
Zhe Zhang
64d39b83cc HDFS-9799. Reimplement getCurrentTrashDir to remove incompatibility. (zhz)
Change-Id: I7834bcebffed38cb384db5395ddb8b6dd9e79a0b
2016-02-17 13:32:18 -08:00
cnauroth
26ce37a1a6 HADOOP-12548. Read s3a creds from a Credential Provider. Contributed by Larry McCay.
(cherry picked from commit 76fab26c5c02cef38924d04136407489fd9457d9)

Conflicts:
	hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java

(cherry picked from commit 6731bb468dab743e0546e8e0fbbefaf46a1729c2)
2016-02-17 12:20:49 -08:00
Xiaoyu Yao
5953421544 HADOOP-12878. KMS SPNEGO sequence does not work with WEBHDFS. Contributed by Xiaoyu Yao.
(cherry picked from commit fd1befb6ba450e45b1fcb3fb28b0da6c48daf6b3)
2016-02-17 08:47:30 -08:00
Vinayakumar B
e88c01fa58 HADOOP-12810. FileSystem#listLocatedStatus causes unnecessary RPC calls (Contributed by Ryan Blue)
(cherry picked from commit 96ea3094315bb1e1a5e268e3817c7fdedc3e9462)
(cherry picked from commit 2bf5a005fab287689a148c1928f3b04c0a8dcedf)
2016-02-17 10:15:43 +05:30
Vinayakumar B
8d6fb15b03 HADOOP-12805. Annotate CanUnbuffer with @InterfaceAudience.Public (Contributed by Ted Yu)
(cherry picked from commit 4b0e59fdc010be517dd67ddf35c962da204df547)
(cherry picked from commit e79a5e4460b5199eebb0d788fdc1eaa36d6b0ac4)
2016-02-16 17:33:44 +05:30
Akira Ajisaka
bb02c3c803 HADOOP-12786. "hadoop key" command usage is not documented. Contributed by Xiao Chen.
(cherry picked from commit 1c48e50ce71fd0e38740d69ce1e03119dca97a38)
(cherry picked from commit a670165bbd743f8271375b67236b00e95ae238a1)
2016-02-15 11:39:09 +09:00
Junping Du
aed60ae0bf Set the release date for 2.6.4.
(cherry picked from commit ec12ce8f48944c38271399a6e452aa2c2a9f5b80)
(cherry picked from commit a28be9edc72cc4fe42fab107c17bcac6789af4e5)

Conflicts:

	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2016-02-13 01:48:50 -08:00
Masatake Iwasaki
e0fccc9c94 HADOOP-12589. Fix intermittent test failure of TestCopyPreserveFlag (iwasakims)
(cherry picked from commit 36ba5cac37dee6b60e607401ac06d263e4ac5d8f)
2016-02-13 15:02:15 +09:00
cnauroth
b846401307 HADOOP-12780. During WASB atomic rename handle crash when one directory has been renamed but not file under it. Contributed by Madhumita Chakraborty.
(cherry picked from commit 91a96eaa534dbb27e81b6c24bbb8138200a80a83)
(cherry picked from commit ac5a7935901255e5fc56b88574e72f875942b906)
2016-02-12 15:50:28 -08:00
Arpit Agarwal
8c1cf718aa HDFS-9801. ReconfigurableBase should update the cached configuration. (Arpit Agarwal) 2016-02-12 12:41:20 -08:00
Vinayakumar B
26934cf6c7 HADOOP-12776. Remove getaclstatus call for non-acl commands in getfacl. (Contributed by Brahma Reddy Battula)
(cherry picked from commit c78740a979c1b434c6595b302bd376fc3d432509)
(cherry picked from commit 488e6cbe16140f8e93bbf9a4c512211680c21777)
2016-02-12 11:56:00 +05:30
Andrew Wang
9afa321fd2 HADOOP-12699. TestKMS#testKMSProvider intermittently fails during 'test rollover draining'. Contributed by Xiao Chen.
(cherry picked from commit 8fdef0bd9d1ece560ab4e1a1ec7fc77c46a034bb)
(cherry picked from commit fb57c01eaaf572dee59e91e75d59237cf540d6d1)
2016-02-11 17:21:55 -08:00
cnauroth
ddd82d24be HADOOP-12795. KMS does not log detailed stack trace for unexpected errors. Contributed by Chris Nauroth.
(cherry picked from commit 70c756d35e6ed5608ce82d1a6fbfb02e19af5ecf)
(cherry picked from commit 25dcb88630eb4a6c30db4f20323beeb7fd2584cc)
2016-02-11 16:53:21 -08:00
Zhe Zhang
66a19d675e Add HADOOP-12764 to CHANGES.txt.
Change-Id: Ie32b71b7bd8892a3bb434aec12cdf2c43c61b897
2016-02-11 09:35:06 -08:00
Zhe Zhang
9023751de6 HADOOP-12764. Increase default value of KMS maxHttpHeaderSize and make it configurable. (zhz)
Change-Id: Iabb766f6311b83a1ac03093b0ba26a0284b74d70
2016-02-11 09:29:45 -08:00
Uma Maheswara Rao G
4324a3d012 HADOOP-12788. OpensslAesCtrCryptoCodec should log which random number generator is used. Contributed by Wei-Chiu Chuang.
(cherry picked from commit df4dcd3e75f1f935bd9a537e63758fee71cf4e02)
2016-02-10 15:07:33 -08:00
Jason Lowe
cad1436570 HADOOP-12792. TestUserGroupInformation#testGetServerSideGroups fails in chroot. Contributed by Eric Badger
(cherry picked from commit 6f03959e4dc0bc11030fd7e30a025447a4d6948a)
2016-02-10 21:55:53 +00:00
Sangjin Lee
13bb016ba9 HADOOP-12773. HBase classes fail to load with client/job classloader enabled (sjlee)
(cherry picked from commit 58acbf940a92ef8a761208a7a743175ee7b3377d)
2016-02-08 13:59:10 -08:00
cnauroth
44c6277d01 HADOOP-12752. Improve diagnostics/use of envvar/sysprop credential propagation. Contributed by Steve Loughran.
(cherry picked from commit cf3261570ae139c177225af165557038a9280a5d)
(cherry picked from commit a76611d4ec8f78faae436d7bdff31f4ae6d0d6fd)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2016-02-08 09:36:58 -08:00
Steve Loughran
f4bcc76df6 HADOOP-12292. Make use of DeleteObjects optional. (Thomas Demoor via stevel) 2016-02-06 18:17:30 +00:00
cnauroth
be115634f2 HADOOP-12426. Add Entry point for Kerberos health check. Contributed by Steve Loughran.
(cherry picked from commit cfa8513890ec1cd7f71258ff3c3083f6d89a4fc4)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/conf/hadoop-env.sh

(cherry picked from commit 4db6cc44cd1f1b2692ad3fdc18798cf5f32250ec)
2016-02-05 15:52:26 -08:00
cnauroth
e01d8393b6 HADOOP-12758. Extend CSRF Filter with UserAgent Checks. Contributed by Larry McCay.
(cherry picked from commit a37e423e8407c42988577d87907d13ce0432dda1)
(cherry picked from commit 5752df23622495cd288747e61b3644c4137251db)
2016-02-05 14:38:40 -08:00
Kihwal Lee
150240cce0 HADOOP-12772. NetworkTopologyWithNodeGroup.getNodeGroup() can loop infinitely for invalid 'loc' values. Contributed by Kuhu Shukla.
(cherry picked from commit 49e176c29f95c179c0f6b07d4d582e6a771a96bd)
2016-02-05 15:48:32 -06:00
Colin Patrick Mccabe
4fb2a098f4 HADOOP-12766. The default value of "hadoop.workaround.non.threadsafe.getpwuid" is different between core-default.xml and NativeIO.java (Akira AJISAKA via cmccabe)
(cherry picked from commit 9086dd58c3fc391ffdc017a913e56d1801040c7a)
(cherry picked from commit 86760c0f528ed50cf6211ba6592f6f226b085b90)
2016-02-05 10:58:39 -08:00
Xiaoyu Yao
740a1385d2 HADOOP-12771. Fix typo in JvmPauseMonitor#getNumGcWarnThreadholdExceeded. Contributed by Xiaobing Zhou.
(cherry picked from commit 5d00067ca7f1460bbda1330e7329205a7b1ce019)
2016-02-05 10:41:02 -08:00
Xuan
acd90c6819 YARN-4662. Document some newly added metrics. Contributed by Jian He
(cherry picked from commit 63c63e298cf9ff252532297deedde15e77323809)
(cherry picked from commit dfad608b22b5b90f4a13a14fc8786c24c7dacbb9)
2016-02-03 20:06:57 -08:00
Sangjin Lee
b49ac969bc HADOOP-12761. incremental maven build is not really incremental (sjlee)
(cherry picked from commit 4dc0a3949386ce2961356143a5a843dd537829dc)
2016-02-03 09:02:02 -08:00
Junping Du
847158811b Adding release 2.6.5 to CHANGES.txt 2016-02-02 18:36:39 -08:00
Andrew Wang
1d15c90233 HADOOP-12755. Fix typo in defaultFS warning message.
(cherry picked from commit 8171874dd198a6d10f48211f311595b222e6b930)
(cherry picked from commit b4ad58796b70954804ad96f0c15381ad13e7a8ea)
2016-02-02 11:57:00 -08:00
Colin Patrick Mccabe
bc00b8ce9e HADOOP-12735. core-default.xml misspells hadoop.workaround.non.threadsafe.getpwuid (Ray Chiang via cmccabe)
(cherry picked from commit 2e8ab3d46568162af6aa90b612ed61d487e7c7b0)
(cherry picked from commit b94fbdf6f080a95ad8f2d787bc8e219e8eeea0f6)
2016-01-27 11:40:59 -08:00
Yongjun Zhang
62206dd2ed HADOOP-12718. Incorrect error message by fs -put local dir without permission. (John Zhuge via Yongjun Zhang)
(cherry picked from commit 97056c3355810a803f07baca89b89e2bf6bb7201)
2016-01-27 08:05:33 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
3efc72ccd5 Release process for 2.7.2: Set the release date for 2.7.2
(cherry picked from commit ec4d2d9f40c1cb52ca4561b3d010ffc046a73495)
2016-01-25 15:47:39 -08:00
Walter Su
26673b312d HADOOP-12715. TestValueQueue#testgetAtMostPolicyALL fails intermittently. Contributed by Xiao Chen.
(cherry picked from commit 6eacdea0e475b4fff91cedce5005a7c11749cf64)
2016-01-25 19:43:21 +08:00
Akira Ajisaka
c25ab5814c HADOOP-12736. TestTimedOutTestsListener#testThreadDumpAndDeadlocks sometimes times out. Contributed by Xiao Chen.
(cherry picked from commit 643227927a7d7974655627d7e97aae42600692ae)
(cherry picked from commit 38ec290455a61a53f1f2c8fcc06f914de52fd5e2)
2016-01-25 14:00:03 +09:00
Akira Ajisaka
d228bf1de3 HADOOP-12731. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta.
(cherry picked from commit 736eb17a796a1c1ad5f4db2c6a64f6752db7bec3)
(cherry picked from commit 4edd7bd82094dd8c1474a912532e6373cedf79c9)
2016-01-25 13:48:46 +09:00
Kihwal Lee
330876689b HDFS-8898. Create API and command-line argument to get quota and quota usage without detailed content summary. Contributed by Ming Ma.
(cherry picked from commit b5db1d44104a8ac4c3643cc3ac841f75f31c8345)
2016-01-22 09:20:39 -06:00
Akira Ajisaka
2097016ab1 HADOOP-12730. Hadoop streaming -mapper and -reducer options are wrongly documented as required. Contributed by Kengo Seki.
(cherry picked from commit 0bae506c221f9736d08a6fba00ce5a862ab43cce)
(cherry picked from commit 6368d102b993e2bda08272ed368b9be912c0abbe)
2016-01-22 21:09:23 +09:00
Xiaoyu Yao
67f711edba HADOOP-12659. Incorrect usage of config parameters in token manager of KMS. Contributed by Mingliang Liu.
(cherry picked from commit f3427d3766d7101d0d1c37d6281918551d221ebe)
2016-01-21 13:56:09 -08:00
Akira Ajisaka
68509ae839 HADOOP-7161. Remove unnecessary oro package from dependency management section. Contributed by Sean Busbey.
(cherry picked from commit 2ac39ca762fd7e47b7b9a7b3308b31138b0f59be)
(cherry picked from commit cd5c66b080b7b60050a5d39be48163ad9e650ef0)
2016-01-22 02:46:04 +09:00
Vinayakumar B
a02fab85ee HADOOP-12423. Handle failure of registering shutdownhook by ShutdownHookManager in static block (Contributed by Abhishek Agarwal)
(cherry picked from commit 446987e20aacd870e1bc3f950b2bd4bbda1f9571)
(cherry picked from commit c13929b385cf2eddcf580b242ffef1f88b7c5d40)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2016-01-21 20:14:31 +05:30
Colin Patrick Mccabe
de5175d216 HADOOP-12712. Fix some cmake plugin and native build warnings (cmccabe)
(cherry picked from commit b2c155f810888480d058512a326a5083e1bb4eaa)

 Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-maven-plugins/src/main/java/org/apache/hadoop/maven/plugin/cmakebuilder/CompileMojo.java
	hadoop-maven-plugins/src/main/java/org/apache/hadoop/maven/plugin/cmakebuilder/TestMojo.java
	hadoop-maven-plugins/src/main/java/org/apache/hadoop/maven/plugin/util/Exec.java
2016-01-21 16:04:05 +05:30
Lei Xu
b4b5468152 HDFS-9655. NN should start JVM pause monitor before loading fsimage. (John Zhuge via Lei (Eddy) Xu)
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNode.java
2016-01-20 14:35:59 -08:00
Ravi Prakash
a359dc87d4 HADOOP-12696. Add tests for S3FileSystem Contract. Contributed by Matt Paduano
(cherry picked from commit 1acc509b45d58c0eb7e83ea1ba13169410be0dbe)
(cherry picked from commit 2cbb8bbd728aab6d438c3051c970e4b4475b8e68)
2016-01-19 14:01:51 -08:00
Wangda Tan
5dc2e78c97 HADOOP-12356. Fix computing CPU usage statistics on Windows. (Inigo Goiri via wangda)
(cherry picked from commit 89d1fd5dac4bccf42d82686e146b02eb60d14736)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2016-01-19 21:31:35 +08:00
Akira Ajisaka
ca22066582 HDFS-9623. Update example configuration of block state change log in log4j.properties. Contributed by Masatake Iwasaki.
(cherry picked from commit 92c5f565fd5466eab4496c2413de2e8b2897a91f)
(cherry picked from commit 3a8d372518aefe3d25fc9107ae0220d6de8fa736)
2016-01-19 13:32:54 +09:00
cnauroth
ffc0d98886 HADOOP-12635. Adding Append API support for WASB. Contributed by Dushyanth.
(cherry picked from commit 8bc93db2e7c64830b6a662f28c8917a9eef4e7c9)
(cherry picked from commit 62d616621134cc5e68f4d5fd32f49ea4d731417c)
2016-01-18 09:13:31 -08:00
cnauroth
23d729f841 HADOOP-12691. Add CSRF Filter for REST APIs to Hadoop Common. Contributed by Larry McCay.
(cherry picked from commit 06f4ac0ccdc623283106f258644148d5e003f75c)
(cherry picked from commit 9600736d89fc8e55d39a31dac00a33755a58888c)
2016-01-18 09:09:56 -08:00
Ravi Prakash
5468c40fe7 HADOOP-12689. S3 filesystem operations stopped working correctly
(cherry picked from commit 2d16f40dab291a29b3fc005221b12fd587615d4e)
(cherry picked from commit 6330683778d684d539ae756226f62728776cc1d7)
2016-01-15 15:19:15 -08:00
Akira Ajisaka
8a23379283 HADOOP-12700. Remove unused import in TestCompressorDecompressor.java. Contributed by John Zhuge.
(cherry picked from commit f977366d9522ee31080e16db90972729fcfe256f)
(cherry picked from commit f0b1b531734bf0699f48ba0bd00ddc9a0a821493)
2016-01-15 10:58:20 +09:00