Commit Graph

11262 Commits

Author SHA1 Message Date
Tsz-Wo Nicholas Sze 38fc086940 HADOOP-10865. Add a Crc32 chunked verification benchmark for both directly and non-directly buffer cases. 2016-02-18 12:02:00 -08:00
Kihwal Lee b83348c2e3 HDFS-4946. Allow preferLocalNode in BlockPlacementPolicyDefault to be configurable. Contributed by James Kinley and Nathan Roberts.
(cherry picked from commit ba6d5ed955)
2016-02-18 13:27:39 -06:00
Robert Kanter f864faaafa HADOOP-12817. Enable TLS v1.1 and 1.2 (rkanter)
(cherry picked from commit a365a3941c)
2016-02-18 11:11:32 -08:00
cnauroth 779a69e28d HDFS-9711. Integrate CSRF prevention filter in WebHDFS. Contributed by Chris Nauroth.
(cherry picked from commit 5d1889a66d)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/web/DatanodeHttpServer.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java
2016-02-18 10:09:33 -08:00
Akira Ajisaka c183f235f1 HDFS-6832. Fix the usage of 'hdfs namenode' command. Contributed by Manjunath Ballur.
(cherry picked from commit e78d8e66f7)
2016-02-19 01:35:43 +09:00
Varun Vasudev 212c519ad3 MAPREDUCE-6634. Log uncaught exceptions/errors in various thread pools in mapreduce. Contributed by Sidharta Seethana.
(cherry picked from commit c50d1e54000c76880a041ce5959a2eb23c86bd35)
2016-02-18 14:19:01 +05:30
Rohith Sharma K S d4203c9aa2 YARN-4654. Yarn node label CLI should parse "=" correctly when trying to remove all labels on a node. (Naganarasimha G R via rohithsharmaks)
(cherry picked from commit c1afac3a98)
2016-02-18 14:17:04 +05:30
Sangjin Lee 23b5c71729 YARN-4690. Skip object allocation in FSAppAttempt#getResourceUsage when possible (Ming Ma via sjlee)
(cherry picked from commit 7de70680fe)
2016-02-17 21:05:10 -08:00
Karthik Kambatla 25c2597f9c YARN-4569. Remove incorrect part of maxResources in FairScheduler documentation. (Ray Chiang via kasha)
(cherry picked from commit a0c95b5fc4)
2016-02-17 18:43:41 -08:00
Karthik Kambatla 33c1988595 YARN-4689. FairScheduler: Cleanup preemptContainer to be more readable. (Kai Sasaki via kasha)
(cherry picked from commit 2ab4c476ed)
2016-02-17 18:28:08 -08:00
Xiaoyu Yao ad4fcd1f9f HDFS-8855. Webhdfs client leaks active NameNode connections. Contributed by Xiaobing Zhou.
(cherry picked from commit fe5624b85d)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/web/DatanodeHttpServer.java
2016-02-17 16:05:07 -08:00
Zhe Zhang e226dbbc8a HDFS-9799. Reimplement getCurrentTrashDir to remove incompatibility. (zhz)
Change-Id: I7834bcebffed38cb384db5395ddb8b6dd9e79a0b
2016-02-17 13:31:48 -08:00
cnauroth 6731bb468d HADOOP-12548. Read s3a creds from a Credential Provider. Contributed by Larry McCay.
(cherry picked from commit 76fab26c5c)

Conflicts:
	hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java
2016-02-17 12:20:41 -08:00
Andrew Wang c22aedac68 HDFS-9608. Disk IO imbalance in HDFS with heterogeneous storages. Contributed by Wei Zhou.
(cherry picked from commit 3a23dc683c)
2016-02-17 11:30:13 -08:00
Haohui Mai e7d1507e21 HDFS-9815. Move o.a.h.fs.Hdfs to hadoop-hdfs-client. Contributed by Vinayakumar B. 2016-02-17 10:56:57 -08:00
Xiaoyu Yao 91c4a3a816 HADOOP-12878. KMS SPNEGO sequence does not work with WEBHDFS. Contributed by Xiaoyu Yao.
(cherry picked from commit fd1befb6ba)
2016-02-17 08:44:37 -08:00
Masatake Iwasaki 3e80aece2e HADOOP-12710. Remove dependency on commons-httpclient for TestHttpServerLogs (Wei-Chiu Chuang via iwasakims)
(cherry picked from commit 1a1c2f5bab)
2016-02-18 00:25:20 +09:00
Tsuyoshi Ozawa a33cdfb875 MAPREDUCE-6341. addendum patch to fix typos. Contributed by John Michael Luy.
(cherry picked from commit 453e7e0d10)
2016-02-17 14:18:04 +09:00
Vinayakumar B 2bf5a005fa HADOOP-12810. FileSystem#listLocatedStatus causes unnecessary RPC calls (Contributed by Ryan Blue)
(cherry picked from commit 96ea309431)
2016-02-17 10:15:08 +05:30
Junping Du 6874a142d8 HDFS-9456. BlockPlacementPolicyWithNodeGroup should override verifyBlockPlacement(). Contributed by Xiaobing Zhou.
(cherry picked from commit 77ba5add0d)
2016-02-16 19:00:52 -08:00
Vinayakumar B e79a5e4460 HADOOP-12805. Annotate CanUnbuffer with @InterfaceAudience.Public (Contributed by Ted Yu)
(cherry picked from commit 4b0e59fdc0)
2016-02-16 17:32:35 +05:30
Akira Ajisaka 8dec72bfd7 HDFS-9765. TestBlockScanner#testVolumeIteratorWithCaching fails intermittently. (aajisaka)
(cherry picked from commit 8ed07bd3e6)
2016-02-15 19:08:35 +09:00
Akira Ajisaka 5e78264cde HDFS-9773. Remove dead code related to SimulatedFSDataset in tests. Contributed by Brahma Reddy Battula.
(cherry picked from commit b0738ae673)
2016-02-15 15:35:25 +09:00
Akira Ajisaka 75c5470165 HDFS-9691. TestBlockManagerSafeMode#testCheckSafeMode fails intermittently. Contributed by Mingliang Liu.
(cherry picked from commit ac5da11399)
2016-02-15 14:00:40 +09:00
Akira Ajisaka a670165bbd HADOOP-12786. "hadoop key" command usage is not documented. Contributed by Xiao Chen.
(cherry picked from commit 1c48e50ce7)
2016-02-15 11:38:54 +09:00
Jian He 68d98f70ba YARN-4653. Document YARN security model from the perspective of Application Developers. Contributed by Steve Loughran 2016-02-14 17:14:35 +08:00
Junping Du a28be9edc7 Set the release date for 2.6.4.
(cherry picked from commit ec12ce8f48)
2016-02-13 01:44:12 -08:00
Masatake Iwasaki 7a67f8f709 HADOOP-12589. Fix intermittent test failure of TestCopyPreserveFlag (iwasakims)
(cherry picked from commit 36ba5cac37)
2016-02-13 15:01:08 +09:00
cnauroth ac5a793590 HADOOP-12780. During WASB atomic rename handle crash when one directory has been renamed but not file under it. Contributed by Madhumita Chakraborty.
(cherry picked from commit 91a96eaa53)
2016-02-12 15:50:19 -08:00
Arpit Agarwal 63f51208a8 HDFS-9801. ReconfigurableBase should update the cached configuration. (Arpit Agarwal) 2016-02-12 12:41:12 -08:00
Jing Zhao f8c9c0ff0e HDFS-9754. Avoid unnecessary getBlockCollection calls in BlockManager. Contributed by Jing Zhao.
(cherry picked from commit 972782d956)
2016-02-12 11:40:28 -08:00
Arun Suresh f501c6dc49 HDFS-9797. Log Standby exceptions thrown by RequestHedgingProxyProvider at DEBUG Level (Inigo Goiri via asuresh)
(cherry picked from commit 9fdfb546fb)
2016-02-12 11:19:29 -08:00
Zhe Zhang 5e8be29ac9 HDFS-9644. Update encryption documentation to reflect nested EZs. (zhz)
Change-Id: I84ae96f4711a16ded46d501c51ca322bfca5151d
2016-02-12 10:46:51 -08:00
Masatake Iwasaki f71fa500f9 HDFS-9700. DFSClient and DFSOutputStream should set TCP_NODELAY on sockets for DataTransferProtocol (Gary Helmling via iwasakims)
(cherry picked from commit 372d1302c6)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/client/impl/DfsClientConf.java
2016-02-13 03:32:58 +09:00
Akira Ajisaka a714d04f5d HDFS-9768. Reuse ObjectMapper instance in HDFS to improve the performance. Contributed by Lin Yiqun.
(cherry picked from commit e6a7044b85)
2016-02-13 02:04:01 +09:00
Steve Loughran 2ea1913cad YARN-4682. AMRM client to log when AMRM token updated. (Prabhu Joseph via stevel) 2016-02-12 10:58:46 +00:00
Varun Vasudev dcead143fe YARN-4684. TestYarnCLI#testGetContainers failing in CN locale. Contributed by Bibin A Chundatt.
(cherry picked from commit 74e9d17a813baeb4e610eb5fdd8e289660346782)
2016-02-12 12:08:57 +05:30
Vinayakumar B 488e6cbe16 HADOOP-12776. Remove getaclstatus call for non-acl commands in getfacl. (Contributed by Brahma Reddy Battula)
(cherry picked from commit c78740a979)
2016-02-12 11:55:16 +05:30
Arpit Agarwal 7f1d18fec6 HDFS-9790. HDFS Balancer should exit with a proper message if upgrade is not finalized (Contributed by Xiaobing Zhou) 2016-02-11 21:18:45 -08:00
Karthik Kambatla 383f3ff28c HDFS-9780. RollingFileSystemSink doesn't work on secure clusters. (Daniel Templeton via kasha)
(cherry picked from commit 33ce7f6c07)
2016-02-11 20:45:23 -08:00
Karthik Kambatla d3a0bb6d32 HDFS-9637. Tests for RollingFileSystemSink. Addendum patch to add missing file. 2016-02-11 20:41:06 -08:00
Andrew Wang fb57c01eaa HADOOP-12699. TestKMS#testKMSProvider intermittently fails during 'test rollover draining'. Contributed by Xiao Chen.
(cherry picked from commit 8fdef0bd9d)
2016-02-11 17:21:50 -08:00
cnauroth 25dcb88630 HADOOP-12795. KMS does not log detailed stack trace for unexpected errors. Contributed by Chris Nauroth.
(cherry picked from commit 70c756d35e)
2016-02-11 16:53:12 -08:00
Karthik Kambatla ee4ace3edf HDFS-9637. Tests for RollingFileSystemSink. (Daniel Templeton via kasha) 2016-02-11 16:45:31 -08:00
Arun Suresh 6a238e4a6b YARN-2575. Create separate ACLs for Reservation create/update/delete/list ops (Sean Po via asuresh)
(cherry picked from commit 23f937e3b7)
2016-02-11 10:49:11 -08:00
Zhe Zhang dfd49a027e Add HADOOP-12764 to CHANGES.txt.
Change-Id: Ie32b71b7bd8892a3bb434aec12cdf2c43c61b897
2016-02-11 09:34:32 -08:00
Zhe Zhang 84dcd1a802 HADOOP-12764. Increase default value of KMS maxHttpHeaderSize and make it configurable. (zhz)
Change-Id: Iabb766f6311b83a1ac03093b0ba26a0284b74d70
2016-02-11 09:29:14 -08:00
Varun Vasudev 3a5b39e931 YARN-4655. Log uncaught exceptions/errors in various thread pools in YARN. Contributed by Sidharta Seethana.
(cherry picked from commit fa00d3e205)
2016-02-11 12:09:29 +05:30
Varun Vasudev 05b57c87f9 YARN-4628. Display application priority in yarn top. Contributed by Bibin A Chundatt.
(cherry picked from commit 663a80031c)
2016-02-11 12:00:32 +05:30
Jian He 0c9110d15e Move YARN-4519 in CHANGES.txt to 2.8 2016-02-11 10:19:42 +08:00