Commit Graph

3435 Commits

Author SHA1 Message Date
Chris Nauroth 4892f6a0eb HDFS-9843. Document distcp options required for copying between encrypted locations. Contributed by Xiaoyu Yao.
(cherry picked from commit dbbfc58c33)
2016-02-24 15:16:13 -08:00
cnauroth 59cd23e279 HDFS-9854. Log cipher suite negotiation more verbosely. Contributed by Wei-Chiu Chuang.
(cherry picked from commit d1dd248b75)
2016-02-24 12:11:44 -08:00
Kihwal Lee 83f7f62be3 HDFS-9395. Make HDFS audit logging consistant. Contributed by Kuhu Shukla.
(cherry picked from commit d27d7fc72e)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
2016-02-24 12:08:43 -06:00
Zhe Zhang 9ecb71f92c HDFS-9844. Correct path creation in getTrashRoot to handle root dir.
Change-Id: I5afe6c7176063892e3e632698c849bd9f4b92906
2016-02-23 13:30:21 -08:00
Colin Patrick Mccabe 440379a0d4 HDFS-9549. TestCacheDirectives#testExceedsCapacity is flaky (Xiao Chen via cmccabe)
(cherry picked from commit 211c78c090)
2016-02-23 12:05:53 -08:00
Tsuyoshi Ozawa 56b82de6e1 HDFS-9084. Pagination, sorting and filtering of files/directories in the HDFS Web UI. (Contributed by Ravi Prakash)
(cherry picked from commit 48c61cd6aa)
2016-02-23 19:31:22 +09:00
Tsz-Wo Nicholas Sze 9b10373b2b HDFS-8578. On upgrade, Datanode should process all storage/data dirs in parallel. Contributed by vinayakumarb and szetszwo 2016-02-22 15:16:14 -08:00
Arpit Agarwal fef99bcae0 HDFS-9842. dfs.datanode.balance.bandwidthPerSec should accept friendly size units. (Contributed by Lin Yiqun) 2016-02-22 11:34:17 -08:00
Vinayakumar B 2e3c35a835 HDFS-9425. Expose number of blocks per volume as a metric (Contributed by Brahma Reddy Battula)
(cherry picked from commit 342c9572bf)
2016-02-22 09:29:47 +05:30
Vinayakumar B 3e76768f21 HDFS-7452. skip StandbyException log for getCorruptFiles() (Contributed by Bramha Reddy Battula)
(cherry picked from commit f313516731)
2016-02-22 09:22:12 +05:30
Arpit Agarwal 7660cfd91a HDFS-9839. Reduce verbosity of processReport logging. (Contributed by Arpit Agarwal)
This closes #78
2016-02-20 23:20:18 -08:00
Yongjun Zhang b144e0f15d HDFS-9764. DistCp doesn't print value for several arguments including -numListstatusThreads. (Wei-Chiu Chuang via Yongjun Zhang)
(cherry picked from commit ba1c9d484a)
2016-02-19 10:29:27 -08:00
Tsz-Wo Nicholas Sze 5faa2934e8 Move HDFS-8923 to Release 2.8.0 in CHANGES.txt. 2016-02-18 18:44:40 -08:00
Tsz-Wo Nicholas Sze 2a09f00ac3 HDFS-8923. Add -source flag to balancer usage message. Contributed by Chris Trezzo 2016-02-18 18:39:09 -08:00
Kihwal Lee b83348c2e3 HDFS-4946. Allow preferLocalNode in BlockPlacementPolicyDefault to be configurable. Contributed by James Kinley and Nathan Roberts.
(cherry picked from commit ba6d5ed955)
2016-02-18 13:27:39 -06:00
cnauroth 779a69e28d HDFS-9711. Integrate CSRF prevention filter in WebHDFS. Contributed by Chris Nauroth.
(cherry picked from commit 5d1889a66d)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/web/DatanodeHttpServer.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java
2016-02-18 10:09:33 -08:00
Akira Ajisaka c183f235f1 HDFS-6832. Fix the usage of 'hdfs namenode' command. Contributed by Manjunath Ballur.
(cherry picked from commit e78d8e66f7)
2016-02-19 01:35:43 +09:00
Xiaoyu Yao ad4fcd1f9f HDFS-8855. Webhdfs client leaks active NameNode connections. Contributed by Xiaobing Zhou.
(cherry picked from commit fe5624b85d)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/web/DatanodeHttpServer.java
2016-02-17 16:05:07 -08:00
Zhe Zhang e226dbbc8a HDFS-9799. Reimplement getCurrentTrashDir to remove incompatibility. (zhz)
Change-Id: I7834bcebffed38cb384db5395ddb8b6dd9e79a0b
2016-02-17 13:31:48 -08:00
Andrew Wang c22aedac68 HDFS-9608. Disk IO imbalance in HDFS with heterogeneous storages. Contributed by Wei Zhou.
(cherry picked from commit 3a23dc683c)
2016-02-17 11:30:13 -08:00
Haohui Mai e7d1507e21 HDFS-9815. Move o.a.h.fs.Hdfs to hadoop-hdfs-client. Contributed by Vinayakumar B. 2016-02-17 10:56:57 -08:00
Junping Du 6874a142d8 HDFS-9456. BlockPlacementPolicyWithNodeGroup should override verifyBlockPlacement(). Contributed by Xiaobing Zhou.
(cherry picked from commit 77ba5add0d)
2016-02-16 19:00:52 -08:00
Akira Ajisaka 8dec72bfd7 HDFS-9765. TestBlockScanner#testVolumeIteratorWithCaching fails intermittently. (aajisaka)
(cherry picked from commit 8ed07bd3e6)
2016-02-15 19:08:35 +09:00
Akira Ajisaka 5e78264cde HDFS-9773. Remove dead code related to SimulatedFSDataset in tests. Contributed by Brahma Reddy Battula.
(cherry picked from commit b0738ae673)
2016-02-15 15:35:25 +09:00
Akira Ajisaka 75c5470165 HDFS-9691. TestBlockManagerSafeMode#testCheckSafeMode fails intermittently. Contributed by Mingliang Liu.
(cherry picked from commit ac5da11399)
2016-02-15 14:00:40 +09:00
Junping Du a28be9edc7 Set the release date for 2.6.4.
(cherry picked from commit ec12ce8f48)
2016-02-13 01:44:12 -08:00
Arpit Agarwal 63f51208a8 HDFS-9801. ReconfigurableBase should update the cached configuration. (Arpit Agarwal) 2016-02-12 12:41:12 -08:00
Jing Zhao f8c9c0ff0e HDFS-9754. Avoid unnecessary getBlockCollection calls in BlockManager. Contributed by Jing Zhao.
(cherry picked from commit 972782d956)
2016-02-12 11:40:28 -08:00
Arun Suresh f501c6dc49 HDFS-9797. Log Standby exceptions thrown by RequestHedgingProxyProvider at DEBUG Level (Inigo Goiri via asuresh)
(cherry picked from commit 9fdfb546fb)
2016-02-12 11:19:29 -08:00
Zhe Zhang 5e8be29ac9 HDFS-9644. Update encryption documentation to reflect nested EZs. (zhz)
Change-Id: I84ae96f4711a16ded46d501c51ca322bfca5151d
2016-02-12 10:46:51 -08:00
Masatake Iwasaki f71fa500f9 HDFS-9700. DFSClient and DFSOutputStream should set TCP_NODELAY on sockets for DataTransferProtocol (Gary Helmling via iwasakims)
(cherry picked from commit 372d1302c6)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/client/impl/DfsClientConf.java
2016-02-13 03:32:58 +09:00
Akira Ajisaka a714d04f5d HDFS-9768. Reuse ObjectMapper instance in HDFS to improve the performance. Contributed by Lin Yiqun.
(cherry picked from commit e6a7044b85)
2016-02-13 02:04:01 +09:00
Arpit Agarwal 7f1d18fec6 HDFS-9790. HDFS Balancer should exit with a proper message if upgrade is not finalized (Contributed by Xiaobing Zhou) 2016-02-11 21:18:45 -08:00
Karthik Kambatla 383f3ff28c HDFS-9780. RollingFileSystemSink doesn't work on secure clusters. (Daniel Templeton via kasha)
(cherry picked from commit 33ce7f6c07)
2016-02-11 20:45:23 -08:00
Karthik Kambatla ee4ace3edf HDFS-9637. Tests for RollingFileSystemSink. (Daniel Templeton via kasha) 2016-02-11 16:45:31 -08:00
Andrew Wang d489570755 HDFS-9788. Incompatible tag renumbering in HeartbeatResponseProto.
(cherry picked from commit aeb13ef2ab)
2016-02-10 15:26:14 -08:00
Akira Ajisaka a60a0a7128 HDFS-9686. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta.
(cherry picked from commit 802a7edfae)
2016-02-10 23:50:04 +09:00
Akira Ajisaka 15ef3a85d9 Revert "HDFS-9686. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta."
This reverts commit e4c01b8b1c.
2016-02-10 23:45:15 +09:00
Uma Maheswara Rao G 04ecce1ca9 HDFS-9779 . TestReplicationPolicyWithNodeGroup NODE variable picks wrong rack value. Contributed by Kuhu Shukla.
(cherry picked from commit a7fce9ab41)
2016-02-09 15:16:53 -08:00
Allen Wittenauer 73b195eccc HDFS-9760. WebHDFS AuthFilter cannot be configured with custom AltKerberos auth handler (Ryan Sasson via aw) 2016-02-09 14:16:12 -08:00
Akira Ajisaka cb53dfcc95 HDFS-9784. Example usage is not correct in Transparent Encryption document. Contributed by Ohnishi Takashi.
(cherry picked from commit 60d2011b7c)
2016-02-10 03:30:44 +09:00
Walter Su ac856893e7 Move HDFS-9347 from 2.8.0 to 2.6.5 in CHANGES.txt. 2016-02-09 10:53:45 +08:00
zhezhang ef9a81e875 HDFS-9244. Support nested encryption zones.
Change-Id: I43a13035a8b27956e90967ee82058efb647c3415
2016-02-08 16:31:41 -08:00
Uma Maheswara Rao G 44a020ed81 HDFS-9777. Fix typos in DFSAdmin command line and documentation.(Wei-Chiu Chuang via umamahesh)
(cherry picked from commit bffaa38a91)
2016-02-08 14:00:47 -08:00
Kihwal Lee 494cfd1dc4 HDFS-9752. Permanent write failures may happen to slow writers during datanode rolling upgrades. Contributed by Walter Su.
(cherry picked from commit 193d27de0a)
2016-02-08 12:17:07 -06:00
Uma Maheswara Rao G 82d4b2cf27 HDFS-9713. DataXceiver#copyBlock should return if block is pinned. Contributed by Uma Maheswara Rao G.
(cherry picked from commit aea31eee78)
2016-02-07 20:55:58 -08:00
Akira Ajisaka e4c01b8b1c HDFS-9686. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta.
(cherry picked from commit fe124da5ff)
2016-02-06 19:32:50 +09:00
cnauroth a7232f5e1d HDFS-9761. Rebalancer sleeps too long between iterations. Contributed by Mingliang Liu.
(cherry picked from commit c6497949e8)
2016-02-05 15:07:59 -08:00
Tsz-Wo Nicholas Sze 117397b89f HDFS-9726. Refactor IBR code to a new class. 2016-02-05 23:20:16 +08:00
Haohui Mai e62ca14856 HDFS-9724. Degraded performance in WebHDFS listing as it does not reuse ObjectMapper. Contributed by Akira Ajisaka. 2016-02-04 11:35:34 -08:00