Commit Graph

10986 Commits

Author SHA1 Message Date
Akira Ajisaka 7ddff4b37a HDFS-9864. Correct reference for RENEWDELEGATIONTOKEN and CANCELDELEGATIONTOKEN in webhdfs doc. Contributed by Brahma Reddy Battula.
(cherry picked from commit 056f9013122dc3f0effc62d620261c312dd7f8ed)
(cherry picked from commit 6a9f8d95b7c4f9c66253d975ebbca1d186267d4e)
2016-02-29 18:42:48 +09:00
Masatake Iwasaki c7824e8e9e HADOOP-12552. Fix undeclared/unused dependency to httpclient (iwasakims)
(cherry picked from commit 809ebc0b14)
2016-02-29 18:26:09 +09:00
Suresh Srinivas 2cb1fd3bd3 HADOOP-9121. InodeTree.java has redundant check for vName while throwing exception. Contributed by Arup Malakar.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418005 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit a5331eeead)
(cherry picked from commit fca24fbbaa)
2016-02-29 11:36:18 +09:00
Chris Nauroth 60611c9c75 HADOOP-12846. Credential Provider Recursive Dependencies. Contributed by Larry McCay.
(cherry picked from commit 7634d404b7)
(cherry picked from commit 2e761dabd8)
2016-02-28 11:23:09 -08:00
Li Lu 8324199e5c HADOOP-12831. LocalFS/FSOutputSummer NPEs in constructor if bytes per checksum set to 0 (Mingliang Liu via gtcarrera9)
(cherry-picked from commit 7545ce6636)
2016-02-27 22:04:23 -08:00
Steve Loughran 6218008591 HADOOP-12825. Log slow name resolutions. (Sidharta Seethana via stevel) 2016-02-27 20:05:35 +00:00
Chris Nauroth d55863de0f HADOOP-12849. TestSymlinkLocalFSFileSystem fails intermittently. Contributed by Mingliang Liu.
(cherry picked from commit 798babf661)
(cherry picked from commit c692d7c52f)
2016-02-26 21:59:20 -08:00
Tsz-Wo Nicholas Sze 5b95971f8a HDFS-9710. DN can be configured to send block receipt IBRs in batches. 2016-02-26 15:34:41 -08:00
Xiaoyu Yao fd9a0abba9 HDFS-9831. Document webhdfs retry configuration keys introduced by HDFS-5219/HDFS-5122. Contributed by Xiaobing Zhou.
(cherry picked from commit 1513c0179e)
2016-02-26 14:26:40 -08:00
Jason Lowe da9f00ac8b YARN-4723. NodesListManager$UnknownNodeId ClassCastException. Contributed by Kuhu Shukla
(cherry picked from commit 6b0f813e89)
2016-02-26 20:26:31 +00:00
Ming Ma 6f5ca1b293 YARN-4720. Skip unnecessary NN operations in log aggregation. (Jun Gong via mingma)
(cherry picked from commit 7f3139e54d)
2016-02-26 08:49:51 -08:00
Suresh Srinivas cf8bcc73c2 HADOOP-8818. Use equals instead == in MD5MD5CRC32FileChecksum and TFileDumper. Contributed by Brandon Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1385374 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 0c53ed4cd1)
(cherry picked from commit 7b64e5805747f7be8ad1b8cbcefc7a312350a199)
2016-02-27 01:26:31 +09:00
Kihwal Lee e862fe7f02 HDFS-9855. Modify TestAuditLoggerWithCommands to workaround the absence of HDFS-8332. Contributed by Kuhu Shukla.
(cherry picked from commit 03afcdd39d)
2016-02-26 10:23:45 -06:00
Masatake Iwasaki 7140a02122 HADOOP-12711. Remove dependency on commons-httpclient for ServletUtil (Wei-Chiu Chuang via iwasakims)
(cherry picked from commit b0091338f2)
2016-02-26 15:33:21 +09:00
Xiaoyu Yao 6e9a4c598d HADOOP-12824. Collect network and disk usage on the node running Windows. Contributed by Inigo Goiri. 2016-02-25 15:49:26 -08:00
Chris Nauroth 27edd164a0 HDFS-9843. Document distcp options required for copying between encrypted locations. Contributed by Xiaoyu Yao.
(cherry picked from commit dbbfc58c33)
(cherry picked from commit 4892f6a0eb)
2016-02-24 15:16:27 -08:00
Li Lu b22f4db3a0 YARN-4680. TimerTasks leak in ATS V1.5 Writer. (Xuan Gong via
gtcarrera9)

(cherry picked from commit 9e0f7b8b69)
2016-02-24 14:08:28 -08:00
cnauroth d4bbdd9d28 HADOOP-12716. KerberosAuthenticator#doSpnegoSequence use incorrect class to determine isKeyTab in JDK8. Contributed by Xiaoyu Yao.
(cherry picked from commit d6b181c6fa)
(cherry picked from commit ef9131fbcddc01a9d8cb3dfd0a729ed9d17d788e)
2016-02-24 13:56:12 -08:00
cnauroth d5dfb278d6 HDFS-9854. Log cipher suite negotiation more verbosely. Contributed by Wei-Chiu Chuang.
(cherry picked from commit d1dd248b75)
(cherry picked from commit 59cd23e279)
2016-02-24 12:18:23 -08:00
Kihwal Lee 69acab5f23 HDFS-9395. Make HDFS audit logging consistant. Contributed by Kuhu Shukla.
(cherry picked from commit d27d7fc72e)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java

(cherry picked from commit 83f7f62be3)
2016-02-24 12:12:41 -06:00
Sangjin Lee 6b59e59865 YARN-4722. AsyncDispatcher logs redundant event queue sizes (Jason Lowe via sjlee)
(cherry picked from commit 553b591ba0)
2016-02-24 09:32:54 -08:00
cnauroth 8ad907f06a HADOOP-12535. Run FileSystem contract tests with hadoop-azure. Contributed by Madhumita Chakraborty.
(cherry picked from commit 3369a4f691)
(cherry picked from commit 9ea19a861f)
2016-02-23 21:38:01 -08:00
Zhe Zhang bab4fb55c9 HDFS-9844. Correct path creation in getTrashRoot to handle root dir.
Change-Id: I5afe6c7176063892e3e632698c849bd9f4b92906
2016-02-23 13:30:47 -08:00
Jason Lowe 6f3f5a8c38 YARN-2046. Out of band heartbeats are sent only on container kill and possibly too early. Contributed by Ming Ma
(cherry picked from commit d284e187b8)
2016-02-23 20:51:41 +00:00
Colin Patrick Mccabe 7812cfdd81 HDFS-9549. TestCacheDirectives#testExceedsCapacity is flaky (Xiao Chen via cmccabe)
(cherry picked from commit 211c78c090)
(cherry picked from commit 440379a0d4)
2016-02-23 12:06:16 -08:00
Junping Du fe43f57c2a YARN-3223. Resource update during NM graceful decommission. Contributed by Brook Zhou.
(cherry picked from commit 9ed17f181d)
(cherry picked from commit e3ce0ffdc3)
2016-02-23 03:41:27 -08:00
Tsuyoshi Ozawa 19a08eff6f HDFS-9084. Pagination, sorting and filtering of files/directories in the HDFS Web UI. (Contributed by Ravi Prakash)
(cherry picked from commit 48c61cd6aa)
2016-02-23 19:31:33 +09:00
Varun Vasudev cb4f5ebd3e MAPREDUCE-6635. Unsafe long to int conversion in UncompressedSplitLineReader and IndexOutOfBoundsException. Contributed by Junping Du.
(cherry picked from commit c6f2d761d5)
(cherry picked from commit f1999fe275)
2016-02-23 13:07:40 +05:30
Varun Vasudev 5f68f640a5 YARN-4709. NMWebServices produces incorrect JSON for containers. Contributed by Varun Saxena.
(cherry picked from commit 140cb5d745)
(cherry picked from commit 2c218ca8a8)
2016-02-23 12:33:11 +05:30
cnauroth 606547dbd2 HADOOP-12555. WASB to read credentials from a credential provider. Contributed by Larry McCay.
(cherry picked from commit 27b77751c1)
(cherry picked from commit a5511debdb)
2016-02-22 17:30:53 -08:00
Tsz-Wo Nicholas Sze 82cd1580d0 HDFS-8578. On upgrade, Datanode should process all storage/data dirs in parallel. Contributed by vinayakumarb and szetszwo 2016-02-22 15:16:59 -08:00
Zhe Zhang 6d4a4e785b HADOOP-12668. Support excluding weak Ciphers in HttpServer2 through ssl-server.conf. Contributed by Vijay Singh.
Change-Id: Ie46a5427d29188935427f67e55203c19fcd83335
2016-02-22 14:15:11 -08:00
cnauroth 746d669847 HADOOP-11613. Remove commons-httpclient dependency from hadoop-azure. Contributed by Masatake Iwasaki.
(cherry picked from commit d4f5fc23b2)
(cherry picked from commit 3f14eed580)
2016-02-22 13:39:57 -08:00
Arpit Agarwal 08666fb87e HDFS-9842. dfs.datanode.balance.bandwidthPerSec should accept friendly size units. (Contributed by Lin Yiqun) 2016-02-22 11:34:26 -08:00
Junping Du 606672a5b1 YARN-4386. refreshNodesGracefully() should send recommission event to active RMNodes only. Contributed by Kuhu Shukla.
(cherry picked from commit 3fab88540f)
(cherry picked from commit 7402448387)
2016-02-22 07:39:52 -08:00
Akira Ajisaka 8ddf5822f3 YARN-4707. Remove the extra char (>) from SecureContainer.md. Contributed by Brahma Reddy Battula.
(cherry picked from commit 5e7d4d51f8)
(cherry picked from commit 34635f9e37)
2016-02-22 17:18:17 +09:00
Vinayakumar B 426f213088 HDFS-9425. Expose number of blocks per volume as a metric (Contributed by Brahma Reddy Battula)
(cherry picked from commit 342c9572bf)
(cherry picked from commit 2e3c35a835)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/BlockPoolSlice.java
2016-02-22 09:31:52 +05:30
Vinayakumar B 8ca8d218a4 HDFS-7452. skip StandbyException log for getCorruptFiles() (Contributed by Bramha Reddy Battula)
(cherry picked from commit f313516731)
(cherry picked from commit 3e76768f21)
2016-02-22 09:22:45 +05:30
Arpit Agarwal 4823fbb490 HDFS-9839. Reduce verbosity of processReport logging. (Contributed by Arpit Agarwal)
This closes #78
2016-02-20 23:20:28 -08:00
Andrew Wang d31660ef4a MAPREDUCE-6637. Testcase Failure : TestFileInputFormat.testSplitLocationInfo. Contributed by Brahma Reddy Battula.
(cherry picked from commit 37577852ba)
(cherry picked from commit 7f6737951a)
2016-02-19 16:33:44 -08:00
Junping Du e3ed99cfe0 Support additional compression levels for GzipCodec. Contributed by Ravi Mutyala.
(cherry picked from commit 18f9b77a32)
(cherry picked from commit e38c2ef6c5)
(cherry picked from commit 78a4c34894)
2016-02-19 14:34:56 -08:00
Yongjun Zhang 5a5f9ca1f0 HDFS-9764. DistCp doesn't print value for several arguments including -numListstatusThreads. (Wei-Chiu Chuang via Yongjun Zhang)
(cherry picked from commit ba1c9d484a)
2016-02-19 10:29:46 -08:00
Yongjun Zhang 62ba1e415a HADOOP-12828. Print user when services are started. (Wei-Chiu Chuang via Yongjun Zhang)
(cherry picked from commit a963baba10)
2016-02-19 09:58:09 -08:00
Tsz-Wo Nicholas Sze b30d71d450 Move HDFS-8923 to Release 2.8.0 in CHANGES.txt. 2016-02-18 18:44:23 -08:00
Tsz-Wo Nicholas Sze 11c6930a17 HDFS-8923. Add -source flag to balancer usage message. Contributed by Chris Trezzo 2016-02-18 18:39:45 -08:00
cnauroth 49602ef580 HADOOP-11031. Design Document for Credential Provider API. Contributed by Larry McCay.
(cherry picked from commit 8ab7658025)
(cherry picked from commit b4c4f30fa4)
2016-02-18 14:07:15 -08:00
Tsz-Wo Nicholas Sze 207ed9601f HADOOP-10865. Add a Crc32 chunked verification benchmark for both directly and non-directly buffer cases. 2016-02-18 11:59:58 -08:00
Kihwal Lee bb8079e553 HDFS-4946. Allow preferLocalNode in BlockPlacementPolicyDefault to be configurable. Contributed by James Kinley and Nathan Roberts.
(cherry picked from commit ba6d5ed955)
2016-02-18 13:28:17 -06:00
cnauroth e5c8a34446 HDFS-9711. Integrate CSRF prevention filter in WebHDFS. Contributed by Chris Nauroth.
(cherry picked from commit 5d1889a66d)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/web/DatanodeHttpServer.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java

(cherry picked from commit 779a69e28d)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
2016-02-18 10:16:06 -08:00
cnauroth 2e047429be HADOOP-12691. Move files to correct location.
(cherry picked from commit da77f423d1)
(cherry picked from commit 2b9ea68ef8)
2016-02-18 10:15:31 -08:00