Commit Graph

10902 Commits

Author SHA1 Message Date
Masatake Iwasaki 64213b5278 HADOOP-12793. Write a new group mapping service guide (Wei-Chiu Chuang via iwasakims)
(cherry picked from commit f70e317ccc)
2016-03-03 17:15:09 +09:00
Zhe Zhang 7dfe40a23b HDFS-9886. Configuration properties for hedged read is broken. Contributed by Akira AJISAKA. 2016-03-02 10:27:51 -08:00
Xiaoyu Yao 7b9a2bf278 HDFS-9887. WebHdfs socket timeouts should be configurable. Contributed by Austin Donnelly and Chris Douglas.
(cherry picked from commit 5abf051249)
2016-03-02 09:25:25 -08:00
Akira Ajisaka e3d5863677 HDFS-9851. NameNode throws NPE when setPermission is called on a path that does not exist. Contributed by Brahma Reddy Battula.
(cherry picked from commit 27e0681f28)
(cherry picked from commit 463ec6fa8c)
2016-03-02 14:44:04 +09:00
Akira Ajisaka b13bd04100 HDFS-9766. TestDataNodeMetrics#testDataNodeTimeSpend fails intermittently. Contributed by Xiao Chen.
(cherry picked from commit 81fbc40f084eab85750cc7d4cc967d43d70d8333)
(cherry picked from commit e840141726)
2016-03-02 14:14:52 +09:00
Andrew Wang 90f39b899c HDFS-9881. DistributedFileSystem#getTrashRoot returns incorrect path for encryption zones.
(cherry picked from commit 4abb2fa687)
(cherry picked from commit 81b7b9de27)
2016-03-01 16:35:46 -08:00
Kihwal Lee 2c8733a19d HDFS-9880. TestDatanodeRegistration fails occasionally. Contributed by Kihwal Lee.
(cherry picked from commit e76b13c415)
2016-03-01 17:02:08 -06:00
Chris Nauroth f563c53535 HADOOP-12853. Change WASB documentation regarding page blob support. Contributed by Madhumita Chakraborty.
(cherry picked from commit f98dff329b)
(cherry picked from commit bce33b5179)
2016-03-01 13:19:03 -08:00
Jian He c50f79d838 YARN-4671. There is no need to acquire CS lock when completing a container. Contributed by Meng Ding 2016-03-01 13:15:37 -08:00
Kihwal Lee cc28118eed HDFS-8791. block ID-based DN storage layout can be very slow for datanode on ext4. Contributed by Chris Trezzo.
(cherry picked from commit b8dbffbef87c0ee0bee5e17649586fc9f0e1f55b)
2016-03-01 15:02:26 -06:00
Chris Nauroth 79ef70f861 HDFS-9870. Remove unused imports from DFSUtil. Contributed by Brahma Reddy Battula.
(cherry picked from commit 2137e8feeb)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt

(cherry picked from commit 6659d13f12)
2016-03-01 11:16:29 -08:00
Akira Ajisaka aa896c767c HADOOP-12843. Fix findbugs warnings in hadoop-common (branch-2). (aajisaka)
(cherry picked from commit 67e8489ac6)
2016-03-02 00:22:29 +09:00
Chris Nauroth f1236c5d7c HADOOP-12851. S3AFileSystem Uptake of ProviderUtils.excludeIncompatibleCredentialProviders. Contributed by Larry McCay.
(cherry picked from commit d251e55415)
(cherry picked from commit e402371b6a)
2016-02-29 22:00:41 -08:00
Jian He 475a277e60 YARN-4748. ApplicationHistoryManagerOnTimelineStore should not swallow exceptions on generateApplicationReport. Contributed by Li Lu
(cherry picked from commit d93c22ec27)
2016-02-29 18:19:49 -08:00
Jian He 07623aa941 HADOOP-12622. Improve the loggings in RetryPolicies and RetryInvocationHandler. Contributed by Junping Du
(cherry picked from commit d8f390d015)
2016-02-29 16:25:00 -08:00
Haohui Mai 69b195d619 HADOOP-12813. Migrate TestRPC and related codes to rebase on ProtobufRpcEngine. Contributed by Kai Zheng. 2016-02-29 14:15:25 -08:00
Akira Ajisaka 7ddff4b37a HDFS-9864. Correct reference for RENEWDELEGATIONTOKEN and CANCELDELEGATIONTOKEN in webhdfs doc. Contributed by Brahma Reddy Battula.
(cherry picked from commit 056f9013122dc3f0effc62d620261c312dd7f8ed)
(cherry picked from commit 6a9f8d95b7c4f9c66253d975ebbca1d186267d4e)
2016-02-29 18:42:48 +09:00
Masatake Iwasaki c7824e8e9e HADOOP-12552. Fix undeclared/unused dependency to httpclient (iwasakims)
(cherry picked from commit 809ebc0b14)
2016-02-29 18:26:09 +09:00
Suresh Srinivas 2cb1fd3bd3 HADOOP-9121. InodeTree.java has redundant check for vName while throwing exception. Contributed by Arup Malakar.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418005 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit a5331eeead)
(cherry picked from commit fca24fbbaa)
2016-02-29 11:36:18 +09:00
Chris Nauroth 60611c9c75 HADOOP-12846. Credential Provider Recursive Dependencies. Contributed by Larry McCay.
(cherry picked from commit 7634d404b7)
(cherry picked from commit 2e761dabd8)
2016-02-28 11:23:09 -08:00
Li Lu 8324199e5c HADOOP-12831. LocalFS/FSOutputSummer NPEs in constructor if bytes per checksum set to 0 (Mingliang Liu via gtcarrera9)
(cherry-picked from commit 7545ce6636)
2016-02-27 22:04:23 -08:00
Steve Loughran 6218008591 HADOOP-12825. Log slow name resolutions. (Sidharta Seethana via stevel) 2016-02-27 20:05:35 +00:00
Chris Nauroth d55863de0f HADOOP-12849. TestSymlinkLocalFSFileSystem fails intermittently. Contributed by Mingliang Liu.
(cherry picked from commit 798babf661)
(cherry picked from commit c692d7c52f)
2016-02-26 21:59:20 -08:00
Tsz-Wo Nicholas Sze 5b95971f8a HDFS-9710. DN can be configured to send block receipt IBRs in batches. 2016-02-26 15:34:41 -08:00
Xiaoyu Yao fd9a0abba9 HDFS-9831. Document webhdfs retry configuration keys introduced by HDFS-5219/HDFS-5122. Contributed by Xiaobing Zhou.
(cherry picked from commit 1513c0179e)
2016-02-26 14:26:40 -08:00
Jason Lowe da9f00ac8b YARN-4723. NodesListManager$UnknownNodeId ClassCastException. Contributed by Kuhu Shukla
(cherry picked from commit 6b0f813e89)
2016-02-26 20:26:31 +00:00
Ming Ma 6f5ca1b293 YARN-4720. Skip unnecessary NN operations in log aggregation. (Jun Gong via mingma)
(cherry picked from commit 7f3139e54d)
2016-02-26 08:49:51 -08:00
Suresh Srinivas cf8bcc73c2 HADOOP-8818. Use equals instead == in MD5MD5CRC32FileChecksum and TFileDumper. Contributed by Brandon Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1385374 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 0c53ed4cd1)
(cherry picked from commit 7b64e5805747f7be8ad1b8cbcefc7a312350a199)
2016-02-27 01:26:31 +09:00
Kihwal Lee e862fe7f02 HDFS-9855. Modify TestAuditLoggerWithCommands to workaround the absence of HDFS-8332. Contributed by Kuhu Shukla.
(cherry picked from commit 03afcdd39d)
2016-02-26 10:23:45 -06:00
Masatake Iwasaki 7140a02122 HADOOP-12711. Remove dependency on commons-httpclient for ServletUtil (Wei-Chiu Chuang via iwasakims)
(cherry picked from commit b0091338f2)
2016-02-26 15:33:21 +09:00
Xiaoyu Yao 6e9a4c598d HADOOP-12824. Collect network and disk usage on the node running Windows. Contributed by Inigo Goiri. 2016-02-25 15:49:26 -08:00
Chris Nauroth 27edd164a0 HDFS-9843. Document distcp options required for copying between encrypted locations. Contributed by Xiaoyu Yao.
(cherry picked from commit dbbfc58c33)
(cherry picked from commit 4892f6a0eb)
2016-02-24 15:16:27 -08:00
Li Lu b22f4db3a0 YARN-4680. TimerTasks leak in ATS V1.5 Writer. (Xuan Gong via
gtcarrera9)

(cherry picked from commit 9e0f7b8b69)
2016-02-24 14:08:28 -08:00
cnauroth d4bbdd9d28 HADOOP-12716. KerberosAuthenticator#doSpnegoSequence use incorrect class to determine isKeyTab in JDK8. Contributed by Xiaoyu Yao.
(cherry picked from commit d6b181c6fa)
(cherry picked from commit ef9131fbcddc01a9d8cb3dfd0a729ed9d17d788e)
2016-02-24 13:56:12 -08:00
cnauroth d5dfb278d6 HDFS-9854. Log cipher suite negotiation more verbosely. Contributed by Wei-Chiu Chuang.
(cherry picked from commit d1dd248b75)
(cherry picked from commit 59cd23e279)
2016-02-24 12:18:23 -08:00
Kihwal Lee 69acab5f23 HDFS-9395. Make HDFS audit logging consistant. Contributed by Kuhu Shukla.
(cherry picked from commit d27d7fc72e)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java

(cherry picked from commit 83f7f62be3)
2016-02-24 12:12:41 -06:00
Sangjin Lee 6b59e59865 YARN-4722. AsyncDispatcher logs redundant event queue sizes (Jason Lowe via sjlee)
(cherry picked from commit 553b591ba0)
2016-02-24 09:32:54 -08:00
cnauroth 8ad907f06a HADOOP-12535. Run FileSystem contract tests with hadoop-azure. Contributed by Madhumita Chakraborty.
(cherry picked from commit 3369a4f691)
(cherry picked from commit 9ea19a861f)
2016-02-23 21:38:01 -08:00
Zhe Zhang bab4fb55c9 HDFS-9844. Correct path creation in getTrashRoot to handle root dir.
Change-Id: I5afe6c7176063892e3e632698c849bd9f4b92906
2016-02-23 13:30:47 -08:00
Jason Lowe 6f3f5a8c38 YARN-2046. Out of band heartbeats are sent only on container kill and possibly too early. Contributed by Ming Ma
(cherry picked from commit d284e187b8)
2016-02-23 20:51:41 +00:00
Colin Patrick Mccabe 7812cfdd81 HDFS-9549. TestCacheDirectives#testExceedsCapacity is flaky (Xiao Chen via cmccabe)
(cherry picked from commit 211c78c090)
(cherry picked from commit 440379a0d4)
2016-02-23 12:06:16 -08:00
Junping Du fe43f57c2a YARN-3223. Resource update during NM graceful decommission. Contributed by Brook Zhou.
(cherry picked from commit 9ed17f181d)
(cherry picked from commit e3ce0ffdc3)
2016-02-23 03:41:27 -08:00
Tsuyoshi Ozawa 19a08eff6f HDFS-9084. Pagination, sorting and filtering of files/directories in the HDFS Web UI. (Contributed by Ravi Prakash)
(cherry picked from commit 48c61cd6aa)
2016-02-23 19:31:33 +09:00
Varun Vasudev cb4f5ebd3e MAPREDUCE-6635. Unsafe long to int conversion in UncompressedSplitLineReader and IndexOutOfBoundsException. Contributed by Junping Du.
(cherry picked from commit c6f2d761d5)
(cherry picked from commit f1999fe275)
2016-02-23 13:07:40 +05:30
Varun Vasudev 5f68f640a5 YARN-4709. NMWebServices produces incorrect JSON for containers. Contributed by Varun Saxena.
(cherry picked from commit 140cb5d745)
(cherry picked from commit 2c218ca8a8)
2016-02-23 12:33:11 +05:30
cnauroth 606547dbd2 HADOOP-12555. WASB to read credentials from a credential provider. Contributed by Larry McCay.
(cherry picked from commit 27b77751c1)
(cherry picked from commit a5511debdb)
2016-02-22 17:30:53 -08:00
Tsz-Wo Nicholas Sze 82cd1580d0 HDFS-8578. On upgrade, Datanode should process all storage/data dirs in parallel. Contributed by vinayakumarb and szetszwo 2016-02-22 15:16:59 -08:00
Zhe Zhang 6d4a4e785b HADOOP-12668. Support excluding weak Ciphers in HttpServer2 through ssl-server.conf. Contributed by Vijay Singh.
Change-Id: Ie46a5427d29188935427f67e55203c19fcd83335
2016-02-22 14:15:11 -08:00
cnauroth 746d669847 HADOOP-11613. Remove commons-httpclient dependency from hadoop-azure. Contributed by Masatake Iwasaki.
(cherry picked from commit d4f5fc23b2)
(cherry picked from commit 3f14eed580)
2016-02-22 13:39:57 -08:00
Arpit Agarwal 08666fb87e HDFS-9842. dfs.datanode.balance.bandwidthPerSec should accept friendly size units. (Contributed by Lin Yiqun) 2016-02-22 11:34:26 -08:00