Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,855 Commits 326 Branches 371 Tags
Commit Graph

10855 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Akira Ajisaka
b4710b5052 HADOOP-12871. Fix dead link to NativeLibraries.html in CommandsManual.md. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 1c3136cbd8ff5f4eaf9c2c0145975439d0249db3)
(cherry picked from commit 96a0939d5bc26ff42262d9057f9e53c22d090e1d)
 2016-03-03 23:23:27 +09:00
Masatake Iwasaki
55f7ceb0db HDFS-9048. DistCp documentation is out-of-dated (Daisuke Kobayashi via iwasakims) 
(cherry picked from commit 33a412e8a4ab729d588a9576fb7eb90239c6e383)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2016-03-03 18:58:59 +09:00
Akira Ajisaka
85a62dcb5b HADOOP-12870. Fix typo admininistration in CommandsManual.md. Contributed by John Zhuge. 
(cherry picked from commit eb864d35d6c5f0c0af67032d5f6925aa123273af)
(cherry picked from commit 9e87f59dea25ebb90e7bc3ae640da25c4b8e9a82)
 2016-03-03 18:52:05 +09:00
Masatake Iwasaki
64213b5278 HADOOP-12793. Write a new group mapping service guide (Wei-Chiu Chuang via iwasakims) 
(cherry picked from commit f70e317cccf14185cc24ea3cb57ffc63b00158cc)
 2016-03-03 17:15:09 +09:00
Zhe Zhang
7dfe40a23b HDFS-9886. Configuration properties for hedged read is broken. Contributed by Akira AJISAKA. 2016-03-02 10:27:51 -08:00
Xiaoyu Yao
7b9a2bf278 HDFS-9887. WebHdfs socket timeouts should be configurable. Contributed by Austin Donnelly and Chris Douglas. 
(cherry picked from commit 5abf051249d485313dfffc6aeff6f81c0da1f623)
 2016-03-02 09:25:25 -08:00
Akira Ajisaka
e3d5863677 HDFS-9851. NameNode throws NPE when setPermission is called on a path that does not exist. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 27e0681f28ee896ada163bbbc08fd44d113e7d15)
(cherry picked from commit 463ec6fa8c7d4c925fdd62456b0d2621414ab7d7)
 2016-03-02 14:44:04 +09:00
Akira Ajisaka
b13bd04100 HDFS-9766. TestDataNodeMetrics#testDataNodeTimeSpend fails intermittently. Contributed by Xiao Chen. 
(cherry picked from commit 81fbc40f084eab85750cc7d4cc967d43d70d8333)
(cherry picked from commit e8401417269bc3515918566bb2860e3b70d1d3ed)
 2016-03-02 14:14:52 +09:00
Andrew Wang
90f39b899c HDFS-9881. DistributedFileSystem#getTrashRoot returns incorrect path for encryption zones. 
(cherry picked from commit 4abb2fa687a80d2b76f2751dd31513822601b235)
(cherry picked from commit 81b7b9de27300521b26c8598e3b7fbf88805e505)
 2016-03-01 16:35:46 -08:00
Kihwal Lee
2c8733a19d HDFS-9880. TestDatanodeRegistration fails occasionally. Contributed by Kihwal Lee. 
(cherry picked from commit e76b13c415459e4062c4c9660a16759a11ffb34a)
 2016-03-01 17:02:08 -06:00
Chris Nauroth
f563c53535 HADOOP-12853. Change WASB documentation regarding page blob support. Contributed by Madhumita Chakraborty. 
(cherry picked from commit f98dff329b1f94c9f53022baf0209fc1a7aaf7c2)
(cherry picked from commit bce33b51790b90f0655e36df3a0394f5691f8d6e)
 2016-03-01 13:19:03 -08:00
Jian He
c50f79d838 YARN-4671. There is no need to acquire CS lock when completing a container. Contributed by Meng Ding 2016-03-01 13:15:37 -08:00
Kihwal Lee
cc28118eed HDFS-8791. block ID-based DN storage layout can be very slow for datanode on ext4. Contributed by Chris Trezzo. 
(cherry picked from commit b8dbffbef87c0ee0bee5e17649586fc9f0e1f55b)
 2016-03-01 15:02:26 -06:00
Chris Nauroth
79ef70f861 HDFS-9870. Remove unused imports from DFSUtil. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 2137e8feeb5c5c88d3a80db3a334fd472f299ee4)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt

(cherry picked from commit 6659d13f12e697c1ff7b22d0a4ff5519d8adc1aa)
 2016-03-01 11:16:29 -08:00
Akira Ajisaka
aa896c767c HADOOP-12843. Fix findbugs warnings in hadoop-common (branch-2). (aajisaka) 
(cherry picked from commit 67e8489ac6df70e07d530017bb7ddee017e57e5b)
 2016-03-02 00:22:29 +09:00
Chris Nauroth
f1236c5d7c HADOOP-12851. S3AFileSystem Uptake of ProviderUtils.excludeIncompatibleCredentialProviders. Contributed by Larry McCay. 
(cherry picked from commit d251e55415f1fab085159b9eb3b43214d100b6a8)
(cherry picked from commit e402371b6a0854a89e7bd573b04e43fed5e3e9cf)
 2016-02-29 22:00:41 -08:00
Jian He
475a277e60 YARN-4748. ApplicationHistoryManagerOnTimelineStore should not swallow exceptions on generateApplicationReport. Contributed by Li Lu 
(cherry picked from commit d93c22ec274b1a0f29609217039b80732886fed7)
 2016-02-29 18:19:49 -08:00
Jian He
07623aa941 HADOOP-12622. Improve the loggings in RetryPolicies and RetryInvocationHandler. Contributed by Junping Du 
(cherry picked from commit d8f390d015510950ccf78174af8891cd613d4438)
 2016-02-29 16:25:00 -08:00
Haohui Mai
69b195d619 HADOOP-12813. Migrate TestRPC and related codes to rebase on ProtobufRpcEngine. Contributed by Kai Zheng. 2016-02-29 14:15:25 -08:00
Akira Ajisaka
7ddff4b37a HDFS-9864. Correct reference for RENEWDELEGATIONTOKEN and CANCELDELEGATIONTOKEN in webhdfs doc. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 056f9013122dc3f0effc62d620261c312dd7f8ed)
(cherry picked from commit 6a9f8d95b7c4f9c66253d975ebbca1d186267d4e)
 2016-02-29 18:42:48 +09:00
Masatake Iwasaki
c7824e8e9e HADOOP-12552. Fix undeclared/unused dependency to httpclient (iwasakims) 
(cherry picked from commit 809ebc0b146135d86433e9c7bfa17e294b7928f2)
 2016-02-29 18:26:09 +09:00
Suresh Srinivas
2cb1fd3bd3 HADOOP-9121. InodeTree.java has redundant check for vName while throwing exception. Contributed by Arup Malakar. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418005 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit a5331eeeadd1f248b6961078303d75d41f241919)
(cherry picked from commit fca24fbbaa1f8dd13514084f6cdee6a111b31765)
 2016-02-29 11:36:18 +09:00
Chris Nauroth
60611c9c75 HADOOP-12846. Credential Provider Recursive Dependencies. Contributed by Larry McCay. 
(cherry picked from commit 7634d404b750eafa135a37fa275325d0398255fb)
(cherry picked from commit 2e761dabd8b0458bb324a32b28c4a8daf31a69b5)
 2016-02-28 11:23:09 -08:00
Li Lu
8324199e5c HADOOP-12831. LocalFS/FSOutputSummer NPEs in constructor if bytes per checksum set to 0 (Mingliang Liu via gtcarrera9) 
(cherry-picked from commit 7545ce6636066a05763744a817878e03ee87f456)
 2016-02-27 22:04:23 -08:00
Steve Loughran
6218008591 HADOOP-12825. Log slow name resolutions. (Sidharta Seethana via stevel) 2016-02-27 20:05:35 +00:00
Chris Nauroth
d55863de0f HADOOP-12849. TestSymlinkLocalFSFileSystem fails intermittently. Contributed by Mingliang Liu. 
(cherry picked from commit 798babf661311264fa895c89a33d0f2da927da33)
(cherry picked from commit c692d7c52fa83da28ae69da164b4177456e21d76)
 2016-02-26 21:59:20 -08:00
Tsz-Wo Nicholas Sze
5b95971f8a HDFS-9710. DN can be configured to send block receipt IBRs in batches. 2016-02-26 15:34:41 -08:00
Xiaoyu Yao
fd9a0abba9 HDFS-9831. Document webhdfs retry configuration keys introduced by HDFS-5219/HDFS-5122. Contributed by Xiaobing Zhou. 
(cherry picked from commit 1513c0179eea1992d7b9526dd6f13e4ceda5cfb2)
 2016-02-26 14:26:40 -08:00
Jason Lowe
da9f00ac8b YARN-4723. NodesListManager$UnknownNodeId ClassCastException. Contributed by Kuhu Shukla 
(cherry picked from commit 6b0f813e898cbd14b2ae52ecfed6d30bce8cb6b7)
 2016-02-26 20:26:31 +00:00
Ming Ma
6f5ca1b293 YARN-4720. Skip unnecessary NN operations in log aggregation. (Jun Gong via mingma) 
(cherry picked from commit 7f3139e54da2c496327446a5eac43f8421fc8839)
 2016-02-26 08:49:51 -08:00
Suresh Srinivas
cf8bcc73c2 HADOOP-8818. Use equals instead == in MD5MD5CRC32FileChecksum and TFileDumper. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1385374 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 0c53ed4cd122f87b2b041d670b9b59e27da5439c)
(cherry picked from commit 7b64e5805747f7be8ad1b8cbcefc7a312350a199)
 2016-02-27 01:26:31 +09:00
Kihwal Lee
e862fe7f02 HDFS-9855. Modify TestAuditLoggerWithCommands to workaround the absence of HDFS-8332. Contributed by Kuhu Shukla. 
(cherry picked from commit 03afcdd39d61ccebd4e7b7903115213cee1bf92d)
 2016-02-26 10:23:45 -06:00
Masatake Iwasaki
7140a02122 HADOOP-12711. Remove dependency on commons-httpclient for ServletUtil (Wei-Chiu Chuang via iwasakims) 
(cherry picked from commit b0091338f2ffea0fb16fed01c44f911490d94c70)
 2016-02-26 15:33:21 +09:00
Xiaoyu Yao
6e9a4c598d HADOOP-12824. Collect network and disk usage on the node running Windows. Contributed by Inigo Goiri. 2016-02-25 15:49:26 -08:00
Chris Nauroth
27edd164a0 HDFS-9843. Document distcp options required for copying between encrypted locations. Contributed by Xiaoyu Yao. 
(cherry picked from commit dbbfc58c33fd1d2f7abae1784c2d78b7438825e2)
(cherry picked from commit 4892f6a0eb23d3dd8c8abdbfe9450737af242e99)
 2016-02-24 15:16:27 -08:00
Li Lu
b22f4db3a0 YARN-4680. TimerTasks leak in ATS V1.5 Writer. (Xuan Gong via 
gtcarrera9)

(cherry picked from commit 9e0f7b8b69ead629f999aa86c8fb7eb581e175d8)
 2016-02-24 14:08:28 -08:00
cnauroth
d4bbdd9d28 HADOOP-12716. KerberosAuthenticator#doSpnegoSequence use incorrect class to determine isKeyTab in JDK8. Contributed by Xiaoyu Yao. 
(cherry picked from commit d6b181c6faa56e43c9f05d2cc860a0aeb940fd90)
(cherry picked from commit ef9131fbcddc01a9d8cb3dfd0a729ed9d17d788e)
 2016-02-24 13:56:12 -08:00
cnauroth
d5dfb278d6 HDFS-9854. Log cipher suite negotiation more verbosely. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit d1dd248b756e5a323ac885eefd3f81a639d6b86f)
(cherry picked from commit 59cd23e279094ab0d0b42b3bf2c8c4a04ae2cd28)
 2016-02-24 12:18:23 -08:00
Kihwal Lee
69acab5f23 HDFS-9395. Make HDFS audit logging consistant. Contributed by Kuhu Shukla. 
(cherry picked from commit d27d7fc72e279614212c1eae52a84675073e89fb)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java

(cherry picked from commit 83f7f62be379045ad6933689b21b76c7086f919d)
 2016-02-24 12:12:41 -06:00
Sangjin Lee
6b59e59865 YARN-4722. AsyncDispatcher logs redundant event queue sizes (Jason Lowe via sjlee) 
(cherry picked from commit 553b591ba06bbf0b18dca674d25a48218fed0a26)
 2016-02-24 09:32:54 -08:00
cnauroth
8ad907f06a HADOOP-12535. Run FileSystem contract tests with hadoop-azure. Contributed by Madhumita Chakraborty. 
(cherry picked from commit 3369a4f6916f12e9d6b97072badd1b176be443bd)
(cherry picked from commit 9ea19a861f10ca6281eaed2ee5032af21eaa53b3)
 2016-02-23 21:38:01 -08:00
Zhe Zhang
bab4fb55c9 HDFS-9844. Correct path creation in getTrashRoot to handle root dir. 
Change-Id: I5afe6c7176063892e3e632698c849bd9f4b92906
 2016-02-23 13:30:47 -08:00
Jason Lowe
6f3f5a8c38 YARN-2046. Out of band heartbeats are sent only on container kill and possibly too early. Contributed by Ming Ma 
(cherry picked from commit d284e187b8db43056236032ebc2114ee462c27f6)
 2016-02-23 20:51:41 +00:00
Colin Patrick Mccabe
7812cfdd81 HDFS-9549. TestCacheDirectives#testExceedsCapacity is flaky (Xiao Chen via cmccabe) 
(cherry picked from commit 211c78c09073e5b34db309b49d8de939a7a812f5)
(cherry picked from commit 440379a0d4cafd2641a666b954ebc04ba0353f13)
 2016-02-23 12:06:16 -08:00
Junping Du
fe43f57c2a YARN-3223. Resource update during NM graceful decommission. Contributed by Brook Zhou. 
(cherry picked from commit 9ed17f181d96b8719a0ef54a129081948781d57e)
(cherry picked from commit e3ce0ffdc31c533e9ae1d74a14bcf57485968104)
 2016-02-23 03:41:27 -08:00
Tsuyoshi Ozawa
19a08eff6f HDFS-9084. Pagination, sorting and filtering of files/directories in the HDFS Web UI. (Contributed by Ravi Prakash) 
(cherry picked from commit 48c61cd6aa3feae6a4a71d2d1bb6d01a3d50c7b7)
 2016-02-23 19:31:33 +09:00
Varun Vasudev
cb4f5ebd3e MAPREDUCE-6635. Unsafe long to int conversion in UncompressedSplitLineReader and IndexOutOfBoundsException. Contributed by Junping Du. 
(cherry picked from commit c6f2d761d5430eac6b9f07f137a7028de4e0660c)
(cherry picked from commit f1999fe2754cbf11b138fb048c7486cab9b02c97)
 2016-02-23 13:07:40 +05:30
Varun Vasudev
5f68f640a5 YARN-4709. NMWebServices produces incorrect JSON for containers. Contributed by Varun Saxena. 
(cherry picked from commit 140cb5d74565aad848b40a251ec02b597a3a20d4)
(cherry picked from commit 2c218ca8a8da9bdea3ba052da10d87e5716c1d16)
 2016-02-23 12:33:11 +05:30
cnauroth
606547dbd2 HADOOP-12555. WASB to read credentials from a credential provider. Contributed by Larry McCay. 
(cherry picked from commit 27b77751c1163ab4a1ce081a426e5190d1b8aff4)
(cherry picked from commit a5511debdb63770b58e406926343a1a189225d78)
 2016-02-22 17:30:53 -08:00
Tsz-Wo Nicholas Sze
82cd1580d0 HDFS-8578. On upgrade, Datanode should process all storage/data dirs in parallel. Contributed by vinayakumarb and szetszwo 2016-02-22 15:16:59 -08:00