11003 Commits

Author SHA1 Message Date
Allen Wittenauer
f74ecffaa6 HADOOP-12651. Replace dev-support with wrappers to Yetus (aw)
(cherry picked from commit 2a867355dfce880bb82257508862ec26bc7f16b9)
2016-03-03 20:54:34 -08:00
Allen Wittenauer
b0d3b0c1f8 HADOOP-12651. Replace dev-support with wrappers to Yetus (aw)
(cherry picked from commit 8cecad2d564d89d0f56e98de80a6f9b0bcb39d7a)

 Conflicts:
	dev-support/test-patch.sh
	hadoop-common-project/hadoop-common/pom.xml
2016-03-03 20:54:08 -08:00
Robert Kanter
f9f57265cf MAPREDUCE-4785. TestMRApp occasionally fails (haibochen via rkanter)
(cherry picked from commit ff0ee84d77d9438f0954ae4e1497d63997bb7347)
2016-03-03 16:38:25 -08:00
Akira Ajisaka
899715a15e HADOOP-12872. Fix formatting in ServiceLevelAuth.md. Contributed by Brahma Reddy Battula.
(cherry picked from commit 0a9f00af5e11913935ebf426d9da74278dd011af)
2016-03-03 23:32:51 +09:00
Akira Ajisaka
96a0939d5b HADOOP-12871. Fix dead link to NativeLibraries.html in CommandsManual.md. Contributed by Brahma Reddy Battula.
(cherry picked from commit 1c3136cbd8ff5f4eaf9c2c0145975439d0249db3)
2016-03-03 23:23:12 +09:00
Masatake Iwasaki
8095c612a3 HDFS-9048. DistCp documentation is out-of-dated (Daisuke Kobayashi via iwasakims)
(cherry picked from commit 33a412e8a4ab729d588a9576fb7eb90239c6e383)
2016-03-03 18:57:41 +09:00
Akira Ajisaka
9e87f59dea HADOOP-12870. Fix typo admininistration in CommandsManual.md. Contributed by John Zhuge.
(cherry picked from commit eb864d35d6c5f0c0af67032d5f6925aa123273af)
2016-03-03 18:51:50 +09:00
Masatake Iwasaki
69e024f8fa HADOOP-12793. Write a new group mapping service guide (Wei-Chiu Chuang via iwasakims)
(cherry picked from commit f70e317cccf14185cc24ea3cb57ffc63b00158cc)
2016-03-03 17:14:53 +09:00
Arpit Agarwal
7b4a1001ea HDFS-9534. Add CLI command to clear storage policy from a path. (Contributed by Xiaobing Zhou) 2016-03-02 18:35:38 -08:00
Colin Patrick Mccabe
5998b20d63 HDFS-9835. OIV: add ReverseXML processor which reconstructs an fsimage from an XML file (cmccabe)
(cherry picked from commit 700b0e4019cf483f7532609711812150b8c44742)
2016-03-02 18:18:45 -08:00
Zhe Zhang
b97ac02c4b HDFS-9886. Configuration properties for hedged read is broken. Contributed by Akira AJISAKA. 2016-03-02 10:27:09 -08:00
Andrew Wang
3fecfe1352 HADOOP-12859. Disable hiding field style checks in class setters. Contributed by Kai Zheng.
(cherry picked from commit 480302b4ba932ff16b88081dac651f0a5c46c09b)
2016-03-02 09:40:33 -08:00
Xiaoyu Yao
6bffe1a908 HDFS-9887. WebHdfs socket timeouts should be configurable. Contributed by Austin Donnelly and Chris Douglas.
(cherry picked from commit 5abf051249d485313dfffc6aeff6f81c0da1f623)
2016-03-02 09:24:46 -08:00
Akira Ajisaka
463ec6fa8c HDFS-9851. NameNode throws NPE when setPermission is called on a path that does not exist. Contributed by Brahma Reddy Battula.
(cherry picked from commit 27e0681f28ee896ada163bbbc08fd44d113e7d15)
2016-03-02 14:43:49 +09:00
Akira Ajisaka
e840141726 HDFS-9766. TestDataNodeMetrics#testDataNodeTimeSpend fails intermittently. Contributed by Xiao Chen.
(cherry picked from commit 81fbc40f084eab85750cc7d4cc967d43d70d8333)
2016-03-02 14:14:27 +09:00
Andrew Wang
81b7b9de27 HDFS-9881. DistributedFileSystem#getTrashRoot returns incorrect path for encryption zones.
(cherry picked from commit 4abb2fa687a80d2b76f2751dd31513822601b235)
2016-03-01 16:35:43 -08:00
Kihwal Lee
bcbff207d6 HDFS-9880. TestDatanodeRegistration fails occasionally. Contributed by Kihwal Lee.
(cherry picked from commit e76b13c415459e4062c4c9660a16759a11ffb34a)
2016-03-01 17:01:37 -06:00
Chris Nauroth
bce33b5179 HADOOP-12853. Change WASB documentation regarding page blob support. Contributed by Madhumita Chakraborty.
(cherry picked from commit f98dff329b1f94c9f53022baf0209fc1a7aaf7c2)
2016-03-01 13:18:57 -08:00
Jian He
023c2d2e56 YARN-4671. There is no need to acquire CS lock when completing a container. Contributed by Meng Ding 2016-03-01 13:14:51 -08:00
Kihwal Lee
a823c30a9b HDFS-8791. block ID-based DN storage layout can be very slow for datanode on ext4. Contributed by Chris Trezzo.
(cherry picked from commit b8dbffbef87c0ee0bee5e17649586fc9f0e1f55b)
2016-03-01 15:03:32 -06:00
Chris Nauroth
6659d13f12 HDFS-9870. Remove unused imports from DFSUtil. Contributed by Brahma Reddy Battula.
(cherry picked from commit 2137e8feeb5c5c88d3a80db3a334fd472f299ee4)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2016-03-01 11:16:21 -08:00
Akira Ajisaka
67e8489ac6 HADOOP-12843. Fix findbugs warnings in hadoop-common (branch-2). (aajisaka) 2016-03-02 00:20:57 +09:00
Chris Nauroth
e402371b6a HADOOP-12851. S3AFileSystem Uptake of ProviderUtils.excludeIncompatibleCredentialProviders. Contributed by Larry McCay.
(cherry picked from commit d251e55415f1fab085159b9eb3b43214d100b6a8)
2016-02-29 22:00:27 -08:00
Karthik Kambatla
c1855a33eb HADOOP-10321. TestCompositeService should cover all enumerations of adding a service to a parent service. (Ray Chiang via kasha)
(cherry picked from commit 680f3fc02d0037d13c84a8b5c1a7e8729c0bcc94)
2016-02-29 19:00:22 -08:00
Jian He
589b537631 YARN-4748. ApplicationHistoryManagerOnTimelineStore should not swallow exceptions on generateApplicationReport. Contributed by Li Lu
(cherry picked from commit d93c22ec274b1a0f29609217039b80732886fed7)
2016-02-29 18:19:34 -08:00
Jian He
3e842de1d5 HADOOP-12622. Improve the loggings in RetryPolicies and RetryInvocationHandler. Contributed by Junping Du 2016-02-29 16:24:30 -08:00
Karthik Kambatla
84172b047b YARN-4704. TestResourceManager#testResourceAllocation() fails when using FairScheduler. (Yufei Gu via kasha)
(cherry picked from commit 9dafaaaf0de68ce7f5e495ea4b8e0ce036dc35a2)
2016-02-29 16:10:26 -08:00
Jing Zhao
3cb7ae11a8 HDFS-7964. Add support for async edit logging. Contributed by Daryn Sharp.
(cherry picked from commit 2151716832ad14932dd65b1a4e47e64d8d6cd767)
2016-02-29 15:45:23 -08:00
Haohui Mai
c5db4ab0b4 HADOOP-12813. Migrate TestRPC and related codes to rebase on ProtobufRpcEngine. Contributed by Kai Zheng. 2016-02-29 14:10:18 -08:00
Jason Lowe
bd0f5085e3 YARN-4731. container-executor should not follow symlinks in recursive_unlink_children. Contributed by Colin Patrick McCabe
(cherry picked from commit c58a6d53c58209a8f78ff64e04e9112933489fb5)
2016-02-29 15:26:26 +00:00
Akira Ajisaka
531a081b01 HDFS-9864. Correct reference for RENEWDELEGATIONTOKEN and CANCELDELEGATIONTOKEN in webhdfs doc. Contributed by Brahma Reddy Battula.
(cherry picked from commit 056f9013122dc3f0effc62d620261c312dd7f8ed)
2016-02-29 18:42:35 +09:00
Masatake Iwasaki
32c7791a6c HADOOP-12552. Fix undeclared/unused dependency to httpclient (iwasakims)
(cherry picked from commit 809ebc0b146135d86433e9c7bfa17e294b7928f2)
2016-02-29 18:23:33 +09:00
Rohith Sharma K S
2a1bb6cb67 YARN-4566. Fix test failure in TestMiniYarnClusterNodeUtilization. (Takashi Ohnishi via rohithsharmaks)
(cherry picked from commit e0b14f26f5201a149218276469434df511697acc)
2016-02-29 10:50:23 +08:00
Suresh Srinivas
fca24fbbaa HADOOP-9121. InodeTree.java has redundant check for vName while throwing exception. Contributed by Arup Malakar.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418005 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit a5331eeeadd1f248b6961078303d75d41f241919)
2016-02-29 11:35:19 +09:00
Chris Nauroth
2e761dabd8 HADOOP-12846. Credential Provider Recursive Dependencies. Contributed by Larry McCay.
(cherry picked from commit 7634d404b750eafa135a37fa275325d0398255fb)
2016-02-28 11:23:02 -08:00
Karthik Kambatla
f3b37d8020 YARN-4718. Rename variables in SchedulerNode to reduce ambiguity post YARN-1011. (Inigo Goiri via kasha)
(cherry picked from commit f9692770a58af0ab082eb7f15da9cbdcd177605b)
2016-02-28 10:01:48 -08:00
Li Lu
090f74c741 HADOOP-12831. LocalFS/FSOutputSummer NPEs in constructor if bytes per checksum set to 0 (Mingliang Liu via gtcarrera9)
(cherry-picked from commit 7545ce6636066a05763744a817878e03ee87f456)
2016-02-27 22:03:49 -08:00
Steve Loughran
4d870b1faa HADOOP-12825. Log slow name resolutions. (Sidharta Seethana via stevel) 2016-02-27 20:05:53 +00:00
Chris Nauroth
c692d7c52f HADOOP-12849. TestSymlinkLocalFSFileSystem fails intermittently. Contributed by Mingliang Liu.
(cherry picked from commit 798babf661311264fa895c89a33d0f2da927da33)
2016-02-26 21:59:14 -08:00
Robert Kanter
48cb4b9ba7 MAPREDUCE-6622. Add capability to set JHS job cache to a task-based limit (rchiang via rkanter)
(cherry picked from commit 0f72da7e281376f4fcbfbf3fb33f5d7fedcdb1aa)
2016-02-26 17:57:45 -08:00
Tsz-Wo Nicholas Sze
7b79567cf9 HDFS-9710. DN can be configured to send block receipt IBRs in batches. 2016-02-26 15:34:00 -08:00
Xiaoyu Yao
1513c0179e HDFS-9831. Document webhdfs retry configuration keys introduced by HDFS-5219/HDFS-5122. Contributed by Xiaobing Zhou. 2016-02-26 14:24:03 -08:00
Jason Lowe
0bd7ba4ea8 YARN-4723. NodesListManager$UnknownNodeId ClassCastException. Contributed by Kuhu Shukla
(cherry picked from commit 6b0f813e898cbd14b2ae52ecfed6d30bce8cb6b7)
2016-02-26 20:25:56 +00:00
Lei Xu
49a10a3cec HADOOP-12841. Update s3-related properties in core-default.xml. (Wei-Chiu Chuang via lei)
(cherry picked from commit 2093acf6b659d5a271b7e97f9b64652d7cf01eef)
2016-02-26 10:48:35 -08:00
Ming Ma
1656bcec5f YARN-4720. Skip unnecessary NN operations in log aggregation. (Jun Gong via mingma)
(cherry picked from commit 7f3139e54da2c496327446a5eac43f8421fc8839)
2016-02-26 08:43:14 -08:00
Suresh Srinivas
b1d497a7de HADOOP-8818. Use equals instead == in MD5MD5CRC32FileChecksum and TFileDumper. Contributed by Brandon Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1385374 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 0c53ed4cd122f87b2b041d670b9b59e27da5439c)
2016-02-27 01:27:00 +09:00
Kihwal Lee
03afcdd39d HDFS-9855. Modify TestAuditLoggerWithCommands to workaround the absence of HDFS-8332. Contributed by Kuhu Shukla. 2016-02-26 10:22:27 -06:00
Masatake Iwasaki
b0091338f2 HADOOP-12711. Remove dependency on commons-httpclient for ServletUtil (Wei-Chiu Chuang via iwasakims) 2016-02-26 15:32:07 +09:00
Robert Kanter
872b8d90a6 YARN-4579. Allow DefaultContainerExecutor container log directory permissions to be configurable (rchiang via rkanter)
(cherry picked from commit d7fdec1e6b465395d2faca6e404e329d20f6c3d8)
2016-02-25 16:40:05 -08:00
Karthik Kambatla
6722e17f6d HDFS-9858. RollingFileSystemSink can throw an NPE on non-secure clusters. (Daniel Templeton via kasha)
(cherry picked from commit c2460dad642feee1086442d33c30c24ec77236b9)
2016-02-25 16:36:07 -08:00