Commit Graph

11013 Commits

Author SHA1 Message Date
Varun Vasudev 78919f8c34 YARN-4245. Generalize config file handling in container-executor. Contributed by Sidharta Seethana.
(cherry picked from commit 8ed2e060e8)
2016-03-07 16:19:27 +05:30
Varun Vasudev e9a0ffc7f1 YARN-4737. Add CSRF filter support in YARN. Contributed by Jonathan Maron.
(cherry picked from commit 43416187c07afb35e3267f94d0a41d8d3cfb5735)
2016-03-07 15:23:36 +05:30
Harsh J ed22444a60 MAPREDUCE-6648. Add yarn.app.mapreduce.am.log.level to mapred-default.xml (harsh) 2016-03-07 13:13:05 +05:30
Zhihai Xu 7ac7ca48b7 YARN-4761. NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations on fair scheduler. Contributed by Sangjin Lee
(cherry picked from commit e1ccc9622b)
2016-03-06 19:49:47 -08:00
Rohith Sharma K S 1415e6190a YARN-4763. RMApps Page crashes with NPE. (Bibin A Chundatt via rohithsharmaks)
(cherry picked from commit 77e2c3e8c7365b2aca00b6169829f87c63e4b460)
2016-03-05 13:07:20 +05:30
Chris Nauroth 2e60387401 HADOOP-12717. NPE when trying to rename a directory in Windows Azure Storage FileSystem. Contributed by Robert Yokota and Gaurav Kanade.
(cherry picked from commit c50aad0f85)
2016-03-04 22:57:56 -08:00
Chris Nauroth 592f161e13 HDFS-9239. DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness. Contributed by Chris Nauroth.
(cherry picked from commit 2759689d7d)
2016-03-04 15:30:28 -08:00
Yongjun Zhang 1d6c9486a4 HDFS-9889. Update balancer/mover document about HDFS-6133 feature. Contributed by Yongjun Zhang.
(cherry picked from commit 8e08861a14)
2016-03-04 13:28:10 -08:00
Masatake Iwasaki 722182fdfb HADOOP-12470. In-page TOC of documentation should be automatically generated by doxia macro (iwasakims)
(cherry picked from commit cbd31328a6)

 Conflicts:
	hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md
	hadoop-common-project/hadoop-common/src/site/markdown/UnixShellGuide.md
2016-03-04 14:12:44 +09:00
Andrew Wang 670944810c HADOOP-11792. Remove all of the CHANGES.txt files. 2016-03-03 21:02:58 -08:00
Allen Wittenauer f74ecffaa6 HADOOP-12651. Replace dev-support with wrappers to Yetus (aw)
(cherry picked from commit 2a867355df)
2016-03-03 20:54:34 -08:00
Allen Wittenauer b0d3b0c1f8 HADOOP-12651. Replace dev-support with wrappers to Yetus (aw)
(cherry picked from commit 8cecad2d56)

 Conflicts:
	dev-support/test-patch.sh
	hadoop-common-project/hadoop-common/pom.xml
2016-03-03 20:54:08 -08:00
Robert Kanter f9f57265cf MAPREDUCE-4785. TestMRApp occasionally fails (haibochen via rkanter)
(cherry picked from commit ff0ee84d77)
2016-03-03 16:38:25 -08:00
Akira Ajisaka 899715a15e HADOOP-12872. Fix formatting in ServiceLevelAuth.md. Contributed by Brahma Reddy Battula.
(cherry picked from commit 0a9f00af5e)
2016-03-03 23:32:51 +09:00
Akira Ajisaka 96a0939d5b HADOOP-12871. Fix dead link to NativeLibraries.html in CommandsManual.md. Contributed by Brahma Reddy Battula.
(cherry picked from commit 1c3136cbd8)
2016-03-03 23:23:12 +09:00
Masatake Iwasaki 8095c612a3 HDFS-9048. DistCp documentation is out-of-dated (Daisuke Kobayashi via iwasakims)
(cherry picked from commit 33a412e8a4)
2016-03-03 18:57:41 +09:00
Akira Ajisaka 9e87f59dea HADOOP-12870. Fix typo admininistration in CommandsManual.md. Contributed by John Zhuge.
(cherry picked from commit eb864d35d6)
2016-03-03 18:51:50 +09:00
Masatake Iwasaki 69e024f8fa HADOOP-12793. Write a new group mapping service guide (Wei-Chiu Chuang via iwasakims)
(cherry picked from commit f70e317ccc)
2016-03-03 17:14:53 +09:00
Arpit Agarwal 7b4a1001ea HDFS-9534. Add CLI command to clear storage policy from a path. (Contributed by Xiaobing Zhou) 2016-03-02 18:35:38 -08:00
Colin Patrick Mccabe 5998b20d63 HDFS-9835. OIV: add ReverseXML processor which reconstructs an fsimage from an XML file (cmccabe)
(cherry picked from commit 700b0e4019)
2016-03-02 18:18:45 -08:00
Zhe Zhang b97ac02c4b HDFS-9886. Configuration properties for hedged read is broken. Contributed by Akira AJISAKA. 2016-03-02 10:27:09 -08:00
Andrew Wang 3fecfe1352 HADOOP-12859. Disable hiding field style checks in class setters. Contributed by Kai Zheng.
(cherry picked from commit 480302b4ba)
2016-03-02 09:40:33 -08:00
Xiaoyu Yao 6bffe1a908 HDFS-9887. WebHdfs socket timeouts should be configurable. Contributed by Austin Donnelly and Chris Douglas.
(cherry picked from commit 5abf051249)
2016-03-02 09:24:46 -08:00
Akira Ajisaka 463ec6fa8c HDFS-9851. NameNode throws NPE when setPermission is called on a path that does not exist. Contributed by Brahma Reddy Battula.
(cherry picked from commit 27e0681f28)
2016-03-02 14:43:49 +09:00
Akira Ajisaka e840141726 HDFS-9766. TestDataNodeMetrics#testDataNodeTimeSpend fails intermittently. Contributed by Xiao Chen.
(cherry picked from commit 81fbc40f084eab85750cc7d4cc967d43d70d8333)
2016-03-02 14:14:27 +09:00
Andrew Wang 81b7b9de27 HDFS-9881. DistributedFileSystem#getTrashRoot returns incorrect path for encryption zones.
(cherry picked from commit 4abb2fa687)
2016-03-01 16:35:43 -08:00
Kihwal Lee bcbff207d6 HDFS-9880. TestDatanodeRegistration fails occasionally. Contributed by Kihwal Lee.
(cherry picked from commit e76b13c415)
2016-03-01 17:01:37 -06:00
Chris Nauroth bce33b5179 HADOOP-12853. Change WASB documentation regarding page blob support. Contributed by Madhumita Chakraborty.
(cherry picked from commit f98dff329b)
2016-03-01 13:18:57 -08:00
Jian He 023c2d2e56 YARN-4671. There is no need to acquire CS lock when completing a container. Contributed by Meng Ding 2016-03-01 13:14:51 -08:00
Kihwal Lee a823c30a9b HDFS-8791. block ID-based DN storage layout can be very slow for datanode on ext4. Contributed by Chris Trezzo.
(cherry picked from commit b8dbffbef87c0ee0bee5e17649586fc9f0e1f55b)
2016-03-01 15:03:32 -06:00
Chris Nauroth 6659d13f12 HDFS-9870. Remove unused imports from DFSUtil. Contributed by Brahma Reddy Battula.
(cherry picked from commit 2137e8feeb)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2016-03-01 11:16:21 -08:00
Akira Ajisaka 67e8489ac6 HADOOP-12843. Fix findbugs warnings in hadoop-common (branch-2). (aajisaka) 2016-03-02 00:20:57 +09:00
Chris Nauroth e402371b6a HADOOP-12851. S3AFileSystem Uptake of ProviderUtils.excludeIncompatibleCredentialProviders. Contributed by Larry McCay.
(cherry picked from commit d251e55415)
2016-02-29 22:00:27 -08:00
Karthik Kambatla c1855a33eb HADOOP-10321. TestCompositeService should cover all enumerations of adding a service to a parent service. (Ray Chiang via kasha)
(cherry picked from commit 680f3fc02d)
2016-02-29 19:00:22 -08:00
Jian He 589b537631 YARN-4748. ApplicationHistoryManagerOnTimelineStore should not swallow exceptions on generateApplicationReport. Contributed by Li Lu
(cherry picked from commit d93c22ec27)
2016-02-29 18:19:34 -08:00
Jian He 3e842de1d5 HADOOP-12622. Improve the loggings in RetryPolicies and RetryInvocationHandler. Contributed by Junping Du 2016-02-29 16:24:30 -08:00
Karthik Kambatla 84172b047b YARN-4704. TestResourceManager#testResourceAllocation() fails when using FairScheduler. (Yufei Gu via kasha)
(cherry picked from commit 9dafaaaf0d)
2016-02-29 16:10:26 -08:00
Jing Zhao 3cb7ae11a8 HDFS-7964. Add support for async edit logging. Contributed by Daryn Sharp.
(cherry picked from commit 2151716832)
2016-02-29 15:45:23 -08:00
Haohui Mai c5db4ab0b4 HADOOP-12813. Migrate TestRPC and related codes to rebase on ProtobufRpcEngine. Contributed by Kai Zheng. 2016-02-29 14:10:18 -08:00
Jason Lowe bd0f5085e3 YARN-4731. container-executor should not follow symlinks in recursive_unlink_children. Contributed by Colin Patrick McCabe
(cherry picked from commit c58a6d53c5)
2016-02-29 15:26:26 +00:00
Akira Ajisaka 531a081b01 HDFS-9864. Correct reference for RENEWDELEGATIONTOKEN and CANCELDELEGATIONTOKEN in webhdfs doc. Contributed by Brahma Reddy Battula.
(cherry picked from commit 056f9013122dc3f0effc62d620261c312dd7f8ed)
2016-02-29 18:42:35 +09:00
Masatake Iwasaki 32c7791a6c HADOOP-12552. Fix undeclared/unused dependency to httpclient (iwasakims)
(cherry picked from commit 809ebc0b14)
2016-02-29 18:23:33 +09:00
Rohith Sharma K S 2a1bb6cb67 YARN-4566. Fix test failure in TestMiniYarnClusterNodeUtilization. (Takashi Ohnishi via rohithsharmaks)
(cherry picked from commit e0b14f26f5)
2016-02-29 10:50:23 +08:00
Suresh Srinivas fca24fbbaa HADOOP-9121. InodeTree.java has redundant check for vName while throwing exception. Contributed by Arup Malakar.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418005 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit a5331eeead)
2016-02-29 11:35:19 +09:00
Chris Nauroth 2e761dabd8 HADOOP-12846. Credential Provider Recursive Dependencies. Contributed by Larry McCay.
(cherry picked from commit 7634d404b7)
2016-02-28 11:23:02 -08:00
Karthik Kambatla f3b37d8020 YARN-4718. Rename variables in SchedulerNode to reduce ambiguity post YARN-1011. (Inigo Goiri via kasha)
(cherry picked from commit f9692770a5)
2016-02-28 10:01:48 -08:00
Li Lu 090f74c741 HADOOP-12831. LocalFS/FSOutputSummer NPEs in constructor if bytes per checksum set to 0 (Mingliang Liu via gtcarrera9)
(cherry-picked from commit 7545ce6636)
2016-02-27 22:03:49 -08:00
Steve Loughran 4d870b1faa HADOOP-12825. Log slow name resolutions. (Sidharta Seethana via stevel) 2016-02-27 20:05:53 +00:00
Chris Nauroth c692d7c52f HADOOP-12849. TestSymlinkLocalFSFileSystem fails intermittently. Contributed by Mingliang Liu.
(cherry picked from commit 798babf661)
2016-02-26 21:59:14 -08:00
Robert Kanter 48cb4b9ba7 MAPREDUCE-6622. Add capability to set JHS job cache to a task-based limit (rchiang via rkanter)
(cherry picked from commit 0f72da7e28)
2016-02-26 17:57:45 -08:00