Commit Graph

15780 Commits

Author SHA1 Message Date
Sunil G 165f07f51a YARN-6123. [YARN-5864] Add a test to make sure queues of orderingPolicy will be updated when childQueues is added or removed. Contributed by Wangda Tan. 2017-01-27 18:37:51 +05:30
Xiaoyu Yao 2034315763 HADOOP-14029. Fix KMSClientProvider for non-secure proxyuser use case. Contributed by Xiaoyu Yao. 2017-01-26 20:34:32 -08:00
Arpit Agarwal 7bc333ad41 HDFS-11374. Skip FSync in CreateEditsLog to speed up edit log generation. Contributed by Hanisha Koneru. 2017-01-26 16:21:25 -08:00
Masatake Iwasaki 55c9f6d747 HDFS-9884. Use doxia macro to generate in-page TOC of HDFS site documentation. (iwasakims) 2017-01-27 08:06:39 +09:00
Xiao Chen 88da9f6b67 Revert "HDFS-8377. Support HTTP/2 in datanode. Contributed by Duo Zhang."
This reverts commit ada233b7cd.
2017-01-26 13:42:50 -08:00
Karthik Kambatla c65f884fc7 MAPREDUCE-6829. Add peak memory usage counter for each task. (Miklos Szegedi via kasha) 2017-01-26 11:08:13 -08:00
Xiao Chen 44606aa850 HDFS-11364. Add a test to verify Audit log entries for setfacl/getfacl commands over FS shell. Contributed by Manoj Govindassamy. 2017-01-26 10:48:26 -08:00
Daniel Templeton f85b74ccf9 YARN-4975. Fair Scheduler: exception thrown when a parent queue marked 'parent' has configured child queues
(Contributed by Yufei Gu via Daniel Templeton)
2017-01-26 10:31:09 -08:00
Arpit Agarwal 7c1cc30b3c HDFS-11369. Change exception message in StorageLocationChecker. 2017-01-26 09:12:38 -08:00
Sangjin Lee 425a7e5028 YARN-3637. Handle localization sym-linking correctly at the YARN level. Contributed by Chris Trezzo. 2017-01-25 15:51:36 -08:00
Andrew Wang cd59b9ccab HADOOP-13989. Remove erroneous source jar option from hadoop-client shade configuration. Contributed by Joe Pallas. 2017-01-25 15:40:45 -08:00
Andrew Wang ff02bdfe65 Add CHANGES, RELEASENOTES, and jdiff for 3.0.0-alpha2 release. 2017-01-25 15:39:40 -08:00
Daniel Templeton a7463b6c88 MAPREDUCE-6808. Log map attempts as part of shuffle handler audit log (Contributed by Gergő Pásztor via Daniel Templeton) 2017-01-25 14:32:40 -08:00
Jason Lowe 9e19f758c1 YARN-5641. Localizer leaves behind tarballs after container is complete. Contributed by Eric Badger 2017-01-25 21:41:43 +00:00
Xiaoyu Yao a46933e8ce HADOOP-13988. KMSClientProvider does not work with WebHDFS and Apache Knox w/ProxyUser. Contributed by Greg Senia and Xiaoyu Yao. 2017-01-25 13:33:06 -08:00
Steve Loughran 7fc3e68a87 HADOOP-13433 Race in UGI.reloginFromKeytab. Contributed by Duo Zhang. 2017-01-25 21:29:27 +00:00
Karthik Kambatla abedb8a9d8 YARN-5830. FairScheduler: Avoid preempting AM containers. (Yufei Gu via kasha) 2017-01-25 12:17:28 -08:00
Jing Zhao b782bf2156 HDFS-11124. Report blockIds of internal blocks for EC files in Fsck. Contributed by Takanobu Asanuma. 2017-01-25 11:16:17 -08:00
Zhe Zhang 18e1d68209 HDFS-10534. NameNode WebUI should display DataNode usage histogram. Contributed by Kai Sasaki. 2017-01-25 09:58:39 -08:00
Jitendra Pandey 5a5652098c HDFS-11365. Log portnumber in PrivilegedNfsGatewayStarter. Contributed by Mukul Kumar Singh. 2017-01-24 21:58:02 -08:00
Xiao Chen 9c0a4d3e71 HADOOP-13990. Document KMS usage of CredentialProvider API. Contributed by John Zhuge. 2017-01-24 21:30:10 -08:00
Arpit Agarwal b57368b6f8 HDFS-11194. Maintain aggregated peer performance metrics on NameNode. 2017-01-24 16:58:20 -08:00
Junping Du 8528d85a68 YARN-6099. Improve webservice to list aggregated log files. Contributed by Xuan Gong. 2017-01-24 15:26:53 -08:00
Jason Lowe a33ce45e35 YARN-5547. NMLeveldbStateStore should be more tolerant of unknown keys. Contributed by Ajith S 2017-01-24 16:17:36 +00:00
Rohith Sharma K S 0101267d9d YARN-6082. Invalid REST api response for getApps since queueUsagePercentage is coming as INF. Contributed by Sunil G. 2017-01-24 10:59:55 +05:30
Sangjin Lee dc6ec97048 YARN-6117. SharedCacheManager does not start up. Contributed by Chris Trezzo. 2017-01-23 21:07:25 -08:00
Daniel Templeton a2c50127d1 YARN-6012. Remove node label (removeFromClusterNodeLabels) document is missing (Contributed by Ying Zhang via Daniel Templeton) 2017-01-23 17:42:54 -08:00
Wangda Tan ce832059db YARN-5864. Capacity Scheduler - Queue Priorities. (wangda) 2017-01-23 10:52:14 -08:00
Jason Lowe 69fa81679f YARN-5910. Support for multi-cluster delegation tokens. Contributed by Jian He 2017-01-23 17:12:51 +00:00
Sunil G 3fa0d540df YARN-6031. Application recovery has failed when node label feature is turned off during RM recovery. Contributed by Ying Zhang. 2017-01-23 12:19:35 +05:30
Eric Yang a847903b6e HADOOP-13119. Add ability to secure log servlet using proxy users. Contribute by Yuanbo Liu. 2017-01-21 15:43:18 -08:00
Akira Ajisaka 98c35bb1a4 HADOOP-13858. TestGridmixMemoryEmulation and TestResourceUsageEmulators fail on the environment other than Linux or Windows. 2017-01-21 17:31:20 +09:00
Lei Xu ccf2d66244 HADOOP-13962. Update ADLS SDK to 2.1.4. (John Zhuge via lei) 2017-01-21 10:52:40 +08:00
Ray Chiang 9bab85cadf YARN-6106. Document FairScheduler 'allowPreemptionFrom' queue property. (Yufei Gu via rchiang) 2017-01-20 14:08:25 -08:00
Wei-Chiu Chuang 355b907c09 HDFS-11121. Add assertions to BlockInfo#addStorage to protect from breaking reportedBlock-blockGroup mapping. Contributed by Takanobu Asanuma. 2017-01-21 05:56:22 +08:00
Andrew Wang d79c645b2e Update straggler 3.0.0-alpha2-SNAPSHOT versions to 3.0.0-alpha3-SNAPSHOT 2017-01-20 10:39:38 -08:00
Andrew Wang 8a2e1d4cbe HADOOP-14004. Missing hadoop-cloud-storage-project module in pom.xml. Contributed by Akira Ajisaka. 2017-01-20 10:36:31 -08:00
Lei Xu e015b56319 HADOOP-13956. Read ADLS credentials from Credential Provider. (John Zhuge via lei) 2017-01-20 14:48:04 +08:00
Ming Ma fdf7202992 Merge branch 'trunk' of https://git-wip-us.apache.org/repos/asf/hadoop into trunk 2017-01-19 22:31:43 -08:00
Ming Ma f3fb94be05 HDFS-11296. Maintenance state expiry should be an epoch time and not jvm monotonic. (Manoj Govindassamy via mingma) 2017-01-19 22:31:15 -08:00
Sangjin Lee b01514f65b YARN-5928. Move ATSv2 HBase backend code into a new module that is only dependent at runtime by yarn servers. Contributed by Haibo Chen. 2017-01-19 20:52:55 -08:00
Arpit Agarwal 60865c8ea0 HADOOP-14002. Document -DskipShade property in BUILDING.txt. Contributed by Hanisha Koneru. 2017-01-19 17:32:25 -08:00
Andrew Wang 5d8b80ea9b Preparing for 3.0.0-alpha3 development 2017-01-19 15:50:07 -08:00
Daniel Templeton f5839fd6df YARN-6028. Add document for container metrics (Contributed by Weiwei Yang via Daniel Templeton) 2017-01-19 12:45:17 -08:00
Jian He efc8faa1ba YARN-6104. RegistrySecurity overrides zookeeper sasl system properties. Contributed by Billie Rinaldi 2017-01-19 10:18:59 -08:00
Arun Suresh 7e8d32147c YARN-6110. Fix opportunistic containers documentation. (Akira Ajisaka via asuresh) 2017-01-19 06:14:28 -08:00
Steve Loughran 85e4961f60 HADOOP-13999 Add -DskipShade maven profile to disable jar shading to reduce compile time. Contributed by Arun Suresh 2017-01-19 11:49:40 +00:00
Steve Loughran ed33ce11dd HADOOP-13496. Include file lengths in Mismatch in length error for distcp. Contributed by Ted Yu
(cherry picked from commit 77401bd5fc)
2017-01-19 11:25:40 +00:00
Akira Ajisaka 1763467210 HADOOP-14001. Improve delegation token validity checking. 2017-01-19 17:56:39 +09:00
Lei Xu 78ae2aed8f HDFS-11259. Update fsck to display maintenance state info. (Manoj Govindassamy via lei) 2017-01-19 16:28:31 +08:00