Commit Graph

15621 Commits

Author SHA1 Message Date
Sangjin Lee 425a7e5028 YARN-3637. Handle localization sym-linking correctly at the YARN level. Contributed by Chris Trezzo. 2017-01-25 15:51:36 -08:00
Andrew Wang cd59b9ccab HADOOP-13989. Remove erroneous source jar option from hadoop-client shade configuration. Contributed by Joe Pallas. 2017-01-25 15:40:45 -08:00
Andrew Wang ff02bdfe65 Add CHANGES, RELEASENOTES, and jdiff for 3.0.0-alpha2 release. 2017-01-25 15:39:40 -08:00
Daniel Templeton a7463b6c88 MAPREDUCE-6808. Log map attempts as part of shuffle handler audit log (Contributed by Gergő Pásztor via Daniel Templeton) 2017-01-25 14:32:40 -08:00
Jason Lowe 9e19f758c1 YARN-5641. Localizer leaves behind tarballs after container is complete. Contributed by Eric Badger 2017-01-25 21:41:43 +00:00
Xiaoyu Yao a46933e8ce HADOOP-13988. KMSClientProvider does not work with WebHDFS and Apache Knox w/ProxyUser. Contributed by Greg Senia and Xiaoyu Yao. 2017-01-25 13:33:06 -08:00
Steve Loughran 7fc3e68a87 HADOOP-13433 Race in UGI.reloginFromKeytab. Contributed by Duo Zhang. 2017-01-25 21:29:27 +00:00
Karthik Kambatla abedb8a9d8 YARN-5830. FairScheduler: Avoid preempting AM containers. (Yufei Gu via kasha) 2017-01-25 12:17:28 -08:00
Jing Zhao b782bf2156 HDFS-11124. Report blockIds of internal blocks for EC files in Fsck. Contributed by Takanobu Asanuma. 2017-01-25 11:16:17 -08:00
Zhe Zhang 18e1d68209 HDFS-10534. NameNode WebUI should display DataNode usage histogram. Contributed by Kai Sasaki. 2017-01-25 09:58:39 -08:00
Jitendra Pandey 5a5652098c HDFS-11365. Log portnumber in PrivilegedNfsGatewayStarter. Contributed by Mukul Kumar Singh. 2017-01-24 21:58:02 -08:00
Xiao Chen 9c0a4d3e71 HADOOP-13990. Document KMS usage of CredentialProvider API. Contributed by John Zhuge. 2017-01-24 21:30:10 -08:00
Arpit Agarwal b57368b6f8 HDFS-11194. Maintain aggregated peer performance metrics on NameNode. 2017-01-24 16:58:20 -08:00
Junping Du 8528d85a68 YARN-6099. Improve webservice to list aggregated log files. Contributed by Xuan Gong. 2017-01-24 15:26:53 -08:00
Jason Lowe a33ce45e35 YARN-5547. NMLeveldbStateStore should be more tolerant of unknown keys. Contributed by Ajith S 2017-01-24 16:17:36 +00:00
Rohith Sharma K S 0101267d9d YARN-6082. Invalid REST api response for getApps since queueUsagePercentage is coming as INF. Contributed by Sunil G. 2017-01-24 10:59:55 +05:30
Sangjin Lee dc6ec97048 YARN-6117. SharedCacheManager does not start up. Contributed by Chris Trezzo. 2017-01-23 21:07:25 -08:00
Daniel Templeton a2c50127d1 YARN-6012. Remove node label (removeFromClusterNodeLabels) document is missing (Contributed by Ying Zhang via Daniel Templeton) 2017-01-23 17:42:54 -08:00
Wangda Tan ce832059db YARN-5864. Capacity Scheduler - Queue Priorities. (wangda) 2017-01-23 10:52:14 -08:00
Jason Lowe 69fa81679f YARN-5910. Support for multi-cluster delegation tokens. Contributed by Jian He 2017-01-23 17:12:51 +00:00
Sunil G 3fa0d540df YARN-6031. Application recovery has failed when node label feature is turned off during RM recovery. Contributed by Ying Zhang. 2017-01-23 12:19:35 +05:30
Eric Yang a847903b6e HADOOP-13119. Add ability to secure log servlet using proxy users. Contribute by Yuanbo Liu. 2017-01-21 15:43:18 -08:00
Akira Ajisaka 98c35bb1a4 HADOOP-13858. TestGridmixMemoryEmulation and TestResourceUsageEmulators fail on the environment other than Linux or Windows. 2017-01-21 17:31:20 +09:00
Lei Xu ccf2d66244 HADOOP-13962. Update ADLS SDK to 2.1.4. (John Zhuge via lei) 2017-01-21 10:52:40 +08:00
Ray Chiang 9bab85cadf YARN-6106. Document FairScheduler 'allowPreemptionFrom' queue property. (Yufei Gu via rchiang) 2017-01-20 14:08:25 -08:00
Wei-Chiu Chuang 355b907c09 HDFS-11121. Add assertions to BlockInfo#addStorage to protect from breaking reportedBlock-blockGroup mapping. Contributed by Takanobu Asanuma. 2017-01-21 05:56:22 +08:00
Andrew Wang d79c645b2e Update straggler 3.0.0-alpha2-SNAPSHOT versions to 3.0.0-alpha3-SNAPSHOT 2017-01-20 10:39:38 -08:00
Andrew Wang 8a2e1d4cbe HADOOP-14004. Missing hadoop-cloud-storage-project module in pom.xml. Contributed by Akira Ajisaka. 2017-01-20 10:36:31 -08:00
Lei Xu e015b56319 HADOOP-13956. Read ADLS credentials from Credential Provider. (John Zhuge via lei) 2017-01-20 14:48:04 +08:00
Ming Ma fdf7202992 Merge branch 'trunk' of https://git-wip-us.apache.org/repos/asf/hadoop into trunk 2017-01-19 22:31:43 -08:00
Ming Ma f3fb94be05 HDFS-11296. Maintenance state expiry should be an epoch time and not jvm monotonic. (Manoj Govindassamy via mingma) 2017-01-19 22:31:15 -08:00
Sangjin Lee b01514f65b YARN-5928. Move ATSv2 HBase backend code into a new module that is only dependent at runtime by yarn servers. Contributed by Haibo Chen. 2017-01-19 20:52:55 -08:00
Arpit Agarwal 60865c8ea0 HADOOP-14002. Document -DskipShade property in BUILDING.txt. Contributed by Hanisha Koneru. 2017-01-19 17:32:25 -08:00
Andrew Wang 5d8b80ea9b Preparing for 3.0.0-alpha3 development 2017-01-19 15:50:07 -08:00
Daniel Templeton f5839fd6df YARN-6028. Add document for container metrics (Contributed by Weiwei Yang via Daniel Templeton) 2017-01-19 12:45:17 -08:00
Jian He efc8faa1ba YARN-6104. RegistrySecurity overrides zookeeper sasl system properties. Contributed by Billie Rinaldi 2017-01-19 10:18:59 -08:00
Arun Suresh 7e8d32147c YARN-6110. Fix opportunistic containers documentation. (Akira Ajisaka via asuresh) 2017-01-19 06:14:28 -08:00
Steve Loughran 85e4961f60 HADOOP-13999 Add -DskipShade maven profile to disable jar shading to reduce compile time. Contributed by Arun Suresh 2017-01-19 11:49:40 +00:00
Steve Loughran ed33ce11dd HADOOP-13496. Include file lengths in Mismatch in length error for distcp. Contributed by Ted Yu
(cherry picked from commit 77401bd5fc)
2017-01-19 11:25:40 +00:00
Akira Ajisaka 1763467210 HADOOP-14001. Improve delegation token validity checking. 2017-01-19 17:56:39 +09:00
Lei Xu 78ae2aed8f HDFS-11259. Update fsck to display maintenance state info. (Manoj Govindassamy via lei) 2017-01-19 16:28:31 +08:00
Andrew Wang a8f1c7f542 HDFS-110268. Correctly reconstruct erasure coding file from FSImage. Contributed by SammiChen. 2017-01-19 00:24:11 -08:00
Lei Xu 63320d1daa HDFS-11287. Storage class member storageDirs should be private to avoid unprotected access by derived classes. (Manoj Govindassamy via lei) 2017-01-19 15:38:20 +08:00
Yiqun Lin 724bb86351 HDFS-11316. TestDataNodeVolumeFailure#testUnderReplicationAfterVolFailure fails in trunk. Contributed by Yiqun Lin. 2017-01-19 12:05:13 +08:00
Yiqun Lin 383aa9c9f5 HADOOP-13965. Groups should be consistent in using default group mapping class. Contributed by Yiqun Lin. 2017-01-19 09:42:56 +08:00
Andrew Wang 2bf4c6e2d6 HADOOP-13996. Fix some release build issues. 2017-01-18 15:18:48 -08:00
Allen Wittenauer 0eb4b513b7 HADOOP-13673. Update scripts to be smarter when running with privilege
Signed-off-by: Andrew Wang <wang@apache.org>
Signed-off-by: Ravi Prakash <raviprak@apache.org>
2017-01-18 14:39:05 -08:00
Allen Wittenauer acda1a5fee HADOOP-13964. Remove vestigal templates directories
Signed-off-by: Andrew Wang <wang@apache.org>
2017-01-18 14:35:51 -08:00
Wangda Tan 72054a817d YARN-5556. CapacityScheduler: Support deleting queues without requiring a RM restart. (Naganarasimha G R via wangda) 2017-01-18 13:31:33 -08:00
Andrew Wang a2a5d7b5bc HDFS-10759. Change fsimage bool isStriped from boolean to an enum. Contributed by Ewan Higgs. 2017-01-18 13:31:05 -08:00