Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,736 Commits 326 Branches 371 Tags
Commit Graph

12736 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Arpit Agarwal
b64d9093e1 HDFS-11112. Journal Nodes should refuse to format non-empty directories. Contributed by Yiqun Lin. 2017-02-01 16:52:07 -08:00
Masatake Iwasaki
2f4cf07fb1 MAPREDUCE-6644. Use doxia macro to generate in-page TOC of MapReduce site documentation. (iwasakims) 
(cherry picked from commit 3619ae32bea227f17ecc9ef964e9194bc09fac0b)
 2017-02-02 01:23:02 +09:00
Lei Xu
d258077bc1 HDFS-11335. Remove HdfsClientConfigKeys.DFS_CLIENT_SLOW_IO_WARNING_THRESHOLD_KEY usage from DNConf. (Manoj Govindassamy via lei) 
(cherry picked from commit bec9b7aa1dd3ed95b8783597135f8d90b3cc8dcd)
 2017-02-01 14:44:08 +08:00
Daniel Templeton
be14bda5c0 YARN-4658. Typo in o.a.h.yarn.server.resourcemanager.scheduler.fair.TestFairScheduler comment (Contributed by Udai Potluri via Daniel Templeton) 
(cherry picked from commit 3e06475307e30377092547dfdebe6c2c6ac6e78f)
 2017-01-31 16:26:41 -08:00
Daniel Templeton
ccf33bc36c YARN-6103. Log updates for ZKRMStateStore (Contributed by Daniel Sturman via Daniel Templeton) 
(cherry picked from commit 87852b6ef4b9d973b7b3999974d41c8860fb1495)
 2017-01-30 21:46:38 -08:00
Ray Chiang
9f0b813350 YARN-6106. Document FairScheduler 'allowPreemptionFrom' queue property. (Yufei Gu via rchiang) 
(cherry picked from commit 3f970ac363dc2faf4f54180ee5b64d0c60807097)
 2017-01-30 13:42:11 -08:00
Karthik Kambatla
c9824c5ff6 YARN-6131. FairScheduler: Lower update interval for faster tests. (kasha) 
(cherry picked from commit 11e44bdda74b3357714f4b11a66f703d64c0f14f)
 2017-01-30 13:39:35 -08:00
Karthik Kambatla
8b01d5cbba HDFS-11378. Addendum to fix branch-2 compilation. Verify multiple DataNodes can be decommissioned/maintenance at the same time. (Manoj Govindassamy via kasha) 2017-01-29 11:18:54 -08:00
Ming Ma
34f9ceab4a HDFS-11378. Verify multiple DataNodes can be decommissioned/maintenance at the same time. (Manoj Govindassamy via mingma) 
(cherry picked from commit 312b36d113d83640b92c62fdd91ede74bd04c00f)
 2017-01-27 16:17:51 -08:00
Masatake Iwasaki
528bff9c42 HDFS-9884. Use doxia macro to generate in-page TOC of HDFS site documentation. (iwasakims) 2017-01-28 08:11:40 +09:00
Anu Engineer
d20dc8691e HDFS-9911. TestDataNodeLifeline Fails intermittently. Contributed by Yiqun Lin 
(cherry picked from commit a95639068c99ebcaefe8b6c4268449d12a6577d6)
 2017-01-27 20:55:59 +00:00
Jason Lowe
4703f5d20b YARN-5641. Localizer leaves behind tarballs after container is complete. Contributed by Eric Badger 2017-01-27 15:25:57 +00:00
Junping Du
660f4d8631 YARN-6126. Obtaining app logs for Running application fails with json parse error. Contributed by Xuan Gong. 
(cherry picked from commit 1a16431bd0df52d2df32c594f8b9b506c2101ad8)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/cli/LogsCLI.java
 2017-01-27 06:33:44 -08:00
Xiaoyu Yao
6b602c6e34 HADOOP-14029. Fix KMSClientProvider for non-secure proxyuser use case. Contributed by Xiaoyu Yao. 
(cherry picked from commit 2034315763cd7b1eb77e96c719918fc14e2dabf6)
 2017-01-26 20:36:43 -08:00
Arpit Agarwal
17d4ba26fc HDFS-11374. Skip FSync in CreateEditsLog to speed up edit log generation. Contributed by Hanisha Koneru. 2017-01-26 16:21:38 -08:00
Xiao Chen
67d2875f8f Revert "HDFS-8377. Support HTTP/2 in datanode. Contributed by Duo Zhang." 
This reverts commit f70b9d92413940739ed6f6cd468e6d09702939d1.
 2017-01-26 14:21:17 -08:00
Karthik Kambatla
1b1a25cca6 YARN-6000. Make AllocationFileLoaderService.Listener public. (Tao Jie via kasha) 
(cherry picked from commit 4d3f73acc0a5cabc748132889dbe670bea178a3f)
 2017-01-26 14:11:50 -08:00
Daniel Templeton
c4eeac02de YARN-4975. Fair Scheduler: exception thrown when a parent queue marked 'parent' has configured child queues 
(Contributed by Yufei Gu via Daniel Templeton)

(cherry picked from commit f85b74ccf9f1c1c1444cc00750b03468cbf40fb9)
 2017-01-26 14:08:46 -08:00
Daniel Templeton
443f2803ac YARN-4997. Update fair scheduler to use pluggable auth provider (Contributed by Tao Jie via Daniel Templeton) 
(cherry picked from commit b3befc021b0e2d63d1a3710ea450797d1129f1f5)
 2017-01-26 14:07:46 -08:00
Xiao Chen
4a48f0e702 HADOOP-14003. Make additional KMS tomcat settings configurable. Contributed by Andrew Wang. 2017-01-26 11:22:16 -08:00
Karthik Kambatla
a91cc63d37 MAPREDUCE-6829. Add peak memory usage counter for each task. (Miklos Szegedi via kasha) 
(cherry picked from commit c65f884fc7e08118524f8c88737119d8196b4c1b)
 2017-01-26 11:08:53 -08:00
Xiao Chen
827cd30923 HDFS-11364. Add a test to verify Audit log entries for setfacl/getfacl commands over FS shell. Contributed by Manoj Govindassamy. 
(cherry picked from commit 44606aa8508a6e98219b8330e625c8d397bfb067)
 2017-01-26 10:58:17 -08:00
Arpit Agarwal
deb3ef4587 HDFS-11369. Change exception message in StorageLocationChecker. 2017-01-26 09:12:46 -08:00
Jason Lowe
b806201f0a Revert "YARN-5641. Localizer leaves behind tarballs after container is complete. Contributed by Eric Badger" 
This reverts commit 45407acaed05284ad897d04f4575ab0a4ee7a88b.
 2017-01-26 14:42:22 +00:00
Sangjin Lee
b799ea7641 YARN-3637. Handle localization sym-linking correctly at the YARN level. Contributed by Chris Trezzo. 
(cherry picked from commit 425a7e502869c4250aba927ecc3c6f3c561c6ff2)
 2017-01-25 15:52:05 -08:00
Sangjin Lee
c4d3b28c2d YARN-6117. SharedCacheManager does not start up. Contributed by Chris Trezzo. 
(cherry picked from commit dc6ec9704829f180ce0e182c436fe1a435744c88)
 2017-01-25 15:36:07 -08:00
Jason Lowe
45407acaed YARN-5641. Localizer leaves behind tarballs after container is complete. Contributed by Eric Badger 
(cherry picked from commit 9e19f758c1950cbcfcd1969461a8a910efca0767)
 2017-01-25 21:54:17 +00:00
Xiaoyu Yao
9fa98cc45e HADOOP-13988. KMSClientProvider does not work with WebHDFS and Apache Knox w/ProxyUser. Contributed by Greg Senia and Xiaoyu Yao. 
(cherry picked from commit a46933e8ce4c1715c11e3e3283bf0e8c2b53b837)
 2017-01-25 13:34:42 -08:00
Steve Loughran
bb46d40558 HADOOP-13433 Race in UGI.reloginFromKeytab. Contributed by Duo Zhang. 2017-01-25 21:26:01 +00:00
Karthik Kambatla
73497f08fc YARN-5830. FairScheduler: Avoid preempting AM containers. (Yufei Gu via kasha) 
(cherry picked from commit abedb8a9d86b4593a37fd3d2313fbcb057c7846a)
 2017-01-25 12:19:27 -08:00
Karthik Kambatla
71026cc3f6 YARN-5831. FairScheduler: Propagate allowPreemptionFrom flag all the way down to the app. (Yufei Gu via kasha) 
(cherry picked from commit e224c9623493d6c4c2f3ff731fd3c72c0f448b19)
 2017-01-25 12:19:20 -08:00
Karthik Kambatla
0ceb7149d9 YARN-4752. Improved preemption in FairScheduler. (kasha) 2017-01-25 10:45:02 -08:00
Zhe Zhang
558fee285a HDFS-10534. NameNode WebUI should display DataNode usage histogram. Contributed by Kai Sasaki. 
(cherry picked from commit 18e1d6820926646999e7ec248c504b4145cf1a76)
 2017-01-25 10:39:11 -08:00
Jitendra Pandey
1af0a4d901 HDFS-11365. Log portnumber in PrivilegedNfsGatewayStarter. Contributed by Mukul Kumar Singh. 2017-01-24 21:59:41 -08:00
Arpit Agarwal
b4078e1d0e HDFS-11194. Maintain aggregated peer performance metrics on NameNode. 2017-01-24 19:34:33 -08:00
Junping Du
8027c3e8b9 YARN-6099. Improve webservice to list aggregated log files. Contributed by Xuan Gong. 2017-01-24 15:28:52 -08:00
Wangda Tan
1309accd68 YARN-5864. Capacity Scheduler - Queue Priorities. (wangda) 2017-01-24 14:44:42 -08:00
Jason Lowe
1672a06135 YARN-5547. NMLeveldbStateStore should be more tolerant of unknown keys. Contributed by Ajith S 2017-01-24 16:19:02 +00:00
Rohith Sharma K S
26c4cfb653 YARN-6082. Invalid REST api response for getApps since queueUsagePercentage is coming as INF. Contributed by Sunil G. 
(cherry picked from commit 0101267d9d801eab4cb3b4df289c402ecb591685)
 2017-01-24 11:01:52 +05:30
Jason Lowe
94b326f2c8 YARN-5910. Support for multi-cluster delegation tokens. Contributed by Jian He 
(cherry picked from commit 69fa81679f59378fd19a2c65db8019393d7c05a2)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMAppManager.java
 2017-01-23 17:23:32 +00:00
Sunil G
f8e49bb343 YARN-6031. Application recovery has failed when node label feature is turned off during RM recovery. Contributed by Ying Zhang. 
(cherry picked from commit 3fa0d540dfca579f3c2840a959b748a7528b02ed)
 2017-01-23 12:24:39 +05:30
Eric Yang
efe8f941a9 HADOOP-13119. Add ability to secure log servlet using proxy users. Contribute by Yuanbo Liu. 
(cherry picked from commit a847903b6e64c6edb11d852b91f2c816b1253eb3)
 2017-01-21 15:47:13 -08:00
Akira Ajisaka
b204a1eb5f HADOOP-13858. TestGridmixMemoryEmulation and TestResourceUsageEmulators fail on the environment other than Linux or Windows. 
(cherry picked from commit 98c35bb1a4faf794060612bee7494d501701b698)
 2017-01-21 17:35:57 +09:00
Daniel Templeton
be7e4a0805 YARN-6028. Add document for container metrics (Contributed by Weiwei Yang via Daniel Templeton) 
(cherry picked from commit f5839fd6df77786353160b41eb4b5ceea9380017)
 2017-01-20 10:07:49 -08:00
Ming Ma
bed700e98f HDFS-11296. Maintenance state expiry should be an epoch time and not jvm monotonic. (Manoj Govindassamy via mingma) 
(cherry picked from commit f3fb94be05a61a4c4c06ab279897e5de2b181b0e)
 2017-01-19 22:33:43 -08:00
Jian He
d374087670 YARN-6104. RegistrySecurity overrides zookeeper sasl system properties. Contributed by Billie Rinaldi 2017-01-19 10:19:24 -08:00
Chris Nauroth
5251de00fa YARN-5456. container-executor support for FreeBSD, NetBSD, and others if conf path is absolute. Contributed by Allen Wittenauer. 
(cherry picked from commit b913677365ad77ca7daa5741c04c14df1a0313cd)
 2017-01-19 20:48:27 +05:30
Chris Nauroth
198bd84b33 YARN-5121. fix some container-executor portability issues. Contributed by Allen Wittenauer. 
(cherry picked from commit ef501b1a0b4c34a2cc43eb082d1c2364684cd7f1)
 2017-01-19 20:48:27 +05:30
Arun Suresh
3c6ec20955 YARN-6110. Fix opportunistic containers documentation. (Akira Ajisaka via asuresh) 
(cherry picked from commit 7e8d32147c701d5207feeb43cb3ae728e357d9dc)
 2017-01-19 06:16:30 -08:00
Steve Loughran
b2704702f9 HADOOP-13496. Include file lengths in Mismatch in length error for distcp. Contributed by Ted Yu 
(cherry picked from commit 77401bd5fcca5127c9908156971eeec468371f47)
 2017-01-19 11:25:20 +00:00