Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,720 Commits 326 Branches 371 Tags
Commit Graph

12720 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Karthik Kambatla
1b1a25cca6 YARN-6000. Make AllocationFileLoaderService.Listener public. (Tao Jie via kasha) 
(cherry picked from commit 4d3f73acc0a5cabc748132889dbe670bea178a3f)
 2017-01-26 14:11:50 -08:00
Daniel Templeton
c4eeac02de YARN-4975. Fair Scheduler: exception thrown when a parent queue marked 'parent' has configured child queues 
(Contributed by Yufei Gu via Daniel Templeton)

(cherry picked from commit f85b74ccf9f1c1c1444cc00750b03468cbf40fb9)
 2017-01-26 14:08:46 -08:00
Daniel Templeton
443f2803ac YARN-4997. Update fair scheduler to use pluggable auth provider (Contributed by Tao Jie via Daniel Templeton) 
(cherry picked from commit b3befc021b0e2d63d1a3710ea450797d1129f1f5)
 2017-01-26 14:07:46 -08:00
Xiao Chen
4a48f0e702 HADOOP-14003. Make additional KMS tomcat settings configurable. Contributed by Andrew Wang. 2017-01-26 11:22:16 -08:00
Karthik Kambatla
a91cc63d37 MAPREDUCE-6829. Add peak memory usage counter for each task. (Miklos Szegedi via kasha) 
(cherry picked from commit c65f884fc7e08118524f8c88737119d8196b4c1b)
 2017-01-26 11:08:53 -08:00
Xiao Chen
827cd30923 HDFS-11364. Add a test to verify Audit log entries for setfacl/getfacl commands over FS shell. Contributed by Manoj Govindassamy. 
(cherry picked from commit 44606aa8508a6e98219b8330e625c8d397bfb067)
 2017-01-26 10:58:17 -08:00
Arpit Agarwal
deb3ef4587 HDFS-11369. Change exception message in StorageLocationChecker. 2017-01-26 09:12:46 -08:00
Jason Lowe
b806201f0a Revert "YARN-5641. Localizer leaves behind tarballs after container is complete. Contributed by Eric Badger" 
This reverts commit 45407acaed05284ad897d04f4575ab0a4ee7a88b.
 2017-01-26 14:42:22 +00:00
Sangjin Lee
b799ea7641 YARN-3637. Handle localization sym-linking correctly at the YARN level. Contributed by Chris Trezzo. 
(cherry picked from commit 425a7e502869c4250aba927ecc3c6f3c561c6ff2)
 2017-01-25 15:52:05 -08:00
Sangjin Lee
c4d3b28c2d YARN-6117. SharedCacheManager does not start up. Contributed by Chris Trezzo. 
(cherry picked from commit dc6ec9704829f180ce0e182c436fe1a435744c88)
 2017-01-25 15:36:07 -08:00
Jason Lowe
45407acaed YARN-5641. Localizer leaves behind tarballs after container is complete. Contributed by Eric Badger 
(cherry picked from commit 9e19f758c1950cbcfcd1969461a8a910efca0767)
 2017-01-25 21:54:17 +00:00
Xiaoyu Yao
9fa98cc45e HADOOP-13988. KMSClientProvider does not work with WebHDFS and Apache Knox w/ProxyUser. Contributed by Greg Senia and Xiaoyu Yao. 
(cherry picked from commit a46933e8ce4c1715c11e3e3283bf0e8c2b53b837)
 2017-01-25 13:34:42 -08:00
Steve Loughran
bb46d40558 HADOOP-13433 Race in UGI.reloginFromKeytab. Contributed by Duo Zhang. 2017-01-25 21:26:01 +00:00
Karthik Kambatla
73497f08fc YARN-5830. FairScheduler: Avoid preempting AM containers. (Yufei Gu via kasha) 
(cherry picked from commit abedb8a9d86b4593a37fd3d2313fbcb057c7846a)
 2017-01-25 12:19:27 -08:00
Karthik Kambatla
71026cc3f6 YARN-5831. FairScheduler: Propagate allowPreemptionFrom flag all the way down to the app. (Yufei Gu via kasha) 
(cherry picked from commit e224c9623493d6c4c2f3ff731fd3c72c0f448b19)
 2017-01-25 12:19:20 -08:00
Karthik Kambatla
0ceb7149d9 YARN-4752. Improved preemption in FairScheduler. (kasha) 2017-01-25 10:45:02 -08:00
Zhe Zhang
558fee285a HDFS-10534. NameNode WebUI should display DataNode usage histogram. Contributed by Kai Sasaki. 
(cherry picked from commit 18e1d6820926646999e7ec248c504b4145cf1a76)
 2017-01-25 10:39:11 -08:00
Jitendra Pandey
1af0a4d901 HDFS-11365. Log portnumber in PrivilegedNfsGatewayStarter. Contributed by Mukul Kumar Singh. 2017-01-24 21:59:41 -08:00
Arpit Agarwal
b4078e1d0e HDFS-11194. Maintain aggregated peer performance metrics on NameNode. 2017-01-24 19:34:33 -08:00
Junping Du
8027c3e8b9 YARN-6099. Improve webservice to list aggregated log files. Contributed by Xuan Gong. 2017-01-24 15:28:52 -08:00
Wangda Tan
1309accd68 YARN-5864. Capacity Scheduler - Queue Priorities. (wangda) 2017-01-24 14:44:42 -08:00
Jason Lowe
1672a06135 YARN-5547. NMLeveldbStateStore should be more tolerant of unknown keys. Contributed by Ajith S 2017-01-24 16:19:02 +00:00
Rohith Sharma K S
26c4cfb653 YARN-6082. Invalid REST api response for getApps since queueUsagePercentage is coming as INF. Contributed by Sunil G. 
(cherry picked from commit 0101267d9d801eab4cb3b4df289c402ecb591685)
 2017-01-24 11:01:52 +05:30
Jason Lowe
94b326f2c8 YARN-5910. Support for multi-cluster delegation tokens. Contributed by Jian He 
(cherry picked from commit 69fa81679f59378fd19a2c65db8019393d7c05a2)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMAppManager.java
 2017-01-23 17:23:32 +00:00
Sunil G
f8e49bb343 YARN-6031. Application recovery has failed when node label feature is turned off during RM recovery. Contributed by Ying Zhang. 
(cherry picked from commit 3fa0d540dfca579f3c2840a959b748a7528b02ed)
 2017-01-23 12:24:39 +05:30
Eric Yang
efe8f941a9 HADOOP-13119. Add ability to secure log servlet using proxy users. Contribute by Yuanbo Liu. 
(cherry picked from commit a847903b6e64c6edb11d852b91f2c816b1253eb3)
 2017-01-21 15:47:13 -08:00
Akira Ajisaka
b204a1eb5f HADOOP-13858. TestGridmixMemoryEmulation and TestResourceUsageEmulators fail on the environment other than Linux or Windows. 
(cherry picked from commit 98c35bb1a4faf794060612bee7494d501701b698)
 2017-01-21 17:35:57 +09:00
Daniel Templeton
be7e4a0805 YARN-6028. Add document for container metrics (Contributed by Weiwei Yang via Daniel Templeton) 
(cherry picked from commit f5839fd6df77786353160b41eb4b5ceea9380017)
 2017-01-20 10:07:49 -08:00
Ming Ma
bed700e98f HDFS-11296. Maintenance state expiry should be an epoch time and not jvm monotonic. (Manoj Govindassamy via mingma) 
(cherry picked from commit f3fb94be05a61a4c4c06ab279897e5de2b181b0e)
 2017-01-19 22:33:43 -08:00
Jian He
d374087670 YARN-6104. RegistrySecurity overrides zookeeper sasl system properties. Contributed by Billie Rinaldi 2017-01-19 10:19:24 -08:00
Chris Nauroth
5251de00fa YARN-5456. container-executor support for FreeBSD, NetBSD, and others if conf path is absolute. Contributed by Allen Wittenauer. 
(cherry picked from commit b913677365ad77ca7daa5741c04c14df1a0313cd)
 2017-01-19 20:48:27 +05:30
Chris Nauroth
198bd84b33 YARN-5121. fix some container-executor portability issues. Contributed by Allen Wittenauer. 
(cherry picked from commit ef501b1a0b4c34a2cc43eb082d1c2364684cd7f1)
 2017-01-19 20:48:27 +05:30
Arun Suresh
3c6ec20955 YARN-6110. Fix opportunistic containers documentation. (Akira Ajisaka via asuresh) 
(cherry picked from commit 7e8d32147c701d5207feeb43cb3ae728e357d9dc)
 2017-01-19 06:16:30 -08:00
Steve Loughran
b2704702f9 HADOOP-13496. Include file lengths in Mismatch in length error for distcp. Contributed by Ted Yu 
(cherry picked from commit 77401bd5fcca5127c9908156971eeec468371f47)
 2017-01-19 11:25:20 +00:00
Akira Ajisaka
c6c29d0080 HADOOP-14001. Improve delegation token validity checking. 
(cherry picked from commit 176346721006a03f41d028560e9e29b5931d5be2)
 2017-01-19 17:58:44 +09:00
Lei Xu
1cc5f460ed HDFS-11259. Update fsck to display maintenance state info. (Manoj Govindassamy via lei) 2017-01-19 16:24:58 +08:00
Lei Xu
541efe18c7 HDFS-11287. Storage class member storageDirs should be private to avoid unprotected access by derived classes. (Manoj Govindassamy via lei) 
(cherry picked from commit 63320d1daab7ce846bb180623378efe431ad8c52)
 2017-01-19 15:38:40 +08:00
Wangda Tan
8d6fa4569b YARN-5556. CapacityScheduler: Support deleting queues without requiring a RM restart. (Naganarasimha G R via wangda) 
(cherry picked from commit 72054a817dfb43e93916d7036eba19cf2f49cea2)
 2017-01-18 13:35:30 -08:00
Vinitha Reddy Gankidi
e2b3eff641 HDFS-10733. NameNode terminated after full GC thinking QJM is unresponsive. Contributed by Vinitha Gankidi. 2017-01-18 12:52:58 -08:00
Akira Ajisaka
db47bd15dd HDFS-11290. TestFSNameSystemMBean should wait until JMX cache is cleared. Contributed by Erik Krogen. 
(cherry picked from commit b1a9ec856b572894e769f052aea2340fc3f23c78)
 2017-01-18 17:56:22 +09:00
Arpit Agarwal
42a14b6db9 HDFS-10917. Collect peer performance statistics on DataNode. Contributed by Xiaobing Zhou. 2017-01-17 15:31:18 -08:00
Subru Krishnan
fb639aed90 YARN-6016. Fix minor bugs in handling of local AMRMToken in AMRMProxy. (Botong Huang via Subru). 
(cherry picked from commit 4d1f3d9020b8a8bf1d2a81e4d6ad20418ed9bcc2)
 2017-01-17 14:51:27 -08:00
Xiaoyu Yao
420e4db98a HDFS-11209. SNN can't checkpoint when rolling upgrade is not finalized. Contributed by Xiaoyu Yao. 
(cherry picked from commit b1fce2b8b14c4ce43f7098a269ac2b95304db0ce)
 2017-01-17 14:36:03 -08:00
Kihwal Lee
3017069a76 HADOOP-13976. Path globbing does not match newlines. Contributed by Eric Badger. 
(cherry picked from commit 706d630eb9db9658083d57d1d99b6a0f11cc5657)
 2017-01-17 15:12:50 -06:00
Xiaoyu Yao
eae5bde007 HDFS-10913. Introduce fault injectors to simulate slow mirrors. Contributed by Xiaobing Zhou. 2017-01-17 10:30:34 -08:00
Jason Lowe
bec7c56ce5 MAPREDUCE-6831. Flaky test TestJobImpl.testKilledDuringKillAbort. Contributed by Peter Bacsko 
(cherry picked from commit 78b487bde175544ebe40e4dafab35569baa1d79e)
 2017-01-17 16:03:20 +00:00
bibinchundatt
580275628b YARN-6057. yarn.scheduler.minimum-allocation-* descriptions are incorrect about behavior when a request is out of bounds. Contributed by Julia Sommer. 
(cherry picked from commit a9d946d4df91c29ea86851bb1c5046e95dc80406)
 2017-01-17 14:18:41 +05:30
Arpit Agarwal
be8e001f1f HDFS-11339. Support File IO sampling for Datanode IO profiling hooks. Contributed by Hanisha Koneru. 2017-01-16 22:49:14 -08:00
Arpit Agarwal
52fdd387ec HDFS-11299. Support multiple Datanode File IO hooks. Contributed by Hanisha Koneru. 2017-01-16 22:42:13 -08:00
Arpit Agarwal
ae0082a3fc HDFS-11282. Document the missing metrics of DataNode Volume IO operations. Contributed by Yiqun Lin. 2017-01-16 22:24:49 -08:00