Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,812 Commits 326 Branches 371 Tags
Commit Graph

17812 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Aaron Fabbri
bfdf99eb35
HADOOP-15040 Upgrade AWS SDK to 1.11.271: NPE bug spams logs w/ Yarn Log Aggregation 2018-02-14 18:21:32 -08:00
Anu Engineer
26f16f6a64 HADOOP-15204. Add Configuration API for parsing storage sizes. Contributed by Anu Engineer. 
(cherry picked from commit 8f66affd6265c9e4231e18d7ca352fb3035dae9a)
 2018-02-14 13:29:56 -08:00
Eric Payne
c81415dd2a Revert "YARN-7813: Capacity Scheduler Intra-queue Preemption should be configurable for each queue" 
This reverts commit 1fcc3eac885af23d79b170b5b80f271d7877641a.
 2018-02-14 14:34:07 -06:00
Xiao Chen
562274a20b Revert "HADOOP-12897. KerberosAuthenticator.authenticate to include URL on IO failures. Contributed by Ajay Kumar." 
This reverts commit e88265ea56c7ca3abfbe9c78819c9df9f789af39.
 2018-02-14 10:26:54 -08:00
Steve Loughran
401a0ee38d HADOOP-10571. Use Log.*(Object, Throwable) overload to log exceptions. 
Contributed by Andras Bokor.

(cherry picked from commit f20dc0d5770d3876954faf0a6e8dcce6539ffc23)
 2018-02-14 16:21:22 +00:00
Wangda Tan
4eb98f70ee YARN-7789. Should fail RM if 3rd resource type is configured but RM uses DefaultResourceCalculator. (Zian Chen via wangda) 
Change-Id: I1f6a451fe16758def6f47c046a9b8a67ad7255af
(cherry picked from commit 042ef2fa7bcc22e3ca4eb8205c34d83e594bc7de)
 2018-02-14 23:21:22 +08:00
Arpit Agarwal
e88265ea56 HADOOP-12897. KerberosAuthenticator.authenticate to include URL on IO failures. Contributed by Ajay Kumar. 2018-02-13 10:14:38 -08:00
Eric Payne
1fcc3eac88 YARN-7813: Capacity Scheduler Intra-queue Preemption should be configurable for each queue 
(cherry picked from commit c5e6e3de1c31eda052f89eddd7bba288625936b9)
 2018-02-13 10:20:35 -06:00
Chris Douglas
08053c4ead HADOOP-15195. With SELinux enabled, directories mounted with start-build-env.sh may not be accessible. Contributed by Grigori Rybkine 
(cherry picked from commit 0c5d7d71a80bccd4ad7eab269d0727b999606a7e)
 2018-02-12 21:07:25 -08:00
Chris Douglas
1f6b1894fc Revert "HADOOP-15195. With SELinux enabled, directories mounted with start-build-env.sh may not be accessible. Contributed by Grigori Rybkine" 
This reverts commit d51e4affbacad720793a42794aa16343a4e36a66.
 2018-02-12 21:06:21 -08:00
Chris Douglas
d51e4affba HADOOP-15195. With SELinux enabled, directories mounted with start-build-env.sh may not be accessible. Contributed by Grigori Rybkine 
(cherry picked from commit 5b88cb339898f82519223bcd07e1caedff02d051)
 2018-02-12 21:03:00 -08:00
Jason Lowe
5f7ef73b7a YARN-7914. Fix exit code handling for short lived Docker containers. Contributed by Shane Kumpf 
(cherry picked from commit 5a1db60ab1e8b28cd73367c69970513de88cf4dd)
 2018-02-12 15:51:32 -06:00
Jason Lowe
600e919469 MAPREDUCE-7048. Uber AM can crash due to unknown task in statusUpdate. Contributed by Peter Bacsko 
(cherry picked from commit 87e2570a1419d3616de2de3b553108ad1a8af425)
 2018-02-12 13:26:33 -06:00
Brahma Reddy Battula
fb088564a2 HDFS-8693. Addendum patch to execute the command using UGI. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 35c17351cab645dcc72e0d2ae1608507aa787ffb)
 2018-02-12 22:16:41 +05:30
Jason Lowe
aad3958e50 YARN-7917. Fix failing test TestDockerContainerRuntime#testLaunchContainerWithDockerTokens. Contributed by Shane Kumpf 
(cherry picked from commit 3414fd1243c0b0dcbb9cea986af5f096300eba97)
 2018-02-12 09:30:06 -06:00
Arpit Agarwal
e82abfd64b HDFS-10453. ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.. Contributed by He Xiaoqiao. 2018-02-12 07:17:50 -08:00
Steve Loughran
bd5ab59125 HADOOP-15187. Remove ADL mock test dependency on REST call invoked from Java SDK. 
Contributed by Vishwajeet Dusane.
 2018-02-12 15:11:17 +00:00
Wangda Tan
101cf2599e YARN-7739. DefaultAMSProcessor should properly check customized resource types against minimum/maximum allocation. (wangda) 
Change-Id: I10cc9341237d9a2fc0f8c855efb98a36b91389e2
(cherry picked from commit d02e42cee4a08a47ed2835f7a4a100daaa95833f)
 2018-02-12 10:39:42 +08:00
Wangda Tan
3b20413acf YARN-7697. NM goes down with OOM due to leak in log-aggregation. (Xuan Gong via wangda) 
Change-Id: Ie4fc7979d834e25f37a033c314f3efceeb8f4a9e
(cherry picked from commit d4c98579e36df7eeb788352d7b76cd2c7448c511)
 2018-02-12 10:39:34 +08:00
Wangda Tan
1e6d2972b8 YARN-5848. Remove unnecessary public/crossdomain.xml from YARN UIv2 sub project. (Sunil G via wangda) 
Change-Id: Ie295f88232192e6b520c335b0332383cc6a232c0
(cherry picked from commit 789a185c16351d2343e075413a50eb3e5849cc5f)
 2018-02-12 10:39:27 +08:00
Wangda Tan
47a2e18670 YARN-7906. Fix mvn site fails with error: Multiple sources of package comments found for package o.a.h.y.client.api.impl. (Akira Ajisaka via wangda) 
Change-Id: I20221d97446e97f208d587eacbc60448c11ffd48
(cherry picked from commit e795833d8c1981cab85a10b4e516cd0c5423c792)
 2018-02-12 10:39:21 +08:00
Weiwei Yang
388f4d11d7 YARN-7838. Support AND/OR constraints in Distributed Shell. Contributed by Weiwei Yang. 2018-02-11 14:21:55 +08:00
Eric Yang
c97d5bceb2 YARN-7909. Add charset to YARN Service REST API. (Contributed by Eric Yang) 2018-02-09 20:01:25 -05:00
Yiqun Lin
543f3abbee HDFS-13099. RBF: Use the ZooKeeper as the default State Store. Contributed by Yiqun Lin. 2018-02-09 13:57:42 +08:00
Jian He
ddec08d7cc YARN-7827. Stop and Delete Yarn Service from RM UI fails with HTTP ERROR 404. Contributed by Sunil G 2018-02-08 21:32:40 -08:00
Yufei Gu
1bc03ddf97 YARN-7655. Avoid AM preemption caused by RRs for specific nodes or racks. Contributed by Steven Rand. 2018-02-08 12:32:43 -08:00
Jian He
eb2449d539 YARN-5428. Allow for specifying the docker client configuration directory. Contributed by Shane Kumpf 2018-02-08 11:35:30 -08:00
Steve Loughran
996796f104 HADOOP-15214. Make Hadoop compatible with Guava 21.0. 
Contributed by Igor Dvorzhak
 2018-02-08 10:55:54 -08:00
Xiaoyu Yao
8faf0b50d4 HDFS-13120. Snapshot diff could be corrupted after concat. Contributed by Xiaoyu Yao. 2018-02-08 08:59:48 -08:00
Yongjun Zhang
f491f717e9 HDFS-13115. In getNumUnderConstructionBlocks(), ignore the inodeIds for which the inodes have been deleted. Contributed by Yongjun Zhang. 2018-02-07 12:58:09 -08:00
Jitendra Pandey
b061215ecf HDFS-11701. NPE from Unresolved Host causes permanent DFSInputStream failures. Contributed by Lokesh Jain. 2018-02-07 11:22:36 -08:00
Jason Lowe
456705a07c YARN-7815. Make the YARN mounts added to Docker containers more restrictive. Contributed by Shane Kumpf 2018-02-07 13:09:08 -06:00
Brahma Reddy Battula
01bd6ab18f HDFS-12935. Get ambiguous result for DFSAdmin command in HA mode when only one namenode is up. Contributed by Jianfei Jiang. 2018-02-07 23:10:33 +05:30
Billie Rinaldi
266da25c04 Revert "YARN-6078. Containers stuck in Localizing state. Contributed by Billie Rinaldi." 
This reverts commit e14f03dfbf078de63126a1e882261081b9ec6778.
 2018-02-07 07:17:00 -08:00
Billie Rinaldi
aa461f9091 YARN-7516. Add security check for trusted docker images. Contributed by Eric Yang 2018-02-07 07:09:45 -08:00
Xiao Chen
e5c2fdddd6 HDFS-12933. Improve logging when DFSStripedOutputStream failed to write some blocks. Contributed by chencan. 2018-02-06 22:54:53 -08:00
Tsz-Wo Nicholas Sze
4fadcf1631 HDFS-13107. Add Mover Cli Unit Tests for Federated cluster. Contributed by Bharat Viswanadham 2018-02-06 16:59:26 -08:00
Sean Mackrory
b14db95c35 HDFS-13106. Need to exercise all HDFS APIs for EC. Contributed by Haibo Yan. 2018-02-06 16:39:00 -07:00
Tsz-Wo Nicholas Sze
4d1bf33d0f HDFS-12947. Limit the number of Snapshots allowed to be created for a Snapshottable Directory. Contributed by Shashikant Banerjee 2018-02-06 14:46:44 -08:00
Robert Kanter
814d701d46 YARN-7841. Cleanup AllocationFileLoaderService's reloadAllocations method (snemeth via rkanter) 2018-02-06 14:36:49 -08:00
Anu Engineer
4304fcd5bd HDFS-12990. Change default NameNode RPC port back to 8020. Contributed by Xiao Chen. 2018-02-06 13:43:45 -08:00
Kihwal Lee
2dd960de98 HADOOP-15212. Add independent secret manager method for logging expired tokens. Contributed by Daryn Sharp. 2018-02-06 15:33:18 -06:00
Weiwei Yang
bff858e910 YARN-7860. Fix UT failure TestRMWebServiceAppsNodelabel#testAppsRunning. Contributed by Sunil G. 2018-02-06 19:33:04 +08:00
Sunil G
72415c39cf YARN-7866. [UI2] Error to be displayed correctly while accessing kerberized cluster without kinit. Contributed by Sunil G. 2018-02-06 16:00:34 +05:30
Sunil G
2c326088ae YARN-7850. [UI2] Log Aggregation status to be displayed in Application Page. Contributed by Gergely Novák. 2018-02-06 15:32:09 +05:30
Jian He
87429affce YARN-7889. Missing kerberos token when check for RM REST API availability. Contributed by Eric Yang 2018-02-05 22:56:25 -08:00
Billie Rinaldi
a196ee9362 YARN-7890. NPE during container relaunch. Contributed by Jason Lowe 2018-02-05 18:04:09 -08:00
Jason Lowe
60656bceca YARN-7849. TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization fails due to heartbeat sync error. Contributed by Botong Huang 2018-02-05 17:16:04 -06:00
Jason Lowe
33e6cdbd16 YARN-7876. Localized jars that are expanded after localization are not fully copied. Contributed by Miklos Szegedi 2018-02-05 12:30:20 -06:00
Yongjun Zhang
4e9a59ce16 HDFS-13100. Handle IllegalArgumentException when GETSERVERDEFAULTS is not implemented in webhdfs. Contributed by Aaron T. Myers and Yongjun Zhang. 2018-02-02 22:58:44 -08:00