Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,900 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

17900 Commits

Author SHA1 Message Date
Xiao Chen 25f18619f8 HDFS-13164. File not closed if streamer fail with DSQuotaExceededException. 
(cherry picked from commit 51088d3233)
 2018-02-23 14:00:17 -08:00
Kihwal Lee 1f0952bfc7 HADOOP-9747. Reduce unnecessary UGI synchronization. Contributed by Daryn Sharp. 2018-02-23 13:13:20 -06:00
Xiaoyu Yao efbbcf9221 HDFS-13136. Avoid taking FSN lock while doing group member lookup for FSD permission check. Contributed by Xiaoyu Yao. 
(cherry picked from commit e978e1d9064fc794ea83217d0af2315d4167211e)
 2018-02-23 09:01:45 -08:00
Sunil G 40feeeeec7 YARN-7949. [UI2] ArtifactsId should not be a compulsory field for new service. Contributed by Yesha Vora. 
(cherry picked from commit d1cd573687)
 2018-02-23 16:50:59 +05:30
Sunil G c152187275 YARN-7675. [UI2] Support loading pre-2.8 version /scheduler REST response for queue page. Contributed by Gergely Novák. 
(cherry picked from commit cc683952d2)
 2018-02-23 16:11:20 +05:30
Gabor Bota b8942cb3bf
HADOOP-15236. Fix typo in RequestHedgingProxyProvider and RequestHedgingRMFailoverProxyProvider 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit c36b4aa31c)
 2018-02-23 13:56:26 +09:00
Eric Yang 7fac69ea48 YARN-7942. Add check for JAAS configuration for Yarn Service. 
Contributed by Billie Rinaldi
(Cherry-picked from commit 95904f6b3c)
 2018-02-22 16:19:26 -05:00
Eric Yang 13922cc32d YARN-7836. Added error check for updating service components. 
(Contributed by Gour Saha)
(Cherry-picked from commit 190969006d)
 2018-02-22 16:11:22 -05:00
Jason Lowe bfbd43f2f7 YARN-7916. Remove call to docker logs on failure in container-executor. Contributed by Shane Kumpf 
(cherry picked from commit 3132709b46)
 2018-02-21 16:55:06 -06:00
Steve Loughran 958b445047 HADOOP-15247. Move commons-net up to 3.6. 
Contributed by Steve Loughran.

(cherry picked from commit 004b722372)
 2018-02-21 10:41:20 +00:00
Sunil G e53da3914a YARN-7947. Capacity Scheduler intra-queue preemption can NPE for non-schedulable apps. Contributed by Eric Payne. 
(cherry picked from commit bdd2a184d7)
 2018-02-21 14:57:43 +05:30
Sunil G 21af27995d YARN-7223. Document GPU isolation feature. Contributed by Wangda Tan. 
(cherry picked from commit 86b227a1fb)
 2018-02-21 14:17:18 +05:30
Anu Engineer 4aa4bb46af HDFS-13175. Add more information for checking argument in DiskBalancerVolume. 
Contributed by  Lei (Eddy) Xu.

(cherry picked from commit 121e1e1280)
 2018-02-20 19:58:58 -08:00
Eric Yang 7506e100fc YARN-7940. Fixed a bug in ServiceAM ZooKeeper initialization. 
(Contributed by Billie Rinaldi)

(cherry-picked from commit 7280c5af82)
 2018-02-20 14:16:46 -05:00
Yiqun Lin 538c473f49 HDFS-13119. RBF: Manage unavailable clusters. Contributed by Yiqun Lin. 
(cherry picked from commit 8896d20b91)
 2018-02-20 10:14:09 +08:00
Jason Lowe 94def88889 YARN-7813. Capacity Scheduler Intra-queue Preemption should be configurable for each queue. Contributed by Eric Payne 
(cherry picked from commit 9497215084)
 2018-02-19 14:22:52 -06:00
Jason Lowe 1481adbabe Revert "YARN-7677. Docker image cannot set HADOOP_CONF_DIR. Contributed by Jim Brennan" 
This reverts commit 6f64530fc3.
 2018-02-19 08:23:29 -06:00
fang zhenyi 55669df4f9
HADOOP-15223. Replace Collections.EMPTY* with empty* when available 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 4d4dde5112)
 2018-02-18 22:22:06 +09:00
Rohith Sharma K S 7ee3713f73 YARN-7937. Fix http method name in Cluster Application Timeout Update API example request. Contributed by Charan Hebri. 
(cherry picked from commit 87bdde6943)
 2018-02-18 14:05:59 +05:30
Arun Suresh 950566230c YARN-7918. Fix TestAMRMClientPlacementConstraints. (Gergely Novák via asuresh) 
(cherry picked from commit a1e56a6286)
 2018-02-17 03:26:13 -08:00
Wangda Tan f878ddb067 YARN-7328. ResourceUtils allows yarn.nodemanager.resource-types.memory-mb and .vcores to override yarn.nodemanager.resource.memory-mb and .cpu-vcores. (lovekesh bansal via wangda) 
Change-Id: Ibb1faf0beefec079dae2208986976b2f64650672
(cherry picked from commit ca1043ab90)
 2018-02-17 13:03:58 +08:00
Wangda Tan ac9e5ee568 HADOOP-14875. Create end user documentation from the compatibility guidelines. (Daniel Templeton via wangda) 
Change-Id: I5d66d0f034874623af22aecae0a0b858b65396ed
(cherry picked from commit 31db977cb3)
 2018-02-17 13:03:58 +08:00
Jason Lowe 03aba69835 HADOOP-15206. BZip2 drops and duplicates records when input split size is small. Contributed by Aki Tanaka 
(cherry picked from commit 0898ff42e9)
 2018-02-16 14:50:14 -06:00
Arpit Agarwal c880a87101 HDFS-13058. Fix dfs.namenode.shared.edits.dir in TestJournalNode. Contributed by Bharat Viswanadham. 2018-02-16 10:29:29 -08:00
Arpit Agarwal f43f32bd31 HDFS-13153. Enable HDFS diskbalancer by default. Contributed by Ajay Kumar. 2018-02-16 09:38:51 -08:00
Steve Loughran 27a9640036 HADOOP-14507. Extend per-bucket secret key config with explicit getPassword() on fs.s3a.$bucket.secret.key. 
Contributed by Steve Loughran.

(cherry picked from commit 7ac88244c5)
 2018-02-16 16:39:26 +00:00
Eric Payne 02836d3282 MAPREDUCE-7053: Timed out tasks can fail to produce thread dump. Contributed by Jason Lowe. 
(cherry picked from commit 82f029f7b5)
 2018-02-16 08:19:03 -06:00
Sunil G d6eb001da9 YARN-7292. Retrospect Resource Profile Behavior for overriding capability. Contributed by Wangda Tan. 
(cherry picked from commit aae629913c)
 2018-02-16 13:56:44 +05:30
Bharat Viswanadham 1fb2f020e2
HDFS-13151. Fix the javadoc error in ReplicaInfo 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit a1e05e0292)
 2018-02-16 16:23:29 +09:00
Jason Lowe 6f64530fc3 YARN-7677. Docker image cannot set HADOOP_CONF_DIR. Contributed by Jim Brennan 2018-02-15 17:14:39 -06:00
Konstantinos Karanasos 41708402a1 YARN-7920. Simplify configuration for PlacementConstraints. Contributed by Wangda Tan. 
(cherry picked from commit 0b489e564c)
 2018-02-15 14:25:34 -08:00
Kihwal Lee 4cdc57f6a4 HDFS-13112. Token expiration edits may cause log corruption or deadlock. Contributed by Daryn Sharp. 
(cherry picked from commit 47473952e5)
 2018-02-15 15:34:46 -06:00
Jason Lowe 50de2676a1 MAPREDUCE-7052. TestFixedLengthInputFormat#testFormatCompressedIn is flaky. Contributed by Peter Bacsko 
(cherry picked from commit a53d62ab26)
 2018-02-15 15:16:39 -06:00
Kihwal Lee 8b9376a089 xattr api cleanup 
(cherry picked from commit da59acd8ca)
 2018-02-15 11:13:56 -06:00
Steve Loughran 050f5287b7 HADOOP-13972. ADLS to support per-store configuration. 
Contributed by Sharad Sonker.
 2018-02-15 16:25:55 +00:00
Steve Loughran 96c047fbb9 HADOOP-15176. Enhance IAM Assumed Role support in S3A client. 
Contributed by Steve Loughran
 2018-02-15 15:56:10 +00:00
Steve Loughran c761e658f6 HADOOP-15076. Enhance S3A troubleshooting documents and add a performance document. 
Contributed by Steve Loughran.
 2018-02-15 14:56:32 +00:00
Steve Loughran 58a2120e8a HADOOP-15090. Add ADL troubleshooting doc. 
Contributed by Steve Loughran.
 2018-02-15 14:24:36 +00:00
Aaron Fabbri bfdf99eb35
HADOOP-15040 Upgrade AWS SDK to 1.11.271: NPE bug spams logs w/ Yarn Log Aggregation 2018-02-14 18:21:32 -08:00
Anu Engineer 26f16f6a64 HADOOP-15204. Add Configuration API for parsing storage sizes. Contributed by Anu Engineer. 
(cherry picked from commit 8f66affd62)
 2018-02-14 13:29:56 -08:00
Eric Payne c81415dd2a Revert "YARN-7813: Capacity Scheduler Intra-queue Preemption should be configurable for each queue" 
This reverts commit 1fcc3eac88.
 2018-02-14 14:34:07 -06:00
Xiao Chen 562274a20b Revert "HADOOP-12897. KerberosAuthenticator.authenticate to include URL on IO failures. Contributed by Ajay Kumar." 
This reverts commit e88265ea56.
 2018-02-14 10:26:54 -08:00
Steve Loughran 401a0ee38d HADOOP-10571. Use Log.*(Object, Throwable) overload to log exceptions. 
Contributed by Andras Bokor.

(cherry picked from commit f20dc0d577)
 2018-02-14 16:21:22 +00:00
Wangda Tan 4eb98f70ee YARN-7789. Should fail RM if 3rd resource type is configured but RM uses DefaultResourceCalculator. (Zian Chen via wangda) 
Change-Id: I1f6a451fe16758def6f47c046a9b8a67ad7255af
(cherry picked from commit 042ef2fa7b)
 2018-02-14 23:21:22 +08:00
Arpit Agarwal e88265ea56 HADOOP-12897. KerberosAuthenticator.authenticate to include URL on IO failures. Contributed by Ajay Kumar. 2018-02-13 10:14:38 -08:00
Eric Payne 1fcc3eac88 YARN-7813: Capacity Scheduler Intra-queue Preemption should be configurable for each queue 
(cherry picked from commit c5e6e3de1c)
 2018-02-13 10:20:35 -06:00
Chris Douglas 08053c4ead HADOOP-15195. With SELinux enabled, directories mounted with start-build-env.sh may not be accessible. Contributed by Grigori Rybkine 
(cherry picked from commit 0c5d7d71a8)
 2018-02-12 21:07:25 -08:00
Chris Douglas 1f6b1894fc Revert "HADOOP-15195. With SELinux enabled, directories mounted with start-build-env.sh may not be accessible. Contributed by Grigori Rybkine" 
This reverts commit d51e4affba.
 2018-02-12 21:06:21 -08:00
Chris Douglas d51e4affba HADOOP-15195. With SELinux enabled, directories mounted with start-build-env.sh may not be accessible. Contributed by Grigori Rybkine 
(cherry picked from commit 5b88cb3398)
 2018-02-12 21:03:00 -08:00
Jason Lowe 5f7ef73b7a YARN-7914. Fix exit code handling for short lived Docker containers. Contributed by Shane Kumpf 
(cherry picked from commit 5a1db60ab1)
 2018-02-12 15:51:32 -06:00