Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
14,698 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

14698 Commits

Author SHA1 Message Date
Inigo Goiri 5cef413a8e HADOOP-15950. Failover for LdapGroupsMapping. Contributed by Lukas Majercak. 2018-12-03 13:23:10 -08:00
Inigo Goiri a29eb49f85 Revert "HADOOP-15950. Failover for LdapGroupsMapping. Contributed by Lukas Majercak." 
This reverts commit b98ffbe3f2.
 2018-12-03 13:22:14 -08:00
Giovanni Matteo Fumarola b98ffbe3f2 HADOOP-15950. Failover for LdapGroupsMapping. Contributed by Lukas Majercak. 2018-12-03 12:46:30 -08:00
Jonathan Hung 74e40981eb YARN-7794. SLSRunner is not loading timeline service jars, causing failure. 2018-11-30 17:03:01 -08:00
Jonathan Hung 7456da99c1 YARN-9036. Escape newlines in health report in YARN UI. Contributed by Keqiu Hu 2018-11-30 10:18:17 -08:00
Steve Loughran a3470c65d8
HADOOP-15959. Revert "HADOOP-12751. While using kerberos Hadoop incorrectly assumes names with '@' to be non-simple" 2018-11-30 11:33:19 +00:00
Yiqun Lin 50e11dc807 HDFS-13870. WebHDFS: Document ALLOWSNAPSHOT and DISALLOWSNAPSHOT API doc. Contributed by Siyao Meng. 
(cherry picked from commit 0e36e935d9)
 2018-11-30 11:34:28 +08:00
Weiwei Yang 408f60e6d8 HADOOP-15943. AliyunOSS: add missing owner & group attributes for oss FileStatus. Contributed by wujinhu. 
(cherry picked from commit 5ff0cf86a9)
 2018-11-23 14:46:48 +08:00
Akira Ajisaka d892d82ac0
Update jdiff.stable.api from 2.9.1 to 2.9.2. 2018-11-20 14:32:49 +09:00
Akira Ajisaka 6cae964f6c
Add 2.9.2 release notes and changes documents. 
(cherry picked from commit 1a00b4e325)
 2018-11-20 14:30:09 +09:00
Weiwei Yang 311be8864f HADOOP-15919. AliyunOSS: Enable Yarn to use OSS. Contributed by wujinhu. 
(cherry picked from commit be0708c6eb)
 2018-11-19 15:03:54 +08:00
Vinayakumar B c3f0681f99 HDFS-14056. Fix error messages in HDFS-12716. Contributed by Ayush Saxena. 
(cherry picked from commit 886b935630bf2d46f4c6773de013c093d2e44c38)
 2018-11-16 18:02:10 +05:30
Vinayakumar B bc4098eb07 HDFS-13963. NN UI is broken with IE11. Contributed by Ayush Saxena. 
(cherry picked from commit 8571507efa)
 2018-11-16 17:43:49 +05:30
Akira Ajisaka c39e1ee2b9
HADOOP-15925. The config and log of gpg-agent are removed in create-release script. Contributed by Dinesh Chitlangia. 
(cherry picked from commit af5958f7b6)
 2018-11-16 13:18:48 +09:00
Akira Ajisaka 4199086084
HADOOP-15930. Exclude MD5 checksum files from release artifact. 
(cherry picked from commit df5e863fee)
 2018-11-15 10:49:37 +09:00
Sammi Chen 3aac324a07 HADOOP-15917. AliyunOSS: fix incorrect ReadOps and WriteOps in statistics. Contributed by Jinhu Wu. 
(cherry picked from commit 3fade865ce)
(cherry picked from commit 64cb97fb44)
(cherry picked from commit 5d532cfc6f)
(cherry picked from commit 37082a664a)
 2018-11-14 13:53:53 +08:00
Akira Ajisaka a86b665340
HADOOP-15923. create-release script should set max-cache-ttl as well as default-cache-ttl for gpg-agent. 
(cherry picked from commit 703b2860a4)
 2018-11-13 13:42:37 +09:00
Botong Huang b7ca20e16e YARN-8933. [AMRMProxy] Fix potential empty fields in allocation response, move SubClusterTimeout to FederationInterceptor. Contributed by Botong Huang. 2018-11-11 19:41:08 -08:00
Akira Ajisaka ee1cb3b6e8
YARN-8233. NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null. Contributed by Tao Yang. 2018-11-10 21:44:46 +09:00
Jason Lowe 5e433e5bd0 MAPREDUCE-7156. NullPointerException when reaching max shuffle connections. Contributed by Peter Bacsko 
(cherry picked from commit ba1f9d66d9)
 2018-11-06 18:14:12 -06:00
Inigo Goiri d9b3b58389 HDFS-14048. DFSOutputStream close() throws exception on subsequent call after DataNode restart. Contributed by Erik Krogen. 2018-11-06 12:16:46 -08:00
Inigo Goiri 98075d9224 HDFS-14043. Tolerate corrupted seen_txid file. Contributed by Lukas Majercak. 
(cherry picked from commit f3296501e0)
(cherry picked from commit 9bf4f3d614)
 2018-11-05 16:56:37 -08:00
Akira Ajisaka 939827daa6
HADOOP-15900. Update JSch versions in LICENSE.txt. 
(cherry picked from commit d43cc5db0f)

Conflicts:
	LICENSE.txt
 2018-11-05 17:53:53 +09:00
Akira Ajisaka 72ee45acff
HADOOP-15899. Update AWS Java SDK versions in NOTICE.txt. 2018-11-05 15:32:54 +09:00
bibinchundatt 731b90d44f YARN-8905. [Router] Add JvmMetricsInfo and pause monitor. Contributed by Bilwa S T. 
(cherry picked from commit f84a278baa)
 2018-11-03 20:50:28 +05:30
Giovanni Matteo Fumarola 81da8b262b YARN-8893. [AMRMProxy] Fix thread leak in AMRMClientRelayer and UAM client. Contributed by Botong Huang. 2018-11-02 16:02:56 -07:00
Jonathan Hung 62ec800bd4 YARN-7225. Add queue and partition info to RM audit log. Contributed by Eric Payne 2018-11-01 14:13:15 -07:00
Akira Ajisaka c19baf19da
Addendum: Fix potential FSImage corruption. Contributed by Xiao Chen. 
(cherry picked from commit dd70b1f538)
 2018-10-31 17:04:06 +09:00
Steve Loughran f23f339a6c
HADOOP-15866. Renamed HADOOP_SECURITY_GROUP_SHELL_COMMAND_TIMEOUT keys break compatibility. 
Contributed by Wei-Chiu Chuang.

(cherry picked from commit 52cb766ad0)
 2018-10-30 09:58:59 +09:00
Sammi Chen a0aa610143 HADOOP-15868. AliyunOSS: update document for properties of multiple part download, multiple part upload and directory copy. Contributed by Jinhu Wu. 
(cherry picked from commit 7574d18538)
(cherry picked from commit 366541d834)
(cherry picked from commit c5a227062f)
(cherry picked from commit ca22bf175f)
 2018-10-26 15:35:30 +08:00
Wei-Chiu Chuang f2739f3f59 HADOOP-15850. CopyCommitter#concatFileChunks should check that the blocks per chunk is not 0. Contributed by Ted Yu. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit e2cecb681e)
(cherry picked from commit a7dd244a49)

	modified:   hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/mapred/CopyCommitter.java
(cherry picked from commit 84726679f0)

(cherry picked from commit 8360d15abc)
 2018-10-24 09:39:31 -07:00
Akira Ajisaka ca699774a2
HADOOP-15822. zstd compressor can fail with a small output buffer. Contributed by Jason Lowe. 
(cherry picked from commit 8f97d6f2cd)

Conflicts:
	dev-support/docker/Dockerfile
 2018-10-24 14:00:34 +09:00
Rohith Sharma K S dbf36dbb8d YARN-8826. Fix lingering timeline collector after serviceStop in TimelineCollectorManager. Contributed by Prabha Manepalli. 
(cherry picked from commit 0b62983c5a)
 2018-10-23 14:10:24 +05:30
Sunil G 56a27284a7 YARN-7502. Nodemanager restart docs should describe nodemanager supervised property. Contributed by Suma Shivaprasad. 
(cherry picked from commit e50334513c)
 2018-10-22 14:18:37 +05:30
Jason Lowe e412d8f6cd HADOOP-15859. ZStandardDecompressor.c mistakes a class for an instance. Contributed by Jason Lowe 
(cherry picked from commit 9abda83947)
 2018-10-17 14:45:56 -05:00
Vinayakumar B e212d7d81f Fix potential FSImage corruption. Contributed by Daryn Sharp. 2018-10-15 16:04:34 +05:30
Inigo Goiri 0ba621029c HDFS-13802. RBF: Remove FSCK from Router Web UI. Contributed by Fei Hui. 
(cherry picked from commit f63ee083db)
 2018-10-12 10:12:40 -07:00
Steve Loughran 437bfa90c2
HADOOP-15837. DynamoDB table Update can fail S3A FS init. 
Contributed by Steve Loughran.

(cherry picked from commit f1fbc56371)
 2018-10-12 09:49:28 +01:00
Vrushali C 7ed627af6b YARN-3879 [Storage implementation] Create HDFS backing storage implementation for ATS reads. Contributed by Abhishek Modi. 2018-10-11 21:23:34 -07:00
Wangda Tan 91f18a5148 YARN-7274. Ability to disable elasticity at leaf queue level. (Zian Chen via wangda) 
Change-Id: Ic8d43e297f0f5de788b562f7eff8106c5c35e8d2
(cherry picked from commit 74665e3a7d)
 2018-10-11 16:58:07 +00:00
Steve Loughran 5da49631b6
HADOOP-15679. ShutdownHookManager shutdown time needs to be configurable & extended. 2018-10-11 12:43:09 +01:00
Vrushali C 7a5d27dde4 YARN-6989 Ensure timeline service v2 codebase gets UGI from HttpServletRequest in a consistent way. Contributed by Abhishek Modi 2018-10-10 15:25:58 -07:00
Weiwei Yang cc1bf7f894 YARN-8858. CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used. Contributed by Wangda Tan. 
(cherry picked from commit edce866489)
 2018-10-10 10:17:18 +08:00
Weiwei Yang d412785175 YARN-8720. CapacityScheduler does not enforce max resource allocation check at queue level. Contributed by Tarun Parimi. 
(cherry picked from commit f1a893fdbc)
 2018-10-10 10:16:16 +08:00
Inigo Goiri b0900ad310 YARN-7652. Handle AM register requests asynchronously in FederationInterceptor. Contributed by Botong Huang. 
(cherry picked from commit c3d22d3b45)
 2018-10-09 10:30:42 -07:00
Vidura Mudalige fa4a111037
HADOOP-15818. Fix deprecated maven-surefire-plugin configuration in hadoop-kms module 
This closes #425

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit a30b1d1824)
 2018-10-09 12:57:42 +09:00
Yiqun Lin c632c6e6e9 HDFS-13768. Adding replicas to volume map makes DataNode start slowly. Contributed by Surendra Singh Lilhore. 2018-10-09 10:20:37 +08:00
Inigo Goiri 5539dd97d2 HDFS-13964. RBF: TestRouterWebHDFSContractAppend fails with No Active Namenode under nameservice. Contributed by Ayush Saxena. 
(cherry picked from commit 3bfff0f79e)
 2018-10-06 10:43:36 -07:00
Jason Lowe d7e9ea37bf HADOOP-15820. ZStandardDecompressor native code sets an integer field as a long. Contributed by Jason Lowe 
(cherry picked from commit f13e231025)
 2018-10-05 09:30:50 -05:00
Yiqun Lin 7b88a57c37 HADOOP-15817. Reuse Object Mapper in KMSJSONReader. Contributed by Jonathan Eagles. 
(cherry picked from commit 81f635f47f)
 2018-10-04 10:47:22 +08:00