Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,001 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

18001 Commits

Author SHA1 Message Date
Takanobu Asanuma e38e184a19 HDFS-13661. Ls command with e option fails when the filesystem is not HDFS. 
(cherry picked from commit d963575918)
 2018-12-20 10:06:26 +09:00
Eric Yang 2ffd8487b4 YARN-9125. Fixed Carriage Return detection in Docker container launch. 
Contributed by Billie Rinaldi
 2018-12-17 12:29:49 -05:00
Eric Yang 55da3078b1 YARN-9040. Fixed memory leak in LevelDBCacheTimelineStore and DBIterator. 
Contributed by Tarun Parimi

(cherry picked from commit 71e0b0d800)
 2018-12-17 12:08:56 -05:00
Weiwei Yang d78234222d YARN-9009. Fix flaky test TestEntityGroupFSTimelineStore.testCleanLogs. Contributed by OrDTesters. 
(cherry picked from commit 1c09a10e96)
 2018-12-10 12:36:53 +08:00
Jonathan Hung 80ef3e7581 YARN-9085. Add Guaranteed and MaxCapacity to CSQueueMetrics 
(cherry picked from commit 978ab3e958227220cb6f1a08ae6e7cdb8a46628b)
(cherry picked from commit dca69d178dba21c41fd1293187f29143f7e81e19)
 2018-12-07 10:46:07 -08:00
Jason Lowe a7b402b06a HADOOP-15974. Upgrade Curator version to 2.13.0 to fix ZK tests. Contributed by Akira Ajisaka 
(cherry picked from commit 9287ab3642)
 2018-12-04 16:52:33 -06:00
Steve Loughran 38335e0b7d
HADOOP-15966. Hadoop Kerberos broken on macos as java.security.krb5.realm is reset. 
Contributed by Steve Loughran

(cherry picked from commit db2d8b01c6)
 2018-12-04 15:37:36 +00:00
Akira Ajisaka cc4f7ccb27
HADOOP-15970. Upgrade plexus-utils from 2.0.5 to 3.1.0. 
(cherry picked from commit ff31313d83)
 2018-12-04 22:47:38 +09:00
Giovanni Matteo Fumarola 25fdf2ba6c HADOOP-15950. Failover for LdapGroupsMapping. Contributed by Lukas Majercak. 2018-12-03 12:45:51 -08:00
Haibo Chen 0683468d51 YARN-7794. SLSRunner is not loading timeline service jars, causing failure. (Yufei Gu via Haibo Chen) 
(cherry picked from commit fcea5a4d79)
(cherry picked from commit e00e08365e)
 2018-11-30 17:00:13 -08:00
Jonathan Hung 15057a7e67 YARN-9036. Escape newlines in health report in YARN UI. Contributed by Keqiu Hu 
(cherry picked from commit c3d10aa6eddadd0e00edfb87cc77c9483ec8fb13)
 2018-11-30 10:17:26 -08:00
Akira Ajisaka c9c4511a0e
MAPREDUCE-7165. mapred-site.xml is misformatted in single node setup document. Contributed by Zhaohui Xin. 
(cherry picked from commit c9bfca217f)
 2018-11-30 13:31:13 +09:00
Brahma Reddy Battula 6895550043 HDFS-14095. EC: Track Erasure Coding commands in DFS statistics. Contributed by Ayush Saxena. 
(cherry picked from commit f534736867)
 2018-11-30 00:21:07 +05:30
Steve Loughran 065a1e72f2
HADOOP-15959. Revert "HADOOP-12751. While using kerberos Hadoop incorrectly assumes names with '@' to be non-simple" 
This reverts commit 829a2e4d27.

(cherry picked from commit d0edd37269)
 2018-11-29 17:58:15 +00:00
bibinchundatt b42c2679ad YARN-9069. Fix SchedulerInfo#getSchedulerType for custom schedulers. Contributed by Bilwa S T. 
(cherry picked from commit 07142f54a8)
 2018-11-29 22:08:48 +05:30
Jason Lowe 4c238b50df MAPREDUCE-7164. FileOutputCommitter does not report progress while merging paths. Contributed by Kuhu Shukla 
(cherry picked from commit 4d8de7ab69)
 2018-11-28 16:10:02 -06:00
Jason Lowe e4dcc3e606 YARN-8812. Containers fail during creating a symlink which started with hyphen for a resource file. Contributed by Oleksandr Shevchenko 
(cherry picked from commit 3ce99e32f7)
 2018-11-28 08:56:04 -06:00
Steve Loughran 7dac294110
HADOOP-15932. Oozie unable to create sharelib in s3a filesystem. 
Contributed by Steve Loughran.

(cherry picked from commit 4c106fca0c)
 2018-11-27 20:57:16 +00:00
Vinayakumar B 8569555fd1 HDFS-13816. dfs.getQuotaUsage() throws NPE on non-existent dir instead of FileNotFoundException. Contributed by Vinayakumar B. 
(cherry picked from commit b098281454)
 2018-11-26 18:23:20 +05:30
Vinayakumar B c2e65cac5e HADOOP-15948. Inconsistency in get and put syntax if filename/dirname contains space. Contributed by Ayush Saxena. 
(cherry picked from commit 23b441c225)
 2018-11-26 18:14:30 +05:30
Weiwei Yang 8d930ae344 HADOOP-15943. AliyunOSS: add missing owner & group attributes for oss FileStatus. Contributed by wujinhu. 
(cherry picked from commit 5ff0cf86a9)
 2018-11-23 14:39:23 +08:00
Weiwei Yang 8a67f63664 HADOOP-15919. AliyunOSS: Enable Yarn to use OSS. Contributed by wujinhu. 
(cherry picked from commit be0708c6eb)
 2018-11-19 14:50:06 +08:00
Weiwei Yang 067e39f781 YARN-8833. Avoid potential integer overflow when computing fair shares. Contributed by liyakun. 
(cherry picked from commit d027a24f03)
 2018-11-18 23:25:31 +08:00
Vinayakumar B a19c72d7e8 HDFS-14056. Fix error messages in HDFS-12716. Contributed by Ayush Saxena. 
(cherry picked from commit 886b935630bf2d46f4c6773de013c093d2e44c38)
 2018-11-16 18:02:01 +05:30
Vinayakumar B 1b6fa47334 HDFS-13963. NN UI is broken with IE11. Contributed by Ayush Saxena. 
(cherry picked from commit 8571507efa)
 2018-11-16 17:36:50 +05:30
Akira Ajisaka 6dc6978eeb
HADOOP-15925. The config and log of gpg-agent are removed in create-release script. Contributed by Dinesh Chitlangia. 
(cherry picked from commit af5958f7b6)
 2018-11-16 13:18:32 +09:00
Akira Ajisaka 2db612fff9
HADOOP-15930. Exclude MD5 checksum files from release artifact. 
(cherry picked from commit df5e863fee)
 2018-11-15 10:47:53 +09:00
Sammi Chen 64cb97fb44 HADOOP-15917. AliyunOSS: fix incorrect ReadOps and WriteOps in statistics. Contributed by Jinhu Wu. 
(cherry picked from commit 3fade865ce)
 2018-11-14 13:09:11 +08:00
Brahma Reddy Battula 04bba91585 HDFS-14070. Refactor NameNodeWebHdfsMethods to allow better extensibility. Contributed by CR Hota 
(cherry picked from commit e7b63baca1)
 2018-11-13 13:12:56 +05:30
Akira Ajisaka ff1cbb48c8
HADOOP-15923. create-release script should set max-cache-ttl as well as default-cache-ttl for gpg-agent. 
(cherry picked from commit 703b2860a4)
 2018-11-13 13:42:19 +09:00
Arpit Agarwal f514c08900 HDFS-14065. Failed Storage Locations shows nothing in the Datanode Volume Failures. Contributed by Ayush Saxena. 
(cherry picked from commit b6d4e19f34)
 2018-11-12 15:31:56 -08:00
Akira Ajisaka 50ce9fd4e2
YARN-8233. NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null. Contributed by Tao Yang. 2018-11-10 18:02:57 +09:00
Akira Ajisaka ca331c8057
HADOOP-15916. Upgrade Maven Surefire plugin to 3.0.0-M1. 
(cherry picked from commit a736b5da15)
(cherry picked from commit 7b62c9684d)
 2018-11-10 00:28:46 +09:00
Kitti Nanasi bbc94de477 HDFS-14039. ec -listPolicies doesn't show correct state for the default policy when the default is not RS(6,3). Contributed by Kitti Nanasi. 
Signed-off-by: Xiao Chen <xiao@apache.org>
(cherry picked from commit 8d99648c20)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ErasureCodingPolicyManager.java

(cherry picked from commit 01b8197893)
 2018-11-08 10:22:32 -08:00
Vinayakumar B 76be3515bf HDFS-13772. Erasure coding: Unnecessary NameNode Logs displaying for Enabling/Disabling Erasure coding policies which are already enabled/disabled. Contributed by Ayush Saxena 
(cherry picked from commit 8df2eb8119)
 2018-11-08 10:22:32 -08:00
Weiwei Yang be2a0a5e23 YARN-8977. Remove unnecessary type casting when calling AbstractYarnScheduler#getSchedulerNode. Contributed by Wanqiang Ji. 
(cherry picked from commit c96cbe8659)
 2018-11-07 22:54:34 +08:00
Takanobu Asanuma eb365039da YARN-8866. Fix a parsing error for crossdomain.xml. 
(cherry picked from commit 8dc1f6dbf7)
 2018-11-07 18:28:15 +09:00
Jason Lowe e830d73adb MAPREDUCE-7156. NullPointerException when reaching max shuffle connections. Contributed by Peter Bacsko 
(cherry picked from commit ba1f9d66d9)
 2018-11-06 18:11:39 -06:00
Inigo Goiri c4d390a775 HDFS-14048. DFSOutputStream close() throws exception on subsequent call after DataNode restart. Contributed by Erik Krogen. 
(cherry picked from commit 887244de4a)
 2018-11-06 11:21:19 -08:00
Jason Lowe f3e6682ba7 YARN-8865. RMStateStore contains large number of expired RMDelegationToken. Contributed by Wilfred Spiegelenburg 
(cherry picked from commit ab6aa4c726)
 2018-11-06 08:59:47 -06:00
Weiwei Yang ddb349ceb3 YARN-8970. Improve the debug message in CS#allocateContainerOnSingleNode. Contributed by Zhankun Tang. 
(cherry picked from commit 5d6554c722)
 2018-11-06 14:54:33 +08:00
Weiwei Yang c3a0f07db0 YARN-8969. AbstractYarnScheduler#getNodeTracker should return generic type to avoid type casting. Contributed by Wanqiang Ji. 
(cherry picked from commit c7fcca0d7e)
 2018-11-06 13:43:24 +08:00
Inigo Goiri 4b47daa640 HDFS-14043. Tolerate corrupted seen_txid file. Contributed by Lukas Majercak. 
(cherry picked from commit f3296501e0)
(cherry picked from commit 9bf4f3d614)
 2018-11-05 16:53:28 -08:00
Akira Ajisaka aee665f2db
HADOOP-15900. Update JSch versions in LICENSE.txt. 
(cherry picked from commit d43cc5db0f)
 2018-11-05 17:52:36 +09:00
Akira Ajisaka 869b1cee67
HADOOP-15899. Update AWS Java SDK versions in NOTICE.txt. 
(cherry picked from commit 73d8f8761e)
 2018-11-05 15:32:23 +09:00
Jonathan Hung 68ec0fa0a8 YARN-7225. Add queue and partition info to RM audit log. Contributed by Eric Payne 
(cherry picked from commit 2ab611d48b)
 2018-11-01 14:31:57 -07:00
Akira Ajisaka 2ae21d5387
Addendum: Fix potential FSImage corruption. Contributed by Xiao Chen. 
(cherry picked from commit dd70b1f538)
 2018-10-31 17:03:47 +09:00
Xiao Chen 20c9a12bc7 HDFS-14027. DFSStripedOutputStream should implement both hsync methods. 
(cherry picked from commit db7e636824)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSStripedOutputStream.java

(cherry picked from commit 399645ebc1)
 2018-10-29 19:14:12 -07:00
Wei-Chiu Chuang 0f34ff7722 Revert "HADOOP-15864. Job submitter / executor fail when SBN domain name can not resolved. Contributed by He Xiaoqiao." 
This reverts commit fa01a8fa0e.
 2018-10-28 17:07:29 -07:00
Anu Engineer c5b704a34c HDFS-14028. HDFS OIV temporary dir deletes folder. 
Contributed by Adam Antal.

(cherry picked from commit 4f10d7e23f)
 2018-10-26 16:55:55 -07:00