Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,012 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

18012 Commits

Author SHA1 Message Date
Weiwei Yang ad5dd32843 HADOOP-16030. AliyunOSS: bring fixes back from HADOOP-15671. Contributed by wujinhu. 
(cherry picked from commit f87b3b11c4)
 2019-01-07 17:03:22 +08:00
Sunil G a450d58b49
Revert "HADOOP-15759. AliyunOSS: Update oss-sdk version to 3.0.0. Contributed by Jinhu Wu." 
This reverts commit e4fca6aae4.

Revert "HADOOP-15671. AliyunOSS: Support Assume Roles in AliyunOSS. Contributed by Jinhu Wu."

This reverts commit 2b635125fb.

(cherry picked from commit 1f425271a7)
 2019-01-05 17:50:37 +09:00
Pranay Singh a4f8421324 HDFS-14084. Need for more stats in DFSClient. Contributed by Pranay Singh. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit ecdeaa7e6a)
(cherry picked from commit 1f39eae7e6)
(cherry picked from commit e8e55839a0)
 2019-01-03 13:44:57 -08:00
Jonathan Hung a0291a015c YARN-9175. Null resources check in ResourceInfo for branch-3.0 2019-01-03 15:58:10 -05:00
Weiwei Yang c4e39e3a59 YARN-9164. Shutdown NM may cause NPE when opportunistic container scheduling is enabled. Contributed by lujie. 
(cherry picked from commit cfe89e6f96)
 2019-01-04 02:00:59 +08:00
Weiwei Yang f17ef6f451 HADOOP-15323. AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore. Contributed wujinhu. 
(cherry picked from commit 040a202b20)
 2019-01-03 22:04:47 +08:00
Ayush Saxena eb1f44ee04
HADOOP-16025. Update the year to 2019. 
Contributed by Ayush Saxena.

(cherry picked from commit cb26f15428)
 2019-01-02 22:25:57 +00:00
Weiwei Yang 8e0aa7860a MAPREDUCE-7174. Mapreduce example wordmedian should handle generic options. Contributed by Fei Hui. 
(cherry picked from commit 9e7196749e)
 2019-01-02 22:27:41 +08:00
Akira Ajisaka 2556b70c6b
HADOOP-16009. Replace the url of the repository in Apache Hadoop source code. 
(cherry picked from commit eee29ed706)
 2018-12-31 06:32:05 +09:00
Wei-Chiu Chuang 054594c614 HDFS-14171. Performance improvement in Tailing EditLog. Contributed by Kenneth Yang. 
(cherry picked from commit e9a005dfcf)
(cherry picked from commit c48640ffbd)
(cherry picked from commit f24684ca9c)
 2018-12-28 10:39:47 -08:00
Jason Lowe c9fdf7503e HADOOP-15973. Configuration: Included properties are not cached if resource is a stream. Contributed by Eric Payne 2018-12-20 10:00:17 -06:00
Takanobu Asanuma e38e184a19 HDFS-13661. Ls command with e option fails when the filesystem is not HDFS. 
(cherry picked from commit d963575918)
 2018-12-20 10:06:26 +09:00
Eric Yang 2ffd8487b4 YARN-9125. Fixed Carriage Return detection in Docker container launch. 
Contributed by Billie Rinaldi
 2018-12-17 12:29:49 -05:00
Eric Yang 55da3078b1 YARN-9040. Fixed memory leak in LevelDBCacheTimelineStore and DBIterator. 
Contributed by Tarun Parimi

(cherry picked from commit 71e0b0d800)
 2018-12-17 12:08:56 -05:00
Weiwei Yang d78234222d YARN-9009. Fix flaky test TestEntityGroupFSTimelineStore.testCleanLogs. Contributed by OrDTesters. 
(cherry picked from commit 1c09a10e96)
 2018-12-10 12:36:53 +08:00
Jonathan Hung 80ef3e7581 YARN-9085. Add Guaranteed and MaxCapacity to CSQueueMetrics 
(cherry picked from commit 978ab3e958227220cb6f1a08ae6e7cdb8a46628b)
(cherry picked from commit dca69d178dba21c41fd1293187f29143f7e81e19)
 2018-12-07 10:46:07 -08:00
Jason Lowe a7b402b06a HADOOP-15974. Upgrade Curator version to 2.13.0 to fix ZK tests. Contributed by Akira Ajisaka 
(cherry picked from commit 9287ab3642)
 2018-12-04 16:52:33 -06:00
Steve Loughran 38335e0b7d
HADOOP-15966. Hadoop Kerberos broken on macos as java.security.krb5.realm is reset. 
Contributed by Steve Loughran

(cherry picked from commit db2d8b01c6)
 2018-12-04 15:37:36 +00:00
Akira Ajisaka cc4f7ccb27
HADOOP-15970. Upgrade plexus-utils from 2.0.5 to 3.1.0. 
(cherry picked from commit ff31313d83)
 2018-12-04 22:47:38 +09:00
Giovanni Matteo Fumarola 25fdf2ba6c HADOOP-15950. Failover for LdapGroupsMapping. Contributed by Lukas Majercak. 2018-12-03 12:45:51 -08:00
Haibo Chen 0683468d51 YARN-7794. SLSRunner is not loading timeline service jars, causing failure. (Yufei Gu via Haibo Chen) 
(cherry picked from commit fcea5a4d79)
(cherry picked from commit e00e08365e)
 2018-11-30 17:00:13 -08:00
Jonathan Hung 15057a7e67 YARN-9036. Escape newlines in health report in YARN UI. Contributed by Keqiu Hu 
(cherry picked from commit c3d10aa6eddadd0e00edfb87cc77c9483ec8fb13)
 2018-11-30 10:17:26 -08:00
Akira Ajisaka c9c4511a0e
MAPREDUCE-7165. mapred-site.xml is misformatted in single node setup document. Contributed by Zhaohui Xin. 
(cherry picked from commit c9bfca217f)
 2018-11-30 13:31:13 +09:00
Brahma Reddy Battula 6895550043 HDFS-14095. EC: Track Erasure Coding commands in DFS statistics. Contributed by Ayush Saxena. 
(cherry picked from commit f534736867)
 2018-11-30 00:21:07 +05:30
Steve Loughran 065a1e72f2
HADOOP-15959. Revert "HADOOP-12751. While using kerberos Hadoop incorrectly assumes names with '@' to be non-simple" 
This reverts commit 829a2e4d27.

(cherry picked from commit d0edd37269)
 2018-11-29 17:58:15 +00:00
bibinchundatt b42c2679ad YARN-9069. Fix SchedulerInfo#getSchedulerType for custom schedulers. Contributed by Bilwa S T. 
(cherry picked from commit 07142f54a8)
 2018-11-29 22:08:48 +05:30
Jason Lowe 4c238b50df MAPREDUCE-7164. FileOutputCommitter does not report progress while merging paths. Contributed by Kuhu Shukla 
(cherry picked from commit 4d8de7ab69)
 2018-11-28 16:10:02 -06:00
Jason Lowe e4dcc3e606 YARN-8812. Containers fail during creating a symlink which started with hyphen for a resource file. Contributed by Oleksandr Shevchenko 
(cherry picked from commit 3ce99e32f7)
 2018-11-28 08:56:04 -06:00
Steve Loughran 7dac294110
HADOOP-15932. Oozie unable to create sharelib in s3a filesystem. 
Contributed by Steve Loughran.

(cherry picked from commit 4c106fca0c)
 2018-11-27 20:57:16 +00:00
Vinayakumar B 8569555fd1 HDFS-13816. dfs.getQuotaUsage() throws NPE on non-existent dir instead of FileNotFoundException. Contributed by Vinayakumar B. 
(cherry picked from commit b098281454)
 2018-11-26 18:23:20 +05:30
Vinayakumar B c2e65cac5e HADOOP-15948. Inconsistency in get and put syntax if filename/dirname contains space. Contributed by Ayush Saxena. 
(cherry picked from commit 23b441c225)
 2018-11-26 18:14:30 +05:30
Weiwei Yang 8d930ae344 HADOOP-15943. AliyunOSS: add missing owner & group attributes for oss FileStatus. Contributed by wujinhu. 
(cherry picked from commit 5ff0cf86a9)
 2018-11-23 14:39:23 +08:00
Weiwei Yang 8a67f63664 HADOOP-15919. AliyunOSS: Enable Yarn to use OSS. Contributed by wujinhu. 
(cherry picked from commit be0708c6eb)
 2018-11-19 14:50:06 +08:00
Weiwei Yang 067e39f781 YARN-8833. Avoid potential integer overflow when computing fair shares. Contributed by liyakun. 
(cherry picked from commit d027a24f03)
 2018-11-18 23:25:31 +08:00
Vinayakumar B a19c72d7e8 HDFS-14056. Fix error messages in HDFS-12716. Contributed by Ayush Saxena. 
(cherry picked from commit 886b935630bf2d46f4c6773de013c093d2e44c38)
 2018-11-16 18:02:01 +05:30
Vinayakumar B 1b6fa47334 HDFS-13963. NN UI is broken with IE11. Contributed by Ayush Saxena. 
(cherry picked from commit 8571507efa)
 2018-11-16 17:36:50 +05:30
Akira Ajisaka 6dc6978eeb
HADOOP-15925. The config and log of gpg-agent are removed in create-release script. Contributed by Dinesh Chitlangia. 
(cherry picked from commit af5958f7b6)
 2018-11-16 13:18:32 +09:00
Akira Ajisaka 2db612fff9
HADOOP-15930. Exclude MD5 checksum files from release artifact. 
(cherry picked from commit df5e863fee)
 2018-11-15 10:47:53 +09:00
Sammi Chen 64cb97fb44 HADOOP-15917. AliyunOSS: fix incorrect ReadOps and WriteOps in statistics. Contributed by Jinhu Wu. 
(cherry picked from commit 3fade865ce)
 2018-11-14 13:09:11 +08:00
Brahma Reddy Battula 04bba91585 HDFS-14070. Refactor NameNodeWebHdfsMethods to allow better extensibility. Contributed by CR Hota 
(cherry picked from commit e7b63baca1)
 2018-11-13 13:12:56 +05:30
Akira Ajisaka ff1cbb48c8
HADOOP-15923. create-release script should set max-cache-ttl as well as default-cache-ttl for gpg-agent. 
(cherry picked from commit 703b2860a4)
 2018-11-13 13:42:19 +09:00
Arpit Agarwal f514c08900 HDFS-14065. Failed Storage Locations shows nothing in the Datanode Volume Failures. Contributed by Ayush Saxena. 
(cherry picked from commit b6d4e19f34)
 2018-11-12 15:31:56 -08:00
Akira Ajisaka 50ce9fd4e2
YARN-8233. NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null. Contributed by Tao Yang. 2018-11-10 18:02:57 +09:00
Akira Ajisaka ca331c8057
HADOOP-15916. Upgrade Maven Surefire plugin to 3.0.0-M1. 
(cherry picked from commit a736b5da15)
(cherry picked from commit 7b62c9684d)
 2018-11-10 00:28:46 +09:00
Kitti Nanasi bbc94de477 HDFS-14039. ec -listPolicies doesn't show correct state for the default policy when the default is not RS(6,3). Contributed by Kitti Nanasi. 
Signed-off-by: Xiao Chen <xiao@apache.org>
(cherry picked from commit 8d99648c20)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ErasureCodingPolicyManager.java

(cherry picked from commit 01b8197893)
 2018-11-08 10:22:32 -08:00
Vinayakumar B 76be3515bf HDFS-13772. Erasure coding: Unnecessary NameNode Logs displaying for Enabling/Disabling Erasure coding policies which are already enabled/disabled. Contributed by Ayush Saxena 
(cherry picked from commit 8df2eb8119)
 2018-11-08 10:22:32 -08:00
Weiwei Yang be2a0a5e23 YARN-8977. Remove unnecessary type casting when calling AbstractYarnScheduler#getSchedulerNode. Contributed by Wanqiang Ji. 
(cherry picked from commit c96cbe8659)
 2018-11-07 22:54:34 +08:00
Takanobu Asanuma eb365039da YARN-8866. Fix a parsing error for crossdomain.xml. 
(cherry picked from commit 8dc1f6dbf7)
 2018-11-07 18:28:15 +09:00
Jason Lowe e830d73adb MAPREDUCE-7156. NullPointerException when reaching max shuffle connections. Contributed by Peter Bacsko 
(cherry picked from commit ba1f9d66d9)
 2018-11-06 18:11:39 -06:00
Inigo Goiri c4d390a775 HDFS-14048. DFSOutputStream close() throws exception on subsequent call after DataNode restart. Contributed by Erik Krogen. 
(cherry picked from commit 887244de4a)
 2018-11-06 11:21:19 -08:00