Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
19,596 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

19596 Commits

Author SHA1 Message Date
S O'Donnell 1e877761e8 HDFS-15313. Ensure inodes in active filesytem are not deleted during snapshot delete. Contributed by Shashikant Banerjee. 
(cherry picked from commit 1a11c4bc71)
 2020-07-21 08:08:31 +02:00
Masatake Iwasaki 9dd1aa0984 YARN-10347. Fix double locking in CapacityScheduler#reinitialize in branch-3.1. 
(cherry picked from commit 4fa8055aa4)
 2020-07-12 20:18:41 +02:00
Konstantin V Shvachko 4ef7dab215 HDFS-15323. StandbyNode fails transition to active due to insufficient transaction tailing. Contributed by Konstantin V Shvachko. 
(cherry picked from commit ebb878bab9)
 2020-06-24 17:06:35 +02:00
Gabor Bota 637906b4de Revert "HDFS-14941. Potential editlog race condition can cause corrupted file. Contributed by Chen Liang and Konstantin Shvachko." 
This reverts commit c6cbf67b
 2020-06-24 17:04:36 +02:00
Eric Yang 53ae2f9273
SPNEGO TLS verification 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 81d8a887b0)
(cherry picked from commit a8d3d4a2a8)
 2020-06-15 11:23:04 +09:00
Steve Loughran f9be4610c2 Revert "HADOOP-8143. Change distcp to have -pb on by default." 
This reverts commit dd65eea74b.

Change-Id: I74180cf59d5bbad8c9f66cb331535addcbea863e
 2020-05-15 13:55:43 +01:00
Steve Loughran b552fadc99 Revert "HADOOP-14557. Document HADOOP-8143 (Change distcp to have -pb on by default)." 
This reverts commit 44350fdf49.

It is related to the rollback of HADOOP-8143.

Change-Id: If48e3dd670c920ada702dc36461ff398fe9d35cc
 2020-05-15 13:55:43 +01:00
Akira Ajisaka a1f884da16
Revert "SPNEGO TLS verification" 
This reverts commit 8302507581.
 2020-05-13 17:16:34 +09:00
Eric Yang 8302507581
SPNEGO TLS verification 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit ba66f3b454)
(cherry picked from commit 4b7d6667fd)
 2020-05-02 21:54:37 +09:00
Gabor Bota 818cd3b2b2 Preparing for 3.1.4 release 
Change-Id: Ibde183eb466eda4210c0e3ee77dcd27672d337cd
 2020-04-29 11:24:29 +02:00
Akira Ajisaka 74ec3c001d
HDFS-15286. Concat on a same file deleting the file. Contributed by hemanthboyina. 
(cherry picked from commit 5e0eda5d5f)
 2020-04-28 06:30:38 +09:00
Siyao Meng b7d9a5279b HADOOP-17014. Upgrade jackson-databind to 2.9.10.4 (#1981) 
(cherry picked from commit 9aef65cdb2)
 2020-04-27 13:36:26 -07:00
Eric E Payne 7e05577c47 MAPREDUCE-7277. IndexCache totalMemoryUsed differs from cache contents. Contributed by Jon Eagles (jeagles). 
(cherry picked from commit e2322e1117)
 2020-04-27 20:12:27 +00:00
Mingliang Liu 75354285e6
HDFS-15297. TestNNHandlesBlockReportPerStorage::blockReport_02 fails intermittently. Contributed by Ayush Saxena 2020-04-25 15:49:29 -07:00
Dhiraj 68dcdad666
HDFS-15281. Make sure ZKFC uses dfs.namenode.rpc-address to bind to host address (#1964) 
Contributed by Dhiraj Hegde.

Signed-off-by: Mingliang Liu <liuml07@apache.org>
Signed-off-by: Inigo Goiri <inigoiri@apache.org>
 2020-04-25 13:53:32 -07:00
Wei-Chiu Chuang 6f7a30fd71 HDFS-15295. AvailableSpaceBlockPlacementPolicy should use chooseRandomWithStorageTypeTwoTrial() for better performance. Contributed by Jinglun. 
(cherry picked from commit 453771f170)
(cherry picked from commit d6c48f8100)
(cherry picked from commit 9e3b4c9ebd)
 2020-04-24 11:54:29 -07:00
Mingliang Liu 03ff1d3bd8
HDFS-15276. Concat on INodeRefernce fails with illegal state exception. Contributed by hemanthboyina 2020-04-22 14:14:19 -07:00
Mingliang Liu 52ea5a0227
HADOOP-17001. The suffix name of the unified compression class. Contributed by bianqi 2020-04-22 13:08:03 -07:00
Inigo Goiri 3938aa422e HDFS-14004. TestLeaseRecovery2#testCloseWhileRecoverLease fails intermittently in trunk. Contributed by Ayush Saxena. 
(cherry picked from commit efdfe679d6)
(cherry picked from commit 7d64d44515)
 2020-04-21 09:50:31 -07:00
Akira Ajisaka e0db6c33d4
HADOOP-16944. Use Yetus 0.12.0 in GitHub PR (#1917) 
(cherry picked from commit 5576915236)
 2020-04-21 21:13:07 +09:00
Jonathan Hung 6dc1f7e154 YARN-9954. Configurable max application tags and max tag length. Contributed by Bilwa S T 
(cherry picked from commit 49ae9b2137)
(cherry picked from commit d1af4e0fae)
 2020-04-17 10:36:26 -07:00
Stephen O'Donnell 0ea8f3a19c HDFS-15283. Cache pool MAXTTL is not persisted and restored on cluster restart. Contributed by Stephen O'Donnell. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 3481895f8a)
(cherry picked from commit aaad947c74)
(cherry picked from commit 041c93a26c)
 2020-04-16 20:19:26 -07:00
Masatake Iwasaki 796bafedba HADOOP-16982. Update Netty to 4.1.48.Final. Contributed by Lisheng Sun. 2020-04-16 11:57:08 +09:00
Eric E Payne 8bcd7cfc0b MAPREDUCE-7272. TaskAttemptListenerImpl excessive log messages. Contributed by Ahmed Hussein (ahussein) 
(cherry picked from commit 11d17417ce)
 2020-04-13 19:22:56 +00:00
Jonathan Hung 6271a2852e YARN-10212. Create separate configuration for max global AM attempts. Contributed by Bilwa S T 
(cherry picked from commit 57659422abbf6d9bf52e6e27fca775254bb77a56)
(cherry picked from commit e3a52804b03d646f15048c078f8c5292d5cbecfa)
(cherry picked from commit 54599b177c)
 2020-04-09 10:44:39 -07:00
Ayush Saxena 2a089e916b HADOOP-16952. Add .diff to gitignore. Contributed by Ayush Saxena. 2020-04-09 19:27:33 +05:30
Akira Ajisaka d8033bfa96
HADOOP-14836. Upgrade maven-clean-plugin to 3.1.0 (#1933) 
(cherry picked from commit e53d472bb0)
 2020-04-09 01:50:01 +09:00
Akira Ajisaka a6371bfdb8
HADOOP-16949. pylint fails in the build environment (#1926) 
(cherry picked from commit e6455cc864)

Conflicts:
	dev-support/docker/Dockerfile_aarch64
(cherry picked from commit 11aff6c269)
 2020-04-04 16:57:53 +09:00
Ayush Saxena 6a4c3fad66 HDFS-14647. NPE during secure namenode startup. Contributed by Fengnan Li. 
(cherry picked from commit 62deab17a3)
(cherry picked from commit 6cd9290401)
 2020-03-25 17:14:24 -07:00
Eric Yang b837431a08 HDFS-14434. Ignore user.name query parameter in secure WebHDFS. 
Contributed by KWON BYUNGCHANG

(cherry picked from commit d78854b928)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHdfsTokens.java

(cherry picked from commit ba6b3a3848)
 2020-03-25 17:14:18 -07:00
Giovanni Matteo Fumarola 4aa7734fc7 HDFS-14006. Refactor name node to allow different token verification implementations. Contributed by CR Hota. 
(cherry picked from commit 00d5e631b5)
(cherry picked from commit eca7bc7ac4)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNode.java
 2020-03-25 17:13:58 -07:00
Isa Hekmatizadeh d64f688198 HDFS-15219. DFS Client will stuck when ResponseProcessor.run throw Error (#1902). Contributed by zhengchenyu. 
(cherry picked from commit d9c4f1129c)
 2020-03-25 16:52:42 -07:00
Ayush Saxena 4891f24a94 HDFS-15158. The number of failed volumes mismatch with volumeFailures of Datanode metrics. Contributed by Yang Yun. 
(cherry picked from commit 6191d4b4a0)
(cherry picked from commit 1e3b0df6ab)
 2020-03-25 16:42:09 -07:00
Yiqun Lin f1a19b7a3f HDFS-14986. ReplicaCachingGetSpaceUsed throws ConcurrentModificationException. Contributed by Aiphago. 
(cherry picked from commit 2b452b4e60)
 2020-03-25 16:31:54 -07:00
Jonathan Hung 9c6dd8c83a YARN-10200. Add number of containers to RMAppManager summary 
(cherry picked from commit 2de0572cdc1c6fdbfaab108b169b2d5b0c077e86)
(cherry picked from commit 5d3fb0ebe9)
 2020-03-25 10:33:18 -07:00
Sean Mackrory dde8417972 HADOOP-15636. Follow-up from HADOOP-14918; restoring test under new name. Contributed by Gabor Bota. 2020-03-23 13:53:18 -07:00
Sean Mackrory 770e2aaf83 HADOOP-14918. Remove the Local Dynamo DB test option. Contributed by Gabor Bota. 
(cherry picked from commit b089a06793)
 2020-03-23 13:52:08 -07:00
Wei-Chiu Chuang 61915fbd83 HDFS-15208. Suppress bogus AbstractWadlGeneratorGrammarGenerator in KMS stderr in hdfs. 
Contributed by Wei-Chiu Chuang.

Change-Id: I7abeaf4b65e2a4758356aa69ab8930f7e993077d
(cherry picked from commit 096533c2dc)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/resources/log4j.properties

(cherry picked from commit 1d55e1e229)
 2020-03-18 09:59:12 -07:00
Surendra Singh Lilhore a3224ff799 HDFS-15211. EC: File write hangs during close in case of Exception during updatePipeline. Contributed by Ayush Saxena. 2020-03-15 20:59:00 +05:30
Ayush Saxena 8566c65917 HDFS-15197. [SBN read] Change ObserverRetryOnActiveException log to debug. Contributed by Chen Liang. 2020-03-15 16:31:58 +05:30
Steve Loughran caec6a1945 HADOOP-16775. DistCp reuses the same temp file within the task for different files. 
Contributed by Amir Shenavandeh.

This avoids overwrite consistency issues with S3 and other stores

Change-Id: Ic4d05ef3397e963ba28fd9f775bb362b0da36ad9
 2020-03-13 19:34:50 +00:00
S O'Donnell 4e1021975b HDFS-15216. Wrong Use Case of -showprogress in fsck. Contributed by Ravuri Sushma sree. 2020-03-13 15:47:57 +00:00
Eric E Payne 80e394e81b YARN-942. TestContainerSchedulerQueuing.testKillOnlyRequiredOpportunisticContainers fails sporadically Contributed by Ahmed Hussein (ahussein) 
(cherry picked from commit ede05b19d1)
 2020-03-10 15:25:10 +00:00
Brahma Reddy Battula e829631eed HADOOP-16871. Upgrade Netty version to 4.1.45.Final to handle CVE-2019-20444,CVE-2019-16869 
(cherry picked from commit c6b8a30386)
(cherry picked from commit 74fa55afc3)

 Conflicts:
	hadoop-project/pom.xml
 2020-03-09 18:22:18 -07:00
Wei-Chiu Chuang 7bb5bf0e4e HADOOP-16643. Update netty4 to the latest 4.1.42. Contributed by Lisheng Sun. 
(cherry picked from commit 85af77c757)
 2020-03-09 17:58:15 -07:00
Weiwei Yang 79e5633867 HADOOP-16840. AliyunOSS: getFileStatus throws FileNotFoundException in versioning bucket. Contributed by wujinhu. 
(cherry picked from commit 6dfe00c71e)
 2020-03-08 22:01:59 -07:00
John Zhuge c3249fa1ea
HADOOP-14206. TestSFTPFileSystem#testFileExists failure: Invalid encoding for signature. Contributed by Jim Brennan. 
(cherry picked from commit 999096d82e)
 2020-03-08 00:02:02 -08:00
Siyao Meng 57783e7e24 HADOOP-16891. Upgrade jackson-databind to 2.9.10.3 (#1865) 
(cherry picked from commit e36b272608)
(cherry picked from commit 8a55178f49)
 2020-02-28 17:03:38 -08:00
Wei-Chiu Chuang 58b025c8f4 HADOOP-16882. Update jackson-databind to 2.9.10.2 in branch-3.1, branch-2.10. Contributed by Lisheng Sun. 2020-02-28 16:24:38 -08:00
Surendra Singh Lilhore 64eb5b2709 HDFS-15199. NPE in BlockSender. Contributed by Ayush Saxena. 2020-02-28 18:47:54 +05:30