Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
15,367 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

15367 Commits

Author SHA1 Message Date
Yufei Gu 4f47d9e52b HADOOP-15062. TestCryptoStreamsWithOpensslAesCtrCryptoCodec fails on Debian 9. Contributed by Miklos Szegedi. 
(cherry picked from commit 138c1ed566)
 2020-04-20 13:16:32 +09:00
Ravi Prakash 2096113d06 HADOOP-14597. Native compilation broken with OpenSSL-1.1.0. Contributed by Ravi Prakash. 
(cherry picked from commit 94ca52ae9e)
 2020-04-20 12:53:09 +09:00
Masatake Iwasaki df7cc1edb0 HADOOP-16739. Fix native build failure of hadoop-pipes on CentOS 8. 2020-04-20 12:50:44 +09:00
Wangda Tan 34804679e3 YARN-8369. Javadoc build failed due to 'bad use of >'. (Takanobu Asanuma via wangda) 
Change-Id: I79a42154e8f86ab1c3cc939b3745024b8eebe5f4
(cherry picked from commit 17aa40f669)
 2020-04-19 12:51:56 +09:00
Jonathan Hung ebce5c74e6 YARN-9954. Configurable max application tags and max tag length. Contributed by Bilwa S T 
(cherry picked from commit cd6c10de442fc3a53c9ed5521ac1d944a6ac95c6)
(cherry picked from commit 2c79865b951d0fdea7f576ce31e310b4074ecedd)
 2020-04-17 10:35:39 -07:00
Stephen O'Donnell 9ec141c77f HDFS-15283. Cache pool MAXTTL is not persisted and restored on cluster restart. Contributed by Stephen O'Donnell. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 3481895f8a)
(cherry picked from commit aaad947c74)
(cherry picked from commit 041c93a26c)
(cherry picked from commit 0ea8f3a19c)
 2020-04-16 20:19:38 -07:00
bilaharith 8f60971138 HADOOP-16933. Backport HADOOP-16890 and HADOOP-16825 to branch-2 
Hadoop 16890. Change in expiry calculation for MSI token provider. Contributed by Bilahari T H
(cherry picked from commit 0b931f36ec)

HADOOP-16825: ITestAzureBlobFileSystemCheckAccess failing. Contributed by Bilahari T H
(cherry picked from commit 5944d28130)
 2020-04-16 11:31:51 -07:00
Sneha Vijayarajan 3bc2e26cd7 HADOOP-16778. ABFS: Backport HADOOP-16660 ABFS: Make RetryCount in ExponentialRetryPolicy Configurable to Branch-2. 
Contributed by Sneha Vijayarajan.
 2020-04-16 11:27:46 -07:00
Bilahari T H 17a0bf8d78 HADOOP-16734. Backport HADOOP-16455- "ABFS: Implement FileSystem.access() method" to branch-2. 
Contributed by Bilahari T H.
 2020-04-16 11:25:27 -07:00
Chen Liang 70c2a2992f HDFS-15036. Active NameNode should not silently fail the image transfer. Contributed by Chen Liang. 2020-04-16 11:24:22 -07:00
Eric Yang 7945ed40f0 HADOOP-16361. Fixed TestSecureLogins#testValidKerberosName on branch-2. 
Contributed by Jim Brennan via eyang
 2020-04-16 12:12:21 -04:00
Eric Badger 0e05b02136 YARN-8680. YARN NM: Implement Iterable Abstraction for LocalResourceTracker 
state. Contributed by Pradeep Ambati.
 2020-04-14 18:30:56 +00:00
Eric E Payne 48a8d7691e MAPREDUCE-7272. TaskAttemptListenerImpl excessive log messages. Contributed by Ahmed Hussein (ahussein) 2020-04-13 19:47:27 +00:00
Masatake Iwasaki 00b313d6ff HDFS-15048. Fix findbug in DirectoryScanner. Contributed by Sean Chow. 2020-04-13 16:00:50 +09:00
Masatake Iwasaki 01ed6832f4 HDFS-14476. lock too long when fix inconsistent blocks between disk and in-memory. Contributed by Sean Chow. 2020-04-13 16:00:50 +09:00
Akira Ajisaka 8fae3b1cec
HADOOP-16869. Upgrade findbugs-maven-plugin to 3.0.5 to fix mvn findbugs:findbugs failure (#1855) 
(cherry picked from commit 7f35676f90)

 Conflicts:
	hadoop-project/pom.xml
 2020-04-13 15:17:03 +09:00
Jonathan Hung c0394c5434 YARN-10212. Create separate configuration for max global AM attempts. Contributed by Bilwa S T 
(cherry picked from commit 57659422abbf6d9bf52e6e27fca775254bb77a56)
(cherry picked from commit e3a52804b03d646f15048c078f8c5292d5cbecfa)
(cherry picked from commit 54599b177c)
(cherry picked from commit 6271a2852e)
 2020-04-09 11:07:59 -07:00
Eric E Payne 0ce55c699c YARN-8242. YARN NM: OOM error while reading back the state store on recovery. Contributed by Pradeep Ambati and Kanwaljeet Sachdev 
YARN-10227. Pull YARN-8242 back to branch-2.10. Contributed by Jim Brennan
 2020-04-09 17:18:07 +00:00
Ayush Saxena 10c297af04 HADOOP-16952. Add .diff to gitignore. Contributed by Ayush Saxena. 2020-04-09 19:28:13 +05:30
Eric Badger a3343c4097 YARN-2710. RM HA tests failed intermittently on trunk. Contributed by Ahmed 
Hussein.
 2020-04-09 00:52:45 +00:00
Akira Ajisaka bfeec47759
HADOOP-16949. pylint fails in the build environment (#1926) 
(cherry picked from commit e6455cc864)

Conflicts:
	dev-support/docker/Dockerfile_aarch64
(cherry picked from commit 11aff6c269)
 2020-04-04 16:58:24 +09:00
Jonathan Hung a7556f1ec2 YARN-8213. Add Capacity Scheduler performance metrics. (Weiwei Yang via wangda) 2020-03-27 16:10:39 -07:00
Jonathan Hung 1c8529f030 YARN-10200. Add number of containers to RMAppManager summary 
(cherry picked from commit 2de0572cdc1c6fdbfaab108b169b2d5b0c077e86)
(cherry picked from commit 5d3fb0ebe9)
(cherry picked from commit 9c6dd8c83a)
 2020-03-25 10:39:45 -07:00
Jonathan Hung 2c321c3c30
HADOOP-14918. Remove the Local Dynamo DB test option (branch-2.10) (#1864). Contributed by Jonathan Hung and Gabor Bota. 2020-03-23 16:22:26 +01:00
Eric Badger d01e9c125b Revert "YARN-2710. RM HA tests failed intermittently on trunk. Contributed by Ahmed" 
This reverts commit 85eac8b0df.
 2020-03-17 22:15:38 +00:00
Eric Badger 85eac8b0df YARN-2710. RM HA tests failed intermittently on trunk. Contributed by Ahmed 
Hussein.
 2020-03-16 22:31:43 +00:00
Ayush Saxena 5854aa4ddc HDFS-15197. [SBN read] Change ObserverRetryOnActiveException log to debug. Contributed by Chen Liang. 2020-03-15 16:32:29 +05:30
Inigo Goiri 4069d5d438 HDFS-11396. TestNameNodeMetadataConsistency#testGenerationStampInFuture timed out. Contributed by Ayush Saxena 2020-03-13 15:39:25 -07:00
Masatake Iwasaki 40c755d809 HDFS-15077. Fix intermittent failure of TestDFSClientRetries#testLeaseRenewSocketTimeout. 2020-03-12 12:49:38 +09:00
Eric E Payne e9a7b30fa0 YARN-942. TestContainerSchedulerQueuing.testKillOnlyRequiredOpportunisticContainers fails sporadically Contributed by Ahmed Hussein (ahussein) 
(cherry picked from commit ede05b19d1)
 2020-03-10 15:48:49 +00:00
Weiwei Yang 5d46b06d1f HADOOP-16840. AliyunOSS: getFileStatus throws FileNotFoundException in versioning bucket. Contributed by wujinhu. 
(cherry picked from commit 6dfe00c71e)
 2020-03-08 22:03:32 -07:00
John Zhuge 319e361da0
HADOOP-14206. TestSFTPFileSystem#testFileExists failure: Invalid encoding for signature. Contributed by Jim Brennan. 
(cherry picked from commit 999096d82e)
 2020-03-08 11:36:48 -07:00
Inigo Goiri d547630804 HDFS-15204. TestRetryCacheWithHA testRemoveCacheDescriptor fails intermittently. Contributed by Ahmed Hussein. 2020-03-04 10:07:08 -08:00
Wei-Chiu Chuang 024c33384b Revert "HDFS-15111. stopStandbyServices() should log which service state it is transitioning from. Contributed by Xieming Li." 
This reverts commit cb6b6b4320.
 2020-03-02 15:43:13 -08:00
Ayush Saxena cb6b6b4320 HDFS-15111. stopStandbyServices() should log which service state it is transitioning from. Contributed by Xieming Li. 
(cherry picked from commit b182dd809c)
(cherry picked from commit 7bfa123d58)
 2020-03-02 15:39:21 -08:00
Siyao Meng 6cbde863a5 HADOOP-16891. Upgrade jackson-databind to 2.9.10.3 (#1865) 
(cherry picked from commit e36b272608)
(cherry picked from commit 8a55178f49)
(cherry picked from commit 57783e7e24)
 2020-02-28 17:04:03 -08:00
Wei-Chiu Chuang 5508dda8f4 HADOOP-16882. Update jackson-databind to 2.9.10.2 in branch-3.1, branch-2.10. Contributed by Lisheng Sun. 2020-02-28 16:54:28 -08:00
Inigo Goiri 2d44d7f139 YARN-10161. TestRouterWebServicesREST is corrupting STDOUT. Contributed by Jim Brennan. 
(cherry picked from commit a43510e21d)
 2020-02-27 13:22:16 -08:00
Kihwal Lee 232e9f8ee1 HDFS-15147. LazyPersistTestCase wait logic is error-prone. Contributed 
by Ahmed Hussein.
 2020-02-27 09:58:44 -06:00
Elixir Kook e844f6ffaa
YARN-10156. Fix typo 'complaint' which means quite different in Federation.md (#1856) 
(cherry picked from commit d608e94f92)
 2020-02-26 17:33:05 +09:00
Kihwal Lee 3b86011c24 HDFS-13404. Addendum: RBF: TestRouterWebHDFSContractAppend.testRenameFileBeingAppended fail. Contributed by Takanobu Asanuma. 
(cherry picked from commit b52fd05d42)

Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/contract/AbstractContractAppendTest.java
 2020-02-25 12:28:56 -06:00
Kihwal Lee e80b5ec58d Revert "HDFS-6874. Add GETFILEBLOCKLOCATIONS operation to HttpFS. Contributed by Weiwei Yang" 
This reverts commit b4a108fa9f.

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/client/HttpFSFileSystem.java
	hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/server/FSOperations.java
	hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/client/BaseTestHttpFSWith.java
 2020-02-25 11:33:20 -06:00
Eric E Payne 254b94bf5e YARN-10140: TestTimelineAuthFilterForV2 fails due to login failures in branch-2.10. Contributed by Ahmed Hussein (ahussein) 2020-02-25 16:36:50 +00:00
Ayush Saxena a5c3620bc2 HDFS-15166. Remove redundant field fStream in ByteStringLog. Contributed by Xieming Li. 2020-02-24 20:18:10 +05:30
Konstantin V Shvachko 9c2c14f36d HDFS-15185. StartupProgress reports edits segments until the entire startup completes. Contributed by Konstantin V Shvachko. 
(cherry picked from commit 6f84269bcd)
 2020-02-21 11:02:04 -08:00
Masatake Iwasaki 3fc1c44974 HDFS-15052. WebHDFS getTrashRoot leads to OOM due to FileSystem object creation. (#1758) 
(cherry picked from commit 2338d25dc7)

 Conflicts:
        hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFS.java

(cherry picked from commit 610805ec72)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSUtilClient.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/web/resources/NamenodeWebHdfsMethods.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFS.java
 2020-02-21 14:27:26 +09:00
Ayush Saxena ce06503599 HDFS-15115. Namenode crash caused by NPE in BlockPlacementPolicyDefault when dynamically change logger to debug. Contributed by wangzhixiang 2020-02-19 20:56:08 +05:30
Hanisha Koneru 73ab4a42a6
HDFS-10659. Namenode crashes after Journalnode re-installation in an HA cluster due to missing paxos directory. Contributed by star, Hanisha Koneru. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 7217494f40)
 2020-02-19 18:33:10 +09:00
Wei-Chiu Chuang f87efc1211 HADOOP-16868. ipc.Server readAndProcess threw NullPointerException. Contributed by Tsz-wo Sze. 
(cherry picked from commit cb3f3cca01)
(cherry picked from commit d411a849e1)
(cherry picked from commit b28347d282)
 2020-02-18 21:54:12 -08:00
Kihwal Lee 38e97c2061 HDFS-12459. Fix revert: Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API. Contributed by Weiwei Yang. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 3ead525c71)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/JsonUtil.java
	hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/WebHDFS.md
 2020-02-17 15:49:48 -06:00