Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
15,299 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

3672 Commits

Author SHA1 Message Date
sguggilam 4eb1f81876
HADOOP-17164 UGI loginUserFromKeytab doesn't set the last login time (#2194) 
Contributed by Sandeep Guggilam.

Signed-off-by: Mingliang Liu <liuml07@apache.org>
Signed-off-by: Steve Loughran <stevel@apache.org>
 2020-08-05 09:04:01 -07:00
Chen Liang 3044a13080 HDFS-15404. ShellCommandFencer should expose info about source. Contributed by Chen Liang. 
(cherry picked from commit 3833c616e0)
(cherry picked from commit 370efc6d95)
(cherry picked from commit 1e33696bc8)
 2020-07-20 15:26:44 -07:00
Akira Ajisaka e53186954d HADOOP-16753. Refactor HAAdmin. Contributed by Xieming Li. 
(cherry picked from commit 1defe3a65a)
(cherry picked from commit 0d949d375e)
(cherry picked from commit 635067d03d)
 2020-07-20 13:39:00 -07:00
Erik Krogen f36d524a10 HADOOP-17127. Use RpcMetrics.TIMEUNIT to initialize rpc queueTime and processingTime. Contributed by Jim Brennan. 2020-07-15 08:33:42 -07:00
Chris Douglas d50f5b7df4 HADOOP-14354. SysInfoWindows is not thread safe. Contributed by Inigo Goiri 
(cherry picked from commit 689fb2fc66)
 2020-07-10 14:37:05 +09:00
Akira Ajisaka 3969327077 HADOOP-12940. Fix warnings from Spotbugs in hadoop-common. 
Conflicts:
	hadoop-common-project/hadoop-common/dev-support/findbugsExcludeFile.xml
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/erasurecode/ECSchema.java
 2020-07-10 13:38:08 +09:00
Mingliang Liu 8e01bd317b
HADOOP-17059. ArrayIndexOfboundsException in ViewFileSystem#listStatus. Contributed by hemanthboyina 2020-06-10 09:03:57 -07:00
Kihwal Lee 14ff6171a5 HADOOP-16255. Add ChecksumFs.rename(path, path, boolean). Contributed by Jungtaek Lim. 2020-06-08 17:31:16 -05:00
Mingliang Liu dcc6d63828
HADOOP-17047. TODO comment exist in trunk while related issue HADOOP-6223 is already fixed. Contributed by Rungroj Maipradit 2020-06-08 11:34:01 -07:00
Dhiraj e49573631c
HADOOP-17052. NetUtils.connect() throws unchecked exception (UnresolvedAddressException) causing clients to abort (#2036) 
Contributed by Dhiraj Hegde.

Signed-off-by: Mingliang Liu <liuml07@apache.org>
 2020-06-01 11:08:32 -07:00
Masatake Iwasaki e2c7c8d96f HADOOP-17045. `Configuration` javadoc describes supporting environment variables, but the feature is not available. 2020-05-18 11:11:46 +09:00
Virajith Jalaparti cf12c1349d Revert "HADOOP-12077. Provide a multi-URI replication Inode for ViewFs. Contributed by Gera Shegalov" 
This reverts commit e6b7112c88.
 2020-05-13 08:18:43 -07:00
Chris Douglas e6b7112c88 HADOOP-12077. Provide a multi-URI replication Inode for ViewFs. Contributed by Gera Shegalov 
(cherry picked from commit 6d3d01d7ad)
 2020-05-13 07:44:50 -07:00
Andrew Wang ae2bc55bfc HADOOP-8299. ViewFileSystem link slash mount point crashes with IndexOutOfBoundsException. Contributed by Manoj Govindassamy. 
(cherry picked from commit 22ff0eff4d)
 2020-05-13 06:56:15 -07:00
Virajith Jalaparti 284a1e58d7 HADOOP-15565. Add an inner FS cache to ViewFileSystem, separate from the global cache, to avoid file system leaks. Contributed by Jinglun. 2020-05-12 20:41:19 -07:00
Dhiraj 23b15089ad
HDFS-15281. Make sure ZKFC uses dfs.namenode.rpc-address to bind to host address (#1964) 
Contributed by Dhiraj Hegde.

Signed-off-by: Mingliang Liu <liuml07@apache.org>
Signed-off-by: Inigo Goiri <inigoiri@apache.org>
 2020-04-25 13:54:26 -07:00
Masatake Iwasaki 34862e4ff8 HADOOP-16647. Support OpenSSL 1.1.1 LTS. Contributed by Rakesh Radhakrishnan. 
(cherry picked from commit 8f8be6b92a)
 2020-04-20 13:22:45 +09:00
Yufei Gu 4f47d9e52b HADOOP-15062. TestCryptoStreamsWithOpensslAesCtrCryptoCodec fails on Debian 9. Contributed by Miklos Szegedi. 
(cherry picked from commit 138c1ed566)
 2020-04-20 13:16:32 +09:00
Ravi Prakash 2096113d06 HADOOP-14597. Native compilation broken with OpenSSL-1.1.0. Contributed by Ravi Prakash. 
(cherry picked from commit 94ca52ae9e)
 2020-04-20 12:53:09 +09:00
Kihwal Lee 3b86011c24 HDFS-13404. Addendum: RBF: TestRouterWebHDFSContractAppend.testRenameFileBeingAppended fail. Contributed by Takanobu Asanuma. 
(cherry picked from commit b52fd05d42)

Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/contract/AbstractContractAppendTest.java
 2020-02-25 12:28:56 -06:00
Wei-Chiu Chuang f87efc1211 HADOOP-16868. ipc.Server readAndProcess threw NullPointerException. Contributed by Tsz-wo Sze. 
(cherry picked from commit cb3f3cca01)
(cherry picked from commit d411a849e1)
(cherry picked from commit b28347d282)
 2020-02-18 21:54:12 -08:00
Kihwal Lee 9cc63d1f63 HADOOP-15787. TestIPC.testRTEDuringConnectionSetup fails with jdk8u242. Contributed by Zsolt Venczel. 
(cherry picked from commit a463cf75a0)
(cherry picked from commit 0b19c8e086)
 2020-02-05 13:33:30 -06:00
Chen Liang b97fdb7b4c HDFS-15148. dfs.namenode.send.qop.enabled should not apply to primary NN port. Contributed by Chen Liang. 2020-02-04 12:59:31 -08:00
Kihwal Lee 8d4671b611 HADOOP-16683. Disable retry of FailoverOnNetworkExceptionRetry in case of wrapped AccessControlException. Contributed by Adam Antal 
(cherry picked from commit 3d249301f4)
 2020-01-24 11:08:24 -06:00
Kihwal Lee 2873a705f4 HADOOP-16580. Disable retry of FailoverOnNetworkExceptionRetry in case of AccessControlException. Contributed by Adam Antal 
(cherry picked from commit c79a5f2d99)
 2020-01-24 11:07:06 -06:00
sunlisheng dc010b9844 HADOOP-16793. Redefine log level when ipc connection interrupted in Client#handleSaslConnectionFailure(). 
Signed-off-by: sunlisheng <sunlisheng@xiaomi.com>
(cherry picked from commit d887e49dd4)
 2020-01-21 18:56:41 +09:00
Chen Liang 6deb6be252 HDFS-15099. [SBN Read] checkOperation(WRITE) should throw ObserverRetryOnActiveException for ObserverNode. Contributed by Chen Liang. 
(cherry picked from commit 26a969ec73)
 2020-01-10 17:19:59 -08:00
Daryn Sharp 23a77050e0 HADOOP-16749. Configuration parsing of CDATA values are blank 
Signed-off-by: Jonathan Eagles <jeagles@gmail.com>
 2020-01-10 10:48:45 -06:00
Chen Liang 82bc4778ef HADOOP-16789. In TestZKFailoverController, restore changes from HADOOP-11149 that were dropped by HDFS-6440. Contributed by Jim Brennan. 2020-01-03 16:07:56 -08:00
Erik Krogen a22698fa52 HDFS-15032. Properly handle InvocationTargetExceptions in the proxy created by ProxyCombiner. This fixes a bug encountered by the HDFS balancer when used with Observer Nodes. Contributed by Erik Krogen. 
(cherry picked from c174d50b30)
(cherry picked from 3402c87353)
(cherry picked from b06965ae32)
 2019-12-11 09:41:40 -08:00
Jonathan Hung d74f64aa99 Setting version to 2.10.1-SNAPSHOT after branch-2 to branch-2.10 rename 2019-12-09 11:49:59 -08:00
Mingliang Liu cdb0cafff5
HADOOP-16735. Make it clearer in config default that EnvironmentVariableCredentialsProvider supports AWS_SESSION_TOKEN. Contributed by Mingliang Liu 
This closes #1733
 2019-12-05 17:56:02 -08:00
Erik Krogen 0ac6dc79b0 HADOOP-16700. Track response time separately in Server.Call to avoid negative RpcQueueTime values. Contributed by xuzq. 
(cherry picked from be77231452)
(cherry picked from c1ed247459)
(cherry picked from 23f25418e8)
 2019-12-03 14:19:27 -08:00
Yiqun Lin fc2cdb6cca HDFS-14986. ReplicaCachingGetSpaceUsed throws ConcurrentModificationException. Contributed by Aiphago. 
(cherry picked from commit 2b452b4e60)
 2019-11-28 10:45:25 +08:00
Chen Liang 238781ab98 HDFS-14991. Backport better time precision of configuration#getTimeDuration to branch-2 to support SBN read. Contributed by Chen Liang. 2019-11-18 20:26:27 -08:00
Akira Ajisaka 81060b3413
HADOOP-15097. AbstractContractDeleteTest::testDeleteNonEmptyDirRecursive with misleading path. Contributed by Xieming Li. 
(cherry picked from commit 92c28c100e)
 2019-11-15 13:53:39 +09:00
Chen Liang db887f66d8 HDFS-14941. Potential editlog race condition can cause corrupted file. Contributed by Chen Liang and Konstantin Shvachko. 2019-11-06 15:47:57 -08:00
Duo Zhang e649b30b32 HADOOP-16598. Backport "HADOOP-16558 [COMMON+HDFS] use protobuf-maven-plugin to generate protobuf classes" to all active branches 
Reapply but this time with proper patch.

Signed-off-by: stack <stack@apache.org>
 2019-11-01 09:22:23 -07:00
stack e880347d53 Revert "HADOOP-16598. Backport "HADOOP-16558 [COMMON+HDFS] use protobuf-maven-plugin to generate protobuf classes" to all active branches" 
Wrong patch applied; missed jdk7 handling

This reverts commit a36dbe6f35.
 2019-11-01 09:21:33 -07:00
Jonathan Hung fab62a145d Add 2.10.0 release notes for HDFS-12943 
(cherry picked from commit ef9d12df24)
(cherry picked from commit 9ccfc2d6d3)
(cherry picked from commit f29481f046)
 2019-10-31 20:35:49 -07:00
Duo Zhang a36dbe6f35 HADOOP-16598. Backport "HADOOP-16558 [COMMON+HDFS] use protobuf-maven-plugin to generate protobuf classes" to all active branches 
Signed-off-by: stack <stack@apache.org>
 2019-10-30 22:33:51 -07:00
Jonathan Hung 915b795358 Make upstream aware of 2.10.0 release 
(cherry picked from commit 7663db59c097c82eeed2df7a91168a4d7123c96b)
(cherry picked from commit 5d2ffcc7aa)
(cherry picked from commit 4d274f60bc)
 2019-10-30 21:01:40 -07:00
Jonathan Hung 339ab2347d HDFS-14667. Backport [HDFS-14403] "Cost-based FairCallQueue" to branch-2. Contributed by Erik Krogen 2019-10-22 11:46:25 -07:00
Ayush Saxena c78eb006f9 HADOOP-16662. Remove unnecessary InnerNode check in NetworkTopology#add(). Contributed by Lisheng Sun. 2019-10-20 11:58:30 +05:30
Jonathan Hung 108127238b Preparing for 2.11.0 development 2019-10-15 10:01:45 -07:00
Erik Krogen 8337d1a489 HDFS-14162. [SBN read] Allow Balancer to work with Observer node. Add a new ProxyCombiner allowing for multiple related protocols to be combined. Allow AlignmentContext to be passed in NameNodeProxyFactory. Contributed by Erik Krogen. 2019-10-10 09:07:18 -07:00
Jonathan Hung ab7181e9af YARN-9760. Support configuring application priorities on a workflow level. Contributed by Varun Saxena 2019-10-08 11:19:39 -07:00
Jonathan Hung 842b306b76 HADOOP-16588. Update commons-beanutils version to 1.9.4 in branch-2. Contributed by Wei-Chiu Chuang and Jonathan Hung. 
Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>
 2019-10-03 13:09:43 +09:00
Erik Krogen 0050f4363e HADOOP-16581. Addendum: Remove use of Java 8 functionality. Contributed by Masatake Iwasaki. 2019-09-23 08:06:27 -07:00
Yuval Degani 44193ede8d HADOOP-16581. Revise ValueQueue to correctly replenish queues that go below the watermark (#1463) 
(cherry picked from dd0834696a)
(cherry picked from e31594f20e)
(cherry picked from b091abc471)
 2019-09-20 09:59:14 -07:00