17aa8f6764
HADOOP-16785. Improve wasb and abfs resilience on double close() calls.
...
This hardens the wasb and abfs output streams' resilience to being invoked
in/after close().
wasb:
Explicity raise IOEs on operations invoked after close,
rather than implicitly raise NPEs.
This ensures that invocations which catch and swallow IOEs will perform as
expected.
abfs:
When rethrowing an IOException in the close() call, explicitly wrap it
with a new instance of the same subclass.
This is needed to handle failures in try-with-resources clauses, where
any exception in closed() is added as a suppressed exception to the one
thrown in the try {} clause
*and you cannot attach the same exception to itself*
Contributed by Steve Loughran.
Change-Id: Ic44b494ff5da332b47d6c198ceb67b965d34dd1b
2020-01-08 11:46:54 +00:00
bb1aed475b
HADOOP-16751. Followup: move java import. ( #1799 )
...
This moves the import of a java module to the preferred place in the import ordering.
Change-Id: I1a594e3d954554a72c2b71c954eda0ae940a8f70
2020-01-08 11:32:31 +00:00
a7fccc1122
HADOOP-16727. KMS Jetty server does not startup if trust store password is null.
2020-01-07 15:46:14 -08:00
bc366d4ea7
HADOOP-16773. Fix duplicate assertj-core dependency in hadoop-common module. Contributed by Xieming Li.
2020-01-07 20:49:24 +09:00
b19d87c2b7
HADOOP-16751. DurationInfo text parsing/formatting should be moved out of hotpath.
...
Contributed by Rajesh Balamohan
Change-Id: Icc3dcfa81aa69164f2c088f9b533d231138cbb8b
2020-01-02 17:03:07 +00:00
958764479d
HADOOP-16777. Add Tez to LimitedPrivate of ClusterStorageCapacityExceededException
...
Contributed by Wang Yan.
Change-Id: I92dfe7079ba8ebe89d70255bb845309be0603a8e
2020-01-02 15:49:42 +00:00
d79cce20ab
HDFS-14740. Recover data blocks from persistent memory read cache during datanode restarts. Contributed by Feilong He.
2020-01-02 11:44:00 +05:30
926d0b48f0
HDFS-15081. Typo in RetryCache#waitForCompletion annotation. Contributed by Fei Hui.
2019-12-27 18:32:15 +05:30
d80d86264d
HADOOP-16042. Update the link to HadoopJavaVersion ( #1784 )
2019-12-27 17:18:10 +09:00
e2a5448d2b
HADOOP-16774. TestDiskChecker and TestReadWriteDiskValidator fails when run with -Pparallel-tests ( #1776 ). Contributed by Vinayakumar B.
2019-12-21 00:08:15 +05:30
ab32762f43
HADOOP-16755. Fix broken link in single node cluster setup documentation. Contributed by Denes Gerencser.
2019-12-16 08:44:28 +05:30
fd7de2b82a
HADOOP-16764. Rewrite Python example codes using Python3 ( #1762 )
2019-12-16 11:04:20 +09:00
631dbbc6f2
YARN-9923. Introduce HealthReporter interface to support multiple health checker files. Contributed by Adam Antal
2019-12-15 17:28:04 +01:00
d12ad9e8ad
HADOOP-16757. Increase timeout unit test rule for MetadataStoreTestBase ( #1757 )
...
Contributed by Mingliang Liu.
Signed-off-by: Steve Loughran <stevel@apache.org>
2019-12-13 08:19:27 -08:00
c174d50b30
HDFS-15032. Properly handle InvocationTargetExceptions in the proxy created by ProxyCombiner. This fixes a bug encountered by the HDFS balancer when used with Observer Nodes. Contributed by Erik Krogen.
2019-12-11 09:39:37 -08:00
19512b21e3
HADOOP-16735. Make it clearer in config default that EnvironmentVariableCredentialsProvider supports AWS_SESSION_TOKEN. Contributed by Mingliang Liu
...
This closes #1733
2019-12-05 17:37:17 -08:00
83a14559e5
HDFS-15023. [SBN read] ZKFC should check the state before joining the election. Contributed by Fei Hui.
2019-12-05 18:52:01 +05:30
f1ab7f18c4
HADOOP-16718. Allow disabling Server Name Indication (SNI) for Jetty. Contributed by Aravindan Vijayan.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Reviewed-by: Siyao Meng <smeng@cloudera.com>
2019-12-03 15:47:16 -08:00
2b452b4e60
HDFS-14986. ReplicaCachingGetSpaceUsed throws ConcurrentModificationException. Contributed by Aiphago.
2019-11-28 10:43:35 +08:00
3161813482
HADOOP-16685: FileSystem#listStatusIterator does not check if given path exists ( #1695 )
2019-11-26 11:11:26 -08:00
da9435182a
HADOOP-16717. Remove GenericsUtil isLog4jLogger dependency on Log4jLoggerAdapter. Contributed by Xieming Li.
2019-11-25 14:36:27 +09:00
1a0c0e42e7
HADOOP-16276. Fix jsvc startup command in hadoop-functions.sh due to jsvc >= 1.0.11 changed default current working directory ( #1272 )
2019-11-20 16:44:44 -08:00
6f899e9030
HADOOP-15852. Refactor QuotaUsage. Contributed by David Mollitor.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-11-20 14:40:10 -08:00
be77231452
HADOOP-16700. Track response time separately in Server.Call to avoid negative RpcQueueTime values. Contributed by xuzq.
2019-11-20 07:56:33 -08:00
1415ad3800
HADOOP-16707. NPE in UGI.getCurrentUser in ITestAbfsIdentityTransformer setup.
...
Contributed by Steve Loughran.
Change-Id: I38fdba2fa70e534d78b15e61de19368912588b0c
2019-11-20 14:32:12 +00:00
4050471b45
HADOOP-16657. Move remaining log4j APIs over to slf4j in hadoop-common. Contributed by Minni Mittal.
2019-11-19 08:01:17 +05:30
27642367ef
YARN-9011. Race condition during decommissioning. Contributed by Peter Bacsko
2019-11-18 16:29:39 +01:00
7f811722b7
HADOOP-16712. Config ha.failover-controller.active-standby-elector.zk.op.retries is not in core-default.xml. Contributed by Xieming Li.
2019-11-18 19:00:25 +05:30
67f2c491fe
HDFS-14802. The feature of protect directories should be used in RenameOp ( #1669 )
2019-11-15 12:35:37 -08:00
c892a879dd
HDFS-14882. Consider DataNode load when #getBlockLocation. Contributed by Xiaoqiao He.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Reviewed-by: Istvan Fajth <pifta@cloudera.com>
2019-11-15 12:16:31 -08:00
92c28c100e
HADOOP-15097. AbstractContractDeleteTest::testDeleteNonEmptyDirRecursive with misleading path. Contributed by Xieming Li.
2019-11-15 13:49:57 +09:00
d0302d3849
HADOOP-16691. Unify Logging in UserGroupInformation.
...
Unify Logging in UserGroupInformation.
2019-11-14 10:28:26 -08:00
c73334a924
HADOOP-16705. MBeanInfoBuilder puts unnecessary memory pressure on the system with a debug log.
...
MBeanInfoBuilder's get() method DEBUG logs all the MBeanAttributeInfo attributes that it gathered. This can have a high memory churn that can be easily avoided.
2019-11-14 09:54:02 -08:00
a139a87610
HADOOP-16708. HadoopExecutors cleanup to only log at debug.
...
Contributed by David Mollitor.
Change-Id: Ib501a3ed6ed299ccd3c773c4dc086441a5728e73
2019-11-14 17:51:39 +00:00
73a386ab76
HADOOP-16585. [Tool:NNloadGeneratorMR] Multiple threads are using same id for creating file LoadGenerator#write. Contributed by Ranith Sardar.
2019-11-14 01:45:46 +05:30
df6b3162c1
HADOOP-16677. Recalculate the remaining timeout millis correctly while throwing an InterupptedException in SocketIOWithTimeout. ( #1687 )
2019-11-12 14:19:39 -08:00
3ab98eefa5
HADOOP-16656. Document FairCallQueue configs in core-default.xml. Contributed by Siyao Meng.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-11-12 11:34:24 -08:00
990063d2af
HADOOP-16665. Filesystems to be closed if they failed during initialize().
...
Contributed by Steve Loughran.
This FileSystem instantiation so if an IOException or RuntimeException is
raised in the invocation of FileSystem.initialize() then a best-effort
attempt is made to close the FS instance; exceptions raised that there
are swallowed.
The S3AFileSystem is also modified to do its own cleanup if an
IOException is raised during its initialize() process, it being the
FS we know has the "potential" to leak threads, especially in
extension points (e.g AWS Authenticators) which spawn threads.
Change-Id: Ib84073a606c9d53bf53cbfca4629876a03894f04
2019-11-12 18:17:21 +00:00
3d249301f4
HADOOP-16683. Disable retry of FailoverOnNetworkExceptionRetry in case of wrapped AccessControlException. Contributed by Adam Antal
2019-11-09 15:43:53 +01:00
dd900259c4
HDFS-14941. Potential editlog race condition can cause corrupted file. Contributed by Chen Liang and Konstantin Shvachko.
2019-11-06 09:56:19 -08:00
ee8addbec4
Revert "HADOOP-16656. Document FairCallQueue configs in core-default.xml. Contributed by Siyao Meng."
...
This reverts commit f9b99d2f24
2019-11-05 15:41:52 -08:00
6f0190d8e4
HADOOP-16678: Review of ArrayWritable ( #1692 )
2019-11-04 14:24:44 -08:00
dca19fc3aa
HADOOP-16484. S3A to warn or fail if S3Guard is disabled ( #1661 ). Contributed by Gabor Bota.
2019-11-04 12:55:36 +01:00
ef9d12df24
Add 2.10.0 release notes for HDFS-12943
2019-10-31 20:33:59 -07:00
f9b99d2f24
HADOOP-16656. Document FairCallQueue configs in core-default.xml. Contributed by Siyao Meng.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-10-31 12:59:46 -07:00
d9fbedc4ae
HDFS-14936. Add getNumOfChildren() for interface InnerNode. Contributed by Lisheng Sun.
2019-10-31 23:39:27 +05:30
8c9173c87c
HADOOP-16510. [hadoop-common] Fix order of actual and expected expression in assert statements. Contributed by Adam Antal
2019-10-31 14:35:20 +01:00
e6137d0e50
Make upstream aware of 2.10.0 release
2019-10-30 20:58:32 -07:00
bd498bac86
HADOOP-16669. TestRawLocalFileSystemContract.testPermission fails if no native library.
...
Contributed by Steve Loughran.
Change-Id: I622e36f17a63c775c5e33e93b8b26e461d0bc451
2019-10-29 17:09:26 +00:00
7be5508d9b
HDFS-14923. Remove dead code from HealthMonitor. Contributed by Fei Hui.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-10-25 15:06:16 -07:00
Steve Loughran
Hanisha Koneru
Akira Ajisaka
Rajesh Balamohan
Rakesh Radhakrishnan
Ayush Saxena
Chandra Sanivarapu
Vinayakumar B
Kengo Seki
Szilard Nemeth
Mingliang Liu
Erik Krogen
Aravindan Vijayan
Yiqun Lin
Sahil Takiar
Siyao Meng
David Mollitor
Abhishek Modi
Hui Fei
He Xiaoqiao
belugabehr
Lukas Majercak
Surendra Singh Lilhore
Xudong Cao
Siyao Meng
Chen Liang
Wei-Chiu Chuang
Gabor Bota
Jonathan Hung
Jonathan Hung