ab32762f43
HADOOP-16755. Fix broken link in single node cluster setup documentation. Contributed by Denes Gerencser.
2019-12-16 08:44:28 +05:30
fd7de2b82a
HADOOP-16764. Rewrite Python example codes using Python3 ( #1762 )
2019-12-16 11:04:20 +09:00
631dbbc6f2
YARN-9923. Introduce HealthReporter interface to support multiple health checker files. Contributed by Adam Antal
2019-12-15 17:28:04 +01:00
d12ad9e8ad
HADOOP-16757. Increase timeout unit test rule for MetadataStoreTestBase ( #1757 )
...
Contributed by Mingliang Liu.
Signed-off-by: Steve Loughran <stevel@apache.org>
2019-12-13 08:19:27 -08:00
c174d50b30
HDFS-15032. Properly handle InvocationTargetExceptions in the proxy created by ProxyCombiner. This fixes a bug encountered by the HDFS balancer when used with Observer Nodes. Contributed by Erik Krogen.
2019-12-11 09:39:37 -08:00
19512b21e3
HADOOP-16735. Make it clearer in config default that EnvironmentVariableCredentialsProvider supports AWS_SESSION_TOKEN. Contributed by Mingliang Liu
...
This closes #1733
2019-12-05 17:37:17 -08:00
83a14559e5
HDFS-15023. [SBN read] ZKFC should check the state before joining the election. Contributed by Fei Hui.
2019-12-05 18:52:01 +05:30
f1ab7f18c4
HADOOP-16718. Allow disabling Server Name Indication (SNI) for Jetty. Contributed by Aravindan Vijayan.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Reviewed-by: Siyao Meng <smeng@cloudera.com>
2019-12-03 15:47:16 -08:00
2b452b4e60
HDFS-14986. ReplicaCachingGetSpaceUsed throws ConcurrentModificationException. Contributed by Aiphago.
2019-11-28 10:43:35 +08:00
3161813482
HADOOP-16685: FileSystem#listStatusIterator does not check if given path exists ( #1695 )
2019-11-26 11:11:26 -08:00
da9435182a
HADOOP-16717. Remove GenericsUtil isLog4jLogger dependency on Log4jLoggerAdapter. Contributed by Xieming Li.
2019-11-25 14:36:27 +09:00
1a0c0e42e7
HADOOP-16276. Fix jsvc startup command in hadoop-functions.sh due to jsvc >= 1.0.11 changed default current working directory ( #1272 )
2019-11-20 16:44:44 -08:00
6f899e9030
HADOOP-15852. Refactor QuotaUsage. Contributed by David Mollitor.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-11-20 14:40:10 -08:00
be77231452
HADOOP-16700. Track response time separately in Server.Call to avoid negative RpcQueueTime values. Contributed by xuzq.
2019-11-20 07:56:33 -08:00
1415ad3800
HADOOP-16707. NPE in UGI.getCurrentUser in ITestAbfsIdentityTransformer setup.
...
Contributed by Steve Loughran.
Change-Id: I38fdba2fa70e534d78b15e61de19368912588b0c
2019-11-20 14:32:12 +00:00
4050471b45
HADOOP-16657. Move remaining log4j APIs over to slf4j in hadoop-common. Contributed by Minni Mittal.
2019-11-19 08:01:17 +05:30
27642367ef
YARN-9011. Race condition during decommissioning. Contributed by Peter Bacsko
2019-11-18 16:29:39 +01:00
7f811722b7
HADOOP-16712. Config ha.failover-controller.active-standby-elector.zk.op.retries is not in core-default.xml. Contributed by Xieming Li.
2019-11-18 19:00:25 +05:30
67f2c491fe
HDFS-14802. The feature of protect directories should be used in RenameOp ( #1669 )
2019-11-15 12:35:37 -08:00
c892a879dd
HDFS-14882. Consider DataNode load when #getBlockLocation. Contributed by Xiaoqiao He.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Reviewed-by: Istvan Fajth <pifta@cloudera.com>
2019-11-15 12:16:31 -08:00
92c28c100e
HADOOP-15097. AbstractContractDeleteTest::testDeleteNonEmptyDirRecursive with misleading path. Contributed by Xieming Li.
2019-11-15 13:49:57 +09:00
d0302d3849
HADOOP-16691. Unify Logging in UserGroupInformation.
...
Unify Logging in UserGroupInformation.
2019-11-14 10:28:26 -08:00
c73334a924
HADOOP-16705. MBeanInfoBuilder puts unnecessary memory pressure on the system with a debug log.
...
MBeanInfoBuilder's get() method DEBUG logs all the MBeanAttributeInfo attributes that it gathered. This can have a high memory churn that can be easily avoided.
2019-11-14 09:54:02 -08:00
a139a87610
HADOOP-16708. HadoopExecutors cleanup to only log at debug.
...
Contributed by David Mollitor.
Change-Id: Ib501a3ed6ed299ccd3c773c4dc086441a5728e73
2019-11-14 17:51:39 +00:00
73a386ab76
HADOOP-16585. [Tool:NNloadGeneratorMR] Multiple threads are using same id for creating file LoadGenerator#write. Contributed by Ranith Sardar.
2019-11-14 01:45:46 +05:30
df6b3162c1
HADOOP-16677. Recalculate the remaining timeout millis correctly while throwing an InterupptedException in SocketIOWithTimeout. ( #1687 )
2019-11-12 14:19:39 -08:00
3ab98eefa5
HADOOP-16656. Document FairCallQueue configs in core-default.xml. Contributed by Siyao Meng.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-11-12 11:34:24 -08:00
990063d2af
HADOOP-16665. Filesystems to be closed if they failed during initialize().
...
Contributed by Steve Loughran.
This FileSystem instantiation so if an IOException or RuntimeException is
raised in the invocation of FileSystem.initialize() then a best-effort
attempt is made to close the FS instance; exceptions raised that there
are swallowed.
The S3AFileSystem is also modified to do its own cleanup if an
IOException is raised during its initialize() process, it being the
FS we know has the "potential" to leak threads, especially in
extension points (e.g AWS Authenticators) which spawn threads.
Change-Id: Ib84073a606c9d53bf53cbfca4629876a03894f04
2019-11-12 18:17:21 +00:00
3d249301f4
HADOOP-16683. Disable retry of FailoverOnNetworkExceptionRetry in case of wrapped AccessControlException. Contributed by Adam Antal
2019-11-09 15:43:53 +01:00
dd900259c4
HDFS-14941. Potential editlog race condition can cause corrupted file. Contributed by Chen Liang and Konstantin Shvachko.
2019-11-06 09:56:19 -08:00
ee8addbec4
Revert "HADOOP-16656. Document FairCallQueue configs in core-default.xml. Contributed by Siyao Meng."
...
This reverts commit f9b99d2f24
2019-11-05 15:41:52 -08:00
6f0190d8e4
HADOOP-16678: Review of ArrayWritable ( #1692 )
2019-11-04 14:24:44 -08:00
dca19fc3aa
HADOOP-16484. S3A to warn or fail if S3Guard is disabled ( #1661 ). Contributed by Gabor Bota.
2019-11-04 12:55:36 +01:00
ef9d12df24
Add 2.10.0 release notes for HDFS-12943
2019-10-31 20:33:59 -07:00
f9b99d2f24
HADOOP-16656. Document FairCallQueue configs in core-default.xml. Contributed by Siyao Meng.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-10-31 12:59:46 -07:00
d9fbedc4ae
HDFS-14936. Add getNumOfChildren() for interface InnerNode. Contributed by Lisheng Sun.
2019-10-31 23:39:27 +05:30
8c9173c87c
HADOOP-16510. [hadoop-common] Fix order of actual and expected expression in assert statements. Contributed by Adam Antal
2019-10-31 14:35:20 +01:00
e6137d0e50
Make upstream aware of 2.10.0 release
2019-10-30 20:58:32 -07:00
bd498bac86
HADOOP-16669. TestRawLocalFileSystemContract.testPermission fails if no native library.
...
Contributed by Steve Loughran.
Change-Id: I622e36f17a63c775c5e33e93b8b26e461d0bc451
2019-10-29 17:09:26 +00:00
7be5508d9b
HDFS-14923. Remove dead code from HealthMonitor. Contributed by Fei Hui.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-10-25 15:06:16 -07:00
2eba262472
HADOOP-16615. Add password check for credential provider,
...
Contributed by hongdongdong.
Change-Id: Iaac01bc8594860064a80c822a0e47981243ab7e1
2019-10-24 18:48:27 +01:00
2ae4b33d48
HADOOP-16662. Remove unnecessary InnerNode check in NetworkTopology#add(). Contributed by Lisheng Sun.
2019-10-19 11:05:54 +05:30
6d92aa7c30
HADOOP-16579. Upgrade to Curator 4.2.0 and ZooKeeper 3.5.5 ( #1656 ). Contributed by Norbert Kalmár, Mate Szalay-Beko
...
* HADOOP-16579 - Upgrade to Apache Curator 4.2.0 and ZooKeeper 3.5.5
- Add a static initializer for the unit tests using ZooKeeper to enable
the four-letter-words diagnostic telnet commands. (this is an interface
that become disabled by default, so to keep the ZooKeeper 3.4.x behavior
we enabled it for the tests)
- Also fix ZKFailoverController to look for relevant fail-over ActiveAttempt
records. The new ZooKeeper seems to respond quicker during the fail-over
tests than the ZooKeeper, so we made sure to catch all the relevant records
by adding a new parameter to ZKFailoverontroller.waitForActiveAttempt().
Co-authored-by: Norbert Kalmár <nkalmar@cloudera.com>
2019-10-18 13:26:20 -07:00
3d41f33018
HADOOP-16152. Upgrade Eclipse Jetty version to 9.4.x. Contributed by Yuming Wang, Siyao Meng.
...
Co-authored-By: Siyao Meng <smeng@cloudera.com>
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-10-18 08:25:02 -07:00
c79a5f2d99
HADOOP-16580. Disable retry of FailoverOnNetworkExceptionRetry in case of AccessControlException. Contributed by Adam Antal
2019-10-16 13:29:06 +02:00
c39e9fc9a3
HADOOP-15169. "hadoop.ssl.enabled.protocols" should be considered in httpserver2. Contributed by Brahma Reddy Battula, Wei-Chiu Chuang.
...
Reviewed-by: Xiaoyu Yao <xyao@apache.org>
Co-authored-By: Brahma Reddy Battula <brahma@apache.org>
2019-10-15 13:55:23 -07:00
dee9e97075
Revert "HADOOP-15870. S3AInputStream.remainingInFile should use nextReadPos."
...
This reverts commit 7a4b3d42c4
2019-10-14 16:56:50 +01:00
44bc095998
HADOOP-13907. Fix TestWebDelegationToken#testKerberosDelegationTokenAuthenticator on Windows. Contributed by Kitti Nanasi.
2019-10-12 13:16:51 +05:30
7a4b3d42c4
HADOOP-15870. S3AInputStream.remainingInFile should use nextReadPos.
...
Contributed by lqjacklee.
Change-Id: I32bb00a683102e7ff8ff8ce0b8d9c3195ca7381c
2019-10-10 21:58:42 +01:00
5462d2176f
YARN-9760. Support configuring application priorities on a workflow level. Contributed by Varun Saxena
2019-10-08 11:20:13 -07:00
Ayush Saxena
Kengo Seki
Szilard Nemeth
Mingliang Liu
Erik Krogen
Aravindan Vijayan
Yiqun Lin
Sahil Takiar
Akira Ajisaka
Siyao Meng
David Mollitor
Steve Loughran
Abhishek Modi
Hui Fei
He Xiaoqiao
belugabehr
Lukas Majercak
Surendra Singh Lilhore
Xudong Cao
Siyao Meng
Chen Liang
Wei-Chiu Chuang
Gabor Bota
Jonathan Hung
Jonathan Hung
hongdongdong
Mate Szalay-Beko
Yuming Wang
Steve Loughran
lqjacklee