7025f39944
HDFS-15809. DeadNodeDetector does not remove live nodes from dead node set. Contributed by Jinglun.
2021-03-15 11:34:13 +08:00
b1dc6c40a0
HADOOP-17585. Correct timestamp format in the docs for the touch command. Contributed by Stephen O'Donnell.
2021-03-14 18:09:50 +08:00
970455c917
HDFS-15816. Fix shouldAvoidStaleDataNodesForWrite returns when no stale node in cluster. Contributed by Yang Yun.
2021-03-14 17:48:18 +08:00
fe633d4739
HADOOP-17548. ABFS: Toggle Store Mkdirs request overwrite parameter ( #2729 )
...
Contributed by Sumangala Patki.
2021-03-14 13:35:02 +05:30
e565b05c80
HDFS-15884. RBF: Remove unused method getCreateLocation in RouterRpcServer ( #2754 ). Contributed by tomscut.
2021-03-14 04:07:31 +05:30
167603ba0d
HADOOP-17586. Upgrade org.codehaus.woodstox:stax2-api to 4.2.1. ( #2769 ). Contributed by Ayush Saxena.
...
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2021-03-13 15:09:03 +05:30
6921ec8b40
HDFS-15882. Fix incorrectly initializing RandomAccessFile based on configuration options ( #2751 ). Contributed by Xie Lei.
...
Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
2021-03-13 14:22:11 +08:00
7cf5969f0b
HADOOP-17581. Fix reference to LOG is ambiguous after HADOOP-17482. ( #2764 )
2021-03-12 11:27:53 -08:00
5f067cf0f3
[YARN-10687] Add option to disable/enable free disk space checking and percentage checking for full and not-full disks. Contributed by Qi Zhu.
2021-03-12 17:17:31 +00:00
5db4c0bf70
YARN-10412. Move CS placement rule related changes to a separate package. Contributed by Gergely Pollak
2021-03-12 14:10:16 +01:00
2b62b12d0d
HADOOP-17582. Replace GitHub App Token with GitHub OAuth token ( #2766 )
...
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
2021-03-12 18:04:00 +09:00
ecd3335187
HDFS-15848. Snapshot Operations: Add debug logs at the entry point. Contributed by Bhavik Patel.
2021-03-12 15:42:15 +09:00
0f6ba5e031
HADOOP-17514. Remove trace subcommand from hadoop CLI. ( #2680 )
2021-03-12 10:26:46 +09:00
54ae6bcfc3
HADOOP-17571 : Bump up woodstox-core to 5.3.0 due to security concerns ( #2757 )
...
Contributed by Viraj Jasani.
Signed-off-by: Mingliang Liu <liuml07@apache.org>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-03-11 11:51:24 -08:00
9b78de2550
HADOOP-17570. Apply YETUS-1102 to re-enable GitHub comments ( #2745 )
...
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
2021-03-11 21:48:47 +09:00
bcd9c67082
HADOOP-16721. Improve S3A rename resilience ( #2742 )
...
The S3A connector's rename() operation now raises FileNotFoundException if
the source doesn't exist; a FileAlreadyExistsException if the destination
exists and is unsuitable for the source file/directory.
When renaming to a path which does not exist, the connector no longer checks
for the destination parent directory existing -instead it simply verifies
that there is no file immediately above the destination path.
This is needed to avoid race conditions with delete() and rename()
calls working on adjacent subdirectories.
Contributed by Steve Loughran.
2021-03-11 12:47:39 +00:00
23b343aed1
HADOOP-16870. Use spotbugs-maven-plugin instead of findbugs-maven-plugin ( #2753 )
...
Removed findbugs from the hadoop build images and added spotbugs instead.
Upgraded SpotBugs to 4.2.2 and spotbugs-maven-plugin to 4.2.0.
Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
2021-03-11 10:56:07 +09:00
ebfba0b6fa
[HADOOP-17567] typo in MagicCommitTracker ( #2749 )
...
Contributed by Pierrick Hymbert
2021-03-10 15:39:55 +00:00
7a851c7176
HADOOP-17573. Fix compilation error of OBSFileSystem in trunk. ( #2758 )
2021-03-10 22:23:54 +09:00
6a55baeee4
HDFS-15875. Check whether file is being truncated before truncate ( #2746 )
2021-03-10 14:11:29 +08:00
176bd88890
HADOOP-16080. hadoop-aws does not work with hadoop-client-api. ( #2522 )
...
Contributed by Chao Sun.
(Cherry-picked via PR #2575 )
2021-03-09 20:01:29 +00:00
b2a565629d
YARN-10671.Fix Typo in TestSchedulingRequestContainerAllocation. Contributed by D M Murali Krishna Reddy.
2021-03-09 20:26:07 +05:30
d5e035dbe1
YARN-9615. Add dispatcher metrics to RM. Contributed by Jonathan Hung and Qi Zhu.
2021-03-09 14:33:14 +01:00
3851994cd6
Revert "YARN-9615. Add dispatcher metrics to RM. Contributed by Qi Zhu."
...
This reverts commit 369f75b7a7
2021-03-09 14:32:02 +01:00
369f75b7a7
YARN-9615. Add dispatcher metrics to RM. Contributed by Qi Zhu.
2021-03-09 14:28:23 +01:00
c3aa413ee3
YARN-10679. Better logging of uncaught exceptions throughout SLS. Contributed by Szilard Nemeth.
2021-03-09 14:02:12 +01:00
099f58f8f4
YARN-10681. Fix assertion failure message in BaseSLSRunnerTest. Contributed by Szilard Nemeth.
2021-03-09 13:22:48 +01:00
7f522c92fa
YARN-10677. Logger of SLSFairScheduler is provided with the wrong class. Contributed by Szilard Nemeth.
2021-03-09 12:53:32 +01:00
ea90cd3556
YARN-10678. Try blocks without catch blocks in SLS scheduler classes can swallow other exceptions. Contributed by Szilard Nemeth.
2021-03-09 12:03:53 +01:00
20416bc62d
YARN-10675. Consolidate YARN-10672 and YARN-10447. Contributed by Szilard Nemeth.
2021-03-09 11:34:37 +01:00
e472ee2aa5
YARN-10676. Improve code quality in TestTimelineAuthenticationFilterForV1. Contributed by Szilard Nemeth.
2021-03-09 11:28:24 +01:00
63aa142b77
HADOOP-17557. skip-dir option is not processed by Yetus. Contributed by Ahmed Hussein.
2021-03-09 11:10:10 +09:00
6a922f9896
HDFS-15873. Add namenode address in logs for block report ( #2743 )
2021-03-08 11:50:51 -05:00
04cd3115ba
YARN-10658. CapacityScheduler QueueInfo add queue path field to avoid ambiguous QueueName. Contributed by Qi Zhu.
2021-03-08 12:29:44 +01:00
4a0b7f7ebe
HDFS-15384. Document getLocatedBlocks(String src, long start) of DFSClient only return partial blocks. Contributed by Yang Yun.
2021-03-08 12:18:46 +08:00
9cb51bf106
HDFS-15808. Add metrics for FSNamesystem read/write lock hold long time. ( #2668 ) Contributed by tomscut.
2021-03-06 13:40:44 -08:00
ef7ab535c5
HADOOP-17552. Change ipc.client.rpc-timeout.ms from 0 to 120000 by default to avoid potential hang. ( #2727 )
2021-03-06 22:26:16 +09:00
c6b30a59dd
YARN-10672. All testcases in TestReservations are flaky. Contributed By Szilard Nemeth.
2021-03-05 23:13:35 +01:00
9d088639bf
YARN-10664. Allow parameter expansion in NM_ADMIN_USER_ENV. Contributed by Jim
...
Brennan.
2021-03-05 19:46:40 +00:00
e82e7c597a
YARN-10640. Adjust the queue Configured capacity to Configured weight number for weight mode in UI. Contributed by Qi Zhu.
2021-03-05 15:56:56 +01:00
0774116756
HADOOP-17563. Update Bouncy Castle to 1.68. ( #2740 )
2021-03-05 22:56:51 +09:00
e7cad3811f
YARN-10642. Race condition: AsyncDispatcher can get stuck by the changes introduced in YARN-8995. Contributed by zhengchenyu.
2021-03-05 13:50:45 +01:00
e19c00925f
YARN-10639. Queueinfo related capacity, should adjusted to weight mode. Contributed by Qi Zhu.
2021-03-05 13:18:06 +01:00
6699198b54
YARN-10532. Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used. Contributed by Qi Zhu.
2021-03-04 17:18:35 +01:00
a85aeee876
YARN-10623. Capacity scheduler should support refresh queue automatically by a thread policy. Contributed by Qi Zhu.
2021-03-04 12:23:11 +01:00
d615e2d3bd
YARN-10649. Fix RMNodeImpl.updateExistContainers leak ( #2719 ). Contributed by Max Xie
2021-03-04 14:52:58 +05:30
9fd2198daa
HADOOP-17546. Update Description of hadoop-http-auth-signature-secret in HttpAuthentication.md. Contributed by Ravuri Sushma sree.
2021-03-04 14:55:37 +09:00
7e8040e6ad
YARN-10655. Limit queue creation depth relative to its first static parent. Contributed by Andras Gyori.
2021-03-03 17:44:30 +01:00
cdba06e380
HDFS-15870. Remove unused configuration dfs.namenode.stripe.min ( #2739 )
...
Co-authored-by: tomscut <litao@bigo.sg>
2021-03-03 22:34:02 +09:00
8af56de1fa
HADOOP-17560. Fix some spelling errors ( #2730 )
...
Co-authored-by: jiaguodong5 <jiaguodong5@jd.com>
2021-03-03 11:41:05 +09:00
sunlisheng
He Xiaoqiao
sumangala-patki
litao
Ayush Saxena
lamberken
Xiaoyu Yao
Jim Brennan
Szilard Nemeth
Akira Ajisaka
Takanobu Asanuma
Masatake Iwasaki
Viraj Jasani
Steve Loughran
Pierrick Hymbert
Hui Fei
Chao Sun
Brahma Reddy Battula
Peter Bacsko
tomscut
Haoze Wu
Eric Badger
Neil
litao
JJiaguodong