38495af325
YARN-10692. Add Node GPU Utilization and apply to NodeMetrics. Contributed by Qi Zhu.
2021-03-18 12:46:11 +01:00
a5745711dd
YARN-10659. Improve CS MappingRule %secondary_group evaluation. Contributed by Gergely Pollak
2021-03-18 12:43:01 +01:00
d7eeca4d0c
YARN-10685. Fix typos in AbstractCSQueue. Contributed by Qi Zhu.
2021-03-18 11:49:16 +01:00
49f89f1d3d
YARN-10688. ClusterMetrics should support GPU capacity related metrics.. Contributed by Qi Zhu.
2021-03-17 18:11:37 +00:00
b503de2328
HADOOP-17578. Improve UGI debug log to help troubleshooting TokenCach… ( #2762 )
2021-03-17 10:57:11 -07:00
3e58d5611d
YARN-10497. Fix an issue in CapacityScheduler which fails to delete queues. Contributed by Wangda Tan and Qi Zhu.
2021-03-17 13:38:20 +01:00
9c43b60348
HDFS-15895 : Remove redundant String#format in DFSAdmin#printOpenFiles ( #2772 )
2021-03-17 15:12:36 +09:00
9ba60c33d8
HDFS-15890. Improve the Logs for File Concat Operation. Contributed by Bhavik Patel.
2021-03-17 14:14:26 +09:00
25390babc7
HDFS-13975. TestBalancer#testMaxIterationTime fails sporadically ( #2726 )
...
Co-authored-by: toshihiko.uchida <toshihiko.uchida@linecorp.com>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-03-17 12:00:05 +09:00
0d42104119
HDFS-15898. Test case TestOfflineImageViewer fails ( #2779 )
2021-03-17 09:11:30 +08:00
f276f1af80
YARN-10652. Capacity Scheduler fails to handle user weights for a user that has a "." (dot) in it
...
This only fixes the user name resolution for weights in the queues. It
does not add generic support for user names with dots in all use cases
in the capacity scheduler.
Contributed by: Siddharth Ahuja
2021-03-17 10:55:05 +11:00
47620f8821
HDFS-15843. Make write cross-platform ( #2710 )
2021-03-16 09:06:51 -07:00
73394fabc7
YARN-10686. Fix TestCapacitySchedulerAutoQueueCreation#testAutoQueueCreationFailsForEmptyPathWithAQCAndWeightMode. Contributed by Qi Zhu.
2021-03-16 16:09:12 +01:00
b80588b688
YARN-10682. The scheduler monitor policies conf should trim values separated by comma. Contributed by Qi Zhu.
2021-03-16 15:23:27 +01:00
e9c98548e9
YARN-10689. Fix the finding bugs in extractFloatValueFromWeightConfig. ( #2760 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-03-16 13:50:29 +09:00
299b8062f1
MAPREDUCE-7322. revisiting TestMRIntermediateDataEncryption. Contributed by Ahmed Hussein.
2021-03-15 20:13:17 +00:00
aa4c17b9d7
YARN-10588. Percentage of queue and cluster is zero in WebUI . Contributed by Bilwa S T
2021-03-15 19:09:40 +00:00
9b2f812996
HADOOP-17532. Yarn Job execution get failed when LZ4 Compression Codec is used. Contributed Bhavik Patel.
2021-03-14 21:15:08 -07:00
7025f39944
HDFS-15809. DeadNodeDetector does not remove live nodes from dead node set. Contributed by Jinglun.
2021-03-15 11:34:13 +08:00
b1dc6c40a0
HADOOP-17585. Correct timestamp format in the docs for the touch command. Contributed by Stephen O'Donnell.
2021-03-14 18:09:50 +08:00
970455c917
HDFS-15816. Fix shouldAvoidStaleDataNodesForWrite returns when no stale node in cluster. Contributed by Yang Yun.
2021-03-14 17:48:18 +08:00
fe633d4739
HADOOP-17548. ABFS: Toggle Store Mkdirs request overwrite parameter ( #2729 )
...
Contributed by Sumangala Patki.
2021-03-14 13:35:02 +05:30
e565b05c80
HDFS-15884. RBF: Remove unused method getCreateLocation in RouterRpcServer ( #2754 ). Contributed by tomscut.
2021-03-14 04:07:31 +05:30
167603ba0d
HADOOP-17586. Upgrade org.codehaus.woodstox:stax2-api to 4.2.1. ( #2769 ). Contributed by Ayush Saxena.
...
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2021-03-13 15:09:03 +05:30
6921ec8b40
HDFS-15882. Fix incorrectly initializing RandomAccessFile based on configuration options ( #2751 ). Contributed by Xie Lei.
...
Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
2021-03-13 14:22:11 +08:00
7cf5969f0b
HADOOP-17581. Fix reference to LOG is ambiguous after HADOOP-17482. ( #2764 )
2021-03-12 11:27:53 -08:00
5f067cf0f3
[YARN-10687] Add option to disable/enable free disk space checking and percentage checking for full and not-full disks. Contributed by Qi Zhu.
2021-03-12 17:17:31 +00:00
5db4c0bf70
YARN-10412. Move CS placement rule related changes to a separate package. Contributed by Gergely Pollak
2021-03-12 14:10:16 +01:00
2b62b12d0d
HADOOP-17582. Replace GitHub App Token with GitHub OAuth token ( #2766 )
...
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
2021-03-12 18:04:00 +09:00
ecd3335187
HDFS-15848. Snapshot Operations: Add debug logs at the entry point. Contributed by Bhavik Patel.
2021-03-12 15:42:15 +09:00
0f6ba5e031
HADOOP-17514. Remove trace subcommand from hadoop CLI. ( #2680 )
2021-03-12 10:26:46 +09:00
54ae6bcfc3
HADOOP-17571 : Bump up woodstox-core to 5.3.0 due to security concerns ( #2757 )
...
Contributed by Viraj Jasani.
Signed-off-by: Mingliang Liu <liuml07@apache.org>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-03-11 11:51:24 -08:00
9b78de2550
HADOOP-17570. Apply YETUS-1102 to re-enable GitHub comments ( #2745 )
...
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
2021-03-11 21:48:47 +09:00
bcd9c67082
HADOOP-16721. Improve S3A rename resilience ( #2742 )
...
The S3A connector's rename() operation now raises FileNotFoundException if
the source doesn't exist; a FileAlreadyExistsException if the destination
exists and is unsuitable for the source file/directory.
When renaming to a path which does not exist, the connector no longer checks
for the destination parent directory existing -instead it simply verifies
that there is no file immediately above the destination path.
This is needed to avoid race conditions with delete() and rename()
calls working on adjacent subdirectories.
Contributed by Steve Loughran.
2021-03-11 12:47:39 +00:00
23b343aed1
HADOOP-16870. Use spotbugs-maven-plugin instead of findbugs-maven-plugin ( #2753 )
...
Removed findbugs from the hadoop build images and added spotbugs instead.
Upgraded SpotBugs to 4.2.2 and spotbugs-maven-plugin to 4.2.0.
Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
2021-03-11 10:56:07 +09:00
ebfba0b6fa
[HADOOP-17567] typo in MagicCommitTracker ( #2749 )
...
Contributed by Pierrick Hymbert
2021-03-10 15:39:55 +00:00
7a851c7176
HADOOP-17573. Fix compilation error of OBSFileSystem in trunk. ( #2758 )
2021-03-10 22:23:54 +09:00
6a55baeee4
HDFS-15875. Check whether file is being truncated before truncate ( #2746 )
2021-03-10 14:11:29 +08:00
176bd88890
HADOOP-16080. hadoop-aws does not work with hadoop-client-api. ( #2522 )
...
Contributed by Chao Sun.
(Cherry-picked via PR #2575 )
2021-03-09 20:01:29 +00:00
b2a565629d
YARN-10671.Fix Typo in TestSchedulingRequestContainerAllocation. Contributed by D M Murali Krishna Reddy.
2021-03-09 20:26:07 +05:30
d5e035dbe1
YARN-9615. Add dispatcher metrics to RM. Contributed by Jonathan Hung and Qi Zhu.
2021-03-09 14:33:14 +01:00
3851994cd6
Revert "YARN-9615. Add dispatcher metrics to RM. Contributed by Qi Zhu."
...
This reverts commit 369f75b7a7
2021-03-09 14:32:02 +01:00
369f75b7a7
YARN-9615. Add dispatcher metrics to RM. Contributed by Qi Zhu.
2021-03-09 14:28:23 +01:00
c3aa413ee3
YARN-10679. Better logging of uncaught exceptions throughout SLS. Contributed by Szilard Nemeth.
2021-03-09 14:02:12 +01:00
099f58f8f4
YARN-10681. Fix assertion failure message in BaseSLSRunnerTest. Contributed by Szilard Nemeth.
2021-03-09 13:22:48 +01:00
7f522c92fa
YARN-10677. Logger of SLSFairScheduler is provided with the wrong class. Contributed by Szilard Nemeth.
2021-03-09 12:53:32 +01:00
ea90cd3556
YARN-10678. Try blocks without catch blocks in SLS scheduler classes can swallow other exceptions. Contributed by Szilard Nemeth.
2021-03-09 12:03:53 +01:00
20416bc62d
YARN-10675. Consolidate YARN-10672 and YARN-10447. Contributed by Szilard Nemeth.
2021-03-09 11:34:37 +01:00
e472ee2aa5
YARN-10676. Improve code quality in TestTimelineAuthenticationFilterForV1. Contributed by Szilard Nemeth.
2021-03-09 11:28:24 +01:00
63aa142b77
HADOOP-17557. skip-dir option is not processed by Yetus. Contributed by Ahmed Hussein.
2021-03-09 11:10:10 +09:00
Peter Bacsko
Szilard Nemeth
Eric Badger
Xiaoyu Yao
Viraj Jasani
Takanobu Asanuma
touchida
Hui Fei
Wilfred Spiegelenburg
Gautham B A
zhuqi
Jim Brennan
Eric Payne
Chao Sun
sunlisheng
He Xiaoqiao
sumangala-patki
litao
Ayush Saxena
lamberken
Akira Ajisaka
Masatake Iwasaki
Steve Loughran
Pierrick Hymbert
Chao Sun
Brahma Reddy Battula