e9a3c2950e
HADOOP-17538. Add kms-default.xml and httpfs-default.xml to site index. ( #2716 )
2021-02-24 07:46:02 +09:00
7b7c0019f4
HADOOP-17528. SFTP File System: close the connection pool when closing a FileSystem ( #2701 )
...
Contributed by Mike Pryakhin.
2021-02-23 17:03:27 +00:00
647d23b611
HDFS-15847. create client protocol: add ecPolicyName & storagePolicy param to debug statement string. Contributed by Bhavik Patel.
2021-02-23 19:08:38 +05:30
a57282540f
HDFS-15845. RBF: Router fails to start due to NoClassDefFoundError for hadoop-federation-balance. ( #2714 )
2021-02-23 15:12:06 +09:00
47420ae3ed
YARN-10647. Fix TestRMNodeLabelsManager failed after YARN-10501. Contributed by
...
Qi Zhu.
2021-02-22 18:48:14 +00:00
8bca105655
MAPREDUCE-7323. Remove job_history_summary.py. ( #2712 )
...
Reviewed-by: Takanobu Asanuma <tasanuma@apache.org>
2021-02-22 23:15:04 +09:00
b722c52f4e
YARN-10513. CS Flexible Auto Queue Creation RM UIv2 modifications. Contributed by Andras Gyori.
2021-02-22 12:55:45 +01:00
7f64030314
HADOOP-17537. ABFS: Correct assertion reversed in HADOOP-13327
...
Contributed Sumangala Patki.
2021-02-22 11:45:58 +00:00
1e32ab7d2f
HDFS-15734. [READ] DirectoryScanner#scan need not check StorageType.PROVIDED ( #2559 )
...
Co-authored-by: wangyuxuan <wangyuxuan@xiaomi.com>
2021-02-22 18:13:36 +08:00
f8059d0bdf
Revert "first commit ( #2559 )"
...
This reverts commit 1b94569d89
2021-02-22 18:13:06 +08:00
1b94569d89
first commit ( #2559 )
...
Co-authored-by: wangyuxuan <wangyuxuan@xiaomi.com>
2021-02-22 02:10:39 -08:00
e119063a07
HADOOP-17534. Update Jackson to 2.10.5 and Jackson databind to 2.10.5.1 ( #2708 )
...
Reviewed-by: Wei-Chiu Chuang <weichiu@apache.org>
2021-02-22 17:33:02 +09:00
98ffd65d8b
HDFS-15826. Solve the problem of incorrect progress of delegation tokens when loading FsImage. ( #2686 )
...
Co-authored-by: zhujianghua <zhujianghua@zhujianghuadeMacBook-Pro.local>
2021-02-21 23:22:32 -08:00
ff84a57483
HDFS-15806. DeadNodeDetector should close all the threads when it is closed. Contributed by Jinglun.
2021-02-20 19:48:00 +05:30
2ce5752fa8
HDFS-15839. RBF: Cannot get method setBalancerBandwidth on Router Client. Contributed by Yang Yun.
2021-02-20 19:34:29 +05:30
b9b49ed956
HADOOP-16748. Migrate to Python 3 and upgrade Yetus to 0.13.0 ( #1738 )
...
- Upgrade Yetus to 0.13.0 to support Python 3 for the release scripts.
- Removed determine-flaky-tests-hadoop.py.
- Temporarily disabled shelldocs check due to YETUS-1099.
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Reviewed-by: Mingliang Liu <liuml07@apache.org>
2021-02-20 17:18:23 +09:00
4891e68c2b
YARN-10501. Can't remove all node labels after add node label without
...
nodemanager port. Contributed by caozhiqiang.
2021-02-19 22:29:10 +00:00
d28b6f90c8
YARN-10636. CS Auto Queue creation should reject submissions with empty path parts. Contributed by Gergely Pollak.
2021-02-19 13:57:30 +01:00
4383726d19
YARN-10635. CSMapping rule can return paths with empty parts. Contributed by Gergely Pollak.
2021-02-19 12:01:31 +01:00
25af8901a9
HDFS-15835. Erasure coding: Add/remove logs for the better readability/debugging. Contributed by Bhavik Patel.
2021-02-19 14:44:58 +09:00
9a298d180d
Revert "HADOOP-16870. Use spotbugs-maven-plugin instead of findbugs-maven-plugin ( #2454 )"
...
This reverts commit 4cf3531583
2021-02-19 11:09:10 +09:00
2970bd93f3
HDFS-15830. Support to make dfs.image.parallel.load reconfigurable ( #2694 )
2021-02-19 09:07:22 +08:00
e391844e8e
HDFS-15815. if required storageType are unavailable, log the failed reason during choosing Datanode. Contributed by Yang Yun.
2021-02-18 01:39:04 +05:30
0ed9e36282
HDFS-15834. Remove the usage of org.apache.log4j.Level ( #2696 )
2021-02-17 01:59:24 -05:00
4cf3531583
HADOOP-16870. Use spotbugs-maven-plugin instead of findbugs-maven-plugin ( #2454 )
...
Use spotbugs instead of findbugs. Removed findbugs from the hadoop build images,
and added spotbugs in the images instead.
Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Reviewed-by: Dinesh Chitlangia <dineshc@apache.org>
2021-02-17 10:38:20 +09:00
eac7aefaaf
HADOOP-17109. add guava BaseEncoding to illegalClasses ( #2703 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-02-17 10:15:41 +09:00
9882a22365
YARN-10625. FairScheduler: add global flag to disable AM-preemption. Contributed by Peter Bacsko
2021-02-16 18:06:57 +01:00
1bb4101b59
HADOOP-17038 Support disabling buffered reads in ABFS positional reads. ( #2646 )
...
- Contributed by @anoopsjohn
2021-02-16 22:27:52 +05:30
3fcc7a55b6
[YARN-10626] Log resource allocation in NM log at container start time. Contributed by Eric Badger
2021-02-16 16:45:35 +00:00
2b3c5b1733
HDFS-15836. RBF: Fix contract tests after HADOOP-13327 ( #2702 )
...
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
2021-02-16 14:50:50 +09:00
07a4220cd2
HDFS-15821. Add metrics for in-service datanodes ( #2690 ). Contributed by Zehao Chen.
2021-02-15 11:14:32 -06:00
bad6038a48
YARN-10622. Fix preemption policy to exclude childless ParentQueues. Contributed by Andras Gyori
2021-02-15 14:48:42 +01:00
852aac34f2
Support max queues limit configuration in new auto created queue, consistent with old auto created. Contributed by Qi Zhu
2021-02-15 14:20:50 +01:00
c3134ab3a9
HDFS-15814. Make some parameters configurable for DataNodeDiskMetrics ( #2676 )
2021-02-14 00:12:24 -05:00
f9a073c6c1
YARN-10500. TestDelegationTokenRenewer fails intermittently. ( #2619 )
2021-02-11 13:55:04 -06:00
78905d7e3f
HADOOP-16906. Abortable ( #2684 )
...
Adds an Abortable.abort() interface for streams to enable output streams to be terminated; this
is implemented by the S3A connector's output stream. It allows for commit protocols
to be implemented which commit/abort work by writing to the final destination and
using the abort() call to cancel any write which is not intended to be committed.
Consult the specification document for information about the interface and its use.
Contributed by Jungtaek Lim and Steve Loughran.
2021-02-11 17:37:20 +00:00
98ca6afd17
YARN-10618. RM UI2 Application page shows the AM preempted containers instead of the nonAM ones. Contributed by Benjamin Teke
2021-02-11 09:14:37 +01:00
933fbeffee
HADOOP-17516. Upgrade ant to 1.10.9. ( #2683 )
...
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
2021-02-11 08:07:08 +09:00
cacc870389
YARN-10593. Fix incorrect string comparison in GpuDiscoverer. Contributed by Peter Bacsko
2021-02-10 13:09:32 +01:00
798df6d699
HADOOP-13327 Output Stream Specification. ( #2587 )
...
This defines what output streams and especially those which implement
Syncable are meant to do, and documents where implementations (HDFS; S3)
don't. With tests.
The file:// FileSystem now supports Syncable if an application calls
FileSystem.setWriteChecksum(false) before creating a file -checksumming
and Syncable.hsync() are incompatible.
Contributed by Steve Loughran.
2021-02-10 10:28:59 +00:00
a8bd516e39
YARN-10620. fs2cs: parentQueue for certain placement rules are not set during conversion. Contributed by Peter Bacsko
2021-02-10 11:15:53 +01:00
462561654b
MAPREDUCE-7319. Log list of mappers at trace level in ShuffleHandler audit log.
...
Contributed by Jim Brennan.
2021-02-09 19:01:38 +00:00
fc5f241535
YARN-10619. CS Mapping Rule %specified rule catches default submissions. Contributed by Gergely Pollak
2021-02-09 18:16:42 +01:00
9434c1eccc
HDFS-15818. Fix TestFsDatasetImpl.testReadLockCanBeDisabledByConfig. Contributed by Leon Gao ( #2679 )
2021-02-09 10:49:28 +00:00
2df2dfb9ed
HDFS-15817. Rename snapshots while marking them deleted. ( #2677 )
2021-02-09 10:27:51 +05:30
0b05dd8802
YARN-9650. Set thread names for CapacityScheduler AsyncScheduleThread ( #2665 )
...
Amogh Rajesh Desai via Zhankun Tang
2021-02-09 11:05:14 +08:00
0e2b3086e3
HDFS-15683. Allow configuring DISK/ARCHIVE capacity for individual volumes. ( #2625 )
2021-02-08 11:01:21 -08:00
19ae0faacc
HDFS-15820. Ensure snapshot root trash provisioning happens only post safe mode exit ( #2682 )
2021-02-06 08:26:12 -08:00
c4918fb298
[HDFS-15813] DataStreamer: keep sending heartbeat packets during flush. Contributed by Daryn Sharp and Jim Brennan
2021-02-05 21:20:30 +00:00
c22c77af43
[YARN-10607] User environment is unable to prepend PATH when mapreduce.admin.user.env also sets PATH. Contributed by Eric Badger.
2021-02-05 17:33:01 +00:00
Masatake Iwasaki
Mike
Ayush Saxena
Takanobu Asanuma
Eric Badger
Akira Ajisaka
Peter Bacsko
sumangala-patki
Wang Yuxuan
Wei-Chiu Chuang
jianghuazhu
Hui Fei
Ahmed Hussein
Szilard Nemeth
Anoop Sam John
Jim Brennan
Zehao Chen
litao
Steve Loughran
LeonGao
bshashikant
Amogh Rajesh Desai