9cf408d6ba
HDFS-15731. Reduce threadCount for unit tests to reduce the memory usage ( #2556 )
...
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
2021-01-24 22:50:05 +09:00
91d4ba57c5
HDFS-15632. AbstractContractDeleteTest should set recursive peremeter to true for recursive test cases. Contributed by Anton Kutuzov.
2021-01-22 17:55:37 -08:00
d09e3c929f
HADOOP-17224. Install Intel ISA-L library in Dockerfile. ( #2537 )
2021-01-22 10:27:06 +09:00
8620984b8d
YARN-10515. Fix flaky test TestCapacitySchedulerAutoQueueCreation.testDynamicAutoQueueCreationWithTags. Contributed by Peter Bacsko
2021-01-21 20:58:57 +01:00
1ccba3734d
YARN-10490. yarn top command not quitting completely with ctrl+c. Contributed by Agshin Kazimli
2021-01-21 20:30:19 +01:00
e2f8503ebd
HADOOP-17484. Typo in hadop-aws index.md ( #2634 )
...
Contributed by Maksim Bober.
2021-01-21 17:30:58 +00:00
17fdac8de5
YARN-10581. CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to include queue creation type for queues. Contributed by Szilard Nemeth.
2021-01-21 18:06:53 +01:00
06fef5ee43
YARN-10579. CS Flexible AQC: Modify RM /scheduler endpoint to include weight values for queues. Contributed by Szilard Nemeth
2021-01-21 09:23:11 +01:00
8bc2dfbf36
YARN-10519. Refactor QueueMetricsForCustomResources class to move to yarn-common package. Contributed by Minni Mittal
2021-01-21 11:23:30 +05:30
45b3a84709
HDFS-15783. Speed up BlockPlacementPolicyRackFaultTolerant#verifyBlockPlacement ( #2626 )
2021-01-21 10:07:46 +09:00
cfe6e1f7da
YARN-10578. Fix Auto Queue Creation parent handling. Contributed by Andras Gyori
2021-01-20 15:22:44 +01:00
4b5bc05a78
YARN-10512. CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to include mode of operation for CS. Contributed by Szilard Nemeth.
2021-01-20 12:28:59 +05:30
68bc721841
HADOOP-17433. Skipping network I/O in S3A getFileStatus(/) breaks ITestAssumeRole. ( #2600 )
...
Contributed by Steve Loughran.
2021-01-19 17:19:27 +00:00
a326f22606
YARN-10573. Enhance placement rule conversion in fs2cs in weight mode and enable it by default. Contributed by Peter Bacsko
2021-01-19 09:42:40 +01:00
6abdb148e4
YARN-10535. Make queue placement in CapacityScheduler compliant with auto-queue-placement. Contributed by Gergely Pollak
2021-01-18 20:19:36 +01:00
9b4f09a6bb
HDFS-15758. Fix typos in MutableMetric. Contributed by Haibin Huang.
2021-01-18 20:35:37 +05:30
acea862d59
YARN-10574. Fix the FindBugs warning introduced in YARN-10506. Contributed by Gergely Pollak
2021-01-18 16:04:45 +01:00
97f843de3a
HADOOP-16947. Stale record should be remove when MutableRollingAverages generating aggregate data. Contributed by Haibin Huang.
2021-01-16 14:06:56 +08:00
7743d40ac5
HDFS-15549. Use Hardlink to move replica between DISK and ARCHIVE storage if on same filesystem mount ( #2583 ). Contributed by Leon Gao.
2021-01-15 16:28:11 -08:00
3d46141583
YARN-10506. Update queue creation logic to use weight mode and allow the flexible static/dynamic creation. (Contributed by Qi Zhu, Andras Gyori)
...
Change-Id: I118862fd5e11ee6888275e2bcf667fedfa56c5d7
2021-01-15 14:20:08 -08:00
6cd540e964
YARN-7200. SLS generates a realtimetrack.json file but that file is missing the closing ']'. Contributed by Agshin Kazimli
2021-01-15 22:32:30 +01:00
630f8ddd2c
HDFS-15672. TestBalancerWithMultipleNameNodes#testBalancingBlockpoolsWithBlockPoolPolicy fails on trunk. ( #2475 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-01-14 16:19:35 +09:00
768e2f42ba
YARN-10562. Follow up changes for YARN-9833. Contributed by Jim Brennan.
2021-01-13 23:41:52 +00:00
d8fadec944
YARN-4589: Diagnostics for localization timeouts is lacking. Contributed by Chang Li (lichangleo) and Jim Brennan (Jim_Brennan)
2021-01-13 17:01:28 +00:00
836c630430
YARN-10525. Add weight mode conversion to fs2cs. Contributed by Peter Bacsko
2021-01-13 14:24:12 +01:00
61f77b7674
YARN-8529. Add timeout to RouterWebServiceUtil#invokeRMWebService. Contributed by Minni Mittal
2021-01-13 16:00:11 +05:30
8ec824f2ba
HDFS-15762. TestMultipleNNPortQOP#testMultipleNNPortOverwriteDownStream fails intermittently ( #2598 )
...
Co-authored-by: Toshihiko Uchida <toshihiko.uchida@linecorp.com>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-01-13 11:23:07 +09:00
724edb0354
HADOOP-17451. IOStatistics test failures in S3A code. ( #2594 )
...
Caused by HADOOP-16830 and HADOOP-17271.
Fixes tests which fail intermittently based on configs and
in the case of the HugeFile tests, bulk runs with existing
FS instances meant statistic probes sometimes ended up probing those
of a previous FS.
Contributed by Steve Loughran.
Change-Id: I65ba3f44444e59d298df25ac5c8dc5a8781dfb7d
2021-01-12 17:30:32 +00:00
05c9c2ed02
Revert "HADOOP-17451. IOStatistics test failures in S3A code. ( #2594 )"
...
This reverts commit d3014e01f3
2021-01-12 17:29:59 +00:00
d3014e01f3
HADOOP-17451. IOStatistics test failures in S3A code. ( #2594 )
...
Caused by HADOOP-16380 and HADOOP-17271.
Fixes tests which fail intermittently based on configs and
in the case of the HugeFile tests, bulk runs with existing
FS instances meant statistic probes sometimes ended up probing those
of a previous FS.
Contributed by Steve Loughran.
2021-01-12 17:25:14 +00:00
0a6ddfa145
HADOOP-17272. ABFS Streams to support IOStatistics API ( #2604 )
...
Contributed by Mehakmeet Singh.
2021-01-12 15:48:09 +00:00
0d7ac54510
HDFS-14558. RBF: Isolation/Fairness documentation. Contributed by Fengnan Li.
2021-01-12 23:38:55 +08:00
85b1c017ee
YARN-10563. Fix dependency exclusion problem in poms. Contributed by Peter Bacsko
2021-01-12 15:29:20 +01:00
9c6e093783
YARN-10570. Remove experimental warning message from fs2cs. Contributed by Peter Bacsko
2021-01-12 15:21:27 +01:00
612330661b
HADOOP-17459. ADLS Gen1: Fixes for rename contract tests #2607
...
Contributed by Bilaharith
2021-01-12 14:00:48 +00:00
ca7dd5fad3
MAPREDUCE-7310. Clear the fileMap in JHEventHandlerForSigtermTest ( #2499 )
...
Co-authored-by: Zhengxi Li <zli89@illinois.edu>
Reviewed-by: Wanqiang Ji <jiwq@apache.org>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-01-12 15:45:13 +09:00
ae894ecfcc
HADOOP-17438. Increase docker memory limit in Jenkins ( #2560 )
...
Reviewed-by: Eric Badger <ebadger@apache.org>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-01-12 15:34:06 +09:00
b0eec09097
YARN-10504. Implement weight mode in Capacity Scheduler. (Contributed by Wangda Tan, Benjamin Teke, zhuqi, Andras Gyori)
...
Change-Id: Ic49c730b0ab502ba86527fb662d25c4c8b1c2588
2021-01-11 17:46:09 -08:00
32abc0af49
HDFS-15702. Fix intermittent falilure of TestDecommission#testAllocAndIBRWhileDecommission. ( #2507 )
2021-01-11 11:59:32 -08:00
d4fd675a95
Revert "HADOOP-16524. Reloading SSL keystore for both DataNode and NameNode ( #2470 )"
...
This reverts commit e306f59421
2021-01-11 08:54:55 -08:00
1ec5c67b5e
HADOOP-16492. Support HuaweiCloud Object Storage as a Hadoop Backend File System. Contributed by zhongjun.
2021-01-11 18:12:12 +05:30
ec22850dbe
Make upstream aware of 3.2.2 release.
2021-01-09 18:06:08 +08:00
890f2da624
YARN-10553. Refactor TestDistributedShell ( #2581 )
2021-01-09 08:39:21 +09:00
77435a025e
HADOOP-17408. Optimize NetworkTopology sorting block locations. ( #2601 ). Contributed by Ahmed Hussein and Daryn Sharp.
2021-01-08 13:10:09 -06:00
e306f59421
HADOOP-16524. Reloading SSL keystore for both DataNode and NameNode ( #2470 )
...
Co-authored-by: Borislav Iordanov <biordanov@apple.com>
Signed-off-by: stack <stack@apache.org>
2021-01-08 09:10:21 -08:00
4176759909
YARN-10507. Add the capability to fs2cs to write the converted placement rules inside capacity-scheduler.xml. Contributed by Peter Bacsko
2021-01-08 13:40:33 +01:00
580a6a75a3
YARN-10528. maxAMShare should only be accepted for leaf queues, not parent queues. Contributed by Siddharth Ahuja
2021-01-08 12:38:43 +01:00
2ba7ec2b48
HDFS-15766. RBF: MockResolver.getMountPoints() breaks the semantic of FileSubclusterResolver. Contributed by Jinglun.
2021-01-08 16:27:54 +05:30
87bd4d2aca
HDFS-15754. Add DataNode packet metrics ( #2578 )
...
Contributed by Fengnan Li.
2021-01-07 23:46:23 -08:00
1b1791075a
YARN-10538: Add RECOMMISSIONING nodes to the list of updated nodes returned to the AM ( #2564 )
...
Contributed by Srinivas S T
2021-01-08 10:52:52 +05:30
Akira Ajisaka
Anton Kutuzov
Takanobu Asanuma
Szilard Nemeth
Maksim Bober
Peter Bacsko
bibinchundatt
Sunil G
Steve Loughran
Ayush Saxena
He Xiaoqiao
LeonGao
Wangda Tan
Masatake Iwasaki
Eric Badger
Eric Payne
touchida
Mehakmeet Singh
Yiqun Lin
bilaharith
lzx404243
Ahmed Hussein
stack
Brahma Reddy Battula
Borislav Iordanov
lfengnan
srinivasst