5626734a36
HDFS-16182.numOfReplicas is given the wrong value in BlockPlacementPolicyDefault$chooseTarget can cause DataStreamer to fail with Heterogeneous Storage. ( #3320 )
2021-11-16 18:21:50 +08:00
c9f95b01ef
HDFS-16315. Add metrics related to Transfer and NativeCopy for DataNode ( #3643 )
...
Reviewed-by: Hui Fei <ferhui@apache.org>
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
2021-11-16 11:19:14 +09:00
89fcbd84f9
HDFS-16313. RBF: Add metrics for each sub cluster ( #3638 )
2021-11-16 09:47:25 +08:00
b933f5f54b
YARN-11001. Add docs on removing node label mapping from a node. Contributed by Manu Zhang
2021-11-15 16:02:18 +01:00
e14a2dcbba
HADOOP-18006. maven-enforcer-plugin's execution of banned-illegal-imports gets overridden in child poms ( #3648 )
...
Reviewed-by: Ahmed Hussein <ahussein@apache.org>
2021-11-15 22:57:24 +09:00
573b358fce
HADOOP-18003. Add a method appendIfAbsent for CallerContext ( #3644 )
2021-11-15 22:44:49 +09:00
60acf8434d
HDFS-16319. Add metrics doc for ReadLockLongHoldCount and WriteLockLongHoldCount ( #3653 ). Contributed by tomscut.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2021-11-14 20:10:24 +05:30
6e6f2e4baa
HDFS-16321. Fix invalid config in TestAvailableSpaceRackFaultTolerantBPP ( #3655 ). Contributed by guo.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2021-11-14 19:59:15 +05:30
7cb887e6c2
YARN-10997. Revisit allocation and reservation logging. Contributed by Andras Gyori
2021-11-12 15:43:45 +01:00
7fb1bb8f35
HADOOP-18005. Correct log format for LdapGroupsMapping ( #3647 ). Contributed by tomscut.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2021-11-12 20:12:18 +05:30
e220e88eca
YARN-10996. Fix race condition of User object acquisitions. Contributed by Andras Gyori
2021-11-12 15:33:39 +01:00
db89a9411e
HDFS-16287. Support to make dfs.namenode.avoid.read.slow.datanode reconfigurable ( #3596 )
2021-11-12 10:07:34 +08:00
3d692c0936
HDFS-16305.Record the remote NameNode address when the rolling log is triggered. ( #3629 )
2021-11-12 09:52:02 +08:00
1c1cf64616
HDFS-16311. Metric metadataOperationRate calculation error in DataNodeVolumeMetrics ( #3636 )
...
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
2021-11-12 10:23:25 +09:00
8b159d296d
[YARN-10998] Add YARN_ROUTER_HEAPSIZE to yarn-env for routers ( #3603 )
2021-11-11 09:49:29 -08:00
2a1a11c039
HDFS-16312. Fix typo for DataNodeVolumeMetrics and ProfilingFileIoEvents ( #3637 )
...
Reviewed-by: Hui Fei <ferhui@apache.org>
2021-11-10 19:22:32 +09:00
ea65fc26d8
HDFS-16298. Improve error msg for BlockMissingException ( #3615 )
...
Reviewed-by: Hui Fei <ferhui@apache.org>
2021-11-10 19:16:45 +09:00
b307f18a58
HDFS-16301. Improve BenchmarkThroughput#SIZE naming standardization. ( #3622 )
2021-11-10 11:32:52 +09:00
cbc7fb6bca
HDFS-16299. Fix bug for TestDataNodeVolumeMetrics#verifyDataNodeVolumeMetrics ( #3616 )
...
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
2021-11-09 17:06:28 +09:00
9b2fa7e47a
HDFS-16307. Improve HdfsBlockPlacementPolicies docs readability
2021-11-08 10:21:39 -08:00
0a952e4d1f
HDFS-16304. Locate OpenSSL libs for libhdfspp ( #3625 )
2021-11-08 08:58:07 -08:00
d2b8d6b534
HDFS-16302. RBF: RouterRpcFairnessPolicyController record requests accepted by each nameservice ( #3621 )
2021-11-08 09:52:16 +08:00
e5cee76785
HDFS-16273. RBF: RouterRpcFairnessPolicyController add availableHandleOnPerNs metrics ( #3553 )
...
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Reviewed-by: Hui Fei <ferhui@apache.org>
2021-11-08 09:30:53 +09:00
45f164a854
Revert "HADOOP-17873. ABFS: Fix transient failures in ITestAbfsStreamStatistics and ITestAbfsRestOperationException ( #3341 )"
...
This reverts commit 82658a22d6
2021-11-05 14:21:15 +00:00
e1ac10ceae
HADOOP-17863. ABFS: Fix compiler deprecation warning in TextFileBasedIdentityHandler ( #3332 )
...
Closes #3332
Contributed by Sumangala Patki
2021-11-05 12:53:51 +00:00
19644c0cdc
HADOOP-17862. ABFS: Fix unchecked cast compiler warning for AbfsListStatusRemoteIterator ( #3331 )
...
closes #3331
Contributed by Sumangala Patki
2021-11-05 12:50:37 +00:00
6f7b965808
HDFS-16296. RouterRpcFairnessPolicyController add rejected permits for each nameservice ( #3613 )
2021-11-05 11:03:07 +08:00
1032724aa3
HDFS-16300. Use libcrypto in Windows for libhdfspp ( #3617 )
2021-11-04 09:19:11 -07:00
82658a22d6
HADOOP-17873. ABFS: Fix transient failures in ITestAbfsStreamStatistics and ITestAbfsRestOperationException ( #3341 )
...
Addresses transient failures in the following test classes:
* ITestAbfsStreamStatistics: Uses a filesystem level static instance to record read/write statistics, which also tracks these operations in other tests running in parallel. Marked for sequential-only run to avoid transient failure
* ITestAbfsRestOperationException: The use of a static member to track retry count causes transient failures when two tests of this class happen to run together. Switch to non-static variable for assertions on retry count
closes #3341
Contributed by Sumangala Patki
2021-11-04 14:40:37 +00:00
72718a8dc1
HDFS-16294.Remove invalid DataNode#CONFIG_PROPERTY_SIMULATED. ( #3605 )
2021-11-04 16:43:25 +09:00
a9c51ea57d
HADOOP-17374. support listObjectV2 ( #3587 )
2021-11-03 21:47:41 -07:00
18b2cca74c
HDFS-16291.Make the comment of INode#ReclaimContext more standardized. ( #3602 )
2021-11-04 09:51:11 +08:00
359b03c83e
HDFS-16266. Add remote port information to HDFS audit log ( #3538 )
...
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
Reviewed-by: Wei-Chiu Chuang <weichiu@apache.org>
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
2021-11-04 10:16:03 +09:00
a21895a5b3
HDFS-16286. Add a debug tool to verify the correctness of erasure coding on file ( #3593 )
2021-11-03 20:19:56 +00:00
6c6d1b64d4
HADOOP-17928. Syncable: S3A to warn and downgrade ( #3585 )
...
This switches the default behavior of S3A output streams
to warning that Syncable.hsync() or hflush() have been
called; it's not considered an error unless the defaults
are overridden.
This avoids breaking applications which call the APIs,
at the risk of people trying to use S3 as a safe store
of streamed data (HBase WALs, audit logs etc).
Contributed by Steve Loughran.
2021-11-02 13:26:16 +00:00
2f35cc36cd
HDFS-16259. Catch and re-throw sub-classes of AccessControlException thrown by any permission provider plugins (eg Ranger) ( #3598 )
2021-11-02 11:14:48 +00:00
618fea27d2
HDFS-16269. [Fix] Improve NNThroughputBenchmark#blockReport operation. ( #3544 )
...
Reviewed-by: Fei Hui <feihui.ustc@gmail.com>
Reviewed-by: Wei-Chiu Chuang <weichiu@apache.org>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-11-02 00:55:50 +09:00
bccf2f3ef4
HADOOP-17985. Disable JIRA plugin for Yetus run ( #3601 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-11-01 02:18:23 +09:00
0a68413a4f
HDFS-16290.Make log more standardized when executing verifyAndSetNamespaceInfo(). ( #3600 )
...
HDFS-16290.Make log more standardized when executing verifyAndSetNamespaceInfo(). (#3600 ). Contributed by JiangHua Zhu.
2021-10-31 08:48:52 +05:30
634f8a2209
HDFS-16091. WebHDFS should support getSnapshotDiffReportListing. ( #3374 )
2021-10-31 09:29:34 +09:00
6aa664c624
HDFS-16279. Print detail datanode info when process first storage report ( #3564 )
2021-10-29 10:27:00 +09:00
2e32cc68fc
YARN-10985. Add some tests to verify ACL behaviour in CapacitySchedulerConfiguration ( #3570 ). Contributed by Szilard Nemeth
2021-10-28 15:19:32 +02:00
d96ce9c23a
HADOOP-17968 Migrate checkstyle module illegalimport to maven enforcer banned-illegal-imports ( #3584 )
...
Reviewed-by: Ahmed Hussein <ahussein@apache.org>
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
2021-10-28 15:57:15 +09:00
d598904046
YARN-10904. Investigate: Remove unnecessary fields from AbstractCSQueue ( #3551 ) contributed by Szilard Nemeth
2021-10-27 19:03:45 +02:00
66ac476b48
YARN-10924. Clean up CapacityScheduler#initScheduler ( #3581 ) Contributed by Szilard Nemeth
2021-10-27 17:13:49 +02:00
c1a8285363
HDFS-16281. Fix flaky unit tests failed due to timeout ( #3574 )
2021-10-26 14:54:11 +08:00
b923fa7a1c
HADOOP-17946. Upgrade commons-lang to 3.12.0 ( #3575 )
2021-10-26 09:16:50 +08:00
62c86eaa0e
HADOOP-17970. unguava: remove Preconditions from hdfs-projects modules ( #3566 )
2021-10-23 16:13:07 -05:00
9cfd8d0a83
YARN-10909. AbstractCSQueue: Annotate all methods with VisibleForTesting that are only used by test code. Contributed by JackWangCS, Szilard Nemeth
2021-10-23 14:47:09 +02:00
6e57449350
HDFS-16282. Remove duplicate generic usage information to hdfs debug command ( #3576 ). Contributed by daimin.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2021-10-22 21:12:13 +05:30
Neil
litao
Symious
Szilard Nemeth
Viraj Jasani
GuoPhilipse
huhaiyang
jianghuazhu
minni31
Gautham B A
Xiangyi Zhu
Steve Loughran
sumangala-patki
Jinhu Wu
daimin
Stephen O'Donnell
Masatake Iwasaki
Szilard Nemeth
Renukaprasad C
Ahmed Hussein
Jack