6a23c376c9
HDFS-16986. EC: Fix locationBudget in getListing(). ( #5582 ). Contributed by Shuyan Zhang.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
2023-04-24 18:53:25 +08:00
5b23224970
HADOOP-18714. Wrong StringUtils.join() called in AbstractContractRootDirectoryTest ( #5578 )
2023-04-24 09:17:12 +02:00
51dcbd1d61
HDFS-16988. Improve NameServices info at JournalNode web UI ( #5584 ). Contributed by Zhaohui Wang.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2023-04-24 01:13:02 +05:30
b683769fc9
HADOOP-18712. Upgrade to jetty 9.4.51 due to cve ( #5574 ). Contributed by PJ Fanning.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2023-04-24 01:01:51 +05:30
3b7783c549
HADOOP-18689. Bump jettison from 1.5.3 to 1.5.4 in /hadoop-project ( #5502 )
...
Co-authored-by: Ayush Saxena <ayushsaxena@apache.org>
2023-04-22 16:19:21 +05:30
ad49ddda0e
HADOOP-18711. upgrade nimbus jwt jar due to issues in its embedded shaded json-smart code. ( #5573 ). Contributed by PJ Fanning.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2023-04-22 14:01:09 +05:30
742e07d9c3
HADOOP-18710. Add RPC metrics for response time ( #5545 ). Contributed by liuguanghua.
...
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2023-04-22 01:06:08 +05:30
964c1902c8
YARN-11463. Node Labels root directory creation doesn't have a retry logic ( #5562 )
...
Co-authored-by: Ashutosh Gupta <ashugpt@amazon.com>
2023-04-21 14:03:22 +02:00
9e24ed2196
HADOOP-18691. Add a CallerContext getter on the Schedulable interface ( #5540 )
2023-04-20 10:11:25 -07:00
0918c87fa2
HADOOP-18687. Remove json-smart dependency. ( #5549 ). Contributed by PJ Fanning.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2023-04-20 18:28:09 +05:30
d07356e60e
HADOOP-18597. Simplify single node instructions for creating directories for Map Reduce. ( #5305 )
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2023-04-20 16:12:44 +05:30
1ff7a65b9f
HDFS-16954. RBF: The operation of renaming a multi-subcluster directory to a single-cluster directory should throw ioexception. ( #5483 ). Contributed by Max Xie.
...
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2023-04-20 15:19:18 +05:30
9e3d5c754b
Revert "HADOOP-18687. Remove json-smart dependency. ( #5549 ). Contributed by PJ Fanning."
...
This reverts commit b6c0ec796e
2023-04-20 10:26:08 +05:30
b6c0ec796e
HADOOP-18687. Remove json-smart dependency. ( #5549 ). Contributed by PJ Fanning.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2023-04-20 00:47:22 +05:30
5119d0c72f
HDFS-16982 Use the right Quantiles Array for Inverse Quantiles snapshot ( #5556 )
2023-04-18 10:47:37 -07:00
a258f1f235
YARN-11326. [Federation] Add RM FederationStateStoreService Metrics. ( #4963 )
2023-04-18 09:13:08 -07:00
635521db4c
YARN-11438. [Federation] ZookeeperFederationStateStore Support Version. ( #5537 )
2023-04-18 09:05:52 -07:00
0e3aafe6c0
HADOOP-18399. S3A Prefetch - SingleFilePerBlockCache to use LocalDirAllocator ( #5054 )
...
Contributed by Viraj Jasani
2023-04-18 16:37:48 +01:00
405ed1dde6
HADOOP-18470. Hadoop 3.3.5 release wrap-up ( #5558 )
...
Post-release updates of the branches
* Add jdiff xml files from 3.3.5 release.
* Declare 3.3.5 as the latest stable release.
* Copy release notes.
2023-04-18 10:12:07 +01:00
6ea10cf41b
HADOOP-18696. ITestS3ABucketExistence arn test failures. ( #5557 )
...
Explicitly sets the fs.s3a.endpoint.region to eu-west-1 so
the ARN-referenced fs creation fails with unknown store
rather than IllegalArgumentException.
Steve Loughran
2023-04-17 10:18:33 +01:00
2c4d6bf33d
YARN-11465. Improved YarnClient Log Format ( #5550 )
...
Co-authored-by: yl09099 <shaq376260428@163.com>
Reviewed-by: Shilun Fan <slfan1989@apache.org>
Signed-off-by: Shilun Fan <slfan1989@apache.org>
2023-04-17 09:27:52 +08:00
0d1b4a3556
HADOOP-18590. Publish SBOM artifacts ( #5555 ). Contributed by Dongjoon Hyun.
2023-04-15 21:35:43 +05:30
0bcdea7912
YARN-11239. Optimize FederationClientInterceptor audit log. ( #5127 )
2023-04-14 13:09:18 -07:00
0185afafea
HDFS-16974. Consider volumes average load of each DataNode when choosing target. ( #5541 ). Contributed by Shuyan Zhang.
...
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
2023-04-14 10:33:30 +08:00
f1936d29f1
HADOOP-18693. Bump derby from 10.10.2.0 to 10.14.2.0 in /hadoop-project ( #5427 )
...
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-04-13 10:25:17 -07:00
2b60d0c1f4
[HDFS-16971] Add read metrics for remote reads in FileSystem Statistics #5534 ( #5536 )
2023-04-13 09:07:42 -07:00
06f9bdffa6
YARN-10846. Add dispatcher metrics to NM. ( #4687 )
2023-04-12 09:53:20 -07:00
dd6d0ac510
YARN-11462. Fix Typo of hadoop-yarn-common. ( #5539 )
...
Co-authored-by: Shilun Fan <slfan1989@apache.org>
Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
Signed-off-by: Shilun Fan <slfan1989@apache.org>
2023-04-12 11:08:23 +08:00
7c3d94a032
HADOOP-18637. S3A to support upload of files greater than 2 GB using DiskBlocks ( #5543 )
...
Contributed By: HarshitGupta and Steve Loughran
2023-04-12 05:17:45 +05:30
bffa49a64f
YARN-11377. [Federation] Support addToClusterNodeLabels、removeFromClusterNodeLabels、replaceLabelsOnNode API's for Federation. ( #5525 )
2023-04-11 09:47:58 -07:00
74ddf69f80
HDFS-16911. Distcp with snapshot diff to support Ozone filesystem. ( #5364 )
2023-04-10 14:03:16 -07:00
3e2ae1da00
HDFS-16949 Introduce inverse quantiles for metrics where higher numer… ( #5495 )
2023-04-10 08:56:00 -07:00
e45451f9c7
HADOOP-18687. hadoop-auth: remove unnecessary dependency on json-smart ( #5524 )
...
Contributed by Michiel de Jong
2023-04-06 16:00:33 +01:00
523ff81624
HDFS-16952. Support getLinkTarget API in WebHDFS ( #5517 )
...
Co-authored-by: Zhtttylz <hualong.z@hotmail.com>
Reviewed-by: Shilun Fan <slfan1989@apache.org>
Signed-off-by: Shilun Fan <slfan1989@apache.org>
2023-04-06 19:44:47 +08:00
47c22e388e
HDFS-16943. RBF: Implements MySQL based StateStoreDriver. ( #5469 )
2023-04-05 16:44:29 -07:00
422bf3b24c
HDFS-16973. RBF: MountTableResolver cache size lookup should take read lock ( #5533 )
2023-04-05 14:06:38 -07:00
69b90b5698
YARN-11436. [Federation] MemoryFederationStateStore Support Version. ( #5518 )
2023-04-05 10:35:24 -07:00
dfb2ca0a64
HADOOP-18684. S3A filesystem to support binding to to other URI schemes ( #5521 )
...
Contributed by Harshit Gupta
2023-04-05 12:42:11 +01:00
937caf7de9
HDFS-16967. RBF: File based state stores should allow concurrent access to the records ( #5523 )
...
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Reviewed-by: Simbarashe Dzinamarira <sdzinamarira@linkedin.com>
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
2023-04-04 22:39:53 +09:00
14c5810d5e
HADOOP-18680: Insufficient heap during full test runs in Docker container.
...
Closes #5522
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2023-04-03 22:53:29 +00:00
811441d5bc
HDFS-16951. Add description of GETSERVERDEFAULTS to WebHDFS doc ( #5491 )
...
Co-authored-by: Zhtttylz <hualong.z@hotmail.com>
Reviewed-by: Shilun Fan <slfan1989@apache.org>
Signed-off-by: Shilun Fan <slfan1989@apache.org>
2023-04-01 18:18:20 +08:00
eb1d3ebe2f
YARN-11442. Refactor FederationInterceptorREST Code. ( #5420 )
2023-03-31 15:29:18 -07:00
389b3ea6e3
HADOOP-18012. ABFS: Enable config controlled ETag check for Rename idempotency ( #5488 )
...
To support recovery of network failures during rename, the abfs client
fetches the etag of the source file, and when recovering from a
failure, uses this tag to determine whether the rename succeeded
before the failure happened.
* This works for files, but not directories
* It adds the overhead of a HEAD request before each rename.
* The option can be disabled by setting "fs.azure.enable.rename.resilience"
to false
Contributed by Sree Bhattacharyya
2023-03-31 19:15:15 +01:00
016362a28b
HADOOP-18548. Hadoop Archive tool (HAR) should acquire delegation tokens from source and destination file systems ( #5355 )
...
Signed-off-by: Chris Nauroth <cnauroth@apache.org>
2023-03-30 07:12:02 +08:00
b4bcbb9515
HDFS-16959. RBF: State store cache loading metrics ( #5497 )
2023-03-29 10:43:13 -07:00
5bc8f25327
YARN-11446. [Federation] Add updateSchedulerConfiguration, getSchedulerConfiguration REST APIs for Router. ( #5476 )
2023-03-28 09:33:19 -07:00
aa602381c5
YARN-11426. Improve YARN NodeLabel Memory Display. ( #5335 )
...
YARN-11426. Improve YARN NodeLabel Memory Display.
Co-authored-by: slfan1989 <louj1988@@>
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Reviewed-by: Chris Nauroth <cnauroth@apache.org>
Signed-off-by: Shilun Fan <slfan1989@apache.org>
2023-03-28 22:48:46 +08:00
700147b4ac
HDFS-16964. Improve processing of excess redundancy after failover. ( #5510 ). Contributed by Shuyan Zhang.
...
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
2023-03-28 16:14:59 +08:00
b5e8269d9b
HADOOP-18458: AliyunOSSBlockOutputStream to support heap/off-heap buffer before uploading data to OSS ( #4912 )
2023-03-28 14:27:01 +08:00
926993cb73
YARN-11376. [Federation] Support updateNodeResource、refreshNodesResources API's for Federation. ( #5496 )
2023-03-27 09:27:21 -07:00
zhangshuyan
Doroszlai, Attila
wangzhaohui
PJ Fanning
dependabot[bot]
LiuGuH
Ashutosh Gupta
Christos Bisias
Nikita Eshkeev
Neil
Ayush Saxena
rdingankar
slfan1989
Viraj Jasani
Steve Loughran
yl09099
Dongjoon Hyun
Melissa You
Sadanand Shenoy
mjwiq
zhtttylz
Simbarashe Dzinamarira
HarshitGupta11
Chris Nauroth
sreeb-msft
Galsza
Jinhu Wu