f8e598f278
MAPREDUCE-7268. Fix TestMapreduceConfigFields ( #1935 )
2020-04-03 10:59:07 +09:00
25361b077b
YARN-10120. Https Support in Router WebServiceClient.
...
Contributed by Bilwa S T.
2020-04-02 18:11:43 +05:30
736659e0e1
HDFS-15252. HttpFS: setWorkingDirectory should not accept invalid paths. Contributed by hemanthboyina.
2020-04-02 19:21:02 +09:00
4a3eb10972
HDFS-15051. RBF: Impose directory level permissions for Mount entries. Contributed by Xiaoqiao He.
2020-04-02 11:06:01 +05:30
d3b5951572
HDFS-15242. Add metrics for operations hold lock times of FsDatasetImpl. Contributed by Xiaoqiao He.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
2020-04-01 16:36:46 -07:00
c613296dc8
MAPREDUCE-7241. FileInputFormat listStatus with less memory footprint. Contributed by Zhihua Deng
2020-04-01 07:46:33 -05:00
c162648aff
YARN-10202. Fix documentation about NodeAttributes. Contributed by Sen Zhao.
2020-04-01 16:05:47 +09:00
c734d247b1
HADOOP-16910 : ABFS Streams to update FileSystem.Statistics counters on IO. ( #1918 ). Contributed by Mehakmeet Singh.
2020-03-31 14:49:09 +02:00
80b877a72f
HDFS-15196. RBF: RouterRpcServer getListing cannot list large dirs correctly. Contributed by Fengnan Li.
2020-03-30 12:29:21 -07:00
960c9ebaea
HDFS-15245. Improve JournalNode web UI. Contributed by Jianfei Jiang.
2020-03-30 02:40:25 +05:30
3eeb2466e9
upate the hadoop.version property in the root pom.xml and hadoop.assemblies.version in hadoop-project/pom.xml (see HADOOP-15369)
2020-03-29 23:44:20 +05:30
8914cf9167
Preparing for 3.4.0 development
2020-03-29 23:24:25 +05:30
f7a94ec0a4
HDFS-15239. Add button to go to the parent directory in the explorer. Contributed by hemanthboyina.
2020-03-29 08:17:02 -07:00
696a663cd0
HDFS-15193. Improving the error message for missing `dfs.namenode.rpc-address.$NAMESERVICE`. Contributed by Ctest.
2020-03-29 00:01:22 +05:30
f531a4a487
HDFS-15191. EOF when reading legacy buffer in BlockTokenIdentifier. Contributed by Steven Rand.
2020-03-27 12:55:38 -07:00
cbe71eaddf
HDFS-15238. RBF: NamenodeHeartbeatService caused memory to grow rapidly. Contributed by xuzq.
2020-03-27 13:42:06 +05:30
eaaaba12b1
HADOOP-16939 fs.s3a.authoritative.path should support multiple FS URIs ( #1914 )
...
add unit test, new ITest and then fix the issue: different schema, bucket == skip
factored out the underlying logic for unit testing; also moved
maybeAddTrailingSlash to S3AUtils (while retaining/forwarnding existing method
in S3AFS).
tested: london, sole failure is
testListingDelete[auth=true](org.apache.hadoop.fs.s3a.ITestS3GuardOutOfBandOperations)
filed HADOOP-16853
Change-Id: I4b8d0024469551eda0ec70b4968cba4abed405ed
2020-03-26 12:59:11 -06:00
745a6c1e69
Revert "HADOOP-16818. ABFS: Combine append+flush calls for blockblob & appendblob"
...
This reverts commit 3612317038
2020-03-26 15:24:37 +00:00
679631b188
HDFS-13470. RBF: Add Browse the Filesystem button to the UI.
2020-03-26 08:23:18 -07:00
50f7f6dfd1
YARN-10210. Add a RMFailoverProxyProvider that does DNS resolution on failover.
2020-03-26 08:14:30 -07:00
3d5ade1839
YARN-10043. FairOrderingPolicy Improvements. Contributed by Manikandan R
2020-03-26 13:23:43 +01:00
9a297ff31d
YARN-10197. FS-CS converter: fix emitted ordering policy string and max-am-resource percent value. Contributed by Peter Bacsko
2020-03-26 12:35:10 +01:00
348685dcb9
YARN-9998. Code cleanup in LeveldbConfigurationStore. Contributed by Benjamin Teke
2020-03-26 12:18:15 +01:00
0fa7bf47df
HDFS-15234. Add a default method body for the INodeAttributeProvider#checkPermissionWithContext API. ( #1909 )
2020-03-25 16:03:26 -07:00
cdcb77a2c5
HDFS-15075. Remove process command timing from BPServiceActor. Contributed by Xiaoqiao He.
2020-03-25 11:30:54 -07:00
6ce189c621
YARN-10200. Add number of containers to RMAppManager summary
2020-03-25 10:41:59 -07:00
a700803a18
HDFS-15154. Allow only hdfs superusers the ability to assign HDFS storage policies. Contributed by Siddharth Wagle.
...
Change-Id: I32d6dd2837945b8fc026a759aa367c55daefe348
2020-03-25 10:28:30 -07:00
e3fbdcbc14
HADOOP-16912. Emit per priority RPC queue time and processing time from DecayRpcScheduler. Contributed by Fengnan Li.
2020-03-25 10:21:20 -07:00
2d294bd575
HADOOP-16938. Make non-HA proxy providers pluggable
2020-03-25 08:06:58 -07:00
cdb2107066
YARN-9879. Allow multiple leaf queues with the same name in CapacityScheduler. Contributed by Gergely Pollak.
2020-03-25 16:50:19 +05:30
25a03bfece
HADOOP-16930. Add hadoop-aws documentation for ProfileCredentialsProvider
...
Contributed by Nicholas Chammas.
2020-03-25 10:39:35 +00:00
d353b30baf
HDFS-15215. The Timestamp for longest write/read lock held log is wrong
2020-03-24 14:50:15 -07:00
d9c4f1129c
HDFS-15219. DFS Client will stuck when ResponseProcessor.run throw Error ( #1902 ). Contributed by zhengchenyu.
2020-03-24 23:17:22 +05:30
ea87d60493
HDFS-13377. The owner of folder can set quota for his sub folder. Contributed by Yang Yun.
2020-03-24 22:56:09 +05:30
4454c6d14b
Revert "HADOOP-16054. Update Dockerfile to use Bionic." ( #1911 )
...
This reverts commit 367833cf41
2020-03-24 22:05:33 +09:00
28afdce009
Revert ""HADOOP-16910. ABFS Streams to update FileSystem.Statistics counters on IO."
...
This reverts commit e2c7ac71b5
2020-03-24 12:11:18 +00:00
5250cd6db3
HDFS-15201 SnapshotCounter hits MaxSnapshotID limit ( #1870 )
2020-03-24 15:15:46 +05:30
5eddc82fb8
HDFS-15088. RBF: Correct annotation typo of RouterPermissionChecker#checkPermission. Contributed by Xiaoqiao He.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2020-03-23 22:41:31 -07:00
f59f6891c8
HDFS-15232. Fix libhdfspp test failures with GCC 7. ( #1906 )
2020-03-24 11:36:14 +09:00
af64ce2f4a
HDFS-15113. Addendum: Missing IBR when NameNode restart if open processCommand async feature. Contributed by Xiaoqiao He.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2020-03-23 12:43:51 -07:00
e2c7ac71b5
ABFS Streams to update FileSystem.Statistics counters on IO.
...
Contributed by Mehakmeet Singh
2020-03-23 13:50:18 +00:00
d312991ead
YARN-10198. Remove Validation of Queue Exist under Managed Parent Queue
...
Contributed by Peter Bacsko. Reviewed by Manikandan R.
2020-03-23 18:01:14 +05:30
62c8015683
HDFS-15227. NPE if the last block changes from COMMITTED to COMPLETE during FSCK. Contributed by Ayush Saxena.
2020-03-22 11:44:18 +05:30
b74e47e31a
HDFS-15214. WebHDFS: Add snapshot counts to Content Summary. Contributed by hemanthboyina.
2020-03-22 01:44:55 +09:00
3612317038
HADOOP-16818. ABFS: Combine append+flush calls for blockblob & appendblob
...
Contributed by Ishani Ahuja.
2020-03-20 10:27:41 +00:00
f02d5abacd
HADOOP-16927. Update hadoop-thirdparty dependency version to 1.0.0 ( #1900 ). Contributed by Vinayakumar B.
2020-03-20 15:13:07 +05:30
f9bb2a8cc5
HDFS-15200. Delete Corrupt Replica Immediately Irrespective of Replicas On Stale Storage. Contributed by Ayush Saxena.
2020-03-19 22:26:34 +05:30
bb41ddaf1e
HDFS-15223. FSCK fails if one namenode is not available. Contributed by Ayush Saxena.
2020-03-19 21:23:13 +05:30
f2d3ac2a3f
YARN-10034. Remove Allocation Tags from released container from Decommission node
...
Contributed by Kyungwan Nam. Reviewed by Adam Antal.
2020-03-19 12:55:14 +05:30
654db35fa2
HDFS-14919. Provide Non DFS Used per DataNode in DataNode UI. Contributed by Lisheng Sun.
2020-03-18 21:00:45 +05:30
Wanqiang Ji
Prabhu Joseph
Takanobu Asanuma
Ayush Saxena
He Xiaoqiao
Jason Lowe
Akira Ajisaka
Mehakmeet Singh
Inigo Goiri
Brahma Reddy Battula
Chen Liang
Steve Loughran
RogPodge
Szilard Nemeth
Wei-Chiu Chuang
Jonathan Hung
Arpit Agarwal
Chao Sun
Sunil G
Nicholas Chammas
Toshihiro Suzuki
Isa Hekmatizadeh
Karthik Palanisamy
Prabhu Joseph
ishaniahuja
Vinayakumar B