Commit Graph

22683 Commits

Author SHA1 Message Date
Yiqun Lin 8a77a224c7 HDFS-13359. DataXceiver hung due to the lock in FsDatasetImpl#getBlockInputStream. Contributed by Yiqun Lin.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-08-09 18:40:28 -07:00
Siyao Meng e02ffed1b1 HDFS-12125. Document the missing EC removePolicy command (#1258) Contributed by Wenxin He, Siyao Meng.
Co-authored-by: Wenxin He <wenxin.he@gmail.com>
2019-08-09 18:00:22 -07:00
Wei-Chiu Chuang ce3c5a3e3b HDFS-14623. In NameNode Web UI, for Head the file (first 32K) old data is showing. Contributed by hemanthboyina. 2019-08-09 15:41:37 -07:00
Wei-Chiu Chuang 865021b8c9 HDFS-14195. OIV: print out storage policy id in oiv Delimited output. Contributed by Wang, Xinglong. 2019-08-09 15:37:29 -07:00
Nanda kumar 98dd7c48ff HDDS-1906. TestScmSafeMode#testSCMSafeModeRestrictedOp is failing. (#1260) 2019-08-09 11:28:38 -07:00
Eric Yang 6ff0453ede YARN-9527. Prevent rogue Localizer Runner from downloading same file repeatly.
Contributed by Jim Brennan
2019-08-09 14:12:17 -04:00
Abhishek Modi a79564fed0 YARN-9732. yarn.system-metrics-publisher.enabled=false is not honored by RM. Contributed by KWON BYUNGCHANG. 2019-08-09 22:25:30 +05:30
Steve Loughran 189dc10884 HADOOP-16481. ITestS3GuardDDBRootOperations.test_300_MetastorePrune needs to set region. (#1209). Contributed by Steve Loughran. 2019-08-09 17:33:08 +02:00
Steve Loughran e25a5c2eab HADOOP-16499. S3A retry policy to be exponential (#1246). Contributed by Steve Loughran. 2019-08-09 15:52:37 +02:00
Da Zhou 43a91f820a
HADOOP-16315. ABFS: transform full UPN for named user in AclStatus
Contributed by Da Zhou

Change-Id: Ibc78322415fcbeff89c06c8586c53f5695550290
2019-08-09 12:38:13 +01:00
Sunil G acffec7a92 YARN-9715. [UI2] yarn-container-log URI need to be encoded to avoid potential misuses. Contributed by Akhil PB. 2019-08-09 16:05:02 +05:30
Szilard Nemeth e5f4cd0fda SUBMARINE-57. Add more elaborate message if submarine command is not recognized. Contributed by Adam Antal 2019-08-09 12:13:46 +02:00
Rakesh Radhakrishnan f6fa865d6f HDFS-14700. Clean up pmem cache before setting pmem cache capacity. Contributed by Feilong He. 2019-08-09 14:07:54 +05:30
Szilard Nemeth e0c21c6da9 YARN-9092. Create an object for cgroups mount enable and cgroups mount path as they belong together. Contributed by Gergely Pollak 2019-08-09 10:18:34 +02:00
Szilard Nemeth 742e30b473 YARN-9096: Some GpuResourcePlugin and ResourcePluginManager methods are synchronized unnecessarily. Contributed by Gergely Pollak 2019-08-09 09:59:19 +02:00
Szilard Nemeth 72d7e570a7 YARN-9094: Remove unused interface method: NodeResourceUpdaterPlugin#handleUpdatedResourceFromRM. Contributed by Gergely Pollak 2019-08-09 09:49:18 +02:00
Szilard Nemeth df30d8ea09 YARN-9727: Allowed Origin pattern is discouraged if regex contains *. Contributed by Zoltan Siegl 2019-08-09 09:34:23 +02:00
Abhishek Modi a92b7a5491 YARN-9694. UI always show default-rack for all the nodes while running SLS. 2019-08-09 11:41:16 +05:30
Doroszlai, Attila 88ed1e0bfd HDDS-1934. TestSecureOzoneCluster may fail due to port conflict (#1254) 2019-08-08 21:38:31 -07:00
Bharat Viswanadham 91f41b7d88
HDDS-1884. Support Bucket ACL operations for OM HA. (#1202) 2019-08-08 21:29:00 -07:00
Bharat Viswanadham aa5f445fb9
HDDS-1863. Freon RandomKeyGenerator even if keySize is set to 0, it returns some random data to key. (#1167) 2019-08-08 15:40:19 -07:00
Wei-Chiu Chuang 6ad9a11494 HDFS-14693. NameNode should log a warning when EditLog IPC logger's pending size exceeds limit. Contributed by Xudong Cao. 2019-08-08 13:50:30 -07:00
Wei-Chiu Chuang 2265872c2d HDFS-14705. Remove unused configuration dfs.min.replication. Contributed by CR Hota. 2019-08-08 13:48:29 -07:00
Wei-Chiu Chuang 28a848412c HDFS-14701. Change Log Level to warn in SlotReleaser. Contributed by Lisheng Sun. 2019-08-08 13:46:31 -07:00
Wei-Chiu Chuang 23f91f68b8 HDFS-14662. Document the usage of the new Balancer "asService" parameter. Contributed by Chen Zhang. 2019-08-08 13:45:29 -07:00
Siyao Meng 14a4ce3cee HDDS-1829 On OM reload/restart OmMetrics#numKeys should be updated. Contributed by Siyao Meng. 2019-08-08 13:38:10 -07:00
Stephen O'Donnell b0799148cf HDFS-14459. ClosedChannelException silently ignored in FsVolumeList.addBlockPool(). Contributed by Stephen O'Donnell.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-08-08 13:36:39 -07:00
bilaharith 5840df86d7
HADOOP-16479. ABFS FileStatus.getModificationTime returns localized time instead of UTC.
Contributed by Bilahari T H

Change-Id: I532055baaadfd7c324710e4b25f60cdf0378bdc0
2019-08-08 19:08:48 +01:00
Xiaoyu Yao 3ac0f3a0c1
HDDS-1619. Support volume acl operations for OM HA. Contributed by… (#1147) 2019-08-08 09:55:46 -07:00
Bharat Viswanadham 63161cf590
HDDS-1926. The new caching layer is used for old OM requests but not updated
Closes #1247
2019-08-08 15:52:04 +02:00
Charles Xu 9e6519a11a YARN-9711. Missing spaces in NMClientImpl (#1177) Contributed by Charles Xu. 2019-08-08 06:41:04 -07:00
Eric E Payne 3b38f2019e YARN-9685: NPE when rendering the info table of leaf queue in non-accessible partitions. Contributed by Tao Yang. 2019-08-08 12:37:50 +00:00
Nanda kumar 397a5633af
HDDS-1888. Add containers to node2container map in SCM as part of ICR processing.
Signed-off-by: Nanda kumar <nanda@apache.org>
2019-08-08 15:22:03 +05:30
HUAN-PING SU 00b5a27864 SUBMARINE-72. Kill and destroy the job through the submarine client (#1090) Contributed by kevin su. 2019-08-07 21:29:24 -07:00
hunshenshi 22d7d1f8bf YARN-9601.Potential NPE in ZookeeperFederationStateStore#getPoliciesConfigurations (#908) Contributed by hunshenshi. 2019-08-07 21:26:14 -07:00
Zsombor Gegesy b0131bc265 HADOOP-15014. Addendum: KMS should log the IP address of the clients. Contributed by Zsombor Gegesy.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-08-07 20:57:42 -07:00
Bharat Viswanadham 70b4617cfe
HDDS-1900. Remove UpdateBucket handler which supports add/remove Acl. (#1219) 2019-08-07 17:07:40 -07:00
Doroszlai, Attila ab6a5c9d07 HDDS-1925. ozonesecure acceptance test broken by HTTP auth requirement (#1248) 2019-08-07 17:07:15 -07:00
Sammi Chen 8f9245bc2d HDDS-1865. Use "ozone.network.topology.aware.read" to control both RPC client and server side logic (#1184) 2019-08-07 16:59:13 -07:00
Hrishikesh Gadre 3cc0ace203 HADOOP-16491. Upgrade jetty version to 9.3.27. Contributed by Hrishikesh Gadre.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-08-07 13:50:14 -07:00
Ayush Saxena 11f750e6a7 HDFS-14616. Add the warn log when the volume available space isn't enough. Contributed by liying. 2019-08-08 00:49:58 +05:30
Ayush Saxena de64253892 HDFS-14608. DataNode#DataTransfer should be named. Contributed by Inigo Goiri. 2019-08-08 00:37:56 +05:30
Erik Krogen 827dbb11e2 HDFS-14370. Add exponential backoff to the edit log tailer to avoid spinning on empty edit tail requests. Contributed by Erik Krogen. 2019-08-07 09:25:58 -07:00
Doroszlai, Attila 0520f5cede
HDDS-1924. ozone sh bucket path command does not exist
Closes #1245
2019-08-07 18:21:37 +02:00
Xiaoyu Yao 70f46746b1
HDDS-1907. TestOzoneRpcClientWithRatis is failing with ACL errors.
Signed-off-by: Nanda kumar <nanda@apache.org>
2019-08-07 18:34:05 +05:30
Doroszlai, Attila 9cd211ac86 HDDS-1921. TestOzoneManagerDoubleBufferWithOMResponse is flaky (#1238) 2019-08-06 21:14:41 -07:00
Yiqun Lin a5bb1e8ee8 HDFS-14313. Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du. Contributed by Lisheng Sun. 2019-08-07 10:18:11 +08:00
HUAN-PING SU 38e6968647 HDDS-1919. Fix Javadoc in TestAuditParser (#1240) 2019-08-06 18:00:34 -07:00
Akira Ajisaka 0b0ba70b35
HADOOP-15908. hadoop-build-tools jar is downloaded from remote repository instead of using from local. Contributed by Oleksandr Shevchenko. 2019-08-07 09:29:18 +09:00
Doroszlai, Attila c4d97ae500 HDDS-1918. hadoop-ozone-tools has integration tests run as unit (#1236) 2019-08-06 17:00:54 -07:00