Commit Graph

19805 Commits

Author SHA1 Message Date
Weiwei Yang 9c3fc3ef28 YARN-7494. Add muti-node lookup mechanism and pluggable nodes sorting policies to optimize placement decision. Contributed by Sunil Govindan. 2018-08-21 22:42:28 +08:00
Weiwei Yang 54d0bf8935 YARN-8683. Support to display pending scheduling requests in RM app attempt page. Contributed by Tao Yang. 2018-08-21 19:00:31 +08:00
Rohith Sharma K S d3fef7a5c5 YARN-8129. Improve error message for invalid value in fields attribute. Contributed by Abhishek Modi. 2018-08-21 11:58:07 +05:30
Vinayakumar B 770d9d9bb6 HDFS-13772. Erasure coding: Unnecessary NameNode Logs displaying for Enabling/Disabling Erasure coding policies which are already enabled/disabled. Contributed by Ayush Saxena 2018-08-21 09:33:19 +05:30
Steve Loughran 34577d2c21
HADOOP-15679. ShutdownHookManager shutdown time needs to be configurable & extended.
Contributed by Steve Loughran.
2018-08-20 18:36:24 -07:00
Giovanni Matteo Fumarola e0f6ffdbad YARN-8581. [AMRMProxy] Add sub-cluster timeout in LocalityMulticastAMRMProxyPolicy. Contributed by Botong Huang. 2018-08-20 14:33:16 -07:00
Giovanni Matteo Fumarola 8736fc39ac YARN-8673. [AMRMProxy] More robust responseId resync after an YarnRM master slave switch. Contributed by Botong Huang. 2018-08-20 12:22:36 -07:00
Jason Lowe 65e7469712 YARN-8242. YARN NM: OOM error while reading back the state store on recovery. Contributed by Pradeep Ambati and Kanwaljeet Sachdev 2018-08-20 10:14:40 -05:00
Yiqun Lin 01ff817814 HDFS-13750. RBF: Router ID in RouterRpcClient is always null. Contributed by Takanobu Asanuma. 2018-08-20 23:01:59 +08:00
Mukul Kumar Singh e3d73bbc24 HDDS-353. Multiple delete Blocks tests are failing consistently. Contributed by Lokesh Jain. 2018-08-20 13:37:58 +05:30
Brahma Reddy Battula 6425ed27ea HDFS-13790. RBF: Move ClientProtocol APIs to its own module. Contributed by Chao Sun. 2018-08-20 12:20:29 +05:30
Rohith Sharma K S 4aacbfff60 YARN-8679. [ATSv2] If HBase cluster is down for long time, high chances that NM ContainerManager dispatcher get blocked. Contributed by Wangda Tan. 2018-08-18 10:26:55 +05:30
Giovanni Matteo Fumarola 79c97f6a0b HADOOP-14624. Add GenericTestUtils.DelayAnswer that accept slf4j logger API. Contributed by Ian Pickering and Wenxin He. 2018-08-17 14:40:00 -07:00
Anu Engineer ab37423ad8 HDDS-355. Disable OpenKeyDeleteService and DeleteKeysService.
Contributed by Anu Engineer.
2018-08-17 11:50:46 -07:00
Xiao Chen 60ffec9f79 HADOOP-9214. Create a new touch command to allow modifying atime and mtime. Contributed by Hrishikesh Gadre. 2018-08-17 11:18:09 -07:00
Jason Lowe a17eed1b87 HDFS-13822. speedup libhdfs++ build (enable parallel build). Contributed by Allen Wittenauer and Pradeep Ambati 2018-08-17 12:25:36 -05:00
Aaron Fabbri d7232857d8
HADOOP-14154 Persist isAuthoritative bit in DynamoDBMetaStore (Contributed by Gabor Bota) 2018-08-17 10:15:39 -07:00
Xiao Chen 8d7c93186e HADOOP-15674. Test failure TestSSLHttpServer.testExcludedCiphers with TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256 cipher suite. Contributed by Szilard Nemeth. 2018-08-17 10:09:23 -07:00
Xiaoyu Yao fb5b3dce61 Revert "HDFS-13790. RBF: Move ClientProtocol APIs to its own module. Contributed by Chao Sun."
This reverts commit fa121eb66b.
2018-08-17 08:01:44 -07:00
Xiaoyu Yao 9dd5d5ba71 HDDS-218. add existing docker-compose files to the ozone release artifact. Contributed by Elek Marton. 2018-08-17 07:58:24 -07:00
Brahma Reddy Battula fa121eb66b HDFS-13790. RBF: Move ClientProtocol APIs to its own module. Contributed by Chao Sun. 2018-08-17 15:22:55 +05:30
Márton Elek 77b015000a HADOOP-8807. Update README and website to reflect HADOOP-8662. Contributed by Andras Bokor. 2018-08-17 11:10:29 +02:00
Xiao Chen c67b0650ea HDFS-13747. Statistic for list_located_status is incremented incorrectly by listStatusIterator. Contributed by Antal Mihalyi. 2018-08-16 23:14:21 -07:00
Rohith Sharma K S 1697a02306 YARN-8612. Fix NM Collector Service Port issue in YarnConfiguration. Contributed by Prabha Manepalli. 2018-08-17 11:12:10 +05:30
Xiao Chen edeb2a356a HADOOP-15655. Enhance KMS client retry behavior. Contributed by Kitti Nanasi. 2018-08-16 22:42:03 -07:00
Xiaoyu Yao 2d13e410d8 HDDS-119. Skip Apache license header check for some ozone doc scripts. Contributed by Ajay Kumar. 2018-08-16 22:18:52 -07:00
Wei-Chiu Chuang 1290e3c647 HDFS-10240. Race between close/recoverLease leads to missing block. Contributed by Jinglun, zhouyingchao and Wei-Chiu Chuang. 2018-08-16 16:29:38 -07:00
Eric Yang d42806160e YARN-8667. Cleanup symlinks when container restarted by NM.
Contributed by Chandni Singh
2018-08-16 18:41:58 -04:00
Daniel Templeton 8512e1a91b HDFS-13746. Still occasional "Should be different group" failure in TestRefreshUserMappings#testGroupMappingRefresh
(Contributed by Siyao Meng via Daniel Templeton)

Change-Id: I9fad1537ace38367a463d9fe67aaa28d3178fc69
2018-08-16 15:00:45 -07:00
Mukul Kumar Singh 5ef29087ad HDDS-179. CloseContainer/PutKey command should be syncronized with write operations. Contributed by Shashikant Banerjee. 2018-08-16 23:35:19 +05:30
Steve Loughran 0e832e7a74
HADOOP-15642. Update aws-sdk version to 1.11.375.
Contributed by Steve Loughran.
2018-08-16 09:58:46 -07:00
Eric Yang 8990eaf592 YARN-8474. Fixed ApiServiceClient kerberos negotiation.
Contributed by Billie Rinaldi
2018-08-16 12:46:37 -04:00
Jason Lowe cb21eaa026 YARN-8656. container-executor should not write cgroup tasks files for docker containers. Contributed by Jim Brennan 2018-08-16 10:06:17 -05:00
Yiqun Lin 6df606f1b4 HDFS-13829. Remove redundant condition judgement in DirectoryScanner#scan. Contributed by liaoyuxiangqin. 2018-08-16 18:44:18 +08:00
Xiao Chen 7dc79a8b5b HDFS-13732. ECAdmin should print the policy name when an EC policy is set. Contributed by Zsolt Venczel. 2018-08-15 13:53:47 -07:00
Anu Engineer d951af22b4 HADOOP-15552. Addendum patch to fix the build break in Ozone File system.
Contributed by Anu Engineer.
2018-08-15 10:58:29 -07:00
Anu Engineer c918d88a9b Revert "HDDS-119:Skip Apache license header check for some ozone doc scripts. Contributed by Ajay Kumar"
This reverts commit c4bbcd5634.
2018-08-15 10:06:17 -07:00
Xiao Chen ef02f9b233 HDFS-13217. Audit log all EC policy names during addErasureCodingPolicies. Contributed by liaoyuxiangqin. 2018-08-15 09:23:05 -07:00
Akira Ajisaka 3e3963b035
HADOOP-15552. Move logging APIs over to slf4j in hadoop-tools - Part2. Contributed by Ian Pickering. 2018-08-16 00:31:59 +09:00
Xiaoyu Yao f2315f2e9c HDDS-347. TestCloseContainerByPipeline#testCloseContainerViaStandaAlone sometimes fails. Contributed by Lixin Ge. 2018-08-15 08:11:17 -07:00
Weiwei Yang 8dc07b4723 YARN-8614. Fix few annotation typos in YarnConfiguration. Contributed by Sen Zhao. 2018-08-15 12:15:54 +08:00
Wei-Chiu Chuang bdd0e01ed9 HADOOP-14212. Addendum patch: Expose SecurityEnabled boolean field in JMX for other services besides NameNode. Contributed by Adam Antal. 2018-08-14 18:25:38 -07:00
Daniel Templeton 4a5006b1d0 HDFS-13819. TestDirectoryScanner#testDirectoryScannerInFederatedCluster is flaky
Change-Id: I1cea6e67fcec72702ad202775dee3373261ac5cd
2018-08-14 17:22:15 -07:00
Wei-Chiu Chuang 363bd16e31 HADOOP-14212. Expose SecurityEnabled boolean field in JMX for other services besides NameNode. Contributed by Adam Antal. 2018-08-14 17:19:00 -07:00
Xiaoyu Yao 75fc51588d HDDS-298. Implement SCMClientProtocolServer.getContainerWithPipeline for closed containers. Contributed by Ajay Kumar. 2018-08-14 14:57:46 -07:00
Xiao Chen cede33997f HDFS-13788. Update EC documentation about rack fault tolerance. Contributed by Kitti Nanasi. 2018-08-14 11:57:22 -07:00
Márton Elek 7e822ec246 HDDS-324. Addendum: remove the q letter which is accidentally added to the hadoop-functions.sh. 2018-08-14 20:54:33 +02:00
Wei-Chiu Chuang 61a9b4f58b HDFS-13758. DatanodeManager should throw exception if it has BlockRecoveryCommand but the block is not under construction. Contributed by chencan. 2018-08-14 11:51:27 -07:00
Eric Yang 4cba0741d5 YARN-8160. Support upgrade of service that use docker containers.
Contributed by Chandni Singh
2018-08-14 11:36:26 -04:00
Jason Lowe d1d129aa9d YARN-8640. Restore previous state in container-executor after failure. Contributed by Jim Brennan 2018-08-14 10:21:03 -05:00