Commit Graph

602 Commits

Author SHA1 Message Date
Eric Yang e2a9fa8448 HADOOP-15821. Move YARN Registry to Hadoop Registry.
Contributed by Íñigo Goiri
2018-10-19 19:46:48 -04:00
Takanobu Asanuma 9bd18324c7 HADOOP-15804. upgrade to commons-compress 1.18. Contributed by Akira Ajisaka. 2018-10-19 21:29:35 +09:00
Xiao Chen 8853fc8a55 HADOOP-15849. Upgrade netty version to 3.10.6. 2018-10-13 20:22:02 -07:00
Tsz Wo Nicholas Sze fb18cc5eaa HDDS-625. putKey hangs for a long time after completion, sometimes forever. Contributed by Arpit Agarwal 2018-10-12 10:37:37 +08:00
Jitendra Pandey 0bc6d0484a HDDS-550. Serialize ApplyTransaction calls per Container in ContainerStateMachine. Contributed by Shashikant Banerjee. 2018-10-11 17:12:47 -07:00
Akira Ajisaka 6fa3feb577
HADOOP-15832. Upgrade BouncyCastle to 1.60. Contributed by Robert Kanter. 2018-10-10 10:16:57 +09:00
Takanobu Asanuma 9bbeb52486 HADOOP-15775. [JDK9] Add missing javax.activation-api dependency. Contributed by Akira Ajisaka. 2018-10-09 13:06:14 +09:00
Eric Yang 347ea38581 YARN-8763. Added node manager websocket API for accessing containers.
Contributed by Zian Chen
2018-10-08 13:56:47 -04:00
Takanobu Asanuma 241cbec2da HADOOP-15816. Upgrade Apache Zookeeper version due to security concerns. Contributed by Akira Ajisaka. 2018-10-05 14:57:45 +09:00
Takanobu Asanuma 2626f46691 HADOOP-15814. Maven 3.3.3 unable to parse pom file. Contributed by Wei-Chiu Chuang. 2018-10-03 16:38:41 +09:00
Akira Ajisaka 31fa9bb799
HADOOP-15767. [JDK10] Building native package on JDK10 fails due to missing javah. Contributed by Takanobu Asanuma. 2018-10-03 11:29:18 +09:00
Robert Kanter 96ae4ac45f Changed version in trunk to 3.3.0-SNAPSHOT addendum 2018-10-02 16:48:59 -07:00
Sunil G 58fa96b697 Changed version in trunk to 3.3.0-SNAPSHOT. 2018-10-02 22:41:41 +05:30
Sunil G 19ad5be651 YARN-8800. Updated documentation of Submarine with latest examples. Contributed by Wangda Tan. 2018-09-29 00:01:04 +05:30
Bharat Viswanadham 67173b4847 HDDS-441. Create new s3gateway daemon. Contributed by Elek Marton. 2018-09-24 13:42:55 -07:00
Bharat Viswanadham 62f817d32e HDDS-447. Separate ozone-dist and hadoop-dist projects with real classpath separation. Contributed by Elek Marton. 2018-09-24 10:10:11 -07:00
Sean Mackrory 0def61482b Merge branch 'HADOOP-15407' into trunk 2018-09-22 21:19:12 -06:00
Nanda kumar c0956ee2a8 HDDS-476. Add Pipeline reports to make pipeline active on SCM restart.
Contributed by Mukul Kumar Singh.
2018-09-19 18:52:08 +05:30
Sammi Chen e4fca6aae4 HADOOP-15759. AliyunOSS: Update oss-sdk version to 3.0.0. Contributed by Jinhu Wu. 2018-09-18 18:37:49 +08:00
Takanobu Asanuma 281c192e7f
[JDK10] Upgrade Maven Javadoc Plugin from 3.0.0-M1 to 3.0.1.
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-09-18 09:32:27 +09:00
Thomas Marquardt d6a4f39bd5 HADOOP-15669. ABFS: Improve HTTPS Performance.
Contributed by Vishwajeet Dusane.
2018-09-17 19:54:01 +00:00
Steve Loughran f044deedbb HADOOP-15407. HADOOP-15540. Support Windows Azure Storage - Blob file system "ABFS" in Hadoop: Core Commit.
Contributed by Shane Mainali, Thomas Marquardt, Zichen Sun, Georgi Chalakov, Esfandiar Manii, Amit Singh, Dana Kaban, Da Zhou, Junhua Gu, Saher Ahwal, Saurabh Pant, James Baker, Shaoyu Zhang, Lawrence Chen, Kevin Chen and Steve Loughran
2018-09-17 19:54:01 +00:00
Mukul Kumar Singh c9e0b69ab3 HDDS-233. Update ozone to latest ratis snapshot build(0.3.0-50588bd-SNAPSHOT). Contributed by Shashikant Banerjee. 2018-09-13 19:01:07 +05:30
Weiwei Yang 1e7d6e55a5 YARN-7865. Node attributes documentation. Contributed by Naganarasimha G R. 2018-09-12 16:01:01 +05:30
Akira Ajisaka 76d0365190 HADOOP-15584. Move httpcomponents versions in pom.xml. Contributed by Brandon Scheller. 2018-09-12 14:28:47 +09:00
Mukul Kumar Singh 2651e2c43d HDDS-365. Implement flushStateMachineData for containerStateMachine. Contributed by Shashikant Banerjee. 2018-08-29 07:58:30 +05:30
Steve Loughran 0e832e7a74
HADOOP-15642. Update aws-sdk version to 1.11.375.
Contributed by Steve Loughran.
2018-08-16 09:58:46 -07:00
Xiaoyu Yao b4031a8f1b HDDS-324. Use pipeline name as Ratis groupID to allow datanode to report pipeline info. Contributed by Mukul Kumar Singh. 2018-08-13 12:47:49 -07:00
Mukul Kumar Singh 900c0e114f HDDS-230. ContainerStateMachine should implement readStateMachineData api to read data from Containers if required during replication. Contributed by Mukul Kumar Singh. 2018-08-07 15:03:14 +05:30
Akira Ajisaka 88625f5cd9
HADOOP-15531. Use commons-text instead of commons-lang in some classes to fix deprecation warnings. Contributed by Takanobu Asanuma. 2018-07-13 11:42:12 -04:00
Akira Ajisaka 418cc7f3ae
HDFS-13729. Fix broken links to RBF documentation. Contributed by Gabor Bota. 2018-07-11 14:46:43 -04:00
Akira Ajisaka 2b2399d623
HADOOP-15495. Upgrade commons-lang version to 3.7 in hadoop-common-project and hadoop-tools. Contributed by Takanobu Asanuma. 2018-06-28 14:37:22 +09:00
Anu Engineer e16e5b307d HDDS-177. Create a releasable ozonefs artifact
Contributed by Marton, Elek.
2018-06-24 01:05:04 -07:00
Sean Mackrory b089a06793 HADOOP-14918. Remove the Local Dynamo DB test option. Contributed by Gabor Bota. 2018-06-20 16:45:08 -06:00
Jitendra Pandey c42dcc7c47 HADOOP-15482. Upgrade jackson-databind to version 2.9.5. Contributed by Lokesh Jain. 2018-06-07 23:00:26 -07:00
Steve Loughran d901be6795
HADOOP-15506. Upgrade Azure Storage Sdk version to 7.0.0 and update corresponding code blocks.
Contributed by Esfandiar Manii.
2018-06-06 18:28:14 +01:00
Wangda Tan ff583d3fa3 YARN-8349. Remove YARN registry entries when a service is killed by the RM. (Billie Rinaldi via wangda)
Change-Id: Ia58db3637789a8921482f564aa9bdf99c45cc36c
2018-06-01 14:49:18 -07:00
Jason Lowe 31ab960f4f YARN-8338. TimelineService V1.5 doesn't come up after HADOOP-15406. Contributed by Vinod Kumar Vavilapalli 2018-05-29 11:00:30 -05:00
Anu Engineer 5a9140690a HDDS-49. Standalone protocol should use grpc in place of netty.
Contributed by Mukul Kumar Singh.
2018-05-22 19:56:15 -07:00
Anu Engineer 481bfdb94f HDDS-89. Create ozone specific inline documentation as part of the build.
Contributed by Elek, Marton.
2018-05-22 10:49:10 -07:00
Mukul Kumar Singh 6653f4ba2e HDDS-19. Update ozone to latest ratis snapshot build (0.1.1-alpha-d7d7061-SNAPSHOT). Contributed by Lokesh Jain. 2018-05-14 22:25:03 +05:30
Anu Engineer c1d64d60f6 HDDS-39. Ozone: Compile Ozone/HDFS/Cblock protobuf files with proto3 compiler using maven protoc plugin.
Contributed by Mukul Kumar Singh.
2018-05-11 11:08:45 -07:00
Owen O'Malley 2adda92de1
HDFS-7240 git commit fixup
Signed-off-by: Owen O'Malley <omalley@apache.org>
2018-04-26 13:52:17 -07:00
Xiaoyu Yao 20dab05564 HDFS-13407. Ozone: Use separated version schema for Hdds/Ozone projects. Contributed by Elek Marton. 2018-04-26 05:36:04 -07:00
Mukul Kumar Singh ec6c8742e5 HDFS-13415. Ozone: Remove cblock code from HDFS-7240. Contributed by Elek, Marton. 2018-04-26 05:36:04 -07:00
Anu Engineer 8b832f3c35 HDFS-13405. Ozone: Rename HDSL to HDDS.
Contributed by Ajay Kumar, Elek Marton, Mukul Kumar Singh, Shashikant Banerjee and Anu Engineer.
2018-04-26 05:36:04 -07:00
Nanda kumar 6cc765fbb6 HDFS-13320. Ozone: Support for MicrobenchMarking Tool. Contributed by Shashikant Banerjee 2018-04-26 05:36:04 -07:00
Anu Engineer 4e61bc431e HDFS-13258. Ozone: restructure Hdsl/Ozone code to separated maven subprojects.
Contributed by Elek Marton, Mukul Kumar Singh, Xiaoyu Yao, Ajay Kumar, Anu Engineer, Lokesh Jain, Nanda Kumar.
2018-04-26 05:36:04 -07:00
Xiaoyu Yao 7846636a5d HDFS-12551. Ozone: Documentation: Add Ozone overview documentation. Contributed by Anu Engineer. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao f2d9360b9d HDFS-12199. Ozone: OzoneFileSystem: OzoneFileystem initialization code. Contributed by Mukul Kumar Singh. 2018-04-26 05:36:04 -07:00
Weiwei Yang c398ab49d3 HDFS-12047. Ozone: Add REST API documentation. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Yiqun Lin 52aa60ed2f HDFS-11963. Ozone: Documentation: Add getting started page (addendum). Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Anu Engineer 8d289df627 HDFS-11963. Ozone: Documentation: Add getting started page. Contributed by Anu Engineer. 2018-04-26 05:36:04 -07:00
Anu Engineer aa16380d71 HDFS-11566. Ozone: Document missing metrics for container operations. Contributed by Yiqun Lin. 2018-04-26 05:34:18 -07:00
Takanobu Asanuma bcb57b1f89
HADOOP-15393. Upgrade the version of commons-lang3 to 3.7
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-04-18 13:33:15 +09:00
Sunil G 427ad7ecc4 YARN-8126. Support auto-spawning of admin configured services during bootstrap of RM. Contributed by Rohith Sharma K S. 2018-04-17 15:08:31 +05:30
Xiaoyu Yao ea95a335d0 HADOOP-15369. Avoid usage of ${project.version} in parent poms. Contributed by Elek Marton. 2018-04-16 10:15:37 -07:00
Takanobu Asanuma 7623cc5a98
HADOOP-15374. Add links of the new features of 3.1.0 to the top page
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-04-10 18:59:40 +09:00
Sean Mackrory 82665a7887 HADOOP-15299. Bump Jackson 2 version to Jackson 2.9.x. 2018-03-26 14:05:15 -06:00
Arpit Agarwal dae5051828 HADOOP-15334. Upgrade Maven surefire plugin. Contributed by Arpit Agarwal. 2018-03-22 10:52:02 -07:00
weiy 6e2b5fa493 HDFS-13215. RBF: Move Router to its own module. Contributed by Wei Yan 2018-03-19 22:13:40 -07:00
Yiqun Lin 4cc9a6d9bb HADOOP-15296. Fix a wrong link for RBF in the top page. Contributed by Takanobu Asanuma. 2018-03-08 16:02:34 +08:00
Rohith Sharma K S 55ba49dd07 YARN-7346. Add a profile to allow optional compilation for ATSv2 with HBase-2.0. Contributed by Haibo Chen and Rohith. 2018-03-06 11:55:21 +05:30
Akira Ajisaka 432cd74c72
HADOOP-15261. Upgrade commons-io from 2.4 to 2.5. Contributed by PandaMonkey. 2018-03-02 15:47:43 -08:00
Ray Chiang 923e1773e1 HADOOP-14652. Update metrics-core version to 3.2.4. (rchiang) 2018-03-01 15:36:10 -08:00
Haibo Chen 10663b78c8 Revert "yarn-7346.07.patch"
This reverts commit 5e37ca5bb4.
2018-02-28 21:11:36 -08:00
Haibo Chen 5e37ca5bb4 yarn-7346.07.patch 2018-02-28 21:04:54 -08:00
Steve Loughran edc9f1451b HADOOP-15263. hadoop cloud-storage module to mark hadoop-common as provided; add azure-datalake.
Contributed by Steve Loughran
2018-02-28 14:42:25 +00:00
Steve Loughran e015e00989 HADOOP-15264. AWS "shaded" SDK 1.271 is pulling in netty 4.1.17.
Contributed by Steve Loughran.

(cherry picked from commit b580196a16)
2018-02-28 13:11:07 +00:00
Steve Loughran 004b722372 HADOOP-15247. Move commons-net up to 3.6.
Contributed by Steve Loughran.
2018-02-21 10:40:42 +00:00
Rohith Sharma K S 9af30d46c6 YARN-7919. Refactor timelineservice-hbase module into submodules. Contributed by Haibo Chen. 2018-02-17 20:30:28 +05:30
Wangda Tan 31db977cb3 HADOOP-14875. Create end user documentation from the compatibility guidelines. (Daniel Templeton via wangda)
Change-Id: I5d66d0f034874623af22aecae0a0b858b65396ed
2018-02-17 12:28:55 +08:00
Aaron Fabbri 60971b8195
HADOOP-15040 Upgrade AWS SDK to 1.11.271: NPE bug spams logs w/ Yarn Log Aggregation 2018-02-13 18:51:22 -08:00
Wangda Tan 60f9e60b3b Preparing for 3.2.0 development
Change-Id: I6d0e01f3d665d26573ef2b957add1cf0cddf7938
2018-02-11 11:17:38 +08:00
Xiao Chen 09dd709d6e HADOOP-15197. Remove tomcat from the Hadoop-auth test bundle. 2018-02-01 15:33:52 -08:00
Akira Ajisaka cdaf92c9f5
HADOOP-15177. Update the release year to 2018. Contributed by Bharat Viswanadham. 2018-01-18 13:15:57 +09:00
Steve Loughran 2e0a451a8d HADOOP-15033. Use java.util.zip.CRC32C for Java 9 and above
Contributed by Dmitry Chuyko,
2018-01-11 10:47:50 +00:00
Akira Ajisaka d2d8f4aeb3
HADOOP-15133. [JDK9] Ignore com.sun.javadoc.* and com.sun.tools.* in animal-sniffer-maven-plugin to compile with Java 9. 2017-12-21 11:58:34 +09:00
Virajith Jalaparti 352f994b64 HDFS-12665. [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb). Contributed by Ewan Higgs. 2017-12-15 17:51:40 -08:00
Sammi Chen 67b2661e3d HADOOP-15080. Aliyun OSS: update oss sdk from 2.8.1 to 2.8.3 to remove its dependency on Cat-x json-lib. 2017-12-07 22:46:11 +08:00
Wei-Chiu Chuang 3881c9ef7e HADOOP-15054. upgrade hadoop dependency on commons-codec to 1.11. 2017-11-29 08:54:49 -08:00
Akira Ajisaka 6903cf096e HADOOP-13514. Upgrade maven surefire plugin to 2.20.1
Signed-off-by: Allen Wittenauer <aw@apache.org>
2017-11-19 12:39:37 -08:00
Daniel Templeton 69043ba8b5 HADOOP-14876. Create downstream developer docs from the compatibility guidelines 2017-11-15 10:03:29 -08:00
Andrew Wang 8b12574165 HADOOP-15037. Add site release notes for OrgQueue and resource types. 2017-11-13 18:49:22 -08:00
Daniel Templeton 040a38dc49 YARN-7369. Improve the resource types docs 2017-11-13 11:05:07 -08:00
Jian He ba7ed7b66a YARN-7384. Remove apiserver cmd and merge service cmd into application cmd. Contributed by Billie Rinaldi 2017-11-06 13:30:19 -08:00
Gour Saha 541b64c798 YARN-7165. Miscellaneous fixes in yarn-native-services. Contributed by Jian He 2017-11-06 13:30:15 -08:00
Jian He 7dd4490a44 YARN-7073. Yarn native services rest API documentation. Contributed by Gour Saha 2017-11-06 13:30:14 -08:00
Jian He fecf22b2fd YARN-7113. Clean up packaging and dependencies for yarn-native-services. Contributed by Billie Rinaldi 2017-11-06 13:30:13 -08:00
Billie Rinaldi 40ab068eab YARN-7091. Rename application to service in yarn-native-services. Contributed by Jian He 2017-11-06 13:30:13 -08:00
Gour Saha 2ba38ce8ec YARN-5244. Documentation required for DNS Server implementation. Contributed by Jon Maron 2017-11-06 13:30:12 -08:00
Jian He f934f62fc7 YARN-5218. Initial core change for DNS for YARN. Contributed by Jonathan Maron 2017-11-06 13:28:39 -08:00
Jian He 234dba84a1 YARN-5909. Remove agent related code in slider AM. Contributed by Jian He 2017-11-06 13:28:36 -08:00
Gour Saha 09e4b9e897 YARN-5690. Integrate native services modules into maven build. Contributed by Billie Rinaldi 2017-11-06 13:28:34 -08:00
Jian He 18bf0dce28 YARN-5610. Initial code for native services REST API. Contributed by Gour Saha 2017-11-06 13:28:33 -08:00
Chris Douglas e4878a59b3 HADOOP-14992. Upgrade Avro patch version. Contributed by Bharat Viswanadham 2017-10-30 09:49:22 -07:00
Chris Douglas b50def3697 HADOOP-14986. Enforce JDK limitations. 2017-10-27 18:47:45 -07:00
Subru Krishnan 625039ef20 HADOOP-14840. Tool to estimate resource requirements of an application pipeline based on prior executions. (Rui Li via Subru). 2017-10-25 15:51:27 -07:00
Yiqun Lin b90750cfb8 HDFS-12695. Add a link to HDFS router federation document in site.xml. Contributed by Yiqun Lin. 2017-10-24 10:46:09 +08:00
Wangda Tan 4afd308b62 YARN-7170. Improve bower dependencies for YARN UI v2. (Sunil G via wangda) 2017-10-19 21:58:40 -07:00