Commit Graph

464 Commits

Author SHA1 Message Date
Eric Yang 347ea38581 YARN-8763. Added node manager websocket API for accessing containers.
Contributed by Zian Chen
2018-10-08 13:56:47 -04:00
Takanobu Asanuma 241cbec2da HADOOP-15816. Upgrade Apache Zookeeper version due to security concerns. Contributed by Akira Ajisaka. 2018-10-05 14:57:45 +09:00
Takanobu Asanuma 2626f46691 HADOOP-15814. Maven 3.3.3 unable to parse pom file. Contributed by Wei-Chiu Chuang. 2018-10-03 16:38:41 +09:00
Akira Ajisaka 31fa9bb799
HADOOP-15767. [JDK10] Building native package on JDK10 fails due to missing javah. Contributed by Takanobu Asanuma. 2018-10-03 11:29:18 +09:00
Robert Kanter 96ae4ac45f Changed version in trunk to 3.3.0-SNAPSHOT addendum 2018-10-02 16:48:59 -07:00
Sunil G 58fa96b697 Changed version in trunk to 3.3.0-SNAPSHOT. 2018-10-02 22:41:41 +05:30
Bharat Viswanadham 67173b4847 HDDS-441. Create new s3gateway daemon. Contributed by Elek Marton. 2018-09-24 13:42:55 -07:00
Bharat Viswanadham 62f817d32e HDDS-447. Separate ozone-dist and hadoop-dist projects with real classpath separation. Contributed by Elek Marton. 2018-09-24 10:10:11 -07:00
Sean Mackrory 0def61482b Merge branch 'HADOOP-15407' into trunk 2018-09-22 21:19:12 -06:00
Nanda kumar c0956ee2a8 HDDS-476. Add Pipeline reports to make pipeline active on SCM restart.
Contributed by Mukul Kumar Singh.
2018-09-19 18:52:08 +05:30
Sammi Chen e4fca6aae4 HADOOP-15759. AliyunOSS: Update oss-sdk version to 3.0.0. Contributed by Jinhu Wu. 2018-09-18 18:37:49 +08:00
Takanobu Asanuma 281c192e7f
[JDK10] Upgrade Maven Javadoc Plugin from 3.0.0-M1 to 3.0.1.
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-09-18 09:32:27 +09:00
Thomas Marquardt d6a4f39bd5 HADOOP-15669. ABFS: Improve HTTPS Performance.
Contributed by Vishwajeet Dusane.
2018-09-17 19:54:01 +00:00
Steve Loughran f044deedbb HADOOP-15407. HADOOP-15540. Support Windows Azure Storage - Blob file system "ABFS" in Hadoop: Core Commit.
Contributed by Shane Mainali, Thomas Marquardt, Zichen Sun, Georgi Chalakov, Esfandiar Manii, Amit Singh, Dana Kaban, Da Zhou, Junhua Gu, Saher Ahwal, Saurabh Pant, James Baker, Shaoyu Zhang, Lawrence Chen, Kevin Chen and Steve Loughran
2018-09-17 19:54:01 +00:00
Mukul Kumar Singh c9e0b69ab3 HDDS-233. Update ozone to latest ratis snapshot build(0.3.0-50588bd-SNAPSHOT). Contributed by Shashikant Banerjee. 2018-09-13 19:01:07 +05:30
Akira Ajisaka 76d0365190 HADOOP-15584. Move httpcomponents versions in pom.xml. Contributed by Brandon Scheller. 2018-09-12 14:28:47 +09:00
Mukul Kumar Singh 2651e2c43d HDDS-365. Implement flushStateMachineData for containerStateMachine. Contributed by Shashikant Banerjee. 2018-08-29 07:58:30 +05:30
Steve Loughran 0e832e7a74
HADOOP-15642. Update aws-sdk version to 1.11.375.
Contributed by Steve Loughran.
2018-08-16 09:58:46 -07:00
Xiaoyu Yao b4031a8f1b HDDS-324. Use pipeline name as Ratis groupID to allow datanode to report pipeline info. Contributed by Mukul Kumar Singh. 2018-08-13 12:47:49 -07:00
Mukul Kumar Singh 900c0e114f HDDS-230. ContainerStateMachine should implement readStateMachineData api to read data from Containers if required during replication. Contributed by Mukul Kumar Singh. 2018-08-07 15:03:14 +05:30
Akira Ajisaka 88625f5cd9
HADOOP-15531. Use commons-text instead of commons-lang in some classes to fix deprecation warnings. Contributed by Takanobu Asanuma. 2018-07-13 11:42:12 -04:00
Akira Ajisaka 2b2399d623
HADOOP-15495. Upgrade commons-lang version to 3.7 in hadoop-common-project and hadoop-tools. Contributed by Takanobu Asanuma. 2018-06-28 14:37:22 +09:00
Anu Engineer e16e5b307d HDDS-177. Create a releasable ozonefs artifact
Contributed by Marton, Elek.
2018-06-24 01:05:04 -07:00
Sean Mackrory b089a06793 HADOOP-14918. Remove the Local Dynamo DB test option. Contributed by Gabor Bota. 2018-06-20 16:45:08 -06:00
Jitendra Pandey c42dcc7c47 HADOOP-15482. Upgrade jackson-databind to version 2.9.5. Contributed by Lokesh Jain. 2018-06-07 23:00:26 -07:00
Steve Loughran d901be6795
HADOOP-15506. Upgrade Azure Storage Sdk version to 7.0.0 and update corresponding code blocks.
Contributed by Esfandiar Manii.
2018-06-06 18:28:14 +01:00
Wangda Tan ff583d3fa3 YARN-8349. Remove YARN registry entries when a service is killed by the RM. (Billie Rinaldi via wangda)
Change-Id: Ia58db3637789a8921482f564aa9bdf99c45cc36c
2018-06-01 14:49:18 -07:00
Jason Lowe 31ab960f4f YARN-8338. TimelineService V1.5 doesn't come up after HADOOP-15406. Contributed by Vinod Kumar Vavilapalli 2018-05-29 11:00:30 -05:00
Anu Engineer 5a9140690a HDDS-49. Standalone protocol should use grpc in place of netty.
Contributed by Mukul Kumar Singh.
2018-05-22 19:56:15 -07:00
Anu Engineer 481bfdb94f HDDS-89. Create ozone specific inline documentation as part of the build.
Contributed by Elek, Marton.
2018-05-22 10:49:10 -07:00
Mukul Kumar Singh 6653f4ba2e HDDS-19. Update ozone to latest ratis snapshot build (0.1.1-alpha-d7d7061-SNAPSHOT). Contributed by Lokesh Jain. 2018-05-14 22:25:03 +05:30
Anu Engineer c1d64d60f6 HDDS-39. Ozone: Compile Ozone/HDFS/Cblock protobuf files with proto3 compiler using maven protoc plugin.
Contributed by Mukul Kumar Singh.
2018-05-11 11:08:45 -07:00
Owen O'Malley 2adda92de1
HDFS-7240 git commit fixup
Signed-off-by: Owen O'Malley <omalley@apache.org>
2018-04-26 13:52:17 -07:00
Xiaoyu Yao 20dab05564 HDFS-13407. Ozone: Use separated version schema for Hdds/Ozone projects. Contributed by Elek Marton. 2018-04-26 05:36:04 -07:00
Mukul Kumar Singh ec6c8742e5 HDFS-13415. Ozone: Remove cblock code from HDFS-7240. Contributed by Elek, Marton. 2018-04-26 05:36:04 -07:00
Anu Engineer 8b832f3c35 HDFS-13405. Ozone: Rename HDSL to HDDS.
Contributed by Ajay Kumar, Elek Marton, Mukul Kumar Singh, Shashikant Banerjee and Anu Engineer.
2018-04-26 05:36:04 -07:00
Nanda kumar 6cc765fbb6 HDFS-13320. Ozone: Support for MicrobenchMarking Tool. Contributed by Shashikant Banerjee 2018-04-26 05:36:04 -07:00
Anu Engineer 4e61bc431e HDFS-13258. Ozone: restructure Hdsl/Ozone code to separated maven subprojects.
Contributed by Elek Marton, Mukul Kumar Singh, Xiaoyu Yao, Ajay Kumar, Anu Engineer, Lokesh Jain, Nanda Kumar.
2018-04-26 05:36:04 -07:00
Xiaoyu Yao f2d9360b9d HDFS-12199. Ozone: OzoneFileSystem: OzoneFileystem initialization code. Contributed by Mukul Kumar Singh. 2018-04-26 05:36:04 -07:00
Takanobu Asanuma bcb57b1f89
HADOOP-15393. Upgrade the version of commons-lang3 to 3.7
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-04-18 13:33:15 +09:00
Xiaoyu Yao ea95a335d0 HADOOP-15369. Avoid usage of ${project.version} in parent poms. Contributed by Elek Marton. 2018-04-16 10:15:37 -07:00
Sean Mackrory 82665a7887 HADOOP-15299. Bump Jackson 2 version to Jackson 2.9.x. 2018-03-26 14:05:15 -06:00
Arpit Agarwal dae5051828 HADOOP-15334. Upgrade Maven surefire plugin. Contributed by Arpit Agarwal. 2018-03-22 10:52:02 -07:00
weiy 6e2b5fa493 HDFS-13215. RBF: Move Router to its own module. Contributed by Wei Yan 2018-03-19 22:13:40 -07:00
Rohith Sharma K S 55ba49dd07 YARN-7346. Add a profile to allow optional compilation for ATSv2 with HBase-2.0. Contributed by Haibo Chen and Rohith. 2018-03-06 11:55:21 +05:30
Akira Ajisaka 432cd74c72
HADOOP-15261. Upgrade commons-io from 2.4 to 2.5. Contributed by PandaMonkey. 2018-03-02 15:47:43 -08:00
Ray Chiang 923e1773e1 HADOOP-14652. Update metrics-core version to 3.2.4. (rchiang) 2018-03-01 15:36:10 -08:00
Haibo Chen 10663b78c8 Revert "yarn-7346.07.patch"
This reverts commit 5e37ca5bb4.
2018-02-28 21:11:36 -08:00
Haibo Chen 5e37ca5bb4 yarn-7346.07.patch 2018-02-28 21:04:54 -08:00
Steve Loughran edc9f1451b HADOOP-15263. hadoop cloud-storage module to mark hadoop-common as provided; add azure-datalake.
Contributed by Steve Loughran
2018-02-28 14:42:25 +00:00
Steve Loughran e015e00989 HADOOP-15264. AWS "shaded" SDK 1.271 is pulling in netty 4.1.17.
Contributed by Steve Loughran.

(cherry picked from commit b580196a16)
2018-02-28 13:11:07 +00:00
Steve Loughran 004b722372 HADOOP-15247. Move commons-net up to 3.6.
Contributed by Steve Loughran.
2018-02-21 10:40:42 +00:00
Rohith Sharma K S 9af30d46c6 YARN-7919. Refactor timelineservice-hbase module into submodules. Contributed by Haibo Chen. 2018-02-17 20:30:28 +05:30
Aaron Fabbri 60971b8195
HADOOP-15040 Upgrade AWS SDK to 1.11.271: NPE bug spams logs w/ Yarn Log Aggregation 2018-02-13 18:51:22 -08:00
Wangda Tan 60f9e60b3b Preparing for 3.2.0 development
Change-Id: I6d0e01f3d665d26573ef2b957add1cf0cddf7938
2018-02-11 11:17:38 +08:00
Xiao Chen 09dd709d6e HADOOP-15197. Remove tomcat from the Hadoop-auth test bundle. 2018-02-01 15:33:52 -08:00
Akira Ajisaka cdaf92c9f5
HADOOP-15177. Update the release year to 2018. Contributed by Bharat Viswanadham. 2018-01-18 13:15:57 +09:00
Steve Loughran 2e0a451a8d HADOOP-15033. Use java.util.zip.CRC32C for Java 9 and above
Contributed by Dmitry Chuyko,
2018-01-11 10:47:50 +00:00
Akira Ajisaka d2d8f4aeb3
HADOOP-15133. [JDK9] Ignore com.sun.javadoc.* and com.sun.tools.* in animal-sniffer-maven-plugin to compile with Java 9. 2017-12-21 11:58:34 +09:00
Virajith Jalaparti 352f994b64 HDFS-12665. [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb). Contributed by Ewan Higgs. 2017-12-15 17:51:40 -08:00
Sammi Chen 67b2661e3d HADOOP-15080. Aliyun OSS: update oss sdk from 2.8.1 to 2.8.3 to remove its dependency on Cat-x json-lib. 2017-12-07 22:46:11 +08:00
Wei-Chiu Chuang 3881c9ef7e HADOOP-15054. upgrade hadoop dependency on commons-codec to 1.11. 2017-11-29 08:54:49 -08:00
Akira Ajisaka 6903cf096e HADOOP-13514. Upgrade maven surefire plugin to 2.20.1
Signed-off-by: Allen Wittenauer <aw@apache.org>
2017-11-19 12:39:37 -08:00
Jian He ba7ed7b66a YARN-7384. Remove apiserver cmd and merge service cmd into application cmd. Contributed by Billie Rinaldi 2017-11-06 13:30:19 -08:00
Gour Saha 541b64c798 YARN-7165. Miscellaneous fixes in yarn-native-services. Contributed by Jian He 2017-11-06 13:30:15 -08:00
Jian He fecf22b2fd YARN-7113. Clean up packaging and dependencies for yarn-native-services. Contributed by Billie Rinaldi 2017-11-06 13:30:13 -08:00
Billie Rinaldi 40ab068eab YARN-7091. Rename application to service in yarn-native-services. Contributed by Jian He 2017-11-06 13:30:13 -08:00
Jian He f934f62fc7 YARN-5218. Initial core change for DNS for YARN. Contributed by Jonathan Maron 2017-11-06 13:28:39 -08:00
Jian He 234dba84a1 YARN-5909. Remove agent related code in slider AM. Contributed by Jian He 2017-11-06 13:28:36 -08:00
Gour Saha 09e4b9e897 YARN-5690. Integrate native services modules into maven build. Contributed by Billie Rinaldi 2017-11-06 13:28:34 -08:00
Jian He 18bf0dce28 YARN-5610. Initial code for native services REST API. Contributed by Gour Saha 2017-11-06 13:28:33 -08:00
Chris Douglas e4878a59b3 HADOOP-14992. Upgrade Avro patch version. Contributed by Bharat Viswanadham 2017-10-30 09:49:22 -07:00
Chris Douglas b50def3697 HADOOP-14986. Enforce JDK limitations. 2017-10-27 18:47:45 -07:00
Subru Krishnan 625039ef20 HADOOP-14840. Tool to estimate resource requirements of an application pipeline based on prior executions. (Rui Li via Subru). 2017-10-25 15:51:27 -07:00
Wangda Tan 4afd308b62 YARN-7170. Improve bower dependencies for YARN UI v2. (Sunil G via wangda) 2017-10-19 21:58:40 -07:00
Akira Ajisaka 0de40f0e27
Revert "HADOOP-13514. Upgrade maven surefire plugin to 2.19.1."
This reverts commit 3d04c00aed.
2017-10-13 18:00:25 +09:00
Akira Ajisaka 3d04c00aed
HADOOP-13514. Upgrade maven surefire plugin to 2.19.1. 2017-10-11 10:42:32 +09:00
Jitendra Pandey f29e55bf5e HADOOP-14910. Upgrade netty-all jar to latest 4.0.x.Final. Contributed by Vinayakumar B. 2017-10-10 11:00:07 -07:00
John Zhuge 8aca46e53f HADOOP-14651. Update okhttp version to 2.7.5. Contributed by Ray Chiang and John Zhuge. 2017-09-29 12:15:06 -07:00
Akira Ajisaka dd378775df
HADOOP-14822. hadoop-project/pom.xml is executable. Contributed by Ajay Kumar. 2017-09-27 14:25:07 +09:00
Aaron Fabbri a2b31e355a
HADOOP-14890 Move up to AWS SDK 1.11.199. Contributed by Steve Loughran. 2017-09-25 17:12:01 -07:00
Ray Chiang cde804b91f HADOOP-14903. Add json-smart explicitly to pom.xml. (rchiang) 2017-09-25 15:30:51 -07:00
Andrew Wang 8d29bf57ca Revert "HADOOP-14655. Update httpcore version to 4.4.6. (rchiang)"
This reverts commit 088a18b44d.
2017-09-22 14:43:44 -07:00
Andrew Wang 3cf3540f19 HADOOP-14835. mvn site build throws SAX errors. Contributed by Andrew Wang and Sean Mackrory. 2017-09-18 15:13:42 -07:00
Kai Zheng 08b98149e1 HADOOP-14869. Upgrade Apache Kerby version to v1.0.1. Contributed by Wei Zhou 2017-09-15 19:49:58 +08:00
Aaron Fabbri 49467165a5
HADOOP-14738 Remove S3N and obsolete bits of S3A; rework docs. Contributed by Steve Loughran. 2017-09-14 14:10:48 -07:00
Steve Loughran b9465bb876
Revert "HADOOP-14654. Update httpclient version to 4.5.3. (rchiang)"
This reverts commit 1118ca9b07.
2017-09-14 13:31:30 +01:00
Ray Chiang f1d751bd05 HADOOP-14797. Update re2j version to 1.1. (rchiang) 2017-09-12 11:35:21 -07:00
Ray Chiang a6432ba5a1 HADOOP-14653. Update joda-time version to 2.9.9. (rchiang) 2017-09-12 11:12:44 -07:00
Ray Chiang 39818259c3 HADOOP-14648. Bump commons-configuration2 to 2.1.1. (rchiang) 2017-09-12 10:53:48 -07:00
Ray Chiang af45cd1be6 HADOOP-14796. Update json-simple version to 1.1.1. (rchiang) 2017-09-12 10:36:04 -07:00
Ray Chiang 556812c179 HADOOP-14799. Update nimbus-jose-jwt to 4.41.1. (rchiang) 2017-09-12 10:19:34 -07:00
Ray Chiang ad74691807 HADOOP-14798. Update sshd-core and related mina-core library versions. (rchiang) 2017-09-12 10:04:22 -07:00
Ray Chiang 088a18b44d HADOOP-14655. Update httpcore version to 4.4.6. (rchiang) 2017-09-11 13:54:40 -07:00
Ray Chiang 1118ca9b07 HADOOP-14654. Update httpclient version to 4.5.3. (rchiang) 2017-09-11 13:33:42 -07:00
Andrew Wang 0d419c984f Preparing for 3.1.0 development 2017-09-01 11:53:48 -07:00
Steve Loughran 621b43e254
HADOOP-13345 HS3Guard: Improved Consistency for S3A.
Contributed by: Chris Nauroth, Aaron Fabbri, Mingliang Liu, Lei (Eddy) Xu,
Sean Mackrory, Steve Loughran and others.
2017-09-01 14:13:41 +01:00
Ray Chiang 26d8c8fa58 HADOOP-14649. Update aliyun-sdk-oss version to 2.8.1. (Genmao Yu via rchiang) 2017-08-23 15:22:24 -07:00
Subru Krishnan 18f3603bce YARN-6996. Change javax.cache library implementation from JSR107 to Apache Geronimo. (Ray Chiang via Subru). 2017-08-14 11:10:00 -07:00
Lei Xu ce797a1706 HDFS-12221. Replace xcerces in XmlEditsVisitor. (Ajay Kumar via lei) 2017-08-14 10:27:47 -07:00