Commit Graph

376 Commits

Author SHA1 Message Date
Wangda Tan 26e87be3f2 YARN-7056. [Partial backport] Document Resource Profiles feature. (Sunil G via wangda)
Change-Id: I5f5d52cdf7aba4ac09684aab573e6916dbad183e
(cherry picked from commit 6b88cd1901)
2019-08-29 17:02:47 -07:00
Sneha Vijayarajan f56972bfe1 HADOOP-16460: ABFS: fix for Sever Name Indication (SNI)
Contributed by Sneha Vijayarajan <snvijaya@microsoft.com>
2019-08-28 22:42:28 +00:00
Takanobu Asanuma e3d4f6bfed HADOOP-16331. Fix ASF License check in pom.xml. Contributed by Akira Ajisaka.
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
2019-05-29 17:41:21 +09:00
Akira Ajisaka cea1b0000c
HADOOP-16323. https everywhere in Maven settings. 2019-05-27 15:28:54 +09:00
Thomas Marquardt 92e37a0b73 HADOOP-15669. ABFS: Improve HTTPS Performance.
Contributed by Vishwajeet Dusane.
2019-04-24 21:46:25 +00:00
Steve Loughran 1b64b0f924 HADOOP-15407. HADOOP-15540. Support Windows Azure Storage - Blob file system "ABFS" in Hadoop: Core Commit.
Contributed by Shane Mainali, Thomas Marquardt, Zichen Sun, Georgi Chalakov, Esfandiar Manii, Amit Singh, Dana Kaban, Da Zhou, Junhua Gu, Saher Ahwal, Saurabh Pant, James Baker, Shaoyu Zhang, Lawrence Chen, Kevin Chen and Steve Loughran
2019-04-24 21:46:25 +00:00
Akira Ajisaka 6485b89133
HADOOP-16089. AliyunOSS: update oss-sdk version to 3.4.1. Contributed by wujinhu.
(cherry picked from commit 0f9aa5b4d5)
2019-02-04 14:48:40 +09:00
Akira Ajisaka 7bca49c0d2
HADOOP-16055. Upgrade AWS SDK to 1.11.271 in branch-2. 2019-01-25 21:09:51 +09:00
Sunil G 2c4e4937bd
Revert "HADOOP-15759. AliyunOSS: Update oss-sdk version to 3.0.0. Contributed by Jinhu Wu."
This reverts commit e4fca6aae4.

Revert "HADOOP-15671. AliyunOSS: Support Assume Roles in AliyunOSS. Contributed by Jinhu Wu."

This reverts commit 2b635125fb.

(cherry picked from commit 1f425271a7)
2019-01-05 17:51:02 +09:00
Ayush Saxena f804d7d3de
HADOOP-16025. Update the year to 2019.
Contributed by Ayush Saxena.
2019-01-02 22:27:03 +00:00
Akira Ajisaka c157ab49c0
HADOOP-16009. Replace the url of the repository in Apache Hadoop source code.
(cherry picked from commit eee29ed706)
2018-12-31 06:32:31 +09:00
Sammi Chen f6ab07e28c HADOOP-15759. AliyunOSS: Update oss-sdk version to 3.0.0. Contributed by Jinhu Wu.
(cherry picked from commit e4fca6aae4)
(cherry picked from commit 53528d5ec5)
(cherry picked from commit 61847f4ea0)
2018-09-18 20:18:15 +08:00
Steve Loughran 0b5d0c3740 HADOOP-15506. Upgrade Azure Storage Sdk version to 7.0.0 and update corresponding code blocks.
Contributed by Esfandiar Manii.

(cherry picked from commit d901be6795)
(cherry picked from commit baac7c2b28)
(cherry picked from commit df338f2e1a)
2018-06-11 15:34:54 -07:00
Steve Loughran e5351608ca HADOOP-14651. Update okhttp version to 2.7.5.
Contributed by Ray Chiang and John Zhuge.
2018-04-04 15:16:20 +01:00
Arpit Agarwal fe4fe23f83 HADOOP-15334. Upgrade Maven surefire plugin. Contributed by Arpit Agarwal. 2018-03-22 10:51:56 -07:00
weiy 4aa34324b2 HDFS-13215. RBF: Move Router to its own module. 2018-03-19 23:23:16 -07:00
Rohith Sharma K S 207daabbcc YARN-8003. Backport the code structure changes in YARN-7346 to branch-2. Contributed by Haibo Chen. 2018-03-07 13:25:28 +05:30
Chris Douglas 762125b864 Backport HADOOP-13514 (surefire upgrade) to branch-2 2018-02-26 16:32:06 -08:00
Brahma Reddy Battula 7307a89ec1 HADOOP-14903. Add json-smart explicitly to pom.xml. Contributed by Brahma Reddy Battula and Ray Chiang 2018-02-22 18:52:48 +05:30
Ray Chiang eeb731307f HADOOP-14799. Update nimbus-jose-jwt to 4.41.1. (rchiang)
(cherry picked from commit 556812c179)
2018-02-22 18:08:52 +05:30
Rohith Sharma K S da0660ec84 YARN-7919. Refactor timelineservice-hbase module into submodules. Contributed by Haibo Chen. 2018-02-18 13:26:10 +05:30
Kihwal Lee 56b950d777 Revert "HADOOP-14799. Update nimbus-jose-jwt to 4.41.1. (rchiang)"
This reverts commit 577a267198.
2018-02-14 15:20:45 -06:00
Ray Chiang 577a267198 HADOOP-14799. Update nimbus-jose-jwt to 4.41.1. (rchiang)
(cherry picked from commit 556812c179)
2018-02-14 00:07:09 +05:30
Akira Ajisaka b0c9b89281
HADOOP-15177. Update the release year to 2018. Contributed by Bharat Viswanadham.
(cherry picked from commit cdaf92c9f5)
2018-01-18 13:17:07 +09:00
Sammi Chen c225ac3f8f HADOOP-15080. Aliyun OSS: update oss sdk from 2.8.1 to 2.8.3 to remove its dependency on Cat-x json-lib.
(cherry picked from commit 67b2661e3d)
2017-12-07 14:15:21 -07:00
Kai Zheng 30ab9b6aef HADOOP-14964. AliyunOSS: backport Aliyun OSS module to branch-2. Contributed by Sammi Chen
The consolidated commits in this backport are as follows:
    HADOOP-14787. AliyunOSS: Implement the `createNonRecursive` operator.
    HADOOP-14649. Update aliyun-sdk-oss version to 2.8.1. (Genmao Yu via rchiang)
    HADOOP-14194. Aliyun OSS should not use empty endpoint as default. Contributed by Genmao Yu
    HADOOP-14466. Remove useless document from TestAliyunOSSFileSystemContract.java. Contributed by Chen Liang.
    HADOOP-14458. Add missing imports to TestAliyunOSSFileSystemContract.java. Contributed by Mingliang Liu.
    HADOOP-14192. AliyunOSS FileSystem contract test should implement getTestBaseDir(). Contributed by Mingliang Liu
    HADOOP-14072. AliyunOSS: Failed to read from stream when seek beyond the download size. Contributed by Genmao Yu
    HADOOP-13769. AliyunOSS: update oss sdk version. Contributed by Genmao Yu
    HADOOP-14069. AliyunOSS: listStatus returns wrong file info. Contributed by Fei Hui
    HADOOP-13768. AliyunOSS: handle the failure in the batch delete operation `deleteDirs`. Contributed by Genmao Yu
    HADOOP-14065. AliyunOSS: oss directory filestatus should use meta time. Contributed by Fei Hui
    HADOOP-14045. Aliyun OSS documentation missing from website. Contributed by Yiqun Lin.
    HADOOP-13723. AliyunOSSInputStream#read() should update read bytes stat correctly. Contributed by Mingliang Liu
    HADOOP-13624.  Rename TestAliyunOSSContractDispCp. Contributed by Genmao Yu
    HADOOP-13591. Unit test failure in TestOSSContractGetFileStatus and TestOSSContractRootDir. Contributed by Genmao Yu
    HADOOP-13481. User documents for Aliyun OSS FileSystem. Contributed by Genmao Yu.
    HADOOP-12756. Incorporate Aliyun OSS file system implementation. Contributed by Mingfei Shi and Lin Zhou
2017-11-13 09:29:33 +08:00
Arun Suresh 71a55bebfb Preparing for 2.10.0 development 2017-10-31 12:51:14 -07:00
Chris Douglas 2afb8ba14f HADOOP-14992. Upgrade Avro patch version. Contributed by Bharat Viswanadham
(cherry picked from commit e4878a59b3)
(cherry picked from commit 85be67ebe4)
2017-10-30 09:49:49 -07:00
Chris Douglas 9e721775a4 HADOOP-14986. Enforce JDK limitations.
(cherry picked from commit b50def3697)
(cherry picked from commit 1660a638f0)
2017-10-27 21:42:42 -07:00
Subru Krishnan 9897538a96 HADOOP-14840. Tool to estimate resource requirements of an application pipeline based on prior executions. (Rui Li via Subru).
(cherry picked from commit 625039ef20)
2017-10-26 19:14:24 -07:00
Akira Ajisaka 13f1a7e0ed
Revert "HADOOP-14840. Tool to estimate resource requirements of an application pipeline based on prior executions. (Rui Li via Subru)."
This reverts commit da7f989d86.
2017-10-26 15:33:53 +09:00
Subru Krishnan da7f989d86 HADOOP-14840. Tool to estimate resource requirements of an application pipeline based on prior executions. (Rui Li via Subru).
(cherry picked from commit 625039ef20)
2017-10-25 17:05:35 -07:00
Yiqun Lin 3d36f75f23 HDFS-12695. Add a link to HDFS router federation document in site.xml. Contributed by Yiqun Lin.
(cherry picked from commit b90750cfb8)
2017-10-24 10:50:39 +08:00
Wangda Tan bc2326f5f0 YARN-7170. Improve bower dependencies for YARN UI v2. (Sunil G via wangda) 2017-10-19 22:20:36 -07:00
vrushali 17213a0d27 Updating to use maven 3.3 2017-10-18 02:06:49 +05:30
Varun Saxena 78a6ecccb3 Addendum for YARN-4753. Use doxia macro to generate in-page TOC of YARN site documentation 2017-10-17 23:36:40 +05:30
Varun Saxena 82de1fd84a YARN-6707. [ATSv2] Update HBase version to 1.2.6 (Vrushali C via Varun Saxena)
(cherry picked from commit e86eef9812)

Conflicts:
	hadoop-project/pom.xml
2017-10-17 23:36:38 +05:30
Sangjin Lee a16a684fbb YARN-5928. Move ATSv2 HBase backend code into a new module that is only dependent at runtime by yarn servers. Contributed by Haibo Chen.
(cherry picked from commit b92089c0e8ab1b87b8b5b55b1e3d4367ae5d847a)
2017-10-17 23:36:36 +05:30
Sangjin Lee 6aa7510681 YARN-5976. Update hbase version to 1.2. Contributed by Vrushali C.
(cherry picked from commit f945008d1cf5730bdebeae501ed0e42477ad219e)
2017-10-17 23:36:35 +05:30
Sangjin Lee e212e562ec YARN-5355. Backported YARN-2928 into our branch-2 feature branch. 2017-10-17 23:36:33 +05:30
Chris Trezzo 3e7c06af41 MAPREDUCE-5951. Add support for the YARN Shared Cache.
(cherry picked from commit e46d5bb962)
2017-10-12 11:30:38 -07:00
Chris Trezzo d12cea2098 YARN-2960. Add documentation for the YARN shared cache.
(cherry picked from commit 7e76f85bc6)
2017-10-05 11:23:24 -07:00
Steve Loughran a1afc6aa59
HADOOP-13345 S3Guard: Improved Consistency for S3A.
Contributed by: Chris Nauroth, Aaron Fabbri, Mingliang Liu, Lei (Eddy) Xu,
Sean Mackrory, Steve Loughran and others.

(cherry-picked from/based on commit 621b43e254)
2017-09-29 11:29:22 +01:00
Akira Ajisaka 61f41b071d
HADOOP-14822. hadoop-project/pom.xml is executable. Contributed by Ajay Kumar.
(cherry picked from commit dd378775df)
2017-09-27 14:27:13 +09:00
Steve Loughran 27a41848ac
HADOOP-14890 Move up to AWS SDK 1.11.199.
Contributed by Steve Loughran.
2017-09-26 20:11:10 +01:00
Subru Krishnan 9ad067efe9 YARN-6996. Change javax.cache library implementation from JSR107 to Apache Geronimo. (Ray Chiang via Subru).
(cherry picked from commit 18f3603bce)
2017-09-21 18:09:16 -07:00
Subru Krishnan 049f7c84a1 YARN-6866. Minor clean-up and fixes in anticipation of YARN-2915 merge with trunk. (Botong Huang via Subru).
(cherry picked from commit 40453879ec)
(cherry picked from commit 86f05c3312)
2017-09-21 16:55:43 -07:00
Subru Krishnan 7dd6caff9e YARN-6484. Documenting the YARN Federation feature. (Carlo Curino via Subru).
(cherry picked from commit 749ca890e6)
(cherry picked from commit d6c29b2f5b)
2017-09-21 16:49:54 -07:00
Subru Krishnan dc0a2e6c59 YARN-5411. Create a proxy chain for ApplicationClientProtocol in the Router. (Giovanni Matteo Fumarola via Subru).
(cherry picked from commit 4846069061)
(cherry picked from commit 80e1904000)
2017-09-21 16:43:08 -07:00
Carlo Curino 3c5dfa0fe5 YARN-3663. Federation State and Policy Store (DBMS implementation). (Giovanni Matteo Fumarola via curino).
(cherry picked from commit be99c1fe2e)
(cherry picked from commit 5272af8c7e)
2017-09-21 16:33:31 -07:00