Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
14,784 Commits 326 Branches 371 Tags
Commit Graph

372 Commits

Author SHA1 Message Date
Thomas Marquardt
92e37a0b73 HADOOP-15669. ABFS: Improve HTTPS Performance. 
Contributed by Vishwajeet Dusane.
 2019-04-24 21:46:25 +00:00
Steve Loughran
1b64b0f924 HADOOP-15407. HADOOP-15540. Support Windows Azure Storage - Blob file system "ABFS" in Hadoop: Core Commit. 
Contributed by Shane Mainali, Thomas Marquardt, Zichen Sun, Georgi Chalakov, Esfandiar Manii, Amit Singh, Dana Kaban, Da Zhou, Junhua Gu, Saher Ahwal, Saurabh Pant, James Baker, Shaoyu Zhang, Lawrence Chen, Kevin Chen and Steve Loughran
 2019-04-24 21:46:25 +00:00
Akira Ajisaka
6485b89133
HADOOP-16089. AliyunOSS: update oss-sdk version to 3.4.1. Contributed by wujinhu. 
(cherry picked from commit 0f9aa5b4d58e34653f42e98a244aaf1c806b37cf)
 2019-02-04 14:48:40 +09:00
Akira Ajisaka
7bca49c0d2
HADOOP-16055. Upgrade AWS SDK to 1.11.271 in branch-2. 2019-01-25 21:09:51 +09:00
Sunil G
2c4e4937bd
Revert "HADOOP-15759. AliyunOSS: Update oss-sdk version to 3.0.0. Contributed by Jinhu Wu." 
This reverts commit e4fca6aae46a3c04fc56897986a4ab4e5aa98503.

Revert "HADOOP-15671. AliyunOSS: Support Assume Roles in AliyunOSS. Contributed by Jinhu Wu."

This reverts commit 2b635125fb059fc204ed35bc0e264c42dd3a9fe9.

(cherry picked from commit 1f425271a73fff1fdbe3fbfdb71e906fd1ac0574)
 2019-01-05 17:51:02 +09:00
Ayush Saxena
f804d7d3de
HADOOP-16025. Update the year to 2019. 
Contributed by Ayush Saxena.
 2019-01-02 22:27:03 +00:00
Akira Ajisaka
c157ab49c0
HADOOP-16009. Replace the url of the repository in Apache Hadoop source code. 
(cherry picked from commit eee29ed7066e9401c7530b8b6f3b221bacef9a8a)
 2018-12-31 06:32:31 +09:00
Sammi Chen
f6ab07e28c HADOOP-15759. AliyunOSS: Update oss-sdk version to 3.0.0. Contributed by Jinhu Wu. 
(cherry picked from commit e4fca6aae46a3c04fc56897986a4ab4e5aa98503)
(cherry picked from commit 53528d5ec5ab812484e2d5a6622d58ba8c86a5b0)
(cherry picked from commit 61847f4ea07d7c7698b0658e097a9937db700b56)
 2018-09-18 20:18:15 +08:00
Steve Loughran
0b5d0c3740 HADOOP-15506. Upgrade Azure Storage Sdk version to 7.0.0 and update corresponding code blocks. 
Contributed by Esfandiar Manii.

(cherry picked from commit d901be679554eb6b323f3bc6e8de267d85dd2e06)
(cherry picked from commit baac7c2b285454d71d0371505fb7a3403a548176)
(cherry picked from commit df338f2e1a19ed9c0c5c13f7d4aad08f9836de9f)
 2018-06-11 15:34:54 -07:00
Steve Loughran
e5351608ca HADOOP-14651. Update okhttp version to 2.7.5. 
Contributed by Ray Chiang and John Zhuge.
 2018-04-04 15:16:20 +01:00
Arpit Agarwal
fe4fe23f83 HADOOP-15334. Upgrade Maven surefire plugin. Contributed by Arpit Agarwal. 2018-03-22 10:51:56 -07:00
weiy
4aa34324b2 HDFS-13215. RBF: Move Router to its own module. 2018-03-19 23:23:16 -07:00
Rohith Sharma K S
207daabbcc YARN-8003. Backport the code structure changes in YARN-7346 to branch-2. Contributed by Haibo Chen. 2018-03-07 13:25:28 +05:30
Chris Douglas
762125b864 Backport HADOOP-13514 (surefire upgrade) to branch-2 2018-02-26 16:32:06 -08:00
Brahma Reddy Battula
7307a89ec1 HADOOP-14903. Add json-smart explicitly to pom.xml. Contributed by Brahma Reddy Battula and Ray Chiang 2018-02-22 18:52:48 +05:30
Ray Chiang
eeb731307f HADOOP-14799. Update nimbus-jose-jwt to 4.41.1. (rchiang) 
(cherry picked from commit 556812c179aa094c21acf610439a8d69fe6420ab)
 2018-02-22 18:08:52 +05:30
Rohith Sharma K S
da0660ec84 YARN-7919. Refactor timelineservice-hbase module into submodules. Contributed by Haibo Chen. 2018-02-18 13:26:10 +05:30
Kihwal Lee
56b950d777 Revert "HADOOP-14799. Update nimbus-jose-jwt to 4.41.1. (rchiang)" 
This reverts commit 577a267198b1d745eee85d1ad9af64d4506bbd0a.
 2018-02-14 15:20:45 -06:00
Ray Chiang
577a267198 HADOOP-14799. Update nimbus-jose-jwt to 4.41.1. (rchiang) 
(cherry picked from commit 556812c179aa094c21acf610439a8d69fe6420ab)
 2018-02-14 00:07:09 +05:30
Akira Ajisaka
b0c9b89281
HADOOP-15177. Update the release year to 2018. Contributed by Bharat Viswanadham. 
(cherry picked from commit cdaf92c9f57560219b8f915a19ad8603ddf2a505)
 2018-01-18 13:17:07 +09:00
Sammi Chen
c225ac3f8f HADOOP-15080. Aliyun OSS: update oss sdk from 2.8.1 to 2.8.3 to remove its dependency on Cat-x json-lib. 
(cherry picked from commit 67b2661e3d73a68ba7ca73b112bf6baea128631e)
 2017-12-07 14:15:21 -07:00
Kai Zheng
30ab9b6aef HADOOP-14964. AliyunOSS: backport Aliyun OSS module to branch-2. Contributed by Sammi Chen 
The consolidated commits in this backport are as follows:
    HADOOP-14787. AliyunOSS: Implement the `createNonRecursive` operator.
    HADOOP-14649. Update aliyun-sdk-oss version to 2.8.1. (Genmao Yu via rchiang)
    HADOOP-14194. Aliyun OSS should not use empty endpoint as default. Contributed by Genmao Yu
    HADOOP-14466. Remove useless document from TestAliyunOSSFileSystemContract.java. Contributed by Chen Liang.
    HADOOP-14458. Add missing imports to TestAliyunOSSFileSystemContract.java. Contributed by Mingliang Liu.
    HADOOP-14192. AliyunOSS FileSystem contract test should implement getTestBaseDir(). Contributed by Mingliang Liu
    HADOOP-14072. AliyunOSS: Failed to read from stream when seek beyond the download size. Contributed by Genmao Yu
    HADOOP-13769. AliyunOSS: update oss sdk version. Contributed by Genmao Yu
    HADOOP-14069. AliyunOSS: listStatus returns wrong file info. Contributed by Fei Hui
    HADOOP-13768. AliyunOSS: handle the failure in the batch delete operation `deleteDirs`. Contributed by Genmao Yu
    HADOOP-14065. AliyunOSS: oss directory filestatus should use meta time. Contributed by Fei Hui
    HADOOP-14045. Aliyun OSS documentation missing from website. Contributed by Yiqun Lin.
    HADOOP-13723. AliyunOSSInputStream#read() should update read bytes stat correctly. Contributed by Mingliang Liu
    HADOOP-13624.  Rename TestAliyunOSSContractDispCp. Contributed by Genmao Yu
    HADOOP-13591. Unit test failure in TestOSSContractGetFileStatus and TestOSSContractRootDir. Contributed by Genmao Yu
    HADOOP-13481. User documents for Aliyun OSS FileSystem. Contributed by Genmao Yu.
    HADOOP-12756. Incorporate Aliyun OSS file system implementation. Contributed by Mingfei Shi and Lin Zhou
 2017-11-13 09:29:33 +08:00
Arun Suresh
71a55bebfb Preparing for 2.10.0 development 2017-10-31 12:51:14 -07:00
Chris Douglas
2afb8ba14f HADOOP-14992. Upgrade Avro patch version. Contributed by Bharat Viswanadham 
(cherry picked from commit e4878a59b3a380e323bb4627a69266bbf2524b36)
(cherry picked from commit 85be67ebe46b0d14e2689fecf4d56374c3a084be)
 2017-10-30 09:49:49 -07:00
Chris Douglas
9e721775a4 HADOOP-14986. Enforce JDK limitations. 
(cherry picked from commit b50def36970e0afa65bd3fd3f40d8c4f81119200)
(cherry picked from commit 1660a638f04435ca363fe4f07c7f03f109a6784a)
 2017-10-27 21:42:42 -07:00
Subru Krishnan
9897538a96 HADOOP-14840. Tool to estimate resource requirements of an application pipeline based on prior executions. (Rui Li via Subru). 
(cherry picked from commit 625039ef20e6011ab360131d70582a6e4bf2ec1d)
 2017-10-26 19:14:24 -07:00
Akira Ajisaka
13f1a7e0ed
Revert "HADOOP-14840. Tool to estimate resource requirements of an application pipeline based on prior executions. (Rui Li via Subru)." 
This reverts commit da7f989d86d28ee6f4a7ac410fc8a4a163e11012.
 2017-10-26 15:33:53 +09:00
Subru Krishnan
da7f989d86 HADOOP-14840. Tool to estimate resource requirements of an application pipeline based on prior executions. (Rui Li via Subru). 
(cherry picked from commit 625039ef20e6011ab360131d70582a6e4bf2ec1d)
 2017-10-25 17:05:35 -07:00
Yiqun Lin
3d36f75f23 HDFS-12695. Add a link to HDFS router federation document in site.xml. Contributed by Yiqun Lin. 
(cherry picked from commit b90750cfb8887fecbd83caff3800455b4f911339)
 2017-10-24 10:50:39 +08:00
Wangda Tan
bc2326f5f0 YARN-7170. Improve bower dependencies for YARN UI v2. (Sunil G via wangda) 2017-10-19 22:20:36 -07:00
vrushali
17213a0d27 Updating to use maven 3.3 2017-10-18 02:06:49 +05:30
Varun Saxena
78a6ecccb3 Addendum for YARN-4753. Use doxia macro to generate in-page TOC of YARN site documentation 2017-10-17 23:36:40 +05:30
Varun Saxena
82de1fd84a YARN-6707. [ATSv2] Update HBase version to 1.2.6 (Vrushali C via Varun Saxena) 
(cherry picked from commit e86eef9812d055f8689646b0f521f80cfc0c6399)

Conflicts:
	hadoop-project/pom.xml
 2017-10-17 23:36:38 +05:30
Sangjin Lee
a16a684fbb YARN-5928. Move ATSv2 HBase backend code into a new module that is only dependent at runtime by yarn servers. Contributed by Haibo Chen. 
(cherry picked from commit b92089c0e8ab1b87b8b5b55b1e3d4367ae5d847a)
 2017-10-17 23:36:36 +05:30
Sangjin Lee
6aa7510681 YARN-5976. Update hbase version to 1.2. Contributed by Vrushali C. 
(cherry picked from commit f945008d1cf5730bdebeae501ed0e42477ad219e)
 2017-10-17 23:36:35 +05:30
Sangjin Lee
e212e562ec YARN-5355. Backported YARN-2928 into our branch-2 feature branch. 2017-10-17 23:36:33 +05:30
Chris Trezzo
3e7c06af41 MAPREDUCE-5951. Add support for the YARN Shared Cache. 
(cherry picked from commit e46d5bb962b0c942f993afc505b165b1cd96e51b)
 2017-10-12 11:30:38 -07:00
Chris Trezzo
d12cea2098 YARN-2960. Add documentation for the YARN shared cache. 
(cherry picked from commit 7e76f85bc68166b01b51fcf6ba4b3fd9281d4a03)
 2017-10-05 11:23:24 -07:00
Steve Loughran
a1afc6aa59
HADOOP-13345 S3Guard: Improved Consistency for S3A. 
Contributed by: Chris Nauroth, Aaron Fabbri, Mingliang Liu, Lei (Eddy) Xu,
Sean Mackrory, Steve Loughran and others.

(cherry-picked from/based on commit 621b43e254afaff708cd6fc4698b29628f6abc33)
 2017-09-29 11:29:22 +01:00
Akira Ajisaka
61f41b071d
HADOOP-14822. hadoop-project/pom.xml is executable. Contributed by Ajay Kumar. 
(cherry picked from commit dd378775df5bd79e23c12120535404c4ca0fb386)
 2017-09-27 14:27:13 +09:00
Steve Loughran
27a41848ac
HADOOP-14890 Move up to AWS SDK 1.11.199. 
Contributed by Steve Loughran.
 2017-09-26 20:11:10 +01:00
Subru Krishnan
9ad067efe9 YARN-6996. Change javax.cache library implementation from JSR107 to Apache Geronimo. (Ray Chiang via Subru). 
(cherry picked from commit 18f3603bce37e0e07c9075811b1179afc2c227eb)
 2017-09-21 18:09:16 -07:00
Subru Krishnan
049f7c84a1 YARN-6866. Minor clean-up and fixes in anticipation of YARN-2915 merge with trunk. (Botong Huang via Subru). 
(cherry picked from commit 40453879ec860819b080ccc82454480a436c0adc)
(cherry picked from commit 86f05c33125af3b435d6793551680ffa35047aa7)
 2017-09-21 16:55:43 -07:00
Subru Krishnan
7dd6caff9e YARN-6484. Documenting the YARN Federation feature. (Carlo Curino via Subru). 
(cherry picked from commit 749ca890e6e62671b4df69d020396ec93edadf16)
(cherry picked from commit d6c29b2f5b953a0b747887cfc9cf4290f0402b1e)
 2017-09-21 16:49:54 -07:00
Subru Krishnan
dc0a2e6c59 YARN-5411. Create a proxy chain for ApplicationClientProtocol in the Router. (Giovanni Matteo Fumarola via Subru). 
(cherry picked from commit 4846069061b6baa06da3b524b9e36567dd368388)
(cherry picked from commit 80e1904000923819c98ae68456cb0452c255d5f3)
 2017-09-21 16:43:08 -07:00
Carlo Curino
3c5dfa0fe5 YARN-3663. Federation State and Policy Store (DBMS implementation). (Giovanni Matteo Fumarola via curino). 
(cherry picked from commit be99c1fe2eb150fabd69902118d65941f82971f6)
(cherry picked from commit 5272af8c7eab76d779c621eb0208bf29ffa25613)
 2017-09-21 16:33:31 -07:00
Subru Krishnan
2dca88b924 YARN-5410. Bootstrap Router server module. (Giovanni Matteo Fumarola via Subru). 
(cherry picked from commit 04f111394b08de7d16a86f8025221f6f5e0dbcc5)
(cherry picked from commit 193ec456d624a99c0d1aafb53bdd64fc29edef71)
 2017-09-21 16:25:02 -07:00
Jian He
fb3f9b48fb YARN-3674. Create Facade for Federation State and Policy Store. Contributed by Subru Krishnan 
(cherry picked from commit 5e976cd2b90ccf1bccb6039edf14140677804c4e)
(cherry picked from commit 5c843823972d030555e25729ae7b4b8fbafb59fd)
 2017-09-21 16:12:34 -07:00
Ming Ma
3bb23f4be9 HDFS-11035. Better documentation for maintenace mode and upgrade domain. 
(cherry picked from commit ce943eb17a4218d8ac1f5293c6726122371d8442)
 2017-09-20 09:42:22 -07:00
Steve Loughran
b30522c59e
HADOOP-14662. Update azure-storage sdk to version 5.4.0. 
Contributed by Thomas Marquard
 2017-08-15 16:27:31 +01:00