Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
20,534 Commits 326 Branches 371 Tags
Commit Graph

20534 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Jason Lowe
7a78bdf7bb MAPREDUCE-7164. FileOutputCommitter does not report progress while merging paths. Contributed by Kuhu Shukla 
(cherry picked from commit 4d8de7ab690ef919b392b12d856482a6a1f2bb3d)
 2018-11-28 15:54:59 -06:00
Jason Lowe
df0e7766e4 YARN-8812. Containers fail during creating a symlink which started with hyphen for a resource file. Contributed by Oleksandr Shevchenko 
(cherry picked from commit 3ce99e32f7d7887412cae8337cd4ebeb3b2ee308)
 2018-11-28 08:50:18 -06:00
Eric Yang
db8b2a130c YARN-9056. Improved YARN service upgrade state logic for readiness check. 
Contributed by Chandni Singh

(cherry picked from commit f657a2a661ed7470915fa33ea4bbda2f4980c8b2)
 2018-11-27 19:45:23 -05:00
Steve Loughran
fa1d4ba7d4
HADOOP-15932. Oozie unable to create sharelib in s3a filesystem. 
Contributed by Steve Loughran.

(cherry picked from commit 4c106fca0ca91536e288f11052568406a0b84300)
 2018-11-27 20:40:48 +00:00
Eric Yang
838190482d YARN-8986. Added port publish for Docker container running with bridge. 
Contributed by Charo Zhang
 2018-11-27 14:27:13 -05:00
Da Zhou
1a3a4960d9
HADOOP-15940. ABFS: For HNS account, avoid unnecessary get call when doing Rename. 
Contributed by Da Zhou <da.zhou@microsoft.com>
 2018-11-27 18:11:30 +00:00
Akira Ajisaka
2e6b9b174e
MAPREDUCE-7162. TestEvents#testEvents fails. Contributed by Zhaohui Xin. 
(cherry picked from commit 1aad99a71813660b83628cacfed393d0b3a123cc)
 2018-11-27 20:02:11 +09:00
Eric Yang
f089796251 HADOOP-15922. Fixed doAsUser decoding for DelegationTokenAuthenticationFilter. 
Contributed by He Xiaoqiao

(cherry picked from commit a9d96948ede11d4d8a8fb58b31b150af84e118d9)
 2018-11-26 13:52:42 -05:00
Vinayakumar B
538757ed49 HDFS-13816. dfs.getQuotaUsage() throws NPE on non-existent dir instead of FileNotFoundException. Contributed by Vinayakumar B. 
(cherry picked from commit b09828145432c8d986ac8f05ec33608d8e611328)
 2018-11-26 18:23:09 +05:30
Vinayakumar B
1b937d701d HADOOP-15948. Inconsistency in get and put syntax if filename/dirname contains space. Contributed by Ayush Saxena. 
(cherry picked from commit 23b441c2253bcb3be5229d3c5eb1e165369070c0)
 2018-11-26 18:13:09 +05:30
Da Zhou
f5d2806c81
HADOOP-15872. ABFS: Update to target 2018-11-09 REST version for ADLS Gen 2. 
Contributed by Junhua Gu and Da Zhou.

(cherry picked from commit a8302e398c2ca4b0deff062c0e921053351b688e)
 2018-11-23 14:19:36 +00:00
Weiwei Yang
fea9d37ad5 HADOOP-15943. AliyunOSS: add missing owner & group attributes for oss FileStatus. Contributed by wujinhu. 
(cherry picked from commit 5ff0cf86a940fd83f1425794921cc075b19f1108)
 2018-11-23 14:10:30 +08:00
Weiwei Yang
01477108d9 YARN-8984. AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or empty. Contributed by Yang Wang. 
(cherry picked from commit 176bb3f812e49b0fe3abddf54eebfc7219b5d718)
 2018-11-22 17:04:16 +08:00
Brahma Reddy Battula
7e10dd03b5 HDFS-14064. WEBHDFS: Support Enable/Disable EC Policy. Contributed by Ayush Saxena. 
(cherry picked from commit 15d8f592b51d08a658e88c6a7a7596e0edf5793b)
 2018-11-22 00:07:38 +05:30
Akira Ajisaka
f6227367fb
Add 2.9.2 release notes and changes documents. 
(cherry picked from commit 1a00b4e325146988375c9ce5b11016c45f059a4e)
 2018-11-20 14:25:48 +09:00
Wangda Tan
34387599c4 YARN-8960. [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment. (Zac Zhou via wangda) 
Change-Id: I21b1addc9c32817650ea744a8f2e6b5602f2f4d4
(cherry picked from commit 8b2381441558cd49b4c940b0760c8accbb2a5567)
 2018-11-19 09:01:21 -08:00
Weiwei Yang
0b2cfc8ab8 HADOOP-15919. AliyunOSS: Enable Yarn to use OSS. Contributed by wujinhu. 
(cherry picked from commit be0708c6eb3c759e43639e0f8df7c9910308fb97)
 2018-11-19 14:21:38 +08:00
Weiwei Yang
650581a19d YARN-8833. Avoid potential integer overflow when computing fair shares. Contributed by liyakun. 
(cherry picked from commit d027a24f0349b60efa5125c330058f123771748f)
 2018-11-18 23:23:09 +08:00
Wangda Tan
bee5bf867b YARN-9001. [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs. (Zac Zhou via wangda) 
Change-Id: I7e8d1c27ebd37e0907ca570c4f3d56fe7a859635
 2018-11-16 10:26:50 -08:00
Weiwei Yang
f5e1bad0f3 HDFS-14063. Support noredirect param for CREATE/APPEND/OPEN/GETFILECHECKSUM in HttpFS. Contributed by Íñigo Goiri. 
(cherry picked from commit ad5256e44dffba2e9994f2db27d9ae71eab690e8)
 2018-11-17 01:16:23 +08:00
Rohith Sharma K S
13e3670e7f YARN-8303. YarnClient should contact TimelineReader for application/attempt/container report. 
(cherry picked from commit ee3355be3cd1cd956296a1b79b264177ff139ce6)
 2018-11-16 18:37:20 +05:30
Vrushali C
da05328824 YARN-8834 Provide Java client for fetching Yarn specific entities from TimelineReader. Contributed by Abhishek Modi 
(cherry picked from commit a3edfddcf7822ea13bdf4858672eb82cea5e0b5f)
 2018-11-16 18:37:01 +05:30
Vinayakumar B
7a2a806213 HDFS-14056. Fix error messages in HDFS-12716. Contributed by Ayush Saxena. 
(cherry picked from commit 886b935630bf2d46f4c6773de013c093d2e44c38)
 2018-11-16 18:01:43 +05:30
Vinayakumar B
71a6ec6058 HDFS-13963. NN UI is broken with IE11. Contributed by Ayush Saxena. 
(cherry picked from commit 8571507efa3af3e4a5213a7e24c65e26162eac4d)
 2018-11-16 17:29:25 +05:30
Akira Ajisaka
a69423d28c
HADOOP-15925. The config and log of gpg-agent are removed in create-release script. Contributed by Dinesh Chitlangia. 
(cherry picked from commit af5958f7b6a209d6a6622acee47a66a4a921828d)
 2018-11-16 13:17:55 +09:00
Arpit Agarwal
351bfa1bcf HADOOP-12558. distcp documentation is woefully out of date. Contributed by Dinesh Chitlangia. 
(cherry picked from commit 914b0cf15f14ddff581b63f0902b7760e4d2bd56)
 2018-11-15 13:58:29 -08:00
Akira Ajisaka
8c9681d7f0
HADOOP-15926. Document upgrading the section in NOTICE.txt when upgrading the version of AWS SDK. Contributed by Dinesh Chitlangia. 
(cherry picked from commit 66b1335bb3a9a6f3a3db455540c973d4a85bef73)
 2018-11-15 16:31:05 +09:00
Akira Ajisaka
9f3d42f106
HADOOP-15930. Exclude MD5 checksum files from release artifact. 
(cherry picked from commit df5e863fee544c9283e28a21c2788c008d7e3e04)
 2018-11-15 10:47:13 +09:00
Sammi Chen
37082a664a HADOOP-15917. AliyunOSS: fix incorrect ReadOps and WriteOps in statistics. Contributed by Jinhu Wu. 
(cherry picked from commit 3fade865ce84dcf68bcd7de5a5ed1c7d904796e9)
(cherry picked from commit 64cb97fb4467513f73fde18f96f391ad34e3bb0a)
(cherry picked from commit 5d532cfc6f23f942ed10edab55ed251eb99a0664)
 2018-11-14 13:48:51 +08:00
Da Zhou
4039840510
HADOOP-15876. Use keySet().removeAll() to remove multiple keys from Map in AzureBlobFileSystemStore 
Contributed by Da Zhou.

(cherry picked from commit a13be203b7877ba56ef63aac4a2e65d4e1a4adbc)
 2018-11-13 21:48:05 +00:00
Xiao Chen
5afd7efe24 Revert "HDFS-13732. ECAdmin should print the policy name when an EC policy is set. Contributed by Zsolt Venczel." 
This reverts commit 7dc79a8b5b7af0bf37d25a221be8ed446b0edb74.
 2018-11-13 12:45:55 -08:00
Wangda Tan
f214af74b2 MAPREDUCE-7158. Inefficient Flush Logic in JobHistory EventWriter. (Zichen Sun via wangda) 
Change-Id: I99ace87980da03bb35a8012cea7218d602a8817a
(cherry picked from commit 762a56cc64bc07d57f94e253920534b8e049f238)
 2018-11-13 11:35:13 -08:00
Wangda Tan
ea753046b0 YARN-8918. [Submarine] Correct method usage of str.subString in CliUtils. (Zhankun Tang via wangda) 
Change-Id: Id1f11dbab3aa838dee3a0ec8b8fd5dc32f5dd946
(cherry picked from commit 076b795b2e82d7f89cc91e0a8513c7081ee8b930)
 2018-11-13 11:35:06 -08:00
Surendra Singh Lilhore
86deff0a06 HADOOP-15869. BlockDecompressorStream#decompress should not return -1 in case of IOException. Contributed by Surendra Singh Lilhore 
(cherry picked from commit 75291e6d53c13debf45493a870a898b63779914b)
 2018-11-13 21:26:22 +05:30
Brahma Reddy Battula
5e86641265 HDFS-14070. Refactor NameNodeWebHdfsMethods to allow better extensibility. Contributed by CR Hota 
(cherry picked from commit e7b63baca1e10b28d8b4462fd80537b871951aa3)
 2018-11-13 13:09:03 +05:30
Takanobu Asanuma
359b1dd40b HADOOP-15912. start-build-env.sh still creates an invalid /etc/sudoers.d/hadoop-build-${USER_ID} file entry after HADOOP-15802. Contributed by Akira Ajisaka. 
(cherry picked from commit a67642c3776156ee941f12f9481160c729c56027)
 2018-11-13 13:58:29 +09:00
Akira Ajisaka
861105747b
HADOOP-15923. create-release script should set max-cache-ttl as well as default-cache-ttl for gpg-agent. 
(cherry picked from commit 703b2860a49577629e7b3ef461d8a61292e79c88)
 2018-11-13 13:41:42 +09:00
Arpit Agarwal
e6532f7eb2 HDFS-14065. Failed Storage Locations shows nothing in the Datanode Volume Failures. Contributed by Ayush Saxena. 
(cherry picked from commit b6d4e19f34f474ea8068ebb374f55e0db2f714da)
 2018-11-12 15:32:14 -08:00
Steve Loughran
d4afeac285
HADOOP-15110. Gauges are getting logged in exceptions from AutoRenewalThreadForUserCreds. 
Contributed by LiXin Ge.

(cherry picked from commit 3c9d97b8f7d6eb75f08fc6d37cee37c22760bb86)
 2018-11-12 12:58:53 +00:00
Weiwei Yang
2415f8a5be YARN-8987. Usability improvements node-attributes CLI. Contributed by Bibin A Chundatt. 
(cherry picked from commit c741109522d2913b87638957c64b94dee6b51029)
 2018-11-12 18:21:11 +08:00
Eric Yang
5399ff8177 YARN-9002. Improve keytab loading for YARN Service. 
Contributed by Gour Saha

(cherry picked from commit 2664248797365761089a86d5bd59aa9ac3ebcc28)
 2018-11-10 01:54:59 -05:00
Akira Ajisaka
7b62c9684d
HADOOP-15916. Upgrade Maven Surefire plugin to 3.0.0-M1. 
(cherry picked from commit a736b5da15084e8eb93d2f68f8eccc506ff7bea7)
 2018-11-10 00:27:30 +09:00
Da Zhou
7440bc5a9c
HADOOP-15812. ABFS: Improve AbfsRestOperationException format to ensure full msg can be displayed on console. 
Author:    Da Zhou <da.zhou@microsoft.com>
(cherry picked from commit 9dbb2b67c6fa69a663c7c23fbb876bac4b6c09ce)
 2018-11-09 11:07:51 +00:00
Kitti Nanasi
57409874bb HDFS-14039. ec -listPolicies doesn't show correct state for the default policy when the default is not RS(6,3). Contributed by Kitti Nanasi. 
Signed-off-by: Xiao Chen <xiao@apache.org>
(cherry picked from commit 8d99648c203004045a9339ad27258092969145d6)
 2018-11-08 10:08:26 -08:00
Junhua Gu
66715005f9
HADOOP-15846. ABFS: fix mask related bugs in setAcl, modifyAclEntries and removeAclEntries. 
Contributed by Junhua Gu.
 2018-11-08 17:20:52 +00:00
Weiwei Yang
b3321d9933 YARN-8988. Reduce the verbose log on RM heartbeat path when distributed node-attributes is enabled. Contributed by Tao Yang. 
(cherry picked from commit e1bbf7dcdfc30a61a2b10bef09c59ff17d290488)
 2018-11-08 17:50:16 +08:00
Weiwei Yang
b10ec0aa14 YARN-8977. Remove unnecessary type casting when calling AbstractYarnScheduler#getSchedulerNode. Contributed by Wanqiang Ji. 
(cherry picked from commit c96cbe8659587cfc114a96aab1be5cc85029fe44)
 2018-11-07 22:44:01 +08:00
Takanobu Asanuma
02abd0f80a YARN-8866. Fix a parsing error for crossdomain.xml. 
(cherry picked from commit 8dc1f6dbf712a65390a9a6859f62fec0481af31b)
 2018-11-07 18:29:28 +09:00
Weiwei Yang
528615f5d9 Revert "HADOOP-15907. Add missing maven modules in BUILDING.txt. Contributed Wanqiang Ji." 
This reverts commit 8720814349e76f4fccb3749658c6172327b733d4.
 2018-11-07 16:48:52 +08:00
Weiwei Yang
8720814349 HADOOP-15907. Add missing maven modules in BUILDING.txt. Contributed Wanqiang Ji. 
(cherry picked from commit e6444f1c640cda86e1c97fbfebf68de92a162c95)
 2018-11-07 16:46:41 +08:00