Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
20,411 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

20411 Commits

Author SHA1 Message Date
Akira Ajisaka 71d8ffb551
YARN-9122. Add table of contents to YARN Service API document. Contributed by Zhankun Tang. 
(cherry picked from commit 26e55d4ceb)
 2018-12-15 10:30:37 +09:00
Eric Yang 52aafb9789 YARN-9125. Fixed Carriage Return detection in Docker container launch command. 
Contributed by Billie Rinaldi

(cherry picked from commit b2d7204ed0)
 2018-12-14 17:55:10 -05:00
Akira Ajisaka 495285e50e
MAPREDUCE-7170. Doc typo in PluggableShuffleAndPluggableSort.md. Contributed by Zhaohui Xin. 
(cherry picked from commit e0d75088f2)
 2018-12-13 16:27:52 +09:00
Wangda Tan 29e4e5f62c YARN-9112. [Submarine] Support polling applicationId when it's not ready in cluster. (Zhankun Tang via wangda) 
Change-Id: I73d73f3d631b28fb9866faa56571839b13824a97
(cherry picked from commit 9fba6cc247)
 2018-12-12 11:52:16 -08:00
Wangda Tan ef0f835537 YARN-8714. [Submarine] Support files/tarballs to be localized for a training job. (Zhankun Tang via wangda) 
Change-Id: I845131273e52a9d81dbc813ea6d4af06b205e334
(cherry picked from commit c771fe6e10)
 2018-12-12 11:52:07 -08:00
Steve Loughran bbe1ddd309
HADOOP-15808. Harden Token service loader use. 
Contributed by Steve Loughran.

(cherry picked from commit 202926ac33)
 2018-12-11 17:34:16 +00:00
Vinayakumar B abe14d32d4 HDFS-14124. EC : Support EC Commands (set/get/unset EcPolicy) via WebHdfs. Contributed by Ayush Saxena. 
(cherry picked from commit 39dc7345b8)
 2018-12-11 18:10:51 +05:30
Weiwei Yang 2b3c3d2a32 YARN-9009. Fix flaky test TestEntityGroupFSTimelineStore.testCleanLogs. Contributed by OrDTesters. 
(cherry picked from commit 1c09a10e96)
 2018-12-10 12:07:23 +08:00
Jonathan Hung 3ab6ea7aca YARN-9085. Add Guaranteed and MaxCapacity to CSQueueMetrics 
(cherry picked from commit 978ab3e958227220cb6f1a08ae6e7cdb8a46628b)
 2018-12-07 10:45:47 -08:00
Jason Lowe 298a1f29e8 MAPREDUCE-7159. FrameworkUploader: ensure proper permissions of generated framework tar.gz if restrictive umask is used. Contributed by Peter Bacsko 
(cherry picked from commit 9886c27c71)
 2018-12-06 14:57:45 -06:00
Eric Yang 8c70728f7f YARN-9071. Improved status update for reinitialized containers. 
Contributed by Chandni Singh

(cherry picked from commit 1b790f4dd1)
 2018-12-05 19:04:55 -05:00
Jason Lowe 78b90725a6 HADOOP-15974. Upgrade Curator version to 2.13.0 to fix ZK tests. Contributed by Akira Ajisaka 
(cherry picked from commit 9287ab3642)
 2018-12-04 16:44:21 -06:00
Wangda Tan 559cb99bf6 Revert "YARN-8870. [Submarine] Add submarine installation scripts. (Xun Liu via wangda)" 
This reverts commit 920401b296.
 2018-12-04 14:13:39 -08:00
Steve Loughran 05e41dd4fe
HADOOP-15966. Hadoop Kerberos broken on macos as java.security.krb5.realm is reset. 
Contributed by Steve Loughran

(cherry picked from commit db2d8b01c6)
 2018-12-04 15:36:50 +00:00
Akira Ajisaka b5ebafa19d
HADOOP-15970. Upgrade plexus-utils from 2.0.5 to 3.1.0. 
(cherry picked from commit ff31313d83)
 2018-12-04 22:46:55 +09:00
Da Zhou 2d2212a508
HADOOP-15968. ABFS: add try catch for UGI failure when initializing ABFS. 
Contributed by Da Zhou.

(cherry picked from commit a8bbd818d5)
 2018-12-04 13:40:03 +00:00
Giovanni Matteo Fumarola 7cfcabc473 HADOOP-15950. Failover for LdapGroupsMapping. Contributed by Lukas Majercak. 2018-12-03 12:44:19 -08:00
Jonathan Hung 6b01e4d2a8 YARN-9036. Escape newlines in health report in YARN UI. Contributed by Keqiu Hu 
(cherry picked from commit 1c8bd7128c99d8215ef16438bd2ce6b1f025a966)
 2018-11-30 10:16:00 -08:00
Eric Yang 69be6e7352 HADOOP-15922. Revert patch 004. 
(cherry picked from commit 38ea3814bd)
 2018-11-30 12:51:58 -05:00
Da Zhou 9bc1fd4721
HADOOP-15957. WASB: Add asterisk wildcard support for PageBlobDirSet. 
Contributed by Da Zhou.

(cherry picked from commit 7ccb640a66)
 2018-11-30 10:13:57 +00:00
Akira Ajisaka b722bfd6f5
MAPREDUCE-7165. mapred-site.xml is misformatted in single node setup document. Contributed by Zhaohui Xin. 
(cherry picked from commit c9bfca217f)
 2018-11-30 13:30:32 +09:00
Tsz Wo Nicholas Sze 9d508f719b HDFS-14112. Avoid recursive call to external authorizer for getContentSummary. 2018-11-29 13:56:43 -08:00
Brahma Reddy Battula e2fa9e8cdd HDFS-14095. EC: Track Erasure Coding commands in DFS statistics. Contributed by Ayush Saxena. 
(cherry picked from commit f534736867)
 2018-11-30 00:28:04 +05:30
Eric Yang a8f67ad7c9 YARN-9067. Fixed Resource Manager resource leak via YARN service. 
Contributed by Eric Yang
 2018-11-29 13:50:06 -05:00
Steve Loughran 1a448565a8
HADOOP-15959. Revert "HADOOP-12751. While using kerberos Hadoop incorrectly assumes names with '@' to be non-simple" 
This reverts commit 829a2e4d27.

(cherry picked from commit d0edd37269)
 2018-11-29 17:53:23 +00:00
bibinchundatt 183ec39c4b YARN-9069. Fix SchedulerInfo#getSchedulerType for custom schedulers. Contributed by Bilwa S T. 
(cherry picked from commit 07142f54a8)
 2018-11-29 22:16:32 +05:30
Wangda Tan ee9deb6e9c YARN-9030. Log aggregation changes to handle filesystems which do not support setting permissions. (Suma Shivaprasad via wangda) 
Change-Id: I80f1e8196b8624e24d74494719fdedfd7061dced
(cherry picked from commit 9de8e8d049)
 2018-11-28 15:06:35 -08:00
Jason Lowe 7a78bdf7bb MAPREDUCE-7164. FileOutputCommitter does not report progress while merging paths. Contributed by Kuhu Shukla 
(cherry picked from commit 4d8de7ab69)
 2018-11-28 15:54:59 -06:00
Jason Lowe df0e7766e4 YARN-8812. Containers fail during creating a symlink which started with hyphen for a resource file. Contributed by Oleksandr Shevchenko 
(cherry picked from commit 3ce99e32f7)
 2018-11-28 08:50:18 -06:00
Eric Yang db8b2a130c YARN-9056. Improved YARN service upgrade state logic for readiness check. 
Contributed by Chandni Singh

(cherry picked from commit f657a2a661)
 2018-11-27 19:45:23 -05:00
Steve Loughran fa1d4ba7d4
HADOOP-15932. Oozie unable to create sharelib in s3a filesystem. 
Contributed by Steve Loughran.

(cherry picked from commit 4c106fca0c)
 2018-11-27 20:40:48 +00:00
Eric Yang 838190482d YARN-8986. Added port publish for Docker container running with bridge. 
Contributed by Charo Zhang
 2018-11-27 14:27:13 -05:00
Da Zhou 1a3a4960d9
HADOOP-15940. ABFS: For HNS account, avoid unnecessary get call when doing Rename. 
Contributed by Da Zhou <da.zhou@microsoft.com>
 2018-11-27 18:11:30 +00:00
Akira Ajisaka 2e6b9b174e
MAPREDUCE-7162. TestEvents#testEvents fails. Contributed by Zhaohui Xin. 
(cherry picked from commit 1aad99a718)
 2018-11-27 20:02:11 +09:00
Eric Yang f089796251 HADOOP-15922. Fixed doAsUser decoding for DelegationTokenAuthenticationFilter. 
Contributed by He Xiaoqiao

(cherry picked from commit a9d96948ed)
 2018-11-26 13:52:42 -05:00
Vinayakumar B 538757ed49 HDFS-13816. dfs.getQuotaUsage() throws NPE on non-existent dir instead of FileNotFoundException. Contributed by Vinayakumar B. 
(cherry picked from commit b098281454)
 2018-11-26 18:23:09 +05:30
Vinayakumar B 1b937d701d HADOOP-15948. Inconsistency in get and put syntax if filename/dirname contains space. Contributed by Ayush Saxena. 
(cherry picked from commit 23b441c225)
 2018-11-26 18:13:09 +05:30
Da Zhou f5d2806c81
HADOOP-15872. ABFS: Update to target 2018-11-09 REST version for ADLS Gen 2. 
Contributed by Junhua Gu and Da Zhou.

(cherry picked from commit a8302e398c)
 2018-11-23 14:19:36 +00:00
Weiwei Yang fea9d37ad5 HADOOP-15943. AliyunOSS: add missing owner & group attributes for oss FileStatus. Contributed by wujinhu. 
(cherry picked from commit 5ff0cf86a9)
 2018-11-23 14:10:30 +08:00
Weiwei Yang 01477108d9 YARN-8984. AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or empty. Contributed by Yang Wang. 
(cherry picked from commit 176bb3f812)
 2018-11-22 17:04:16 +08:00
Brahma Reddy Battula 7e10dd03b5 HDFS-14064. WEBHDFS: Support Enable/Disable EC Policy. Contributed by Ayush Saxena. 
(cherry picked from commit 15d8f592b51d08a658e88c6a7a7596e0edf5793b)
 2018-11-22 00:07:38 +05:30
Akira Ajisaka f6227367fb
Add 2.9.2 release notes and changes documents. 
(cherry picked from commit 1a00b4e325)
 2018-11-20 14:25:48 +09:00
Wangda Tan 34387599c4 YARN-8960. [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment. (Zac Zhou via wangda) 
Change-Id: I21b1addc9c32817650ea744a8f2e6b5602f2f4d4
(cherry picked from commit 8b23814415)
 2018-11-19 09:01:21 -08:00
Weiwei Yang 0b2cfc8ab8 HADOOP-15919. AliyunOSS: Enable Yarn to use OSS. Contributed by wujinhu. 
(cherry picked from commit be0708c6eb)
 2018-11-19 14:21:38 +08:00
Weiwei Yang 650581a19d YARN-8833. Avoid potential integer overflow when computing fair shares. Contributed by liyakun. 
(cherry picked from commit d027a24f03)
 2018-11-18 23:23:09 +08:00
Wangda Tan bee5bf867b YARN-9001. [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs. (Zac Zhou via wangda) 
Change-Id: I7e8d1c27ebd37e0907ca570c4f3d56fe7a859635
 2018-11-16 10:26:50 -08:00
Weiwei Yang f5e1bad0f3 HDFS-14063. Support noredirect param for CREATE/APPEND/OPEN/GETFILECHECKSUM in HttpFS. Contributed by Íñigo Goiri. 
(cherry picked from commit ad5256e44d)
 2018-11-17 01:16:23 +08:00
Rohith Sharma K S 13e3670e7f YARN-8303. YarnClient should contact TimelineReader for application/attempt/container report. 
(cherry picked from commit ee3355be3c)
 2018-11-16 18:37:20 +05:30
Vrushali C da05328824 YARN-8834 Provide Java client for fetching Yarn specific entities from TimelineReader. Contributed by Abhishek Modi 
(cherry picked from commit a3edfddcf7)
 2018-11-16 18:37:01 +05:30
Vinayakumar B 7a2a806213 HDFS-14056. Fix error messages in HDFS-12716. Contributed by Ayush Saxena. 
(cherry picked from commit 886b935630bf2d46f4c6773de013c093d2e44c38)
 2018-11-16 18:01:43 +05:30