Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
20,406 Commits 326 Branches 371 Tags
Commit Graph

20406 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Wangda Tan
fe7cb2d84a YARN-9194. Invalid event: REGISTERED and LAUNCH_FAILED at FAILED, and NullPointerException happens in RM while shutdown a NM. (lujie via wangda) 
Change-Id: I4359f59a73a278a941f4bb9d106dd38c9cb471fe
(cherry picked from commit 6d7eedfd28cc1712690db2f6ca8a281b0901ee28)
 2019-01-17 15:13:42 -08:00
rahul3
4aee7946dc
YARN-9203. Fix typos in yarn-default.xml. 
This closes #437

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 0a46baecd31c485d1ea4e567c29c47bfba0b092e)
 2019-01-17 16:19:49 +09:00
Akira Ajisaka
a415446705
YARN-8747. [UI2] YARN UI2 page loading failed due to js error under some time zone configuration. Contributed by collinma. 
(cherry picked from commit 104ef5df36fd45f1c2d07a2f3d441263aa85e22e)
 2019-01-16 14:37:43 +09:00
luhuachao
18becec548
HADOOP-16019. ZKDelegationTokenSecretManager won't log exception message occured in function setJaasConfiguration. 
Contributed by luhuachao.

(cherry picked from commit ccc43621aba4f1fc9ca880e294a66862493805b0)
 2019-01-15 13:16:07 +00:00
Da Zhou
1d4390e16b
HADOOP-16044. ABFS: Better exception handling of DNS errors followup 
Contributed by Da Zhou.

(cherry picked from commit 30863c5ae3a7ad69b6b4853bad2e8f22c7c67639)
 2019-01-14 19:45:30 +00:00
Akira Ajisaka
0ec180213c
HADOOP-15994. Upgrade Jackson2 to 2.9.8. Contributed by lqjacklee. 
(cherry picked from commit 3bb745df18669e2ae400dc0d1a37a81cdc270eb2)
 2019-01-12 15:53:24 +09:00
Inigo Goiri
c1c15c1bd8 HADOOP-16045. Don't run TestDU on Windows. Contributed by Lukas Majercak. 
(cherry picked from commit 35fa3bd685605d8b3639e6c5cbe83cd9acd8cbe7)
 2019-01-11 18:08:14 -08:00
Da Zhou
8b5fbe7a12
HADOOP-15975. ABFS: remove timeout check for DELETE and RENAME. 
Contributed by Da Zhou.
 2019-01-11 11:12:39 +00:00
Surendra Singh Lilhore
5d2d0e74d5 HDFS-14198. Upload and Create button doesn't get enabled after getting reset. Contributed by Ayush Saxena. 
(cherry picked from commit 9aeaaa0479ea6b4c4135214722c8c7c39fb17d75)
 2019-01-11 14:55:18 +05:30
Akira Ajisaka
d345b1f441
HADOOP-16016. TestSSLFactory#testServerWeakCiphers fails on Java 1.8.0_191 or upper 
(cherry picked from commit d4ca907da636892e4ab98e232fe0f7f77f1f7aac)
 2019-01-11 13:04:40 +09:00
Da Zhou
9cb6000c8a
HADOOP-16036. WASB: Disable jetty logging configuration announcement. 
Contributed by Da Zhou.

(cherry picked from commit 852701f7935eb94eda6f44b74a2ce060e7c159a7)
 2019-01-10 12:08:27 +00:00
Da Zhou
6c2500d7ca
HADOOP-15662. Better exception handling of DNS errors. 
Contributed by Da Zhou.

(cherry picked from commit 72112691421bedb66d887ba4e18d1b7d65a42f2c)
 2019-01-10 12:03:48 +00:00
Da Zhou
f7de630e85
HADOOP-16040. ABFS: Bug fix for tolerateOobAppends configuration. 
Contributed by Da Zhou.

(cherry picked from commit e8d19003695e3bc76bfa8e1187a238eec0220def)
 2019-01-10 11:59:29 +00:00
Jason Lowe
6236de9e23 Revert "HDFS-14084. Need for more stats in DFSClient. Contributed by Pranay Singh." 
This reverts commit 1f39eae7e6f59206b86f96063ffb2ebe15a9cbe1.
 2019-01-09 17:41:52 -06:00
Kai Xie
5dce9d75e6
HADOOP-16018. DistCp won't reassemble chunks when blocks per chunk > 0. 
Contributed by Kai Xie.

(cherry picked from commit 188bebbe7eaec71433548dc47f5a9a995cbea15a)
 2019-01-08 13:34:51 +00:00
Wangda Tan
1dc2b49bfd YARN-8822. Nvidia-docker v2 support for YARN GPU feature. (Charo Zhang via wangda) 
Change-Id: Ib8044307a4241f6b1b7b9b8266b9256f39b16384
 2019-01-07 12:21:33 -08:00
Eric Yang
bba76b6f31 HADOOP-16031. Fixed TestSecureLogins unit test. Contributed by Akira Ajisaka 2019-01-07 13:24:01 -05:00
Weiwei Yang
977e0ff8b9 HADOOP-16030. AliyunOSS: bring fixes back from HADOOP-15671. Contributed by wujinhu. 
(cherry picked from commit f87b3b11c46704dcdb63089dd971e2a5ba1deaac)
 2019-01-07 16:06:03 +08:00
Weiwei Yang
2b549e32e1 YARN-9173. FairShare calculation broken for large values after YARN-8833. Contributed by Wilfred Spiegelenburg. 
(cherry picked from commit 944cf872232d1a8899df0f0bbe90aa29f225cb90)
 2019-01-07 16:05:57 +08:00
Wangda Tan
cffe5c1ba0 YARN-9160. [Submarine] Document 'PYTHONPATH' environment variable setting when using -localization options. (Zhankun Tang via wangda) 
Change-Id: I115b6710eb11501e21ab3e9e7cd1a87f322e5cf8
(cherry picked from commit 2c02aa6ec259128934cc5468cf66104a624d88a7)
 2019-01-06 11:10:47 -08:00
Wangda Tan
1ad1ab5d7a YARN-9141. [Submarine] JobStatus outputs with system UTC clock, not local clock. (Zac Zhou via wangda) 
Change-Id: Ib2b17cf7860ddc9188f06498086de3326bc09519
(cherry picked from commit 8f004fe4e0d479e26d0063427566edc1606bced5)
 2019-01-06 11:10:41 -08:00
Sunil G
71bee05339
Revert "HADOOP-15759. AliyunOSS: Update oss-sdk version to 3.0.0. Contributed by Jinhu Wu." 
This reverts commit e4fca6aae46a3c04fc56897986a4ab4e5aa98503.

Revert "HADOOP-15671. AliyunOSS: Support Assume Roles in AliyunOSS. Contributed by Jinhu Wu."

This reverts commit 2b635125fb059fc204ed35bc0e264c42dd3a9fe9.

(cherry picked from commit 1f425271a73fff1fdbe3fbfdb71e906fd1ac0574)
 2019-01-05 17:36:15 +09:00
Eric Yang
febafd0e4f HADOOP-15996. Improved Kerberos username mapping strategy in Hadoop. 
Contributed by Bolke de Bruin

(cherry picked from commit d43af8b3db4743b4b240751b6f29de6c20cfd6e5)
 2019-01-04 18:02:30 -05:00
Sunil G
7d752c1b9b HADOOP-15997. KMS client uses wrong UGI after HADOOP-14445. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 51427cbdfb39cb6f5774b7b70009d7ee4388edfc)
 2019-01-04 21:49:59 +05:30
Pranay Singh
1f39eae7e6 HDFS-14084. Need for more stats in DFSClient. Contributed by Pranay Singh. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit ecdeaa7e6ad43555031aed032e6ba7a14a17d7bc)
 2019-01-03 09:57:08 -08:00
Weiwei Yang
a24cca11f2 YARN-9164. Shutdown NM may cause NPE when opportunistic container scheduling is enabled. Contributed by lujie. 
(cherry picked from commit cfe89e6f963ba25b5fff1ce48cad36d74b3c789c)
 2019-01-04 01:04:39 +08:00
Weiwei Yang
38ef85171d HADOOP-15323. AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore. Contributed wujinhu. 
(cherry picked from commit 040a202b202a37f3b922cd321eb0a8ded457d88b)
 2019-01-03 21:40:43 +08:00
Ayush Saxena
3783a35128
HADOOP-16025. Update the year to 2019. 
Contributed by Ayush Saxena.

(cherry picked from commit cb26f154289ed065a967886b8eac04794907d643)
 2019-01-02 22:24:57 +00:00
Weiwei Yang
0d78725fa8 MAPREDUCE-7174. Mapreduce example wordmedian should handle generic options. Contributed by Fei Hui. 
(cherry picked from commit 9e7196749ee025db7668c648743d1deb72d3ca28)
 2019-01-02 21:48:57 +08:00
Akira Ajisaka
eefe8ae960
HADOOP-16009. Replace the url of the repository in Apache Hadoop source code. 
(cherry picked from commit eee29ed7066e9401c7530b8b6f3b221bacef9a8a)
 2018-12-31 06:31:09 +09:00
Akira Ajisaka
6bc2781b39
HDFS-14183. [SPS] Remove the -w parameter from the -satisfystoragepolicy usage. Contributed by Ayush Saxena. 
(cherry picked from commit f30473f2ef10482976fa49730dd9a139417150dc)
 2018-12-31 03:17:27 +09:00
Wei-Chiu Chuang
c48640ffbd HDFS-14171. Performance improvement in Tailing EditLog. Contributed by Kenneth Yang. 
(cherry picked from commit e9a005dfcf4d2249235aeff4da85b321dddc1ca9)
 2018-12-28 10:38:55 -08:00
Sunil G
9bfea98746 YARN-9090. [Submarine] Update submarine installation script document. Contributed by Xun Liu. 
(cherry picked from commit 742fd978b5b585fc14fc3fea7ec37f80c5d7dc97)
 2018-12-26 08:27:50 +05:30
Surendra Singh Lilhore
d2ec1ff020 HDFS-14046. In-Maintenance ICON is missing in datanode info page. Contributed by Ranith Sardar. 
(cherry picked from commit 686fcd4db34dfe8642ff4b25fffbc73e42217f30)
 2018-12-24 11:09:07 +05:30
Surendra Singh Lilhore
5ab79f6377 HDFS-14166. Ls with -e option not giving the result in proper format. Contributed by Shubham Dewan. 
(cherry picked from commit 763e96ea2b18f584ba102b68271263be8c5d621c)
 2018-12-22 12:39:51 +05:30
Akira Ajisaka
d6baf9d5bf
YARN-9154. Fix itemization in YARN service quickstart document. Contributed by Ayush Saxena. 
(cherry picked from commit e98e963e5143600017d2d227d504140b8802439d)
 2018-12-22 13:26:41 +09:00
Weiwei Yang
7deef08eb8 YARN-8925. Updating distributed node attributes only when necessary. Contributed by Tao Yang. 2018-12-21 16:31:03 +08:00
Jason Lowe
9c89e2ea76 HADOOP-15973. Configuration: Included properties are not cached if resource is a stream. Contributed by Eric Payne 
(cherry picked from commit 3961690037fa4274a3640104b3c344e8626caa10)
 2018-12-20 09:33:22 -06:00
Takanobu Asanuma
1b941a680d HDFS-13661. Ls command with e option fails when the filesystem is not HDFS. 
(cherry picked from commit d9635759182b614a1dd5034c30978e7c4be8d0dd)
 2018-12-20 10:05:02 +09:00
Eric Yang
29c9c8a893 YARN-9126. Fix container clean up for reinitialization. 
Contributed by Chandni Singh

(cherry picked from commit e815fd9c49e80b9200dd8852abe74fe219ad9110)
 2018-12-19 14:58:19 -05:00
Eric Yang
4e1cef3625 YARN-9084. Reset container state and defer readiness check for upgrade. 
Contributed by Chandni Singh

(cherry picked from commit ccdd982e51f4413bc2e98d03e0a05b1133042a31)
 2018-12-18 18:05:40 -05:00
Eric Yang
28ca14e71b YARN-9040. Fixed memory leak in LevelDBCacheTimelineStore and DBIterator. 
Contributed by Tarun Parimi

(cherry picked from commit 71e0b0d8005ea1952dc7e582db15c2ac09df7c91)
 2018-12-17 12:08:09 -05:00
Da Zhou
f122ae7279
HADOOP-16004. ABFS: Convert 404 error response in AbfsInputStream and AbfsOutPutStream to FileNotFoundException. 
Contributed by Da Zhou.

(cherry picked from commit 346c0c8aff0b206d45f34dbce4fcc81364115d95)
 2018-12-17 11:18:12 +00:00
Da Zhou
d09dbcc8fb
HADOOP-15972 ABFS: reduce list page size to to 500. 
Contributed by Da Zhou.
 2018-12-17 11:08:17 +00:00
Da Zhou
87d9a54968
HADOOP-15969. ABFS: getNamespaceEnabled can fail blocking user access thru ACLs. 
Contributed by Da Zhou.

(cherry picked from commit b2523d8100844338e073531c47666d744a101caf)
 2018-12-17 11:05:39 +00:00
Akira Ajisaka
71d8ffb551
YARN-9122. Add table of contents to YARN Service API document. Contributed by Zhankun Tang. 
(cherry picked from commit 26e55d4ceb691f47801fa5f0ba1147a5bc413f96)
 2018-12-15 10:30:37 +09:00
Eric Yang
52aafb9789 YARN-9125. Fixed Carriage Return detection in Docker container launch command. 
Contributed by Billie Rinaldi

(cherry picked from commit b2d7204ed0b64405a0adbe07e3eaf385e046efa1)
 2018-12-14 17:55:10 -05:00
Akira Ajisaka
495285e50e
MAPREDUCE-7170. Doc typo in PluggableShuffleAndPluggableSort.md. Contributed by Zhaohui Xin. 
(cherry picked from commit e0d75088f24283985a4e4032fa547dad2ebb54db)
 2018-12-13 16:27:52 +09:00
Wangda Tan
29e4e5f62c YARN-9112. [Submarine] Support polling applicationId when it's not ready in cluster. (Zhankun Tang via wangda) 
Change-Id: I73d73f3d631b28fb9866faa56571839b13824a97
(cherry picked from commit 9fba6cc2471db8df9ca6da7b9df378e3072dfeb2)
 2018-12-12 11:52:16 -08:00
Wangda Tan
ef0f835537 YARN-8714. [Submarine] Support files/tarballs to be localized for a training job. (Zhankun Tang via wangda) 
Change-Id: I845131273e52a9d81dbc813ea6d4af06b205e334
(cherry picked from commit c771fe6e10bd3f8533a01026de3c33db2a983cf4)
 2018-12-12 11:52:07 -08:00