Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,663 Commits 326 Branches 371 Tags
Commit Graph

17663 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Sunil G
1d8fce0d2f YARN-7748. TestContainerResizing.testIncreaseContainerUnreservedWhenApplicationCompleted fails due to multiple container fail events. Contributed by Weiwei Yang. 
(cherry picked from commit 35ce6eb1f526ce3db7e015fb1761eee15604100c)
 2018-07-24 22:21:44 +05:30
bibinchundatt
1f713d6c66 YARN-8548. AllocationRespose proto setNMToken initBuilder not done. Contributed by Bilwa S T. 
(cherry picked from commit ff7c2eda34c2c40ad71b50df6462a661bd213fbd)
 2018-07-24 16:32:21 +05:30
bibinchundatt
1a270e3b07 YARN-8434. Update federation documentation of Nodemanager configurations. Contributed by Bibin A Chundatt. 2018-07-24 13:04:26 +05:30
Yiqun Lin
097ae7fdc8 HDFS-13743. RBF: Router throws NullPointerException due to the invalid initialization of MountTableResolver. Contributed by Takanobu Asanuma. 
(cherry picked from commit 7b25fb949bf6f02df997beeca7df46c9e84c8d96)
 2018-07-20 17:32:27 +08:00
Kihwal Lee
00ac5ba90b HADOOP-15614. TestGroupsCaching.testExceptionOnBackgroundRefreshHandled reliably fails. Contributed by Weiwei Yang. 
(cherry picked from commit ccf2db7fc2688d262df3309007cb12a4dfedc179)
 2018-07-19 11:27:38 -05:00
Eric Yang
1776208977 HADOOP-15610. Fixed pylint version for Hadoop docker image. 
Contributed by Jack Bearden

(cherry picked from commit ba1ab08fdae96ad7c9c4f4bf8672abd741b7f758)
 2018-07-19 12:09:10 +05:30
Robert Kanter
6e0db6fe1a YARN-8518. test-container-executor test_is_empty() is broken (Jim_Brennan via rkanter) 
(cherry picked from commit 1bc106a738a6ce4f7ed025d556bb44c1ede022e3)
 2018-07-18 16:10:57 -07:00
Robert Kanter
c1dc4ca2c6 Only mount non-empty directories for cgroups (miklos.szegedi@cloudera.com via rkanter) 
(cherry picked from commit 0838fe833738e04f5e6f6408e97866d77bebbf30)
 2018-07-18 16:10:57 -07:00
Robert Kanter
d61d84279f Disable mounting cgroups by default (miklos.szegedi@cloudera.com via rkanter) 
(cherry picked from commit 351cf87c92872d90f62c476f85ae4d02e485769c)
 2018-07-18 16:10:57 -07:00
Yiqun Lin
34afb9f946 HDFS-13733. RBF: Add Web UI configurations and descriptions to RBF document. Contributed by Takanobu Asanuma. 
(cherry picked from commit 1af87df242c4286474961078d306a5692f85debc)
 2018-07-17 10:48:36 +08:00
Konstantin V Shvachko
475c282939 Fix potential FSImage corruption. Contributed by Ekanth Sethuramalingam & Arpit Agarwal. 
(cherry picked from commit 0a1e922f3d8eca4e852be57124ec1bcafaadb289)
 2018-07-16 18:33:36 -07:00
Wei-Chiu Chuang
67ee584fd8 HADOOP-15598. DataChecksum calculate checksum is contented on hashtable synchronization. Contributed by Prasanth Jayachandran. 
(cherry picked from commit 0c7a578927032d5d1ef3469283d7d1fb7dee2a56)
(cherry picked from commit 34f1dd03ee0c31173eb3a0b88a5fad7796a30c24)
 2018-07-16 11:34:28 -07:00
Wei-Chiu Chuang
0d2b983dc2 HDFS-13524. Occasional "All datanodes are bad" error in TestLargeBlock#testLargeBlockSize. Contributed by Siyao Meng. 
(cherry picked from commit 88b2794244d19b6432253eb649a375e5bcdcf964)
(cherry picked from commit ac9155d6cb174ba19a8cf64b7d0142e147248e04)
 2018-07-16 10:53:30 -07:00
Eric E Payne
5738bd8a10 YARN-8421: when moving app, activeUsers is increased, even though app does not have outstanding request. Contributed by Kyungwan Nam 
(cherry picked from commit 937ef39b3ff90f72392b7a319e4346344db34e03)
 2018-07-16 16:53:07 +00:00
Inigo Goiri
3d47ef1d31 HDFS-13475. RBF: Admin cannot enforce Router enter SafeMode. Contributed by Chao Sun. 
(cherry picked from commit 359ea4e18147af5677c6d88265e26de6b6c72999)
 2018-07-16 09:47:22 -07:00
Jason Lowe
1ae35834a2 YARN-8515. container-executor can crash with SIGPIPE after nodemanager restart. Contributed by Jim Brennan 
(cherry picked from commit 17118f446c2387aa796849da8b69a845d9d307d3)
 2018-07-13 10:08:21 -05:00
Xiao Chen
883df537d6 HDFS-12837. Intermittent failure in TestReencryptionWithKMS. 
(cherry picked from commit b37074be5ab35c238e18bb9c3b89db6d7f8d0986)
 2018-07-11 21:03:53 -07:00
Akira Ajisaka
4d5473c89d
HDFS-13729. Fix broken links to RBF documentation. Contributed by Gabor Bota. 
(cherry picked from commit 418cc7f3aeabedc57c94aa9d4c4248c1476ac90e)
 2018-07-11 14:48:12 -04:00
Wei-Chiu Chuang
74aa4be92d HDFS-13723. Occasional "Should be different group" error in TestRefreshUserMappings#testGroupMappingRefresh. Contributed by Siyao Meng. 
(cherry picked from commit 162228e8db937d4bdb9cf61d15ed555f1c96368f)
(cherry picked from commit f9fa3cb1570af6497fdb51f47a457268fbea6bd5)
 2018-07-11 10:04:38 -07:00
Yiqun Lin
241f7bb7ad HDFS-13726. RBF: Fix RBF configuration links. Contributed by Takanobu Asanuma. 
(cherry picked from commit 2ae13d41dcd4f49e6b4ebc099e5f8bb8280b9872)
 2018-07-11 22:19:32 +08:00
Sunil G
ce7c6762f4 YARN-8473. Containers being launched as app tears down can leave containers in NEW state. Contributed by Jason Lowe. 
(cherry picked from commit 705e2c1f7cba51496b0d019ecedffbe5fb55c28b)
 2018-07-10 20:13:15 +05:30
Andrew Wang
0e57e81b0c HDFS-13719. Docs around dfs.image.transfer.timeout are misleading. Contributed by Kitti Nansi. 
(cherry picked from commit eecb5baaaaa54599aeae758abd4007e55e5b531f)
 2018-07-09 15:17:48 +02:00
Junping Du
0a6942d58c yarn.resourcemanager.fail-fast is used inconsistently. Contributed by Yuanbo Liu. 
(cherry picked from commit d9ba6f3656e8dc97d2813181e27d12e52dca4328)
(cherry picked from commit 3d6ba2dd4e4f1c42522c837ca96ee5d13f1491a4)
 2018-07-09 16:22:58 +08:00
Xiaoyu Yao
3042aa2685 HADOOP-15571. Multiple FileContexts created with the same configuration object should be allowed to have different umask. Contributed by Vinod Kumar Vavilapalli. 
(cherry picked from commit 498e3bfb6b93bf542e5581d83e64e920983fe87e)
 2018-07-06 21:20:57 -07:00
Wei-Chiu Chuang
68290606ea HDFS-13121. NPE when request file descriptors when SC read. Contributed by Zsolt Venczel. 
(cherry picked from commit 0247cb6318507afe06816e337a19f396afc53efa)
(cherry picked from commit f5f4d0b7e72eaf2ea9c9e791f71d0ea95f5b4b20)
 2018-07-06 15:01:35 -07:00
Andrew Wang
896b51578f HDFS-13712. BlockReaderRemote.read() logging improvement. Contributed by Gergo Repas. 
(cherry picked from commit 344f324710522ffb27852c1a673c4f7d3d6eac4b)
 2018-07-03 11:08:05 +02:00
Inigo Goiri
98f2444a7d HDFS-13714. Fix TestNameNodePrunesMissingStorages test failures on Windows. Contributed by Lukas Majercak. 
(cherry picked from commit 7296b644f7c44400f03995668573a4cfd2ee552c)
 2018-07-02 16:37:36 -07:00
Wei-Chiu Chuang
563d56be62 HDFS-13635. Incorrect message when block is not found. Contributed by Gabor Bota. 
(cherry picked from commit fef20a446f7bf9f29e0f0ee690987fb6fc78a031)
(cherry picked from commit 2ce892fcf57b7d32af4f423d0ae9025f7c39b6e3)
 2018-07-02 09:44:16 -07:00
Andrew Wang
a4d0336ba2 HADOOP-15554. Improve JIT performance for Configuration parsing. Contributed by Todd Lipcon. 2018-07-02 18:32:07 +02:00
Andras Bokor
a41dc6ef5b HADOOP-15252. Checkstyle version is not compatible with IDEA's checkstyle plugin 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 90d2bdcb752f5f32ef65765af6fd5596dd5d373b)
 2018-07-02 18:28:46 +02:00
Andrew Wang
d34260f122 HDFS-13702. Remove HTrace hooks from DFSClient to reduce CPU usage. Contributed by Todd Lipcon. 
(cherry picked from commit 5d748bd056a32f2c6922514cd0c5b31d866a9919)
 2018-07-02 12:11:14 +02:00
Andrew Wang
7cd769b31c HDFS-13703. Avoid allocation of CorruptedBlocks hashmap when no corrupted blocks are hit. Contributed by Todd Lipcon. 
(cherry picked from commit 6ba99741086170b83c38d3e7e715d9e8046a1e00)
 2018-07-02 12:02:27 +02:00
Eric E Payne
c5f2fb5ae6 HADOOP-15548: Randomize local dirs. Contributed by Jim Brennan. 
(cherry picked from commit d36f6b9e93e4c30d24d0e837cb00bd24ffa8f274)
 2018-06-29 18:35:47 +00:00
Jason Lowe
90631e6dbf YARN-8451. Multiple NM heartbeat thread created when a slow NM resync with RM. Contributed by Botong Huang 
(cherry picked from commit 100470140d86eede0fa240a9aa93226f274ee4f5)
 2018-06-29 13:14:20 -05:00
Sunil G
7dbe81895b YARN-8401. [UI2] new ui is not accessible with out internet connection. Contributed by Bibin A Chundatt. 
(cherry picked from commit fbaff369e9b9022723a7b2c6f25e71122a8f8a15)
 2018-06-27 10:36:08 -07:00
Rohith Sharma K S
1fa79f0063 YARN-8457. Compilation is broken with -Pyarn-ui. 
(cherry picked from commit 4ffe68a6f70ce01a5654da8991b4cdb35ae0bf1f)
 2018-06-25 10:40:02 -07:00
Inigo Goiri
f3efeb899a HADOOP-15458. TestLocalFileSystem#testFSOutputStreamBuilder fails on Windows. Contributed by Xiao Liang. 
(cherry picked from commit abc3e4bad905efde5a4881e8a072c68f6e910ade)
 2018-06-25 09:51:25 -07:00
Weiwei Yang
3151e95d27 YARN-8443. Total #VCores in cluster metrics is wrong when CapacityScheduler reserved some containers. Contributed by Tao Yang. 2018-06-25 09:46:32 +08:00
Eric E Payne
e977876428 YARN-8444: NodeResourceMonitor crashes on bad swapFree value. Contributed by Jim Brennan. 
(cherry picked from commit 6432128622d64f3f9dd638b9c254c77cdf5408aa)
 2018-06-22 17:30:01 +00:00
Yiqun Lin
db1f37a711 HDFS-13692. StorageInfoDefragmenter floods log when compacting StorageInfo TreeSet. Contributed by Bharat Viswanadham. 
(cherry picked from commit 30728aced4a6b05394b3fc8c613f39fade9cf3c2)
 2018-06-22 10:55:09 +08:00
Xiao Chen
aca66f6155 HDFS-13682. Cannot create encryption zone after KMS auth token expires. 
(cherry picked from commit 32f867a6a907c05a312657139d295a92756d98ef)
 2018-06-20 15:59:45 -07:00
Surendra Singh Lilhore
5667582bc4 HDFS-12857. StoragePolicyAdmin should support schema based path. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit 30941d99c9014431981eeb09ab24e90bef629fee)
 2018-06-19 10:09:05 -07:00
Chris Douglas
d1dcc39222 HADOOP-15533. Make WASB listStatus messages consistent. Contributed by Esfandiar Manii 
(cherry picked from commit f34744603ee93e082e7ba148df1400af5ac7c30c)
(cherry picked from commit 7e655b642d0ed5b85e0e8c212e004d067318ed4c)
 2018-06-17 23:13:25 -07:00
Surendra Singh Lilhore
34f89f5af7 HADOOP-15523. Shell command timeout given is in seconds whereas it is taken as millisec while scheduling. Contributed by Bilwa S T. 
(cherry picked from commit 3905fdb793e6370243d05d0c3036ca69898fe3fb)
 2018-06-17 12:49:09 +05:30
Inigo Goiri
11d3db2dba HDFS-13681. Fix TestStartup.testNNFailToStartOnReadOnlyNNDir test failure on Windows. Contributed by Xiao Liang. 
(cherry picked from commit 8762e9cf10fa100dd5f7fd695f5e52b75a94c5d4)
 2018-06-15 16:50:20 -07:00
Inigo Goiri
69abd1fc5c HDFS-13686. Add overall metrics for FSNamesystemLock. Contributed by Lukas Majercak. 
(cherry picked from commit d31a3ce767d3bb68bdbb4f36d45600eab9f4f8b7)
 2018-06-15 16:00:16 -07:00
Wei-Chiu Chuang
73badce597 HDFS-13174. hdfs mover -p /path times out after 20 min. Contributed by Istvan Fajth. 
(cherry picked from commit c966a3837af1c1a1c4a441f491b0d76d5c9e5d78)
(cherry picked from commit 975d4b3d603632a5edacb138cf4a1ce92ebed02e)
 2018-06-15 13:38:11 -07:00
Inigo Goiri
fe1926a50f HDFS-13676. TestEditLogRace fails on Windows. Contributed by Zuoming Zhang. 
(cherry picked from commit eebeb6033fd09791fcbff626f128a98e393f0a88)
 2018-06-15 13:08:47 -07:00
Inigo Goiri
94e0b9839f HDFS-13673. TestNameNodeMetrics fails on Windows. Contributed by Zuoming Zhang. 
(cherry picked from commit 43d994e4a6dfd1c24eafb909d6f8a0663b20769a)
 2018-06-15 10:34:33 -07:00
Inigo Goiri
a3c0c03899 HDFS-13563. TestDFSAdminWithHA times out on Windows. Contributed by Lukas Majercak. 
(cherry picked from commit 8d4926f38bf53b32453cd2bc7322c8818f752f85)
 2018-06-14 09:59:50 -07:00