Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,681 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

17681 Commits

Author SHA1 Message Date
Xiao Chen 8e5081569f HDFS-13728. Disk Balancer should not fail if volume usage is greater than capacity. Contributed by Stephen O'Donnell. 
(cherry picked from commit 6677717c68)
 2018-08-07 22:05:59 -07:00
Sunil G a3675f382a YARN-8397. Potential thread leak in ActivitiesManager. Contributed by Rohith Sharma K S. 
(cherry picked from commit 6310c0d17d)
 2018-08-01 08:36:12 +05:30
Jonathan Hung 0d6e1a2aab YARN-7974. Allow updating application tracking url after registration. Contributed by Jonathan Hung 2018-07-30 18:06:25 -07:00
Chen Liang 207f08bab4 HADOOP-15637. LocalFs#listLocatedStatus does not filter out hidden .crc files. Contributed by Erik Krogen. 2018-07-30 17:00:51 -07:00
Chen Liang 6c48d6a484 Revert "HADOOP-15637. LocalFs#listLocatedStatus does not filter out hidden .crc files. Contributed by Erik Krogen." 
This reverts commit f60b50be3d.
 2018-07-30 12:04:26 -07:00
Chen Liang f60b50be3d HADOOP-15637. LocalFs#listLocatedStatus does not filter out hidden .crc files. Contributed by Erik Krogen. 2018-07-30 10:33:24 -07:00
Haibo Chen a4fc0279fc YARN-6966. NodeManager metrics may return wrong negative values when NM restart. (Szilard Nemeth via Haibo Chen) 2018-07-30 09:26:00 -07:00
bibinchundatt 9a3b006685 YARN-8558. NM recovery level db not cleaned up properly on container finish. Contributed by Bibin A Chundatt. 2018-07-30 21:31:47 +05:30
Brahma Reddy Battula abc32c863e HDFS-12716. 'dfs.datanode.failed.volumes.tolerated' to support minimum number of volumes to be available. Contributed by Ranith Sardar and usharani 
(cherry picked from commit 3108d27edd)
 2018-07-30 16:08:49 +05:30
Sammi Chen f9aedf32ec HADOOP-15607. AliyunOSS: fix duplicated partNumber issue in AliyunOSSBlockOutputStream. Contributed by Jinhu Wu. 
(cherry picked from commit 0857f116b7)
 2018-07-30 10:56:31 +08:00
Arpit Agarwal eb40d4fab4 HDFS-13765. Fix javadoc for FSDirMkdirOp#createParentDirectories. Contributed by Lokesh Jain. 2018-07-27 10:14:11 -07:00
Anu Engineer faaf72dcb3 HDFS-13727. Log full stack trace if DiskBalancer exits with an unhandled exception. 
Contributed by Gabor Bota.

(cherry picked from commit 64e739e344)
 2018-07-27 09:35:02 -07:00
Wei-Chiu Chuang 0af04ad89f HDFS-11060. make DEFAULT_MAX_CORRUPT_FILEBLOCKS_RETURNED configurable. Contributed by Lantao Jin. 
(cherry picked from commit e95c5e9f62)
(cherry picked from commit 964f3454d1)
 2018-07-25 11:05:36 -07:00
Eric E Payne 299dffc72d YARN-4606. CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps. Contributed by Manikandan R 
(cherry picked from commit 9485c9aee6)
 2018-07-25 16:49:03 +00:00
bibinchundatt 14fd114cd5 YARN-8577. Fix the broken anchor in SLS site-doc. Contributed by Weiwei Yang. 
(cherry picked from commit 3d3158cea4)
 2018-07-25 19:01:40 +05:30
Xiao Chen 7f64a6886f HADOOP-15609. Retry KMS calls when SSLHandshakeException occurs. Contributed by Kitti Nanasi. 
(cherry picked from commit 81d59506e5)
 2018-07-24 21:46:31 -07:00
Gera Shegalov aab32c8cda HADOOP-15612. Improve exception when tfile fails to load LzoCodec. (gera) 
(cherry picked from commit 6bec03cfc8)
 2018-07-24 17:25:28 -07:00
Daniel Templeton 3210b3d8aa HDFS-13448. HDFS Block Placement - Ignore Locality for First Block Replica 
(Contributed by BELUGA BEHR via Daniel Templeton)

Change-Id: I965d1cfa642ad24296038b83e3d5c9983545267d
(cherry picked from commit 849c45db18)
(cherry picked from commit 00c476abd8)
 2018-07-24 16:13:30 -07:00
Sunil G 1d8fce0d2f YARN-7748. TestContainerResizing.testIncreaseContainerUnreservedWhenApplicationCompleted fails due to multiple container fail events. Contributed by Weiwei Yang. 
(cherry picked from commit 35ce6eb1f5)
 2018-07-24 22:21:44 +05:30
bibinchundatt 1f713d6c66 YARN-8548. AllocationRespose proto setNMToken initBuilder not done. Contributed by Bilwa S T. 
(cherry picked from commit ff7c2eda34)
 2018-07-24 16:32:21 +05:30
bibinchundatt 1a270e3b07 YARN-8434. Update federation documentation of Nodemanager configurations. Contributed by Bibin A Chundatt. 2018-07-24 13:04:26 +05:30
Yiqun Lin 097ae7fdc8 HDFS-13743. RBF: Router throws NullPointerException due to the invalid initialization of MountTableResolver. Contributed by Takanobu Asanuma. 
(cherry picked from commit 7b25fb949b)
 2018-07-20 17:32:27 +08:00
Kihwal Lee 00ac5ba90b HADOOP-15614. TestGroupsCaching.testExceptionOnBackgroundRefreshHandled reliably fails. Contributed by Weiwei Yang. 
(cherry picked from commit ccf2db7fc2)
 2018-07-19 11:27:38 -05:00
Eric Yang 1776208977 HADOOP-15610. Fixed pylint version for Hadoop docker image. 
Contributed by Jack Bearden

(cherry picked from commit ba1ab08fda)
 2018-07-19 12:09:10 +05:30
Robert Kanter 6e0db6fe1a YARN-8518. test-container-executor test_is_empty() is broken (Jim_Brennan via rkanter) 
(cherry picked from commit 1bc106a738)
 2018-07-18 16:10:57 -07:00
Robert Kanter c1dc4ca2c6 Only mount non-empty directories for cgroups (miklos.szegedi@cloudera.com via rkanter) 
(cherry picked from commit 0838fe8337)
 2018-07-18 16:10:57 -07:00
Robert Kanter d61d84279f Disable mounting cgroups by default (miklos.szegedi@cloudera.com via rkanter) 
(cherry picked from commit 351cf87c92)
 2018-07-18 16:10:57 -07:00
Yiqun Lin 34afb9f946 HDFS-13733. RBF: Add Web UI configurations and descriptions to RBF document. Contributed by Takanobu Asanuma. 
(cherry picked from commit 1af87df242)
 2018-07-17 10:48:36 +08:00
Konstantin V Shvachko 475c282939 Fix potential FSImage corruption. Contributed by Ekanth Sethuramalingam & Arpit Agarwal. 
(cherry picked from commit 0a1e922f3d)
 2018-07-16 18:33:36 -07:00
Wei-Chiu Chuang 67ee584fd8 HADOOP-15598. DataChecksum calculate checksum is contented on hashtable synchronization. Contributed by Prasanth Jayachandran. 
(cherry picked from commit 0c7a578927)
(cherry picked from commit 34f1dd03ee)
 2018-07-16 11:34:28 -07:00
Wei-Chiu Chuang 0d2b983dc2 HDFS-13524. Occasional "All datanodes are bad" error in TestLargeBlock#testLargeBlockSize. Contributed by Siyao Meng. 
(cherry picked from commit 88b2794244)
(cherry picked from commit ac9155d6cb)
 2018-07-16 10:53:30 -07:00
Eric E Payne 5738bd8a10 YARN-8421: when moving app, activeUsers is increased, even though app does not have outstanding request. Contributed by Kyungwan Nam 
(cherry picked from commit 937ef39b3f)
 2018-07-16 16:53:07 +00:00
Inigo Goiri 3d47ef1d31 HDFS-13475. RBF: Admin cannot enforce Router enter SafeMode. Contributed by Chao Sun. 
(cherry picked from commit 359ea4e181)
 2018-07-16 09:47:22 -07:00
Jason Lowe 1ae35834a2 YARN-8515. container-executor can crash with SIGPIPE after nodemanager restart. Contributed by Jim Brennan 
(cherry picked from commit 17118f446c)
 2018-07-13 10:08:21 -05:00
Xiao Chen 883df537d6 HDFS-12837. Intermittent failure in TestReencryptionWithKMS. 
(cherry picked from commit b37074be5a)
 2018-07-11 21:03:53 -07:00
Akira Ajisaka 4d5473c89d
HDFS-13729. Fix broken links to RBF documentation. Contributed by Gabor Bota. 
(cherry picked from commit 418cc7f3ae)
 2018-07-11 14:48:12 -04:00
Wei-Chiu Chuang 74aa4be92d HDFS-13723. Occasional "Should be different group" error in TestRefreshUserMappings#testGroupMappingRefresh. Contributed by Siyao Meng. 
(cherry picked from commit 162228e8db)
(cherry picked from commit f9fa3cb157)
 2018-07-11 10:04:38 -07:00
Yiqun Lin 241f7bb7ad HDFS-13726. RBF: Fix RBF configuration links. Contributed by Takanobu Asanuma. 
(cherry picked from commit 2ae13d41dc)
 2018-07-11 22:19:32 +08:00
Sunil G ce7c6762f4 YARN-8473. Containers being launched as app tears down can leave containers in NEW state. Contributed by Jason Lowe. 
(cherry picked from commit 705e2c1f7c)
 2018-07-10 20:13:15 +05:30
Andrew Wang 0e57e81b0c HDFS-13719. Docs around dfs.image.transfer.timeout are misleading. Contributed by Kitti Nansi. 
(cherry picked from commit eecb5baaaa)
 2018-07-09 15:17:48 +02:00
Junping Du 0a6942d58c yarn.resourcemanager.fail-fast is used inconsistently. Contributed by Yuanbo Liu. 
(cherry picked from commit d9ba6f3656)
(cherry picked from commit 3d6ba2dd4e)
 2018-07-09 16:22:58 +08:00
Xiaoyu Yao 3042aa2685 HADOOP-15571. Multiple FileContexts created with the same configuration object should be allowed to have different umask. Contributed by Vinod Kumar Vavilapalli. 
(cherry picked from commit 498e3bfb6b)
 2018-07-06 21:20:57 -07:00
Wei-Chiu Chuang 68290606ea HDFS-13121. NPE when request file descriptors when SC read. Contributed by Zsolt Venczel. 
(cherry picked from commit 0247cb6318)
(cherry picked from commit f5f4d0b7e7)
 2018-07-06 15:01:35 -07:00
Andrew Wang 896b51578f HDFS-13712. BlockReaderRemote.read() logging improvement. Contributed by Gergo Repas. 
(cherry picked from commit 344f324710)
 2018-07-03 11:08:05 +02:00
Inigo Goiri 98f2444a7d HDFS-13714. Fix TestNameNodePrunesMissingStorages test failures on Windows. Contributed by Lukas Majercak. 
(cherry picked from commit 7296b644f7)
 2018-07-02 16:37:36 -07:00
Wei-Chiu Chuang 563d56be62 HDFS-13635. Incorrect message when block is not found. Contributed by Gabor Bota. 
(cherry picked from commit fef20a446f)
(cherry picked from commit 2ce892fcf5)
 2018-07-02 09:44:16 -07:00
Andrew Wang a4d0336ba2 HADOOP-15554. Improve JIT performance for Configuration parsing. Contributed by Todd Lipcon. 2018-07-02 18:32:07 +02:00
Andras Bokor a41dc6ef5b HADOOP-15252. Checkstyle version is not compatible with IDEA's checkstyle plugin 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 90d2bdcb75)
 2018-07-02 18:28:46 +02:00
Andrew Wang d34260f122 HDFS-13702. Remove HTrace hooks from DFSClient to reduce CPU usage. Contributed by Todd Lipcon. 
(cherry picked from commit 5d748bd056)
 2018-07-02 12:11:14 +02:00
Andrew Wang 7cd769b31c HDFS-13703. Avoid allocation of CorruptedBlocks hashmap when no corrupted blocks are hit. Contributed by Todd Lipcon. 
(cherry picked from commit 6ba9974108)
 2018-07-02 12:02:27 +02:00