Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,639 Commits 326 Branches 371 Tags
Commit Graph

18639 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Wei-Chiu Chuang
865650052b HDFS-10240. Race between close/recoverLease leads to missing block. Contributed by Jinglun, zhouyingchao and Wei-Chiu Chuang. 2018-08-20 14:57:40 -07:00
Xiao Chen
0424715207 HDFS-13732. ECAdmin should print the policy name when an EC policy is set. Contributed by Zsolt Venczel. 2018-08-20 14:57:07 -07:00
Xiao Chen
81fbfe500e HDFS-13217. Audit log all EC policy names during addErasureCodingPolicies. Contributed by liaoyuxiangqin. 2018-08-20 14:56:47 -07:00
Daniel Templeton
c15853f87a HDFS-13819. TestDirectoryScanner#testDirectoryScannerInFederatedCluster is flaky 
Change-Id: I1cea6e67fcec72702ad202775dee3373261ac5cd
 2018-08-20 14:54:58 -07:00
drankye
975d60685e HDFS-13668. FSPermissionChecker may throws AIOOE when check inode permission. Contributed by He Xiaoqiao. 2018-08-20 14:53:32 -07:00
Xiao Chen
c0ac0a5337 HDFS-13658. Expose HighestPriorityLowRedundancy blocks statistics. Contributed by Kitti Nanasi. 2018-08-20 14:52:28 -07:00
Márton Elek
366517ba99 HDFS-13447. Fix Typos - Node Not Chosen. Contributed by Beluga Behr. 2018-08-20 14:52:04 -07:00
Vinayakumar B
a517ee4f5b HDFS-13785. EC: 'removePolicy' is not working for built-in/system Erasure Code policies. Contributed by Ayush Saxena 2018-08-20 14:51:53 -07:00
Xiao Chen
754069906b HDFS-13799. TestEditLogTailer#testTriggersLogRollsForAllStandbyNN fails due to missing synchronization 
between rollEditsRpcExecutor and tailerThread shutdown. Contributed by Hrishikesh Gadre.
 2018-08-20 14:51:07 -07:00
Yiqun Lin
e4b75ad583 HDFS-13792. Fix FSN read/write lock metrics name. Contributed by Chao Sun. 2018-08-20 14:50:47 -07:00
Wei-Chiu Chuang
0d155de159 HADOOP-14212. Addendum patch: Expose SecurityEnabled boolean field in JMX for other services besides NameNode. Contributed by Adam Antal. 2018-08-20 14:49:28 -07:00
Wei-Chiu Chuang
78fb14ba49 HADOOP-14212. Expose SecurityEnabled boolean field in JMX for other services besides NameNode. Contributed by Adam Antal. 2018-08-20 14:49:24 -07:00
Jason Lowe
44c4928b64 YARN-8242. YARN NM: OOM error while reading back the state store on recovery. Contributed by Pradeep Ambati and Kanwaljeet Sachdev 
(cherry picked from commit 65e7469712be6cf393e29ef73cc94727eec81227)
 2018-08-20 10:21:57 -05:00
Yiqun Lin
d7442c244f HDFS-13750. RBF: Router ID in RouterRpcClient is always null. Contributed by Takanobu Asanuma. 
(cherry picked from commit 01ff8178148790f7b0112058cf08d23d031b6868)
 2018-08-20 23:05:55 +08:00
Rohith Sharma K S
a3d4a25bbf YARN-8679. [ATSv2] If HBase cluster is down for long time, high chances that NM ContainerManager dispatcher get blocked. Contributed by Wangda Tan. 
(cherry picked from commit 4aacbfff605262aaf3dbd926258afcadc86c72c0)
 2018-08-18 11:04:09 +05:30
Xiao Chen
7556b09e9a HADOOP-15674. Test failure TestSSLHttpServer.testExcludedCiphers with TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256 cipher suite. Contributed by Szilard Nemeth. 
(cherry picked from commit 8d7c93186e3090b19aa59006bb6b32ba929bd8e6)
 2018-08-17 10:20:12 -07:00
Xiao Chen
06f0d5e257 HDFS-13747. Statistic for list_located_status is incremented incorrectly by listStatusIterator. Contributed by Antal Mihalyi. 
(cherry picked from commit c67b0650ea10896c6289703595faef0d262c00b3)
 2018-08-16 23:15:48 -07:00
Rohith Sharma K S
3532bd5c8b YARN-8612. Fix NM Collector Service Port issue in YarnConfiguration. Contributed by Prabha Manepalli. 
(cherry picked from commit 1697a0230696e1ed6d9c19471463b44a6d791dfa)
 2018-08-17 11:13:25 +05:30
Eric Yang
5237bdfb5a YARN-8667. Cleanup symlinks when container restarted by NM. 
Contributed by Chandni Singh

(cherry picked from commit d42806160eb95594f08f38bb753cf0306a191a38)
 2018-08-16 18:44:47 -04:00
Daniel Templeton
fbedf89377 HDFS-13746. Still occasional "Should be different group" failure in TestRefreshUserMappings#testGroupMappingRefresh 
(Contributed by Siyao Meng via Daniel Templeton)

Change-Id: I9fad1537ace38367a463d9fe67aaa28d3178fc69
(cherry picked from commit 8512e1a91be3e340d919c7cdc9c09dfb762a6a4e)
 2018-08-16 15:01:34 -07:00
Eric Yang
97c1934247 YARN-8474. Fixed ApiServiceClient kerberos negotiation. 
Contributed by Billie Rinaldi

(cherry picked from commit 8990eaf5925afa533fbd9c3641859a146dc5a22c)
 2018-08-16 12:50:52 -04:00
Jason Lowe
819a2a6f10 YARN-8656. container-executor should not write cgroup tasks files for docker containers. Contributed by Jim Brennan 
(cherry picked from commit cb21eaa026d80a2c9836030d959c0dd7f87c4d6b)
 2018-08-16 10:09:56 -05:00
Weiwei Yang
05547b1e0b YARN-8614. Fix few annotation typos in YarnConfiguration. Contributed by Sen Zhao. 
(cherry picked from commit 8dc07b47235358653c5cccda354201564f7545ed)
 2018-08-15 12:38:55 +08:00
Xiao Chen
83d0d82a69 HDFS-13788. Update EC documentation about rack fault tolerance. Contributed by Kitti Nanasi. 
(cherry picked from commit cede33997f7ab09fc046017508b680e282289ce3)
 2018-08-14 11:57:50 -07:00
Wei-Chiu Chuang
7a115e8de4 HDFS-13758. DatanodeManager should throw exception if it has BlockRecoveryCommand but the block is not under construction. Contributed by chencan. 
(cherry picked from commit 61a9b4f58b639e71c564d84b529ac66aaae7f8ef)
 2018-08-14 11:52:24 -07:00
Jason Lowe
95cd6de5c6 YARN-8640. Restore previous state in container-executor after failure. Contributed by Jim Brennan 
(cherry picked from commit d1d129aa9deecebf42261947fcb0b2ca46dacad5)
 2018-08-14 10:26:21 -05:00
Wei-Chiu Chuang
74d4fd975a HDFS-13738. fsck -list-corruptfileblocks has infinite loop if user is not privileged. Contributed by Yuen-Kuei Hsueh. 
(cherry picked from commit 4023eeba05aefe48384e870da3c95bb3af474514)
 2018-08-13 17:37:12 -07:00
Wei-Chiu Chuang
b38649c59a HDFS-13813. Exit NameNode if dangling child inode is detected when saving FsImage. Contributed by Siyao Meng. 
(cherry picked from commit 23854443efa62aa70a1c30c32c3816750e5d7a5b)
 2018-08-13 16:13:36 -07:00
Vinayakumar B
b3f29e3504 HDFS-13786. EC: Display erasure coding policy for sub-directories is not working. Contributed by Ayush Saxena. 
(cherry picked from commit 2b0f9772417d205e8df16bac6921c2bb8bdcf740)
 2018-08-13 13:58:27 -07:00
Chen Liang
e05b38f132 HDFS-13735. Make QJM HTTP URL connection timeout configurable. Contributed by Chao Sun. 2018-08-13 12:48:12 -07:00
Arpit Agarwal
4e197a4b46 HDFS-13823. NameNode UI : "Utilities -> Browse the file system -> open a file -> Head the file" is not working. Contributed by Nanda kumar. 2018-08-13 11:36:15 -07:00
Xiao Chen
1d748f0261 HADOOP-15638. KMS Accept Queue Size default changed from 500 to 128 in Hadoop 3.x. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit b94c8874e2a634637b1ef5d837f05bc5c5e8e6a6)
 2018-08-13 10:41:07 -07:00
Chao Sun
baca64cc68 Remove super user privilege requirement for NameNode.getServiceStatus. Contributed by Chao Sun. 
(cherry picked from commit a2a8c486998b81d2c73804a07cc74f5269bfd904)
 2018-08-10 16:07:02 -07:00
Xiao Chen
7d1e2e1fbb HDFS-13721. NPE in DataNode due to uninitialized DiskBalancer. 2018-08-10 13:53:34 -07:00
Shane Kumpf
ba6b48e19f YARN-8520. Document best practice for user management. Contributed by Eric Yang 
(cherry picked from commit e7951c69cbc85604f72cdd3559122d4e2c1ea127)
 2018-08-10 14:47:14 -06:00
Weiwei Yang
734bc42289 YARN-8575. Avoid committing allocation proposal to unavailable nodes in async scheduling. Contributed by Tao Yang. 
(cherry picked from commit 0a71bf145293adbd3728525ab4c36c08d51377d3)
 2018-08-10 15:10:27 +08:00
Weiwei Yang
991514f7c3 YARN-8521. NPE in AllocationTagsManager when a container is removed more than once. Contributed by Weiwei Yang. 
(cherry picked from commit 08d5060605af81a3d6048044176dc656c0dad56c)
 2018-08-10 08:44:53 +08:00
Wangda Tan
beea18736b YARN-8136. Add version attribute to site doc examples and quickstart. (Eric Yang via wangda) 
Change-Id: I4541b239f490ca0a6edf9698e0d3deaf83669151
(cherry picked from commit 8244abb7aeb768b73682b8c9a26516a9cf06bca5)
 2018-08-09 12:04:33 -07:00
Wangda Tan
68279fcd65 YARN-8588. Logging improvements for better debuggability. (Suma Shivaprasad via wangda) 
Change-Id: I66aa4b0ec031ae5ce0fae558e2f8cbcbbfebc442
(cherry picked from commit 344c335a920e6f32a35ebace0a118a9dc4a22fb7)
 2018-08-09 12:04:25 -07:00
Weiwei Yang
0ee7e80047 YARN-8559. Expose mutable-conf scheduler's configuration in RM /scheduler-conf endpoint. Contributed by Weiwei Yang. 
(cherry picked from commit d352f167ebb865a6486afbbdac8e2a5e97a7bbad)
 2018-08-10 00:43:53 +08:00
Jason Lowe
3dd299a770 YARN-8331. Race condition in NM container launched after done. Contributed by Pradeep Ambati 
(cherry picked from commit cd04e954d2db27f0a15b7d1c492b7cdb656a51db)
 2018-08-09 10:23:02 -05:00
Sunil G
c6013b060d YARN-8633. Update DataTables version in yarn-common in line with JQuery 3 upgrade. Contributed by Akhil PB. 
(cherry picked from commit 00013d6ef7fdf65fa8a0f6eb56c0aef2f6e19444)
 2018-08-09 12:35:21 +05:30
Bharat Viswanadham
5430aab133 YARN-8426:Upgrade jquery-ui to 1.12.1 in YARN. Contributed by Sunil Govindan 
(cherry picked from commit 361ffb26bebf2491bbe3219ef4a83eb753660018)
 2018-08-09 12:27:50 +05:30
Robert Kanter
0ed91309d3 YARN-8568. Replace the deprecated zk-address property in the HA config example in ResourceManagerHA.md (bsteinbach via rkanter) 
(cherry picked from commit 8478732bb28e9e71061d6b4a043a3a1b5c688902)
 2018-08-08 15:10:52 -07:00
Wangda Tan
f16c311486 Make 3.1.1 awared by other branches - adding missing files 
(cherry picked from commit 3214cd75acd0474373951870e1ba2ec11833a3da)
 2018-08-08 13:06:14 -07:00
Wangda Tan
781620a44d Make 3.1.1 awared by other branches 
(cherry picked from commit 49c687608b65b772faeed614700ece8e526432e8)
 2018-08-08 13:04:05 -07:00
bibinchundatt
b4f957e655 YARN-8601. Print ExecutionType in Container report CLI. Contributed by Bilwa S T. 
(cherry picked from commit ff06bd1be83a2a6d2ee39cb002e91499720a7243)
 2018-08-08 22:46:16 +05:30
Xiao Chen
bf03b25f4b HDFS-13728. Disk Balancer should not fail if volume usage is greater than capacity. Contributed by Stephen O'Donnell. 
(cherry picked from commit 6677717c689cc94a15f14c3466242e23652d473b)
 2018-08-07 22:05:51 -07:00
Wangda Tan
f2768eaa38 YARN-8407. Container launch exception in AM log should be printed in ERROR level. (Yesha Vora via wangda) 
Change-Id: I154e873df1df3503a09c41d6b3874ca195af91d9
(cherry picked from commit 861095f761b40171e0dc25f769f486d910cc3e88)
 2018-08-07 13:07:28 -07:00
Wangda Tan
450c791ecf YARN-8629. Container cleanup fails while trying to delete Cgroups. (Suma Shivaprasad via wangda) 
Change-Id: I392ef4f8baa84d5d7b1f2e438c560b5426b6d4f2
(cherry picked from commit d4258fcad71eabe2de3cf829cde36840200ab9b6)
 2018-08-07 12:41:55 -07:00