Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
19,051 Commits 326 Branches 371 Tags
Commit Graph

19051 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Weiwei Yang
271ed86ac0 YARN-8719. Typo correction for yarn configuration in OpportunisticContainers(federation) docs. Contributed by Y. SREENIVASULU REDDY. 
(cherry picked from commit e8b063f63049d781f4bd67e2ac928c03fd7b7941)
 2018-08-28 01:07:05 +08:00
Konstantin V Shvachko
60fd202a59 HDFS-13848. Refactor NameNode failover proxy providers. Contributed by Konstantin Shvachko. 
(cherry picked from commit a4121c71c29d13866a605d9c0d013e5de9c147c3)
 2018-08-24 18:44:04 -07:00
Haibo Chen
e4282c077b YARN-8051. TestRMEmbeddedElector#testCallbackSynchronization is flaky. (Robert Kanter via Haibo Chen) 
(cherry picked from commit 93d47a0ed504ee81d4b74d340c1815bdbb3c9b14)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestRMEmbeddedElector.java
 2018-08-24 13:24:08 -05:00
Inigo Goiri
246086984e YARN-7773. YARN Federation used Mysql as state store throw exception, Unknown column 'homeSubCluster' in 'field list'. Contributed by Yiran Wu. 
(cherry picked from commit 60e5c1b516647bf99ef3e9501c0ce04deea13ce9)
 2018-08-24 07:10:02 +05:30
Jason Lowe
84654451fa YARN-8649. NPE in localizer hearbeat processing if a container is killed while localizing. Contributed by lujie 
(cherry picked from commit 585ebd873a55bedd2a364d256837f08ada8ba032)
 2018-08-23 09:37:43 -05:00
Takanobu Asanuma
4fa97013a9 HADOOP-14314. The OpenSolaris taxonomy link is dead in InterfaceClassification.md. Contributed by Rui Gao. 
(cherry picked from commit bed8cb6979e0460141ed77e3b15d4f18db098a8e)
 2018-08-23 21:55:40 +09:00
Yiqun Lin
0d73497aa7 HDFS-13821. RBF: Add dfs.federation.router.mount-table.cache.enable so that users can disable cache. Contributed by Fei Hui. 
(cherry picked from commit 81847392badcd58d934333e7c3b5bf14b4fa1f3f)
 2018-08-22 13:05:23 +08:00
Rohith Sharma K S
63d5214332 YARN-8129. Improve error message for invalid value in fields attribute. Contributed by Abhishek Modi. 
(cherry picked from commit d3fef7a5c5b83d27e87b5e49928254a7d1b935e5)
 2018-08-21 12:11:12 +05:30
Vinayakumar B
8df2eb8119 HDFS-13772. Erasure coding: Unnecessary NameNode Logs displaying for Enabling/Disabling Erasure coding policies which are already enabled/disabled. Contributed by Ayush Saxena 2018-08-21 09:34:57 +05:30
Steve Loughran
95fcdc0435
HADOOP-15679. ShutdownHookManager shutdown time needs to be configurable & extended. Contributed by Steve Loughran. 
Change-Id: Ifd4a6e3f796b4dc88e97f63066289e2534c77a29
 2018-08-20 18:48:49 -07:00
Xiao Chen
3712b79b38 HADOOP-9214. Create a new touch command to allow modifying atime and mtime. Contributed by Hrishikesh Gadre. 2018-08-20 14:59:14 -07:00
Xiao Chen
a630a27c53 HADOOP-15655. Enhance KMS client retry behavior. Contributed by Kitti Nanasi. 2018-08-20 14:57:51 -07:00
Wei-Chiu Chuang
865650052b HDFS-10240. Race between close/recoverLease leads to missing block. Contributed by Jinglun, zhouyingchao and Wei-Chiu Chuang. 2018-08-20 14:57:40 -07:00
Xiao Chen
0424715207 HDFS-13732. ECAdmin should print the policy name when an EC policy is set. Contributed by Zsolt Venczel. 2018-08-20 14:57:07 -07:00
Xiao Chen
81fbfe500e HDFS-13217. Audit log all EC policy names during addErasureCodingPolicies. Contributed by liaoyuxiangqin. 2018-08-20 14:56:47 -07:00
Daniel Templeton
c15853f87a HDFS-13819. TestDirectoryScanner#testDirectoryScannerInFederatedCluster is flaky 
Change-Id: I1cea6e67fcec72702ad202775dee3373261ac5cd
 2018-08-20 14:54:58 -07:00
drankye
975d60685e HDFS-13668. FSPermissionChecker may throws AIOOE when check inode permission. Contributed by He Xiaoqiao. 2018-08-20 14:53:32 -07:00
Xiao Chen
c0ac0a5337 HDFS-13658. Expose HighestPriorityLowRedundancy blocks statistics. Contributed by Kitti Nanasi. 2018-08-20 14:52:28 -07:00
Márton Elek
366517ba99 HDFS-13447. Fix Typos - Node Not Chosen. Contributed by Beluga Behr. 2018-08-20 14:52:04 -07:00
Vinayakumar B
a517ee4f5b HDFS-13785. EC: 'removePolicy' is not working for built-in/system Erasure Code policies. Contributed by Ayush Saxena 2018-08-20 14:51:53 -07:00
Xiao Chen
754069906b HDFS-13799. TestEditLogTailer#testTriggersLogRollsForAllStandbyNN fails due to missing synchronization 
between rollEditsRpcExecutor and tailerThread shutdown. Contributed by Hrishikesh Gadre.
 2018-08-20 14:51:07 -07:00
Yiqun Lin
e4b75ad583 HDFS-13792. Fix FSN read/write lock metrics name. Contributed by Chao Sun. 2018-08-20 14:50:47 -07:00
Wei-Chiu Chuang
0d155de159 HADOOP-14212. Addendum patch: Expose SecurityEnabled boolean field in JMX for other services besides NameNode. Contributed by Adam Antal. 2018-08-20 14:49:28 -07:00
Wei-Chiu Chuang
78fb14ba49 HADOOP-14212. Expose SecurityEnabled boolean field in JMX for other services besides NameNode. Contributed by Adam Antal. 2018-08-20 14:49:24 -07:00
Jason Lowe
44c4928b64 YARN-8242. YARN NM: OOM error while reading back the state store on recovery. Contributed by Pradeep Ambati and Kanwaljeet Sachdev 
(cherry picked from commit 65e7469712be6cf393e29ef73cc94727eec81227)
 2018-08-20 10:21:57 -05:00
Yiqun Lin
d7442c244f HDFS-13750. RBF: Router ID in RouterRpcClient is always null. Contributed by Takanobu Asanuma. 
(cherry picked from commit 01ff8178148790f7b0112058cf08d23d031b6868)
 2018-08-20 23:05:55 +08:00
Rohith Sharma K S
a3d4a25bbf YARN-8679. [ATSv2] If HBase cluster is down for long time, high chances that NM ContainerManager dispatcher get blocked. Contributed by Wangda Tan. 
(cherry picked from commit 4aacbfff605262aaf3dbd926258afcadc86c72c0)
 2018-08-18 11:04:09 +05:30
Xiao Chen
7556b09e9a HADOOP-15674. Test failure TestSSLHttpServer.testExcludedCiphers with TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256 cipher suite. Contributed by Szilard Nemeth. 
(cherry picked from commit 8d7c93186e3090b19aa59006bb6b32ba929bd8e6)
 2018-08-17 10:20:12 -07:00
Xiao Chen
06f0d5e257 HDFS-13747. Statistic for list_located_status is incremented incorrectly by listStatusIterator. Contributed by Antal Mihalyi. 
(cherry picked from commit c67b0650ea10896c6289703595faef0d262c00b3)
 2018-08-16 23:15:48 -07:00
Rohith Sharma K S
3532bd5c8b YARN-8612. Fix NM Collector Service Port issue in YarnConfiguration. Contributed by Prabha Manepalli. 
(cherry picked from commit 1697a0230696e1ed6d9c19471463b44a6d791dfa)
 2018-08-17 11:13:25 +05:30
Eric Yang
5237bdfb5a YARN-8667. Cleanup symlinks when container restarted by NM. 
Contributed by Chandni Singh

(cherry picked from commit d42806160eb95594f08f38bb753cf0306a191a38)
 2018-08-16 18:44:47 -04:00
Daniel Templeton
fbedf89377 HDFS-13746. Still occasional "Should be different group" failure in TestRefreshUserMappings#testGroupMappingRefresh 
(Contributed by Siyao Meng via Daniel Templeton)

Change-Id: I9fad1537ace38367a463d9fe67aaa28d3178fc69
(cherry picked from commit 8512e1a91be3e340d919c7cdc9c09dfb762a6a4e)
 2018-08-16 15:01:34 -07:00
Eric Yang
97c1934247 YARN-8474. Fixed ApiServiceClient kerberos negotiation. 
Contributed by Billie Rinaldi

(cherry picked from commit 8990eaf5925afa533fbd9c3641859a146dc5a22c)
 2018-08-16 12:50:52 -04:00
Jason Lowe
819a2a6f10 YARN-8656. container-executor should not write cgroup tasks files for docker containers. Contributed by Jim Brennan 
(cherry picked from commit cb21eaa026d80a2c9836030d959c0dd7f87c4d6b)
 2018-08-16 10:09:56 -05:00
Weiwei Yang
05547b1e0b YARN-8614. Fix few annotation typos in YarnConfiguration. Contributed by Sen Zhao. 
(cherry picked from commit 8dc07b47235358653c5cccda354201564f7545ed)
 2018-08-15 12:38:55 +08:00
Xiao Chen
83d0d82a69 HDFS-13788. Update EC documentation about rack fault tolerance. Contributed by Kitti Nanasi. 
(cherry picked from commit cede33997f7ab09fc046017508b680e282289ce3)
 2018-08-14 11:57:50 -07:00
Wei-Chiu Chuang
7a115e8de4 HDFS-13758. DatanodeManager should throw exception if it has BlockRecoveryCommand but the block is not under construction. Contributed by chencan. 
(cherry picked from commit 61a9b4f58b639e71c564d84b529ac66aaae7f8ef)
 2018-08-14 11:52:24 -07:00
Jason Lowe
95cd6de5c6 YARN-8640. Restore previous state in container-executor after failure. Contributed by Jim Brennan 
(cherry picked from commit d1d129aa9deecebf42261947fcb0b2ca46dacad5)
 2018-08-14 10:26:21 -05:00
Wei-Chiu Chuang
74d4fd975a HDFS-13738. fsck -list-corruptfileblocks has infinite loop if user is not privileged. Contributed by Yuen-Kuei Hsueh. 
(cherry picked from commit 4023eeba05aefe48384e870da3c95bb3af474514)
 2018-08-13 17:37:12 -07:00
Wei-Chiu Chuang
b38649c59a HDFS-13813. Exit NameNode if dangling child inode is detected when saving FsImage. Contributed by Siyao Meng. 
(cherry picked from commit 23854443efa62aa70a1c30c32c3816750e5d7a5b)
 2018-08-13 16:13:36 -07:00
Vinayakumar B
b3f29e3504 HDFS-13786. EC: Display erasure coding policy for sub-directories is not working. Contributed by Ayush Saxena. 
(cherry picked from commit 2b0f9772417d205e8df16bac6921c2bb8bdcf740)
 2018-08-13 13:58:27 -07:00
Chen Liang
e05b38f132 HDFS-13735. Make QJM HTTP URL connection timeout configurable. Contributed by Chao Sun. 2018-08-13 12:48:12 -07:00
Arpit Agarwal
4e197a4b46 HDFS-13823. NameNode UI : "Utilities -> Browse the file system -> open a file -> Head the file" is not working. Contributed by Nanda kumar. 2018-08-13 11:36:15 -07:00
Xiao Chen
1d748f0261 HADOOP-15638. KMS Accept Queue Size default changed from 500 to 128 in Hadoop 3.x. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit b94c8874e2a634637b1ef5d837f05bc5c5e8e6a6)
 2018-08-13 10:41:07 -07:00
Chao Sun
baca64cc68 Remove super user privilege requirement for NameNode.getServiceStatus. Contributed by Chao Sun. 
(cherry picked from commit a2a8c486998b81d2c73804a07cc74f5269bfd904)
 2018-08-10 16:07:02 -07:00
Xiao Chen
7d1e2e1fbb HDFS-13721. NPE in DataNode due to uninitialized DiskBalancer. 2018-08-10 13:53:34 -07:00
Shane Kumpf
ba6b48e19f YARN-8520. Document best practice for user management. Contributed by Eric Yang 
(cherry picked from commit e7951c69cbc85604f72cdd3559122d4e2c1ea127)
 2018-08-10 14:47:14 -06:00
Weiwei Yang
734bc42289 YARN-8575. Avoid committing allocation proposal to unavailable nodes in async scheduling. Contributed by Tao Yang. 
(cherry picked from commit 0a71bf145293adbd3728525ab4c36c08d51377d3)
 2018-08-10 15:10:27 +08:00
Weiwei Yang
991514f7c3 YARN-8521. NPE in AllocationTagsManager when a container is removed more than once. Contributed by Weiwei Yang. 
(cherry picked from commit 08d5060605af81a3d6048044176dc656c0dad56c)
 2018-08-10 08:44:53 +08:00
Wangda Tan
beea18736b YARN-8136. Add version attribute to site doc examples and quickstart. (Eric Yang via wangda) 
Change-Id: I4541b239f490ca0a6edf9698e0d3deaf83669151
(cherry picked from commit 8244abb7aeb768b73682b8c9a26516a9cf06bca5)
 2018-08-09 12:04:33 -07:00