Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,523 Commits 326 Branches 371 Tags
Commit Graph

9523 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Kihwal Lee
fdd645be6b HDFS-11053. Unnecessary superuser check in versionRequest(). Contributed by Kihwal Lee. 
Updated CHANGES.txt
(cherry picked from commit e90af4a89ba2741aeca20ead47699587b14f0de8)
 2016-10-26 09:19:45 -05:00
Zhe Zhang
c05d701161 HDFS-11015. Enforce timeout in balancer. Contributed by Kihwal Lee. 
(cherry picked from commit f6367c5f44a88cb5eb7edffb015b10b657504a61)
(cherry picked from commit ff806cbfc7f5d1bdccd51a1802b6d69f4777219e)
(cherry picked from commit 262518fa5b2f0e06c9d9158ec8b37a2ac3cc6981)
 2016-10-25 11:50:51 -07:00
Brahma Reddy Battula
d05e737b84 HADOOP-13236. truncate will fail when we use viewfilesystem. Contributed by Brahma Reddy Battula 
(cherry picked from commit f872c6bc0390415f13e95b99749b0b1a690991b7)
 2016-10-21 06:21:46 +05:30
Steve Loughran
897cf09b40 Revert "HADOOP-13236. truncate will fail when we use viewfilesystem. Contributed by Brahma Reddy Battula" 
This reverts commit f6d8746f2e809a1889a0bcccc8c6f1ecdad13481.
 2016-10-20 19:48:56 +01:00
Brahma Reddy Battula
f6d8746f2e HADOOP-13236. truncate will fail when we use viewfilesystem. Contributed by Brahma Reddy Battula 
(cherry picked from commit f872c6bc0390415f13e95b99749b0b1a690991b7)
 2016-10-20 21:54:09 +05:30
Kihwal Lee
6ae7b9f800 HDFS-10627. Volume Scanner marks a block as "suspect" even if the exception is network-related. Contributed by Rushabh S Shah. 
Updated CHANGES.txt
(cherry picked from commit 5c0bffddc0cb824a8a2751bcd0dc3e15ce081727)
 2016-10-20 11:09:20 -05:00
Brahma Reddy Battula
1e5c40b5b4 HDFS-9444. Add utility to find set of available ephemeral ports to ServerSocketUtil. Contributed by Masatake Iwasaki 
(cherry picked from commit e9a34ae29c7390f3ffcbeee02dc5faa26fca482a)
(cherry picked from commit 5f754e8638d5a35ab12765edec6561228312f71c)
 2016-10-18 10:50:19 -07:00
Konstantin V Shvachko
4aea760676 Update CHANGES.txt for HDFS-10712 and HDFS-10301. (shv) 2016-10-18 10:37:01 -07:00
Masatake Iwasaki
fd3df4bb04 HDFS-9333. Some tests using MiniDFSCluster errored complaining port in use. (iwasakims) 
(cherry picked from commit 964e546ab1dba5f5d53b209ec6c9a70a85654765)

 Conflicts:
  hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestBlockTokenWithDFSStriped.java

(cherry picked from commit 1b91ebb7145860ecda394d764da5fc7063406fee)
(cherry picked from commit 1524e6320659df7d066ac96fd2c190d7a7c5b932)
 2016-10-18 10:32:16 -07:00
Robert Kanter
bd16763591 HADOOP-12259. Utility to Dynamic port allocation (brahmareddy via rkanter) 
(cherry picked from commit ee233ec95ce8cfc8309d3adc072d926cd85eba08)
(cherry picked from commit 731ed9cad81f91e9da18148f0c4757a38ca406f6)
 2016-10-18 10:25:52 -07:00
Xiao Chen
d053d1c3ff HDFS-10879. TestEncryptionZonesWithKMS#testReadWrite fails intermittently. Contributed by Xiao Chen. 
(cherry picked from commit d31bef575478fe78c0600fb602e117e4b81c9887)
(cherry picked from commit 11ed4f5d40effcdb26461a393379c6bddaa29bed)
 2016-10-18 10:16:30 -07:00
Wei-Chiu Chuang
f27cf17f7e HADOOP-13535. Add jetty6 acceptor startup issue workaround to branch-2. Contributed by Min Shen. 
(cherry picked from commit 23984e17870bcff6fffd8e1ca185fd37e2352b29)
(cherry picked from commit 6ca5ffe4b52c13e71027c465c9a757724f6b091d)
 2016-10-18 10:03:46 -07:00
Yongjun Zhang
b2dfab4326 HDFS-10512. VolumeScanner may terminate due to NPE in DataNode.reportBadBlocks. Contributed by Wei-Chiu Chuang and Yiqun Lin. 
(cherry picked from commit da6f1b88dd47e22b24d44f6fc8bbee73e85746f7)
(cherry picked from commit 96e68e722f0fe99d1609b38377014c04ef5b6640)
 2016-10-18 09:09:06 -07:00
Vinitha Reddy Gankidi
86f291f057 HDFS-10712. TestDataNodeVolumeFailure should pass not null BlockReportContext. Contributed by Vinitha Gankidi. 2016-10-17 19:08:52 -07:00
Vinitha Reddy Gankidi
1fcaba9b14 HDFS-10301. Remove FBR tracking state to fix false zombie storage detection for interleaving block reports. Contributed by Vinitha Gankidi. 
(cherry picked from commit 391ce535a739dc92cb90017d759217265a4fd969)
 2016-10-17 18:37:44 -07:00
Akira Ajisaka
8eb0b6f39c HDFS-11002. Fix broken attr/getfattr/setfattr links in ExtendedAttributes.md. Contributed by Mingliang Liu. 
(cherry picked from commit 901eca004d0e7e413b109a93128892176c808d61)
(cherry picked from commit 43cf0b29732ebafb8b5b23b06d6015fe4c7777b4)
 2016-10-13 14:32:47 +09:00
Naganarasimha
ac395be019 YARN-3877. YarnClientImpl.submitApplication swallows exceptions. Contributed by Varun Saxena 
(cherry picked from commit e4e72db5f9f305b493138ab36f073fe5d1750ad8)
(cherry picked from commit 4c2b20ca3e98d5f63e29d734595d693ad3a20529)
 2016-10-11 16:29:43 -07:00
Andrew Wang
165febbc84 HDFS-10991. Export hdfsTruncateFile symbol in libhdfs. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit dacd3ec66b111be24131957c986f0c748cf9ea26)
(cherry picked from commit 67f0319db667ed724a3c19cc2ab745ef661fc5f8)
 2016-10-11 15:08:53 -07:00
Tsz-Wo Nicholas Sze
b23b60e7b4 HDFS-8824. Do not use small blocks for balancing the cluster. 
(cherry-picked from commit 61b9e5f7ff15daa0efd09e98efd70351f474c8cb)
 2016-10-07 11:01:29 -07:00
Zhe Zhang
47fcae7da8 HDFS-10745. Directly resolve paths into INodesInPath. Contributed by Daryn Sharp.. 2016-10-06 09:39:59 -07:00
Brahma Reddy Battula
23d4351174 adding entry for HADOOP-13670 in changes.txt 2016-10-06 20:01:31 +05:30
Brahma Reddy Battula
7e241cfcba HADOOP-13670. Update CHANGES.txt to reflect all the changes in branch-2.7. Contributed by Brahma Reddy Battula 2016-10-06 17:56:45 +05:30
Wei-Chiu Chuang
039c3a7351 HDFS-10609. Uncaught InvalidEncryptionKeyException during pipeline recovery may abort downstream applications. Contributed by Wei-Chiu Chuang. 2016-10-05 13:29:20 -07:00
Jason Lowe
599146d10b MAPREDUCE-6741. Add MR support to redact job conf properties. Contributed by Haibo Chen 
(cherry picked from commit f1b74a3d9ff71bc014dbfd29a6996071b81d14c5)

Conflicts:

	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
 2016-10-05 15:33:23 +00:00
Zhe Zhang
5c99959b2d HDFS-10896. Move lock logging logic from FSNamesystem into FSNamesystemLock. Contributed by Erik Krogen. 2016-10-04 16:52:56 -07:00
Kihwal Lee
3eff0873f6 HDFS-10878. TestDFSClientRetries#testIdempotentAllocateBlockAndClose throws ConcurrentModificationException. Contributed by Rushabh S Shah. 
Modified CHANGES.txt
(cherry picked from commit 382307cbdd94107350fe6fad1acf87d63c9be9d6)
 2016-10-04 11:17:59 -05:00
Arpit Agarwal
c08346ea2d HDFS-10713. Throttle FsNameSystem lock warnings. Contributed by Hanisha Koneru. 
(cherry-picked from a349c54603c5cb7327d3bbb22285bd8e686c4790)
 2016-09-30 16:18:23 -07:00
Jason Lowe
7a2d602ae0 MAPREDUCE-6771. RMContainerAllocator sends container diagnostics event after corresponding completion event. Contributed by Haibo Chen 2016-09-29 16:05:41 +00:00
Kihwal Lee
031125b8ff HADOOP-11780. Prevent IPC reader thread death. Contributed by Daryn Sharp. 
(cherry picked from commit e19b37ead23805c7ed45bdcbfa7fdc8898cde7b2)
 2016-09-28 10:49:29 -05:00
Mingliang Liu
bdc97f74fe HDFS-10915. Fix time measurement bug in TestDatanodeRestart. Contributed by Xiaobing Zhou 
(cherry picked from commit 6437ba18c5c26bc271a63aff5ea03756f43dd9a3)
 2016-09-27 20:49:30 -07:00
Brahma Reddy Battula
5c3294d00f HDFS-10889. Remove outdated Fault Injection Framework documentaion. Contributed by Brahma Reddy Battula 
(cherry picked from commit df1d0f5d56f375e82b0219a19675a7b6052aaf30)
 2016-09-27 19:48:32 +05:30
Brahma Reddy Battula
1190f837c8 adding the entry in CHANGE.txt for HDFS-9885 2016-09-27 10:58:31 +05:30
Brahma Reddy Battula
ff4fb48da1 HDFS-9885. Correct the distcp counters name while displaying counters. Contributed by Surendra Singh Lilhore 
(cherry picked from commit e17a4970bea8213660bb6c550104783069153236)
 2016-09-27 10:53:51 +05:30
Brahma Reddy Battula
aaff2033b9 HADOOP-12597. In kms-site.xml configuration hadoop.security.keystore.JavaKeyStoreProvider.password should be updated with new name. ( Contributed by Surendra Singh Lilhore via Brahma Reddy Battula) 2016-09-26 22:31:31 +05:30
Konstantin V Shvachko
66ee9f554e HDFS-10843. Add missing file to commit 4b5806217e6846bcecc6480af46c0e70102daac0. 2016-09-23 11:13:25 -07:00
Konstantin V Shvachko
4b5806217e HDFS-10843. Update space quota when a UC block is completed rather than committed. Contributed by Erik Krogen. 
(cherry picked from commit a5bb88c8e0fd4bd19b6d377fecbe1d2d441514f6)
 2016-09-23 10:56:15 -07:00
Mingliang Liu
2a1e48bd2f HADOOP-13601. Fix a log message typo in AbstractDelegationTokenSecretManager. Contributed by Mehran Hassani. 
(cherry picked from commit e80386d69d5fb6a08aa3366e42d2518747af569f)
 2016-09-20 13:25:01 -07:00
Jason Lowe
d6c36c2954 YARN-5540. Scheduler spends too much time looking at empty priorities. Contributed by Jason Lowe 2016-09-19 20:37:22 +00:00
Xiao Chen
81ac06039e HADOOP-13558. UserGroupInformation created from a Subject incorrectly tries to renew the Kerberos ticket. Contributed by Xiao Chen. 
(cherry picked from commit 680be58aac03a9ffab6b07c8fde9602ddb9dc858)
(cherry picked from commit d157733082697e67be56f516606a0127f5830c58)

Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/TestUserGroupInformation.java

(cherry picked from commit a7f1dc8aa8c602faf9745588cba1e337f0e59afd)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/UserGroupInformation.java
 2016-09-19 12:56:02 -07:00
Kihwal Lee
a8b7817739 HDFS-9621. Consolidate FSDirStatAndListingOp#createFileStatus to let its INodesInPath parameter always include the target INode. Contributed by Jing Zhao. 
(cherry picked from commit 313f03bfdab32cf365bc3470c5f9b6928a24f099)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java

(cherry picked from commit c2708bc5fbf212ae6c48084442748c3265ddccd7)
 2016-09-15 11:05:52 -07:00
Haohui Mai
6f44510d87 HDFS-8200. Refactor FSDirStatAndListingOp. Contributed by Haohui Mai. 
(cherry picked from commit 01acf3a3af5727bfdc0a37f9caf4cf8e1be89224)
 2016-09-15 10:54:15 -07:00
Kihwal Lee
199ccd4915 HDFS-10744. Internally optimize path component resolution. Contributed by Daryn Sharp. 
(cherry picked from commit 1ef8d7a638df5150b8426755af034839d5f88ca2)
(cherry picked from commit 3dac73080a7cab3652512d56510235fdef157fa7)
 2016-09-13 21:58:58 -07:00
Tsz-Wo Nicholas Sze
9afc6615b0 In Balancer, the target task should be removed when its size < 0. Contributed by Yiqun Lin 
(cherry picked from commit cefa21e98a12b06602ee8000f8cef6c3b17af999)
 2016-09-12 23:28:34 -07:00
Kihwal Lee
a39a9fc46b HDFS-10673. Optimize FSPermissionChecker's internal path usage. Contributed by Daryn Sharp. 
(cherry picked from commit 438a9f047eb6af2a4b916a4f6ef6f68adeab8068)
(cherry picked from commit 09b06a6e9e873ad05fc2ebfaf0e9e9eba71516d2)
(cherry picked from commit f09b04b3f5252b0482e7ead5ed2661578cd4c56c)
 2016-09-12 15:57:48 -07:00
Tsz-Wo Nicholas Sze
32d810133c HDFS-8818. Changes the global moveExecutor to per datanode executors and changes MAX_SIZE_TO_MOVE to be configurable. 
(cherry picked from commit ac8d153046d542e9d13cb3f67c0461764eaf0a26)
 2016-09-12 15:01:58 -07:00
Xiaoyu Yao
d7da70332f HDFS-9019. Adding informative message to sticky bit permission denied exception. Contributed by Xiaoyu Yao. 
(cherry picked from commit 970daaa5e44d3c09afd46d1c8e923a5096708c44)
(cherry picked from commit b2465690a15ee4257b381a8d186ffa6981ddc537)
 2016-09-12 13:16:31 -07:00
Yongjun Zhang
e6c162a394 HDFS-10276. HDFS should not expose path info that user has no permission to see. (Yuanbo Liu via Yongjun Zhang) 
(cherry picked from commit 5ea6fd85c7aff6df28b87789f607bb57ee920639)
(cherry picked from commit 3e4c7906c2cf5c3e4c708fc56b670fa788e8cec7)
 2016-09-12 13:02:56 -07:00
Yongjun Zhang
97e4b13038 HDFS-5802. NameNode does not check for inode type before traversing down a path. (Xiao Chen via Yongjun Zhang) 
(cherry picked from commit 9859fd006b638d94c9842a719f12c51159746fc8)
 2016-09-12 12:58:00 -07:00
Akira Ajisaka
e807fde448 HADOOP-13579. Fix source-level compatibility after HADOOP-11252. Contributed by Tsuyoshi Ozawa. 2016-09-09 14:27:57 +09:00
Arpit Agarwal
607801b2ff HDFS-9038. DFS reserved space is erroneously counted towards non-DFS used. (Brahma Reddy Battula) 2016-09-08 13:40:01 -07:00