Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,115 Commits 326 Branches 371 Tags
Commit Graph

10115 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Colin Patrick Mccabe
535c903bc6 HADOOP-12344. Improve validateSocketPathSecurity0 error message (Casey Brotherton via Colin P. McCabe) 
(cherry picked from commit 6716f159645639edc669900308250492dfef5641)
 2015-10-13 12:25:48 -07:00
Jitendra Pandey
e7203b6954 HDFS-8855. Webhdfs client leaks active NameNode connections. Contributed by Xiaobing Zhou. 2015-10-13 09:14:01 -07:00
Kihwal Lee
f203b84cf4 HDFS-8676. Delayed rolling upgrade finalization can cause heartbeat expiration. Contributed by Walter Su. 
(cherry picked from commit 5b43db47a313decccdcca8f45c5708aab46396df)
 2015-10-13 10:07:47 -05:00
Vinayakumar B
b0b97dfbef HDFS-9139. Enable parallel JUnit tests for HDFS Pre-commit (Contributed by Chris Nauroth and Vinayakumar B) 
(cherry picked from commit 39581e3be2aaeb1eeb7fb98b6bdecd8d4e3c7269)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestEditLogTailer.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestSeveralNameNodes.java
 2015-10-13 19:29:51 +05:30
Vinayakumar B
b01eaa3b46 HDFS-9160. [OIV-Doc] : Missing details of 'delimited' for processor options (Contributed by nijel) 
(cherry picked from commit caa711b660ce73c0f6bf97e3499d157a3a2daaea)
 2015-10-13 18:14:04 +05:30
Varun Vasudev
34b8142802 YARN-4017. container-executor overuses PATH_MAX. Contributed by Sidharta Seethana 
(cherry picked from commit 5b6bae00942c495e4be6ea2b8eb0676a48468dc6)
 2015-10-13 12:50:28 +05:30
Vinayakumar B
50253c43f0 HDFS-9224. TestFileTruncate fails intermittently with BindException (Contributed by Brahma Reddy Battula) 
(cherry picked from commit 69b025dbbaa44395e49d1c04b90e1f65f0fc1132)
 2015-10-13 11:43:32 +05:30
Lei Xu
218aa7bba1 HDFS-9006. Provide BlockPlacementPolicy that supports upgrade domain. (Ming Ma via lei) 
(cherry picked from commit 0f5f9846edab3ea7e80f35000072136f998bcd46)
 2015-10-12 16:24:46 -07:00
Haohui Mai
eed61a5eda Addendum patch for HDFS-9215. 2015-10-12 15:52:15 -07:00
Jian He
ee1ce393f5 YARN-4230. RM crashes with NPE when increasing container resource if there is no headroom left. Contributed by Meng Ding 
(cherry picked from commit 9849c8b3865c7c9c9be81ae0ef8f29caa1d5f881)
 2015-10-12 11:52:04 -07:00
yliu
146f297d7d HADOOP-10300. Allowed deferred sending of call responses. (Daryn Sharp via yliu) 2015-10-12 16:05:47 +08:00
Zhihai Xu
9988b57e71 YARN-4201. AMBlacklist does not work for minicluster. Contributed by Jun Gong. 
(cherry picked from commit 049c6e8dc0f952b5ff7d394aa564ab7db13e4f26)
 2015-10-12 00:16:40 -07:00
yliu
85b5481d87 HDFS-8988. Use LightWeightHashSet instead of LightWeightLinkedSet in BlockManager#excessReplicateMap. (yliu) 2015-10-12 14:55:58 +08:00
yliu
5e2a44a7fe HDFS-9221. HdfsServerConstants#ReplicaState#getState should avoid calling values() since it creates a temporary array. (Staffan Friberg via yliu) 2015-10-12 14:30:01 +08:00
Devaraj K
28edc7b129 YARN-3964. Support NodeLabelsProvider at Resource Manager side. 
Contributed by Dian Fu.

(cherry picked from commit db9304788187c700647c4d84caeb3b5ad6d868d8)
 2015-10-11 11:24:05 +05:30
Haohui Mai
f6b0fcdc75 Revert "HADOOP-12469. distcp shout not ignore the ignoreFailures option. Contributed by Mingliang Liu." 
This reverts commit a412edf5c4838e007217652e1cb6a24e73b7e735.
 2015-10-10 03:25:16 -07:00
Haohui Mai
a412edf5c4 HADOOP-12469. distcp shout not ignore the ignoreFailures option. Contributed by Mingliang Liu. 2015-10-09 22:38:13 -07:00
Haohui Mai
d578165b99 HDFS-9222. Add hadoop-hdfs-client as a dependency of hadoop-hdfs-native-client. Contributed by Mingliang Liu. 2015-10-09 22:31:23 -07:00
Haohui Mai
ce0bb73c10 HDFS-9215. Suppress the RAT warnings in hdfs-native-client module. Contributed by Haohui Mai. 2015-10-09 22:20:55 -07:00
Wangda Tan
37642abb83 YARN-4140. RM container allocation delayed incase of app submitted to Nodelabel partition. (Bibin A Chundatt via wangda) 
(cherry picked from commit def374e666ed0c1d665aeb1b7307e09769448138)
 2015-10-09 16:40:10 -07:00
Andrew Wang
12d3b69217 HDFS-8941. DistributedFileSystem listCorruptFileBlocks API should resolve relative path. Contributed by Rakesh R. 
(cherry picked from commit c32614f410fb62a7179abfefbab42a05415a3066)
 2015-10-09 11:57:07 -07:00
Andrew Wang
673f301408 HDFS-9110. Use Files.walkFileTree in NNUpgradeUtil#doPreUpgrade for better efficiency. Contributed by Charlie Helin. 
(cherry picked from commit 357b1fd0822447f9e73a20c69f37006d9a37ecbc)
 2015-10-09 11:49:27 -07:00
Ming Ma
02380e0156 HDFS-9142. Separating Configuration object for namenode(s) in MiniDFSCluster. (Siqi Li via mingma) 
(cherry picked from commit de8efc65a455c10ae7280b5982c48f9aca84c9d4)
 2015-10-09 11:41:54 -07:00
Yongjun Zhang
61988f8016 HDFS-9181. Better handling of exceptions thrown during upgrade shutdown. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit c11fc8a1be222f870cded0b24736387e44cc788c)
 2015-10-09 09:24:37 -07:00
Karthik Kambatla
2d8f9e3fd9 MAPREDUCE-6302. Incorrect headroom can lead to a deadlock between map and reduce allocations. (kasha) 
(cherry picked from commit 4aa9b3e75ca86917125e56e1b438668273a5d87f)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/RMContainerAllocator.java
 2015-10-09 07:54:47 -07:00
Jason Lowe
0139517811 YARN-261. Ability to fail AM attempts. Contributed by Andrey Klochkov and Rohith Sharma K S 
(cherry picked from commit a0bca2b5ad2344fda5411d910a3730c85f12a0df)
 2015-10-09 14:19:41 +00:00
Rohith Sharma K S
21609e8e9a YARN-4235. FairScheduler PrimaryGroup does not handle empty groups returned for a user. (Anubhav Dhoot via rohithsharmaks) 
(cherry picked from commit 8f195387a4a4a5a278119bf4c2f15cad61f0e2c7)
 2015-10-09 10:11:53 +05:30
Akira Ajisaka
2c6c9e315c HADOOP-11104. org.apache.hadoop.metrics2.lib.MetricsRegistry needs numerical parameter checking. Contributed by Ray Chiang. 
(cherry picked from commit e1bf8b3df6f019b92a3dad37c977f40397324e75)
 2015-10-09 11:10:54 +09:00
Akira Ajisaka
22ff37f5ce MAPREDUCE-6479. Add missing mapred job command options in mapreduce document. Contributed by nijel. 
(cherry picked from commit 584cf3bb35b96749f711b9e7145cf3fb71897cd9)
 2015-10-09 10:58:15 +09:00
Jason Lowe
ec74b0cd4e YARN-3943. Use separate threshold configurations for disk-full detection and disk-not-full detection. Contributed by Zhihai Xu 
(cherry picked from commit 8d226225d030253152494bda32708377ad0f7af7)
 2015-10-08 22:26:35 +00:00
Jason Lowe
1caa05de4a Fixup CHANGES.txt to reflect recent commits to 2.7.2 and 2.6.2 
(cherry picked from commit 0841940a21737890e01731e66bc403786a78a922)
 2015-10-08 16:47:30 +00:00
Yongjun Zhang
aaf7b73fe4 HDFS-8164. cTime is 0 in VERSION file for newly formatted NameNode. Contributed by Xiao Chen. 
(cherry picked from commit 1107bd399c790467b22e55291c2611fd1c16e156)
 2015-10-07 23:23:36 -07:00
yliu
22ed1471bd HDFS-9137. DeadLock between DataNode#refreshVolumes and BPOfferService#registrationSucceeded. (Uma Maheswara Rao G via yliu) 2015-10-08 10:26:30 +08:00
Andrew Wang
2f4bcdef8c HDFS-9211. Fix incorrect version in hadoop-hdfs-native-client/pom.xml from HDFS-9170 branch-2 backport. Contributed by Eric Payne. 2015-10-07 18:04:19 -07:00
Lei Xu
ad1f0f307b HDFS-9176. Fix TestDirectoryScanner#testThrottling often fails. (Daniel Templeton via lei) 
(cherry picked from commit 6dd47d754cb11297c8710a5c318c034abea7a836)
 2015-10-07 14:34:18 -07:00
Akira Ajisaka
613c7088fd HADOOP-12465. Incorrect javadoc in WritableUtils.java. Contributed by Jagadesh Kiran N. 
(cherry picked from commit 7fbf69bf47bb733f95b4afd733f9b65e1e7f2b46)
 2015-10-08 06:09:02 +09:00
Kihwal Lee
c43181d8a7 HDFS-9178. Slow datanode I/O can cause a wrong node to be marked bad. Contributed by Kihwal Lee. 
(cherry picked from commit 99e5204ff5326430558b6f6fd9da7c44654c15d7)
 2015-10-07 10:18:35 -05:00
Vinayakumar B
2b6fe90764 HDFS-9159. [OIV] : return value of the command is not correct if invalid value specified in '-p (processor)' option (Contributed by nijel) 
(cherry picked from commit 61b3547c462a4e51d0a31c0a8c8ce210e2d90df8)
 2015-10-07 14:30:07 +05:30
Haohui Mai
960b19edf6 HDFS-9170. Move libhdfs / fuse-dfs / libwebhdfs to hdfs-client. Contributed by Haohui Mai. 2015-10-07 00:15:52 -07:00
Jing Zhao
a4b8dc48f1 HDFS-9196. Fix TestWebHdfsContentLength. Contributed by Masatake Iwasaki. 
(cherry picked from commit 239d119c6707e58c9a5e0099c6d65fe956e95140)
 2015-10-06 23:55:33 -07:00
Rohith Sharma K S
99126714a3 YARN-4228. FileSystemRMStateStore use IOUtils#close instead of fs#close. (Bibin A Chundatt via rohithsharmaks) 
(cherry picked from commit 3793cbe4c3cce5d03c4a18d562cbcb7cacd8f743)
 2015-10-07 10:20:36 +05:30
Rohith Sharma K S
053fcf4c0d YARN-4209. RMStateStore FENCED state doesn’t work due to updateFencedState called by stateMachine.doTransition. (Zhihai Xu via rohithsharmaks) 
(cherry picked from commit 9156fc60c654e9305411686878acb443f3be1e67)
 2015-10-07 09:37:14 +05:30
Robert Kanter
e5bf4594cc MAPREDUCE-6503. archive-logs tool should use HADOOP_PREFIX instead of HADOOP_HOME (rkanter) 
(cherry picked from commit 1bca1bb5175b5976a5a0e45b6e1c4486bdf87a0e)
 2015-10-06 16:50:18 -07:00
Steve Loughran
fa3e774295 HADOOP-12284. UserGroupInformation doAs can throw misleading exception (Aaron Dosset via stevel) 2015-10-06 21:39:33 +01:00
Wangda Tan
5453a63612 YARN-4215. RMNodeLabels Manager Need to verify and replace node labels for the only modified Node Label Mappings in the request. (Naganarasimha G R via wangda) 
(cherry picked from commit 29a582ada0fe195989eca25e5a995895e178f4ea)
 2015-10-06 11:59:10 -07:00
Vinayakumar B
96fbe42bd7 HDFS-7899. Improve EOF error message (Contributed by Jagadesh Kiran N) 
(cherry picked from commit 874c8ed2399ff5f760d358abae3e98c013f48d22)
 2015-10-06 15:55:12 +05:30
cnauroth
535762fadb HADOOP-12350. WASB Logging: Improve WASB Logging around deletes, reads and writes. Contributed by Dushyanth. 
(cherry picked from commit 5f6edb30c2bb648d5564c951edc25645e17e6636)
 2015-10-05 20:12:33 -07:00
Wangda Tan
d24a3b9a3c YARN-4176. Resync NM nodelabels with RM periodically for distributed nodelabels. (Bibin A Chundatt via wangda) 
(cherry picked from commit 30ac69c6bd3db363248d6c742561371576006dab)
 2015-10-05 15:48:40 -07:00
Colin Patrick Mccabe
05b88080b6 HDFS-9155. OEV should treat .XML files as XML even when the file name extension is uppercase (nijel via cmccabe) 
(cherry picked from commit 2fc2b50534c2052ed3f6f38f30d29d98d99fd10a)
 2015-10-05 13:02:55 -07:00
Colin Patrick Mccabe
a509413c9a HADOOP-12452. Fix tracing documention reflecting the update to htrace-4 (Masatake Iwasaki via Colin P. McCabe) 
(cherry picked from commit 3e1752f9fb762a8b3268247f0690374419b2c3a1)
 2015-10-05 11:36:00 -07:00