Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,126 Commits 326 Branches 371 Tags
Commit Graph

10126 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Jing Zhao
d6fbd4124c HDFS-1172. Blocks in newly completed files are considered under-replicated too quickly. Contributed by Masatake Iwasaki. 
(cherry picked from commit 2a987243423eb5c7e191de2ba969b7591a441c70)
 2015-10-13 23:07:08 -07:00
Colin Patrick Mccabe
fea7e472c8 Add CHANGES.txt entry for HDFS-9187 2015-10-13 16:22:23 -07:00
Colin Patrick Mccabe
d37f88674f HDFS-9187. Fix null pointer error in Globber when FS was not constructed via FileSystem#createFileSystem (cmccabe) 
(cherry picked from commit d286032b715192ddbdd770b07d623fdc396810e2)
 2015-10-13 16:21:13 -07:00
Haohui Mai
ee04add696 HDFS-9167. Update pom.xml in other modules to depend on hdfs-client instead of hdfs. Contributed by Mingliang Liu. 2015-10-13 15:24:29 -07:00
Haohui Mai
65d41fd896 HDFS-8779. WebUI fails to display block IDs that are larger than 2^53 - 1. Contributed by Haohui Mai. 2015-10-13 13:51:32 -07:00
Steve Loughran
5eab51a24f HADOOP-10775. Shell operations to fail with meaningful errors on windows if winutils.exe not found. (stevel) 2015-10-13 21:47:54 +01:00
Haohui Mai
016d9fa9b9 HDFS-9235. hdfs-native-client build getting errors when built with cmake 2.6. Contributed by Eric Payne. 2015-10-13 13:42:50 -07:00
Tsuyoshi Ozawa
171e54e12c HADOOP-11515. Upgrade jsch lib to jsch-0.1.51 to avoid problems running on java7. (stevel and ozawa) 
(cherry picked from commit 33fefa33e51133aaf1e699e087e3bca2e8065eec)
 2015-10-14 05:32:01 +09:00
Haohui Mai
5c5362980c HDFS-9145. Tracking methods that hold FSNamesytemLock for too long. Contributed by Mingliang Liu. 2015-10-13 13:20:17 -07:00
Steve Loughran
38f86c0842 HADOOP-12449. TestDNS and TestNetUtils failing if no network. (stevel) 2015-10-13 21:13:41 +01:00
Haohui Mai
950e8a459e HADOOP-12474. MiniKMS should use random ports for Jetty server by default. Contributed by Mingliang Liu. 2015-10-13 13:08:03 -07:00
Colin Patrick Mccabe
535c903bc6 HADOOP-12344. Improve validateSocketPathSecurity0 error message (Casey Brotherton via Colin P. McCabe) 
(cherry picked from commit 6716f159645639edc669900308250492dfef5641)
 2015-10-13 12:25:48 -07:00
Jitendra Pandey
e7203b6954 HDFS-8855. Webhdfs client leaks active NameNode connections. Contributed by Xiaobing Zhou. 2015-10-13 09:14:01 -07:00
Kihwal Lee
f203b84cf4 HDFS-8676. Delayed rolling upgrade finalization can cause heartbeat expiration. Contributed by Walter Su. 
(cherry picked from commit 5b43db47a313decccdcca8f45c5708aab46396df)
 2015-10-13 10:07:47 -05:00
Vinayakumar B
b0b97dfbef HDFS-9139. Enable parallel JUnit tests for HDFS Pre-commit (Contributed by Chris Nauroth and Vinayakumar B) 
(cherry picked from commit 39581e3be2aaeb1eeb7fb98b6bdecd8d4e3c7269)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestEditLogTailer.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestSeveralNameNodes.java
 2015-10-13 19:29:51 +05:30
Vinayakumar B
b01eaa3b46 HDFS-9160. [OIV-Doc] : Missing details of 'delimited' for processor options (Contributed by nijel) 
(cherry picked from commit caa711b660ce73c0f6bf97e3499d157a3a2daaea)
 2015-10-13 18:14:04 +05:30
Varun Vasudev
34b8142802 YARN-4017. container-executor overuses PATH_MAX. Contributed by Sidharta Seethana 
(cherry picked from commit 5b6bae00942c495e4be6ea2b8eb0676a48468dc6)
 2015-10-13 12:50:28 +05:30
Vinayakumar B
50253c43f0 HDFS-9224. TestFileTruncate fails intermittently with BindException (Contributed by Brahma Reddy Battula) 
(cherry picked from commit 69b025dbbaa44395e49d1c04b90e1f65f0fc1132)
 2015-10-13 11:43:32 +05:30
Lei Xu
218aa7bba1 HDFS-9006. Provide BlockPlacementPolicy that supports upgrade domain. (Ming Ma via lei) 
(cherry picked from commit 0f5f9846edab3ea7e80f35000072136f998bcd46)
 2015-10-12 16:24:46 -07:00
Haohui Mai
eed61a5eda Addendum patch for HDFS-9215. 2015-10-12 15:52:15 -07:00
Jian He
ee1ce393f5 YARN-4230. RM crashes with NPE when increasing container resource if there is no headroom left. Contributed by Meng Ding 
(cherry picked from commit 9849c8b3865c7c9c9be81ae0ef8f29caa1d5f881)
 2015-10-12 11:52:04 -07:00
yliu
146f297d7d HADOOP-10300. Allowed deferred sending of call responses. (Daryn Sharp via yliu) 2015-10-12 16:05:47 +08:00
Zhihai Xu
9988b57e71 YARN-4201. AMBlacklist does not work for minicluster. Contributed by Jun Gong. 
(cherry picked from commit 049c6e8dc0f952b5ff7d394aa564ab7db13e4f26)
 2015-10-12 00:16:40 -07:00
yliu
85b5481d87 HDFS-8988. Use LightWeightHashSet instead of LightWeightLinkedSet in BlockManager#excessReplicateMap. (yliu) 2015-10-12 14:55:58 +08:00
yliu
5e2a44a7fe HDFS-9221. HdfsServerConstants#ReplicaState#getState should avoid calling values() since it creates a temporary array. (Staffan Friberg via yliu) 2015-10-12 14:30:01 +08:00
Devaraj K
28edc7b129 YARN-3964. Support NodeLabelsProvider at Resource Manager side. 
Contributed by Dian Fu.

(cherry picked from commit db9304788187c700647c4d84caeb3b5ad6d868d8)
 2015-10-11 11:24:05 +05:30
Haohui Mai
f6b0fcdc75 Revert "HADOOP-12469. distcp shout not ignore the ignoreFailures option. Contributed by Mingliang Liu." 
This reverts commit a412edf5c4838e007217652e1cb6a24e73b7e735.
 2015-10-10 03:25:16 -07:00
Haohui Mai
a412edf5c4 HADOOP-12469. distcp shout not ignore the ignoreFailures option. Contributed by Mingliang Liu. 2015-10-09 22:38:13 -07:00
Haohui Mai
d578165b99 HDFS-9222. Add hadoop-hdfs-client as a dependency of hadoop-hdfs-native-client. Contributed by Mingliang Liu. 2015-10-09 22:31:23 -07:00
Haohui Mai
ce0bb73c10 HDFS-9215. Suppress the RAT warnings in hdfs-native-client module. Contributed by Haohui Mai. 2015-10-09 22:20:55 -07:00
Wangda Tan
37642abb83 YARN-4140. RM container allocation delayed incase of app submitted to Nodelabel partition. (Bibin A Chundatt via wangda) 
(cherry picked from commit def374e666ed0c1d665aeb1b7307e09769448138)
 2015-10-09 16:40:10 -07:00
Andrew Wang
12d3b69217 HDFS-8941. DistributedFileSystem listCorruptFileBlocks API should resolve relative path. Contributed by Rakesh R. 
(cherry picked from commit c32614f410fb62a7179abfefbab42a05415a3066)
 2015-10-09 11:57:07 -07:00
Andrew Wang
673f301408 HDFS-9110. Use Files.walkFileTree in NNUpgradeUtil#doPreUpgrade for better efficiency. Contributed by Charlie Helin. 
(cherry picked from commit 357b1fd0822447f9e73a20c69f37006d9a37ecbc)
 2015-10-09 11:49:27 -07:00
Ming Ma
02380e0156 HDFS-9142. Separating Configuration object for namenode(s) in MiniDFSCluster. (Siqi Li via mingma) 
(cherry picked from commit de8efc65a455c10ae7280b5982c48f9aca84c9d4)
 2015-10-09 11:41:54 -07:00
Yongjun Zhang
61988f8016 HDFS-9181. Better handling of exceptions thrown during upgrade shutdown. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit c11fc8a1be222f870cded0b24736387e44cc788c)
 2015-10-09 09:24:37 -07:00
Karthik Kambatla
2d8f9e3fd9 MAPREDUCE-6302. Incorrect headroom can lead to a deadlock between map and reduce allocations. (kasha) 
(cherry picked from commit 4aa9b3e75ca86917125e56e1b438668273a5d87f)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/RMContainerAllocator.java
 2015-10-09 07:54:47 -07:00
Jason Lowe
0139517811 YARN-261. Ability to fail AM attempts. Contributed by Andrey Klochkov and Rohith Sharma K S 
(cherry picked from commit a0bca2b5ad2344fda5411d910a3730c85f12a0df)
 2015-10-09 14:19:41 +00:00
Rohith Sharma K S
21609e8e9a YARN-4235. FairScheduler PrimaryGroup does not handle empty groups returned for a user. (Anubhav Dhoot via rohithsharmaks) 
(cherry picked from commit 8f195387a4a4a5a278119bf4c2f15cad61f0e2c7)
 2015-10-09 10:11:53 +05:30
Akira Ajisaka
2c6c9e315c HADOOP-11104. org.apache.hadoop.metrics2.lib.MetricsRegistry needs numerical parameter checking. Contributed by Ray Chiang. 
(cherry picked from commit e1bf8b3df6f019b92a3dad37c977f40397324e75)
 2015-10-09 11:10:54 +09:00
Akira Ajisaka
22ff37f5ce MAPREDUCE-6479. Add missing mapred job command options in mapreduce document. Contributed by nijel. 
(cherry picked from commit 584cf3bb35b96749f711b9e7145cf3fb71897cd9)
 2015-10-09 10:58:15 +09:00
Jason Lowe
ec74b0cd4e YARN-3943. Use separate threshold configurations for disk-full detection and disk-not-full detection. Contributed by Zhihai Xu 
(cherry picked from commit 8d226225d030253152494bda32708377ad0f7af7)
 2015-10-08 22:26:35 +00:00
Jason Lowe
1caa05de4a Fixup CHANGES.txt to reflect recent commits to 2.7.2 and 2.6.2 
(cherry picked from commit 0841940a21737890e01731e66bc403786a78a922)
 2015-10-08 16:47:30 +00:00
Yongjun Zhang
aaf7b73fe4 HDFS-8164. cTime is 0 in VERSION file for newly formatted NameNode. Contributed by Xiao Chen. 
(cherry picked from commit 1107bd399c790467b22e55291c2611fd1c16e156)
 2015-10-07 23:23:36 -07:00
yliu
22ed1471bd HDFS-9137. DeadLock between DataNode#refreshVolumes and BPOfferService#registrationSucceeded. (Uma Maheswara Rao G via yliu) 2015-10-08 10:26:30 +08:00
Andrew Wang
2f4bcdef8c HDFS-9211. Fix incorrect version in hadoop-hdfs-native-client/pom.xml from HDFS-9170 branch-2 backport. Contributed by Eric Payne. 2015-10-07 18:04:19 -07:00
Lei Xu
ad1f0f307b HDFS-9176. Fix TestDirectoryScanner#testThrottling often fails. (Daniel Templeton via lei) 
(cherry picked from commit 6dd47d754cb11297c8710a5c318c034abea7a836)
 2015-10-07 14:34:18 -07:00
Akira Ajisaka
613c7088fd HADOOP-12465. Incorrect javadoc in WritableUtils.java. Contributed by Jagadesh Kiran N. 
(cherry picked from commit 7fbf69bf47bb733f95b4afd733f9b65e1e7f2b46)
 2015-10-08 06:09:02 +09:00
Kihwal Lee
c43181d8a7 HDFS-9178. Slow datanode I/O can cause a wrong node to be marked bad. Contributed by Kihwal Lee. 
(cherry picked from commit 99e5204ff5326430558b6f6fd9da7c44654c15d7)
 2015-10-07 10:18:35 -05:00
Vinayakumar B
2b6fe90764 HDFS-9159. [OIV] : return value of the command is not correct if invalid value specified in '-p (processor)' option (Contributed by nijel) 
(cherry picked from commit 61b3547c462a4e51d0a31c0a8c8ce210e2d90df8)
 2015-10-07 14:30:07 +05:30
Haohui Mai
960b19edf6 HDFS-9170. Move libhdfs / fuse-dfs / libwebhdfs to hdfs-client. Contributed by Haohui Mai. 2015-10-07 00:15:52 -07:00