Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,651 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

10651 Commits

Author SHA1 Message Date
Devaraj K 28edc7b129 YARN-3964. Support NodeLabelsProvider at Resource Manager side. 
Contributed by Dian Fu.

(cherry picked from commit db93047881)
 2015-10-11 11:24:05 +05:30
Haohui Mai f6b0fcdc75 Revert "HADOOP-12469. distcp shout not ignore the ignoreFailures option. Contributed by Mingliang Liu." 
This reverts commit a412edf5c4.
 2015-10-10 03:25:16 -07:00
Haohui Mai a412edf5c4 HADOOP-12469. distcp shout not ignore the ignoreFailures option. Contributed by Mingliang Liu. 2015-10-09 22:38:13 -07:00
Haohui Mai d578165b99 HDFS-9222. Add hadoop-hdfs-client as a dependency of hadoop-hdfs-native-client. Contributed by Mingliang Liu. 2015-10-09 22:31:23 -07:00
Haohui Mai ce0bb73c10 HDFS-9215. Suppress the RAT warnings in hdfs-native-client module. Contributed by Haohui Mai. 2015-10-09 22:20:55 -07:00
Wangda Tan 37642abb83 YARN-4140. RM container allocation delayed incase of app submitted to Nodelabel partition. (Bibin A Chundatt via wangda) 
(cherry picked from commit def374e666)
 2015-10-09 16:40:10 -07:00
Andrew Wang 12d3b69217 HDFS-8941. DistributedFileSystem listCorruptFileBlocks API should resolve relative path. Contributed by Rakesh R. 
(cherry picked from commit c32614f410)
 2015-10-09 11:57:07 -07:00
Andrew Wang 673f301408 HDFS-9110. Use Files.walkFileTree in NNUpgradeUtil#doPreUpgrade for better efficiency. Contributed by Charlie Helin. 
(cherry picked from commit 357b1fd082)
 2015-10-09 11:49:27 -07:00
Ming Ma 02380e0156 HDFS-9142. Separating Configuration object for namenode(s) in MiniDFSCluster. (Siqi Li via mingma) 
(cherry picked from commit de8efc65a4)
 2015-10-09 11:41:54 -07:00
Yongjun Zhang 61988f8016 HDFS-9181. Better handling of exceptions thrown during upgrade shutdown. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit c11fc8a1be)
 2015-10-09 09:24:37 -07:00
Karthik Kambatla 2d8f9e3fd9 MAPREDUCE-6302. Incorrect headroom can lead to a deadlock between map and reduce allocations. (kasha) 
(cherry picked from commit 4aa9b3e75c)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/RMContainerAllocator.java
 2015-10-09 07:54:47 -07:00
Jason Lowe 0139517811 YARN-261. Ability to fail AM attempts. Contributed by Andrey Klochkov and Rohith Sharma K S 
(cherry picked from commit a0bca2b5ad)
 2015-10-09 14:19:41 +00:00
Rohith Sharma K S 21609e8e9a YARN-4235. FairScheduler PrimaryGroup does not handle empty groups returned for a user. (Anubhav Dhoot via rohithsharmaks) 
(cherry picked from commit 8f195387a4)
 2015-10-09 10:11:53 +05:30
Akira Ajisaka 2c6c9e315c HADOOP-11104. org.apache.hadoop.metrics2.lib.MetricsRegistry needs numerical parameter checking. Contributed by Ray Chiang. 
(cherry picked from commit e1bf8b3df6)
 2015-10-09 11:10:54 +09:00
Akira Ajisaka 22ff37f5ce MAPREDUCE-6479. Add missing mapred job command options in mapreduce document. Contributed by nijel. 
(cherry picked from commit 584cf3bb35)
 2015-10-09 10:58:15 +09:00
Jason Lowe ec74b0cd4e YARN-3943. Use separate threshold configurations for disk-full detection and disk-not-full detection. Contributed by Zhihai Xu 
(cherry picked from commit 8d226225d0)
 2015-10-08 22:26:35 +00:00
Jason Lowe 1caa05de4a Fixup CHANGES.txt to reflect recent commits to 2.7.2 and 2.6.2 
(cherry picked from commit 0841940a21)
 2015-10-08 16:47:30 +00:00
Yongjun Zhang aaf7b73fe4 HDFS-8164. cTime is 0 in VERSION file for newly formatted NameNode. Contributed by Xiao Chen. 
(cherry picked from commit 1107bd399c)
 2015-10-07 23:23:36 -07:00
yliu 22ed1471bd HDFS-9137. DeadLock between DataNode#refreshVolumes and BPOfferService#registrationSucceeded. (Uma Maheswara Rao G via yliu) 2015-10-08 10:26:30 +08:00
Andrew Wang 2f4bcdef8c HDFS-9211. Fix incorrect version in hadoop-hdfs-native-client/pom.xml from HDFS-9170 branch-2 backport. Contributed by Eric Payne. 2015-10-07 18:04:19 -07:00
Lei Xu ad1f0f307b HDFS-9176. Fix TestDirectoryScanner#testThrottling often fails. (Daniel Templeton via lei) 
(cherry picked from commit 6dd47d754c)
 2015-10-07 14:34:18 -07:00
Akira Ajisaka 613c7088fd HADOOP-12465. Incorrect javadoc in WritableUtils.java. Contributed by Jagadesh Kiran N. 
(cherry picked from commit 7fbf69bf47)
 2015-10-08 06:09:02 +09:00
Kihwal Lee c43181d8a7 HDFS-9178. Slow datanode I/O can cause a wrong node to be marked bad. Contributed by Kihwal Lee. 
(cherry picked from commit 99e5204ff5)
 2015-10-07 10:18:35 -05:00
Vinayakumar B 2b6fe90764 HDFS-9159. [OIV] : return value of the command is not correct if invalid value specified in '-p (processor)' option (Contributed by nijel) 
(cherry picked from commit 61b3547c46)
 2015-10-07 14:30:07 +05:30
Haohui Mai 960b19edf6 HDFS-9170. Move libhdfs / fuse-dfs / libwebhdfs to hdfs-client. Contributed by Haohui Mai. 2015-10-07 00:15:52 -07:00
Jing Zhao a4b8dc48f1 HDFS-9196. Fix TestWebHdfsContentLength. Contributed by Masatake Iwasaki. 
(cherry picked from commit 239d119c67)
 2015-10-06 23:55:33 -07:00
Rohith Sharma K S 99126714a3 YARN-4228. FileSystemRMStateStore use IOUtils#close instead of fs#close. (Bibin A Chundatt via rohithsharmaks) 
(cherry picked from commit 3793cbe4c3)
 2015-10-07 10:20:36 +05:30
Rohith Sharma K S 053fcf4c0d YARN-4209. RMStateStore FENCED state doesn’t work due to updateFencedState called by stateMachine.doTransition. (Zhihai Xu via rohithsharmaks) 
(cherry picked from commit 9156fc60c6)
 2015-10-07 09:37:14 +05:30
Robert Kanter e5bf4594cc MAPREDUCE-6503. archive-logs tool should use HADOOP_PREFIX instead of HADOOP_HOME (rkanter) 
(cherry picked from commit 1bca1bb517)
 2015-10-06 16:50:18 -07:00
Steve Loughran fa3e774295 HADOOP-12284. UserGroupInformation doAs can throw misleading exception (Aaron Dosset via stevel) 2015-10-06 21:39:33 +01:00
Wangda Tan 5453a63612 YARN-4215. RMNodeLabels Manager Need to verify and replace node labels for the only modified Node Label Mappings in the request. (Naganarasimha G R via wangda) 
(cherry picked from commit 29a582ada0)
 2015-10-06 11:59:10 -07:00
Vinayakumar B 96fbe42bd7 HDFS-7899. Improve EOF error message (Contributed by Jagadesh Kiran N) 
(cherry picked from commit 874c8ed239)
 2015-10-06 15:55:12 +05:30
cnauroth 535762fadb HADOOP-12350. WASB Logging: Improve WASB Logging around deletes, reads and writes. Contributed by Dushyanth. 
(cherry picked from commit 5f6edb30c2)
 2015-10-05 20:12:33 -07:00
Wangda Tan d24a3b9a3c YARN-4176. Resync NM nodelabels with RM periodically for distributed nodelabels. (Bibin A Chundatt via wangda) 
(cherry picked from commit 30ac69c6bd)
 2015-10-05 15:48:40 -07:00
Colin Patrick Mccabe 05b88080b6 HDFS-9155. OEV should treat .XML files as XML even when the file name extension is uppercase (nijel via cmccabe) 
(cherry picked from commit 2fc2b50534)
 2015-10-05 13:02:55 -07:00
Colin Patrick Mccabe a509413c9a HADOOP-12452. Fix tracing documention reflecting the update to htrace-4 (Masatake Iwasaki via Colin P. McCabe) 
(cherry picked from commit 3e1752f9fb)
 2015-10-05 11:36:00 -07:00
Vinod Kumar Vavilapalli b876babdc7 HADOOP-12441. Fixed shell-kill command behaviour to work correctly on some Linux distributions after HADOOP-12317. Contributed by Wangda Tan. 
(cherry picked from commit f1c19b9365)
 2015-10-05 10:57:55 -07:00
Vinayakumar B d843c50d58 HDFS-9158. [OEV-Doc] : Document does not mention about '-f' and '-r' options (Contributed by nijel) 
(cherry picked from commit b925cf1006)
 2015-10-05 18:23:37 +05:30
Vinayakumar B dc72ed7218 HDFS-9151. Mover should print the exit status/reason on console like balancer tool. (Contributed by Surendra singh lilhore) 
(cherry picked from commit 0faa4efa3d)
 2015-10-05 13:23:30 +05:30
Tsuyoshi Ozawa e6514c6a3b HADOOP-11098. [JDK8] Max Non Heap Memory default changed between JDK7 and 8. 
(cherry picked from commit 30e2f836a2)
 2015-10-05 08:15:40 +09:00
Haohui Mai 460b5db9ff HDFS-9193. Fix incorrect references the usages of the DN in dfshealth.js. Contributed by Chang Li. 2015-10-03 11:44:40 -07:00
Haohui Mai 1257483ebf HDFS-8979. Clean up checkstyle warnings in hadoop-hdfs-client module. Contributed by Mingliang Liu. 2015-10-03 11:37:19 -07:00
Harsh J 21b4ba48ce HADOOP-12458. Retries is typoed to spell Retires in parts of hadoop-yarn and hadoop-common. Contributed by Neelesh Srinivas Salian. 
(cherry picked from commit c918f7be5e)
 2015-10-03 18:39:22 +05:30
Jakob Homan caa970974c HDFS-9191. Typo in Hdfs.java. NoSuchElementException is misspelled. Contributed by Catherine Palmer. 
(cherry picked from commit 3929ac9340)
 2015-10-03 10:50:03 +02:00
Xuan 53bddc410f YARN-1897. CLI and core support for signal container functionality. Contributed by Ming Ma 
(cherry picked from commit 8f08532bde)
 2015-10-02 18:53:04 -07:00
Jason Lowe 3e3733437f YARN-3619. ContainerMetrics unregisters during getMetrics and leads to ConcurrentModificationException. Contributed by Zhihai Xu 
(cherry picked from commit fdf02d1f26)
 2015-10-02 20:21:32 +00:00
Kihwal Lee b5d08e29e1 fix CHANGES.txt 2015-10-02 15:02:23 -05:00
Yongjun Zhang 7964b13405 HDFS-9100. HDFS Balancer does not respect dfs.client.use.datanode.hostname. Contributed by Casey Brotherton. 
(cherry picked from commit 1037ee580f)
 2015-10-02 12:08:55 -07:00
Lei Xu 4d01dbda50 HDFS-9015. Refactor TestReplicationPolicy to test different block placement policies. (Ming Ma via lei) 
(cherry picked from commit 260b9d9410e45dbcb89d97d58450c79220c9e7bc)
 2015-10-02 11:41:45 -07:00
rohithsharmaks 7dd9ebdebc MAPREDUCE-6485. Create a new task attempt with failed map task priority if in-progress attempts are unassigned. (Xianyin Xin via rohithsharmaks) 
(cherry picked from commit 439f43ad3d)
 2015-10-02 20:36:20 +05:30