Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,538 Commits 326 Branches 371 Tags
Commit Graph

10538 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Akira Ajisaka
2c6c9e315c HADOOP-11104. org.apache.hadoop.metrics2.lib.MetricsRegistry needs numerical parameter checking. Contributed by Ray Chiang. 
(cherry picked from commit e1bf8b3df6f019b92a3dad37c977f40397324e75)
 2015-10-09 11:10:54 +09:00
Akira Ajisaka
22ff37f5ce MAPREDUCE-6479. Add missing mapred job command options in mapreduce document. Contributed by nijel. 
(cherry picked from commit 584cf3bb35b96749f711b9e7145cf3fb71897cd9)
 2015-10-09 10:58:15 +09:00
Jason Lowe
ec74b0cd4e YARN-3943. Use separate threshold configurations for disk-full detection and disk-not-full detection. Contributed by Zhihai Xu 
(cherry picked from commit 8d226225d030253152494bda32708377ad0f7af7)
 2015-10-08 22:26:35 +00:00
Jason Lowe
1caa05de4a Fixup CHANGES.txt to reflect recent commits to 2.7.2 and 2.6.2 
(cherry picked from commit 0841940a21737890e01731e66bc403786a78a922)
 2015-10-08 16:47:30 +00:00
Yongjun Zhang
aaf7b73fe4 HDFS-8164. cTime is 0 in VERSION file for newly formatted NameNode. Contributed by Xiao Chen. 
(cherry picked from commit 1107bd399c790467b22e55291c2611fd1c16e156)
 2015-10-07 23:23:36 -07:00
yliu
22ed1471bd HDFS-9137. DeadLock between DataNode#refreshVolumes and BPOfferService#registrationSucceeded. (Uma Maheswara Rao G via yliu) 2015-10-08 10:26:30 +08:00
Andrew Wang
2f4bcdef8c HDFS-9211. Fix incorrect version in hadoop-hdfs-native-client/pom.xml from HDFS-9170 branch-2 backport. Contributed by Eric Payne. 2015-10-07 18:04:19 -07:00
Lei Xu
ad1f0f307b HDFS-9176. Fix TestDirectoryScanner#testThrottling often fails. (Daniel Templeton via lei) 
(cherry picked from commit 6dd47d754cb11297c8710a5c318c034abea7a836)
 2015-10-07 14:34:18 -07:00
Akira Ajisaka
613c7088fd HADOOP-12465. Incorrect javadoc in WritableUtils.java. Contributed by Jagadesh Kiran N. 
(cherry picked from commit 7fbf69bf47bb733f95b4afd733f9b65e1e7f2b46)
 2015-10-08 06:09:02 +09:00
Kihwal Lee
c43181d8a7 HDFS-9178. Slow datanode I/O can cause a wrong node to be marked bad. Contributed by Kihwal Lee. 
(cherry picked from commit 99e5204ff5326430558b6f6fd9da7c44654c15d7)
 2015-10-07 10:18:35 -05:00
Vinayakumar B
2b6fe90764 HDFS-9159. [OIV] : return value of the command is not correct if invalid value specified in '-p (processor)' option (Contributed by nijel) 
(cherry picked from commit 61b3547c462a4e51d0a31c0a8c8ce210e2d90df8)
 2015-10-07 14:30:07 +05:30
Haohui Mai
960b19edf6 HDFS-9170. Move libhdfs / fuse-dfs / libwebhdfs to hdfs-client. Contributed by Haohui Mai. 2015-10-07 00:15:52 -07:00
Jing Zhao
a4b8dc48f1 HDFS-9196. Fix TestWebHdfsContentLength. Contributed by Masatake Iwasaki. 
(cherry picked from commit 239d119c6707e58c9a5e0099c6d65fe956e95140)
 2015-10-06 23:55:33 -07:00
Rohith Sharma K S
99126714a3 YARN-4228. FileSystemRMStateStore use IOUtils#close instead of fs#close. (Bibin A Chundatt via rohithsharmaks) 
(cherry picked from commit 3793cbe4c3cce5d03c4a18d562cbcb7cacd8f743)
 2015-10-07 10:20:36 +05:30
Rohith Sharma K S
053fcf4c0d YARN-4209. RMStateStore FENCED state doesn’t work due to updateFencedState called by stateMachine.doTransition. (Zhihai Xu via rohithsharmaks) 
(cherry picked from commit 9156fc60c654e9305411686878acb443f3be1e67)
 2015-10-07 09:37:14 +05:30
Robert Kanter
e5bf4594cc MAPREDUCE-6503. archive-logs tool should use HADOOP_PREFIX instead of HADOOP_HOME (rkanter) 
(cherry picked from commit 1bca1bb5175b5976a5a0e45b6e1c4486bdf87a0e)
 2015-10-06 16:50:18 -07:00
Steve Loughran
fa3e774295 HADOOP-12284. UserGroupInformation doAs can throw misleading exception (Aaron Dosset via stevel) 2015-10-06 21:39:33 +01:00
Wangda Tan
5453a63612 YARN-4215. RMNodeLabels Manager Need to verify and replace node labels for the only modified Node Label Mappings in the request. (Naganarasimha G R via wangda) 
(cherry picked from commit 29a582ada0fe195989eca25e5a995895e178f4ea)
 2015-10-06 11:59:10 -07:00
Vinayakumar B
96fbe42bd7 HDFS-7899. Improve EOF error message (Contributed by Jagadesh Kiran N) 
(cherry picked from commit 874c8ed2399ff5f760d358abae3e98c013f48d22)
 2015-10-06 15:55:12 +05:30
cnauroth
535762fadb HADOOP-12350. WASB Logging: Improve WASB Logging around deletes, reads and writes. Contributed by Dushyanth. 
(cherry picked from commit 5f6edb30c2bb648d5564c951edc25645e17e6636)
 2015-10-05 20:12:33 -07:00
Wangda Tan
d24a3b9a3c YARN-4176. Resync NM nodelabels with RM periodically for distributed nodelabels. (Bibin A Chundatt via wangda) 
(cherry picked from commit 30ac69c6bd3db363248d6c742561371576006dab)
 2015-10-05 15:48:40 -07:00
Colin Patrick Mccabe
05b88080b6 HDFS-9155. OEV should treat .XML files as XML even when the file name extension is uppercase (nijel via cmccabe) 
(cherry picked from commit 2fc2b50534c2052ed3f6f38f30d29d98d99fd10a)
 2015-10-05 13:02:55 -07:00
Colin Patrick Mccabe
a509413c9a HADOOP-12452. Fix tracing documention reflecting the update to htrace-4 (Masatake Iwasaki via Colin P. McCabe) 
(cherry picked from commit 3e1752f9fb762a8b3268247f0690374419b2c3a1)
 2015-10-05 11:36:00 -07:00
Vinod Kumar Vavilapalli
b876babdc7 HADOOP-12441. Fixed shell-kill command behaviour to work correctly on some Linux distributions after HADOOP-12317. Contributed by Wangda Tan. 
(cherry picked from commit f1c19b9365cbac88e45a9eed516fbfc6c9aa9947)
 2015-10-05 10:57:55 -07:00
Vinayakumar B
d843c50d58 HDFS-9158. [OEV-Doc] : Document does not mention about '-f' and '-r' options (Contributed by nijel) 
(cherry picked from commit b925cf100662e155c9efeff06523b09303817394)
 2015-10-05 18:23:37 +05:30
Vinayakumar B
dc72ed7218 HDFS-9151. Mover should print the exit status/reason on console like balancer tool. (Contributed by Surendra singh lilhore) 
(cherry picked from commit 0faa4efa3dd74de9cc39584bf6e88cfbf3e9a045)
 2015-10-05 13:23:30 +05:30
Tsuyoshi Ozawa
e6514c6a3b HADOOP-11098. [JDK8] Max Non Heap Memory default changed between JDK7 and 8. 
(cherry picked from commit 30e2f836a26490a24c7ddea754dd19f95b24bbc8)
 2015-10-05 08:15:40 +09:00
Haohui Mai
460b5db9ff HDFS-9193. Fix incorrect references the usages of the DN in dfshealth.js. Contributed by Chang Li. 2015-10-03 11:44:40 -07:00
Haohui Mai
1257483ebf HDFS-8979. Clean up checkstyle warnings in hadoop-hdfs-client module. Contributed by Mingliang Liu. 2015-10-03 11:37:19 -07:00
Harsh J
21b4ba48ce HADOOP-12458. Retries is typoed to spell Retires in parts of hadoop-yarn and hadoop-common. Contributed by Neelesh Srinivas Salian. 
(cherry picked from commit c918f7be5e6aecaa3cb0c23a95819329802d32d4)
 2015-10-03 18:39:22 +05:30
Jakob Homan
caa970974c HDFS-9191. Typo in Hdfs.java. NoSuchElementException is misspelled. Contributed by Catherine Palmer. 
(cherry picked from commit 3929ac9340a5c9f26574dc076a449f7e11931527)
 2015-10-03 10:50:03 +02:00
Xuan
53bddc410f YARN-1897. CLI and core support for signal container functionality. Contributed by Ming Ma 
(cherry picked from commit 8f08532bde153811368e1b8336446fba4743f9d2)
 2015-10-02 18:53:04 -07:00
Jason Lowe
3e3733437f YARN-3619. ContainerMetrics unregisters during getMetrics and leads to ConcurrentModificationException. Contributed by Zhihai Xu 
(cherry picked from commit fdf02d1f26cea372bf69e071f57b8bfc09c092c4)
 2015-10-02 20:21:32 +00:00
Kihwal Lee
b5d08e29e1 fix CHANGES.txt 2015-10-02 15:02:23 -05:00
Yongjun Zhang
7964b13405 HDFS-9100. HDFS Balancer does not respect dfs.client.use.datanode.hostname. Contributed by Casey Brotherton. 
(cherry picked from commit 1037ee580f87e6bf13155834c36f26794381678b)
 2015-10-02 12:08:55 -07:00
Lei Xu
4d01dbda50 HDFS-9015. Refactor TestReplicationPolicy to test different block placement policies. (Ming Ma via lei) 
(cherry picked from commit 260b9d9410e45dbcb89d97d58450c79220c9e7bc)
 2015-10-02 11:41:45 -07:00
rohithsharmaks
7dd9ebdebc MAPREDUCE-6485. Create a new task attempt with failed map task priority if in-progress attempts are unassigned. (Xianyin Xin via rohithsharmaks) 
(cherry picked from commit 439f43ad3defbac907eda2d139a793f153544430)
 2015-10-02 20:36:20 +05:30
Akira Ajisaka
966f9508c3 HADOOP-12230. hadoop-project declares duplicate, conflicting curator dependencies. Contributed by Rakesh R. 2015-10-02 12:40:05 +02:00
Zhihai Xu
07f9405692 HADOOP-8437. getLocalPathForWrite should throw IOException for invalid paths. Contributed by Brahma Reddy Battula 
(cherry picked from commit fd026f535cc09e99a7d4d5d2a8c13eabe8865315)
 2015-10-01 12:04:27 -07:00
Karthik Kambatla
db145e0c9a HADOOP-12451. Setting HADOOP_HOME explicitly should be allowed. (kasha) 2015-10-01 11:29:50 -07:00
Akira Ajisaka
c6f30e5913 HADOOP-10296. Incorrect null check in SwiftRestClient#buildException(). Contributed by Rahul Palamuttam and Kanaka Kumar Avvaru. 
(cherry picked from commit ecbfd68974691cc9103ae477d10c15c7f21b6dea)
 2015-10-01 18:35:19 +02:00
Akira Ajisaka
e42f576232 MAPREDUCE-6497. Fix wrong value of JOB_FINISHED event in JobHistoryEventHandler. Contributed by Shinichi Yamashita. 
(cherry picked from commit 195793c6f3e53a5c0527020477fe9c9158576f77)
 2015-10-01 10:26:00 +02:00
Robert Kanter
46ef5aa8eb MAPREDUCE-6494. Permission issue when running archive-logs tool as different users (rkanter) 
(cherry picked from commit 5db371f52f5c6e894a7e6a5d523084f4b316a7ab)
 2015-09-30 17:34:03 -07:00
cnauroth
7273ef0590 HDFS-9175. Change scope of 'AccessTokenProvider.getAccessToken()' and 'CredentialBasedAccessTokenProvider.getCredential()' abstract methods to public. Contributed by Santhosh Nayak. 
(cherry picked from commit c7e03c3a6cf8ccd73a1734a1d19bd8d753b2974c)
 2015-09-30 16:06:45 -07:00
Jason Lowe
d645ee1d62 YARN-3727. For better error recovery, check if the directory exists before using it for localization. Contributed by Zhihai Xu 
(cherry picked from commit 854d25b0c30fd40f640c052e79a8747741492042)
 2015-09-30 15:01:01 +00:00
yliu
3625222635 HADOOP-12448. TestTextCommand: use mkdirs rather than mkdir to create test directory. (Contributed by Colin Patrick McCabe and Chris Nauroth) 2015-09-30 11:04:09 +08:00
Aaron T. Myers
cb89ee931d HDFS-9001. DFSUtil.getNsServiceRpcUris() can return too many entries in a non-HA, non-federated cluster. Contributed by Daniel Templeton. 
(cherry picked from commit 071733dc69a6f83c0cdca046b31ffd4f13304e93)
 2015-09-29 18:20:00 -07:00
Haohui Mai
37d42fcec1 HDFS-8971. Remove guards when calling LOG.debug() and LOG.trace() in client package. Contributed by Mingliang Liu. 2015-09-29 17:52:42 -07:00
Haohui Mai
58bdc9c672 Revert "HDFS-9170. Move libhdfs / fuse-dfs / libwebhdfs to hdfs-client. Contributed by Haohui Mai." 
This reverts commit cf873fff9f211e0832d00c7808eee2cc63ad3237.
 2015-09-29 17:51:31 -07:00
Haohui Mai
cf873fff9f HDFS-9170. Move libhdfs / fuse-dfs / libwebhdfs to hdfs-client. Contributed by Haohui Mai. 2015-09-29 17:48:35 -07:00