Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,479 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

9479 Commits

Author SHA1 Message Date
Wangda Tan b5ba6979b7 YARN-3583. Support of NodeLabel object instead of plain String in YarnClient side. (Sunil G via wangda) 
(cherry picked from commit 563eb1ad2a)
(cherry picked from commit b0d22b0c606fad6b4ab5443c0aed07c829b46726)
 2015-05-19 17:37:24 -07:00
Tsuyoshi Ozawa d022c5aba8 YARN-3677. Fix findbugs warnings in yarn-server-resourcemanager. Contributed by Vinod Kumar Vavilapalli. 
(cherry picked from commit 7401e5b5e8)
 2015-05-20 09:01:42 +09:00
Wangda Tan 7b97f049ee YARN-3565. NodeHeartbeatRequest/RegisterNodeManagerRequest should use NodeLabel object instead of String. (Naganarasimha G R via wangda) 
(cherry picked from commit b37da52a1c)
 2015-05-19 16:35:23 -07:00
Allen Wittenauer 511a503aab HADOOP-12000. cannot use --java-home in test-patch (aw) 2015-05-19 15:24:53 -07:00
Jian He adb90c7f52 YARN-2821. Fixed a problem that DistributedShell AM may hang if restarted. Contributed by Varun Vasudev 
(cherry picked from commit 7438966586)
 2015-05-19 14:21:48 -07:00
cnauroth 7af9a78fe8 HADOOP-11963. Metrics documentation for FSNamesystem misspells PendingDataNodeMessageCount. Contributed by Anu Engineer. 
(cherry picked from commit e422e76fca)
 2015-05-19 11:50:38 -07:00
Arun Suresh 00e2a0a494 HADOOP-11973. Ensure ZkDelegationTokenSecretManager namespace znodes get created with ACLs. (Gregory Chanan via asuresh) 
(cherry picked from commit fd3cb533d2)
 2015-05-19 11:37:15 -07:00
Junping Du dafe33efbf Moving MAPREDUCE-6361 to 2.7.1 CHANGES.txt 2015-05-19 11:53:46 -07:00
Colin Patrick Mccabe 9534e533dc HADOOP-11970. Replace uses of ThreadLocal<Random> with JDK7 ThreadLocalRandom (Sean Busbey via Colin P. McCabe) 
(cherry picked from commit 470c87dbc6)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestReplicationPolicy.java
        hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/common/JspHelper.java
 2015-05-19 11:15:04 -07:00
Kihwal Lee 536b9ee6d6 HDFS-8404. Pending block replication can get stuck using older genstamp. Contributed by Nathan Roberts. 
(cherry picked from commit 8860e352c3)
 2015-05-19 13:06:48 -05:00
Ravi Prakash 084e453629 YARN-3302. TestDockerContainerExecutor should run automatically if it can detect docker in the usual place (Ravindra Kumar Naik via raviprak) 
(cherry picked from commit c97f32e7b9)
 2015-05-19 10:30:24 -07:00
Xuan d39039d54d YARN-3601. Fix UT TestRMFailover.testRMWebAppRedirect. Contributed by Weiwei Yang 
(cherry picked from commit 5009ad4a7f)
 2015-05-19 09:57:13 -07:00
Kihwal Lee 9e656bfa94 HDFS-8131. Implement a space balanced block placement policy. Contributed by Liu Shaohui. 
(cherry picked from commit de30d66b26)
 2015-05-19 08:06:07 -05:00
Allen Wittenauer 6c4aa89e56 HADOOP-11581. Multithreaded correctness Warnings #org.apache.hadoop.fs.shell.Ls (Brahma Reddy Battula via aw) 
(cherry picked from commit b015fec601)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2015-05-19 18:36:19 +09:00
Vinayakumar B 5bbf157cb2 HADOOP-11103. Clean up RemoteException (Contributed by Sean Busbey) 
(cherry picked from commit d4a2830b63)
 2015-05-19 14:41:34 +05:30
Akira Ajisaka fb49967e97 HADOOP-10971. Add -C flag to make `hadoop fs -ls` print filenames only. Contributed by Kengo Seki. 
(cherry picked from commit 3b50dcdce4)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2015-05-19 17:58:52 +09:00
Allen Wittenauer df6d242e28 HADOOP-8934. Shell command ls should include sort options (Jonathan Allen via aw) (missed file) 
(cherry picked from commit 576459801c)
 2015-05-19 17:39:12 +09:00
Allen Wittenauer 3d0e2e54a1 HADOOP-8934. Shell command ls should include sort options (Jonathan Allen via aw) 
(cherry picked from commit 30b797ee9d)

Conflicts:
	hadoop-common-project/hadoop-common/src/site/apt/FileSystemShell.apt.vm
 2015-05-19 17:38:22 +09:00
Vinayakumar B 6dee42f6db HDFS-6348. SecondaryNameNode not terminating properly on runtime exceptions (Contributed by Rakesh R) 
(cherry picked from commit 93972a332a)
 2015-05-19 12:25:00 +05:30
Jing Zhao 5caea4cd46 HADOOP-1540. Support file exclusion list in distcp. Contributed by Rich Haase. 
(cherry picked from commit 0790275f05)
 2015-05-18 13:26:09 -07:00
Xuan 3ceb2ffe54 YARN-3541. Add version info on timeline service / generic history web UI and REST API. Contributed by Zhijie Shen 
(cherry picked from commit 76afd28862)
 2015-05-18 13:19:01 -07:00
Ravi Prakash e5b805d361 HDFS-4185. Add a metric for number of active leases (Rakesh R via raviprak) 
(cherry picked from commit cdfae446ad)
 2015-05-18 12:38:32 -07:00
Tsz-Wo Nicholas Sze 7bd4db968d HDFS-8405. Fix a typo in NamenodeFsck. Contributed by Takanobu Asanuma 2015-05-19 03:01:07 +08:00
Arpit Agarwal 9bcb740049 HDFS-8345. Storage policy APIs must be exposed via the FileSystem interface. (Arpit Agarwal) 2015-05-18 11:49:01 -07:00
Allen Wittenauer baf782f353 HADOOP-11949. Add user-provided plugins to test-patch (Sean Busbey via aw) 2015-05-18 17:06:57 +00:00
Allen Wittenauer 10c922b5c6 HADOOP-11944. add option to test-patch to avoid relocating patch process directory (Sean Busbey via aw) 2015-05-18 16:14:24 +00:00
Allen Wittenauer d82222920e HADOOP-11884. test-patch.sh should pull the real findbugs version (Kengo Seki via aw) 2015-05-18 16:09:34 +00:00
Uma Maheswara Rao G ea875939f1 Revert from branch-2: HDFS-8332. DFS client API calls should check filesystem closed. Contributed by Rakesh R. 2015-05-18 14:38:30 +05:30
Akira Ajisaka 8969a5d45a HADOOP-10582. Fix the test case for copying to non-existent dir in TestFsShellCopy. Contributed by Kousuke Saruta. 
(cherry picked from commit a46506d99c)
 2015-05-18 16:32:22 +09:00
Akira Ajisaka b26d99c394 HADOOP-11939. Deprecate DistCpV1 and Logalyzer. Contributed by Brahma Reddy Battula. 
(cherry picked from commit f5c48238d5)
 2015-05-18 16:14:19 +09:00
Akira Ajisaka 343effa2c7 HADOOP-11988. Fix typo in the document for hadoop fs -find. Contributed by Kengo Seki. 
(cherry picked from commit cab0dadbd8)
 2015-05-17 13:36:50 +09:00
Arpit Agarwal 151f6d6dcc HDFS-8157. Writes to RAM DISK reserve locked memory for block files. (Arpit Agarwal) 2015-05-16 09:05:50 -07:00
Xuan 802676e1be YARN-3526. ApplicationMaster tracking URL is incorrectly redirected on a QJM cluster. Contributed by Weiwei Yang 
(cherry picked from commit b0ad644083)
 2015-05-15 22:41:13 -07:00
Haohui Mai 46d62e7016 HDFS-8403. Eliminate retries in TestFileCreation#testOverwriteOpenForWrite. Contributed by Arpit Agarwal. 2015-05-15 19:12:46 -07:00
Haohui Mai 1796d94d62 HDFS-8394. Move getAdditionalBlock() and related functionalities into a separate class. Contributed by Haohui Mai. 2015-05-15 19:10:05 -07:00
Jing Zhao d6aa65d037 HDFS-8397. Refactor the error handling code in DataStreamer. Contributed by Tsz Wo Nicholas Sze. 
(cherry picked from commit 8f37873342)
 2015-05-15 16:32:25 -07:00
Jason Lowe ce64720516 YARN-2421. RM still allocates containers to an app in the FINISHING state. Contributed by Chang Li 
(cherry picked from commit f7e051c431)
 2015-05-15 22:10:16 +00:00
Junping Du cc671349bc YARN-3505 addendum: fix an issue in previous patch. 
(cherry picked from commit 03a293aed6)
 2015-05-15 06:40:28 -07:00
Devaraj K b9865cbf3d MAPREDUCE-6273. HistoryFileManager should check whether summaryFile exists 
to avoid FileNotFoundException causing HistoryFileInfo into MOVE_FAILED
state. Contributed by zhihai xu.

(cherry picked from commit 1ea90144d5)
 2015-05-15 12:34:08 +05:30
Vinayakumar B d9455c790f HDFS-6888. Allow selectively audit logging ops (Contributed by Chen He) 
(cherry picked from commit 7f2e89fa7082840bfa3e8e593c93db050a80d04f)
 2015-05-15 11:05:26 +05:30
cnauroth 91855c2340 HADOOP-11960. Enable Azure-Storage Client Side logging. Contributed by Dushyanth. 
(cherry picked from commit cb8e69a80c)
 2015-05-14 22:22:46 -07:00
Akira Ajisaka 7fb3486eb3 HDFS-8350. Remove old webhdfs.xml and other outdated documentation stuff. Contributed by Brahma Reddy Battula. 2015-05-15 13:57:58 +09:00
Akira Ajisaka 2e5b7f24ab HDFS-8371. Fix test failure in TestHdfsConfigFields for spanreceiver properties. Contributed by Ray Chiang. 
(cherry picked from commit cbc01ed08e)
 2015-05-15 12:15:26 +09:00
Vinod Kumar Vavilapalli ad3196e016 Fixing HDFS state-store. Contributed by Arun Suresh. 
(cherry picked from commit 9a2a9553ee)
 2015-05-14 16:57:03 -07:00
Vinod Kumar Vavilapalli 87862970f1 Fixing MR intermediate spills. Contributed by Arun Suresh. 
(cherry picked from commit 6b710a42e0)
 2015-05-14 16:56:56 -07:00
Ravi Prakash 4caadaa8bb YARN-1519. Check in container-executor if sysconf is implemented before using it (Radim Kolar and Eric Payne via raviprak) 
(cherry picked from commit 53fe4eff09)
 2015-05-14 15:56:36 -07:00
cnauroth fa082e1a0a HADOOP-11713. ViewFileSystem should support snapshot methods. Contributed by Rakesh R. 
(cherry picked from commit 09fe16f166)
 2015-05-14 14:56:13 -07:00
Junping Du bc13c7d84b YARN-3505. Node's Log Aggregation Report with SUCCEED should not cached in RMApps. Contributed by Xuan Gong. 
(cherry picked from commit 15ccd967ee)
 2015-05-14 10:59:48 -07:00
Devaraj K 454236ec19 MAPREDUCE-5708. Duplicate String.format in 
YarnOutputFiles.getSpillFileForWrite. Contributed by Konstantin Weitz.

(cherry picked from commit 05ff54c66c)
 2015-05-14 22:11:15 +05:30
Vinayakumar B 4bbcffa510 HDFS-8150. Make getFileChecksum fail for blocks under construction (Contributed by J.Andreina) 
(cherry picked from commit def9136e02)
 2015-05-14 15:55:20 +05:30