Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,618 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

8618 Commits

Author SHA1 Message Date
Plamen Jeliazkov da318cbbde HDFS-7956. Improve logging for DatanodeRegistration. Contributed by Plamen Jeliazkov. 2015-03-23 23:09:52 -07:00
Andrew Wang af0af28afc HDFS-7960. The full block report should prune zombie storages even if they're not empty. Contributed by Colin McCabe and Eddy Xu. 
(cherry picked from commit 50ee8f4e67)
 2015-03-23 22:01:37 -07:00
Tsz-Wo Nicholas Sze 87079cde7d HDFS-7884. Fix NullPointerException in BlockSender when the generation stamp provided by the client is larger than the one stored in the datanode. Contributed by Brahma Reddy Battula 2015-03-24 13:52:18 +09:00
Xuan 4dfd84ec08 YARN-3393. Getting application(s) goes wrong when app finishes before 
starting the attempt. Contributed by Zhijie Shen

(cherry picked from commit 9fae455e26)
 2015-03-23 20:34:59 -07:00
cnauroth 8e1c33e703 HDFS-7917. Use file to replace data dirs in test to simulate a disk failure. Contributed by Lei (Eddy) Xu. 
(cherry picked from commit 2c238ae4e0)
(cherry picked from commit 01c0bcb176)
 2015-03-23 16:30:48 -07:00
Akira Ajisaka 2742f12b58 HDFS-7881. TestHftpFileSystem#testSeek fails in branch-2. Contributed by Brahma Reddy Battula. 
(cherry picked from commit fad8c78173)
 2015-03-24 06:25:21 +09:00
cnauroth 57e297208d YARN-3336. FileSystem memory leak in DelegationTokenRenewer. 
(cherry picked from commit 6ca1f12024)
(cherry picked from commit 342c525eaa)
 2015-03-23 10:46:22 -07:00
Brandon Li 6b9f2d9f39 HDFS-7942. NFS: support regexp grouping in nfs.exports.allowed.hosts. Contributed by Brandon Li 
(cherry picked from commit 36af4a913c)
(cherry picked from commit 503d8e4164)
 2015-03-23 10:13:11 -07:00
Tsuyoshi Ozawa d2e19160dc YARN-3384. TestLogAggregationService.verifyContainerLogs fails after YARN-2777. Contributed by Naganarasimha G R. 
(cherry picked from commit 82eda771e0)
 2015-03-24 00:26:08 +09:00
Harsh J 929b04ce3a MAPREDUCE-6286. A typo in HistoryViewer makes some code useless, which causes counter limits are not reset correctly. Contributed by Zhihai Xu. 2015-03-22 10:18:32 +05:30
Kihwal Lee 08f2f7ed34 HDFS-6841. Use Time.monotonicNow() wherever applicable instead of Time.now(). Contributed by Vinayakumar B 
(cherry picked from commit 99a8dcd19528b265d4fda9ae09a17e4af52f2782)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocol/DatanodeInfo.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/DFSTestUtil.java
(cherry picked from commit 63b7870aec007081c82427587cb6e1d38e2c70f8)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java
 2015-03-20 14:06:02 -05:00
Jing Zhao 03fb9b4ce0 HDFS-7957. Truncate should verify quota before making changes. Contributed by Jing Zhao. 
(cherry picked from commit d368d3647a)
(cherry picked from commit 6be52e42a9)
 2015-03-20 11:56:39 -07:00
Wangda Tan 57a0382f4b YARN-3369. Missing NullPointer check in AppSchedulingInfo causes RM to die. (Brahma Reddy Battula via wangda) 
(cherry picked from commit 6bc7710ec7)
 2015-03-20 10:44:34 -07:00
Xuan b63ff4c36d YARN-2777. Mark the end of individual log in aggregated log. Contributed 
by Varun Saxena

(cherry picked from commit 1a4b528691)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2015-03-20 10:28:24 -07:00
yliu faeb8b9b53 HDFS-7962. Remove duplicated logs in BlockManager. (yliu) 2015-03-20 05:32:19 +08:00
Jian He e67bd31ac0 YARN-3379. Fixed missing data in localityTable and ResourceRequests table in RM WebUI. Contributed by Xuan Gong 
(cherry picked from commit 4e886eb9cb)
 2015-03-19 22:34:34 -07:00
yliu 0da3fcb4b0 HDFS-7930. commitBlockSynchronization() does not remove locations. (yliu) 2015-03-19 23:26:26 +08:00
Jason Lowe 0be2461df5 MAPREDUCE-6275. Race condition in FileOutputCommitter v2 for user-specified task output subdirs. Contributed by Gera Shegalov and Siqi Li 
(cherry picked from commit 91baca145a)
 2015-03-19 21:41:49 +00:00
Kihwal Lee 4e967d0bcd HDFS-7932. Speed up the shutdown of datanode during rolling upgrade. Contributed by Kihwal Lee. 
(cherry picked from commit 61a4c7fc98)
 2015-03-19 12:29:16 -05:00
Tsuyoshi Ozawa 4821f0cdb7 HADOOP-11729. Fix link to cgroups doc in site.xml. Contributed by Masatake Iwasaki. 
(cherry picked from commit 522c897146)
 2015-03-19 23:09:22 +09:00
Vinayakumar B 76ce2e8ea0 HDFS.7849. Update documentation for enabling a new feature in rolling upgrade ( Contributed by J.Andreina ) 
(cherry picked from commit 5be5129d93)
 2015-03-19 19:10:23 +05:30
Kihwal Lee b8f269af9d HDFS-7816. Unable to open webhdfs paths with "+". Contributed by Haohui Mai 
(cherry picked from commit e79be0ee12)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
(cherry picked from commit ceb39c1cc6)
 2015-03-19 08:04:19 -05:00
Haohui Mai 7129287efb HADOOP-10703. HttpServer2 creates multiple authentication filters. Contributed by Benoy Antony. 2015-03-18 22:33:24 -07:00
Colin Patrick Mccabe 84acee00fa HADOOP-9329. document native build dependencies in BUILDING.txt (Vijay Bhat via Colin P. McCabe) 
(cherry picked from commit bf6295bed8)
(cherry picked from commit b02f77540c)
 2015-03-18 19:15:40 -07:00
Colin Patrick Mccabe 9e61835678 HDFS-7929. inotify unable fetch pre-upgrade edit log segments once upgrade starts (Zhe Zhang via Colin P. McCabe) 
(cherry picked from commit 43b41f2241)
(cherry picked from commit 219eb22c15)
 2015-03-18 19:08:53 -07:00
Jing Zhao 0bf549728d HDFS-7587. Edit log corruption can happen if append fails with a quota violation. Contributed by Jing Zhao. 
(cherry picked from commit c7c71cdba5)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt

(cherry picked from commit 5a5b244648)
 2015-03-18 19:00:06 -07:00
Jing Zhao 4b8de154aa HDFS-7943. Append cannot handle the last block with length greater than the preferred block size. Contributed by Jing Zhao. 
(cherry picked from commit bee5a6a64a)
(cherry picked from commit 6dcc79507d)
 2015-03-18 18:47:21 -07:00
Colin Patrick Mccabe 94976cb369 HDFS-7054. Make DFSOutputStream tracing more fine-grained (cmccabe) 
(cherry picked from commit 8234fd0e10)
(cherry picked from commit 79c07bbaca)
 2015-03-18 18:15:34 -07:00
Haohui Mai 388696c089 HDFS-7945. The WebHdfs system on DN does not honor the length parameter. Contributed by Haohui Mai. 2015-03-18 16:20:07 -07:00
Arpit Agarwal bb986988d4 HDFS-7914. TestJournalNode#testFailToStartWithBadConfig fails when the default dfs.journalnode.http-address port 8480 is in use. (Contributed by Xiaoyu Yao) 2015-03-18 14:05:37 -07:00
Haohui Mai 482aeee784 HDFS-7697. Mark the PB OIV tool as experimental. Contributed by Lei (Eddy) Xu. 2015-03-18 13:34:21 -07:00
Arpit Agarwal 5f7926dcf0 Fix CHANGES.txt for HDFS-7722. 2015-03-18 12:53:02 -07:00
Arpit Agarwal 2b589da779 HDFS-7951. Fix NPE for TestFsDatasetImpl#testAddVolumeFailureReleasesInUseLock on Linux. (Contributed by Xiaoyu Yao) 2015-03-18 12:46:17 -07:00
Arpit Agarwal ae6d273d63 HDFS-7950. Fix TestFsDatasetImpl#testAddVolumes failure on Windows. (Contributed by Xiaoyu Yao) 2015-03-18 12:35:41 -07:00
Jason Lowe 502c040c97 MAPREDUCE-6277. Job can post multiple history files if attempt loses connection to the RM. Contributed by Chang Li 
(cherry picked from commit 30da99cbaf)
 2015-03-18 19:32:04 +00:00
Arpit Agarwal 8944bb3d2e HDFS-7948. TestDataNodeHotSwapVolumes#testAddVolumeFailures failed on Windows. (Contributed by Xiaoyu Yao) 2015-03-18 12:26:22 -07:00
Haohui Mai 5293ae0311 HDFS-7953. NN Web UI fails to navigate to paths that contain #. Contributed by kanaka kumar avvaru. 2015-03-18 11:08:49 -07:00
Jian He 54e63c52c9 Backport part of YARN-3273 to rename CapacitySchedulerLeafQueueInfo#aMResourceLimit to AMResourceLimit. Contributed by Rohith Sharmaks 2015-03-17 22:08:10 -07:00
Arpit Agarwal 26c35438f3 HDFS-7946. TestDataNodeVolumeFailureReporting NPE on Windows. (Contributed by Xiaoyu Yao) 2015-03-17 21:30:13 -07:00
Karthik Kambatla 47e6fc2bf9 Revert "YARN-3181. FairScheduler: Fix up outdated findbugs issues. (kasha)" 
This reverts commit c2b185def8.

(cherry picked from commit 32b4330456)
 2015-03-17 12:32:14 -07:00
Colin Patrick Mccabe d2dad74421 HDFS-7940. Add tracing to DFSClient#setQuotaByStorageType (Rakesh R via Colin P. McCabe) 
(cherry picked from commit d8846707c5)
(cherry picked from commit 455d4aa8a1)
 2015-03-17 11:02:05 -07:00
yliu ef9d46dcb6 HDFS-7838. Expose truncate API for libhdfs. (yliu) 2015-03-17 07:25:58 +08:00
Tsuyoshi Ozawa 51c374ac19 HADOOP-11720. [JDK8] Fix javadoc errors caused by incorrect or illegal tags in hadoop-tools. Contributed by Akira AJISAKA. 
(cherry picked from commit ef9946cd52)
 2015-03-17 16:09:54 +09:00
Colin Patrick Mccabe 861cc05092 HDFS-7722. DataNode#checkDiskError should also remove Storage when error is found. (Lei Xu via Colin P. McCabe) 
(cherry picked from commit b49c3a1813)
(cherry picked from commit 7455412a24)
 2015-03-16 18:42:21 -07:00
Colin Patrick Mccabe 03b979b8a5 HADOOP-11714. Add more trace log4j messages to SpanReceiverHost (cmccabe) 
(cherry picked from commit bf3275dbaa)
(cherry picked from commit eb4eb63de3)
 2015-03-16 18:41:51 -07:00
Colin Patrick Mccabe 647d9ae27a HDFS-7915. The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error (cmccabe) 
(cherry picked from commit bc9cb3e271)
(cherry picked from commit c71b54fa32)
 2015-03-16 18:39:58 -07:00
Tsuyoshi Ozawa f15a2b23ca YARN-3349. Treat all exceptions as failure in TestFSRMStateStore#testFSRMStateStoreClientRetry. Contributed by Zhihai Xu. 
(cherry picked from commit 7522a643fa)
 2015-03-17 08:10:57 +09:00
cnauroth 3718207e46 Revert "HADOOP-11449 / HADOOP-10320 ; reverting patch 6cda3a7 which triggered regression in javadocs on some java8 compilers (stevel on behalf of cnauroth)" 
This reverts commit fe7df5b4d8.

Conflicts:
	hadoop-common-project/hadoop-annotations/src/main/java/org/apache/hadoop/classification/InterfaceStability.java

(cherry picked from commit ef2a66b246)
 2015-03-16 14:37:58 -07:00
Suresh Srinivas 473b445c48 HADOOP-8059. Add javadoc to InterfaceAudience and InterfaceStability. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354684 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 24c4216bf0)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt

(cherry picked from commit 3a783fe38d)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2015-03-16 14:22:45 -07:00
cnauroth 389b28033a HADOOP-11638. OpensslSecureRandom.c pthreads_thread_id should support FreeBSD and Solaris in addition to Linux. Contributed by Kiran Kumar M R. 
(cherry picked from commit 72cd4e4a4e)
 2015-03-16 14:07:05 -07:00