Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,536 Commits 326 Branches 371 Tags
Commit Graph

9536 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Andrew Wang
ada7f66e12 HDFS-8653. Code cleanup for DatanodeManager, DatanodeDescriptor and DatanodeStorageInfo. Contributed by Zhe Zhang. 
(cherry picked from commit 2ffd84273ac490724fe7e7825664bb6d09ef0e99)
 2015-06-29 12:12:54 -07:00
Benoy Antony
e40e9fc7f4 HDFS-7390. Provide JMX metrics per storage type. (Benoy Antony) 
(cherry picked from commit d3fed8e653ed9e18d3a29a11c4b24a628ac770bb)
 2015-06-29 11:02:43 -07:00
Vinayakumar B
438bb25d43 HDFS-8628. Update missing command option for fetchdt (Contributed by J.Andreina) 
(cherry picked from commit fde20ffcef6dcd477f501b5f80c86665296711c5)
 2015-06-29 16:51:15 +05:30
Vinayakumar B
e4adb191aa HADOOP-12119. hadoop fs -expunge does not work for federated namespace (Contributed by J.Andreina) 
(cherry picked from commit c815344e2e68d78f6587b65bc2db25e151aa4364)
 2015-06-29 15:59:21 +05:30
Vinayakumar B
beab746177 HDFS-8586. Dead Datanode is allocated for write when client is from deadnode (Contributed by Brahma Reddy Battula) 
(cherry picked from commit 88ceb382ef45bd09cf004cf44aedbabaf3976759)
 2015-06-29 15:25:54 +05:30
Junping Du
dbd2b18205 YARN-3860. rmadmin -transitionToActive should check the state of non-target node. (Contributed by Masatake Iwasaki) 
(cherry picked from commit a95d39f9d08b3b215a1b33e77e9ab8a2ee59b3a9)
 2015-06-28 22:28:35 -07:00
Vinod Kumar Vavilapalli
4155bb565e Adding release 2.7.2 to CHANGES.txt. 
(cherry picked from commit aad6a7d5dba5858d6e9845f18c4baec16c91911d)
 2015-06-28 16:30:27 -07:00
Arpit Agarwal
0fd47fa809 HDFS-8681. BlockScanner is incorrectly disabled by default. (Contributed by Arpit Agarwal) 2015-06-28 14:51:30 -07:00
Steve Loughran
f02c06965c HADOOP-12009 Clarify FileSystem.listStatus() sorting order & fix FileSystemContractBaseTest:testListStatus. (J.Andreina via stevel) 2015-06-28 19:13:48 +01:00
Devaraj K
e163c1e0da YARN-3859. LeafQueue doesn't print user properly for application add. 
Contributed by Varun Saxena.

(cherry picked from commit b543d1a390a67e5e92fea67d3a2635058c29e9da)
 2015-06-28 10:06:08 +05:30
Xuan
1a8d162bc4 YARN-2871. TestRMRestart#testRMRestartGetApplicationList sometime fails 
in trunk. Contributed by zhihai xu

(cherry picked from commit fe6c1bd73aee188ed58df4d33bbc2d2fe0779a97)
 2015-06-26 19:45:00 -07:00
Colin Patrick Mccabe
9cf5bd2fad HADOOP-12036. Consolidate all of the cmake extensions in one directory (alanburlison via cmccabe) 
(cherry picked from commit aa07dea3577158b92a17651d10da20df73f54561)
 2015-06-26 12:38:15 -07:00
Andrew Wang
dd7776b2fe HDFS-8656. Preserve compatibility of ClientProtocol#rollingUpgrade after finalization. 
(cherry picked from commit 60b858bfa65e0feb665e1a84784a3d45e9091c66)
 2015-06-26 11:33:40 -07:00
Jing Zhao
83d76151e2 HDFS-8623. Refactor NameNode handling of invalid, corrupt, and under-recovery blocks. Contributed by Zhe Zhang. 
(cherry picked from commit de480d6c8945bd8b5b00e8657b7a72ce8dd9b6b5)
 2015-06-26 11:04:05 -07:00
Colin Patrick Mccabe
8552af91f4 HDFS-8651. Make hadoop-hdfs-project Native code -Wall-clean (Alan Burlison via Colin P. McCabe) 
(cherry picked from commit 1b764a01fd8010cf9660eb378977a1b2b81f330a)
 2015-06-26 10:28:14 -07:00
Jason Lowe
0221d19f4e YARN-3850. NM fails to read files from full disks which can lead to container logs being lost and other issues. Contributed by Varun Saxena 
(cherry picked from commit 40b256949ad6f6e0dbdd248f2d257b05899f4332)
 2015-06-26 15:48:05 +00:00
Harsh J
55427fb66c HADOOP-8151. Error handling in snappy decompressor throws invalid exceptions. Contributed by Matt Foley. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389006 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit ac31d6a4485d7ff9074fb5dade7a6cf5292bb347)

Conflicts:

	hadoop-common-project/hadoop-common/CHANGES.txt
 2015-06-26 02:19:08 -07:00
Andrew Wang
84fdd4a3a0 HDFS-8546. Use try with resources in DataStorage and Storage. 
(cherry picked from commit 1403b84b122fb76ef2b085a728b5402c32499c1f)
 2015-06-25 17:50:39 -07:00
Andrew Wang
ba406b723d HDFS-8665. Fix replication check in DFSTestUtils#waitForReplication. 
(cherry picked from commit ff0e5e572f5dcf7b49381cbe901360f6e171d423)
 2015-06-25 17:29:30 -07:00
Jason Lowe
31fd7a51d8 MAPREDUCE-6413. TestLocalJobSubmission is failing with unknown host. Contributed by zhihai xu 
(cherry picked from commit aa5b15b03be61ebb76a226e0de485d5228c8e3d0)
 2015-06-25 19:52:23 +00:00
Arpit Agarwal
05e9ffdd62 HDFS-8640. Make reserved RBW space visible through JMX. (Contributed by kanaka kumar avvaru) 2015-06-25 10:13:31 -07:00
Akira Ajisaka
44dbddb022 HDFS-8462. Implement GETXATTRS and LISTXATTRS operations for WebImageViewer. Contributed by Jagadesh Kiran N. 
(cherry picked from commit bc433908d35758ff0a7225cd6f5662959ef4d294)
 2015-06-26 00:22:30 +09:00
Devaraj K
bb8a2cff2a YARN-3745. SerializedException should also try to instantiate internal 
exception with the default constructor. Contributed by Lavkesh Lahngir.

(cherry picked from commit b381f88c71d18497deb35039372b1e9715d2c038)
 2015-06-25 17:39:40 +05:30
Devaraj K
3e20f595d4 YARN-3826. Race condition in ResourceTrackerService leads to wrong 
diagnostics messages. Contributed by Chengbing Liu.

(cherry picked from commit 57f1a01eda80f44d3ffcbcb93c4ee290e274946a)
 2015-06-25 16:15:24 +05:30
Andrew Wang
4b8593caf8 HDFS-8645. Resolve inconsistent code in TestReplicationPolicy between trunk and branch-2. Contributed by Zhe Zhang. 2015-06-24 18:26:14 -07:00
Benoy Antony
aef9ab2128 HADOOP-12049. Control http authentication cookie persistence via configuration. Contributed by Huizhi Lu. 
(cherry picked from commit a815cc157ceb24e02189634a85abed8e874568e0)
 2015-06-24 16:41:23 -07:00
Andrew Wang
431f685300 HDFS-8646. Prune cached replicas from DatanodeDescriptor state on replica invalidation. 
(cherry picked from commit afe9ea3c12e1f5a71922400eadb642960bc87ca1)
 2015-06-24 14:46:13 -07:00
Jonathan Eagles
d1f0ff165b YARN-3360. Add JMX metrics to TimelineDataManager (Jason Lowe via jeagles) 
(cherry picked from commit 4c659ddbf7629aae92e66a5b54893e9c1c68dfb0)
 2015-06-24 16:17:32 -05:00
Jonathan Eagles
bb6e28592e HADOOP-11958. MetricsSystemImpl fails to show backtrace when an error occurs (Jason Lowe via jeagles) 
(cherry picked from commit 2236b577a34b069c0d1f91da99f63a199f260ac2)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics2/impl/MetricsSystemImpl.java
 2015-06-24 14:54:11 -05:00
rohithsharmaks
1619d8d62a Move YARN-3790 from 2.7.1 to 2.8 in CHANGES.txt 2015-06-24 23:31:09 +05:30
rohithsharmaks
1392d1ad94 YARN-3790. usedResource from rootQueue metrics may get stale data for FS scheduler after recovering the container (Zhihai Xu via rohithsharmaks) 2015-06-24 23:00:25 +05:30
Jason Lowe
15b1800b12 YARN-3832. Resource Localization fails on a cluster due to existing cache directories. Contributed by Brahma Reddy Battula 
(cherry picked from commit 8d58512d6e6d9fe93784a9de2af0056bcc316d96)
 2015-06-24 16:38:22 +00:00
Jason Lowe
14afa5d53d YARN-3809. Failed to launch new attempts because ApplicationMasterLauncher's threads all hang. Contributed by Jun Gong 
(cherry picked from commit 2a20dd9b61ba3833460cbda0e8c3e8b6366fc3ab)
 2015-06-24 16:24:43 +00:00
Jason Lowe
2762affbb2 MAPREDUCE-6400. Multiple shuffle transfer fails because input is closed too early. Contributed by Brahma Reddy Battula, Akira AJISAKA, and Gera Shegalov. 
(cherry picked from commit 72d08a0e41efda635baa985d55d67cb059a7c07c)
 2015-06-24 15:30:09 +00:00
Haohui Mai
0cd7603bd6 Addendum patch for HDFS-6564. 2015-06-23 22:30:27 -07:00
Jing Zhao
77609e6465 HDFS-8639. Add Option for NameNode HTTP port in MiniDFSClusterManager. Contributed by Kai Sasaki. 
(cherry picked from commit 2ba646572185b91d6db1b09837abdcbadbfbeb49)
 2015-06-23 22:21:01 -07:00
Haohui Mai
3fb192bfb7 HDFS-6564. Use slf4j instead of common-logging in hdfs-client. Contributed by Rakesh R. 2015-06-23 11:41:32 -07:00
Vinod Kumar Vavilapalli
8c9e2cf10a MAPREDUCE-6410. Fixed MapReduce JobHistory server to use the right (login) UGI to refresh log and cleaner settings. Contributed by Varun Saxena. 
(cherry picked from commit d481684c7c9293a94f54ef622a92753531c6acc7)
 2015-06-23 11:41:05 -07:00
Robert Kanter
5c1e809af5 YARN-3835. hadoop-yarn-server-resourcemanager test package bundles core-site.xml, yarn-site.xml (vamsee via rkanter) 
(cherry picked from commit 99271b762129d78c86f3c9733a24c77962b0b3f7)
 2015-06-22 18:03:00 -07:00
Karthik Kambatla
9656ee4ee7 YARN-3842. NMProxy should retry on NMNotYetReadyException. (Robert Kanter via kasha) 
(cherry picked from commit 5ebf2817e58e1be8214dc1916a694a912075aa0a)
 2015-06-22 17:48:07 -07:00
Jakob Homan
f6157a4a08 HDFS-8542. WebHDFS getHomeDirectory behavior does not match specification. Contributed by Kanaka Kumar Avvaru. 
(cherry picked from commit fac4e04dd359a7ff31f286d664fb06f019ec0b58)
 2015-06-22 16:38:07 -07:00
Jason Lowe
3bf44b862b MAPREDUCE-5948. org.apache.hadoop.mapred.LineRecordReader does not handle multibyte record delimiters well. Contributed by Vinayakumar B, Rushabh Shah, and Akira AJISAKA 
(cherry picked from commit 077250d8d7b4b757543a39a6ce8bb6e3be356c6f)
 2015-06-22 22:00:20 +00:00
Gera Shegalov
d8cc8f54dd MAPREDUCE-6408. Queue name and user name should be printed on the job page. (Siqi Li via gera) 
(cherry picked from commit 11ac84820746e43f1e7072e08f62ddf81713aeb2)
 2015-06-22 14:42:31 -07:00
Colin Patrick Mccabe
cbd11681ce HDFS-8480. Fix performance and timeout issues in HDFS-7929 by using hard-links to preserve old edit logs, instead of copying them. (Zhe Zhang via Colin P. McCabe) 
(cherry picked from commit 7b424f938c3c306795d574792b086d84e4f06425)
 2015-06-22 14:37:35 -07:00
Andrew Wang
c71f57b2a0 HDFS-8608. Merge HDFS-7912 to trunk and branch-2 (track BlockInfo instead of Block in UnderReplicatedBlocks and PendingReplicationBlocks). Contributed by Zhe Zhang. 
(cherry picked from commit 6e3fcffe291faec40fa9214f4880a35a952836c4)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/UnderReplicatedBlocks.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestReplicationPolicy.java
 2015-06-22 14:22:48 -07:00
Andrew Wang
cd1e0930dc HDFS-4366. Block Replication Policy Implementation May Skip Higher-Priority Blocks for Lower-Priority Blocks. (Derek Dagit and Zhe Zhang via wang) 2015-06-22 14:18:33 -07:00
Akira Ajisaka
c4747158b7 MAPREDUCE-6403. Fix typo in the usage of NNBench. Contributed by Jagadesh Kiran N. 
(cherry picked from commit 445b13240cb632ee8bc718f0576f783a7350af2e)
 2015-06-22 15:34:34 +09:00
Xuan
c3254a63a9 YARN-3834. Scrub debug logging of tokens during resource localization. Contributed by Chris Nauroth 
(cherry picked from commit 6c7a9d502a633b5aca75c9798f19ce4a5729014e)
 2015-06-21 17:14:59 -07:00
Arpit Agarwal
175c5829f0 HDFS-8192. Eviction should key off used locked memory instead of ram disk free space. (Contributed by Arpit Agarwal) 2015-06-20 13:27:58 -07:00
Arpit Agarwal
5dcda16859 HDFS-7164. Update CHANGES.txt 2015-06-20 13:09:21 -07:00