Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,624 Commits 326 Branches 371 Tags
Commit Graph

9624 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Andrew Wang
dd7776b2fe HDFS-8656. Preserve compatibility of ClientProtocol#rollingUpgrade after finalization. 
(cherry picked from commit 60b858bfa65e0feb665e1a84784a3d45e9091c66)
 2015-06-26 11:33:40 -07:00
Jing Zhao
83d76151e2 HDFS-8623. Refactor NameNode handling of invalid, corrupt, and under-recovery blocks. Contributed by Zhe Zhang. 
(cherry picked from commit de480d6c8945bd8b5b00e8657b7a72ce8dd9b6b5)
 2015-06-26 11:04:05 -07:00
Colin Patrick Mccabe
8552af91f4 HDFS-8651. Make hadoop-hdfs-project Native code -Wall-clean (Alan Burlison via Colin P. McCabe) 
(cherry picked from commit 1b764a01fd8010cf9660eb378977a1b2b81f330a)
 2015-06-26 10:28:14 -07:00
Jason Lowe
0221d19f4e YARN-3850. NM fails to read files from full disks which can lead to container logs being lost and other issues. Contributed by Varun Saxena 
(cherry picked from commit 40b256949ad6f6e0dbdd248f2d257b05899f4332)
 2015-06-26 15:48:05 +00:00
Harsh J
55427fb66c HADOOP-8151. Error handling in snappy decompressor throws invalid exceptions. Contributed by Matt Foley. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389006 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit ac31d6a4485d7ff9074fb5dade7a6cf5292bb347)

Conflicts:

	hadoop-common-project/hadoop-common/CHANGES.txt
 2015-06-26 02:19:08 -07:00
Andrew Wang
84fdd4a3a0 HDFS-8546. Use try with resources in DataStorage and Storage. 
(cherry picked from commit 1403b84b122fb76ef2b085a728b5402c32499c1f)
 2015-06-25 17:50:39 -07:00
Andrew Wang
ba406b723d HDFS-8665. Fix replication check in DFSTestUtils#waitForReplication. 
(cherry picked from commit ff0e5e572f5dcf7b49381cbe901360f6e171d423)
 2015-06-25 17:29:30 -07:00
Jason Lowe
31fd7a51d8 MAPREDUCE-6413. TestLocalJobSubmission is failing with unknown host. Contributed by zhihai xu 
(cherry picked from commit aa5b15b03be61ebb76a226e0de485d5228c8e3d0)
 2015-06-25 19:52:23 +00:00
Arpit Agarwal
05e9ffdd62 HDFS-8640. Make reserved RBW space visible through JMX. (Contributed by kanaka kumar avvaru) 2015-06-25 10:13:31 -07:00
Akira Ajisaka
44dbddb022 HDFS-8462. Implement GETXATTRS and LISTXATTRS operations for WebImageViewer. Contributed by Jagadesh Kiran N. 
(cherry picked from commit bc433908d35758ff0a7225cd6f5662959ef4d294)
 2015-06-26 00:22:30 +09:00
Devaraj K
bb8a2cff2a YARN-3745. SerializedException should also try to instantiate internal 
exception with the default constructor. Contributed by Lavkesh Lahngir.

(cherry picked from commit b381f88c71d18497deb35039372b1e9715d2c038)
 2015-06-25 17:39:40 +05:30
Devaraj K
3e20f595d4 YARN-3826. Race condition in ResourceTrackerService leads to wrong 
diagnostics messages. Contributed by Chengbing Liu.

(cherry picked from commit 57f1a01eda80f44d3ffcbcb93c4ee290e274946a)
 2015-06-25 16:15:24 +05:30
Andrew Wang
4b8593caf8 HDFS-8645. Resolve inconsistent code in TestReplicationPolicy between trunk and branch-2. Contributed by Zhe Zhang. 2015-06-24 18:26:14 -07:00
Benoy Antony
aef9ab2128 HADOOP-12049. Control http authentication cookie persistence via configuration. Contributed by Huizhi Lu. 
(cherry picked from commit a815cc157ceb24e02189634a85abed8e874568e0)
 2015-06-24 16:41:23 -07:00
Andrew Wang
431f685300 HDFS-8646. Prune cached replicas from DatanodeDescriptor state on replica invalidation. 
(cherry picked from commit afe9ea3c12e1f5a71922400eadb642960bc87ca1)
 2015-06-24 14:46:13 -07:00
Jonathan Eagles
d1f0ff165b YARN-3360. Add JMX metrics to TimelineDataManager (Jason Lowe via jeagles) 
(cherry picked from commit 4c659ddbf7629aae92e66a5b54893e9c1c68dfb0)
 2015-06-24 16:17:32 -05:00
Jonathan Eagles
bb6e28592e HADOOP-11958. MetricsSystemImpl fails to show backtrace when an error occurs (Jason Lowe via jeagles) 
(cherry picked from commit 2236b577a34b069c0d1f91da99f63a199f260ac2)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics2/impl/MetricsSystemImpl.java
 2015-06-24 14:54:11 -05:00
rohithsharmaks
1619d8d62a Move YARN-3790 from 2.7.1 to 2.8 in CHANGES.txt 2015-06-24 23:31:09 +05:30
rohithsharmaks
1392d1ad94 YARN-3790. usedResource from rootQueue metrics may get stale data for FS scheduler after recovering the container (Zhihai Xu via rohithsharmaks) 2015-06-24 23:00:25 +05:30
Jason Lowe
15b1800b12 YARN-3832. Resource Localization fails on a cluster due to existing cache directories. Contributed by Brahma Reddy Battula 
(cherry picked from commit 8d58512d6e6d9fe93784a9de2af0056bcc316d96)
 2015-06-24 16:38:22 +00:00
Jason Lowe
14afa5d53d YARN-3809. Failed to launch new attempts because ApplicationMasterLauncher's threads all hang. Contributed by Jun Gong 
(cherry picked from commit 2a20dd9b61ba3833460cbda0e8c3e8b6366fc3ab)
 2015-06-24 16:24:43 +00:00
Jason Lowe
2762affbb2 MAPREDUCE-6400. Multiple shuffle transfer fails because input is closed too early. Contributed by Brahma Reddy Battula, Akira AJISAKA, and Gera Shegalov. 
(cherry picked from commit 72d08a0e41efda635baa985d55d67cb059a7c07c)
 2015-06-24 15:30:09 +00:00
Haohui Mai
0cd7603bd6 Addendum patch for HDFS-6564. 2015-06-23 22:30:27 -07:00
Jing Zhao
77609e6465 HDFS-8639. Add Option for NameNode HTTP port in MiniDFSClusterManager. Contributed by Kai Sasaki. 
(cherry picked from commit 2ba646572185b91d6db1b09837abdcbadbfbeb49)
 2015-06-23 22:21:01 -07:00
Haohui Mai
3fb192bfb7 HDFS-6564. Use slf4j instead of common-logging in hdfs-client. Contributed by Rakesh R. 2015-06-23 11:41:32 -07:00
Vinod Kumar Vavilapalli
8c9e2cf10a MAPREDUCE-6410. Fixed MapReduce JobHistory server to use the right (login) UGI to refresh log and cleaner settings. Contributed by Varun Saxena. 
(cherry picked from commit d481684c7c9293a94f54ef622a92753531c6acc7)
 2015-06-23 11:41:05 -07:00
Robert Kanter
5c1e809af5 YARN-3835. hadoop-yarn-server-resourcemanager test package bundles core-site.xml, yarn-site.xml (vamsee via rkanter) 
(cherry picked from commit 99271b762129d78c86f3c9733a24c77962b0b3f7)
 2015-06-22 18:03:00 -07:00
Karthik Kambatla
9656ee4ee7 YARN-3842. NMProxy should retry on NMNotYetReadyException. (Robert Kanter via kasha) 
(cherry picked from commit 5ebf2817e58e1be8214dc1916a694a912075aa0a)
 2015-06-22 17:48:07 -07:00
Jakob Homan
f6157a4a08 HDFS-8542. WebHDFS getHomeDirectory behavior does not match specification. Contributed by Kanaka Kumar Avvaru. 
(cherry picked from commit fac4e04dd359a7ff31f286d664fb06f019ec0b58)
 2015-06-22 16:38:07 -07:00
Jason Lowe
3bf44b862b MAPREDUCE-5948. org.apache.hadoop.mapred.LineRecordReader does not handle multibyte record delimiters well. Contributed by Vinayakumar B, Rushabh Shah, and Akira AJISAKA 
(cherry picked from commit 077250d8d7b4b757543a39a6ce8bb6e3be356c6f)
 2015-06-22 22:00:20 +00:00
Gera Shegalov
d8cc8f54dd MAPREDUCE-6408. Queue name and user name should be printed on the job page. (Siqi Li via gera) 
(cherry picked from commit 11ac84820746e43f1e7072e08f62ddf81713aeb2)
 2015-06-22 14:42:31 -07:00
Colin Patrick Mccabe
cbd11681ce HDFS-8480. Fix performance and timeout issues in HDFS-7929 by using hard-links to preserve old edit logs, instead of copying them. (Zhe Zhang via Colin P. McCabe) 
(cherry picked from commit 7b424f938c3c306795d574792b086d84e4f06425)
 2015-06-22 14:37:35 -07:00
Andrew Wang
c71f57b2a0 HDFS-8608. Merge HDFS-7912 to trunk and branch-2 (track BlockInfo instead of Block in UnderReplicatedBlocks and PendingReplicationBlocks). Contributed by Zhe Zhang. 
(cherry picked from commit 6e3fcffe291faec40fa9214f4880a35a952836c4)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/UnderReplicatedBlocks.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestReplicationPolicy.java
 2015-06-22 14:22:48 -07:00
Andrew Wang
cd1e0930dc HDFS-4366. Block Replication Policy Implementation May Skip Higher-Priority Blocks for Lower-Priority Blocks. (Derek Dagit and Zhe Zhang via wang) 2015-06-22 14:18:33 -07:00
Akira Ajisaka
c4747158b7 MAPREDUCE-6403. Fix typo in the usage of NNBench. Contributed by Jagadesh Kiran N. 
(cherry picked from commit 445b13240cb632ee8bc718f0576f783a7350af2e)
 2015-06-22 15:34:34 +09:00
Xuan
c3254a63a9 YARN-3834. Scrub debug logging of tokens during resource localization. Contributed by Chris Nauroth 
(cherry picked from commit 6c7a9d502a633b5aca75c9798f19ce4a5729014e)
 2015-06-21 17:14:59 -07:00
Arpit Agarwal
175c5829f0 HDFS-8192. Eviction should key off used locked memory instead of ram disk free space. (Contributed by Arpit Agarwal) 2015-06-20 13:27:58 -07:00
Arpit Agarwal
5dcda16859 HDFS-7164. Update CHANGES.txt 2015-06-20 13:09:21 -07:00
Gera Shegalov
ee63c3e831 MAPREDUCE-6305. AM/Task log page should be able to link back to the job. (Siqi Li via gera) 
(cherry picked from commit 055cd5a9a11bd3e544a8a67c6c44b53efcb3a9ed)
 2015-06-20 12:40:59 -07:00
Gera Shegalov
34e744ce1a MAPREDUCE-6316. Task Attempt List entries should link to the task overview. (Siqi Li via gera) 
(cherry picked from commit 63d40d528654707b3f56619a4eb20e21cdeadc7e)
 2015-06-20 11:52:11 -07:00
Yongjun Zhang
5774b1ff02 Move HDFS-7546 to release 2.7.1 in CHANGES.txt. 
(cherry picked from commit bcb3c40bed572a2dd95ce7201d893d7bf59240d5)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-06-20 00:49:17 -07:00
Allen Wittenauer
92cff5663e HDFS-7546. Document, and set an accepting default for dfs.namenode.kerberos.principal.pattern (Harsh J via aw) 
(cherry picked from commit 63613c79c1042ea3d7706ed6f7eccc8cf48ff6ea)
 2015-06-20 00:40:44 -07:00
Yongjun Zhang
87c3d3739f Move HDFS-8337 to branch 2.8 in CHANGES.txt. 
(cherry picked from commit 20c03c96066752f0a7158846de4d7bc4253e83f6)
 2015-06-20 00:28:48 -07:00
Yongjun Zhang
d657e378ad HDFS-8337. Accessing httpfs via webhdfs doesn't work from a jar with kerberos. Contributed by Yongjun Zhang. 
(cherry picked from commit 971dc838ecf8bf55a9bd64128ce2447e4613ea76)
 2015-06-19 23:44:48 -07:00
Devaraj K
5c3070dc16 MAPREDUCE-6405. NullPointerException in App Attempts page. Contributed by 
Siqi Li and Gera Shegalov.

(cherry picked from commit 311a4179cc53a2754d1185b1cb10e6adb1b95d3d)
 2015-06-20 10:37:42 +05:30
Colin Patrick Mccabe
c94579f845 HDFS-8582. Support getting a list of reconfigurable config properties and do not generate spurious reconfig warnings (Lei (Eddy) Xu via Colin P. McCabe) 
(cherry picked from commit d112d183242f447d4b742139f3a4ea531a997f45)
 2015-06-19 19:14:38 -07:00
Arpit Agarwal
fcd1824b61 HDFS-8626. Reserved RBW space is not released if creation of RBW File fails. (Contributed by kanaka kumar avvaru) 2015-06-19 18:23:44 -07:00
Yongjun Zhang
430ba669cc HADOOP-12103. Small refactoring of DelegationTokenAuthenticationFilter to allow code sharing. Contributed by Yongjun Zhang. 
(cherry picked from commit 49f5d20efe7af7cd7c45d93edad33997a695a746)
 2015-06-19 14:46:31 -07:00
Yongjun Zhang
2e13e5b253 HDFS-8633. Fix setting of dfs.datanode.readahead.bytes in hdfs-default.xml to match DFSConfigKeys. Contributed by Ray Chiang. 
(cherry picked from commit b42f1ec13d0a837f188cf424a8dd177720478cc9)
 2015-06-19 09:50:14 -07:00
Gera Shegalov
01991876ed MAPREDUCE-6395. Improve the commit failure messages in MRAppMaster recovery. (Brahma Reddy Battula via gera) 
(cherry picked from commit 10107243be66bae2212a2cd8575f9f5ade13fe9e)
 2015-06-19 02:29:31 -07:00