Commit Graph

9453 Commits

Author SHA1 Message Date
Jason Lowe 2762affbb2 MAPREDUCE-6400. Multiple shuffle transfer fails because input is closed too early. Contributed by Brahma Reddy Battula, Akira AJISAKA, and Gera Shegalov.
(cherry picked from commit 72d08a0e41)
2015-06-24 15:30:09 +00:00
Haohui Mai 0cd7603bd6 Addendum patch for HDFS-6564. 2015-06-23 22:30:27 -07:00
Jing Zhao 77609e6465 HDFS-8639. Add Option for NameNode HTTP port in MiniDFSClusterManager. Contributed by Kai Sasaki.
(cherry picked from commit 2ba6465721)
2015-06-23 22:21:01 -07:00
Haohui Mai 3fb192bfb7 HDFS-6564. Use slf4j instead of common-logging in hdfs-client. Contributed by Rakesh R. 2015-06-23 11:41:32 -07:00
Vinod Kumar Vavilapalli 8c9e2cf10a MAPREDUCE-6410. Fixed MapReduce JobHistory server to use the right (login) UGI to refresh log and cleaner settings. Contributed by Varun Saxena.
(cherry picked from commit d481684c7c)
2015-06-23 11:41:05 -07:00
Robert Kanter 5c1e809af5 YARN-3835. hadoop-yarn-server-resourcemanager test package bundles core-site.xml, yarn-site.xml (vamsee via rkanter)
(cherry picked from commit 99271b7621)
2015-06-22 18:03:00 -07:00
Karthik Kambatla 9656ee4ee7 YARN-3842. NMProxy should retry on NMNotYetReadyException. (Robert Kanter via kasha)
(cherry picked from commit 5ebf2817e5)
2015-06-22 17:48:07 -07:00
Jakob Homan f6157a4a08 HDFS-8542. WebHDFS getHomeDirectory behavior does not match specification. Contributed by Kanaka Kumar Avvaru.
(cherry picked from commit fac4e04dd3)
2015-06-22 16:38:07 -07:00
Jason Lowe 3bf44b862b MAPREDUCE-5948. org.apache.hadoop.mapred.LineRecordReader does not handle multibyte record delimiters well. Contributed by Vinayakumar B, Rushabh Shah, and Akira AJISAKA
(cherry picked from commit 077250d8d7)
2015-06-22 22:00:20 +00:00
Gera Shegalov d8cc8f54dd MAPREDUCE-6408. Queue name and user name should be printed on the job page. (Siqi Li via gera)
(cherry picked from commit 11ac848207)
2015-06-22 14:42:31 -07:00
Colin Patrick Mccabe cbd11681ce HDFS-8480. Fix performance and timeout issues in HDFS-7929 by using hard-links to preserve old edit logs, instead of copying them. (Zhe Zhang via Colin P. McCabe)
(cherry picked from commit 7b424f938c)
2015-06-22 14:37:35 -07:00
Andrew Wang c71f57b2a0 HDFS-8608. Merge HDFS-7912 to trunk and branch-2 (track BlockInfo instead of Block in UnderReplicatedBlocks and PendingReplicationBlocks). Contributed by Zhe Zhang.
(cherry picked from commit 6e3fcffe29)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/UnderReplicatedBlocks.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestReplicationPolicy.java
2015-06-22 14:22:48 -07:00
Andrew Wang cd1e0930dc HDFS-4366. Block Replication Policy Implementation May Skip Higher-Priority Blocks for Lower-Priority Blocks. (Derek Dagit and Zhe Zhang via wang) 2015-06-22 14:18:33 -07:00
Akira Ajisaka c4747158b7 MAPREDUCE-6403. Fix typo in the usage of NNBench. Contributed by Jagadesh Kiran N.
(cherry picked from commit 445b13240c)
2015-06-22 15:34:34 +09:00
Xuan c3254a63a9 YARN-3834. Scrub debug logging of tokens during resource localization. Contributed by Chris Nauroth
(cherry picked from commit 6c7a9d502a)
2015-06-21 17:14:59 -07:00
Arpit Agarwal 175c5829f0 HDFS-8192. Eviction should key off used locked memory instead of ram disk free space. (Contributed by Arpit Agarwal) 2015-06-20 13:27:58 -07:00
Arpit Agarwal 5dcda16859 HDFS-7164. Update CHANGES.txt 2015-06-20 13:09:21 -07:00
Gera Shegalov ee63c3e831 MAPREDUCE-6305. AM/Task log page should be able to link back to the job. (Siqi Li via gera)
(cherry picked from commit 055cd5a9a1)
2015-06-20 12:40:59 -07:00
Gera Shegalov 34e744ce1a MAPREDUCE-6316. Task Attempt List entries should link to the task overview. (Siqi Li via gera)
(cherry picked from commit 63d40d5286)
2015-06-20 11:52:11 -07:00
Yongjun Zhang 5774b1ff02 Move HDFS-7546 to release 2.7.1 in CHANGES.txt.
(cherry picked from commit bcb3c40bed)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2015-06-20 00:49:17 -07:00
Allen Wittenauer 92cff5663e HDFS-7546. Document, and set an accepting default for dfs.namenode.kerberos.principal.pattern (Harsh J via aw)
(cherry picked from commit 63613c79c1)
2015-06-20 00:40:44 -07:00
Yongjun Zhang 87c3d3739f Move HDFS-8337 to branch 2.8 in CHANGES.txt.
(cherry picked from commit 20c03c9606)
2015-06-20 00:28:48 -07:00
Yongjun Zhang d657e378ad HDFS-8337. Accessing httpfs via webhdfs doesn't work from a jar with kerberos. Contributed by Yongjun Zhang.
(cherry picked from commit 971dc838ec)
2015-06-19 23:44:48 -07:00
Devaraj K 5c3070dc16 MAPREDUCE-6405. NullPointerException in App Attempts page. Contributed by
Siqi Li and Gera Shegalov.

(cherry picked from commit 311a4179cc)
2015-06-20 10:37:42 +05:30
Colin Patrick Mccabe c94579f845 HDFS-8582. Support getting a list of reconfigurable config properties and do not generate spurious reconfig warnings (Lei (Eddy) Xu via Colin P. McCabe)
(cherry picked from commit d112d18324)
2015-06-19 19:14:38 -07:00
Arpit Agarwal fcd1824b61 HDFS-8626. Reserved RBW space is not released if creation of RBW File fails. (Contributed by kanaka kumar avvaru) 2015-06-19 18:23:44 -07:00
Yongjun Zhang 430ba669cc HADOOP-12103. Small refactoring of DelegationTokenAuthenticationFilter to allow code sharing. Contributed by Yongjun Zhang.
(cherry picked from commit 49f5d20efe)
2015-06-19 14:46:31 -07:00
Yongjun Zhang 2e13e5b253 HDFS-8633. Fix setting of dfs.datanode.readahead.bytes in hdfs-default.xml to match DFSConfigKeys. Contributed by Ray Chiang.
(cherry picked from commit b42f1ec13d)
2015-06-19 09:50:14 -07:00
Gera Shegalov 01991876ed MAPREDUCE-6395. Improve the commit failure messages in MRAppMaster recovery. (Brahma Reddy Battula via gera)
(cherry picked from commit 10107243be)
2015-06-19 02:29:31 -07:00
Xuan 86b75ac544 YARN-3802. Two RMNodes for the same NodeId are used in RM sometimes
after NM is reconnected. Contributed by zhihai xu

(cherry picked from commit 5b5bb8dcdc)
2015-06-18 14:38:52 -07:00
Colin Patrick Mccabe 2946e92f79 HADOOP-12100. ImmutableFsPermission should not override applyUmask since that method doesn't modify the FsPermission (Bibin A. Chundatt via Colin P. McCabe)
(cherry picked from commit 6e0a9f92fe)
2015-06-18 11:39:28 -07:00
Andrew Wang 7f62e41b2e HDFS-8605. Merge Refactor of DFSOutputStream from HDFS-7285 branch. (vinayakumarb)
(cherry picked from commit 1c13519e1e)
2015-06-18 08:48:23 -07:00
Devaraj K 3b9698ecac YARN-3824. Fix two minor nits in member variable properties of
YarnConfiguration. Contributed by Ray Chiang.

(cherry picked from commit 2ad668748e)
2015-06-18 16:46:33 +05:30
Vinayakumar B 80697e4f32 HADOOP-7139. Allow appending to existing SequenceFiles (Contributed by kanaka kumar avvaru)
(cherry picked from commit 295d678be8)
2015-06-18 14:45:07 +05:30
Devaraj K c4c7fd0bf1 MAPREDUCE-6373. The logger reports total input paths but it is referring
to input files. Contributed by Bibin A Chundatt.

(cherry picked from commit 1babe50a2c)
2015-06-18 11:45:11 +05:30
Yongjun Zhang 8cac3888c1 HADOOP-11965. determine-flaky-tests needs a summary mode. Contributed by Yufei Gu.
(cherry picked from commit 74351af3b7)
2015-06-17 21:08:55 -07:00
Akira Ajisaka 998027652f HDFS-6249. Output AclEntry in PBImageXmlWriter. Contributed by surendra singh lilhore.
(cherry picked from commit cc432885ad)
2015-06-17 17:41:55 -07:00
Akira Ajisaka 9f9315008e HDFS-8615. Correct HTTP method in WebHDFS document. Contributed by Brahma Reddy Battula.
(cherry picked from commit 1a169a26bc)
2015-06-17 17:13:32 -07:00
Colin Patrick Mccabe 8939e3cc2d HDFS-8589. Fix unused imports in BPServiceActor and BlockReportLeaseManager (cmccabe)
(cherry picked from commit 45ced38f10)
2015-06-17 17:02:08 -07:00
Haohui Mai 38a16e1a45 HDFS-8446. Separate safemode related operations in GetBlockLocations(). Contributed by Haohui Mai. 2015-06-17 16:38:19 -07:00
Xuan 16d2412a25 YARN-3804. Both RM are on standBy state when kerberos user not in yarn.admin.acl. Contributed by Varun Saxena
(cherry picked from commit a826d432f9)
2015-06-17 16:24:50 -07:00
Haohui Mai 1270cb47e1 Update CHANGES.txt for HDFS-8238. 2015-06-17 16:20:40 -07:00
Haohui Mai 09941e6f8d HDFS-8238. Move ClientProtocol to the hdfs-client. Contributed by Takanobu Asanuma. 2015-06-17 16:16:55 -07:00
Devaraj K f0901e703b YARN-3148. Allow CORS related headers to passthrough in
WebAppProxyServlet. Contributed by Varun Saxena.

(cherry picked from commit ebb9a82519)
2015-06-17 15:57:45 +05:30
Devaraj K 2802c63ac3 YARN-3617. Fix WindowsResourceCalculatorPlugin.getCpuFrequency() returning
always -1. Contributed by J.Andreina.

(cherry picked from commit 318d2cde7c)
2015-06-17 13:55:25 +05:30
Arpit Agarwal acc90ca175 HDFS-7164. Feature documentation for HDFS-6581. (Contributed by Arpit Agarwal) 2015-06-16 19:06:39 -07:00
Tsz-Wo Nicholas Sze 64389f727c HDFS-8606. Cleanup DFSOutputStream by removing unwanted changes from HDFS-8386. Contributed by Rakesh R 2015-06-16 18:09:30 -07:00
cnauroth 63f3c24bb0 HADOOP-12076. Incomplete Cache Mechanism in CredentialProvider API. Contributed by Larry McCay.
(cherry picked from commit fbf55dcaf4)
2015-06-16 14:44:14 -07:00
Xiaoyu Yao 4bfbc6b1d4 HDFS-8551. Fix hdfs datanode CLI usage message. Contributed by Brahma Reddy Battula.
(cherry picked from commit 9cd5ad9d84)
2015-06-16 14:17:51 -07:00
Xuan fe7f2d40fe YARN-3714. AM proxy filter can not get RM webapp address from
yarn.resourcemanager.hostname.rm-id. Contributed by Masatake Iwasaki

(cherry picked from commit e27d5a13b0)
2015-06-16 14:06:56 -07:00