Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,448 Commits 326 Branches 371 Tags
Commit Graph

9448 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Robert Kanter
5c1e809af5 YARN-3835. hadoop-yarn-server-resourcemanager test package bundles core-site.xml, yarn-site.xml (vamsee via rkanter) 
(cherry picked from commit 99271b762129d78c86f3c9733a24c77962b0b3f7)
 2015-06-22 18:03:00 -07:00
Karthik Kambatla
9656ee4ee7 YARN-3842. NMProxy should retry on NMNotYetReadyException. (Robert Kanter via kasha) 
(cherry picked from commit 5ebf2817e58e1be8214dc1916a694a912075aa0a)
 2015-06-22 17:48:07 -07:00
Jakob Homan
f6157a4a08 HDFS-8542. WebHDFS getHomeDirectory behavior does not match specification. Contributed by Kanaka Kumar Avvaru. 
(cherry picked from commit fac4e04dd359a7ff31f286d664fb06f019ec0b58)
 2015-06-22 16:38:07 -07:00
Jason Lowe
3bf44b862b MAPREDUCE-5948. org.apache.hadoop.mapred.LineRecordReader does not handle multibyte record delimiters well. Contributed by Vinayakumar B, Rushabh Shah, and Akira AJISAKA 
(cherry picked from commit 077250d8d7b4b757543a39a6ce8bb6e3be356c6f)
 2015-06-22 22:00:20 +00:00
Gera Shegalov
d8cc8f54dd MAPREDUCE-6408. Queue name and user name should be printed on the job page. (Siqi Li via gera) 
(cherry picked from commit 11ac84820746e43f1e7072e08f62ddf81713aeb2)
 2015-06-22 14:42:31 -07:00
Colin Patrick Mccabe
cbd11681ce HDFS-8480. Fix performance and timeout issues in HDFS-7929 by using hard-links to preserve old edit logs, instead of copying them. (Zhe Zhang via Colin P. McCabe) 
(cherry picked from commit 7b424f938c3c306795d574792b086d84e4f06425)
 2015-06-22 14:37:35 -07:00
Andrew Wang
c71f57b2a0 HDFS-8608. Merge HDFS-7912 to trunk and branch-2 (track BlockInfo instead of Block in UnderReplicatedBlocks and PendingReplicationBlocks). Contributed by Zhe Zhang. 
(cherry picked from commit 6e3fcffe291faec40fa9214f4880a35a952836c4)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/UnderReplicatedBlocks.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestReplicationPolicy.java
 2015-06-22 14:22:48 -07:00
Andrew Wang
cd1e0930dc HDFS-4366. Block Replication Policy Implementation May Skip Higher-Priority Blocks for Lower-Priority Blocks. (Derek Dagit and Zhe Zhang via wang) 2015-06-22 14:18:33 -07:00
Akira Ajisaka
c4747158b7 MAPREDUCE-6403. Fix typo in the usage of NNBench. Contributed by Jagadesh Kiran N. 
(cherry picked from commit 445b13240cb632ee8bc718f0576f783a7350af2e)
 2015-06-22 15:34:34 +09:00
Xuan
c3254a63a9 YARN-3834. Scrub debug logging of tokens during resource localization. Contributed by Chris Nauroth 
(cherry picked from commit 6c7a9d502a633b5aca75c9798f19ce4a5729014e)
 2015-06-21 17:14:59 -07:00
Arpit Agarwal
175c5829f0 HDFS-8192. Eviction should key off used locked memory instead of ram disk free space. (Contributed by Arpit Agarwal) 2015-06-20 13:27:58 -07:00
Arpit Agarwal
5dcda16859 HDFS-7164. Update CHANGES.txt 2015-06-20 13:09:21 -07:00
Gera Shegalov
ee63c3e831 MAPREDUCE-6305. AM/Task log page should be able to link back to the job. (Siqi Li via gera) 
(cherry picked from commit 055cd5a9a11bd3e544a8a67c6c44b53efcb3a9ed)
 2015-06-20 12:40:59 -07:00
Gera Shegalov
34e744ce1a MAPREDUCE-6316. Task Attempt List entries should link to the task overview. (Siqi Li via gera) 
(cherry picked from commit 63d40d528654707b3f56619a4eb20e21cdeadc7e)
 2015-06-20 11:52:11 -07:00
Yongjun Zhang
5774b1ff02 Move HDFS-7546 to release 2.7.1 in CHANGES.txt. 
(cherry picked from commit bcb3c40bed572a2dd95ce7201d893d7bf59240d5)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-06-20 00:49:17 -07:00
Allen Wittenauer
92cff5663e HDFS-7546. Document, and set an accepting default for dfs.namenode.kerberos.principal.pattern (Harsh J via aw) 
(cherry picked from commit 63613c79c1042ea3d7706ed6f7eccc8cf48ff6ea)
 2015-06-20 00:40:44 -07:00
Yongjun Zhang
87c3d3739f Move HDFS-8337 to branch 2.8 in CHANGES.txt. 
(cherry picked from commit 20c03c96066752f0a7158846de4d7bc4253e83f6)
 2015-06-20 00:28:48 -07:00
Yongjun Zhang
d657e378ad HDFS-8337. Accessing httpfs via webhdfs doesn't work from a jar with kerberos. Contributed by Yongjun Zhang. 
(cherry picked from commit 971dc838ecf8bf55a9bd64128ce2447e4613ea76)
 2015-06-19 23:44:48 -07:00
Devaraj K
5c3070dc16 MAPREDUCE-6405. NullPointerException in App Attempts page. Contributed by 
Siqi Li and Gera Shegalov.

(cherry picked from commit 311a4179cc53a2754d1185b1cb10e6adb1b95d3d)
 2015-06-20 10:37:42 +05:30
Colin Patrick Mccabe
c94579f845 HDFS-8582. Support getting a list of reconfigurable config properties and do not generate spurious reconfig warnings (Lei (Eddy) Xu via Colin P. McCabe) 
(cherry picked from commit d112d183242f447d4b742139f3a4ea531a997f45)
 2015-06-19 19:14:38 -07:00
Arpit Agarwal
fcd1824b61 HDFS-8626. Reserved RBW space is not released if creation of RBW File fails. (Contributed by kanaka kumar avvaru) 2015-06-19 18:23:44 -07:00
Yongjun Zhang
430ba669cc HADOOP-12103. Small refactoring of DelegationTokenAuthenticationFilter to allow code sharing. Contributed by Yongjun Zhang. 
(cherry picked from commit 49f5d20efe7af7cd7c45d93edad33997a695a746)
 2015-06-19 14:46:31 -07:00
Yongjun Zhang
2e13e5b253 HDFS-8633. Fix setting of dfs.datanode.readahead.bytes in hdfs-default.xml to match DFSConfigKeys. Contributed by Ray Chiang. 
(cherry picked from commit b42f1ec13d0a837f188cf424a8dd177720478cc9)
 2015-06-19 09:50:14 -07:00
Gera Shegalov
01991876ed MAPREDUCE-6395. Improve the commit failure messages in MRAppMaster recovery. (Brahma Reddy Battula via gera) 
(cherry picked from commit 10107243be66bae2212a2cd8575f9f5ade13fe9e)
 2015-06-19 02:29:31 -07:00
Xuan
86b75ac544 YARN-3802. Two RMNodes for the same NodeId are used in RM sometimes 
after NM is reconnected. Contributed by zhihai xu

(cherry picked from commit 5b5bb8dcdc888ba1ebc7e4eba0fa0e7e79edda9a)
 2015-06-18 14:38:52 -07:00
Colin Patrick Mccabe
2946e92f79 HADOOP-12100. ImmutableFsPermission should not override applyUmask since that method doesn't modify the FsPermission (Bibin A. Chundatt via Colin P. McCabe) 
(cherry picked from commit 6e0a9f92fe0052d39b95a605174b3f6423c6aae7)
 2015-06-18 11:39:28 -07:00
Andrew Wang
7f62e41b2e HDFS-8605. Merge Refactor of DFSOutputStream from HDFS-7285 branch. (vinayakumarb) 
(cherry picked from commit 1c13519e1e7588c3e2974138d37bf3449ca8b3df)
 2015-06-18 08:48:23 -07:00
Devaraj K
3b9698ecac YARN-3824. Fix two minor nits in member variable properties of 
YarnConfiguration. Contributed by Ray Chiang.

(cherry picked from commit 2ad668748e2535e25e3b04656c29034d58074027)
 2015-06-18 16:46:33 +05:30
Vinayakumar B
80697e4f32 HADOOP-7139. Allow appending to existing SequenceFiles (Contributed by kanaka kumar avvaru) 
(cherry picked from commit 295d678be8853a52c3ec3da43d9265478d6632b3)
 2015-06-18 14:45:07 +05:30
Devaraj K
c4c7fd0bf1 MAPREDUCE-6373. The logger reports total input paths but it is referring 
to input files. Contributed by Bibin A Chundatt.

(cherry picked from commit 1babe50a2cbaae3c8165229347e743d0dc94e979)
 2015-06-18 11:45:11 +05:30
Yongjun Zhang
8cac3888c1 HADOOP-11965. determine-flaky-tests needs a summary mode. Contributed by Yufei Gu. 
(cherry picked from commit 74351af3b7521b194116258c96270ddaeccd8126)
 2015-06-17 21:08:55 -07:00
Akira Ajisaka
998027652f HDFS-6249. Output AclEntry in PBImageXmlWriter. Contributed by surendra singh lilhore. 
(cherry picked from commit cc432885adb0182c2c5b3bf92edde12231fd567c)
 2015-06-17 17:41:55 -07:00
Akira Ajisaka
9f9315008e HDFS-8615. Correct HTTP method in WebHDFS document. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 1a169a26bcc4e4bab7697965906cb9ca7ef8329e)
 2015-06-17 17:13:32 -07:00
Colin Patrick Mccabe
8939e3cc2d HDFS-8589. Fix unused imports in BPServiceActor and BlockReportLeaseManager (cmccabe) 
(cherry picked from commit 45ced38f10fcb9f831218b890786aaeb7987fed4)
 2015-06-17 17:02:08 -07:00
Haohui Mai
38a16e1a45 HDFS-8446. Separate safemode related operations in GetBlockLocations(). Contributed by Haohui Mai. 2015-06-17 16:38:19 -07:00
Xuan
16d2412a25 YARN-3804. Both RM are on standBy state when kerberos user not in yarn.admin.acl. Contributed by Varun Saxena 
(cherry picked from commit a826d432f9b45550cc5ab79ef63ca39b176dabb2)
 2015-06-17 16:24:50 -07:00
Haohui Mai
1270cb47e1 Update CHANGES.txt for HDFS-8238. 2015-06-17 16:20:40 -07:00
Haohui Mai
09941e6f8d HDFS-8238. Move ClientProtocol to the hdfs-client. Contributed by Takanobu Asanuma. 2015-06-17 16:16:55 -07:00
Devaraj K
f0901e703b YARN-3148. Allow CORS related headers to passthrough in 
WebAppProxyServlet. Contributed by Varun Saxena.

(cherry picked from commit ebb9a82519c622bb898e1eec5798c2298c726694)
 2015-06-17 15:57:45 +05:30
Devaraj K
2802c63ac3 YARN-3617. Fix WindowsResourceCalculatorPlugin.getCpuFrequency() returning 
always -1. Contributed by J.Andreina.

(cherry picked from commit 318d2cde7cb5c05a5f87c4ee967446bb60d28ae4)
 2015-06-17 13:55:25 +05:30
Arpit Agarwal
acc90ca175 HDFS-7164. Feature documentation for HDFS-6581. (Contributed by Arpit Agarwal) 2015-06-16 19:06:39 -07:00
Tsz-Wo Nicholas Sze
64389f727c HDFS-8606. Cleanup DFSOutputStream by removing unwanted changes from HDFS-8386. Contributed by Rakesh R 2015-06-16 18:09:30 -07:00
cnauroth
63f3c24bb0 HADOOP-12076. Incomplete Cache Mechanism in CredentialProvider API. Contributed by Larry McCay. 
(cherry picked from commit fbf55dcaf45285e1795cb107e7846799e4042b0b)
 2015-06-16 14:44:14 -07:00
Xiaoyu Yao
4bfbc6b1d4 HDFS-8551. Fix hdfs datanode CLI usage message. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 9cd5ad9d84e46295249877ade50cd49c34b9bf12)
 2015-06-16 14:17:51 -07:00
Xuan
fe7f2d40fe YARN-3714. AM proxy filter can not get RM webapp address from 
yarn.resourcemanager.hostname.rm-id. Contributed by Masatake Iwasaki

(cherry picked from commit e27d5a13b0623e3eb43ac773eccd082b9d6fa9d0)
 2015-06-16 14:06:56 -07:00
Xiaoyu Yao
8ab23d9ec1 HDFS-8548. Minicluster throws NPE on shutdown. Contributed by surendra singh lilhore. 
(cherry picked from commit 6a76250b39f33466bdc8dabab33070c90aa1a389)
 2015-06-16 14:00:33 -07:00
Kihwal Lee
d2d038b0a0 HDFS-4660. Block corruption can happen during pipeline recovery. Contributed by Kihwal Lee. 
(cherry picked from commit c74517c46bf00af408ed866b6577623cdec02de1)
 2015-06-16 15:42:00 -05:00
Akira Ajisaka
4c6a1509cd HADOOP-12095. org.apache.hadoop.fs.shell.TestCount fails. Contributed by Brahma Reddy Battula. 
(cherry picked from commit b578807b9903f3f2056c7064bfe5af8619eb4835)
 2015-06-16 13:38:32 -07:00
Xiaoyu Yao
d7c8a6feaa HDFS-8597. Fix TestFSImage#testZeroBlockSize on Windows. Contributed by Xiaoyu Yao. 
(cherry picked from commit 4e88ff5b27cc33d311ab7a7248c3cf6303997ddd)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-06-16 12:47:05 -07:00
Devaraj K
eb8e2c5448 YARN-3789. Improve logs for LeafQueue#activateApplications(). Contributed 
by Bibin A Chundatt.

(cherry picked from commit b039e69bb03accef485361af301fa59f03d08d6a)
 2015-06-16 14:04:46 +05:30