9890 Commits

Author SHA1 Message Date
Akira Ajisaka
c4747158b7 MAPREDUCE-6403. Fix typo in the usage of NNBench. Contributed by Jagadesh Kiran N.
(cherry picked from commit 445b13240cb632ee8bc718f0576f783a7350af2e)
2015-06-22 15:34:34 +09:00
Xuan
c3254a63a9 YARN-3834. Scrub debug logging of tokens during resource localization. Contributed by Chris Nauroth
(cherry picked from commit 6c7a9d502a633b5aca75c9798f19ce4a5729014e)
2015-06-21 17:14:59 -07:00
Arpit Agarwal
175c5829f0 HDFS-8192. Eviction should key off used locked memory instead of ram disk free space. (Contributed by Arpit Agarwal) 2015-06-20 13:27:58 -07:00
Arpit Agarwal
5dcda16859 HDFS-7164. Update CHANGES.txt 2015-06-20 13:09:21 -07:00
Gera Shegalov
ee63c3e831 MAPREDUCE-6305. AM/Task log page should be able to link back to the job. (Siqi Li via gera)
(cherry picked from commit 055cd5a9a11bd3e544a8a67c6c44b53efcb3a9ed)
2015-06-20 12:40:59 -07:00
Gera Shegalov
34e744ce1a MAPREDUCE-6316. Task Attempt List entries should link to the task overview. (Siqi Li via gera)
(cherry picked from commit 63d40d528654707b3f56619a4eb20e21cdeadc7e)
2015-06-20 11:52:11 -07:00
Yongjun Zhang
5774b1ff02 Move HDFS-7546 to release 2.7.1 in CHANGES.txt.
(cherry picked from commit bcb3c40bed572a2dd95ce7201d893d7bf59240d5)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2015-06-20 00:49:17 -07:00
Allen Wittenauer
92cff5663e HDFS-7546. Document, and set an accepting default for dfs.namenode.kerberos.principal.pattern (Harsh J via aw)
(cherry picked from commit 63613c79c1042ea3d7706ed6f7eccc8cf48ff6ea)
2015-06-20 00:40:44 -07:00
Yongjun Zhang
87c3d3739f Move HDFS-8337 to branch 2.8 in CHANGES.txt.
(cherry picked from commit 20c03c96066752f0a7158846de4d7bc4253e83f6)
2015-06-20 00:28:48 -07:00
Yongjun Zhang
d657e378ad HDFS-8337. Accessing httpfs via webhdfs doesn't work from a jar with kerberos. Contributed by Yongjun Zhang.
(cherry picked from commit 971dc838ecf8bf55a9bd64128ce2447e4613ea76)
2015-06-19 23:44:48 -07:00
Devaraj K
5c3070dc16 MAPREDUCE-6405. NullPointerException in App Attempts page. Contributed by
Siqi Li and Gera Shegalov.

(cherry picked from commit 311a4179cc53a2754d1185b1cb10e6adb1b95d3d)
2015-06-20 10:37:42 +05:30
Colin Patrick Mccabe
c94579f845 HDFS-8582. Support getting a list of reconfigurable config properties and do not generate spurious reconfig warnings (Lei (Eddy) Xu via Colin P. McCabe)
(cherry picked from commit d112d183242f447d4b742139f3a4ea531a997f45)
2015-06-19 19:14:38 -07:00
Arpit Agarwal
fcd1824b61 HDFS-8626. Reserved RBW space is not released if creation of RBW File fails. (Contributed by kanaka kumar avvaru) 2015-06-19 18:23:44 -07:00
Yongjun Zhang
430ba669cc HADOOP-12103. Small refactoring of DelegationTokenAuthenticationFilter to allow code sharing. Contributed by Yongjun Zhang.
(cherry picked from commit 49f5d20efe7af7cd7c45d93edad33997a695a746)
2015-06-19 14:46:31 -07:00
Yongjun Zhang
2e13e5b253 HDFS-8633. Fix setting of dfs.datanode.readahead.bytes in hdfs-default.xml to match DFSConfigKeys. Contributed by Ray Chiang.
(cherry picked from commit b42f1ec13d0a837f188cf424a8dd177720478cc9)
2015-06-19 09:50:14 -07:00
Gera Shegalov
01991876ed MAPREDUCE-6395. Improve the commit failure messages in MRAppMaster recovery. (Brahma Reddy Battula via gera)
(cherry picked from commit 10107243be66bae2212a2cd8575f9f5ade13fe9e)
2015-06-19 02:29:31 -07:00
Xuan
86b75ac544 YARN-3802. Two RMNodes for the same NodeId are used in RM sometimes
after NM is reconnected. Contributed by zhihai xu

(cherry picked from commit 5b5bb8dcdc888ba1ebc7e4eba0fa0e7e79edda9a)
2015-06-18 14:38:52 -07:00
Colin Patrick Mccabe
2946e92f79 HADOOP-12100. ImmutableFsPermission should not override applyUmask since that method doesn't modify the FsPermission (Bibin A. Chundatt via Colin P. McCabe)
(cherry picked from commit 6e0a9f92fe0052d39b95a605174b3f6423c6aae7)
2015-06-18 11:39:28 -07:00
Andrew Wang
7f62e41b2e HDFS-8605. Merge Refactor of DFSOutputStream from HDFS-7285 branch. (vinayakumarb)
(cherry picked from commit 1c13519e1e7588c3e2974138d37bf3449ca8b3df)
2015-06-18 08:48:23 -07:00
Devaraj K
3b9698ecac YARN-3824. Fix two minor nits in member variable properties of
YarnConfiguration. Contributed by Ray Chiang.

(cherry picked from commit 2ad668748e2535e25e3b04656c29034d58074027)
2015-06-18 16:46:33 +05:30
Vinayakumar B
80697e4f32 HADOOP-7139. Allow appending to existing SequenceFiles (Contributed by kanaka kumar avvaru)
(cherry picked from commit 295d678be8853a52c3ec3da43d9265478d6632b3)
2015-06-18 14:45:07 +05:30
Devaraj K
c4c7fd0bf1 MAPREDUCE-6373. The logger reports total input paths but it is referring
to input files. Contributed by Bibin A Chundatt.

(cherry picked from commit 1babe50a2cbaae3c8165229347e743d0dc94e979)
2015-06-18 11:45:11 +05:30
Yongjun Zhang
8cac3888c1 HADOOP-11965. determine-flaky-tests needs a summary mode. Contributed by Yufei Gu.
(cherry picked from commit 74351af3b7521b194116258c96270ddaeccd8126)
2015-06-17 21:08:55 -07:00
Akira Ajisaka
998027652f HDFS-6249. Output AclEntry in PBImageXmlWriter. Contributed by surendra singh lilhore.
(cherry picked from commit cc432885adb0182c2c5b3bf92edde12231fd567c)
2015-06-17 17:41:55 -07:00
Akira Ajisaka
9f9315008e HDFS-8615. Correct HTTP method in WebHDFS document. Contributed by Brahma Reddy Battula.
(cherry picked from commit 1a169a26bcc4e4bab7697965906cb9ca7ef8329e)
2015-06-17 17:13:32 -07:00
Colin Patrick Mccabe
8939e3cc2d HDFS-8589. Fix unused imports in BPServiceActor and BlockReportLeaseManager (cmccabe)
(cherry picked from commit 45ced38f10fcb9f831218b890786aaeb7987fed4)
2015-06-17 17:02:08 -07:00
Haohui Mai
38a16e1a45 HDFS-8446. Separate safemode related operations in GetBlockLocations(). Contributed by Haohui Mai. 2015-06-17 16:38:19 -07:00
Xuan
16d2412a25 YARN-3804. Both RM are on standBy state when kerberos user not in yarn.admin.acl. Contributed by Varun Saxena
(cherry picked from commit a826d432f9b45550cc5ab79ef63ca39b176dabb2)
2015-06-17 16:24:50 -07:00
Haohui Mai
1270cb47e1 Update CHANGES.txt for HDFS-8238. 2015-06-17 16:20:40 -07:00
Haohui Mai
09941e6f8d HDFS-8238. Move ClientProtocol to the hdfs-client. Contributed by Takanobu Asanuma. 2015-06-17 16:16:55 -07:00
Devaraj K
f0901e703b YARN-3148. Allow CORS related headers to passthrough in
WebAppProxyServlet. Contributed by Varun Saxena.

(cherry picked from commit ebb9a82519c622bb898e1eec5798c2298c726694)
2015-06-17 15:57:45 +05:30
Devaraj K
2802c63ac3 YARN-3617. Fix WindowsResourceCalculatorPlugin.getCpuFrequency() returning
always -1. Contributed by J.Andreina.

(cherry picked from commit 318d2cde7cb5c05a5f87c4ee967446bb60d28ae4)
2015-06-17 13:55:25 +05:30
Arpit Agarwal
acc90ca175 HDFS-7164. Feature documentation for HDFS-6581. (Contributed by Arpit Agarwal) 2015-06-16 19:06:39 -07:00
Tsz-Wo Nicholas Sze
64389f727c HDFS-8606. Cleanup DFSOutputStream by removing unwanted changes from HDFS-8386. Contributed by Rakesh R 2015-06-16 18:09:30 -07:00
cnauroth
63f3c24bb0 HADOOP-12076. Incomplete Cache Mechanism in CredentialProvider API. Contributed by Larry McCay.
(cherry picked from commit fbf55dcaf45285e1795cb107e7846799e4042b0b)
2015-06-16 14:44:14 -07:00
Xiaoyu Yao
4bfbc6b1d4 HDFS-8551. Fix hdfs datanode CLI usage message. Contributed by Brahma Reddy Battula.
(cherry picked from commit 9cd5ad9d84e46295249877ade50cd49c34b9bf12)
2015-06-16 14:17:51 -07:00
Xuan
fe7f2d40fe YARN-3714. AM proxy filter can not get RM webapp address from
yarn.resourcemanager.hostname.rm-id. Contributed by Masatake Iwasaki

(cherry picked from commit e27d5a13b0623e3eb43ac773eccd082b9d6fa9d0)
2015-06-16 14:06:56 -07:00
Xiaoyu Yao
8ab23d9ec1 HDFS-8548. Minicluster throws NPE on shutdown. Contributed by surendra singh lilhore.
(cherry picked from commit 6a76250b39f33466bdc8dabab33070c90aa1a389)
2015-06-16 14:00:33 -07:00
Kihwal Lee
d2d038b0a0 HDFS-4660. Block corruption can happen during pipeline recovery. Contributed by Kihwal Lee.
(cherry picked from commit c74517c46bf00af408ed866b6577623cdec02de1)
2015-06-16 15:42:00 -05:00
Akira Ajisaka
4c6a1509cd HADOOP-12095. org.apache.hadoop.fs.shell.TestCount fails. Contributed by Brahma Reddy Battula.
(cherry picked from commit b578807b9903f3f2056c7064bfe5af8619eb4835)
2015-06-16 13:38:32 -07:00
Xiaoyu Yao
d7c8a6feaa HDFS-8597. Fix TestFSImage#testZeroBlockSize on Windows. Contributed by Xiaoyu Yao.
(cherry picked from commit 4e88ff5b27cc33d311ab7a7248c3cf6303997ddd)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2015-06-16 12:47:05 -07:00
Devaraj K
eb8e2c5448 YARN-3789. Improve logs for LeafQueue#activateApplications(). Contributed
by Bibin A Chundatt.

(cherry picked from commit b039e69bb03accef485361af301fa59f03d08d6a)
2015-06-16 14:04:46 +05:30
Haohui Mai
be8e4ed1e1 HDFS-8592. SafeModeException never get unwrapped. Contributed by Haohui Mai. 2015-06-15 22:07:42 -07:00
Yongjun Zhang
b1d3ed02c1 HDFS-8544. Incorrect port specified in HFTP Guide document in branch-2. (Contributed by Brahma Reddy Battula) 2015-06-15 21:45:30 -07:00
Tsuyoshi Ozawa
ff6d5f2ee7 YARN-3711. Documentation of ResourceManager HA should explain configurations about listen addresses. Contributed by Masatake Iwasaki.
(cherry picked from commit e8c514373f2d258663497a33ffb3b231d0743b57)
2015-06-16 10:15:19 +09:00
Tsz-Wo Nicholas Sze
10b97f6655 HDFS-8361. Choose SSD over DISK in block placement. 2015-06-15 17:18:09 -07:00
Tsz-Wo Nicholas Sze
95483513ed Move HDFS-8540 to 2.8 in CHANGES.txt. 2015-06-15 17:02:45 -07:00
Tsz-Wo Nicholas Sze
9ba29f081b HDFS-8540. Mover should exit with NO_MOVE_BLOCK if no block can be moved. Contributed by surendra singh lilhore 2015-06-15 16:28:37 -07:00
Tsz-Wo Nicholas Sze
5c111a5192 HDFS-8576. Lease recovery should return true if the lease can be released and the file can be closed. Contributed by J.Andreina 2015-06-15 16:09:32 -07:00
Akira Ajisaka
98446ee695 MAPREDUCE-6363. [NNBench] Lease mismatch error when running with multiple mappers. Contributed by Brahma Reddy Battula.
(cherry picked from commit 75a2560e51387ea31ef4609ef434475bbbc628f7)
2015-06-15 14:53:28 -07:00