9413 Commits

Author SHA1 Message Date
Xuan
16d2412a25 YARN-3804. Both RM are on standBy state when kerberos user not in yarn.admin.acl. Contributed by Varun Saxena
(cherry picked from commit a826d432f9b45550cc5ab79ef63ca39b176dabb2)
2015-06-17 16:24:50 -07:00
Haohui Mai
1270cb47e1 Update CHANGES.txt for HDFS-8238. 2015-06-17 16:20:40 -07:00
Haohui Mai
09941e6f8d HDFS-8238. Move ClientProtocol to the hdfs-client. Contributed by Takanobu Asanuma. 2015-06-17 16:16:55 -07:00
Devaraj K
f0901e703b YARN-3148. Allow CORS related headers to passthrough in
WebAppProxyServlet. Contributed by Varun Saxena.

(cherry picked from commit ebb9a82519c622bb898e1eec5798c2298c726694)
2015-06-17 15:57:45 +05:30
Devaraj K
2802c63ac3 YARN-3617. Fix WindowsResourceCalculatorPlugin.getCpuFrequency() returning
always -1. Contributed by J.Andreina.

(cherry picked from commit 318d2cde7cb5c05a5f87c4ee967446bb60d28ae4)
2015-06-17 13:55:25 +05:30
Arpit Agarwal
acc90ca175 HDFS-7164. Feature documentation for HDFS-6581. (Contributed by Arpit Agarwal) 2015-06-16 19:06:39 -07:00
Tsz-Wo Nicholas Sze
64389f727c HDFS-8606. Cleanup DFSOutputStream by removing unwanted changes from HDFS-8386. Contributed by Rakesh R 2015-06-16 18:09:30 -07:00
cnauroth
63f3c24bb0 HADOOP-12076. Incomplete Cache Mechanism in CredentialProvider API. Contributed by Larry McCay.
(cherry picked from commit fbf55dcaf45285e1795cb107e7846799e4042b0b)
2015-06-16 14:44:14 -07:00
Xiaoyu Yao
4bfbc6b1d4 HDFS-8551. Fix hdfs datanode CLI usage message. Contributed by Brahma Reddy Battula.
(cherry picked from commit 9cd5ad9d84e46295249877ade50cd49c34b9bf12)
2015-06-16 14:17:51 -07:00
Xuan
fe7f2d40fe YARN-3714. AM proxy filter can not get RM webapp address from
yarn.resourcemanager.hostname.rm-id. Contributed by Masatake Iwasaki

(cherry picked from commit e27d5a13b0623e3eb43ac773eccd082b9d6fa9d0)
2015-06-16 14:06:56 -07:00
Xiaoyu Yao
8ab23d9ec1 HDFS-8548. Minicluster throws NPE on shutdown. Contributed by surendra singh lilhore.
(cherry picked from commit 6a76250b39f33466bdc8dabab33070c90aa1a389)
2015-06-16 14:00:33 -07:00
Kihwal Lee
d2d038b0a0 HDFS-4660. Block corruption can happen during pipeline recovery. Contributed by Kihwal Lee.
(cherry picked from commit c74517c46bf00af408ed866b6577623cdec02de1)
2015-06-16 15:42:00 -05:00
Akira Ajisaka
4c6a1509cd HADOOP-12095. org.apache.hadoop.fs.shell.TestCount fails. Contributed by Brahma Reddy Battula.
(cherry picked from commit b578807b9903f3f2056c7064bfe5af8619eb4835)
2015-06-16 13:38:32 -07:00
Xiaoyu Yao
d7c8a6feaa HDFS-8597. Fix TestFSImage#testZeroBlockSize on Windows. Contributed by Xiaoyu Yao.
(cherry picked from commit 4e88ff5b27cc33d311ab7a7248c3cf6303997ddd)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2015-06-16 12:47:05 -07:00
Devaraj K
eb8e2c5448 YARN-3789. Improve logs for LeafQueue#activateApplications(). Contributed
by Bibin A Chundatt.

(cherry picked from commit b039e69bb03accef485361af301fa59f03d08d6a)
2015-06-16 14:04:46 +05:30
Haohui Mai
be8e4ed1e1 HDFS-8592. SafeModeException never get unwrapped. Contributed by Haohui Mai. 2015-06-15 22:07:42 -07:00
Yongjun Zhang
b1d3ed02c1 HDFS-8544. Incorrect port specified in HFTP Guide document in branch-2. (Contributed by Brahma Reddy Battula) 2015-06-15 21:45:30 -07:00
Tsuyoshi Ozawa
ff6d5f2ee7 YARN-3711. Documentation of ResourceManager HA should explain configurations about listen addresses. Contributed by Masatake Iwasaki.
(cherry picked from commit e8c514373f2d258663497a33ffb3b231d0743b57)
2015-06-16 10:15:19 +09:00
Tsz-Wo Nicholas Sze
10b97f6655 HDFS-8361. Choose SSD over DISK in block placement. 2015-06-15 17:18:09 -07:00
Tsz-Wo Nicholas Sze
95483513ed Move HDFS-8540 to 2.8 in CHANGES.txt. 2015-06-15 17:02:45 -07:00
Tsz-Wo Nicholas Sze
9ba29f081b HDFS-8540. Mover should exit with NO_MOVE_BLOCK if no block can be moved. Contributed by surendra singh lilhore 2015-06-15 16:28:37 -07:00
Tsz-Wo Nicholas Sze
5c111a5192 HDFS-8576. Lease recovery should return true if the lease can be released and the file can be closed. Contributed by J.Andreina 2015-06-15 16:09:32 -07:00
Akira Ajisaka
98446ee695 MAPREDUCE-6363. [NNBench] Lease mismatch error when running with multiple mappers. Contributed by Brahma Reddy Battula.
(cherry picked from commit 75a2560e51387ea31ef4609ef434475bbbc628f7)
2015-06-15 14:53:28 -07:00
Vinod Kumar Vavilapalli
069acdac8a HADOOP-12001. Moving CHANGES.txt up into 2.8.
(cherry picked from commit 04c9a077c8f88e3d8ed3e7966966e13f68c5c2ec)
2015-06-15 14:30:07 -07:00
Vinod Kumar Vavilapalli
58d3a9aaf6 HADOOP-12001. Fixed LdapGroupsMapping to include configurable Posix UID and GID attributes during the search. Contributed by Patrick White.
(cherry picked from commit 722aa1db1f2ac3db0e70063022436a90f90643f3)
2015-06-15 14:25:40 -07:00
Arpit Agarwal
ea9a9b3d7e HDFS-8607. TestFileCorruption doesn't work as expected. (Contributed by Walter Su) 2015-06-15 10:12:07 -07:00
Arpit Agarwal
d07f3804b0 HDFS-8595. TestCommitBlockSynchronization fails in branch-2.7. (Patch applies to all branches). (Contributed by Arpit Agarwal) 2015-06-14 16:24:36 -07:00
Yongjun Zhang
cd578fa289 HDFS-8596. TestDistributedFileSystem et al tests are broken in branch-2 due to incorrect setting of "datanode" attribute. Contributed by Yongjun Zhang.
(cherry picked from commit b0dc291961410b6ac2b275cdcff4b95d75727e8d)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/web/DatanodeHttpServer.java
2015-06-14 12:01:28 -07:00
cnauroth
92144ca75c HDFS-8593. Calculation of effective layout version mishandles comparison to current layout version in storage. Contributed by Chris Nauroth.
(cherry picked from commit b8341f1cd89791c51b396ad531ec7fcc631be149)
2015-06-13 10:38:03 -07:00
Andrew Wang
2776255ed6 HDFS-8499. Refactor BlockInfo class hierarchy with static helper class. Contributed by Zhe Zhang.
(cherry picked from commit 355e98ab7c7dd997378a8624f642199713467fb8)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestReplicationPolicy.java
2015-06-12 11:39:02 -07:00
Colin Patrick Mccabe
378bb484bb HDFS-7923. The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages (cmccabe)
(cherry picked from commit 12b5b06c063d93e6c683c9b6fac9a96912f59e59)
2015-06-12 11:29:05 -07:00
Akira Ajisaka
e397cca456 HADOOP-11971. Move test utilities for tracing from hadoop-hdfs to hadoop-common. Contributed by Masatake Iwasaki.
(cherry picked from commit e4489d97e5f0cec601b93e1b883fa194a7353229)
2015-06-12 07:26:05 -07:00
Devaraj K
3863342ca9 YARN-3794. TestRMEmbeddedElector fails because of ambiguous LOG reference.
Contributed by Chengbing Liu.

(cherry picked from commit d8dcfa98e3ca6a6fea414fd503589bb83b7a9c51)
2015-06-12 13:45:05 +05:30
Haohui Mai
f1ee2eaf86 HDFS-8572. DN always uses HTTP/localhost@REALM principals in SPNEGO. Contributed by Haohui Mai. 2015-06-11 18:59:53 -07:00
Arpit Agarwal
a560e654d9 HDFS-8583. Document that NFS gateway does not work with rpcbind on SLES 11. (Arpit Agarwal) 2015-06-11 15:08:50 -07:00
Colin Patrick Mccabe
754dd3496c HDFS-8566. HDFS documentation about debug commands wrongly identifies them as "hdfs dfs" commands (Surendra Singh Lilhore via Colin P. McCabe)
(cherry picked from commit 587309bbbadd4db41be83347e8c454049f4a7561)
2015-06-11 14:28:41 -07:00
Andrew Wang
086eb49424 HDFS-8573. Move creation of restartMeta file logic from BlockReceiver to ReplicaInPipeline. Contributed by Eddy Xu.
(cherry picked from commit b258b344bb76af6492828201959e36b45f0f75b8)
2015-06-11 10:12:40 -07:00
Vinayakumar B
7454ed2b59 HADOOP-12074. in Shell.java#runCommand() rethrow InterruptedException as InterruptedIOException (Contributed by Lavkesh Lahngir)
(cherry picked from commit 95c73d49b1bb459b626a9ac52acadb8f5fa724de)
2015-06-11 12:00:17 +05:30
Xuan
8a6c7d9973 YARN-3785. Support for Resource as an argument during submitApp call in
MockRM test class. Contributed by Sunil G

(cherry picked from commit 5583f88bf7f1852dc0907ce55d0755e4fb22107a)
2015-06-10 21:41:58 -07:00
Andrew Wang
9523e2c098 HDFS-8549. Abort the balancer if an upgrade is in progress.
(cherry picked from commit a7a7768341f1b7d3a8f2686e2f4d00c57f2e1d4f)
2015-06-10 13:43:00 -07:00
Devaraj K
b117527bf3 MAPREDUCE-6389. Fix BaileyBorweinPlouffe CLI usage message. Contributed by
Brahma Reddy Battula.

(cherry picked from commit c7729efee8727b59f2c78cd5a3ad23fa84139068)
2015-06-10 21:06:35 +05:30
Devaraj K
5426e3e929 MAPREDUCE-6350. JobHistory doesn't support fully-functional search.
Contributed by Siqi Li.
2015-06-10 12:43:31 +05:30
Vinayakumar B
d21bc811d8 HADOOP-7817. RawLocalFileSystem.append() should give FSDataOutputStream with accurate .getPos() (Contributed by kanaka kumar avvaru)
(cherry picked from commit 48ca23def1d1c28448a65238814070e79c8f4c4e)
2015-06-10 11:07:04 +05:30
Arpit Agarwal
2d67dff15f HADOOP-12078. The default retry policy does not handle RetriableException correctly. (Contributed by Arpit Agarwal) 2015-06-09 20:58:46 -07:00
Xiaoyu Yao
d8d9041187 HDFS-8568. TestClusterId#testFormatWithEmptyClusterIdOption is failing. Contributed by Rakesh R.
(cherry picked from commit 3c2397cb041068172c8ad209996414d7371d2eca)
2015-06-09 12:21:53 -07:00
Zhijie Shen
0dad10d845 YARN-3787. Allowed generic history service to load a number of applications whose started time is within the given range. Contributed by Xuan Gong.
(cherry picked from commit 8d0ef3163287d811381e94cc0101dbc9847ee2db)
2015-06-08 23:21:35 -07:00
cnauroth
f5b0cce7fa HADOOP-12073. Azure FileSystem PageBlobInputStream does not return -1 on EOF. Contributed by Ivan Mitic.
(cherry picked from commit c45784bc9031353b938f4756473937cca759b3dc)
2015-06-08 22:42:24 -07:00
Xiaoyu Yao
116a72096d HDFS-8552. Fix hdfs CLI usage message for namenode and zkfc. Contributed by Brahma Reddy Battula
(cherry picked from commit 927577c87ca19e8b5b75722f78e2def6d9386576)
2015-06-08 22:03:07 -07:00
cnauroth
5a002aef12 MAPREDUCE-6392. Document mapred class path options. Contributed by Brahma Reddy Battula.
(cherry picked from commit 025a3a8be07ba2b0c27ee39034b506d91aa486fc)
2015-06-08 16:22:12 -07:00
cnauroth
d9016b0286 YARN-3786. Document yarn class path options. Contributed by Brahma Reddy Battula.
(cherry picked from commit a531b058aef48c9bf2e5366ed110e1f817316c1a)
2015-06-08 16:18:43 -07:00