Commit Graph

9108 Commits

Author SHA1 Message Date
Colin Patrick Mccabe ab80a572be HDFS-8113. Add check for null BlockCollection pointers in BlockInfoContiguous structures (Chengbing Liu via Colin P. McCabe)
(cherry picked from commit f523e963e4)
2015-05-08 14:00:13 -07:00
Yongjun Zhang fbb2cf54bc HDFS-8311. DataStreamer.transfer() should timeout the socket InputStream. (Esteban Gutierrez via Yongjun Zhang)
(cherry picked from commit 730f9930a4)
2015-05-08 01:38:01 -07:00
Jason Lowe 4b96834e0d HADOOP-7165. listLocatedStatus(path, filter) is not redefined in FilterFs. Contributed by Hairong Kuang
(cherry picked from commit c4bd2cdded)
2015-05-08 20:36:55 +00:00
Kihwal Lee 30cb540b4d HDFS-7433. Optimize performance of DatanodeManager's node map. Contributed by Daryn Sharp.
(cherry picked from commit 7a7960be41)
2015-05-08 15:20:14 -05:00
Colin Patrick Mccabe d83ae68bb0 HDFS-8284. Update documentation about how to use HTrace with HDFS (Masatake Iwasaki via Colin P. McCabe)
(cherry picked from commit 8f7c2364d7)
2015-05-08 12:30:34 -07:00
Wangda Tan f8807839c6 YARN-3593. Add label-type and Improve "DEFAULT_PARTITION" in Node Labels Page. (Naganarasimha G R via wangda)
(cherry picked from commit f55d21d894)
2015-05-08 12:05:25 -07:00
Arpit Agarwal a481f950c3 HADOOP-10356. Corrections in winutils/chmod.c (Contributed by René Nyffenegger) 2015-05-08 11:42:55 -07:00
cnauroth 5c188908fe HDFS-5640. Add snapshot methods to FileContext. Contributed by Rakesh R.
(cherry picked from commit 26f61d41df)
2015-05-08 11:21:02 -07:00
Arun Suresh 2124742e07 HDFS-7559. Create unit test to automatically compare HDFS related classes and hdfs-default.xml. (Ray Chiang via asuresh)
(cherry picked from commit 3cefc02af7)
2015-05-08 10:31:23 -07:00
Thomas Graves 638feaaa35 YARN-20. More information for yarn.resourcemanager.webapp.address in yarn-default.xml (Bartosz Ługowski vai tgraves)
(cherry picked from commit f0f5e3c075)
2015-05-08 17:22:33 +00:00
Arpit Agarwal 68d85e92bf HDFS-8340. Fix NFS documentation of nfs.wtmax. (Contributed by Ajith S) 2015-05-08 10:15:35 -07:00
Arpit Agarwal a0905ae57a HDFS-8274. NFS configuration nfs.dump.dir not working (Contributed by Ajith S) 2015-05-08 10:04:11 -07:00
Robert (Bobby) Evans eef8d70bb0 HADOOP-6842. "hadoop fs -text" does not give a useful text representation of MapWritable objects
(cherry picked from commit cc17c83585)
2015-05-08 12:00:31 -05:00
Haohui Mai d4d7d7bf22 HDFS-8346. libwebhdfs build fails during link due to unresolved external symbols. Contributed by Chris Nauroth. 2015-05-08 09:58:00 -07:00
Thomas Graves 547b069887 YARN-3600. AM container link is broken (Naganarasimha G R via tgraves
(cherry picked from commit 5d708a4725)
2015-05-08 16:37:20 +00:00
Robert (Bobby) Evans 28e0593b96 YARN-644: Basic null check is not performed on passed in arguments before using them in ContainerManagerImpl.startContainer
(cherry picked from commit bcf2890502)
2015-05-08 11:11:53 -05:00
Devaraj K a957baeb71 MAPREDUCE-5981. Log levels of certain MR logs can be changed to DEBUG.
Contributed by Varun Saxena.

(cherry picked from commit dc2b2ae31f)
2015-05-08 21:28:52 +05:30
Kihwal Lee 802a5775f3 HDFS-7894. Rolling upgrade readiness is not updated in jmx until query command is issued. Contributed by Brahma Reddy Battula.
(cherry picked from commit 6f622672b6)
2015-05-08 09:32:07 -05:00
Devaraj K bf8be56292 YARN-2784. Make POM project names consistent. Contributed by Rohith. 2015-05-08 19:26:11 +05:30
Jason Lowe bcb863b156 YARN-3554. Default value for maximum nodemanager connect wait time is too high. Contributed by Naganarasimha G R
(cherry picked from commit 9757864fd6)
2015-05-08 13:47:48 +00:00
Uma Maheswara Rao G faf26f081c HDFS-6285. tidy an error log inside BlockReceiver. Contributed by Liang Xie.
(cherry picked from commit 7b1ea9c481)
2015-05-08 17:25:07 +05:30
Vinayakumar B d129bbbb37 HDFS-3384. DataStreamer thread should be closed immediatly when failed to setup a PipelineForAppendOrRecovery (Contributed by Uma Maheswara Rao G)
(cherry picked from commit c648317a68)
2015-05-08 17:18:59 +05:30
Vinayakumar B 2c3d79023b HADOOP-11877. SnappyDecompressor's Logger class name is wrong ( Contributed by surendra singh lilhore)
(cherry picked from commit 1ffb7fa42e)
2015-05-08 16:53:16 +05:30
Vinayakumar B a87ab77fec HDFS-6576. Datanode log is generating at root directory in security mode (Contributed by surendra singh lilhore) 2015-05-08 16:37:36 +05:30
Tsuyoshi Ozawa 5ddc3adb0d YARN-3169. Drop YARN's overview document. Contributed by Brahma Reddy Battula.
(cherry picked from commit b419c1b2ec)
2015-05-08 19:58:47 +09:00
Vinayakumar B 3ee1b50dad HDFS-8226. Non-HA rollback compatibility broken (Contributed by J.Andreina)
Added one missed change, missed while resolving conflict
2015-05-08 15:39:47 +05:30
Vinayakumar B 3a894b4563 HDFS-8226. Non-HA rollback compatibility broken (Contributed by J.Andreina)
(cherry picked from commit e01c1a979c)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-dfs.sh
	hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HdfsUserGuide.md
2015-05-08 15:34:17 +05:30
Devaraj K ade5165ecf MAPREDUCE-6342. Make POM project names consistent. Contributed by Rohith. 2015-05-08 15:20:35 +05:30
Vinayakumar B eaa5f3e448 HDFS-8209. Support different number of datanode directories in MiniDFSCluster. (Contributed by surendra singh lilhore)
(cherry picked from commit 4c6816faf8)
2015-05-08 15:04:58 +05:30
Akira Ajisaka 5cc036d473 MAPREDUCE-6079. Rename JobImpl#username to reporterUserName. Contributed by Tsuyoshi Ozawa.
(cherry picked from commit ecfa052274)
2015-05-08 18:17:35 +09:00
Tsuyoshi Ozawa 8109f29ee2 HDFS-8207. Improper log message when blockreport interval compared with initial delay. Contributed by Brahma Reddy Battula and Ashish Singhi.
(cherry picked from commit 888e630990)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2015-05-08 18:14:08 +09:00
Vinayakumar B 595b92e2c2 HDFS-8175. Provide information on snapshotDiff for supporting the comparison between snapshot and current status (Contributed by J.Andreina)
(cherry picked from commit 6232235df3)
2015-05-08 14:38:53 +05:30
Vinayakumar B 10999ffd7a HDFS-8187. Remove usage of '-setStoragePolicy' and '-getStoragePolicy' using dfsadmin cmd (as it is not been supported) (Contributed by J.Andreina)
(cherry picked from commit e642eff0e0)
2015-05-08 14:26:58 +05:30
Uma Maheswara Rao G a56f57b421 HDFS-8108. Fsck should provide the info on mandatory option to be used along with -blocks ,-locations and -racks. Contributed by J.Andreina.
(cherry picked from commit 4b00ae5c11)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/DFSck.java
2015-05-08 14:23:42 +05:30
Akira Ajisaka 143c9a8ff2 HDFS-8222. Remove usage of "dfsadmin -upgradeProgress" from document which is no longer supported. Contributed by J.Andreina.
(cherry picked from commit fd605997ee)
2015-05-08 17:23:25 +09:00
Vinayakumar B 1f78502416 HDFS-7998. HDFS Federation : Command mentioned to add a NN to existing federated cluster is wrong (Contributed by Ajith S)
(cherry picked from commit 26da2ddf38)
2015-05-08 13:47:06 +05:30
Uma Maheswara Rao G b7a5ebd566 HDFS-8332. DFS client API calls should check filesystem closed. Contributed by Rakesh R. Merge from trunk 2015-05-08 13:46:04 +05:30
Tsuyoshi Ozawa b1f3590b22 YARN-3589. RM and AH web UI display DOCTYPE wrongly. Contbituted by Rohith.
(cherry picked from commit f26700f287)
2015-05-08 17:13:56 +09:00
Tsuyoshi Ozawa 1ae8bf5b21 MAPREDUCE-6284. Add Task Attempt State API to MapReduce Application Master REST API. Contributed by Ryu Kobayashi.
(cherry picked from commit d18f10ad1b)
2015-05-08 16:00:41 +09:00
Devaraj K 0d286d1041 YARN-3358. Audit log not present while refreshing Service ACLs.
Contributed by Varun Saxena.

(cherry picked from commit ef3d66d462)
2015-05-08 12:15:45 +05:30
Vinayakumar B 089d420a82 HDFS-6291. FSImage may be left unclosed in BootstrapStandby#doRun() ( Contributed by Sanghyun Yun)
(cherry picked from commit e5e492a963)
2015-05-08 11:26:56 +05:30
Uma Maheswara Rao G 7fe1d74005 HDFS-8174. Update replication count to live rep count in fsck report. Contributed by J.Andreina
(cherry picked from commit 2ea0f2fc93)
2015-05-08 11:07:58 +05:30
Devaraj K dce2381dc4 YARN-3592. Fix typos in RMNodeLabelsManager. Contributed by Sunil G.
(cherry picked from commit a28cd02ba0)
2015-05-08 10:55:53 +05:30
Vinayakumar B d0fff5d328 HDFS-8067. haadmin prints out stale help messages (Contributed by Ajith S)
(cherry picked from commit 66988476d0)
2015-05-08 10:47:23 +05:30
Vinayakumar B 00954714a6 HDFS-8257. Namenode rollingUpgrade option is incorrect in document (Contributed by J.Andreina)
(cherry picked from commit c7c26a1e4a)
2015-05-08 10:36:09 +05:30
Vinayakumar B 14d88a85e4 HADOOP-11922. Misspelling of threshold in log4j.properties for tests in hadoop-tools (Contributed by Gabor Liptak)
(cherry picked from commit f33efbc827)
2015-05-08 10:23:27 +05:30
Akira Ajisaka c7f3dd1eb3 YARN-3572. Correct typos in WritingYarnApplications.md. Contributed by Gabor Liptak.
(cherry picked from commit a521b50955)
2015-05-08 13:25:07 +09:00
Akira Ajisaka 170f1b0afd YARN-1832. Fix wrong MockLocalizerStatus#equals implementation. Contributed by Hong Zhiguo.
(cherry picked from commit b167fe7605)
2015-05-08 11:15:28 +09:00
Jian He d817fbb34d YARN-2918. RM should not fail on startup if queue's configured labels do not exist in cluster-node-labels. Contributed by Wangda Tan
(cherry picked from commit f489a4ec96)
2015-05-07 17:36:24 -07:00
Haohui Mai a3abe8d7e4 HDFS-8037. CheckAccess in WebHDFS silently accepts malformed FsActions parameters. Contributed by Walter Su. 2015-05-07 15:25:36 -07:00