Commit Graph

9950 Commits

Author SHA1 Message Date
Vinayakumar B f40b4f4542 HDFS-6955. DN should reserve disk space for a full block when creating tmp files (Contributed by Kanaka Kumar Avvaru) 2015-09-18 16:42:22 +05:30
Steve Loughran 22dee29857 YARN-2597 MiniYARNCluster should propagate reason for AHS not starting 2015-09-18 09:45:17 +01:00
Rohith Sharma K S d94c092ad1 YARN-4135. Improve the assertion message in MockRM while failing after waiting for the state.(Nijel S F via rohithsharmaks)
(cherry picked from commit 723c31d45b)
2015-09-18 08:46:36 +05:30
Wangda Tan 1f75e951f5 HADOOP-12386. RetryPolicies.RETRY_FOREVER should be able to specify a retry interval. (Sunil G via wangda)
(cherry picked from commit 6b97fa6652)
2015-09-17 17:47:22 -07:00
Jason Lowe f27f1ef44c MAPREDUCE-5982. Task attempts that fail from the ASSIGNED state can disappear. Contributed by Chang Li
(cherry picked from commit ee4ee6af6a)
2015-09-17 21:38:44 +00:00
Haohui Mai cadde8c1e5 HDFS-9022. Move NameNode.getAddress() and NameNode.getUri() to hadoop-hdfs-client. Contributed by Mingliang Liu. 2015-09-17 14:17:30 -07:00
Jason Lowe 4861fadb17 MAPREDUCE-5002. AM could potentially allocate a reduce container to a map attempt. Contributed by Chang Li
(cherry picked from commit 3f82f582e5)
2015-09-17 18:18:28 +00:00
Jason Lowe 316296e35f MAPREDUCE-6481. LineRecordReader may give incomplete record and wrong position/key information for uncompressed input sometimes. Contributed by Zhihai Xu
(cherry picked from commit 58d1a02b8d)
2015-09-17 14:31:57 +00:00
Jian He 5d2f85021f YARN-4034. Render cluster Max Priority in scheduler metrics in RM web UI. Contributed by Rohith Sharma K S
(cherry picked from commit 6c6e734f0b)
2015-09-17 14:56:32 +08:00
Haohui Mai d5936aa48c HADOOP-12417. TestWebDelegationToken failing with port in use. Contributed by Mingliang Liu. 2015-09-16 18:38:54 -07:00
Haohui Mai ac2ed09be7 MAPREDUCE-6477. Replace usage of deprecated NameNode.DEFAULT_PORT in TestFileSystem. Contributed by Mingliang Liu. 2015-09-16 13:06:38 -07:00
Aaron T. Myers e533555b57 Fix-up for HDFS-9072 - adding missing import of DFSTestUtil. 2015-09-16 12:30:31 -07:00
Haohui Mai a343aa928a HDFS-7995. Implement chmod in the HDFS Web UI. Contributed by Ravi Prakash and Haohui Mai. 2015-09-16 11:50:45 -07:00
Steve Loughran ab09573fcb YARN-3433. Jersey tests failing with Port in Use -again. (Brahma Reddy Battula) 2015-09-16 10:30:49 +01:00
Steve Loughran 9a8d09dada HDFS-9073. Fix failures in TestLazyPersistLockedMemory testReleaseOnEviction(). (J.Andreina via stevel) 2015-09-16 10:11:59 +01:00
Steve Loughran 1f28703d93 HDFS-9072. Fix random failures in TestJMXGet. (J.Andreina via stevel) 2015-09-16 10:08:18 +01:00
Jian He 9eda3ce3fa YARN-4078. Add getPendingResourceRequestForAttempt in YarnScheduler interface. Contributed by Naganarasimha G R
(cherry picked from commit 452079af8b)
2015-09-16 15:01:23 +08:00
Eric Yang b4bb8e1731 HADOOP-12374. Updated expunge command description.
(WeiWei Yang via eyang)
2015-09-15 20:05:01 -07:00
Akira Ajisaka e38e5b56bd HADOOP-12416. Trash messages should be handled by Logger instead of being delivered on System.out. Contributed by Mingliang Liu.
(cherry picked from commit 77aaf4cf7d)
2015-09-16 10:20:53 +09:00
Haohui Mai 08c2c402cf HDFS-7986. Allow files / directories to be deleted from the NameNode UI. Contributed by Ravi Prakash. 2015-09-15 16:48:33 -07:00
cnauroth b297a9c95c HDFS-9082. Change the log level in WebHdfsFileSystem.initialize() from INFO to DEBUG. Contributed by Santhosh Nayak.
(cherry picked from commit 559c09dc0e)
2015-09-15 15:13:56 -07:00
Xuan f3c0a210b6 YARN-4149. yarn logs -am should provide an option to fetch all the log
files. Contributed by Varun Vasudev

(cherry picked from commit 34ef1a092b)
2015-09-15 14:37:59 -07:00
Jason Lowe 181bda0421 YARN-4158. Remove duplicate close for LogWriter in AppLogAggregatorImpl#uploadLogsForContainers. Contributed by Zhihai Xu
(cherry picked from commit 8c1cdb17a0)
2015-09-15 20:22:23 +00:00
Jason Lowe 52f56524d4 MAPREDUCE-6472. MapReduce AM should have java.io.tmpdir=./tmp to be consistent with tasks. Contributed by Naganarasimha G R
(cherry picked from commit 62943b8e3a)
2015-09-15 19:44:17 +00:00
Vinayakumar B 2b78714c68 HDFS-8953. DataNode Metrics logging (Contributed by Kanaka Kumar Avvaru)
(cherry picked from commit ce69c9b54c)
2015-09-16 00:18:59 +05:30
Wangda Tan c31fe79979 YARN-3717. Expose app/am/queue's node-label-expression to RM web UI / CLI / REST-API. (Naganarasimha G R via wangda)
(cherry picked from commit ae5308fe1d)
2015-09-15 11:41:57 -07:00
cnauroth be9354d010 HADOOP-12413. AccessControlList should avoid calling getGroupNames in isUserInList with empty groups. Contributed by Zhihai Xu.
(cherry picked from commit b2017d9b03)
2015-09-15 10:42:02 -07:00
Ming Ma 3531823fcc HDFS-9008. Balancer#Parameters class could use a builder pattern. (Chris Trezzo via mingma)
(cherry picked from commit 083b44c136)
2015-09-15 10:18:44 -07:00
Junping Du df714e25aa YARN-313. Add Admin API for supporting node resource configuration in command line. (Contributed by Inigo Goiri, Kenji Kikushima and Junping Du)
(cherry picked from commit 73e3a49eb0)
2015-09-15 07:58:47 -07:00
Vinayakumar B aa963ab441 HDFS-9067. o.a.h.hdfs.server.datanode.fsdataset.impl.TestLazyWriter is failing in trunk (Contributed by Surendra Singh Lilhore)
(cherry picked from commit a440567491)
2015-09-15 17:33:15 +05:30
Jian He eacc18677a YARN-3635. Refactored current queue mapping implementation in CapacityScheduler to use a generic PlacementManager framework. Contributed by Wangda Tan
(cherry picked from commit 5468baa80a)
2015-09-15 19:02:17 +08:00
Haohui Mai df9bb7449c HDFS-9065. Include commas on # of files, blocks, total filesystem objects in NN Web UI. Contributed by Daniel Templeton. 2015-09-14 20:27:24 -07:00
Haohui Mai 5546df0020 HDFS-9010. Replace NameNode.DEFAULT_PORT with HdfsClientConfigKeys.DFS_NAMENODE_RPC_PORT_DEFAULT config key. Contributed by Mingliang Liu. 2015-09-14 18:23:10 -07:00
Wangda Tan e552775545 YARN-4151. Fix findbugs errors in hadoop-yarn-server-common module. (Meng Ding via wangda)
(cherry picked from commit e2a0270217)
2015-09-14 16:04:08 -07:00
Colin Patrick Mccabe 149d731559 HDFS-8829. Make SO_RCVBUF and SO_SNDBUF size configurable for DataTransferProtocol sockets and allow configuring auto-tuning (He Tianyi via Colin P. McCabe)
Change-Id: I77dc71aaf9e14ef743f2a2cbebeec04a4f628c78
(cherry picked from commit 7b5cf5352e)
2015-09-14 16:02:26 -07:00
Colin Patrick Mccabe 2596695654 HDFS-8996. Consolidate validateLog and scanLog in FJM#EditLogFile (Zhe Zhang via Colin P. McCabe)
(cherry picked from commit 53bad4eb00)
2015-09-14 15:52:39 -07:00
Steve Loughran c951d56556 HDFS-9069. TestNameNodeMetricsLogger failing -port in use. (stevel) 2015-09-14 10:36:34 +01:00
Jian He b705d9d0ac YARN-4126. RM should not issue delegation tokens in unsecure mode. Contributed by Bibin A Chundatt
(cherry picked from commit e1b1d7e4ae)
2015-09-14 14:15:04 +08:00
Karthik Kambatla 1f9f219062 YARN-3697. FairScheduler: ContinuousSchedulingThread can fail to shutdown. (Zhihai Xu via kasha)
(cherry picked from commit 332b520a48)
2015-09-13 18:08:03 -07:00
Karthik Kambatla 11e2fa151c YARN-2005. Blacklisting support for scheduling AMs. (Anubhav Dhoot via kasha)
(cherry picked from commit 81df7b586a)
2015-09-13 17:06:04 -07:00
Steve Loughran 988749e6ea HADOOP-12087. [JDK8] Fix javadoc errors caused by incorrect or illegal tags. (Akira AJISAKA via stevel). 2015-09-13 14:25:06 +01:00
Haohui Mai 323821b174 HDFS-9041. Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client. Contributed by Mingliang Liu. 2015-09-12 11:02:27 -07:00
Steve Loughran c8fe31e03a HADOOP-12407. Test failing: hadoop.ipc.TestSaslRPC. (stevel) 2015-09-12 18:55:42 +01:00
Steve Loughran c4128165b5 syncing branch-2 and trunk CHANGES.TXT to be closer together 2015-09-12 18:52:04 +01:00
Vinayakumar B 7545488b12 HDFS-9036. In BlockPlacementPolicyWithNodeGroup#chooseLocalStorage , random node is selected eventhough fallbackToLocalRack is true. (Contributed by J.Andreina)
(cherry picked from commit c715650385)
2015-09-12 17:40:41 +05:30
Vinayakumar B 1857621671 HDFS-9042. Update document for the Storage policy name (Contributed by J.Andreina)
(cherry picked from commit d8455479b8)
2015-09-12 12:36:37 +05:30
Robert Kanter 764f8baa99 HADOOP-12348. MetricsSystemImpl creates MetricsSourceAdapter with wrong time unit parameter. (zxu via rkanter) 2015-09-11 15:21:22 -07:00
Kihwal Lee 50a367da20 Fix up CHANGES.txt 2015-09-11 16:02:05 -05:00
Robert Kanter 43f051a09a YARN-4145. Make RMHATestBase abstract so its not run when running all tests under that namespace (adhoot via rkanter)
(cherry picked from commit ea4bb2749f)
2015-09-11 11:46:35 -07:00
Robert Kanter d07eef8c87 YARN-4115. Reduce loglevel of ContainerManagementProtocolProxy to Debug (adhoot via rkanter)
(cherry picked from commit b84fb41bb6)
2015-09-11 11:46:35 -07:00