Commit Graph

13103 Commits

Author SHA1 Message Date
Robert Kanter c4d4df8de0 YARN-4701. When task logs are not available, port 8041 is referenced instead of port 8042 (haibochen via rkanter) 2016-02-25 12:48:02 -08:00
Zhe Zhang 8808779db3 HDFS-9734. Refactoring of checksum failure report related codes. Contributed by Kai Zheng.
Change-Id: Ie69a77e3498a360959f8e213c51fb2b17c28b64a
2016-02-25 09:55:50 -08:00
Zhe Zhang ccff6035f5 HDFS-9804. Allow long-running Balancer to login with keytab. Contributed by Xiao Chen.
Change-Id: I54b82e0b11929082057b4d21bfcf285222c94cdb
2016-02-25 09:24:32 -08:00
Tsz-Wo Nicholas Sze 6979cbfc1f HDFS-9838. Refactor the excessReplicateMap to a class. 2016-02-24 19:42:47 -08:00
Karthik Kambatla c684f2b007 YARN-4729. SchedulerApplicationAttempt#getTotalRequiredResources can throw an NPE. (kasha) 2016-02-24 18:33:57 -08:00
Chris Nauroth dbbfc58c33 HDFS-9843. Document distcp options required for copying between encrypted locations. Contributed by Xiaoyu Yao. 2016-02-24 15:16:05 -08:00
Jing Zhao 47b92f2b6f HDFS-9837. BlockManager#countNodes should be able to detect duplicated internal blocks. Contributed by Jing Zhao. 2016-02-24 15:13:56 -08:00
Robert Kanter 954dd57043 YARN-4697. NM aggregation thread pool is not bound by limits (haibochen via rkanter) 2016-02-24 15:00:24 -08:00
Zhe Zhang efdc0070d8 HADOOP-12808. Rename the RS coder from HDFS-RAID as legacy. Contributed by Rui Li.
Change-Id: Icb64eb60833fe0139aadb6da9aa666f664defc0e
2016-02-24 14:29:03 -08:00
cnauroth d6b181c6fa HADOOP-12716. KerberosAuthenticator#doSpnegoSequence use incorrect class to determine isKeyTab in JDK8. Contributed by Xiaoyu Yao. 2016-02-24 13:55:39 -08:00
Li Lu 9e0f7b8b69 YARN-4680. TimerTasks leak in ATS V1.5 Writer. (Xuan Gong via
gtcarrera9)
2016-02-24 13:43:09 -08:00
Arpit Agarwal 2e76c2f751 HADOOP-12070. Some of the bin/hadoop subcommands are not available on Windows. (Contributed by Kengo Seki) 2016-02-24 12:45:34 -08:00
cnauroth d1dd248b75 HDFS-9854. Log cipher suite negotiation more verbosely. Contributed by Wei-Chiu Chuang. 2016-02-24 12:11:35 -08:00
Kihwal Lee d27d7fc72e HDFS-9395. Make HDFS audit logging consistant. Contributed by Kuhu Shukla. 2016-02-24 12:04:01 -06:00
Sangjin Lee 553b591ba0 YARN-4722. AsyncDispatcher logs redundant event queue sizes (Jason Lowe via sjlee) 2016-02-24 09:29:41 -08:00
cnauroth 3369a4f691 HADOOP-12535. Run FileSystem contract tests with hadoop-azure. Contributed by Madhumita Chakraborty. 2016-02-23 21:37:50 -08:00
Robert Kanter 4343a4cf77 MAPREDUCE-6640. mapred job -history command should be able to take Job ID (rkanter) 2016-02-23 17:37:49 -08:00
Zhe Zhang def754ec06 HDFS-9816. Erasure Coding: allow to use multiple EC policies in striping related tests [Part 3]. Contributed by Rui Li.
Change-Id: I64b57bab4722cdc6e1e3148c3a3a401370249afe
2016-02-23 14:05:17 -08:00
Zhe Zhang 647a35e996 HDFS-9844. Correct path creation in getTrashRoot to handle root dir.
Change-Id: I5afe6c7176063892e3e632698c849bd9f4b92906
2016-02-23 13:29:39 -08:00
Jason Lowe d284e187b8 YARN-2046. Out of band heartbeats are sent only on container kill and possibly too early. Contributed by Ming Ma 2016-02-23 20:49:09 +00:00
Colin Patrick Mccabe 211c78c090 HDFS-9549. TestCacheDirectives#testExceedsCapacity is flaky (Xiao Chen via cmccabe) 2016-02-23 12:01:20 -08:00
Colin Patrick Mccabe d9c409a428 HADOOP-12829. StatisticsDataReferenceCleaner swallows interrupt exceptions (Gregory Chanan via cmccabe) 2016-02-23 11:11:22 -08:00
Junping Du 9ed17f181d YARN-3223. Resource update during NM graceful decommission. Contributed by Brook Zhou. 2016-02-23 03:30:26 -08:00
Tsuyoshi Ozawa 0e12114c9c YARN-4648. Move preemption related tests from TestFairScheduler to TestFairSchedulerPreemption. Contributed by Kai Sasaki. 2016-02-23 19:50:08 +09:00
Tsuyoshi Ozawa 48c61cd6aa HDFS-9084. Pagination, sorting and filtering of files/directories in the HDFS Web UI. (Contributed by Ravi Prakash) 2016-02-23 19:30:58 +09:00
Rohith Sharma K S de09f41147 YARN-4651. Document movetoqueue option in 'YARN Commands'. (Takashi Ohnishi via rohithsharmaks) 2016-02-23 18:03:42 +08:00
Varun Vasudev c6f2d761d5 MAPREDUCE-6635. Unsafe long to int conversion in UncompressedSplitLineReader and IndexOutOfBoundsException. Contributed by Junping Du. 2016-02-23 13:05:18 +05:30
Varun Vasudev 140cb5d745 YARN-4709. NMWebServices produces incorrect JSON for containers. Contributed by Varun Saxena. 2016-02-23 12:29:25 +05:30
cnauroth 27b77751c1 HADOOP-12555. WASB to read credentials from a credential provider. Contributed by Larry McCay. 2016-02-22 17:30:13 -08:00
Tsz-Wo Nicholas Sze 66289a3bf4 HDFS-8578. On upgrade, Datanode should process all storage/data dirs in parallel. Contributed by vinayakumarb and szetszwo 2016-02-22 15:01:15 -08:00
Zhe Zhang a2fdfff02d HADOOP-12668. Support excluding weak Ciphers in HttpServer2 through ssl-server.conf. Contributed by Vijay Singh.
Change-Id: Ie46a5427d29188935427f67e55203c19fcd83335
2016-02-22 14:13:54 -08:00
cnauroth d4f5fc23b2 HADOOP-11613. Remove commons-httpclient dependency from hadoop-azure. Contributed by Masatake Iwasaki. 2016-02-22 13:39:38 -08:00
Arpit Agarwal a63301a864 HDFS-9842. dfs.datanode.balance.bandwidthPerSec should accept friendly size units. (Contributed by Lin Yiqun) 2016-02-22 11:34:09 -08:00
Junping Du 3fab88540f YARN-4386. refreshNodesGracefully() should send recommission event to active RMNodes only. Contributed by Kuhu Shukla. 2016-02-22 07:04:19 -08:00
Akira Ajisaka 5e7d4d51f8 YARN-4707. Remove the extra char (>) from SecureContainer.md. Contributed by Brahma Reddy Battula. 2016-02-22 17:17:40 +09:00
Vinayakumar B 342c9572bf HDFS-9425. Expose number of blocks per volume as a metric (Contributed by Brahma Reddy Battula) 2016-02-22 09:29:23 +05:30
Vinayakumar B f313516731 HDFS-7452. skip StandbyException log for getCorruptFiles() (Contributed by Bramha Reddy Battula) 2016-02-22 09:21:46 +05:30
Tsuyoshi Ozawa b68901d7dd YARN-4708. Missing default mapper type in TimelineServer performance test tool usage. Contributed by Kai Sasaki. 2016-02-22 07:54:53 +09:00
Arpit Agarwal d5abd293a8 HDFS-9839. Reduce verbosity of processReport logging. (Contributed by Arpit Agarwal)
This closes #78
2016-02-20 23:19:09 -08:00
Jing Zhao e54cc29312 HDFS-9818. Correctly handle EC reconstruction work caused by not enough racks. Contributed by Jing Zhao. 2016-02-19 19:02:23 -08:00
Robert Kanter 6eae4337d1 MAPREDUCE-6613. Change mapreduce.jobhistory.jhist.format default from json to binary (rchiang via rkanter) 2016-02-19 17:15:54 -08:00
Andrew Wang 37577852ba MAPREDUCE-6637. Testcase Failure : TestFileInputFormat.testSplitLocationInfo. Contributed by Brahma Reddy Battula. 2016-02-19 16:33:17 -08:00
Junping Du 18f9b77a32 Support additional compression levels for GzipCodec. Contributed by Ravi Mutyala. 2016-02-19 14:21:25 -08:00
Jing Zhao 6546d9e7ff HDFS-9829. Erasure Coding: Improve few exception handling logic of ErasureCodingWorker. Contributed by Rakesh R. 2016-02-19 10:40:28 -08:00
Yongjun Zhang ba1c9d484a HDFS-9764. DistCp doesn't print value for several arguments including -numListstatusThreads. (Wei-Chiu Chuang via Yongjun Zhang) 2016-02-19 10:17:37 -08:00
Yongjun Zhang a963baba10 HADOOP-12828. Print user when services are started. (Wei-Chiu Chuang via Yongjun Zhang) 2016-02-19 09:41:22 -08:00
Tsz-Wo Nicholas Sze 748b6c07fe Move HDFS-8923 to Release 2.8.0 in CHANGES.txt. 2016-02-18 18:43:06 -08:00
Tsz-Wo Nicholas Sze 46f7790236 HDFS-8923. Add -source flag to balancer usage message. Contributed by Chris Trezzo 2016-02-18 18:18:12 -08:00
Robert Kanter 8eee59ce6b MAPREDUCE-6627. Add machine-readable output to mapred job -history command (rkanter) 2016-02-18 17:58:26 -08:00
cnauroth 8ab7658025 HADOOP-11031. Design Document for Credential Provider API. Contributed by Larry McCay. 2016-02-18 14:06:38 -08:00