Commit Graph

13154 Commits

Author SHA1 Message Date
Zhe Zhang b4a05c1fd5 HDFS-9674. The HTrace span for OpWriteBlock should record the maxWriteToDisk time. Contributed by Colin McCabe.
Change-Id: I9bf3f3bcd57f5880189ad7c160f3dd66f97d904b
2016-01-21 13:25:42 -08:00
Allen Wittenauer 2a867355df HADOOP-12651. Replace dev-support with wrappers to Yetus (aw) 2016-01-21 13:03:34 -08:00
Allen Wittenauer 8cecad2d56 HADOOP-12651. Replace dev-support with wrappers to Yetus (aw) 2016-01-21 12:22:03 -08:00
Jing Zhao c304890c8c HDFS-9542. Move BlockIdManager from FSNamesystem to BlockManager. Contributed by Jing Zhao. 2016-01-21 11:13:17 -08:00
Jason Lowe 468a53b22f YARN-4610. Reservations continue looking for one app causes other apps to starve. Contributed by Jason Lowe 2016-01-21 18:31:29 +00:00
Zhe Zhang 1bb31fb22e HADOOP-11828. Implement the Hitchhiker erasure coding algorithm. Contributed by Jack Liu Quan.
Change-Id: If43475ccc2574df60949c947af562722db076251
2016-01-21 10:30:05 -08:00
Akira Ajisaka 2ac39ca762 HADOOP-7161. Remove unnecessary oro package from dependency management section. Contributed by Sean Busbey. 2016-01-22 02:45:22 +09:00
Akira Ajisaka 3ac9511da2 YARN-4608. Redundant code statement in WritingYarnApplications. Contributed by Kai Sasaki. 2016-01-22 02:14:31 +09:00
Karthik Kambatla 4992398aee YARN-4603. FairScheduler should mention user requested queuename in error message when failed in queue ACL check. (Tao Jie via kasha) 2016-01-21 17:40:59 +01:00
Jason Lowe f858ac2426 YARN-4492. Add documentation for preemption supported in Capacity scheduler. Contributed by Naganarasimha G R 2016-01-21 15:38:40 +00:00
Kihwal Lee 3616c7b855 HDFS-9634. webhdfs client side exceptions don't provide enough details. Contributed by Eric Payne. 2016-01-21 09:32:57 -06:00
Vinayakumar B 446987e20a HADOOP-12423. Handle failure of registering shutdownhook by ShutdownHookManager in static block (Contributed by Abhishek Agarwal) 2016-01-21 20:08:24 +05:30
Vinayakumar B b7372b7166 HDFS-9625. set replication for empty file failed when set storage policy (Contributed by DENG FEI) 2016-01-21 19:17:05 +05:30
Masatake Iwasaki 9eec6cbedc HADOOP-12605. Fix intermittent failure of TestIPC.testIpcWithReaderQueuing (iwasakims) 2016-01-20 05:00:02 +09:00
Wangda Tan 5ff5f67332 YARN-4557. Fix improper Queues sorting in PartitionedQueueComparator when accessible-node-labels=*. (Naganarasimha G R via wangda) 2016-01-21 11:21:06 +08:00
Xuan 1708a4cd23 YARN-4611. Fix scheduler load simulator to support multi-layer network
location. Contributed by Ming Ma.
2016-01-20 15:41:50 -08:00
Xuan 890a2ebd1a YARN-4559. Make leader elector and zk store share the same curator
client. Contributed by Jian He
2016-01-20 14:48:10 -08:00
Lei Xu 2ec438e8f7 HDFS-9655. NN should start JVM pause monitor before loading fsimage. (John Zhuge via Lei (Eddy) Xu) 2016-01-20 14:26:11 -08:00
Colin Patrick Mccabe 7905788db9 HDFS-9576: HTrace: collect position/length information on read operations (zhz via cmccabe) 2016-01-20 11:26:44 -08:00
Vinayakumar B 1425578690 HDFS-9661. Deadlock in DN.FsDatasetImpl between moveBlockAcrossStorage and createRbw (Contributed by ade) 2016-01-20 21:04:21 +05:30
Yongjun Zhang 57d0a94305 HDFS-6054. MiniQJMHACluster should not use static port to avoid binding failure in unit test. (Yongjun Zhang) 2016-01-19 22:54:47 -08:00
Ravi Prakash 1acc509b45 HADOOP-12696. Add tests for S3FileSystem Contract. Contributed by Matt Paduano 2016-01-19 13:57:08 -08:00
Wangda Tan 89d1fd5dac HADOOP-12356. Fix computing CPU usage statistics on Windows. (Inigo Goiri via wangda) 2016-01-19 21:27:38 +08:00
Jian He edc43a9097 YARN-4565. Fix a bug that leads to AM resource limit not hornored when sizeBasedWeight enabled for FairOrderingPolicy. Contributed by Wangda Tan 2016-01-18 21:04:36 -08:00
Akira Ajisaka 92c5f565fd HDFS-9623. Update example configuration of block state change log in log4j.properties. Contributed by Masatake Iwasaki. 2016-01-19 13:31:26 +09:00
Wangda Tan a44ce3f14f YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda) 2016-01-19 09:30:04 +08:00
Wangda Tan 150f5ae034 Revert "YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda)"
This reverts commit 3fe5728563.

Conflicts:
	hadoop-yarn-project/CHANGES.txt
2016-01-19 09:27:36 +08:00
Jian He f385851141 YARN-4596. SystemMetricPublisher should not swallow error messages from TimelineClient#putEntities. Contributed by Li Lu 2016-01-18 16:58:39 -08:00
cnauroth 8bc93db2e7 HADOOP-12635. Adding Append API support for WASB. Contributed by Dushyanth. 2016-01-18 09:08:58 -08:00
Karthik Kambatla d40859fab1 YARN-4526. Make SystemClock singleton so AppSchedulingInfo could use it. (kasha) 2016-01-18 10:58:14 +01:00
Wangda Tan 3fe5728563 YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda)
(cherry picked from commit 805a9ed85e)
2016-01-18 17:06:05 +08:00
Wangda Tan 01603be97b Move YARN-4524 from 2.9 to 2.8
(cherry picked from commit c56d46307a)
2016-01-18 17:05:18 +08:00
Wangda Tan adf260a728 Revert "YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda)"
This reverts commit 805a9ed85e.
2016-01-18 16:50:45 +08:00
Wangda Tan b08ecf5c75 YARN-4304. AM max resource configuration per partition to be displayed/updated correctly in UI and in various partition related metrics. (Sunil G via wangda) 2016-01-18 11:11:32 +08:00
Wangda Tan 805a9ed85e YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda) 2016-01-18 11:04:25 +08:00
Wangda Tan 9523648d57 YARN-4538. QueueMetrics pending cores and memory metrics wrong. (Bibin A Chundatt via wangda) 2016-01-18 10:57:14 +08:00
Junping Du 02f597c5db YARN-4265. Provide new timeline plugin storage to support fine-grained entity caching. Contributed by Li Lu and Jason Lowe 2016-01-17 17:37:40 -08:00
cnauroth da77f423d1 HADOOP-12691. Move files to correct location. 2016-01-16 07:47:43 -08:00
Tsz-Wo Nicholas Sze 995f06f268 In CHANGES.txt, move HDFS-9294 to Release 2.6.4. 2016-01-16 23:44:14 +08:00
Colin Patrick Mccabe 2a30386539 HADOOP-12662. The build should fail if a -Dbundle option fails (Kai Zheng via cmccabe) 2016-01-15 14:05:21 -08:00
Colin Patrick Mccabe 5af5f9575a HADOOP-12714. Fix hadoop-mapreduce-client-nativetask unit test which fails because it is not able to open the "glibc bug spill" file. (cmccabe) 2016-01-15 13:53:05 -08:00
Colin Patrick Mccabe b2c155f810 HADOOP-12712. Fix some cmake plugin and native build warnings (cmccabe) 2016-01-15 12:29:18 -08:00
Andrew Wang 5d5a22a878 HADOOP-12713. Disable spurious checkstyle checks. 2016-01-15 11:58:56 -08:00
Andrew Wang c07f7fa8ff HDFS-9624. DataNode start slowly due to the initial DU command operations. (Lin Yiqun via wang) 2016-01-15 11:28:46 -08:00
Yongjun Zhang a9c69ebeb7 HDFS-9612. DistCp worker threads are not terminated after jobs are done. (Wei-Chiu Chuang via Yongjun Zhang) 2016-01-15 10:03:09 -08:00
Jason Lowe 9fbd579ab5 MAPREDUCE-6554. MRAppMaster servicestart failing with NPE in MRAppMaster#parsePreviousJobHistory. Contributed by Bibin A Chundatt 2016-01-15 16:52:53 +00:00
Junping Du fc6d3a3b23 YARN-4581. AHS writer thread leak makes RM crash while RM is recovering. Contributed by sandflee. 2016-01-15 08:40:56 -08:00
rohithsharmaks f7736f464f YARN-4389. Allow application to enable or disable am blacklisting. (Sunil G via rohithsharmaks) 2016-01-15 21:38:26 +05:30
Akira Ajisaka 1da762c745 Move HADOOP-12590 from 2.9.0 to 2.8.0 in CHANGES.txt. 2016-01-15 10:48:18 +09:00
Jason Lowe cdf8895259 HADOOP-12706. TestLocalFsFCStatistics#testStatisticsThreadLocalDataCleanUp times out occasionally. Contributed by Sangjin Lee and Colin Patrick McCabe 2016-01-14 23:45:03 +00:00