Commit Graph

10687 Commits

Author SHA1 Message Date
Jason Lowe 290b7db656 YARN-4643. Container recovery is broken with delegating container runtime. Contributed by Sidharta Seethana
(cherry picked from commit 61382ff8fa)
2016-01-28 19:01:28 +00:00
Junping Du 7e3b092cf2 MAPREDUCE-6595. Fix findbugs warnings in OutputCommitter and FileOutputCommitter. Contributed by Akira AJISAKA.
(cherry picked from commit 86560a4978)
(cherry picked from commit db7ff115c0)
2016-01-28 06:20:13 -08:00
Tsz-Wo Nicholas Sze f09b0fe5c4 HDFS-9654. Code refactoring for HDFS-8578. 2016-01-28 11:01:47 +08:00
Jian He d83b124c97 MAPREDUCE-6619. HADOOP_CLASSPATH is overwritten in MR container. Contributed by Junping Du
(cherry picked from commit da18bbedaf)
2016-01-27 13:18:19 -08:00
Colin Patrick Mccabe bc00b8ce9e HADOOP-12735. core-default.xml misspells hadoop.workaround.non.threadsafe.getpwuid (Ray Chiang via cmccabe)
(cherry picked from commit 2e8ab3d465)
(cherry picked from commit b94fbdf6f0)
2016-01-27 11:40:59 -08:00
Yongjun Zhang 62206dd2ed HADOOP-12718. Incorrect error message by fs -put local dir without permission. (John Zhuge via Yongjun Zhang)
(cherry picked from commit 97056c3355)
2016-01-27 08:05:33 -08:00
Jian He b6fe3c20c5 MAPREDUCE-6610. JobHistoryEventHandler should not swallow timeline response. Contributed by Li Lu 2016-01-25 23:01:52 -08:00
Tsz-Wo Nicholas Sze 0271fb1f18 HDFS-9690. ClientProtocol.addBlock is not idempotent after HDFS-8071. 2016-01-26 14:58:44 +08:00
Jitendra Pandey f1f61eac15 HDFS-9672. o.a.h.hdfs.TestLeaseRecovery2 fails intermittently. Contributed by Mingliang Liu. 2016-01-25 17:06:23 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) 3efc72ccd5 Release process for 2.7.2: Set the release date for 2.7.2
(cherry picked from commit ec4d2d9f40)
2016-01-25 15:47:39 -08:00
Jian He 389a7fb33f YARN-4520. Finished app info is unnecessarily persisted in NM state-store if container is acquired but not lunched on this node. Contributed by sandflee 2016-01-25 15:36:59 -08:00
Jason Lowe 435b6ae82b YARN-4452. NPE when submit Unmanaged application. Contributed by Naganarasimha G R.
(cherry picked from commit 50bd067e1d)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
2016-01-25 16:11:59 +00:00
Jason Lowe a025b7b7ea Revert "YARN-4452. NPE when submit Unmanaged application. Contributed by Naganarasimha G R."
This reverts commit 92de57bdca.

Conflicts:

	hadoop-yarn-project/CHANGES.txt
2016-01-25 16:03:27 +00:00
Walter Su 26673b312d HADOOP-12715. TestValueQueue#testgetAtMostPolicyALL fails intermittently. Contributed by Xiao Chen.
(cherry picked from commit 6eacdea0e4)
2016-01-25 19:43:21 +08:00
Akira Ajisaka a7e84dad41 YARN-4592. Remove unused GetContainerStatus proto. Contributed by Chang Li.
(cherry picked from commit 56a0c17508)
(cherry picked from commit 02d4a1fce3)
2016-01-25 15:20:57 +09:00
Akira Ajisaka c25ab5814c HADOOP-12736. TestTimedOutTestsListener#testThreadDumpAndDeadlocks sometimes times out. Contributed by Xiao Chen.
(cherry picked from commit 643227927a)
(cherry picked from commit 38ec290455)
2016-01-25 14:00:03 +09:00
Akira Ajisaka d228bf1de3 HADOOP-12731. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta.
(cherry picked from commit 736eb17a79)
(cherry picked from commit 4edd7bd820)
2016-01-25 13:48:46 +09:00
Akira Ajisaka 8ffa844d48 MAPREDUCE-6614. Remove unnecessary code in TestMapreduceConfigFields. Contributed by Kai Sasaki.
(cherry picked from commit a9386cae6e)
2016-01-25 11:40:08 +09:00
Eric Yang 6ba6f993f8 HDFS-9653. Added blocks pending deletion report to dfsadmin.
(Weiwei Yang via eyang)
2016-01-24 14:27:17 -08:00
rohithsharmaks 80928af293 YARN-4614. Fix random failure in TestApplicationPriority#testApplicationPriorityAllocationWithChangeInPriority. (Sunil G via rohithsharmaks)
(cherry picked from commit 99829eb221)
2016-01-23 07:59:08 +05:30
Jason Lowe c1953e5e91 YARN-4598. Invalid event: RESOURCE_FAILED at CONTAINER_CLEANEDUP_AFTER_KILL. Contributed by tangshangwen
(cherry picked from commit 46e5ea81e0)
2016-01-22 21:56:37 +00:00
Jason Lowe e2762f035f YARN-4371. "yarn application -kill" should take multiple application ids. Contributed by Sunil G
(cherry picked from commit e91e8b711c)
2016-01-22 21:37:41 +00:00
Kihwal Lee 330876689b HDFS-8898. Create API and command-line argument to get quota and quota usage without detailed content summary. Contributed by Ming Ma.
(cherry picked from commit b5db1d4410)
2016-01-22 09:20:39 -06:00
Akira Ajisaka 2097016ab1 HADOOP-12730. Hadoop streaming -mapper and -reducer options are wrongly documented as required. Contributed by Kengo Seki.
(cherry picked from commit 0bae506c22)
(cherry picked from commit 6368d102b9)
2016-01-22 21:09:23 +09:00
Akira Ajisaka 4b121be77e HDFS-9682. Fix a typo "aplication" in HttpFS document. Contributed by Weiwei yang.
(cherry picked from commit 6831634682)
(cherry picked from commit 4fe28a644e)
2016-01-22 20:12:55 +09:00
Akira Ajisaka ecba5f2ed3 YARN-4605. Spelling mistake in the help message of "yarn applicationattempt" command. Contributed by Weiwei Yang.
(cherry picked from commit 8f58f742ae)
(cherry picked from commit ddc22bbcb1)
2016-01-22 19:47:57 +09:00
Akira Ajisaka b85b8d90d1 MAPREDUCE-6605. Fix typos mapreduce.map.skip.proc.count.autoincr and mapreduce.reduce.skip.proc.count.autoincr in mapred-default.xml. Contributed by Kai Sasaki.
(cherry picked from commit 7f215ffdd5)
2016-01-22 18:38:08 +09:00
Xiaoyu Yao 67f711edba HADOOP-12659. Incorrect usage of config parameters in token manager of KMS. Contributed by Mingliang Liu.
(cherry picked from commit f3427d3766)
2016-01-21 13:56:09 -08:00
Jason Lowe d856f82b73 YARN-4610. Reservations continue looking for one app causes other apps to starve. Contributed by Jason Lowe
(cherry picked from commit 468a53b22f)
2016-01-21 18:34:03 +00:00
Akira Ajisaka 68509ae839 HADOOP-7161. Remove unnecessary oro package from dependency management section. Contributed by Sean Busbey.
(cherry picked from commit 2ac39ca762)
(cherry picked from commit cd5c66b080)
2016-01-22 02:46:04 +09:00
Akira Ajisaka a2d73b185f YARN-4608. Redundant code statement in WritingYarnApplications. Contributed by Kai Sasaki.
(cherry picked from commit d3224e2d6274daf73a103c0dbe21ba69add7ca26)
(cherry picked from commit 01cd6dce63f2ac21a52f6f2539cb222e895044eb)
2016-01-22 02:15:16 +09:00
Jason Lowe 15e84fd626 YARN-4492. Add documentation for preemption supported in Capacity scheduler. Contributed by Naganarasimha G R
(cherry picked from commit f858ac2426)
2016-01-21 15:40:30 +00:00
Kihwal Lee 67ba20e364 HDFS-9634. webhdfs client side exceptions don't provide enough details. Contributed by Eric Payne.
(cherry picked from commit 7b70500484574a565dd8cd5c7d8b5bc7c6d91154)
2016-01-21 09:34:06 -06:00
Vinayakumar B a02fab85ee HADOOP-12423. Handle failure of registering shutdownhook by ShutdownHookManager in static block (Contributed by Abhishek Agarwal)
(cherry picked from commit 446987e20a)
(cherry picked from commit c13929b385)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2016-01-21 20:14:31 +05:30
Vinayakumar B 4449677049 HDFS-9625. set replication for empty file failed when set storage policy (Contributed by DENG FEI)
(cherry picked from commit b7372b7166)
(cherry picked from commit 845acfd96c)
2016-01-21 19:19:43 +05:30
Colin Patrick Mccabe de5175d216 HADOOP-12712. Fix some cmake plugin and native build warnings (cmccabe)
(cherry picked from commit b2c155f810)

 Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-maven-plugins/src/main/java/org/apache/hadoop/maven/plugin/cmakebuilder/CompileMojo.java
	hadoop-maven-plugins/src/main/java/org/apache/hadoop/maven/plugin/cmakebuilder/TestMojo.java
	hadoop-maven-plugins/src/main/java/org/apache/hadoop/maven/plugin/util/Exec.java
2016-01-21 16:04:05 +05:30
Wangda Tan ada560bc4e YARN-4557. Fix improper Queues sorting in PartitionedQueueComparator when accessible-node-labels=*. (Naganarasimha G R via wangda)
(cherry picked from commit c9fe0371a8ab40c0d3437fadd32788b320788a7a)
2016-01-21 11:19:09 +08:00
Lei Xu b4b5468152 HDFS-9655. NN should start JVM pause monitor before loading fsimage. (John Zhuge via Lei (Eddy) Xu)
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNode.java
2016-01-20 14:35:59 -08:00
Vinayakumar B 3d38c1ef3a HDFS-9661. Deadlock in DN.FsDatasetImpl between moveBlockAcrossStorage and createRbw (Contributed by ade)
(cherry picked from commit 1425578690)
2016-01-20 21:09:08 +05:30
Yongjun Zhang 15713f947c HDFS-6054. MiniQJMHACluster should not use static port to avoid binding failure in unit test. (Yongjun Zhang)
(cherry picked from commit 57d0a94305)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/qjournal/MiniQJMHACluster.java

(cherry picked from commit a5ee4c09de)
2016-01-19 23:14:56 -08:00
Ravi Prakash a359dc87d4 HADOOP-12696. Add tests for S3FileSystem Contract. Contributed by Matt Paduano
(cherry picked from commit 1acc509b45)
(cherry picked from commit 2cbb8bbd72)
2016-01-19 14:01:51 -08:00
Wangda Tan 5dc2e78c97 HADOOP-12356. Fix computing CPU usage statistics on Windows. (Inigo Goiri via wangda)
(cherry picked from commit 89d1fd5dac)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2016-01-19 21:31:35 +08:00
Jian He 914a8fff56 YARN-4565. Fix a bug that leads to AM resource limit not hornored when sizeBasedWeight enabled for FairOrderingPolicy. Contributed by Wangda Tan 2016-01-18 21:05:21 -08:00
Akira Ajisaka ca22066582 HDFS-9623. Update example configuration of block state change log in log4j.properties. Contributed by Masatake Iwasaki.
(cherry picked from commit 92c5f565fd)
(cherry picked from commit 3a8d372518)
2016-01-19 13:32:54 +09:00
Wangda Tan 2a2ea38a9b YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda)
(cherry picked from commit a44ce3f14f)
2016-01-19 09:33:52 +08:00
Wangda Tan bacb38aaf3 Revert "YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda)"
This reverts commit 3fe5728563.

Conflicts:
	hadoop-yarn-project/CHANGES.txt

(cherry picked from commit 150f5ae034)
2016-01-19 09:33:47 +08:00
Jian He cdef283cd0 YARN-4596. SystemMetricPublisher should not swallow error messages from TimelineClient#putEntities. Contributed by Li Lu 2016-01-18 16:59:24 -08:00
cnauroth ffc0d98886 HADOOP-12635. Adding Append API support for WASB. Contributed by Dushyanth.
(cherry picked from commit 8bc93db2e7)
(cherry picked from commit 62d6166211)
2016-01-18 09:13:31 -08:00
cnauroth 23d729f841 HADOOP-12691. Add CSRF Filter for REST APIs to Hadoop Common. Contributed by Larry McCay.
(cherry picked from commit 06f4ac0ccd)
(cherry picked from commit 9600736d89)
2016-01-18 09:09:56 -08:00
rohithsharmaks c70322d1cf YARN-4265 Addendum patch to fix compilation issue caused by project version number 2016-01-18 16:38:52 +05:30