Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,723 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

10723 Commits

Author SHA1 Message Date
Akira Ajisaka a7e84dad41 YARN-4592. Remove unused GetContainerStatus proto. Contributed by Chang Li. 
(cherry picked from commit 56a0c17508)
(cherry picked from commit 02d4a1fce3)
 2016-01-25 15:20:57 +09:00
Akira Ajisaka c25ab5814c HADOOP-12736. TestTimedOutTestsListener#testThreadDumpAndDeadlocks sometimes times out. Contributed by Xiao Chen. 
(cherry picked from commit 643227927a)
(cherry picked from commit 38ec290455)
 2016-01-25 14:00:03 +09:00
Akira Ajisaka d228bf1de3 HADOOP-12731. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta. 
(cherry picked from commit 736eb17a79)
(cherry picked from commit 4edd7bd820)
 2016-01-25 13:48:46 +09:00
Akira Ajisaka 8ffa844d48 MAPREDUCE-6614. Remove unnecessary code in TestMapreduceConfigFields. Contributed by Kai Sasaki. 
(cherry picked from commit a9386cae6e)
 2016-01-25 11:40:08 +09:00
Eric Yang 6ba6f993f8 HDFS-9653. Added blocks pending deletion report to dfsadmin. 
(Weiwei Yang via eyang)
 2016-01-24 14:27:17 -08:00
rohithsharmaks 80928af293 YARN-4614. Fix random failure in TestApplicationPriority#testApplicationPriorityAllocationWithChangeInPriority. (Sunil G via rohithsharmaks) 
(cherry picked from commit 99829eb221)
 2016-01-23 07:59:08 +05:30
Jason Lowe c1953e5e91 YARN-4598. Invalid event: RESOURCE_FAILED at CONTAINER_CLEANEDUP_AFTER_KILL. Contributed by tangshangwen 
(cherry picked from commit 46e5ea81e0)
 2016-01-22 21:56:37 +00:00
Jason Lowe e2762f035f YARN-4371. "yarn application -kill" should take multiple application ids. Contributed by Sunil G 
(cherry picked from commit e91e8b711c)
 2016-01-22 21:37:41 +00:00
Kihwal Lee 330876689b HDFS-8898. Create API and command-line argument to get quota and quota usage without detailed content summary. Contributed by Ming Ma. 
(cherry picked from commit b5db1d4410)
 2016-01-22 09:20:39 -06:00
Akira Ajisaka 2097016ab1 HADOOP-12730. Hadoop streaming -mapper and -reducer options are wrongly documented as required. Contributed by Kengo Seki. 
(cherry picked from commit 0bae506c22)
(cherry picked from commit 6368d102b9)
 2016-01-22 21:09:23 +09:00
Akira Ajisaka 4b121be77e HDFS-9682. Fix a typo "aplication" in HttpFS document. Contributed by Weiwei yang. 
(cherry picked from commit 6831634682)
(cherry picked from commit 4fe28a644e)
 2016-01-22 20:12:55 +09:00
Akira Ajisaka ecba5f2ed3 YARN-4605. Spelling mistake in the help message of "yarn applicationattempt" command. Contributed by Weiwei Yang. 
(cherry picked from commit 8f58f742ae)
(cherry picked from commit ddc22bbcb1)
 2016-01-22 19:47:57 +09:00
Akira Ajisaka b85b8d90d1 MAPREDUCE-6605. Fix typos mapreduce.map.skip.proc.count.autoincr and mapreduce.reduce.skip.proc.count.autoincr in mapred-default.xml. Contributed by Kai Sasaki. 
(cherry picked from commit 7f215ffdd5)
 2016-01-22 18:38:08 +09:00
Xiaoyu Yao 67f711edba HADOOP-12659. Incorrect usage of config parameters in token manager of KMS. Contributed by Mingliang Liu. 
(cherry picked from commit f3427d3766)
 2016-01-21 13:56:09 -08:00
Jason Lowe d856f82b73 YARN-4610. Reservations continue looking for one app causes other apps to starve. Contributed by Jason Lowe 
(cherry picked from commit 468a53b22f)
 2016-01-21 18:34:03 +00:00
Akira Ajisaka 68509ae839 HADOOP-7161. Remove unnecessary oro package from dependency management section. Contributed by Sean Busbey. 
(cherry picked from commit 2ac39ca762)
(cherry picked from commit cd5c66b080)
 2016-01-22 02:46:04 +09:00
Akira Ajisaka a2d73b185f YARN-4608. Redundant code statement in WritingYarnApplications. Contributed by Kai Sasaki. 
(cherry picked from commit d3224e2d6274daf73a103c0dbe21ba69add7ca26)
(cherry picked from commit 01cd6dce63f2ac21a52f6f2539cb222e895044eb)
 2016-01-22 02:15:16 +09:00
Jason Lowe 15e84fd626 YARN-4492. Add documentation for preemption supported in Capacity scheduler. Contributed by Naganarasimha G R 
(cherry picked from commit f858ac2426)
 2016-01-21 15:40:30 +00:00
Kihwal Lee 67ba20e364 HDFS-9634. webhdfs client side exceptions don't provide enough details. Contributed by Eric Payne. 
(cherry picked from commit 7b70500484574a565dd8cd5c7d8b5bc7c6d91154)
 2016-01-21 09:34:06 -06:00
Vinayakumar B a02fab85ee HADOOP-12423. Handle failure of registering shutdownhook by ShutdownHookManager in static block (Contributed by Abhishek Agarwal) 
(cherry picked from commit 446987e20a)
(cherry picked from commit c13929b385)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2016-01-21 20:14:31 +05:30
Vinayakumar B 4449677049 HDFS-9625. set replication for empty file failed when set storage policy (Contributed by DENG FEI) 
(cherry picked from commit b7372b7166)
(cherry picked from commit 845acfd96c)
 2016-01-21 19:19:43 +05:30
Colin Patrick Mccabe de5175d216 HADOOP-12712. Fix some cmake plugin and native build warnings (cmccabe) 
(cherry picked from commit b2c155f810)

 Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-maven-plugins/src/main/java/org/apache/hadoop/maven/plugin/cmakebuilder/CompileMojo.java
	hadoop-maven-plugins/src/main/java/org/apache/hadoop/maven/plugin/cmakebuilder/TestMojo.java
	hadoop-maven-plugins/src/main/java/org/apache/hadoop/maven/plugin/util/Exec.java
 2016-01-21 16:04:05 +05:30
Wangda Tan ada560bc4e YARN-4557. Fix improper Queues sorting in PartitionedQueueComparator when accessible-node-labels=*. (Naganarasimha G R via wangda) 
(cherry picked from commit c9fe0371a8ab40c0d3437fadd32788b320788a7a)
 2016-01-21 11:19:09 +08:00
Lei Xu b4b5468152 HDFS-9655. NN should start JVM pause monitor before loading fsimage. (John Zhuge via Lei (Eddy) Xu) 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNode.java
 2016-01-20 14:35:59 -08:00
Vinayakumar B 3d38c1ef3a HDFS-9661. Deadlock in DN.FsDatasetImpl between moveBlockAcrossStorage and createRbw (Contributed by ade) 
(cherry picked from commit 1425578690)
 2016-01-20 21:09:08 +05:30
Yongjun Zhang 15713f947c HDFS-6054. MiniQJMHACluster should not use static port to avoid binding failure in unit test. (Yongjun Zhang) 
(cherry picked from commit 57d0a94305)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/qjournal/MiniQJMHACluster.java

(cherry picked from commit a5ee4c09de)
 2016-01-19 23:14:56 -08:00
Ravi Prakash a359dc87d4 HADOOP-12696. Add tests for S3FileSystem Contract. Contributed by Matt Paduano 
(cherry picked from commit 1acc509b45)
(cherry picked from commit 2cbb8bbd72)
 2016-01-19 14:01:51 -08:00
Wangda Tan 5dc2e78c97 HADOOP-12356. Fix computing CPU usage statistics on Windows. (Inigo Goiri via wangda) 
(cherry picked from commit 89d1fd5dac)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2016-01-19 21:31:35 +08:00
Jian He 914a8fff56 YARN-4565. Fix a bug that leads to AM resource limit not hornored when sizeBasedWeight enabled for FairOrderingPolicy. Contributed by Wangda Tan 2016-01-18 21:05:21 -08:00
Akira Ajisaka ca22066582 HDFS-9623. Update example configuration of block state change log in log4j.properties. Contributed by Masatake Iwasaki. 
(cherry picked from commit 92c5f565fd)
(cherry picked from commit 3a8d372518)
 2016-01-19 13:32:54 +09:00
Wangda Tan 2a2ea38a9b YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda) 
(cherry picked from commit a44ce3f14f)
 2016-01-19 09:33:52 +08:00
Wangda Tan bacb38aaf3 Revert "YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda)" 
This reverts commit 3fe5728563.

Conflicts:
	hadoop-yarn-project/CHANGES.txt

(cherry picked from commit 150f5ae034)
 2016-01-19 09:33:47 +08:00
Jian He cdef283cd0 YARN-4596. SystemMetricPublisher should not swallow error messages from TimelineClient#putEntities. Contributed by Li Lu 2016-01-18 16:59:24 -08:00
cnauroth ffc0d98886 HADOOP-12635. Adding Append API support for WASB. Contributed by Dushyanth. 
(cherry picked from commit 8bc93db2e7)
(cherry picked from commit 62d6166211)
 2016-01-18 09:13:31 -08:00
cnauroth 23d729f841 HADOOP-12691. Add CSRF Filter for REST APIs to Hadoop Common. Contributed by Larry McCay. 
(cherry picked from commit 06f4ac0ccd)
(cherry picked from commit 9600736d89)
 2016-01-18 09:09:56 -08:00
rohithsharmaks c70322d1cf YARN-4265 Addendum patch to fix compilation issue caused by project version number 2016-01-18 16:38:52 +05:30
Wangda Tan 1cb0ad00bb YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda) 
(cherry picked from commit 805a9ed85e)
(cherry picked from commit 6dab78c71a)
 2016-01-18 17:08:42 +08:00
Wangda Tan 2ab34fa89f YARN-4524. Cleanup AppSchedulingInfo. (Karthik Kambatla via wangda) 2016-01-18 17:00:15 +08:00
Wangda Tan ca7ac65453 YARN-4304. AM max resource configuration per partition to be displayed/updated correctly in UI and in various partition related metrics. (Sunil G via wangda) 
(cherry picked from commit b08ecf5c75)
 2016-01-18 11:34:26 +08:00
Wangda Tan 7bb65e3308 YARN-4538. QueueMetrics pending cores and memory metrics wrong. (Bibin A Chundatt via wangda) 
(cherry picked from commit 9523648d57)
 2016-01-18 11:18:07 +08:00
Junping Du a04f29ca90 YARN-4265. Provide new timeline plugin storage to support fine-grained entity caching. Contributed by Li Lu and Jason Lowe 
(cherry picked from commit 02f597c5db)
(cherry picked from commit 4a30a44b11)
 2016-01-17 17:44:17 -08:00
Tsz-Wo Nicholas Sze e75ca52138 In CHANGES.txt, move HDFS-9294 to Release 2.6.4. 2016-01-16 23:47:20 +08:00
Ravi Prakash 5468c40fe7 HADOOP-12689. S3 filesystem operations stopped working correctly 
(cherry picked from commit 2d16f40dab)
(cherry picked from commit 6330683778)
 2016-01-15 15:19:15 -08:00
Yongjun Zhang 4c8131b1bf HDFS-9612. DistCp worker threads are not terminated after jobs are done. (Wei-Chiu Chuang via Yongjun Zhang) 
(cherry picked from commit a9c69ebeb7)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2016-01-15 10:12:15 -08:00
rohithsharmaks 9baeae9368 YARN-4389. Allow application to enable or disable am blacklisting. (Sunil G via rohithsharmaks) 
(cherry picked from commit d3c08cde68)
 2016-01-15 22:48:43 +05:30
Jason Lowe de31bff67d MAPREDUCE-6554. MRAppMaster servicestart failing with NPE in MRAppMaster#parsePreviousJobHistory. Contributed by Bibin A Chundatt 
(cherry picked from commit 9fbd579ab5)
 2016-01-15 16:54:03 +00:00
Junping Du a03532e04e YARN-4581. AHS writer thread leak makes RM crash while RM is recovering. Contributed by sandflee. 
(cherry picked from commit fc6d3a3b23)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
(cherry picked from commit e09222306f)
 2016-01-15 08:53:48 -08:00
Akira Ajisaka 8a23379283 HADOOP-12700. Remove unused import in TestCompressorDecompressor.java. Contributed by John Zhuge. 
(cherry picked from commit f977366d9522ee31080e16db90972729fcfe256f)
(cherry picked from commit f0b1b53173)
 2016-01-15 10:58:20 +09:00
Akira Ajisaka 91c1736b7a Correct the section of HADOOP-12590 in CHANGES.txt. 2016-01-15 10:53:16 +09:00
Steve Loughran 1fc36b824c HADOOP-12590. TestCompressorDecompressor failing without stack traces (John Zhuge via stevel) 
(cherry picked from commit 80734bc346)
 2016-01-15 10:41:56 +09:00