Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,861 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

10861 Commits

Author SHA1 Message Date
Tsz-Wo Nicholas Sze 0ad3c51dfb HDFS-8999. Allow a file to be closed with COMMITTED but not yet COMPLETE blocks. 
(cherry picked from commit b10d8ced21)
 2016-02-03 07:41:06 +05:30
Andrew Wang 1d15c90233 HADOOP-12755. Fix typo in defaultFS warning message. 
(cherry picked from commit 8171874dd1)
(cherry picked from commit b4ad58796b)
 2016-02-02 11:57:00 -08:00
Jason Lowe 1d322ca5cc MAPREDUCE-6621. Memory Leak in JobClient#submitJobInternal(). Contributed by Xuan Gong 
(cherry picked from commit 43e669b22d)
 2016-02-02 19:32:04 +00:00
Colin Patrick Mccabe c4c94e1cf2 HDFS-9669. TcpPeerServer should respect ipc.server.listen.queue.size (Elliot Clark via cmccabe) 
(cherry picked from commit 2da03b48eb)
(cherry picked from commit 60d3a3c30b)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
 2016-02-02 11:05:41 -08:00
Lei Xu dfbd0d4df4 HDFS-9721. Allow Delimited PB OIV tool to run upon fsimage that contains INodeReference. (Xiao Chen via lei) 
(cherry picked from commit 9d494f0c0e)
 2016-02-02 10:43:06 -08:00
Vinayakumar B 94950c15c2 HDFS-9718. HAUtil#getConfForOtherNodes should unset independent generic keys before initialize (Contributed by DENG FEI) 
(cherry picked from commit 4d7055e0c8)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/HAUtil.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestHAConfiguration.java

(cherry picked from commit 80dd039b6e)
 2016-02-02 12:57:42 +05:30
Devaraj K aeea77ce14 YARN-4100. Add Documentation for Distributed and Delegated-Centralized 
Node Labels feature. Contributed by Naganarasimha G R.

(cherry picked from commit db144eb1c5)
 2016-02-02 12:08:56 +05:30
Wangda Tan c487453b91 YARN-4340. Add list API to reservation system. (Sean Po via wangda) 
(cherry picked from commit 9875325d5c)
 2016-02-02 10:23:25 +08:00
Jason Lowe 9862879e27 YARN-3102. Decommisioned Nodes not listed in Web UI. Contributed by Kuhu Shukla 
(cherry picked from commit ed55950164)
 2016-02-01 23:17:02 +00:00
Yongjun Zhang d7b01ebcbe HDFS-9406. FSImage may get corrupted after deleting snapshot. (Contributed by Jing Zhao, Stanislav Antic, Vinayakumar B, Yongjun Zhang) 
(cherry picked from commit 34ab50ea92)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestINodeFile.java

(cherry picked from commit fc8d9cc758)
 2016-02-01 14:22:35 -08:00
Lei Xu b8360139af HDFS-9701. DN may deadlock when hot-swapping under load. (Xiao Chen via lei) 
(cherry picked from commit 12a4ebb4471f78b642e12c2ec0784c20f62cca3c)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/TestFsDatasetImpl.java
 2016-02-01 12:49:09 -08:00
Xiaoyu Yao 924e1583ed HDFS-9210. Fix some misuse of %n in VolumeScanner#printStats. Contributed by Xiaoyu Yao. 
(cherry picked from commit b11008d54d)
 2016-02-01 11:57:51 -08:00
Jason Lowe 7bb48ed162 MAPREDUCE-6618. YarnClientProtocolProvider leaking the YarnClient thread. Contributed by Xuan Gong 
(cherry picked from commit 59a212b6e1)
 2016-02-01 16:11:20 +00:00
Steve Loughran dcf2c8b3c8 HDFS-9708. FSNamesystem.initAuditLoggers() doesn't trim classnames (Mingliang Liu via stevel) 2016-02-01 16:01:22 +00:00
Vinayakumar B 6eae76f7a5 HDFS-9566. Remove expensive 'BlocksMap#getStorages(Block b, final DatanodeStorage.State state)' method (Contributed by Daryn Sharp) 
(cherry picked from commit e418bd1fb0)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java

(cherry picked from commit 71374cca9d)
 2016-02-01 13:32:59 +05:30
Jason Lowe a9916057e3 YARN-4428. Redirect RM page to AHS page when AHS turned on and RM page is not available. Contributed by Chang Li 
(cherry picked from commit 772ea7b41b)
 2016-01-29 21:55:38 +00:00
Jian He e45799a61b YARN-4617. LeafQueue#pendingOrderingPolicy should always use fixed ordering policy instead of using same as active applications ordering policy. Contributed by Rohith Sharma K S 
(cherry picked from commit f4a57d4a53)
 2016-01-29 12:23:02 -08:00
Yongjun Zhang f028e3d7bc HDFS-9638. Improve DistCp Help and documentation. (Wei-Chiu Chuang via Yongjun Zhang) 
(cherry picked from commit eddd823cd6)
 2016-01-29 12:13:18 -08:00
Devaraj K eb2366eda1 YARN-4411. RMAppAttemptImpl#createApplicationAttemptReport throws 
IllegalArgumentException. Contributed by Bibin A Chundatt and yarntime.

(cherry picked from commit a277bdc9ed)
 2016-01-29 13:53:29 +05:30
Akira Ajisaka ce5947916d MAPREDUCE-6616. Fail to create jobhistory file if there are some multibyte characters in the job name. Contributed by Kousuke Saruta. 
(cherry picked from commit d314a3f99d5d03c62a3b8fb8883886440ab7d1db)
(cherry picked from commit 79cde21064a1fe274a4dcbf3dec4ed0d743876cf)
 2016-01-29 16:20:45 +09:00
Yongjun Zhang 6a06a492ec HDFS-9706. Log more details in debug logs in BlockReceiver's constructor. (Xiao Chen via Yongjun Zhang) 
(cherry picked from commit 8ee060311c)
 2016-01-28 23:14:56 -08:00
Rohith Sharma K S d28b5b0c5c YARN-4219. addendum patch to fix javadoc errors 
(cherry picked from commit 09d831c95b)
 2016-01-29 11:53:51 +05:30
cnauroth ced22ca78f MAPREDUCE-6563. Streaming documentation contains a stray % character. Contributed by Chris Nauroth. 
(cherry picked from commit 41da9a0773)

Conflicts:
	hadoop-mapreduce-project/CHANGES.txt

(cherry picked from commit bd01fdb64d)
 2016-01-28 14:47:03 -08:00
Xuan 353518f54c YARN-4219. New levelDB cache storage for timeline v1.5. Contributed by 
Li Lu

(cherry picked from commit 9fab22b366)
(cherry picked from commit 2f00d8d3a7)
 2016-01-28 14:37:27 -08:00
Jason Lowe 290b7db656 YARN-4643. Container recovery is broken with delegating container runtime. Contributed by Sidharta Seethana 
(cherry picked from commit 61382ff8fa)
 2016-01-28 19:01:28 +00:00
Junping Du 7e3b092cf2 MAPREDUCE-6595. Fix findbugs warnings in OutputCommitter and FileOutputCommitter. Contributed by Akira AJISAKA. 
(cherry picked from commit 86560a4978)
(cherry picked from commit db7ff115c0)
 2016-01-28 06:20:13 -08:00
Tsz-Wo Nicholas Sze f09b0fe5c4 HDFS-9654. Code refactoring for HDFS-8578. 2016-01-28 11:01:47 +08:00
Jian He d83b124c97 MAPREDUCE-6619. HADOOP_CLASSPATH is overwritten in MR container. Contributed by Junping Du 
(cherry picked from commit da18bbedaf)
 2016-01-27 13:18:19 -08:00
Colin Patrick Mccabe bc00b8ce9e HADOOP-12735. core-default.xml misspells hadoop.workaround.non.threadsafe.getpwuid (Ray Chiang via cmccabe) 
(cherry picked from commit 2e8ab3d465)
(cherry picked from commit b94fbdf6f0)
 2016-01-27 11:40:59 -08:00
Yongjun Zhang 62206dd2ed HADOOP-12718. Incorrect error message by fs -put local dir without permission. (John Zhuge via Yongjun Zhang) 
(cherry picked from commit 97056c3355)
 2016-01-27 08:05:33 -08:00
Jian He b6fe3c20c5 MAPREDUCE-6610. JobHistoryEventHandler should not swallow timeline response. Contributed by Li Lu 2016-01-25 23:01:52 -08:00
Tsz-Wo Nicholas Sze 0271fb1f18 HDFS-9690. ClientProtocol.addBlock is not idempotent after HDFS-8071. 2016-01-26 14:58:44 +08:00
Jitendra Pandey f1f61eac15 HDFS-9672. o.a.h.hdfs.TestLeaseRecovery2 fails intermittently. Contributed by Mingliang Liu. 2016-01-25 17:06:23 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) 3efc72ccd5 Release process for 2.7.2: Set the release date for 2.7.2 
(cherry picked from commit ec4d2d9f40)
 2016-01-25 15:47:39 -08:00
Jian He 389a7fb33f YARN-4520. Finished app info is unnecessarily persisted in NM state-store if container is acquired but not lunched on this node. Contributed by sandflee 2016-01-25 15:36:59 -08:00
Jason Lowe 435b6ae82b YARN-4452. NPE when submit Unmanaged application. Contributed by Naganarasimha G R. 
(cherry picked from commit 50bd067e1d)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2016-01-25 16:11:59 +00:00
Jason Lowe a025b7b7ea Revert "YARN-4452. NPE when submit Unmanaged application. Contributed by Naganarasimha G R." 
This reverts commit 92de57bdca.

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2016-01-25 16:03:27 +00:00
Walter Su 26673b312d HADOOP-12715. TestValueQueue#testgetAtMostPolicyALL fails intermittently. Contributed by Xiao Chen. 
(cherry picked from commit 6eacdea0e4)
 2016-01-25 19:43:21 +08:00
Akira Ajisaka a7e84dad41 YARN-4592. Remove unused GetContainerStatus proto. Contributed by Chang Li. 
(cherry picked from commit 56a0c17508)
(cherry picked from commit 02d4a1fce3)
 2016-01-25 15:20:57 +09:00
Akira Ajisaka c25ab5814c HADOOP-12736. TestTimedOutTestsListener#testThreadDumpAndDeadlocks sometimes times out. Contributed by Xiao Chen. 
(cherry picked from commit 643227927a)
(cherry picked from commit 38ec290455)
 2016-01-25 14:00:03 +09:00
Akira Ajisaka d228bf1de3 HADOOP-12731. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta. 
(cherry picked from commit 736eb17a79)
(cherry picked from commit 4edd7bd820)
 2016-01-25 13:48:46 +09:00
Akira Ajisaka 8ffa844d48 MAPREDUCE-6614. Remove unnecessary code in TestMapreduceConfigFields. Contributed by Kai Sasaki. 
(cherry picked from commit a9386cae6e)
 2016-01-25 11:40:08 +09:00
Eric Yang 6ba6f993f8 HDFS-9653. Added blocks pending deletion report to dfsadmin. 
(Weiwei Yang via eyang)
 2016-01-24 14:27:17 -08:00
rohithsharmaks 80928af293 YARN-4614. Fix random failure in TestApplicationPriority#testApplicationPriorityAllocationWithChangeInPriority. (Sunil G via rohithsharmaks) 
(cherry picked from commit 99829eb221)
 2016-01-23 07:59:08 +05:30
Jason Lowe c1953e5e91 YARN-4598. Invalid event: RESOURCE_FAILED at CONTAINER_CLEANEDUP_AFTER_KILL. Contributed by tangshangwen 
(cherry picked from commit 46e5ea81e0)
 2016-01-22 21:56:37 +00:00
Jason Lowe e2762f035f YARN-4371. "yarn application -kill" should take multiple application ids. Contributed by Sunil G 
(cherry picked from commit e91e8b711c)
 2016-01-22 21:37:41 +00:00
Kihwal Lee 330876689b HDFS-8898. Create API and command-line argument to get quota and quota usage without detailed content summary. Contributed by Ming Ma. 
(cherry picked from commit b5db1d4410)
 2016-01-22 09:20:39 -06:00
Akira Ajisaka 2097016ab1 HADOOP-12730. Hadoop streaming -mapper and -reducer options are wrongly documented as required. Contributed by Kengo Seki. 
(cherry picked from commit 0bae506c22)
(cherry picked from commit 6368d102b9)
 2016-01-22 21:09:23 +09:00
Akira Ajisaka 4b121be77e HDFS-9682. Fix a typo "aplication" in HttpFS document. Contributed by Weiwei yang. 
(cherry picked from commit 6831634682)
(cherry picked from commit 4fe28a644e)
 2016-01-22 20:12:55 +09:00
Akira Ajisaka ecba5f2ed3 YARN-4605. Spelling mistake in the help message of "yarn applicationattempt" command. Contributed by Weiwei Yang. 
(cherry picked from commit 8f58f742ae)
(cherry picked from commit ddc22bbcb1)
 2016-01-22 19:47:57 +09:00