Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,910 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

10910 Commits

Author SHA1 Message Date
Eric Payne 878e1cfc77 YARN-4686. MiniYARNCluster.start() returns before cluster is completely started. Contributed by Eric Badger. 
(cherry picked from commit 92b7e0d413)
 2016-03-18 17:19:06 +00:00
Akira Ajisaka 2fe4225051 HDFS-3677. dfs.namenode.edits.dir.required is missing from hdfs-default.xml. Contributed by Mark Yang. 
(cherry picked from commit 414f33126ac178a44146666cc7c00059cfc9cabf)
(cherry picked from commit 41621a994d)
 2016-03-19 01:11:06 +09:00
Kihwal Lee 242c7f1fee HDFS-9874. Long living DataXceiver threads cause volume shutdown to block. Contributed by Rushabh Shah. 
(cherry picked from commit 63c966a3fb)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
 2016-03-18 10:33:13 -05:00
Colin Patrick Mccabe 73b5a44b0e HDFS-9949. Add a test case to ensure that the DataNode does not regenerate its UUID when a storage directory is cleared (Harsh J via cmccabe) 
(cherry picked from commit dc951e606f)
(cherry picked from commit f69a6c3632)
 2016-03-17 10:43:07 -07:00
Junping Du 52ce763a54 YARN-4785. inconsistent value type of the type field for LeafQueueInfo in response of RM REST API. 
(cherry picked from commit ca8106d2dd)
(cherry picked from commit 66257613b4)
 2016-03-17 09:30:43 -07:00
Akira Ajisaka 73ab502271 MAPREDUCE-6645. TestWordStats outputs logs under directories other than target/test-dir. Contributed by Gabor Liptak. 
(cherry picked from commit 80fa70c4e1)
(cherry picked from commit 365d236175)
 2016-03-17 18:09:38 +09:00
Xuan d21bee170b Revert "YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. (Xuan Gong via gtcarrera9)" 
This reverts commit 3a0b695441.

(cherry picked from commit a888b5bc53)
(cherry picked from commit 398dbde538)
 2016-03-15 22:12:05 -07:00
Wangda Tan 2d9f42d685 MAPREDUCE-6579. JobStatus#getFailureInfo should not output diagnostic information when the job is running. (Akira AJISAKA via wangda) 
(cherry picked from commit 6529c87551)
 2016-03-15 17:32:32 -07:00
Li Lu 8640a9c45f YARN-4817. Change Log Level to DEBUG for putDomain call in ATS 1.5. (Xuan Gong via gtcarrera9) 
(cherry-picked from commit 5176a69868)
 2016-03-15 11:49:09 -07:00
Li Lu 0ebc947140 YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. (Xuan Gong via gtcarrera9) 
(cherry picked from commit 3a0b695441)
 2016-03-15 11:43:39 -07:00
Kihwal Lee fce39557d3 HDFS-9904. testCheckpointCancellationDuringUpload occasionally fails. Contributed by Lin Yiqun. 
(cherry picked from commit d457401784)
 2016-03-15 10:55:10 -05:00
Tsz-Wo Nicholas Sze d59c2c4518 HADOOP-12923. Move the test code in ipc.Client to test. 2016-03-14 15:55:20 -07:00
Ravi Prakash 9e804d14c9 HDFS-9953. Download File from UI broken after pagination. Contributed by Brahma Reddy Battula 
(cherry picked from commit 51b7d8935a)
 2016-03-14 14:33:29 -07:00
Chris Nauroth e6c6f4ddac HDFS-9941. Do not log StandbyException on NN, other minor logging fixes. Contributed by Arpit Agarwal. 
(cherry picked from commit 5644137ada)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockUnderConstructionFeature.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirWriteFileOp.java

(cherry picked from commit dd462bc32f)
 2016-03-14 09:55:34 -07:00
Junping Du 4f5b496b8a YARN-4545. Allow YARN distributed shell to use ATS v1.5 APIs. Li Lu via junping_du 
(cherry picked from commit f291d82cd4)
(cherry picked from commit 3d5ac829da)
 2016-03-14 08:34:08 -07:00
Colin Patrick Mccabe ffa9f2db70 HDFS-9942. Add an HTrace span when refreshing the groups for a username (cmccabe) 
(cherry picked from commit 6e9a582eb1)
(cherry picked from commit b67b5b09a7)
 2016-03-11 12:27:32 -08:00
Steve Loughran a44eec1fde Revert "HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims)" 
This reverts commit 0d3272b54e.
 2016-03-11 16:59:59 +00:00
Akira Ajisaka cb97d8fa63 MAPREDUCE-6520. Migrate MR Client test cases part 1. Contributed by Dustin Cote. 
(cherry picked from commit 247a790609)
(cherry picked from commit c2e14d1bbb)
 2016-03-11 22:55:16 +09:00
Akira Ajisaka 097a03fb6d Revert "MAPREDUCE-6520. Migrate MR Client test cases part 1." 
This reverts commit 70e232f36e.
 2016-03-11 22:55:01 +09:00
Akira Ajisaka 70e232f36e MAPREDUCE-6520. Migrate MR Client test cases part 1. 
(cherry picked from commit ef68b44195)
(cherry picked from commit 7d665f0a98)
 2016-03-11 22:26:03 +09:00
Masatake Iwasaki 0d3272b54e HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims) 
(cherry picked from commit 682adc6ba9)
 2016-03-11 15:08:23 +09:00
Colin Patrick Mccabe a1f110a145 HDFS-9933. ReverseXML should be capitalized in oiv usage message (cmccabe) 
(cherry picked from commit 79961ecea8)
(cherry picked from commit 710811652c)
 2016-03-10 13:45:24 -08:00
Colin Patrick Mccabe 56462678f9 HDFS-9934. ReverseXML oiv processor should bail out if the XML file's layoutVersion doesn't match oiv's (cmccabe) 
(cherry picked from commit bd49354c6d)
(cherry picked from commit c82d1e1187)
 2016-03-10 13:44:33 -08:00
Colin Patrick Mccabe 370a956196 HDFS-9927. Document the new OIV ReverseXML processor (Wei-Chiu Chuang via cmccabe) 
(cherry picked from commit 500875dfcc)
(cherry picked from commit b8b580e6b8)
 2016-03-10 13:39:43 -08:00
Li Lu 92e86ff0cb YARN-4696. Improving EntityGroupFSTimelineStore on exception handling, test setup, and concurrency. 
This commit amends commit d49cfb3504 with a missed test file.

(cherry picked from commit 017d2c127b)
 2016-03-10 13:06:02 -08:00
Li Lu 8e89bb9d38 YARN-4696. Improving EntityGroupFSTimelineStore on exception handling, test setup, and concurrency. (Steve Loughran via gtcarrera9) 
(cherry-picked from commit d49cfb3504)
 2016-03-10 10:58:51 -08:00
Allen Wittenauer a7164e90bf HADOOP-12798. Update changelog and release notes (2016-03-04) (aw) 
(cherry picked from commit 55f73a1cbd)
(cherry picked from commit 95d30a6ec6)
 2016-03-09 19:39:31 -08:00
Allen Wittenauer 095b485e48 HADOOP-11791. Update src/site/markdown/releases to include old versions of Hadoop (aw) 
(cherry picked from commit d759b4bd74)
(cherry picked from commit 140a33df9b)
 2016-03-09 19:39:28 -08:00
Colin Patrick Mccabe 56ab796094 HDFS-9835. OIV: add ReverseXML processor which reconstructs an fsimage from an XML file (cmccabe) 
(cherry picked from commit 700b0e4019)
(cherry picked from commit 5998b20d63)
 2016-03-09 16:38:15 -08:00
Allen Wittenauer 8b4a8ff1b2 Revert "HADOOP-12366. expose calculated paths (aw)" 
This reverts commit 81a7ad45c9.
 2016-03-09 09:59:33 -08:00
Arpit Agarwal 0f15eb6a40 HADOOP-12903. IPC Server should allow suppressing exception logging by type, not log 'server too busy' messages. (Arpit Agarwal) 2016-03-08 23:30:52 -08:00
Akira Ajisaka 65769fbf3c HADOOP-12688. Fix deadlinks in Compatibility.md. Contributed by Gabor Liptak. 
(cherry picked from commit 4cbefafcac4e7b20a23b7b416af1a2efe71e1080)
(cherry picked from commit 0d8ad99e0d)
 2016-03-09 15:33:25 +09:00
Chris Nauroth a3cd43990c HADOOP-12905. Clean up CHANGES.txt RAT exclusions from pom.xml files. Contributed by Chris Nauroth. 
(cherry picked from commit 89b16d27e2)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/pom.xml
	hadoop-mapreduce-project/pom.xml

(cherry picked from commit 38a031ce68)
 2016-03-08 21:23:07 -08:00
Allen Wittenauer b038f71c67 HADOOP-12904. Update Yetus to 0.2.0 (aw) 2016-03-08 16:45:53 -08:00
Wangda Tan 06088c4c67 YARN-4465. SchedulerUtils#validateRequest for Label check should happen only when nodelabel enabled. (Bibin A Chundatt via wangda) 
(cherry picked from commit 0233d4e0ee)
 2016-03-08 14:31:40 -08:00
Akira Ajisaka 2acd4c3bd2 HADOOP-12860. Expand section "Data Encryption on HTTP" in SecureMode documentation. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit f86850b544)
(cherry picked from commit 0586386472)
 2016-03-08 14:30:01 +09:00
Arpit Agarwal a63f1039f9 HDFS-9882. Add heartbeatsTotal in Datanode metrics. (Contributed by Hua Liu) 2016-03-07 21:10:42 -08:00
Ming Ma 47f884e06a HADOOP-12789. log classpath of ApplicationClassLoader at INFO level. (Sangjin Lee via mingma) 
(cherry picked from commit 49eedc7ff0)
 2016-03-07 20:32:32 -08:00
Akira Ajisaka d84d54e26c HDFS-9812. Streamer threads leak if failure happens when closing DFSOutputStream. Contributed by Lin Yiqun. 
(cherry picked from commit 352d299cf8)
(cherry picked from commit fe0009a2bd)
 2016-03-08 10:57:56 +09:00
Andrew Wang 352d5a7e88 HADOOP-12901. Add warning log when KMSClientProvider cannot create a connection to the KMS server. (Xiao Chen via wang) 
(cherry picked from commit 391da36d93)
(cherry picked from commit fed2339e28)
 2016-03-07 14:00:15 -08:00
Arpit Agarwal 02949b2151 HDFS-9906. Remove spammy log spew when a datanode is restarted. (Contributed by Brahma Reddy Battula) 2016-03-07 12:20:32 -08:00
Masatake Iwasaki 22f7730940 HDFS-9865. TestBlockReplacement fails intermittently in trunk (Lin Yiqun via iwasakims) 
(cherry picked from commit d718fc1ee5)
 2016-03-08 02:11:54 +09:00
Jason Lowe 0d734cea44 YARN-4760. proxy redirect to history server uses wrong URL. Contributed by Eric Badger 
(cherry picked from commit 4163e36c2b)
 2016-03-07 15:58:01 +00:00
Jason Lowe 53ec7c9243 YARN-4744. Too many signal to container failure in case of LCE. Contributed by Sidharta Seethana 
(cherry picked from commit 059caf9989)
 2016-03-07 15:48:06 +00:00
Harsh J 5f059e03f5 MAPREDUCE-6648. Add yarn.app.mapreduce.am.log.level to mapred-default.xml (harsh) 2016-03-07 13:13:43 +05:30
Zhihai Xu 1a99d5ab97 YARN-4761. NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations on fair scheduler. Contributed by Sangjin Lee 
(cherry picked from commit e1ccc9622b)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/TestAbstractYarnScheduler.java
 2016-03-06 20:03:55 -08:00
Robert Kanter 3d8ae9c577 MAPREDUCE-6622. Add capability to set JHS job cache to a task-based limit (rchiang via rkanter) 
(cherry picked from commit 0f72da7e28)

Conflicts:
	hadoop-mapreduce-project/CHANGES.txt
 2016-03-06 19:26:12 -08:00
Chris Nauroth cb063d5699 HADOOP-12717. NPE when trying to rename a directory in Windows Azure Storage FileSystem. Contributed by Robert Yokota and Gaurav Kanade. 
(cherry picked from commit c50aad0f85)
(cherry picked from commit 2e60387401)
 2016-03-04 22:58:04 -08:00
Chris Nauroth d5134dadbc HDFS-9239. DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness. Contributed by Chris Nauroth. 
(cherry picked from commit 2759689d7d)
(cherry picked from commit 592f161e13)
 2016-03-04 15:30:37 -08:00
Yongjun Zhang fb6661f3bd HDFS-9889. Update balancer/mover document about HDFS-6133 feature. Contributed by Yongjun Zhang. 
(cherry picked from commit 8e08861a14)
 2016-03-04 13:28:28 -08:00