Jian He
61fa9256c5
YARN-4002. Make ResourceTrackerService#nodeHeartbeat more concurrent. Contributed by Rohith Sharma K S & Zhiguo Hong
...
(cherry picked from commit feb90ffcca
)
2016-05-19 13:02:24 -07:00
Allen Wittenauer
27d6538b88
HADOOP-13177. Native tests fail on OS X, because DYLD_LIBRARY_PATH is not defined to include libhadoop.dylib (Chris Nauroth via aw)
...
(cherry picked from commit c7159f0240
)
(cherry picked from commit f7ffa1a534
)
2016-05-19 09:59:02 -07:00
Junping Du
c8843cac03
YARN-5100. The YarnApplicationState is always running in ATS even application is finished. Contributed by Xuan Gong.
...
(cherry picked from commit 141873ca7d
)
(cherry picked from commit 416274b53e
)
2016-05-19 09:54:03 -07:00
Steve Loughran
7a001ae19b
HADOOP-12767. Update apache httpclient version to 4.5.2; httpcore to 4.4.4. Artem Aliev via stevel.
2016-05-19 14:47:46 +01:00
Rohith Sharma K S
726c1f14b8
YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999). Contributed by Mohammad Shahid Khan and Varun Saxena
2016-05-19 10:50:32 +05:30
Andrew Wang
64e75c34a3
HADOOP-13157. Follow-on improvements to hadoop credential commands. Contributed by Mike Yoder.
2016-05-18 14:57:17 -07:00
Naganarasimha
0fb6a05577
YARN-4925. ContainerRequest in AMRMClient, application should be able to specify nodes/racks together with nodeLabelExpression. Contributed by Bibin A Chundatt
...
(cherry picked from commit f04c81c9ce
)
2016-05-19 01:40:06 +08:00
Chris Nauroth
4ce5a58ca9
HADOOP-13138. Unable to append to a SequenceFile with Compression.NONE. Contributed by Vinayakumar B.
...
(cherry picked from commit 0a527196dcb35a699e12121165bc3738766b569e)
(cherry picked from commit 42f64b3bcc
)
2016-05-18 09:32:24 -07:00
Arpit Agarwal
01a0730996
HDFS-9926. MiniDFSCluster leaks dependency Mockito via DataNodeTestUtils. (Contributed by Josh Elser)
2016-05-18 09:25:33 -07:00
Colin Patrick Mccabe
7bbf42b82f
HADOOP-13140. FileSystem#initialize must not attempt to create StorageStatistics objects with null or empty schemes (Mingliang Liu via cmccabe)
...
(cherry picked from commit f2c1d9181f
)
(cherry picked from commit feabfe9cda
)
Conflicts:
hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FileSystem.java
2016-05-18 09:20:31 -07:00
Xiaoyu Yao
ccb1cade5b
HDFS-10383. Safely close resources in DFSTestUtil. Contributed by Mingliang Liu.
2016-05-17 18:00:18 -07:00
Yongjun Zhang
2bcf1eb36a
HDFS-10381, DataStreamer DataNode exclusion log message should be warning. (John Zhuge via Yongjun Zhang)
...
(cherry picked from commit 16c07cc68a
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/StripedDataStreamer.java
(cherry picked from commit 456fe08a6d
)
2016-05-17 16:00:49 -07:00
Jing Zhao
8755905e30
HDFS-10397. Distcp should ignore -delete option if -diff option is provided instead of exiting. Contributed by Mingliang Liu.
...
(cherry picked from commit 03788d3015
)
(cherry picked from commit dd7f5a3b88
)
2016-05-17 15:55:31 -07:00
Xiaoyu Yao
744d5edc87
HADOOP-13159. Fix potential NPE in Metrics2 source for DecayRpcScheduler. Contributed by Xiaoyu Yao.
...
(cherry picked from commit 9478484845
)
2016-05-17 15:44:28 -07:00
Kihwal Lee
01de843a31
Revert "HDFS-10417. Improve error message from checkBlockLocalPathAccess. Contributed by Tianyin Xu."
...
This reverts commit cb5a1edd1c
.
2016-05-17 15:21:41 -05:00
Kihwal Lee
cb5a1edd1c
HDFS-10417. Improve error message from checkBlockLocalPathAccess. Contributed by Tianyin Xu.
...
(cherry picked from commit 0942954e8a
)
2016-05-17 15:11:40 -05:00
Jason Lowe
c983115e4c
MAPREDUCE-6698. Increase timeout on TestUnnecessaryBlockingOnHistoryFileInfo.testTwoThreadsQueryingDifferentJobOfSameUser. Contributed by Haibo Chen
...
(cherry picked from commit 34fddd1e91
)
2016-05-17 15:04:33 +00:00
Kihwal Lee
362a778bf5
HDFS-10303. DataStreamer#ResponseProcessor calculates packet ack latency incorrectly. Contributed by Surendra Singh Lilhore.
...
(cherry picked from commit 4a5819dae2
)
2016-05-17 09:00:59 -05:00
Steve Loughran
42d9beaa1d
HADOOP-13158 S3AFileSystem#toString might throw NullPointerException due to null cannedACL. (Chris Nauroth via stevel)
2016-05-17 13:18:51 +01:00
Steve Loughran
b44ecfff12
HADOOP-13163 Reuse pre-computed filestatus in Distcp-CopyMapper (Rajesh Balamohan via stevel)
2016-05-17 13:02:22 +01:00
Akira Ajisaka
fc221ecf3d
MAPREDUCE-6693. ArrayIndexOutOfBoundsException occurs when the length of the job name is equal to mapreduce.jobhistory.jobname.limit. Contributed by Ajith S.
...
(cherry picked from commit b357930526
)
(cherry picked from commit 19db965c27
)
2016-05-17 20:23:00 +09:00
Akira Ajisaka
388b2010ae
HDFS-10242. Cannot create space quota of zero. Contributed by Takashi Ohnishi.
...
(cherry picked from commit 9fe5828f05
)
(cherry picked from commit 7f03c1c90e
)
2016-05-17 15:56:36 +09:00
Eric Payne
a552932b38
YARN-5069. TestFifoScheduler.testResourceOverCommit race condition. Contributed by Eric Badger.
...
(cherry picked from commit 1217c8f6b4
)
2016-05-16 20:44:41 +00:00
Chris Nauroth
28a2f28e42
HADOOP-13148. TestDistCpViewFs to include IOExceptions in test error reports. Contributed by Steve Loughran.
...
(cherry picked from commit b9685e85d5
)
(cherry picked from commit bb41547fb4
)
2016-05-16 11:53:33 -07:00
Jason Lowe
70faa87ccf
YARN-4325. Nodemanager log handlers fail to send finished/failed events in some cases. Contributed by Junping Du
...
(cherry picked from commit 81effb7dcd
)
2016-05-16 15:43:42 +00:00
Andrew Wang
29ed65ff9b
HDFS-10333. Intermittent org.apache.hadoop.hdfs.TestFileAppend failure in trunk. Contributed by Yiqun Lin.
...
(cherry picked from commit 45788204ae
)
(cherry picked from commit 413f3dabbd
)
2016-05-15 22:15:18 -07:00
Xuan
4eeec4e35b
YARN-5080. Cannot obtain logs using YARN CLI -am for either KILLED or
...
RUNNING AM. Contributed by Xuan Gong
(cherry picked from commit 7be53b65f9
)
(cherry picked from commit 3fe4107909
)
2016-05-14 12:22:33 -07:00
Li Lu
6b1af6ce68
HADOOP-13083. The number of javadocs warnings is limited to 100. (Gergely Novák via gtcarrera9)
...
(cherry picked from commit 3fa1380c22
)
2016-05-13 13:46:28 -07:00
Sangjin Lee
29699d8e7e
HADOOP-12971. FileSystemShell doc should explain relative path (John Zhuge via sale)
...
(cherry picked from commit 1f2794b4fa
)
2016-05-13 10:03:06 -07:00
Jason Lowe
ff8caccc87
MAPREDUCE-6558. multibyte delimiters with compressed input files generate duplicate records. Contributed by Wilfred Spiegelenburg
...
(cherry picked from commit 9227dfc25f
)
2016-05-13 14:36:13 +00:00
Steve Loughran
a84850b4ca
HADOOP-13113 Enable parallel test execution for hadoop-aws. Chris Nauroth via stevel
2016-05-13 10:46:15 +01:00
Andrew Wang
b5fd6dd4a8
HADOOP-12868. Fix hadoop-openstack undeclared and unused dependencies. Contributed by Masatake Iwasaki.
...
(cherry picked from commit fa440a39b7
)
2016-05-12 23:58:26 -07:00
Andrew Wang
5da54eb3d4
HADOOP-11180. Change log message "token.Token: Cannot find class for token kind kms-dt" to debug. Contributed by Yi Liu.
...
(cherry picked from commit 3bfd29949f
)
(cherry picked from commit d6f6b99c83
)
2016-05-12 23:49:00 -07:00
Steve Loughran
8d74a58042
HADOOP-13028 add low level counter metrics for S3A; use in read performance tests. contributed by: stevel
...
patch includes
HADOOP-12844 Recover when S3A fails on IOException in read()
HADOOP-13058 S3A FS fails during init against a read-only FS if multipart purge
HADOOP-13047 S3a Forward seek in stream length to be configurable
2016-05-12 19:23:18 +01:00
Steve Loughran
9b8f7a8fb2
MAPREDUCE-6639 Process hangs in LocatedFileStatusFetcher if FileSystem.get throws. Ryan Blue via stevel
2016-05-12 18:59:56 +01:00
Steve Loughran
9cbb942465
HADOOP-13116 Jets3tNativeS3FileSystemContractTest does not run.
2016-05-12 16:36:10 +01:00
Steve Loughran
af5e5d6d47
HADOOP-13122 Customize User-Agent header sent in HTTP requests by S3A. Chris Nauroth via stevel.
2016-05-12 13:56:48 +01:00
Karthik Kambatla
a9b0041abc
YARN-4995. FairScheduler: Display per-queue demand on the scheduler page. (xupeng via kasha)
...
(cherry picked from commit 4b4e4c6ba8
)
(cherry picked from commit f96b2b6fac
)
2016-05-11 17:40:57 -07:00
Colin Patrick Mccabe
5f04795aed
HADOOP-13065. Add a new interface for retrieving FS and FC Statistics (Mingliang Liu via cmccabe)
...
(cherry picked from commit 687233f20d
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDistributedFileSystem.java
(cherry picked from commit 15bfcde238
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DistributedFileSystem.java
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDistributedFileSystem.java
2016-05-11 14:24:51 -07:00
Varun Vasudev
4d275d0a25
HADOOP-12749. Create a threadpoolexecutor that overrides afterExecute to log uncaught exceptions/errors. Contributed by Sidharta Seethana.
...
(cherry picked from commit d37eb828ff
)
(cherry picked from commit 2451a0a8e0
)
2016-05-11 14:12:18 -07:00
Larry McCay
ee2c2afdc3
HADOOP-12942. hadoop credential commands non-obviously use password of "none" (Mike Yoder via lmccay)
2016-05-11 14:39:13 -04:00
Chris Nauroth
e9ee258d04
HADOOP-13008. Add XFS Filter for UIs to Hadoop Common. Contributed by Larry McCay.
...
(cherry picked from commit dee279b532
)
(cherry picked from commit 31279ae45e
)
2016-05-11 10:58:56 -07:00
Junping Du
6d1300880f
YARN-5029. RM needs to send update event with YarnApplicationState as Running to ATS/AHS. Contributed by Xuan Gong.
...
(cherry picked from commit 39f2bac38b
)
(cherry picked from commit 9dc3683d87
)
2016-05-11 09:40:51 -07:00
Steve Loughran
ed2230ec7d
HADOOP-13125 FS Contract tests don't report FS initialization errors well. (stevel)
2016-05-11 14:19:12 +01:00
Chris Nauroth
bbd463b3b2
HADOOP-12801. Suppress obsolete S3FileSystem tests. Contributed by Chris Nauroth.
...
(cherry picked from commit d3dbfa7feee7922ddcd0b2e97898adf4e0c37de3)
(cherry picked from commit ba48834431
)
2016-05-10 15:14:42 -07:00
Eric Payne
235caef236
YARN-4768. getAvailablePhysicalMemorySize can be inaccurate on linux. Contributed by Nathan Roberts.
...
(cherry picked from commit 6b1c1cb01c
)
2016-05-10 21:45:37 +00:00
Steve Loughran
11b170adc8
HADOOP-12982 Document missing S3A and S3 properties. (Wei-Chiu Chuang via stevel)
2016-05-10 21:40:23 +01:00
Steve Loughran
d13cd394e5
HADOOP-12751. While using kerberos Hadoop incorrectly assumes names with '@' to be non-simple. (Bolke de Bruin via stevel).
2016-05-10 21:33:26 +01:00
Colin Patrick Mccabe
154332bb54
HDFS-10377. CacheReplicationMonitor shutdown log message should use INFO level (Yiqun Lin via cmccabe)
...
(cherry picked from commit f0252ad252
)
(cherry picked from commit 43f32d3f4a
)
2016-05-10 11:21:16 -07:00
Akira Ajisaka
a84c4d7d4b
HDFS-6187. Update the document of hftp/hsftp in branch-2 to mention that they are deprecated. Contributed by Gergely Novák.
...
(cherry picked from commit 901588542b
)
2016-05-10 09:33:55 -07:00