Kihwal Lee
cb5a1edd1c
HDFS-10417. Improve error message from checkBlockLocalPathAccess. Contributed by Tianyin Xu.
...
(cherry picked from commit 0942954e8a
)
2016-05-17 15:11:40 -05:00
Jason Lowe
c983115e4c
MAPREDUCE-6698. Increase timeout on TestUnnecessaryBlockingOnHistoryFileInfo.testTwoThreadsQueryingDifferentJobOfSameUser. Contributed by Haibo Chen
...
(cherry picked from commit 34fddd1e91
)
2016-05-17 15:04:33 +00:00
Kihwal Lee
362a778bf5
HDFS-10303. DataStreamer#ResponseProcessor calculates packet ack latency incorrectly. Contributed by Surendra Singh Lilhore.
...
(cherry picked from commit 4a5819dae2
)
2016-05-17 09:00:59 -05:00
Steve Loughran
42d9beaa1d
HADOOP-13158 S3AFileSystem#toString might throw NullPointerException due to null cannedACL. (Chris Nauroth via stevel)
2016-05-17 13:18:51 +01:00
Steve Loughran
b44ecfff12
HADOOP-13163 Reuse pre-computed filestatus in Distcp-CopyMapper (Rajesh Balamohan via stevel)
2016-05-17 13:02:22 +01:00
Akira Ajisaka
fc221ecf3d
MAPREDUCE-6693. ArrayIndexOutOfBoundsException occurs when the length of the job name is equal to mapreduce.jobhistory.jobname.limit. Contributed by Ajith S.
...
(cherry picked from commit b357930526
)
(cherry picked from commit 19db965c27
)
2016-05-17 20:23:00 +09:00
Akira Ajisaka
388b2010ae
HDFS-10242. Cannot create space quota of zero. Contributed by Takashi Ohnishi.
...
(cherry picked from commit 9fe5828f05
)
(cherry picked from commit 7f03c1c90e
)
2016-05-17 15:56:36 +09:00
Eric Payne
a552932b38
YARN-5069. TestFifoScheduler.testResourceOverCommit race condition. Contributed by Eric Badger.
...
(cherry picked from commit 1217c8f6b4
)
2016-05-16 20:44:41 +00:00
Chris Nauroth
28a2f28e42
HADOOP-13148. TestDistCpViewFs to include IOExceptions in test error reports. Contributed by Steve Loughran.
...
(cherry picked from commit b9685e85d5
)
(cherry picked from commit bb41547fb4
)
2016-05-16 11:53:33 -07:00
Jason Lowe
70faa87ccf
YARN-4325. Nodemanager log handlers fail to send finished/failed events in some cases. Contributed by Junping Du
...
(cherry picked from commit 81effb7dcd
)
2016-05-16 15:43:42 +00:00
Andrew Wang
29ed65ff9b
HDFS-10333. Intermittent org.apache.hadoop.hdfs.TestFileAppend failure in trunk. Contributed by Yiqun Lin.
...
(cherry picked from commit 45788204ae
)
(cherry picked from commit 413f3dabbd
)
2016-05-15 22:15:18 -07:00
Xuan
4eeec4e35b
YARN-5080. Cannot obtain logs using YARN CLI -am for either KILLED or
...
RUNNING AM. Contributed by Xuan Gong
(cherry picked from commit 7be53b65f9
)
(cherry picked from commit 3fe4107909
)
2016-05-14 12:22:33 -07:00
Li Lu
6b1af6ce68
HADOOP-13083. The number of javadocs warnings is limited to 100. (Gergely Novák via gtcarrera9)
...
(cherry picked from commit 3fa1380c22
)
2016-05-13 13:46:28 -07:00
Sangjin Lee
29699d8e7e
HADOOP-12971. FileSystemShell doc should explain relative path (John Zhuge via sale)
...
(cherry picked from commit 1f2794b4fa
)
2016-05-13 10:03:06 -07:00
Jason Lowe
ff8caccc87
MAPREDUCE-6558. multibyte delimiters with compressed input files generate duplicate records. Contributed by Wilfred Spiegelenburg
...
(cherry picked from commit 9227dfc25f
)
2016-05-13 14:36:13 +00:00
Steve Loughran
a84850b4ca
HADOOP-13113 Enable parallel test execution for hadoop-aws. Chris Nauroth via stevel
2016-05-13 10:46:15 +01:00
Andrew Wang
b5fd6dd4a8
HADOOP-12868. Fix hadoop-openstack undeclared and unused dependencies. Contributed by Masatake Iwasaki.
...
(cherry picked from commit fa440a39b7
)
2016-05-12 23:58:26 -07:00
Andrew Wang
5da54eb3d4
HADOOP-11180. Change log message "token.Token: Cannot find class for token kind kms-dt" to debug. Contributed by Yi Liu.
...
(cherry picked from commit 3bfd29949f
)
(cherry picked from commit d6f6b99c83
)
2016-05-12 23:49:00 -07:00
Steve Loughran
8d74a58042
HADOOP-13028 add low level counter metrics for S3A; use in read performance tests. contributed by: stevel
...
patch includes
HADOOP-12844 Recover when S3A fails on IOException in read()
HADOOP-13058 S3A FS fails during init against a read-only FS if multipart purge
HADOOP-13047 S3a Forward seek in stream length to be configurable
2016-05-12 19:23:18 +01:00
Steve Loughran
9b8f7a8fb2
MAPREDUCE-6639 Process hangs in LocatedFileStatusFetcher if FileSystem.get throws. Ryan Blue via stevel
2016-05-12 18:59:56 +01:00
Steve Loughran
9cbb942465
HADOOP-13116 Jets3tNativeS3FileSystemContractTest does not run.
2016-05-12 16:36:10 +01:00
Steve Loughran
af5e5d6d47
HADOOP-13122 Customize User-Agent header sent in HTTP requests by S3A. Chris Nauroth via stevel.
2016-05-12 13:56:48 +01:00
Karthik Kambatla
a9b0041abc
YARN-4995. FairScheduler: Display per-queue demand on the scheduler page. (xupeng via kasha)
...
(cherry picked from commit 4b4e4c6ba8
)
(cherry picked from commit f96b2b6fac
)
2016-05-11 17:40:57 -07:00
Colin Patrick Mccabe
5f04795aed
HADOOP-13065. Add a new interface for retrieving FS and FC Statistics (Mingliang Liu via cmccabe)
...
(cherry picked from commit 687233f20d
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDistributedFileSystem.java
(cherry picked from commit 15bfcde238
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DistributedFileSystem.java
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDistributedFileSystem.java
2016-05-11 14:24:51 -07:00
Varun Vasudev
4d275d0a25
HADOOP-12749. Create a threadpoolexecutor that overrides afterExecute to log uncaught exceptions/errors. Contributed by Sidharta Seethana.
...
(cherry picked from commit d37eb828ff
)
(cherry picked from commit 2451a0a8e0
)
2016-05-11 14:12:18 -07:00
Larry McCay
ee2c2afdc3
HADOOP-12942. hadoop credential commands non-obviously use password of "none" (Mike Yoder via lmccay)
2016-05-11 14:39:13 -04:00
Chris Nauroth
e9ee258d04
HADOOP-13008. Add XFS Filter for UIs to Hadoop Common. Contributed by Larry McCay.
...
(cherry picked from commit dee279b532
)
(cherry picked from commit 31279ae45e
)
2016-05-11 10:58:56 -07:00
Junping Du
6d1300880f
YARN-5029. RM needs to send update event with YarnApplicationState as Running to ATS/AHS. Contributed by Xuan Gong.
...
(cherry picked from commit 39f2bac38b
)
(cherry picked from commit 9dc3683d87
)
2016-05-11 09:40:51 -07:00
Steve Loughran
ed2230ec7d
HADOOP-13125 FS Contract tests don't report FS initialization errors well. (stevel)
2016-05-11 14:19:12 +01:00
Chris Nauroth
bbd463b3b2
HADOOP-12801. Suppress obsolete S3FileSystem tests. Contributed by Chris Nauroth.
...
(cherry picked from commit d3dbfa7feee7922ddcd0b2e97898adf4e0c37de3)
(cherry picked from commit ba48834431
)
2016-05-10 15:14:42 -07:00
Eric Payne
235caef236
YARN-4768. getAvailablePhysicalMemorySize can be inaccurate on linux. Contributed by Nathan Roberts.
...
(cherry picked from commit 6b1c1cb01c
)
2016-05-10 21:45:37 +00:00
Steve Loughran
11b170adc8
HADOOP-12982 Document missing S3A and S3 properties. (Wei-Chiu Chuang via stevel)
2016-05-10 21:40:23 +01:00
Steve Loughran
d13cd394e5
HADOOP-12751. While using kerberos Hadoop incorrectly assumes names with '@' to be non-simple. (Bolke de Bruin via stevel).
2016-05-10 21:33:26 +01:00
Colin Patrick Mccabe
154332bb54
HDFS-10377. CacheReplicationMonitor shutdown log message should use INFO level (Yiqun Lin via cmccabe)
...
(cherry picked from commit f0252ad252
)
(cherry picked from commit 43f32d3f4a
)
2016-05-10 11:21:16 -07:00
Akira Ajisaka
a84c4d7d4b
HDFS-6187. Update the document of hftp/hsftp in branch-2 to mention that they are deprecated. Contributed by Gergely Novák.
...
(cherry picked from commit 901588542b
)
2016-05-10 09:33:55 -07:00
Akira Ajisaka
1622fc1373
Revert "HDFS-6187. Update the document of hftp/hsftp in branch-2 to mention that they are deprecated."
...
This reverts commit f25dcb935e
.
2016-05-10 09:33:18 -07:00
Akira Ajisaka
f25dcb935e
HDFS-6187. Update the document of hftp/hsftp in branch-2 to mention that they are deprecated.
...
(cherry picked from commit c297df5995
)
2016-05-10 09:29:47 -07:00
Jason Lowe
da48923d3a
MAPREDUCE-6684. High contention on scanning of user directory under immediate_done in Job History Server. Contributed by Haibo Chen
...
(cherry picked from commit 5ffb54694b
)
Conflicts:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/HistoryFileManager.java
2016-05-10 16:16:32 +00:00
Eric Payne
730ce76160
MAPREDUCE-6678. Allow ShuffleHandler readahead without drop-behind. Contributed by Nathan Roberts.
...
(cherry picked from commit cd35b692de
)
2016-05-10 16:07:16 +00:00
Kihwal Lee
d7cda6d031
HDFS-10372. Fix for failing TestFsDatasetImpl#testCleanShutdownOfVolume. Contributed by Rushabh Shah.
...
(cherry picked from commit b9e5a32fa1
)
2016-05-09 15:52:12 -05:00
Naganarasimha
b47259caf0
YARN-4926. Change nodelabel rest API invalid reponse status to 400. Contributed by Bibin A Chundatt
...
(cherry picked from commit 2750fb900f
)
2016-05-08 23:06:15 +05:30
Yongjun Zhang
5ae5b869aa
YARN-5048. DelegationTokenRenewer#skipTokenRenewal may throw NPE (Jian He via Yongjun Zhang)
...
(cherry picked from commit 47c41e7ac7
)
2016-05-06 22:43:44 -07:00
Andrew Wang
8653bcbe67
HDFS-9939. Increase DecompressorStream skip buffer size. Contributed by John Zhuge.
...
(cherry picked from commit 8ef75a702e
)
2016-05-06 17:26:51 -07:00
Jason Lowe
da24fe95f8
YARN-4747. AHS error 500 due to NPE when container start event is missing. Contributed by Varun Saxena
...
(cherry picked from commit b2ed6ae731
)
2016-05-06 23:00:53 +00:00
Jason Lowe
7fc44311d0
MAPREDUCE-6689. MapReduce job can infinitely increase number of reducer resource requests. Contributed by Wangda Tan
...
(cherry picked from commit c9bb96fa81
)
2016-05-06 22:28:03 +00:00
Karthik Kambatla
367e757d8d
YARN-4947. Test timeout is happening for TestRMWebServicesNodes. Contributed by Bibin A Chundatt
2016-05-06 14:28:24 +05:30
Masatake Iwasaki
c80b47e73f
HDFS-2043. TestHFlush failing intermittently. Contributed by Lin Yiqun.
...
(cherry picked from commit 2835f146b5
)
2016-05-06 15:50:48 +09:00
Vinod Kumar Vavilapalli
921562720e
MAPREDUCE-6514. Fixed MapReduce ApplicationMaster to properly updated resources ask after ramping down of all reducers avoiding job hangs. Contributed by Varun Saxena and Wangda Tan.
...
(cherry picked from commit 8d48266720
)
2016-05-05 20:43:55 -07:00
Xiaoyu Yao
59eeee7501
HDFS-10324. Trash directory in an encryption zone should be pre-created with correct permissions. Contributed by Wei-Chiu Chuang.
...
(cherry picked from commit dacd1f50fe
)
(cherry picked from commit 35859872b7
)
2016-05-05 18:23:00 -07:00
Xiaoyu Yao
4d0b19eec2
HADOOP-13098. Dynamic LogLevel setting page should accept case-insensitive log level string. (Junping Du via xyao)
...
(cherry picked from commit 4e5e87ddd4
)
2016-05-05 18:01:38 -07:00