Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,936 Commits 326 Branches 371 Tags
Commit Graph

12936 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Jonathan Eagles
60e65a3e55 HADOOP-14216. Addendum to Improve Configuration XML Parsing Performance (jeagles) 2017-03-30 14:15:37 -05:00
Jason Lowe
a52b30f7e8 MAPREDUCE-6836. exception thrown when accessing the job configuration web UI. Contributed by Haibo Chen 
(cherry picked from commit c9b7ce92737f0a829408936ed9a361220d3e9680)
 2017-03-30 12:56:04 -05:00
Jason Lowe
526499533e MAPREDUCE-6850. Shuffle Handler keep-alive connections are closed from the server side. Contributed by Jonathan Eagles 
(cherry picked from commit c8bd5fc7a86f9890ceaa37a89491ab650e7e9a64)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-shuffle/src/main/java/org/apache/hadoop/mapred/ShuffleHandler.java
 2017-03-30 11:10:20 -05:00
Akira Ajisaka
bb187e145a
HADOOP-14256. [S3A DOC] Correct the format for "Seoul" example. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 0d053eeb3002f348d34cf3aac5b43333af8ff10a)
 2017-03-30 18:13:01 +09:00
Zhe Zhang
3f5dc51ec9 MAPREDUCE-6873. MR Job Submission Fails if MR framework application path not on defaultFS. Contributed by Erik Krogen. 
(cherry picked from commit de7efd2687ccb74608249abf4c83c84a9345ec0a)
 2017-03-29 22:11:22 -07:00
Ming Ma
2ae9ae1864 MAPREDUCE-6862. Fragments are not handled correctly by resource limit checking. (Chris Trezzo via mingma) 
(cherry picked from commit ceab00ac62f8057a07b4b936799e6f04271e6e41)
 2017-03-29 17:42:40 -07:00
Varun Saxena
3fe7d36e72 YARN-6352. Header injections are possible in application proxy servlet (Naganarasimha G R via Varun Saxena) 2017-03-30 03:49:32 +05:30
Daniel Templeton
c2636468d7 YARN-5685. RM configuration allows all failover methods to disabled when automatic failover is enabled 
(cherry picked from commit 640ba1d23fe8b8105bae6d342ddc1c839302f8e5)
 2017-03-29 12:38:50 -07:00
Mingliang Liu
3d5e9e61d5 HADOOP-14247. FileContextMainOperationsBaseTest should clean up test root path. Contributed by Mingliang Liu 
(cherry picked from commit 13c766b62c48ae07849f7f1762ef6883239aef54)
 2017-03-29 11:19:28 -07:00
Daniel Templeton
e00ad6fca5 HDFS-11571. Typo in DataStorage exception message (Contributed by Anna Budai via Daniel Templeton) 
(cherry picked from commit 15e3873dc3d46016344887570e5d4aa8d20ca264)
 2017-03-29 10:57:52 -07:00
Jonathan Eagles
719ae5f2e8 HADOOP-14216. Improve Configuration XML Parsing Performance (jeagles) 2017-03-29 10:14:49 -05:00
Andrew Wang
82b4a9c3d0 HDFS-9705. Refine the behaviour of getFileChecksum when length = 0. Contributed by SammiChen and Kai Zheng. 2017-03-28 21:40:53 -07:00
Akira Ajisaka
554bc8342b
YARN-6329. Remove unnecessary TODO comment from AppLogAggregatorImpl.java. Contributed by victor bertschinger. 
(cherry picked from commit 82fb9ce8df7a534a4cbcec624d7b6c0b33e79123)
 2017-03-29 10:37:52 +09:00
Robert Kanter
a65011a128 YARN-6050. AMs can't be scheduled on racks or nodes (rkanter) 2017-03-28 14:33:08 -07:00
Varun Saxena
97c83f2498 YARN-5368. Memory leak in timeline server (Jonathan Eagles via Varun Saxena) 
(cherry picked from commit 01aca54a22c8586d232a8f79fe9977aeb8d09b83)
 2017-03-29 01:56:59 +05:30
Jason Lowe
bea8f8190f YARN-6359. TestRM#testApplicationKillAtAcceptedState fails rarely due to race condition. Contributed by Robert Kanter 2017-03-28 09:45:18 -05:00
John Zhuge
ef43a62482 HADOOP-14038. Rename ADLS credential properties. Contributed by John Zhuge. 
(cherry picked from commit 253e3e78abb9ebe0e8103d25538ff07875b33c84)
 2017-03-27 23:07:08 -07:00
Akira Ajisaka
643298b282
HADOOP-14218. Replace assertThat with assertTrue in MetricsAsserts. 
(cherry picked from commit 448ec81fd7133f413853570f116d5f6e16f68bd9)
 2017-03-28 14:33:36 +09:00
Masatake Iwasaki
b7b9d74521 HDFS-11486. Client close() should not fail fast if the last block is being decommissioned. Contributed by Wei-Chiu Chuang and Yiqun Lin. 
(cherry picked from commit 64ea62c1ccc05d9b0a0030beafa60ddd31c38952)
 2017-03-28 09:19:42 +09:00
Andrew Wang
10deafee82 HDFS-11170. Add builder-based create API to FileSystem. Contributed by SammiChen and Wei Zhou. 2017-03-27 14:35:03 -07:00
Wangda Tan
c97da481d7 YARN-6339. Improve performance for createAndGetApplicationReport. (Yunjiong Zhao via wangda) 
(cherry picked from commit cd014d57aa8b896da02b5bcadafbd404bca2bc12)
 2017-03-27 13:59:36 -07:00
Jonathan Eagles
e41aac0cd4 Configuration#get return value optimization (jeagles) 2017-03-27 12:52:59 -05:00
Jonathan Eagles
675bc97f18 Delay construction of PreCondition.check failure message in Configuration#set (jeagles) 
(cherry picked from commit 858d597be00ce006c1d1d4cd476729e4f1de8d25)
 2017-03-27 11:02:41 -05:00
Junping Du
0e8beb214d MAPREDUCE-6868. License check for jdiff output files should be ignored. Contributed by Akira Ajisaka. 
(cherry picked from commit 945b006fe85473c1bb87830dbbfc1df9051c7bb9)
 2017-03-26 23:19:05 -07:00
Joe Mészáros
34a11b9108
MAPREDUCE-6866. Fix getNumMapTasks() documentation in JobConf. 
This closes #205

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit e0a2eb71e3eb3efa865068089b649624132d33a1)
 2017-03-27 13:52:26 +09:00
Akira Ajisaka
e4320305d3 YARN-6379. Remove unused argument in ClientRMService. Contributed by Kai Sasaki. 
(cherry picked from commit b63ae854f9f5a900ca860dcb26c30785af32bde0)
 2017-03-27 11:26:23 +09:00
Sunil G
f51ee482a7 YARN-5956. Refactor ClientRMService for unify error handling across apis. Contributed by Kai Sasaki. 2017-03-26 17:00:06 +05:30
Junping Du
43f23e5021 Set jdiff.stable.api to 2.8.0 
(cherry picked from commit e7b7c96a30b0fee3af22a7719eaaa6481e76a963)
 2017-03-25 14:33:38 -07:00
Junping Du
3ad4d37363 Add COMMON/MAPREDUCE/YARN jdiff of 2.8.0 release. 
(cherry picked from commit 6df029db36412b7219b64313dcbe1874dc1c8b0c)
 2017-03-25 14:33:20 -07:00
Junping Du
2fefa1fa2e Add HDFS jdiff for 2.8.0 release. 
(cherry picked from commit d174c06b01e1f743d3111b9b760a9824d8106b86)
 2017-03-25 14:33:06 -07:00
Junping Du
e796105a6f Add 2.8.0 RELEASENOTEs.md and CHANGES.md. 
(cherry picked from commit d8e6d6df4c23aa11455c1775391b1c7883bec2ea)
 2017-03-25 14:32:47 -07:00
Hanisha Koneru
a79ad2d122 HDFS-11570. Unit test for NameNodeStatusMXBean. Contributed by Hanisha Koneru. 2017-03-24 14:44:33 -07:00
Xiaobing Zhou
757d9ebcc5 HDFS-11534. Add counters for number of blocks in pending IBR. Contributed by Xiaobing Zhou. 2017-03-24 14:40:00 -07:00
Daniel Templeton
6209e4c913 YARN-6334. TestRMFailover#testAutomaticFailover always passes even when it should fail 
(Contributed by Yufei Gu via Daniel Templeton)
 2017-03-24 14:02:39 -07:00
John Zhuge
100b8ce05b HADOOP-14230. TestAdlFileSystemContractLive fails to clean up. Contributed by John Zhuge. 
(cherry picked from commit d1b7439b48caa18d64a94be1ad5e4927ce573ab8)
 2017-03-24 13:41:09 -07:00
Daniel Templeton
bbd08bb7a4 YARN-6360. Prevent FS state dump logger from cramming other log files 
(Contributed by Yufei Gu via Daniel Templeton)

(cherry picked from commit d49d1862a645b8c5d3eae95bf633bc82816f0168)
 2017-03-24 11:31:58 -07:00
Andrew Wang
96fe940e59 HADOOP-14211. FilterFs and ChRootedFs are too aggressive about enforcing 'authorityNeeded'. Contributed by Erik Krogen. 
(cherry picked from commit 0e556a5ba645570d381beca60114a1239b27d49f)
 2017-03-24 11:12:31 -07:00
Wei-Chiu Chuang
14414705f7 HDFS-10506. OIV's ReverseXML processor cannot reconstruct some snapshot details. Contributed by Akira Ajisaka. 2017-03-24 08:43:14 -07:00
John Zhuge
d946dfcbe1 HADOOP-14195. CredentialProviderFactory$getProviders is not thread-safe. Contributed by Vihang Karajgaonkar. 
(cherry picked from commit 128015584d69492806fd1700c8f840d78aa9c729)
 2017-03-23 13:57:41 -07:00
Mingliang Liu
1e64c582f5 HADOOP-14214. DomainSocketWatcher::add()/delete() should not self interrupt while looping await(). Contributed by Mingliang Liu 
(cherry picked from commit d35e79abc2fee7153a6168e6088f100de59d8c81)
 2017-03-23 13:34:53 -07:00
Chris Douglas
62b8665726 HADOOP-14197. Fix ADLS doc for credential provider. Contributed by John Zhuge 
(cherry picked from commit c55195588f5853b16d34cb6389cc6f84acc3edea)
 2017-03-23 12:17:42 -07:00
Chris Douglas
05148e33ce HADOOP-14196. Azure Data Lake doc is missing required config entry. Contributed by Atul Sikaria 
(cherry picked from commit 7d4884a57bcaf2ab1ad120c436f9c7e6739dbc2a)
 2017-03-23 12:13:33 -07:00
Mingliang Liu
b24b416db5 HADOOP-14135. Remove URI parameter in AWSCredentialProvider constructors. Contributed by Mingliang Liu 
(cherry picked from commit 2e30aa72e01de7b5774fcb312406a393221e0908)
 2017-03-23 11:37:14 -07:00
Ravi Prakash
87339d7691 HADOOP-14213. Move Configuration runtime check for hadoop-site.xml to initialization. Contributed by Jonathan Eagles 
(cherry picked from commit 595f62e362c08704d6fb692e21c97b512bc7ec49)
 2017-03-23 09:30:22 -07:00
Steve Loughran
20878d052c
HADOOP-14120 needless S3AFileSystem.setOptionalPutRequestParameters in S3ABlockOutputStream putObject(). 
Contributed by Yuanbo Liu
 2017-03-23 12:52:22 +00:00
Zhe Zhang
f98f4bb6ca HADOOP-9631. ViewFs should use underlying FileSystem's server side defaults. Contributed by Lohit Vijayarenu and Erik Krogen. 
(cherry picked from commit 59d69257a888347f0fb9c51bb000afc986b64f98)
 2017-03-22 22:32:07 -07:00
John Zhuge
74fbdd557a HDFS-11561. HttpFS doc errors. Contributed by Yuanbo Liu. 
(cherry picked from commit ed2d03f2a5318a88d0eced8476127f303eb1d1d9)
 2017-03-22 22:16:34 -07:00
Daniel Templeton
d4bba011cc YARN-6284. hasAlreadyRun should be final in ResourceManager.StandByTransitionRunnable 
(Contributed by Laura Adams via Daniel Templeton)

(cherry picked from commit 0a05c5c5989edeba2cffe16e80350245778cefce)
 2017-03-21 14:27:27 -07:00
Junping Du
dabe96a72e YARN-6367. YARN logs CLI needs alway check containerLogsInfo/containerLogInfo before parse the JSON object from NMWebService. Contributed by Xuan Gong. 
(cherry picked from commit c01d15ab2731b6710c94ff3bfa37d496a87b0c9f)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/cli/LogsCLI.java
 2017-03-21 10:55:19 -07:00
John Zhuge
84e2c11f96 HADOOP-14205. No FileSystem for scheme: adl. Contributed by John Zhuge. 2017-03-21 08:23:30 -07:00