Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,936 Commits 326 Branches 371 Tags
Commit Graph

12936 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Lei Xu
d3a6124ffa HADOOP-13962. Update ADLS SDK to 2.1.4. (John Zhuge via lei) 
(cherry picked from commit ccf2d662443fc169835d66b715441529658b245c)
 2017-03-09 15:16:28 -08:00
Lei Xu
01624f0c1b HADOOP-13956. Read ADLS credentials from Credential Provider. (John Zhuge via lei) 
(cherry picked from commit e015b563197a475e354bf84fd27e7bbcc67e00a4)
 2017-03-09 15:16:28 -08:00
Mingliang Liu
881b63499e HADOOP-13900. Remove snapshot version of SDK dependency from Azure Data Lake Store File System. Contributed by Vishwajeet Dusane 
(cherry picked from commit ef34bf2bb92a4e8def6617b185ae72db81450de8)
 2017-03-09 15:16:28 -08:00
Mingliang Liu
7fd0556b2b HADOOP-13257. Improve Azure Data Lake contract tests. Contributed by Vishwajeet Dusane 
(cherry picked from commit 4113ec5fa5ca049ebaba039b1faf3911c6a34f7b)
 2017-03-09 15:16:28 -08:00
Chris Douglas
edf149b979 HADOOP-13037. Refactor Azure Data Lake Store as an independent FileSystem. Contributed by Vishwajeet Dusane 2017-03-09 15:16:28 -08:00
Arpit Agarwal
5cdcda34a2 HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru. 2017-03-09 14:34:10 -08:00
Arpit Agarwal
b6c4776911 HDFS-11461. DataNode Disk Outlier Detection. Contributed by Hanisha Koneru. 2017-03-09 12:59:48 -08:00
Masatake Iwasaki
60be2e5d8a HDFS-11499. Decommissioning stuck because of failing recovery. Contributed by Lukas Majercak and Manoj Govindassamy. 
(cherry picked from commit 385d2cb777a0272ac20c62336c944fad295d5d12)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
 2017-03-09 23:37:04 +09:00
Jason Lowe
4a1187238a YARN-6165. Intra-queue preemption occurs even when preemption is turned off for a specific queue. Contributed by Eric Payne 
(cherry picked from commit d7762a55113a529abd6f4ecb8e6d9b0a84b56e08)
 2017-03-08 16:47:31 -06:00
Jian He
ea8d53de6a Revert "HADOOP-14062. ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled. Contributed by Steven Rand" 
This reverts commit 36eda5af75a1c98b507ea497fce51aa936b2c699.
 2017-03-08 13:20:45 -08:00
John Zhuge
f1fd20be82 Revert "HADOOP-13606 swift FS to add a service load metadata file. Contributed by Steve Loughran" 
This reverts commit 53a12fa721bb431f7d481aac7d245c93efb56153.

(cherry picked from commit 98142d2f722e82d57b0e2bae6276f7c17fd99598)

Change-Id: Ia5fa901fa97391cd46d41f59cd05f7a19c7c7532
 2017-03-08 11:46:27 -08:00
Jian He
36eda5af75 HADOOP-14062. ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled. Contributed by Steven Rand 2017-03-08 10:49:07 -08:00
Robert Kanter
11d4cdc3a6 YARN-6297. TestAppLogAggregatorImp.verifyFilesUploaded() should check # of filed uploaded with that of files expected (haibochen via rkanter) 
(cherry picked from commit 287ba4ffa66212c02e1b1edc8fca53f6368a9efc)
 2017-03-08 10:45:59 -08:00
Sunil G
ec4c2d42fe YARN-6207. Move application across queues should handle delayed event processing. Contributed by Bibin A Chundatt. 
(cherry picked from commit 1eb81867032b016a59662043cbae50daa52dafa9)
 2017-03-08 12:13:14 +05:30
Mingliang Liu
d0e26075b8 HADOOP-14150. Implement getHomeDirectory() method in NativeAzureFileSystem. Contributed by Santhosh G Nayak 
(cherry picked from commit 28daaf0eb206d723d2baf0f9d91e43d98bb2fd26)
 2017-03-07 14:57:41 -08:00
Robert Kanter
7953ac4da6 MAPREDUCE-6839. TestRecovery.testCrashed failed (pairg via rkanter) 
(cherry picked from commit 38d75dfd3a643f8a1acd52e025a466d65065b60e)
 2017-03-07 13:39:40 -08:00
Daniel Templeton
83fbb051bb YARN-6287. RMCriticalThreadUncaughtExceptionHandler.rmContext should be final (Contributed by Corey Barker via Daniel Templeton) 
(cherry picked from commit e0c239cdbda336e09a35d112d451c2e17d74a3fc)
 2017-03-07 12:01:38 -08:00
Arpit Agarwal
8be80ccb72 HDFS-11508. Fix bind failure in SimpleTCPServer & Portmap where bind fails because socket is in TIME_WAIT state. Contributed by Mukul Kumar Singh. 2017-03-07 11:41:12 -08:00
Akira Ajisaka
d2d0872f4d
HADOOP-14087. S3A typo in pom.xml test exclusions. Contributed by Aaron Fabbri. 
(cherry picked from commit f597f4c43e0a6e2304b9bcaf727d6d8d15a365f9)
 2017-03-07 15:16:18 +09:00
Akira Ajisaka
120f680318
Treat encrypted files as private. Contributed by Daniel Templeton. 
(cherry picked from commit f01a69f84f4cc7d925d078a7ce32e5800da4e429)
 2017-03-07 13:38:20 +09:00
Akira Ajisaka
aa1f944bba
MAPREDUCE-6855. Specify charset when create String in CredentialsTestJob. Contributed by Kai Sasaki. 
(cherry picked from commit 14413989cac9acc1fa6f8d330fac32f772613325)
 2017-03-07 13:12:58 +09:00
Mingliang Liu
ff050866bf HADOOP-13930. Azure: Add Authorization support to WASB. Contributed by Sivaguru Sankaridurg and Dushyanth 
(cherry picked from commit 686823529be09bea2a6cecb3503ef722017475bc)
 2017-03-06 17:35:06 -08:00
Mingliang Liu
8323e651a1 Revert "HADOOP-13930. Azure: Add Authorization support to WASB. Contributed by Sivaguru Sankaridurg and Dushyanth" 
This reverts commit b26870c58ec6f88c6a3722c5fc856bbbd60c5550.
 2017-03-06 17:18:36 -08:00
Mingliang Liu
2d059b5a40 HADOOP-14048. REDO operation of WASB#AtomicRename should create placeholder blob for destination folder. Contributed by NITIN VERMA 
(cherry picked from commit c571cda5c7d929477961dfff4176d7de4944d874)
 2017-03-06 17:01:01 -08:00
Arpit Agarwal
8dc8ecbb91 HDFS-10838. Last full block report received time for each DN should be easily discoverable. Contributed by Surendra Singh Lilhore. 2017-03-06 16:40:00 -08:00
Andrew Wang
6e75c1e2f0 HDFS-11498. Make RestCsrfPreventionHandler and WebHdfsHandler compatible with Netty 4.0. 
(cherry picked from commit 5e74196ede9bfc20eb6d6fe3aa6a0e5c47a40fdd)
 2017-03-06 15:04:29 -08:00
Ray Chiang
d943480147 YARN-5665. Enhance documentation for yarn.resourcemanager.scheduler.class property. (Yufei Gu via rchiang) 
(cherry picked from commit d9dc444dc73fbe23f9e553d63baf83f12c636fa7)
 2017-03-06 14:05:09 -08:00
Andrew Wang
cf5a1390aa HDFS-11441. Add escaping to error message in KMS web UI. Contributed by Aaron T. Myers. 
(cherry picked from commit ec839b94c0eb3f09e74f8a3b0bc9a08b3f5418b2)
 2017-03-06 10:47:28 -08:00
Akira Ajisaka
ed55bcee1f
HADOOP-14108. CLI MiniCluster: add an option to specify NameNode HTTP port. Contributed by Takanobu Asanuma. 
(cherry picked from commit 209ecd1a5c056e096a5d804759f88302608d503b)
 2017-03-07 01:36:10 +09:00
Yiqun Lin
5b49a96328 HDFS-8741. Proper error msg to be printed when invalid operation type is given to WebHDFS operations. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit 3536ce031ca780d6de83cf67779f571a0142ccc8)
 2017-03-06 19:05:43 +08:00
Daniel Templeton
c8b96296b2 HADOOP-14026. start-build-env.sh: invalid docker image name (Contributed by Gergő Pásztor via Daniel Templeton) 
(cherry picked from commit 6757329c43c1d6586c135b5aa00f144dd0d8d2f1)
 2017-03-04 11:02:18 -08:00
Yiqun Lin
2288857e3b HDFS-11494. Log message when DN is not selected for block replication. Contributed by Yiqun Lin. 2017-03-04 13:41:49 +08:00
Mingliang Liu
b26870c58e HADOOP-13930. Azure: Add Authorization support to WASB. Contributed by Sivaguru Sankaridurg and Dushyanth 2017-03-03 17:09:05 -08:00
Jian He
712434e744 YARN-6270. WebUtils.getRMWebAppURLWithScheme() needs to honor RM HA setting. Contributed by Xuan Gong 2017-03-03 15:24:23 -08:00
Junping Du
a58dfcb421 YARN-6271. yarn rmadin -getGroups returns information from standby RM. Contributed by Jian He. 
(cherry picked from commit 8db7a8c3aea3d989361f32cca5b271e9653773b6)
 2017-03-03 14:40:32 -08:00
Jing Zhao
30b43a2d4e HDFS-11476. Fix NPE in FsDatasetImpl#checkAndUpdate. Contributed by Xiaobing Zhou. 
(cherry picked from commit ac5ae0065a127ac150a887fa6c6f3cffd86ef733)
 2017-03-03 13:35:13 -08:00
Ray Chiang
303ee13e3c YARN-6218. Fix TestAMRMClient when using FairScheduler. (Miklos Szegedi via rchiang) 
(cherry picked from commit 30b91ff9540e35195af834d1bd5983114a556c6d)
 2017-03-03 12:57:17 -08:00
Jason Lowe
5eca427da2 YARN-6263. NMTokenSecretManagerInRM.createAndGetNMToken is not thread safe. Contributed by Haibo Chen 
(cherry picked from commit e58fc7603053e3ac1bc2464f9622995017db5245)
 2017-03-03 08:24:05 -06:00
Jason Lowe
9b949f49e3 YARN-6274. Documentation refers to incorrect nodemanager health checker interval property. Contributed by WeiWei Yang 
(cherry picked from commit 05237636d3a359dc502e8fa2d66bfdcea274f86c)
 2017-03-03 08:01:40 -06:00
Harsh J
d4c13df515 HADOOP-6801. io.sort.mb and io.sort.factor were renamed and moved to mapreduce but are still in CommonConfigurationKeysPublic.java and used in SequenceFile.java. 
This closes #146

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit eb5a17954a758fdb1f3f29ef34e129d5f37d3a26)
 2017-03-03 18:39:47 +09:00
Akira Ajisaka
e2fb9538f0 MAPREDUCE-6753. Variable in byte printed directly in mapreduce client. Contributed by Kai Sasaki. 
(cherry picked from commit 19a1fc6373f0dea56e5845f19990d469428489bc)
 2017-03-03 16:13:26 +09:00
Akira Ajisaka
e563cd8692 MAPREDUCE-6841. Fix dead link in MapReduce tutorial document. Contributed by Victor Nee. 
(cherry picked from commit 4d33683882cc41939c512db221fd8ee59ecd52a8)
 2017-03-03 16:12:56 +09:00
Andrew Wang
d737a26c5a Revert "HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru." 
This reverts commit 5e760f8dc4bc007bd839f33fe4a99fa603755149.
 2017-03-02 16:21:32 -08:00
Arpit Agarwal
5e760f8dc4 HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru. 2017-03-02 15:38:32 -08:00
Steve Loughran
51fefbe38b
HADOOP-14138. Remove S3A ref from META-INF service discovery, rely on existing core-default entry. 
Contributed by Steve Loughran
 2017-03-02 21:41:49 +00:00
Ming Ma
8ce4863103 HDFS-11412. Maintenance minimum replication config value allowable range should be [0, DefaultReplication]. (Manoj Govindassamy via mingma) 2017-03-02 11:06:48 -08:00
Jian He
b8b605bfc5 MAPREDUCE-6852. Job#updateStatus() failed with NPE due to race condition. Contributed by Junping Du 2017-03-02 10:59:18 -08:00
John Zhuge
cacaa299cf HDFS-11418. HttpFS should support old SSL clients. Contributed by John Zhuge. 
Change-Id: I05b1228f7f168e9b5904365ba9e81be3f29dce74
 2017-03-01 19:45:25 -08:00
John Zhuge
133857ba04 HADOOP-14131. kms.sh creates bogus dir for tomcat logs. Contributed by John Zhuge. 
Change-Id: I444e10318eb64dcd4c0416b985d12049c72e8943
 2017-03-01 16:31:34 -08:00
Arpit Agarwal
ff08f54f41 HDFS-11479. Socket re-use address option should be used in SimpleUdpServer. Contributed by Mukul Kumar Singh. 2017-03-01 12:59:09 -08:00