13225 Commits

Author SHA1 Message Date
Jian He
36eda5af75 HADOOP-14062. ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled. Contributed by Steven Rand 2017-03-08 10:49:07 -08:00
Robert Kanter
11d4cdc3a6 YARN-6297. TestAppLogAggregatorImp.verifyFilesUploaded() should check # of filed uploaded with that of files expected (haibochen via rkanter)
(cherry picked from commit 287ba4ffa66212c02e1b1edc8fca53f6368a9efc)
2017-03-08 10:45:59 -08:00
Sunil G
ec4c2d42fe YARN-6207. Move application across queues should handle delayed event processing. Contributed by Bibin A Chundatt.
(cherry picked from commit 1eb81867032b016a59662043cbae50daa52dafa9)
2017-03-08 12:13:14 +05:30
Mingliang Liu
d0e26075b8 HADOOP-14150. Implement getHomeDirectory() method in NativeAzureFileSystem. Contributed by Santhosh G Nayak
(cherry picked from commit 28daaf0eb206d723d2baf0f9d91e43d98bb2fd26)
2017-03-07 14:57:41 -08:00
Robert Kanter
7953ac4da6 MAPREDUCE-6839. TestRecovery.testCrashed failed (pairg via rkanter)
(cherry picked from commit 38d75dfd3a643f8a1acd52e025a466d65065b60e)
2017-03-07 13:39:40 -08:00
Daniel Templeton
83fbb051bb YARN-6287. RMCriticalThreadUncaughtExceptionHandler.rmContext should be final (Contributed by Corey Barker via Daniel Templeton)
(cherry picked from commit e0c239cdbda336e09a35d112d451c2e17d74a3fc)
2017-03-07 12:01:38 -08:00
Arpit Agarwal
8be80ccb72 HDFS-11508. Fix bind failure in SimpleTCPServer & Portmap where bind fails because socket is in TIME_WAIT state. Contributed by Mukul Kumar Singh. 2017-03-07 11:41:12 -08:00
Akira Ajisaka
d2d0872f4d
HADOOP-14087. S3A typo in pom.xml test exclusions. Contributed by Aaron Fabbri.
(cherry picked from commit f597f4c43e0a6e2304b9bcaf727d6d8d15a365f9)
2017-03-07 15:16:18 +09:00
Akira Ajisaka
120f680318
Treat encrypted files as private. Contributed by Daniel Templeton.
(cherry picked from commit f01a69f84f4cc7d925d078a7ce32e5800da4e429)
2017-03-07 13:38:20 +09:00
Akira Ajisaka
aa1f944bba
MAPREDUCE-6855. Specify charset when create String in CredentialsTestJob. Contributed by Kai Sasaki.
(cherry picked from commit 14413989cac9acc1fa6f8d330fac32f772613325)
2017-03-07 13:12:58 +09:00
Mingliang Liu
ff050866bf HADOOP-13930. Azure: Add Authorization support to WASB. Contributed by Sivaguru Sankaridurg and Dushyanth
(cherry picked from commit 686823529be09bea2a6cecb3503ef722017475bc)
2017-03-06 17:35:06 -08:00
Mingliang Liu
8323e651a1 Revert "HADOOP-13930. Azure: Add Authorization support to WASB. Contributed by Sivaguru Sankaridurg and Dushyanth"
This reverts commit b26870c58ec6f88c6a3722c5fc856bbbd60c5550.
2017-03-06 17:18:36 -08:00
Mingliang Liu
2d059b5a40 HADOOP-14048. REDO operation of WASB#AtomicRename should create placeholder blob for destination folder. Contributed by NITIN VERMA
(cherry picked from commit c571cda5c7d929477961dfff4176d7de4944d874)
2017-03-06 17:01:01 -08:00
Arpit Agarwal
8dc8ecbb91 HDFS-10838. Last full block report received time for each DN should be easily discoverable. Contributed by Surendra Singh Lilhore. 2017-03-06 16:40:00 -08:00
Andrew Wang
6e75c1e2f0 HDFS-11498. Make RestCsrfPreventionHandler and WebHdfsHandler compatible with Netty 4.0.
(cherry picked from commit 5e74196ede9bfc20eb6d6fe3aa6a0e5c47a40fdd)
2017-03-06 15:04:29 -08:00
Ray Chiang
d943480147 YARN-5665. Enhance documentation for yarn.resourcemanager.scheduler.class property. (Yufei Gu via rchiang)
(cherry picked from commit d9dc444dc73fbe23f9e553d63baf83f12c636fa7)
2017-03-06 14:05:09 -08:00
Andrew Wang
cf5a1390aa HDFS-11441. Add escaping to error message in KMS web UI. Contributed by Aaron T. Myers.
(cherry picked from commit ec839b94c0eb3f09e74f8a3b0bc9a08b3f5418b2)
2017-03-06 10:47:28 -08:00
Akira Ajisaka
ed55bcee1f
HADOOP-14108. CLI MiniCluster: add an option to specify NameNode HTTP port. Contributed by Takanobu Asanuma.
(cherry picked from commit 209ecd1a5c056e096a5d804759f88302608d503b)
2017-03-07 01:36:10 +09:00
Yiqun Lin
5b49a96328 HDFS-8741. Proper error msg to be printed when invalid operation type is given to WebHDFS operations. Contributed by Surendra Singh Lilhore.
(cherry picked from commit 3536ce031ca780d6de83cf67779f571a0142ccc8)
2017-03-06 19:05:43 +08:00
Daniel Templeton
c8b96296b2 HADOOP-14026. start-build-env.sh: invalid docker image name (Contributed by Gergő Pásztor via Daniel Templeton)
(cherry picked from commit 6757329c43c1d6586c135b5aa00f144dd0d8d2f1)
2017-03-04 11:02:18 -08:00
Yiqun Lin
2288857e3b HDFS-11494. Log message when DN is not selected for block replication. Contributed by Yiqun Lin. 2017-03-04 13:41:49 +08:00
Mingliang Liu
b26870c58e HADOOP-13930. Azure: Add Authorization support to WASB. Contributed by Sivaguru Sankaridurg and Dushyanth 2017-03-03 17:09:05 -08:00
Jian He
712434e744 YARN-6270. WebUtils.getRMWebAppURLWithScheme() needs to honor RM HA setting. Contributed by Xuan Gong 2017-03-03 15:24:23 -08:00
Junping Du
a58dfcb421 YARN-6271. yarn rmadin -getGroups returns information from standby RM. Contributed by Jian He.
(cherry picked from commit 8db7a8c3aea3d989361f32cca5b271e9653773b6)
2017-03-03 14:40:32 -08:00
Jing Zhao
30b43a2d4e HDFS-11476. Fix NPE in FsDatasetImpl#checkAndUpdate. Contributed by Xiaobing Zhou.
(cherry picked from commit ac5ae0065a127ac150a887fa6c6f3cffd86ef733)
2017-03-03 13:35:13 -08:00
Ray Chiang
303ee13e3c YARN-6218. Fix TestAMRMClient when using FairScheduler. (Miklos Szegedi via rchiang)
(cherry picked from commit 30b91ff9540e35195af834d1bd5983114a556c6d)
2017-03-03 12:57:17 -08:00
Jason Lowe
5eca427da2 YARN-6263. NMTokenSecretManagerInRM.createAndGetNMToken is not thread safe. Contributed by Haibo Chen
(cherry picked from commit e58fc7603053e3ac1bc2464f9622995017db5245)
2017-03-03 08:24:05 -06:00
Jason Lowe
9b949f49e3 YARN-6274. Documentation refers to incorrect nodemanager health checker interval property. Contributed by WeiWei Yang
(cherry picked from commit 05237636d3a359dc502e8fa2d66bfdcea274f86c)
2017-03-03 08:01:40 -06:00
Harsh J
d4c13df515 HADOOP-6801. io.sort.mb and io.sort.factor were renamed and moved to mapreduce but are still in CommonConfigurationKeysPublic.java and used in SequenceFile.java.
This closes #146

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit eb5a17954a758fdb1f3f29ef34e129d5f37d3a26)
2017-03-03 18:39:47 +09:00
Akira Ajisaka
e2fb9538f0 MAPREDUCE-6753. Variable in byte printed directly in mapreduce client. Contributed by Kai Sasaki.
(cherry picked from commit 19a1fc6373f0dea56e5845f19990d469428489bc)
2017-03-03 16:13:26 +09:00
Akira Ajisaka
e563cd8692 MAPREDUCE-6841. Fix dead link in MapReduce tutorial document. Contributed by Victor Nee.
(cherry picked from commit 4d33683882cc41939c512db221fd8ee59ecd52a8)
2017-03-03 16:12:56 +09:00
Andrew Wang
d737a26c5a Revert "HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru."
This reverts commit 5e760f8dc4bc007bd839f33fe4a99fa603755149.
2017-03-02 16:21:32 -08:00
Arpit Agarwal
5e760f8dc4 HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru. 2017-03-02 15:38:32 -08:00
Steve Loughran
51fefbe38b
HADOOP-14138. Remove S3A ref from META-INF service discovery, rely on existing core-default entry.
Contributed by Steve Loughran
2017-03-02 21:41:49 +00:00
Ming Ma
8ce4863103 HDFS-11412. Maintenance minimum replication config value allowable range should be [0, DefaultReplication]. (Manoj Govindassamy via mingma) 2017-03-02 11:06:48 -08:00
Jian He
b8b605bfc5 MAPREDUCE-6852. Job#updateStatus() failed with NPE due to race condition. Contributed by Junping Du 2017-03-02 10:59:18 -08:00
John Zhuge
cacaa299cf HDFS-11418. HttpFS should support old SSL clients. Contributed by John Zhuge.
Change-Id: I05b1228f7f168e9b5904365ba9e81be3f29dce74
2017-03-01 19:45:25 -08:00
John Zhuge
133857ba04 HADOOP-14131. kms.sh creates bogus dir for tomcat logs. Contributed by John Zhuge.
Change-Id: I444e10318eb64dcd4c0416b985d12049c72e8943
2017-03-01 16:31:34 -08:00
Arpit Agarwal
ff08f54f41 HDFS-11479. Socket re-use address option should be used in SimpleUdpServer. Contributed by Mukul Kumar Singh. 2017-03-01 12:59:09 -08:00
Brahma Reddy Battula
a545ee4d7f HDFS-11432. Federation : Support fully qualified path for Quota/Snapshot/cacheadmin/cryptoadmin commands. Contributed by Brahma Reddy Battula.
(cherry picked from commit dcd03df9f9e0080d7e179060ffc8148336c31b3e)
2017-03-01 10:47:47 +05:30
Jian He
c7ddf95d4a YARN-6153. KeepContainer does not work when AM retry window is set. Contributed by kyungwan nam
(cherry picked from commit 235203dffda1482fb38762fde544c4dd9c3e1fa8)
2017-02-28 13:26:55 -08:00
Xuan
95bd3c3d55 YARN-6189: Improve application status log message when RM restarted when
app is in NEW state. Contributed by Junping Du

(cherry picked from commit e0bb867c3fa638c9f689ee0b044b400481cf02b5)
2017-02-28 11:06:07 -08:00
Gera Shegalov
df35ba81fe YARN-1728. Workaround guice3x-undecoded pathInfo in YARN WebApp. (Yuanbo Liu via gera) 2017-02-28 09:46:57 -08:00
Zhe Zhang
5fb785e154 HDFS-11466. Change dfs.namenode.write-lock-reporting-threshold-ms default from 1000ms to 5000ms. Contributed by Andrew Wang.
(cherry picked from commit d269b488a71a158d3ddcbdea96992abe29725c69)
2017-02-28 09:02:59 -08:00
Karthik Kambatla
58eefc71c7 YARN-6231. FairSchedulerTestBase helper methods should call scheduler.update to avoid flakiness. (kasha)
(cherry picked from commit f187d63816584b783fbfe238475c8f37decdb6dc)
2017-02-27 22:16:32 -08:00
Lei Xu
76bf47cb91 Add missing file hadoop-common-project/hadoop-kms/src/main/tomcat/catalina-default.properties for HADOOP-14083. (lei) 2017-02-27 20:49:35 -08:00
Yongjun Zhang
16ca70553c HADOOP-14127. Add log4j configuration to enable logging in hadoop-distcp's tests. (Xiao Chen via Yongjun Zhang)
(cherry picked from commit d235dcdf0b6f36162280e32c7c0342b7970c9b7b)
2017-02-27 20:46:17 -08:00
Lei Xu
d440ad46b5 HADOOP-14083. KMS should support old SSL clients. (John Zhuge via Lei Xu) 2017-02-27 18:12:00 -08:00
Naganarasimha
1eec911cd9 YARN-5703. ReservationAgents are not correctly configured. Contributed by Manikandan R.
(cherry picked from commit 5f5b031d1f20cb7f621db41979e963eaa42cf52f)
2017-02-27 20:42:10 +05:30
Sunil G
68b08e96a0 YARN-6123. [YARN-5864] Add a test to make sure queues of orderingPolicy will be updated when childQueues is added or removed. Contributed by Wangda Tan. 2017-02-27 17:54:47 +05:30