Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
13,702 Commits 326 Branches 371 Tags
Commit Graph

3554 Commits

Author SHA1 Message Date
Steve Loughran
b500714e98
HADOOP-14346. CryptoOutputStream throws IOException if stream is closed. 
Contributed by Pierre Lacave

(cherry picked from commit 40b9c30d64ee1b07ade423533e627a7d4b099261)
 2017-04-27 12:18:30 +01:00
John Zhuge
1e60cfed7e HADOOP-14341. Support multi-line value for ssl.server.exclude.cipher.list. Contributed by John Zhuge. 
(cherry picked from commit 9ccb849eb69f05bccc3435306ec4bde104e411bf)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/http/HttpServer2.java
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/ssl/SSLFactory.java
 2017-04-25 22:36:21 -07:00
Xiaoyu Yao
fc0e6de929 HADOOP-14207. "dfsadmin -refreshCallQueue" fails with DecayRpcScheduler. Contributed by Surendra Singh Lihore. 
(cherry picked from commit 918dee10f56861d15bb6644edcefb4246a3e00a4)
 2017-04-25 18:49:44 -07:00
Mingliang Liu
6fd072f924 HADOOP-12856. FileUtil.checkDest() and RawLocalFileSystem.mkdirs() to throw stricter IOEs; RawLocalFS contract tests to verify. Contributed by Steve Loughran 
(cherry picked from commit d11d280b8b527d572ca0b29ef57434e9ff533ffe)
 2017-04-25 18:34:26 -07:00
Mingliang Liu
3b7bb7b94b HADOOP-14324. Refine S3 server-side-encryption key as encryption secret; improve error reporting and diagnostics. Contributed by Steve Loughran 2017-04-20 17:07:57 -07:00
Daniel Templeton
d77137a03f YARN-6453. fairscheduler-statedump.log gets generated regardless of service 
(Contributed by Yufei Gu via Daniel Templeton)

(cherry picked from commit e74ca7216aecc998d277e5ca1f4d0abae43c7e31)
 2017-04-20 14:14:38 -07:00
John Zhuge
1bbba00a20 HADOOP-14141. Store KMS SSL keystore password in catalina.properties. Contributed by John Zhuge. 
Change-Id: I8326b16aab5c3908529e1a0cc7bfe121d18f42f3
 2017-04-20 12:36:40 -07:00
John Zhuge
6865746ea4 HADOOP-14241. Add ADLS sensitive config keys to default list. Contributed by John Zhuge. 2017-04-19 22:22:36 -07:00
John Zhuge
ef74a5661b Revert "HADOOP-14241. Add ADLS sensitive config keys to default list. Contributed by John Zhuge." 
This reverts commit 3a39dd5391527623a70296410f4754d8d235310a.
 2017-04-19 13:33:38 -07:00
John Zhuge
3a39dd5391 HADOOP-14241. Add ADLS sensitive config keys to default list. Contributed by John Zhuge. 
(cherry picked from commit 0344bea3fd4031622edd828a610c9fdc23c53d26)
 2017-04-19 12:04:03 -07:00
Daniel Templeton
5225ae50b7 HADOOP-13997. Typo in metrics docs (Contributed by Ana Krasteva via Daniel Templeton) 
(cherry picked from commit d4483a2fe47ccc589e71c6fe5501878e6142c26f)
 2017-04-19 09:42:30 -07:00
Kengo Seki
6cfceee865
HADOOP-14315. Python example in the rack awareness document doesn't work due to bad indentation 
This closes #214

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 654372db859656a2201ae9f9f7c374c6564ea34d)
 2017-04-18 17:15:35 +09:00
Akira Ajisaka
a17bd70892
HADOOP-14318. Remove non-existent setfattr command option from FileSystemShell.md. Contributed by Doris Gu. 
(cherry picked from commit 84a8848aaecd56b4cc85185924c2e33674165e01)
 2017-04-18 16:45:14 +09:00
Mingliang Liu
508389ee54 HADOOP-14255. S3A to delete unnecessary fake directory objects in mkdirs(). Contributed by Mingliang Liu 
(cherry picked from commit 507845074970b90330db86bc1ff0124def550bb5)
 2017-04-12 14:30:54 -07:00
Daniel Templeton
f20aa38a1d HADOOP-14246. Authentication Tokens should use SecureRandom instead of Random and 256 bit secrets 
(Conttributed by Robert Konter via Daniel Templeton)

(cherry picked from commit 4dd6206547de8f694532579e37ba8103bafaeb12)
 2017-04-12 11:19:53 -07:00
Chris Nauroth
d5e2bd4096 HDFS-11163. Mover should move the file blocks to default storage once policy is unset. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit 00ed21a6fedb45a7c8992b8d45adaa83f14af34c)
 2017-04-11 21:18:47 -07:00
Steve Loughran
5efb3ade1f HADOOP-14066 VersionInfo should be marked as public API 
(cherry picked from commit 2ed65540a3fe73db5d2dd0d25e658ccf13c9188a)
 2017-04-11 15:06:40 -07:00
Jason Lowe
0cb22a0f15 YARN-6195. Export UsedCapacity and AbsoluteUsedCapacity to JMX. Contributed by Benson Qiu 
(cherry picked from commit 0e065f2edead41f6f894c9d70def389af1c0f239)
 2017-04-11 08:45:16 -05:00
Andrew Wang
dab1deb9a0 HADOOP-14293. Initialize FakeTimer with a less trivial value. 
(cherry picked from commit be144117a885cb39bc192279c96cbe3790dc77b1)
 2017-04-10 11:37:31 -07:00
John Zhuge
ff2870310e HADOOP-14174. Set default ADLS access token provider type to ClientCredential. Contributed by John Zhuge. 
Signed-off-by: John Zhuge <jzhuge@apache.org>
(cherry picked from commit 56e81f2a204d5e65d29222df1b2ba4d892f9c0d5)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/conf/TestCommonConfigurationFields.java
 2017-04-07 15:01:29 -07:00
Zhe Zhang
c85026038a HADOOP-14276. Add a nanosecond API to Time/Timer/FakeTimer. Contributed by Erik Krogen. 
(cherry picked from commit 95b7f1d29a5e2dadd70a56fca5faa006c5bd74fc)
 2017-04-07 10:39:40 -07:00
Andrew Wang
ed8f738be5 HADOOP-14104. Client should always ask namenode for kms provider path. Contributed by Rushabh S Shah. 2017-04-06 14:38:22 -07:00
Xiaoyu Yao
9016614eb1 HDFS-11302. Improve Logging for SSLHostnameVerifier. Contributed by Chen Liang. 
(cherry picked from commit 32bb36b750ab656f2f32f6c74eaa1a3e68ae956e)
 2017-04-05 18:30:33 -07:00
Jonathan Eagles
60e65a3e55 HADOOP-14216. Addendum to Improve Configuration XML Parsing Performance (jeagles) 2017-03-30 14:15:37 -05:00
Mingliang Liu
3d5e9e61d5 HADOOP-14247. FileContextMainOperationsBaseTest should clean up test root path. Contributed by Mingliang Liu 
(cherry picked from commit 13c766b62c48ae07849f7f1762ef6883239aef54)
 2017-03-29 11:19:28 -07:00
Jonathan Eagles
719ae5f2e8 HADOOP-14216. Improve Configuration XML Parsing Performance (jeagles) 2017-03-29 10:14:49 -05:00
John Zhuge
ef43a62482 HADOOP-14038. Rename ADLS credential properties. Contributed by John Zhuge. 
(cherry picked from commit 253e3e78abb9ebe0e8103d25538ff07875b33c84)
 2017-03-27 23:07:08 -07:00
Akira Ajisaka
643298b282
HADOOP-14218. Replace assertThat with assertTrue in MetricsAsserts. 
(cherry picked from commit 448ec81fd7133f413853570f116d5f6e16f68bd9)
 2017-03-28 14:33:36 +09:00
Andrew Wang
10deafee82 HDFS-11170. Add builder-based create API to FileSystem. Contributed by SammiChen and Wei Zhou. 2017-03-27 14:35:03 -07:00
Jonathan Eagles
e41aac0cd4 Configuration#get return value optimization (jeagles) 2017-03-27 12:52:59 -05:00
Jonathan Eagles
675bc97f18 Delay construction of PreCondition.check failure message in Configuration#set (jeagles) 
(cherry picked from commit 858d597be00ce006c1d1d4cd476729e4f1de8d25)
 2017-03-27 11:02:41 -05:00
Junping Du
3ad4d37363 Add COMMON/MAPREDUCE/YARN jdiff of 2.8.0 release. 
(cherry picked from commit 6df029db36412b7219b64313dcbe1874dc1c8b0c)
 2017-03-25 14:33:20 -07:00
Junping Du
e796105a6f Add 2.8.0 RELEASENOTEs.md and CHANGES.md. 
(cherry picked from commit d8e6d6df4c23aa11455c1775391b1c7883bec2ea)
 2017-03-25 14:32:47 -07:00
Daniel Templeton
bbd08bb7a4 YARN-6360. Prevent FS state dump logger from cramming other log files 
(Contributed by Yufei Gu via Daniel Templeton)

(cherry picked from commit d49d1862a645b8c5d3eae95bf633bc82816f0168)
 2017-03-24 11:31:58 -07:00
Andrew Wang
96fe940e59 HADOOP-14211. FilterFs and ChRootedFs are too aggressive about enforcing 'authorityNeeded'. Contributed by Erik Krogen. 
(cherry picked from commit 0e556a5ba645570d381beca60114a1239b27d49f)
 2017-03-24 11:12:31 -07:00
John Zhuge
d946dfcbe1 HADOOP-14195. CredentialProviderFactory$getProviders is not thread-safe. Contributed by Vihang Karajgaonkar. 
(cherry picked from commit 128015584d69492806fd1700c8f840d78aa9c729)
 2017-03-23 13:57:41 -07:00
Mingliang Liu
1e64c582f5 HADOOP-14214. DomainSocketWatcher::add()/delete() should not self interrupt while looping await(). Contributed by Mingliang Liu 
(cherry picked from commit d35e79abc2fee7153a6168e6088f100de59d8c81)
 2017-03-23 13:34:53 -07:00
Ravi Prakash
87339d7691 HADOOP-14213. Move Configuration runtime check for hadoop-site.xml to initialization. Contributed by Jonathan Eagles 
(cherry picked from commit 595f62e362c08704d6fb692e21c97b512bc7ec49)
 2017-03-23 09:30:22 -07:00
Zhe Zhang
f98f4bb6ca HADOOP-9631. ViewFs should use underlying FileSystem's server side defaults. Contributed by Lohit Vijayarenu and Erik Krogen. 
(cherry picked from commit 59d69257a888347f0fb9c51bb000afc986b64f98)
 2017-03-22 22:32:07 -07:00
John Zhuge
84e2c11f96 HADOOP-14205. No FileSystem for scheme: adl. Contributed by John Zhuge. 2017-03-21 08:23:30 -07:00
John Zhuge
2c5de0c60e HDFS-11132. Allow AccessControlException in contract tests when getFileStatus on subdirectory of existing files. Contributed by Vishwajeet Dusane 
(cherry picked from commit 19f373a46b2abb7a575f7884a9c7443b8ed67cd3)

Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/FileSystemContractBaseTest.java
 2017-03-20 21:16:50 -07:00
Erik Krogen
e44569b736 HADOOP-14169. Implement listStatusIterator, listLocatedStatus for ViewFs. Contributed by Erik Krogen. 
(cherry picked from commit e1a99802fc5c2f2ad3ceb000378db1c0133069b3)
 2017-03-17 17:40:14 -07:00
Andrew Wang
7cc88eca43 HDFS-11516. Admin command line should print message to stderr in failure case. Contributed by Kai Sasaki. 
(cherry picked from commit 92ea6d74ecd84b86771e285902dd2a80bccbe3ea)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/cli/util/ErasureCodingCliCmdExecutor.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/resources/testErasureCodingConf.xml
 2017-03-17 11:34:43 -07:00
Jitendra Pandey
d564d1f44d HDFS-11533. reuseAddress option should be used for child channels in Portmap and SimpleTcpServer. Contributed by Mukul Kumar Singh. 2017-03-16 12:37:22 -07:00
Mingliang Liu
ed0d426a88 HADOOP-14170. FileSystemContractBaseTest is not cleaning up test directory clearly. Contributed by Mingliang Liu 2017-03-14 15:00:59 -07:00
Ray Chiang
fa59f4e490 YARN-6042. Dump scheduler and queue state information into FairScheduler DEBUG log. (Yufei Gu via rchiang) 2017-03-14 14:45:13 -07:00
Jing Zhao
e03d8ff488 HDFS-11395. RequestHedgingProxyProvider#RequestHedgingInvocationHandler hides the Exception thrown from NameNode. Contributed by Nandakumar. 
(cherry picked from commit 55796a0946f80a35055701a34379e374399009c5)
 2017-03-13 14:26:44 -07:00
Jian He
8c44a9db21 HADOOP-14062. ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled. Contributed by Steven Rand 2017-03-10 09:26:19 -08:00
Mingliang Liu
9ea6b24c49 HADOOP-13946. Document how HDFS updates timestamps in the FS spec; compare with object stores. Contributed by Steve Loughran 
(cherry picked from commit fd26783aaf3deea7a4e197439bd1075a6689681f)
 2017-03-10 00:21:58 -08:00
Lei Xu
01624f0c1b HADOOP-13956. Read ADLS credentials from Credential Provider. (John Zhuge via lei) 
(cherry picked from commit e015b563197a475e354bf84fd27e7bbcc67e00a4)
 2017-03-09 15:16:28 -08:00