Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,149 Commits 326 Branches 371 Tags
Commit Graph

3149 Commits

Author SHA1 Message Date
Akira Ajisaka
42fa35d531
HADOOP-14371. License error in TestLoadBalancingKMSClientProvider.java. Contributed by hu xiaodong. 
(cherry picked from commit 20cde552748cc6be1c5ca590755d4e5a67baf187)
(cherry picked from commit 036624900be0bcc2af7f60a28a72cea0295f7300)
 2017-05-02 23:39:25 +09:00
Eric Payne
84106e80a8 HADOOP-14320. TestIPC.testIpcWithReaderQueuing fails intermittently. Contributed by Eric Badger. 
(cherry picked from commit 6fe11f61556407f8efb9b376623cd61609a40d5f)
 2017-04-28 14:55:14 -05:00
Steve Loughran
40b9c30d64
HADOOP-14346. CryptoOutputStream throws IOException if stream is closed. 
Contributed by Pierre Lacave
 2017-04-27 12:17:20 +01:00
John Zhuge
19e94bfd1b HADOOP-14341. Support multi-line value for ssl.server.exclude.cipher.list. Contributed by John Zhuge. 
(cherry picked from commit 9ccb849eb69f05bccc3435306ec4bde104e411bf)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/http/HttpServer2.java
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/ssl/SSLFactory.java
 2017-04-25 22:41:27 -07:00
John Zhuge
28f0de875d HADOOP-14241. Add ADLS sensitive config keys to default list. Contributed by John Zhuge. 
(cherry picked from commit 6865746ea444c57569e9b2464d8240dafcdbaaa5)
 2017-04-19 22:24:33 -07:00
John Zhuge
e813110734 Revert "HADOOP-14241. Add ADLS sensitive config keys to default list. Contributed by John Zhuge." 
This reverts commit 935ea448c1364befb58dd1ccedd4d7f736c8002a.
 2017-04-19 13:34:43 -07:00
John Zhuge
935ea448c1 HADOOP-14241. Add ADLS sensitive config keys to default list. Contributed by John Zhuge. 
(cherry picked from commit 0344bea3fd4031622edd828a610c9fdc23c53d26)
 2017-04-19 12:09:09 -07:00
Kengo Seki
525b258944
HADOOP-14315. Python example in the rack awareness document doesn't work due to bad indentation 
This closes #214

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 654372db859656a2201ae9f9f7c374c6564ea34d)
(cherry picked from commit 6cfceee86547211c71f8cb6f9c63798a229de03e)
 2017-04-18 17:16:03 +09:00
Akira Ajisaka
c8bcc96500
HADOOP-14318. Remove non-existent setfattr command option from FileSystemShell.md. Contributed by Doris Gu. 
(cherry picked from commit 84a8848aaecd56b4cc85185924c2e33674165e01)
(cherry picked from commit a17bd7089263511b46918948843d05bb18750b1f)
 2017-04-18 16:46:01 +09:00
Chris Nauroth
c4bf504395 HDFS-11163. Mover should move the file blocks to default storage once policy is unset. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit 00ed21a6fedb45a7c8992b8d45adaa83f14af34c)
(cherry picked from commit d5e2bd4096bf2b4d8a5a22042145a08905f93cd4)
 2017-04-11 21:55:28 -07:00
Steve Loughran
32475a7b6c HADOOP-14066 VersionInfo should be marked as public API 
(cherry picked from commit 2ed65540a3fe73db5d2dd0d25e658ccf13c9188a)
 2017-04-11 15:06:45 -07:00
Junping Du
dfac95a3a2 Preparing for 2.8.1 development 2017-04-11 11:21:49 -07:00
Andrew Wang
c8d494197f HADOOP-14293. Initialize FakeTimer with a less trivial value. 
(cherry picked from commit be144117a885cb39bc192279c96cbe3790dc77b1)
(cherry picked from commit dab1deb9a0c96471b6da4ef95be86cbc81d55305)
 2017-04-10 11:37:35 -07:00
John Zhuge
fa8e411d47 HADOOP-14174. Set default ADLS access token provider type to ClientCredential. Contributed by John Zhuge. 
Signed-off-by: John Zhuge <jzhuge@apache.org>
(cherry picked from commit 56e81f2a204d5e65d29222df1b2ba4d892f9c0d5)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
 2017-04-07 15:05:09 -07:00
Zhe Zhang
ef8b30dd4b HADOOP-14276. Add a nanosecond API to Time/Timer/FakeTimer. Contributed by Erik Krogen. 
(cherry picked from commit 95b7f1d29a5e2dadd70a56fca5faa006c5bd74fc)
(cherry picked from commit c85026038a6ef8d38b7a8563fbb64ac6edd1d4ce)
 2017-04-07 10:52:02 -07:00
Andrew Wang
b1dfdea5b4 HADOOP-14104. Client should always ask namenode for kms provider path. Contributed by Rushabh S Shah. 2017-04-06 14:39:56 -07:00
Wei-Chiu Chuang
eff4b2fa07 HDFS-10683. Make class Token$PrivateToken private. Contributed by John Zhuge. 
(cherry picked from commit c5ca2169151a5eec57152775789b6f53664e102c)
(cherry picked from commit 434403a2a0863e4d572e04e05e85d4f333bd6339)
 2017-04-05 16:35:49 -07:00
Xiao Chen
7ad5b278a7 HDFS-9276. Failed to Update HDFS Delegation Token for long running application in HA mode. Contributed by Liangliang Gu and John Zhuge 
(cherry picked from commit d9aae22fdf2ab22ae8ce4a9d32ac71b3dde084d3)
(cherry picked from commit 24d464a15015a7bf6d02d259568fedab1cb97b84)
 2017-04-05 16:35:44 -07:00
Jing Zhao
e216c15625 HDFS-11395. RequestHedgingProxyProvider#RequestHedgingInvocationHandler hides the Exception thrown from NameNode. Contributed by Nandakumar. 
(cherry picked from commit 55796a0946f80a35055701a34379e374399009c5)
(cherry picked from commit e03d8ff488c5818fbe167fa0143c252d7b6287f0)
 2017-04-05 16:29:04 -07:00
Mingliang Liu
ba3a726988 HADOOP-14247. FileContextMainOperationsBaseTest should clean up test root path. Contributed by Mingliang Liu 
(cherry picked from commit 13c766b62c48ae07849f7f1762ef6883239aef54)
 2017-03-29 11:23:46 -07:00
John Zhuge
c543c0549d HADOOP-14038. Rename ADLS credential properties. Contributed by John Zhuge. 
(cherry picked from commit 253e3e78abb9ebe0e8103d25538ff07875b33c84)
 2017-03-27 23:08:03 -07:00
Jonathan Eagles
ec5a65a0ca Configuration#get return value optimization (jeagles) 
(cherry picked from commit e41aac0cd41c6a4ee740afd09126bc48072880ab)
 2017-03-27 12:53:42 -05:00
Jonathan Eagles
4e40e9d4db Delay construction of PreCondition.check failure message in Configuration#set (jeagles) 
(cherry picked from commit 858d597be00ce006c1d1d4cd476729e4f1de8d25)
 2017-03-27 11:06:41 -05:00
Junping Du
7ec1e6e4f0 Add 2.8.0 RELEASENOTEs.md and CHANGES.md. 
(cherry picked from commit d8e6d6df4c23aa11455c1775391b1c7883bec2ea)
(cherry picked from commit e796105a6fe17a9307f3936cd59763cb173462f7)
 2017-03-25 14:35:43 -07:00
Junping Du
86800b30a9 Add COMMON/MAPREDUCE/YARN jdiff of 2.8.0 release. 
(cherry picked from commit 6df029db36412b7219b64313dcbe1874dc1c8b0c)
(cherry picked from commit 3ad4d3736391f4e443d7fef79770a1fda2a535c2)
 2017-03-25 14:34:55 -07:00
Andrew Wang
5130128a31 HADOOP-14211. FilterFs and ChRootedFs are too aggressive about enforcing 'authorityNeeded'. Contributed by Erik Krogen. 
(cherry picked from commit 0e556a5ba645570d381beca60114a1239b27d49f)
(cherry picked from commit 96fe940e59127dc7c3e4182c3ed450c3cd8d858e)
 2017-03-24 11:25:58 -07:00
John Zhuge
a92f654aa2 HADOOP-14195. CredentialProviderFactory$getProviders is not thread-safe. Contributed by Vihang Karajgaonkar. 
(cherry picked from commit 128015584d69492806fd1700c8f840d78aa9c729)
 2017-03-23 13:58:11 -07:00
Mingliang Liu
47d3c29e30 HADOOP-14214. DomainSocketWatcher::add()/delete() should not self interrupt while looping await(). Contributed by Mingliang Liu 
(cherry picked from commit d35e79abc2fee7153a6168e6088f100de59d8c81)
 2017-03-23 13:39:42 -07:00
Zhe Zhang
8ca9915d0f HADOOP-9631. ViewFs should use underlying FileSystem's server side defaults. Contributed by Lohit Vijayarenu and Erik Krogen. 
(cherry picked from commit 59d69257a888347f0fb9c51bb000afc986b64f98)
(cherry picked from commit f98f4bb6ca45e6f807ca747d673690232e39da52)
 2017-03-22 22:32:41 -07:00
John Zhuge
3ed867fef3 HADOOP-13928. TestAdlFileContextMainOperationsLive.testGetFileContext1 runtime error. (John Zhuge via lei) 
(cherry picked from commit 15066a3e8ddacd36bf7be9fba0b10c350ae45668)
(cherry picked from commit 00dec84cc2d4513922f3f758b54b8e2db9ebd6c8)
 2017-03-21 09:14:17 -07:00
John Zhuge
3a8b120c78 HADOOP-14205. No FileSystem for scheme: adl. Contributed by John Zhuge. 
(cherry picked from commit 84e2c11f969825e52b6bdb4696f48e4567875d41)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/conf/TestCommonConfigurationFields.java
 2017-03-21 08:37:18 -07:00
John Zhuge
e792f1671d HDFS-11132. Allow AccessControlException in contract tests when getFileStatus on subdirectory of existing files. Contributed by Vishwajeet Dusane 
(cherry picked from commit 19f373a46b2abb7a575f7884a9c7443b8ed67cd3)

Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/FileSystemContractBaseTest.java
 2017-03-20 21:29:17 -07:00
Erik Krogen
c7b6e0dd6e HADOOP-14169. Implement listStatusIterator, listLocatedStatus for ViewFs. Contributed by Erik Krogen. 
(cherry picked from commit e1a99802fc5c2f2ad3ceb000378db1c0133069b3)
 2017-03-17 17:42:29 -07:00
Mingliang Liu
026ae87236 HADOOP-13946. Document how HDFS updates timestamps in the FS spec; compare with object stores. Contributed by Steve Loughran 
(cherry picked from commit fd26783aaf3deea7a4e197439bd1075a6689681f)
 2017-03-10 00:22:16 -08:00
Lei Xu
5eaec560d9 HADOOP-13956. Read ADLS credentials from Credential Provider. (John Zhuge via lei) 
(cherry picked from commit e015b563197a475e354bf84fd27e7bbcc67e00a4)
(cherry picked from commit 01624f0c1b7eba9fe4b5778e1da9d38545af3722)
 2017-03-09 15:21:32 -08:00
John Zhuge
cdfa86cadd Revert "HADOOP-13606 swift FS to add a service load metadata file. Contributed by Steve Loughran" 
This reverts commit 53a12fa721bb431f7d481aac7d245c93efb56153.

(cherry picked from commit 98142d2f722e82d57b0e2bae6276f7c17fd99598)

Change-Id: I3a7613a7f4f0e9c80bb6d3c40a53742f807fc689
 2017-03-08 11:47:36 -08:00
Jian He
2e8e51ad40 HADOOP-14062. ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled. Contributed by Steven Rand 2017-03-08 10:49:42 -08:00
Jason Lowe
daf3b5ee67 YARN-6274. Documentation refers to incorrect nodemanager health checker interval property. Contributed by WeiWei Yang 
(cherry picked from commit 05237636d3a359dc502e8fa2d66bfdcea274f86c)
 2017-03-03 08:02:31 -06:00
Brahma Reddy Battula
31bec2c16b HDFS-11432. Federation : Support fully qualified path for Quota/Snapshot/cacheadmin/cryptoadmin commands. Contributed by Brahma Reddy Battula. 
(cherry picked from commit dcd03df9f9e0080d7e179060ffc8148336c31b3e)
 2017-03-01 10:49:36 +05:30
Wei-Chiu Chuang
f9c663f45c HADOOP-13508. FsPermission string constructor does not recognize sticky bit. Contributed by Atul Sikaria. 
(cherry picked from commit 84ec079911b3623394e2664a28333151ce086007)
 2017-02-13 10:47:20 -08:00
Kihwal Lee
6b3443fbf5 HADOOP-14033. Reduce fair call queue lock contention. Contributed by Daryn Sharp. 
(cherry picked from commit 0c01cf57987bcc7a17154a3538960b67f625a9e5)
 2017-02-09 16:20:48 -06:00
Kihwal Lee
47bbe431bf HADOOP-14034. Allow ipc layer exceptions to selectively close connections. Contributed by Daryn Sharp. 
(cherry picked from commit d008b5515304b42faeb48e542c8c27586b8564eb)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ipc/Server.java
 2017-02-09 11:04:29 -06:00
Kihwal Lee
bb98856af9 HADOOP-14032. Reduce fair call queue priority inversion. Contributed by Daryn Sharp. 
(cherry picked from commit a0bfb4150464013a618f30c2e38d88fc6de11ad2)
 2017-02-09 10:14:18 -06:00
Xiao Chen
04076e783b HADOOP-13433 Race in UGI.reloginFromKeytab. Contributed by Duo Zhang. 2017-02-08 23:52:59 -08:00
Eric Yang
e72f485d8c HADOOP-13119. Add ability to secure log servlet using proxy users. Contribute by Yuanbo Liu. 
(cherry picked from commit a847903b6e64c6edb11d852b91f2c816b1253eb3)
 2017-01-21 15:49:32 -08:00
Akira Ajisaka
b8b8b9a32b HADOOP-14001. Improve delegation token validity checking. 
(cherry picked from commit 176346721006a03f41d028560e9e29b5931d5be2)
(cherry picked from commit c6c29d0080964e55ff84246af1e4149d1ef3162a)
 2017-01-19 17:59:18 +09:00
Kihwal Lee
7d949cc432 HADOOP-13976. Path globbing does not match newlines. Contributed by Eric Badger. 
(cherry picked from commit 706d630eb9db9658083d57d1d99b6a0f11cc5657)
 2017-01-17 15:13:56 -06:00
Steve Loughran
e32cd52481 HADOOP-13336 S3A to support per-bucket configuration. Contributed by Steve Loughran 2017-01-11 17:15:01 +00:00
Junping Du
7706a63fb4 Preparing for 2.8.1 development after cutting off 2.8.0 branch. 2017-01-10 18:03:51 -08:00
Vinod Kumar Vavilapalli
9721735ce9 HADOOP-12406. Fixed AbstractMapWritable.readFields to use the thread's ClassLoader to load class instead of System ClassLoader. Contributed by Nadeem Douba. 
(cherry picked from commit 069c6c62def4a0f94382e9f149581d8e22f6d31c)
(cherry picked from commit 4041d2b49e32c7bcf4ec29428b8a85b07b9f74e0)
 2017-01-05 13:23:47 -08:00