Commit Graph

3153 Commits

Author SHA1 Message Date
Xiaoyu Yao a80ac0822b HADOOP-14207. "dfsadmin -refreshCallQueue" fails with DecayRpcScheduler. Contributed by Surendra Singh Lihore.
(cherry picked from commit 918dee10f56861d15bb6644edcefb4246a3e00a4)
(cherry picked from commit 81883e3150c42e866ba9e68d68b734f2772344b2)
2017-05-04 16:03:39 -07:00
Kihwal Lee 103dfae7b9 HADOOP-14372. TestSymlinkLocalFS timeouts are too low. Contributed by Eric Badger.
(cherry picked from commit d4631e466b)
2017-05-03 09:49:50 -05:00
Jason Lowe e4af087d92 HADOOP-14306. TestLocalFileSystem tests have very low timeouts. Contributed by Eric Badger
(cherry picked from commit cedaf4cab9)
2017-05-02 16:54:00 -05:00
Andrew Wang ab511286fd HADOOP-14369. NetworkTopology calls expensive toString() when logging. Contributed by Inigo Goiri.
(cherry picked from commit dcc292d7de)
(cherry picked from commit 484bab3944)
2017-05-02 10:53:59 -07:00
Akira Ajisaka 42fa35d531
HADOOP-14371. License error in TestLoadBalancingKMSClientProvider.java. Contributed by hu xiaodong.
(cherry picked from commit 20cde55274)
(cherry picked from commit 036624900b)
2017-05-02 23:39:25 +09:00
Eric Payne 84106e80a8 HADOOP-14320. TestIPC.testIpcWithReaderQueuing fails intermittently. Contributed by Eric Badger.
(cherry picked from commit 6fe11f6155)
2017-04-28 14:55:14 -05:00
Steve Loughran 40b9c30d64
HADOOP-14346. CryptoOutputStream throws IOException if stream is closed.
Contributed by Pierre Lacave
2017-04-27 12:17:20 +01:00
John Zhuge 19e94bfd1b HADOOP-14341. Support multi-line value for ssl.server.exclude.cipher.list. Contributed by John Zhuge.
(cherry picked from commit 9ccb849eb6)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/http/HttpServer2.java
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/ssl/SSLFactory.java
2017-04-25 22:41:27 -07:00
John Zhuge 28f0de875d HADOOP-14241. Add ADLS sensitive config keys to default list. Contributed by John Zhuge.
(cherry picked from commit 6865746ea4)
2017-04-19 22:24:33 -07:00
John Zhuge e813110734 Revert "HADOOP-14241. Add ADLS sensitive config keys to default list. Contributed by John Zhuge."
This reverts commit 935ea448c1.
2017-04-19 13:34:43 -07:00
John Zhuge 935ea448c1 HADOOP-14241. Add ADLS sensitive config keys to default list. Contributed by John Zhuge.
(cherry picked from commit 0344bea3fd)
2017-04-19 12:09:09 -07:00
Kengo Seki 525b258944
HADOOP-14315. Python example in the rack awareness document doesn't work due to bad indentation
This closes #214

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 654372db85)
(cherry picked from commit 6cfceee865)
2017-04-18 17:16:03 +09:00
Akira Ajisaka c8bcc96500
HADOOP-14318. Remove non-existent setfattr command option from FileSystemShell.md. Contributed by Doris Gu.
(cherry picked from commit 84a8848aae)
(cherry picked from commit a17bd70892)
2017-04-18 16:46:01 +09:00
Chris Nauroth c4bf504395 HDFS-11163. Mover should move the file blocks to default storage once policy is unset. Contributed by Surendra Singh Lilhore.
(cherry picked from commit 00ed21a6fedb45a7c8992b8d45adaa83f14af34c)
(cherry picked from commit d5e2bd4096)
2017-04-11 21:55:28 -07:00
Steve Loughran 32475a7b6c HADOOP-14066 VersionInfo should be marked as public API
(cherry picked from commit 2ed65540a3)
2017-04-11 15:06:45 -07:00
Junping Du dfac95a3a2 Preparing for 2.8.1 development 2017-04-11 11:21:49 -07:00
Andrew Wang c8d494197f HADOOP-14293. Initialize FakeTimer with a less trivial value.
(cherry picked from commit be144117a8)
(cherry picked from commit dab1deb9a0)
2017-04-10 11:37:35 -07:00
John Zhuge fa8e411d47 HADOOP-14174. Set default ADLS access token provider type to ClientCredential. Contributed by John Zhuge.
Signed-off-by: John Zhuge <jzhuge@apache.org>
(cherry picked from commit 56e81f2a20)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
2017-04-07 15:05:09 -07:00
Zhe Zhang ef8b30dd4b HADOOP-14276. Add a nanosecond API to Time/Timer/FakeTimer. Contributed by Erik Krogen.
(cherry picked from commit 95b7f1d29a)
(cherry picked from commit c85026038a)
2017-04-07 10:52:02 -07:00
Andrew Wang b1dfdea5b4 HADOOP-14104. Client should always ask namenode for kms provider path. Contributed by Rushabh S Shah. 2017-04-06 14:39:56 -07:00
Wei-Chiu Chuang eff4b2fa07 HDFS-10683. Make class Token$PrivateToken private. Contributed by John Zhuge.
(cherry picked from commit c5ca216915)
(cherry picked from commit 434403a2a0)
2017-04-05 16:35:49 -07:00
Xiao Chen 7ad5b278a7 HDFS-9276. Failed to Update HDFS Delegation Token for long running application in HA mode. Contributed by Liangliang Gu and John Zhuge
(cherry picked from commit d9aae22fdf)
(cherry picked from commit 24d464a150)
2017-04-05 16:35:44 -07:00
Jing Zhao e216c15625 HDFS-11395. RequestHedgingProxyProvider#RequestHedgingInvocationHandler hides the Exception thrown from NameNode. Contributed by Nandakumar.
(cherry picked from commit 55796a0946)
(cherry picked from commit e03d8ff488)
2017-04-05 16:29:04 -07:00
Mingliang Liu ba3a726988 HADOOP-14247. FileContextMainOperationsBaseTest should clean up test root path. Contributed by Mingliang Liu
(cherry picked from commit 13c766b62c)
2017-03-29 11:23:46 -07:00
John Zhuge c543c0549d HADOOP-14038. Rename ADLS credential properties. Contributed by John Zhuge.
(cherry picked from commit 253e3e78ab)
2017-03-27 23:08:03 -07:00
Jonathan Eagles ec5a65a0ca Configuration#get return value optimization (jeagles)
(cherry picked from commit e41aac0cd4)
2017-03-27 12:53:42 -05:00
Jonathan Eagles 4e40e9d4db Delay construction of PreCondition.check failure message in Configuration#set (jeagles)
(cherry picked from commit 858d597be0)
2017-03-27 11:06:41 -05:00
Junping Du 7ec1e6e4f0 Add 2.8.0 RELEASENOTEs.md and CHANGES.md.
(cherry picked from commit d8e6d6df4c)
(cherry picked from commit e796105a6f)
2017-03-25 14:35:43 -07:00
Junping Du 86800b30a9 Add COMMON/MAPREDUCE/YARN jdiff of 2.8.0 release.
(cherry picked from commit 6df029db36)
(cherry picked from commit 3ad4d37363)
2017-03-25 14:34:55 -07:00
Andrew Wang 5130128a31 HADOOP-14211. FilterFs and ChRootedFs are too aggressive about enforcing 'authorityNeeded'. Contributed by Erik Krogen.
(cherry picked from commit 0e556a5ba6)
(cherry picked from commit 96fe940e59)
2017-03-24 11:25:58 -07:00
John Zhuge a92f654aa2 HADOOP-14195. CredentialProviderFactory$getProviders is not thread-safe. Contributed by Vihang Karajgaonkar.
(cherry picked from commit 128015584d)
2017-03-23 13:58:11 -07:00
Mingliang Liu 47d3c29e30 HADOOP-14214. DomainSocketWatcher::add()/delete() should not self interrupt while looping await(). Contributed by Mingliang Liu
(cherry picked from commit d35e79abc2)
2017-03-23 13:39:42 -07:00
Zhe Zhang 8ca9915d0f HADOOP-9631. ViewFs should use underlying FileSystem's server side defaults. Contributed by Lohit Vijayarenu and Erik Krogen.
(cherry picked from commit 59d69257a8)
(cherry picked from commit f98f4bb6ca)
2017-03-22 22:32:41 -07:00
John Zhuge 3ed867fef3 HADOOP-13928. TestAdlFileContextMainOperationsLive.testGetFileContext1 runtime error. (John Zhuge via lei)
(cherry picked from commit 15066a3e8ddacd36bf7be9fba0b10c350ae45668)
(cherry picked from commit 00dec84cc2)
2017-03-21 09:14:17 -07:00
John Zhuge 3a8b120c78 HADOOP-14205. No FileSystem for scheme: adl. Contributed by John Zhuge.
(cherry picked from commit 84e2c11f96)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/conf/TestCommonConfigurationFields.java
2017-03-21 08:37:18 -07:00
John Zhuge e792f1671d HDFS-11132. Allow AccessControlException in contract tests when getFileStatus on subdirectory of existing files. Contributed by Vishwajeet Dusane
(cherry picked from commit 19f373a46b)

Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/FileSystemContractBaseTest.java
2017-03-20 21:29:17 -07:00
Erik Krogen c7b6e0dd6e HADOOP-14169. Implement listStatusIterator, listLocatedStatus for ViewFs. Contributed by Erik Krogen.
(cherry picked from commit e1a99802fc)
2017-03-17 17:42:29 -07:00
Mingliang Liu 026ae87236 HADOOP-13946. Document how HDFS updates timestamps in the FS spec; compare with object stores. Contributed by Steve Loughran
(cherry picked from commit fd26783aaf)
2017-03-10 00:22:16 -08:00
Lei Xu 5eaec560d9 HADOOP-13956. Read ADLS credentials from Credential Provider. (John Zhuge via lei)
(cherry picked from commit e015b56319)
(cherry picked from commit 01624f0c1b)
2017-03-09 15:21:32 -08:00
John Zhuge cdfa86cadd Revert "HADOOP-13606 swift FS to add a service load metadata file. Contributed by Steve Loughran"
This reverts commit 53a12fa721.

(cherry picked from commit 98142d2f72)

Change-Id: I3a7613a7f4f0e9c80bb6d3c40a53742f807fc689
2017-03-08 11:47:36 -08:00
Jian He 2e8e51ad40 HADOOP-14062. ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled. Contributed by Steven Rand 2017-03-08 10:49:42 -08:00
Jason Lowe daf3b5ee67 YARN-6274. Documentation refers to incorrect nodemanager health checker interval property. Contributed by WeiWei Yang
(cherry picked from commit 05237636d3)
2017-03-03 08:02:31 -06:00
Brahma Reddy Battula 31bec2c16b HDFS-11432. Federation : Support fully qualified path for Quota/Snapshot/cacheadmin/cryptoadmin commands. Contributed by Brahma Reddy Battula.
(cherry picked from commit dcd03df9f9)
2017-03-01 10:49:36 +05:30
Wei-Chiu Chuang f9c663f45c HADOOP-13508. FsPermission string constructor does not recognize sticky bit. Contributed by Atul Sikaria.
(cherry picked from commit 84ec079911)
2017-02-13 10:47:20 -08:00
Kihwal Lee 6b3443fbf5 HADOOP-14033. Reduce fair call queue lock contention. Contributed by Daryn Sharp.
(cherry picked from commit 0c01cf5798)
2017-02-09 16:20:48 -06:00
Kihwal Lee 47bbe431bf HADOOP-14034. Allow ipc layer exceptions to selectively close connections. Contributed by Daryn Sharp.
(cherry picked from commit d008b55153)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ipc/Server.java
2017-02-09 11:04:29 -06:00
Kihwal Lee bb98856af9 HADOOP-14032. Reduce fair call queue priority inversion. Contributed by Daryn Sharp.
(cherry picked from commit a0bfb41504)
2017-02-09 10:14:18 -06:00
Xiao Chen 04076e783b HADOOP-13433 Race in UGI.reloginFromKeytab. Contributed by Duo Zhang. 2017-02-08 23:52:59 -08:00
Eric Yang e72f485d8c HADOOP-13119. Add ability to secure log servlet using proxy users. Contribute by Yuanbo Liu.
(cherry picked from commit a847903b6e)
2017-01-21 15:49:32 -08:00
Akira Ajisaka b8b8b9a32b HADOOP-14001. Improve delegation token validity checking.
(cherry picked from commit 1763467210)
(cherry picked from commit c6c29d0080)
2017-01-19 17:59:18 +09:00