Andrew Wang
16ad896d5c
Update maven version for 3.0.0-alpha4 development
2017-05-26 14:09:44 -07:00
Steve Loughran
8bf0e2d6b3
HADOOP-14430 the accessTime of FileStatus returned by SFTPFileSystem's
...
getFileStatus method is always 0.
Contributed by Hongyuan Li.
2017-05-25 15:19:58 +01:00
Steve Loughran
1ba9704eec
HADOOP-14399. Configuration does not correctly XInclude absolute file URIs.
...
Contributed by Jonathan Eagles
2017-05-25 14:59:33 +01:00
Akira Ajisaka
6a52b5e144
HADOOP-14180. FileSystem contract tests to replace JUnit 3 with 4. Contributed by Xiaobing Zhou and Mingliang Liu.
2017-05-25 15:36:44 +09:00
Brahma Reddy Battula
dcf4559ebd
HADOOP-14166. Reset the DecayRpcScheduler AvgResponseTime metric to zero when queue is not used. Contributed by Surendra Singh Lilhore.
2017-05-25 01:27:13 +08:00
Brahma Reddy Battula
b7a0c0e701
HADOOP-14449. The ASF Header in ComparableVersion.java and SSLHostnameVerifier.java is not correct. Contributed by ZhangBing Lin.
2017-05-25 01:03:22 +08:00
Kai Zheng
a62be38a5e
HDFS-11793. Allow to enable user defined erasure coding policy. Contributed by Sammi Chen
2017-05-24 18:45:52 +08:00
Brahma Reddy Battula
52661e0912
HDFS-11864. Document Metrics to track usage of memory for writes. Contributed by Yiqun Lin.
2017-05-23 23:52:42 +08:00
Rakesh Radhakrishnan
1b5451bf05
HDFS-11794. Add ec sub command -listCodec to show currently supported ec codecs. Contributed by SammiChen.
2017-05-23 17:03:28 +05:30
Brahma Reddy Battula
2a8fcf0c9a
HDFS-11863. Document missing metrics for blocks count in pending IBR. Contributed By Yiqun Lin.
2017-05-23 02:16:25 +08:00
Sunil G
b6f66b0da1
YARN-6584. Correct license headers in hadoop-common, hdfs, yarn and mapreduce. Contributed by Yeliang Cang.
2017-05-22 14:10:06 +05:30
Mingliang Liu
c80d3bc480
HDFS-11862. Option -v missing for du command in FileSystemShell.md. Contributed by Yiqun Lin
2017-05-21 01:23:35 -07:00
Mingliang Liu
1db186f662
HDFS-11803. Add -v option for du command to show header line. Contributed by Xiaobing Zhou
2017-05-19 14:21:01 -07:00
Chris Douglas
ef9e536a71
HADOOP-14434. Use MoveFileEx to allow renaming a file when the destination exists. Contributed by Lukas Majercak
2017-05-17 17:21:03 -07:00
Mingliang Liu
eb7791b474
HADOOP-14427. Avoid reloading of Configuration in ViewFileSystem creation. Contributed by Vinayakumar B
2017-05-17 13:12:14 -07:00
Akira Ajisaka
d4aa9e3c69
HADOOP-14415. Use java.lang.AssertionError instead of junit.framework.AssertionFailedError. Contributed by Chen Liang.
2017-05-17 15:38:28 -04:00
Rohith Sharma K S
d87a63a901
HADOOP-14412. HostsFileReader#getHostDetails is very expensive on large clusters. Contributed by Jason Lowe.
2017-05-17 08:27:45 +05:30
Jason Lowe
7bc2172248
HADOOP-14376. Memory leak when reading a compressed file using the native library. Contributed by Eli Acherkan
2017-05-12 16:54:08 -05:00
Akira Ajisaka
a9e24a13b7
HADOOP-14375. Remove tomcat support from hadoop-functions.sh. Contributed by John Zhuge.
2017-05-12 08:48:51 -05:00
Akira Ajisaka
0d5c8ed8e0
HADOOP-14401. maven-project-info-reports-plugin can be removed. Contributed by Andras Bokor.
2017-05-11 16:37:32 -05:00
Daniel Templeton
09f28da2d2
HADOOP-14413. Add Javadoc comment for jitter parameter on CachingGetSpaceUsed
...
(Contributed by Erik Krogen via Daniel Templeton)
2017-05-11 12:06:06 -07:00
Brahma Reddy Battula
4aae2d40a3
HADOOP-14410. Correct spelling of 'beginning' and variants. Contributed By Dongtao Zhang
2017-05-11 23:33:45 +05:30
Mingliang Liu
3873904a94
HDFS-11800. Document output of 'hdfs count -u' should contain PATHNAME. Contributed by Xiaobing Zhou
2017-05-10 14:33:33 -07:00
Akira Ajisaka
a5fa954684
HADOOP-14373. License error in org.apache.hadoop.metrics2.util.Servers. Contributed by hu xiaodong.
2017-05-10 05:29:47 -05:00
Masatake Iwasaki
06ffeb8d4d
HADOOP-14405. Fix performance regression due to incorrect use of DataChecksum. Contributed by LiXin Ge.
2017-05-10 14:16:41 +09:00
Jason Lowe
f7faac8e90
HADOOP-14377. Increase Common test timeouts from 1 second to 10 seconds. Contributed by Eric Badger
2017-05-09 16:08:34 -05:00
Chris Douglas
45382bf047
AuditLogger and TestAuditLogger are dead code. Contributed by Vrushali C
2017-05-09 10:31:52 -07:00
Lei Xu
149b903be3
HADOOP-14384. Reduce the visibility of FileSystem.newFSDataOutputStreamBuilder before the API becomes stable. (lei)
2017-05-09 10:27:17 -07:00
Andrew Wang
543aac9f28
HADOOP-14386. Rewind trunk from Guava 21.0 back to Guava 11.0.2.
2017-05-09 09:22:53 -07:00
Andrew Wang
54fd0e44b7
HDFS-11644. Support for querying outputstream capabilities. Contributed by Manoj Govindassamy.
2017-05-08 21:59:49 -07:00
Haohui Mai
ff5ec3b841
HADOOP-14383. Implement FileSystem that reads from HTTP / HTTPS endpoints.
2017-05-08 15:28:45 -07:00
Chris Douglas
e4f34ecb04
HADOOP-14390. Correct spelling of 'succeed' and variants. Contributed by Dongtao Zhang
2017-05-05 12:10:50 -07:00
Steve Loughran
4e6bbd049d
HADOOP-14382 Remove usages of MoreObjects.toStringHelper.
...
Contributed by Andrew Wang
2017-05-05 13:03:09 +01:00
Andrew Wang
c2a52ef9c2
HDFS-11643. Add shouldReplicate option to create builder. Contributed by SammiChen.
2017-05-04 11:39:14 -07:00
Arpit Agarwal
81092b1f11
HDFS-11722. Change Datanode file IO profiling sampling to percentage. Contributed by Hanisha Koneru.
2017-05-03 16:29:30 -07:00
Arpit Agarwal
30cd265134
Revert "HDFS-11488. JN log segment syncing should support HA upgrade. Contributed by Hanisha Koneru."
...
This reverts commit 08fb82d6d1
.
2017-05-03 16:28:47 -07:00
Arpit Agarwal
08fb82d6d1
HDFS-11488. JN log segment syncing should support HA upgrade. Contributed by Hanisha Koneru.
2017-05-03 15:46:08 -07:00
Mingliang Liu
83dded556d
HDFS-11739. Fix regression in tests caused by YARN-679. Contributed by Steve Loughran
2017-05-03 11:22:44 -07:00
Kihwal Lee
d4631e466b
HADOOP-14372. TestSymlinkLocalFS timeouts are too low. Contributed by Eric Badger.
2017-05-03 09:47:17 -05:00
Robert Kanter
8b82317fab
HADOOP-14352. Make some HttpServer2 SSL properties optional (jzhuge via rkanter)
2017-05-02 17:51:28 -07:00
Jason Lowe
cedaf4cab9
HADOOP-14306. TestLocalFileSystem tests have very low timeouts. Contributed by Eric Badger
2017-05-02 16:50:51 -05:00
Andrew Wang
dcc292d7de
HADOOP-14369. NetworkTopology calls expensive toString() when logging. Contributed by Inigo Goiri.
2017-05-02 10:51:20 -07:00
Akira Ajisaka
20cde55274
HADOOP-14371. License error in TestLoadBalancingKMSClientProvider.java. Contributed by hu xiaodong.
2017-05-02 23:36:54 +09:00
Akira Ajisaka
b7d769d020
HADOOP-14359. Remove unnecessary shading of commons-httpclient. Contributed by Wei-Chiu Chuang.
2017-05-01 15:22:28 +09:00
Mingliang Liu
c735362df7
HADOOP-14363. Inconsistent default block location in FileSystem javadoc. Contributed by Chen Liang
2017-04-29 23:49:36 -07:00
Eric Payne
6fe11f6155
HADOOP-14320. TestIPC.testIpcWithReaderQueuing fails intermittently. Contributed by Eric Badger.
2017-04-28 14:45:26 -05:00
Junping Du
373bb4931f
YARN-679. Add an entry point that can start any Yarn service. Contributed by Steve Loughran.
2017-04-28 10:45:02 -07:00
Kai Zheng
cb672a45a0
HDFS-11605. Allow user to customize new erasure code policies. Contributed by Huafeng Wang
2017-04-28 13:18:50 +08:00
Chris Douglas
689fb2fc66
HADOOP-14354. SysInfoWindows is not thread safe. Contributed by Inigo Goiri
2017-04-27 16:26:39 -07:00
Chris Douglas
31cf480d65
HADOOP-14309. Add PowerShell NodeFencer. Contributed by Inigo Goiri
2017-04-27 16:09:28 -07:00
Wei-Chiu Chuang
bbf8cac14d
HADOOP-13200. Implement customizable and configurable erasure coders. Contributed by Tim Yao.
2017-04-27 12:39:47 -07:00
Wei-Chiu Chuang
ddaeb3e497
Revert "HADOOP-13200. Implement customizable and configurable erasure coders. Contributed by Tim Yao."
...
This reverts commit 872088c6e7
.
2017-04-27 12:25:47 -07:00
Wei-Chiu Chuang
872088c6e7
HADOOP-13200. Implement customizable and configurable erasure coders. Contributed by Tim Yao.
2017-04-27 11:59:33 -07:00
Steve Loughran
61cda39e4e
HADOOP-14346. CryptoOutputStream throws IOException if stream is closed.
...
Contributed by Pierre Lacave
(cherry picked from commit 40b9c30d64
)
2017-04-27 12:19:04 +01:00
John Zhuge
edd693833b
HADOOP-14340. Enable KMS and HttpFS to exclude SSL ciphers. Contributed by John Zhuge.
2017-04-26 11:44:59 -07:00
John Zhuge
9ccb849eb6
HADOOP-14341. Support multi-line value for ssl.server.exclude.cipher.list. Contributed by John Zhuge.
2017-04-25 22:06:51 -07:00
Xiaoyu Yao
4ea2778acb
HADOOP-14207. "dfsadmin -refreshCallQueue" fails with DecayRpcScheduler. Contributed by Surendra Singh Lihore.
2017-04-25 18:45:56 -07:00
Mingliang Liu
d11d280b8b
HADOOP-12856. FileUtil.checkDest() and RawLocalFileSystem.mkdirs() to throw stricter IOEs; RawLocalFS contract tests to verify. Contributed by Steve Loughran
2017-04-25 18:33:41 -07:00
Andrew Wang
a22fe02fba
HADOOP-14261. Some refactoring work for erasure coding raw coder. Contributed by Lin Zeng.
2017-04-21 11:35:36 -07:00
Mingliang Liu
667966c13c
HADOOP-14324. Refine S3 server-side-encryption key as encryption secret; improve error reporting and diagnostics. Contributed by Steve Loughran
2017-04-20 17:13:36 -07:00
Daniel Templeton
f356f0f4cf
YARN-6453. fairscheduler-statedump.log gets generated regardless of service
...
(Contributed by Yufei Gu via Daniel Templeton)
2017-04-20 14:13:07 -07:00
John Zhuge
0344bea3fd
HADOOP-14241. Add ADLS sensitive config keys to default list. Contributed by John Zhuge.
2017-04-19 11:50:54 -07:00
Daniel Templeton
d4483a2fe4
HADOOP-13997. Typo in metrics docs (Contributed by Ana Krasteva via Daniel Templeton)
2017-04-19 09:41:09 -07:00
John Zhuge
a9f07e0d3e
HADOOP-14317. KMSWebServer$deprecateEnv may leak secret. Contributed by John Zhuge.
2017-04-18 09:29:16 -07:00
Kengo Seki
654372db85
HADOOP-14315. Python example in the rack awareness document doesn't work due to bad indentation
...
This closes #214
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2017-04-18 17:14:22 +09:00
Akira Ajisaka
84a8848aae
HADOOP-14318. Remove non-existent setfattr command option from FileSystemShell.md. Contributed by Doris Gu.
2017-04-18 16:43:50 +09:00
Andrew Wang
c0ca785dbb
HDFS-11652. Improve ECSchema and ErasureCodingPolicy toString, hashCode, equals.
2017-04-17 16:30:25 -07:00
Mingliang Liu
b053fdc547
HADOOP-14255. S3A to delete unnecessary fake directory objects in mkdirs(). Contributed by Mingliang Liu
2017-04-12 14:30:34 -07:00
Daniel Templeton
4dd6206547
HADOOP-14246. Authentication Tokens should use SecureRandom instead of Random and 256 bit secrets
...
(Conttributed by Robert Konter via Daniel Templeton)
2017-04-12 11:17:31 -07:00
Chris Nauroth
b8305e6d06
HADOOP-14248. Retire SharedInstanceProfileCredentialsProvider in trunk. Contributed by Mingliang Liu.
2017-04-12 10:02:13 -07:00
Chris Nauroth
23b1a7bdf1
HDFS-11163. Mover should move the file blocks to default storage once policy is unset. Contributed by Surendra Singh Lilhore.
2017-04-11 22:03:09 -07:00
Wei-Chiu Chuang
f050afb578
HADOOP-13665. Erasure Coding codec should support fallback coder. Contributed by Kai Sasaki.
2017-04-11 07:32:13 -07:00
Jason Lowe
0e065f2ede
YARN-6195. Export UsedCapacity and AbsoluteUsedCapacity to JMX. Contributed by Benson Qiu
2017-04-11 08:44:18 -05:00
Chris Douglas
a5e57df3c5
HADOOP-14225. Remove xmlenc dependency
2017-04-10 11:48:40 -07:00
Andrew Wang
be144117a8
HADOOP-14293. Initialize FakeTimer with a less trivial value.
2017-04-10 11:37:01 -07:00
Steve Loughran
2ed65540a3
HADOOP-14066 VersionInfo should be marked as public API
2017-04-08 13:41:10 +01:00
John Zhuge
56e81f2a20
HADOOP-14174. Set default ADLS access token provider type to ClientCredential. Contributed by John Zhuge.
...
Signed-off-by: John Zhuge <jzhuge@apache.org>
2017-04-07 12:04:44 -07:00
Allen Wittenauer
96cbb4fce2
HADOOP-14202. fix jsvc/secure user var inconsistencies
...
Signed-off-by: John Zhuge <jzhuge@apache.org>
2017-04-07 08:59:21 -07:00
Zhe Zhang
95b7f1d29a
HADOOP-14276. Add a nanosecond API to Time/Timer/FakeTimer. Contributed by Erik Krogen.
2017-04-06 16:59:21 -07:00
Xiaoyu Yao
32bb36b750
HDFS-11302. Improve Logging for SSLHostnameVerifier. Contributed by Chen Liang.
2017-04-05 17:28:00 -07:00
Andrew Wang
18432130a7
HADOOP-14104. Client should always ask namenode for kms provider path. Contributed by Rushabh S Shah.
2017-04-04 13:38:25 -07:00
Chris Douglas
6eba79232f
HADOOP-14271. Correct spelling of 'occurred' and variants. Contributed by Yeliang Cang
2017-04-03 20:13:14 -07:00
Wei-Chiu Chuang
bbd68478d5
HDFS-11598. Improve -setrep for Erasure Coded files. Contributed by Yiqun Lin.
2017-04-03 07:57:28 -07:00
Jonathan Eagles
1309c585fb
HADOOP-14216. Addendum to Improve Configuration XML Parsing Performance (jeagles)
2017-03-30 14:14:43 -05:00
Wei-Chiu Chuang
8c591b8d19
HDFS-10974. Document replication factor for EC files. Contributed by Yiqun Lin.
2017-03-30 11:16:05 -07:00
Chris Douglas
7297e82cb4
HADOOP-14250. Correct spelling of 'separate' and variants. Contributed by Doris Gu
2017-03-30 10:17:11 -07:00
Andrew Wang
4966a6e26e
HADOOP-14223. Extend FileStatus#toString() to include details like Erasure Coding and Encryption. Contributed by Manoj Govindassamy.
2017-03-29 14:37:21 -07:00
Mingliang Liu
13c766b62c
HADOOP-14247. FileContextMainOperationsBaseTest should clean up test root path. Contributed by Mingliang Liu
2017-03-29 11:13:39 -07:00
Jonathan Eagles
523f467d93
HADOOP-14216. Improve Configuration XML Parsing Performance (jeagles)
2017-03-29 10:12:02 -05:00
Yiqun Lin
6b09336438
HDFS-11577. Combine the old and the new chooseRandom for better performance. Contributed by Chen Liang.
2017-03-28 23:02:07 +08:00
John Zhuge
253e3e78ab
HADOOP-14038. Rename ADLS credential properties. Contributed by John Zhuge.
2017-03-27 23:05:57 -07:00
Akira Ajisaka
448ec81fd7
HADOOP-14218. Replace assertThat with assertTrue in MetricsAsserts.
2017-03-28 14:32:40 +09:00
Jonathan Eagles
db2adf356a
Configuration#get return value optimization (jeagles)
2017-03-27 12:48:44 -05:00
Jonathan Eagles
858d597be0
Delay construction of PreCondition.check failure message in Configuration#set (jeagles)
2017-03-27 11:01:48 -05:00
Junping Du
6df029db36
Add COMMON/MAPREDUCE/YARN jdiff of 2.8.0 release.
2017-03-25 14:28:48 -07:00
Junping Du
d8e6d6df4c
Add 2.8.0 RELEASENOTEs.md and CHANGES.md.
2017-03-25 14:02:25 -07:00
Tsuyoshi Ozawa
84ddedc0b2
HADOOP-10101. Update guava dependency to the latest version. (ozawa)
2017-03-25 10:06:52 +09:00
Andrew Wang
332a997e10
HDFS-11170. Add builder-based create API to FileSystem. Contributed by SammiChen and Wei Zhou.
2017-03-24 12:56:46 -07:00
Andrew Wang
52b00600df
HADOOP-13715. Add isErasureCoded() API to FileStatus class. Contributed by Manoj Govindassamy.
2017-03-24 11:44:46 -07:00
Daniel Templeton
d49d1862a6
YARN-6360. Prevent FS state dump logger from cramming other log files
...
(Contributed by Yufei Gu via Daniel Templeton)
2017-03-24 11:31:04 -07:00
Andrew Wang
0e556a5ba6
HADOOP-14211. FilterFs and ChRootedFs are too aggressive about enforcing 'authorityNeeded'. Contributed by Erik Krogen.
2017-03-24 11:12:02 -07:00
John Zhuge
ab759e91b7
HDFS-10649. Remove unused PermissionStatus#applyUMask. Contributed by Chen Liang.
2017-03-23 23:31:27 -07:00
John Zhuge
128015584d
HADOOP-14195. CredentialProviderFactory$getProviders is not thread-safe. Contributed by Vihang Karajgaonkar.
2017-03-23 13:57:08 -07:00
Mingliang Liu
d35e79abc2
HADOOP-14214. DomainSocketWatcher::add()/delete() should not self interrupt while looping await(). Contributed by Mingliang Liu
2017-03-23 13:34:03 -07:00
Ravi Prakash
595f62e362
HADOOP-14213. Move Configuration runtime check for hadoop-site.xml to initialization. Contributed by Jonathan Eagles
2017-03-23 09:28:10 -07:00
Zhe Zhang
59d69257a8
HADOOP-9631. ViewFs should use underlying FileSystem's server side defaults. Contributed by Lohit Vijayarenu and Erik Krogen.
2017-03-22 22:22:22 -07:00
Erik Krogen
e1a99802fc
HADOOP-14169. Implement listStatusIterator, listLocatedStatus for ViewFs. Contributed by Erik Krogen.
2017-03-17 17:12:49 -07:00
Andrew Wang
92ea6d74ec
HDFS-11516. Admin command line should print message to stderr in failure case. Contributed by Kai Sasaki.
2017-03-17 11:26:02 -07:00
Mingliang Liu
c04fb35c45
HADOOP-14191. Duplicate hadoop-minikdc dependency in hadoop-common module. Contributed by Xiaobing Zhou
2017-03-16 16:08:32 -07:00
Jitendra Pandey
09ad8effb8
HDFS-11533. reuseAddress option should be used for child channels in Portmap and SimpleTcpServer. Contributed by Mukul Kumar Singh.
2017-03-16 12:20:46 -07:00
Mingliang Liu
fa67a96d7b
HADOOP-14170. FileSystemContractBaseTest is not cleaning up test directory clearly. Contributed by Mingliang Liu
2017-03-14 14:38:21 -07:00
Mingliang Liu
e6cda5819b
Revert "HADOOP-14170. FileSystemContractBaseTest is not cleaning up test directory clearly. Contributed by Mingliang Liu"
...
This reverts commit b8c69557b7
.
2017-03-14 13:03:42 -07:00
Chen Liang
9832ae0ed8
HDFS-11482. Add storage type demand to into DFSNetworkTopology#chooseRandom. Contributed by Chen Liang.
2017-03-13 17:30:10 -07:00
Jing Zhao
55796a0946
HDFS-11395. RequestHedgingProxyProvider#RequestHedgingInvocationHandler hides the Exception thrown from NameNode. Contributed by Nandakumar.
2017-03-13 14:24:51 -07:00
Mingliang Liu
b8c69557b7
HADOOP-14170. FileSystemContractBaseTest is not cleaning up test directory clearly. Contributed by Mingliang Liu
2017-03-13 14:15:02 -07:00
Andrey Dyatlov
04a5f5a6dc
HADOOP-14156. Fix grammar error in ConfTest.java.
...
This closes #187
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2017-03-13 16:15:53 +09:00
Ray Chiang
4db9cc70d0
YARN-6042. Dump scheduler and queue state information into FairScheduler DEBUG log. (Yufei Gu via rchiang)
2017-03-10 16:13:31 -08:00
Jian He
4478273e5f
HADOOP-14062. ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled. Contributed by Steven Rand
2017-03-10 09:25:58 -08:00
Mingliang Liu
fd26783aaf
HADOOP-13946. Document how HDFS updates timestamps in the FS spec; compare with object stores. Contributed by Steve Loughran
2017-03-10 00:21:20 -08:00
John Zhuge
570827a819
HADOOP-14052. Fix dead link in KMS document. Contributed by Christina Vu.
...
Change-Id: I7093f443d93927184196f62f02cc106a2c89e9cf
2017-03-08 23:50:15 -08:00
Jian He
2be8947d12
Revert "HADOOP-14062. ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled. Contributed by Steven Rand"
...
This reverts commit 241c1cc05b
.
2017-03-08 13:20:01 -08:00
Jian He
241c1cc05b
HADOOP-14062. ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled. Contributed by Steven Rand
2017-03-08 10:48:27 -08:00
John Zhuge
98142d2f72
Revert "HADOOP-13606 swift FS to add a service load metadata file. Contributed by Steve Loughran"
...
This reverts commit 53a12fa721
.
2017-03-08 09:54:22 -08:00
Arpit Agarwal
1f9848dfe1
HDFS-11508. Fix bind failure in SimpleTCPServer & Portmap where bind fails because socket is in TIME_WAIT state. Contributed by Mukul Kumar Singh.
2017-03-07 11:41:05 -08:00
Arpit Agarwal
959940b0ab
HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru.
2017-03-07 10:12:35 -08:00
Mingliang Liu
686823529b
HADOOP-13930. Azure: Add Authorization support to WASB. Contributed by Sivaguru Sankaridurg and Dushyanth
2017-03-06 17:16:36 -08:00
Mingliang Liu
52d7d5aa1a
Revert "HADOOP-13930. Azure: Add Authorization support to WASB. Contributed by Sivaguru Sankaridurg and Dushyanth"
...
This reverts commit 6b7cd62b8c
.
2017-03-06 17:10:11 -08:00
Ray Chiang
d9dc444dc7
YARN-5665. Enhance documentation for yarn.resourcemanager.scheduler.class property. (Yufei Gu via rchiang)
2017-03-06 14:02:49 -08:00
Andrew Wang
ec839b94c0
HDFS-11441. Add escaping to error message in KMS web UI. Contributed by Aaron T. Myers.
2017-03-06 10:47:15 -08:00
Akira Ajisaka
209ecd1a5c
HADOOP-14108. CLI MiniCluster: add an option to specify NameNode HTTP port. Contributed by Takanobu Asanuma.
2017-03-07 01:34:51 +09:00
Mingliang Liu
6b7cd62b8c
HADOOP-13930. Azure: Add Authorization support to WASB. Contributed by Sivaguru Sankaridurg and Dushyanth
2017-03-03 17:09:12 -08:00
Jason Lowe
05237636d3
YARN-6274. Documentation refers to incorrect nodemanager health checker interval property. Contributed by WeiWei Yang
2017-03-03 07:57:37 -06:00
Harsh J
eb5a17954a
HADOOP-6801. io.sort.mb and io.sort.factor were renamed and moved to mapreduce but are still in CommonConfigurationKeysPublic.java and used in SequenceFile.java.
...
This closes #146
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2017-03-03 18:38:04 +09:00
Rakesh Radhakrishnan
3749152b66
HDFS-11416. Refactor out system default erasure coding policy. Contributed by Andrew Wang.
2017-03-03 09:28:03 +05:30
Andrew Wang
8f4817f2c5
Revert "HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru."
...
This reverts commit e61491d476
.
2017-03-02 16:20:48 -08:00
Arpit Agarwal
e61491d476
HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru.
2017-03-02 15:38:25 -08:00
Arpit Agarwal
eeca8b0c4e
HDFS-11419. HDFS specific network topology classes with storage type info included. Contributed by Chen Liang.
2017-03-02 09:21:27 -08:00
Arpit Agarwal
899d5c4d49
HDFS-11479. Socket re-use address option should be used in SimpleUdpServer. Contributed by Mukul Kumar Singh.
2017-03-01 12:59:02 -08:00
Brahma Reddy Battula
dcd03df9f9
HDFS-11432. Federation : Support fully qualified path for Quota/Snapshot/cacheadmin/cryptoadmin commands. Contributed by Brahma Reddy Battula.
2017-03-01 10:45:56 +05:30
Akira Ajisaka
258342e76c
HADOOP-14118. move jets3t into a dependency on hadoop-aws JAR.
2017-02-28 13:47:44 +09:00
Yiqun Lin
9db2e0c8d4
HADOOP-14119. Remove unused imports from GzipCodec.java. Contributed by Yiqun Lin.
2017-02-27 18:39:14 +08:00
Xuan
289bc50e66
HADOOP-14116:FailoverOnNetworkExceptionRetry does not wait when failover
...
on certain exception. Contributed by Jian He
2017-02-24 11:42:23 -08:00
Andrew Wang
c1a52b04d0
HDFS-11427. Rename rs-default to rs.
2017-02-24 10:58:45 -08:00
Harsh J
e8694deb6a
HADOOP-13817. Add a finite shell command timeout to ShellBasedUnixGroupsMapping. (harsh)
2017-02-24 21:34:00 +05:30
Akira Ajisaka
50decd3613
HADOOP-14097. Remove Java6 specific code from GzipCodec.java. Contributed by Elek, Marton.
2017-02-25 00:28:31 +09:00
Andrew Wang
132f758e3d
HDFS-11426. Refactor EC CLI to be similar to storage policies CLI.
2017-02-23 16:00:11 -08:00
Mingliang Liu
a4d4a23785
HADOOP-13321. Deprecate FileSystem APIs that promote inefficient call patterns. Contributed by Chris Nauroth and Mingliang Liu
2017-02-23 12:55:40 -08:00
Mingliang Liu
003ae00693
HDFS-11430. Separate class InnerNode from class NetworkTopology and make it extendable. Contributed by Tsz Wo Nicholas Sze
2017-02-21 15:32:46 -08:00
Eric Yang
172b23af33
HADOOP-14077. Add ability to access jmx via proxy. Contributed by Yuanbo Liu.
2017-02-18 18:34:13 -08:00
Yongjun Zhang
4c26c241ad
HADOOP-13805. UGI.getCurrentUser() fails if user does not have a keytab associated. Contributed by Xiao Chen, Wei-Chiu Chuang, Yongjun Zhang.
2017-02-17 09:18:50 -08:00
Wei-Chiu Chuang
5690b51ef7
HDFS-11100. Recursively deleting file protected by sticky bit should fail. Contributed by John Zhuge.
2017-02-16 05:39:37 -08:00
Wei-Chiu Chuang
cc45da79fd
HADOOP-13233. help of stat is confusing. Contributed by Attila Bukor.
2017-02-13 10:14:45 -08:00
Arpit Agarwal
0aacd8fd25
HDFS-11403. Zookeper ACLs on NN HA enabled clusters should be handled consistently. Contributed by Hanisha Koneru.
2017-02-11 01:17:56 -08:00
Kihwal Lee
0c01cf5798
HADOOP-14033. Reduce fair call queue lock contention. Contributed by Daryn Sharp.
2017-02-09 16:17:24 -06:00
Kihwal Lee
b6bb99c18a
HADOOP-14034. Allow ipc layer exceptions to selectively close connections. Contributed by Daryn Sharp.
2017-02-09 10:47:29 -06:00
Kihwal Lee
a0bfb41504
HADOOP-14032. Reduce fair call queue priority inversion. Contributed by Daryn Sharp.
2017-02-09 10:04:28 -06:00
Junping Du
eec52e158b
YARN-6145. Improve log message on fail over. Contributed by Jian He.
2017-02-08 02:11:19 -08:00
Xiao Chen
2007e0cf2a
HDFS-11210. Enhance key rolling to guarantee new KeyVersion is returned from generateEncryptedKeys after a key is rolled.
2017-02-07 20:36:11 -08:00
Xiao Chen
69b23632c4
HDFS-10860. Switch HttpFS from Tomcat to Jetty. Contributed by John Zhuge.
2017-02-07 09:36:55 -08:00
Xiao Chen
d88497d44a
HADOOP-14047. Require admin to access KMS instrumentation servlets. Contributed by John Zhuge.
2017-02-06 13:14:17 -08:00
Junping Du
cce35c3815
HADOOP-12097. Allow port range to be specified while starting webapp. Contributed by Varun Saxena.
2017-02-05 19:42:11 -08:00
Yiqun Lin
3ea6d3517e
HDFS-11371. Document missing metrics of erasure coding. Contributed by Yiqun Lin.
2017-02-04 11:01:27 +08:00
Akira Ajisaka
cb8f3f3adf
HADOOP-14053. Update the link to HTrace SpanReceivers. Contributed by Yiqun Lin.
2017-02-04 10:58:08 +09:00
Xiao Chen
ba75bc7593
HADOOP-14044. Synchronization issue in delegation token cancel functionality. Contributed by Hrishikesh Gadre.
2017-02-03 17:13:53 -08:00
Chris Douglas
59c5f18784
HADOOP-13895. Make FileStatus Serializable
2017-02-01 10:19:36 -08:00
Xiao Chen
ebd40056a0
HADOOP-13992. KMS should load SSL configuration the same way as SSLFactory. Contributed by John Zhuge.
2017-01-27 10:49:26 -08:00
Xiaoyu Yao
2034315763
HADOOP-14029. Fix KMSClientProvider for non-secure proxyuser use case. Contributed by Xiaoyu Yao.
2017-01-26 20:34:32 -08:00
Andrew Wang
ff02bdfe65
Add CHANGES, RELEASENOTES, and jdiff for 3.0.0-alpha2 release.
2017-01-25 15:39:40 -08:00
Jason Lowe
9e19f758c1
YARN-5641. Localizer leaves behind tarballs after container is complete. Contributed by Eric Badger
2017-01-25 21:41:43 +00:00
Xiaoyu Yao
a46933e8ce
HADOOP-13988. KMSClientProvider does not work with WebHDFS and Apache Knox w/ProxyUser. Contributed by Greg Senia and Xiaoyu Yao.
2017-01-25 13:33:06 -08:00
Steve Loughran
7fc3e68a87
HADOOP-13433 Race in UGI.reloginFromKeytab. Contributed by Duo Zhang.
2017-01-25 21:29:27 +00:00
Xiao Chen
9c0a4d3e71
HADOOP-13990. Document KMS usage of CredentialProvider API. Contributed by John Zhuge.
2017-01-24 21:30:10 -08:00
Arpit Agarwal
b57368b6f8
HDFS-11194. Maintain aggregated peer performance metrics on NameNode.
2017-01-24 16:58:20 -08:00
Eric Yang
a847903b6e
HADOOP-13119. Add ability to secure log servlet using proxy users. Contribute by Yuanbo Liu.
2017-01-21 15:43:18 -08:00
Lei Xu
e015b56319
HADOOP-13956. Read ADLS credentials from Credential Provider. (John Zhuge via lei)
2017-01-20 14:48:04 +08:00
Andrew Wang
5d8b80ea9b
Preparing for 3.0.0-alpha3 development
2017-01-19 15:50:07 -08:00
Daniel Templeton
f5839fd6df
YARN-6028. Add document for container metrics (Contributed by Weiwei Yang via Daniel Templeton)
2017-01-19 12:45:17 -08:00
Akira Ajisaka
1763467210
HADOOP-14001. Improve delegation token validity checking.
2017-01-19 17:56:39 +09:00
Yiqun Lin
383aa9c9f5
HADOOP-13965. Groups should be consistent in using default group mapping class. Contributed by Yiqun Lin.
2017-01-19 09:42:56 +08:00
Allen Wittenauer
0eb4b513b7
HADOOP-13673. Update scripts to be smarter when running with privilege
...
Signed-off-by: Andrew Wang <wang@apache.org>
Signed-off-by: Ravi Prakash <raviprak@apache.org>
2017-01-18 14:39:05 -08:00
Akira Ajisaka
9130af3f74
HADOOP-13955. Replace deprecated HttpServer2 and SSLFactory constants. Contributed by John Zhuge.
2017-01-18 18:11:33 +09:00
Kihwal Lee
706d630eb9
HADOOP-13976. Path globbing does not match newlines. Contributed by Eric Badger.
2017-01-17 15:10:24 -06:00
Akira Ajisaka
e407449ddb
HADOOP-13933. Add haadmin -getAllServiceState option to get the HA state of all the NameNodes/ResourceManagers. Contributed by Surendra Singh Lilhore.
2017-01-17 10:10:23 +09:00
Jitendra Pandey
d1d0b3e1fd
HDFS-11307. The rpc to portmap service for NFS has hardcoded timeout. Contributed by Mukul Kumar Singh.
2017-01-16 14:53:53 -08:00
Lei Xu
ed09c1418d
HADOOP-13928. TestAdlFileContextMainOperationsLive.testGetFileContext1 runtime error. (John Zhuge via lei)
2017-01-15 14:02:11 +08:00
Andrew Wang
5f336512d0
HADOOP-13961. Fix compilation failure from missing hadoop-kms test jar. Contributed by Sangjin Lee and John Zhuge.
2017-01-11 15:48:50 -08:00
Steve Loughran
e648b6e138
HADOOP-13336 S3A to support per-bucket configuration. Contributed by Steve Loughran
2017-01-11 17:25:15 +00:00
Arun Suresh
be529dade1
HADOOP-13903. Improvements to KMS logging to help debug authorization errors. (Tristan Stevens via asuresh)
2017-01-11 00:26:02 -08:00
Arpit Agarwal
4046794a53
HDFS-11299. Support multiple Datanode File IO hooks. Contributed by Hanisha Koneru.
2017-01-10 10:43:11 -08:00
Andrew Wang
511d39e074
HADOOP-13885. Implement getLinkTarget for ViewFileSystem. Contributed by Manoj Govindassamy.
2017-01-09 18:01:37 -08:00
Wei-Chiu Chuang
0a212a40fc
HADOOP-13953. Make FTPFileSystem's data connection mode and transfer mode configurable. Contributed by Xiao Chen.
2017-01-09 15:18:26 -08:00
Arpit Agarwal
4a659ff40f
HDFS-11282. Document the missing metrics of DataNode Volume IO operations. Contributed by Yiqun Lin.
2017-01-05 19:34:32 -08:00
Xiao Chen
5d182949ba
HADOOP-13597. Switch KMS from Tomcat to Jetty. Contributed by John Zhuge.
2017-01-05 17:21:57 -08:00
Jason Lowe
a0a2761621
HADOOP-13578. Add Codec for ZStandard Compression. Contributed by churro morales
2017-01-04 14:46:25 +00:00
Akira Ajisaka
01d31fe938
HADOOP-12733. Remove references to obsolete io.seqfile configuration variables. Contributed by Ray Chiang.
2017-01-04 14:10:36 +09:00
Mingliang Liu
88731c731a
Revert "HADOOP-13946. Document how HDFS updates timestamps in the FS spec; compare with object stores. Contributed by Steve Loughran"
...
This reverts commit 451efb08fe
.
2017-01-03 14:44:26 -08:00
Mingliang Liu
451efb08fe
HADOOP-13946. Document how HDFS updates timestamps in the FS spec; compare with object stores. Contributed by Steve Loughran
2017-01-03 13:08:38 -08:00
Robert Kanter
591fb15944
YARN-5529. Create new DiskValidator class with metrics (yufeigu via rkanter)
2017-01-03 12:13:32 -08:00
Brahma Reddy Battula
6938b67711
HADOOP-13883. Addendum patch to correct the message and alphabetized with the earlier patch. Contributed by Yiqun Lin.
2016-12-31 16:16:02 +05:30
Akira Ajisaka
0665c5f09a
HADOOP-13943. TestCommonConfigurationFields#testCompareXmlAgainstConfigurationClass fails after HADOOP-13863. Contributed by Brahma Reddy Battula.
2016-12-28 01:39:30 +09:00
Daniel Templeton
ded2d08f33
HADOOP-13940. Document the missing envvars commands (Contributed by Yiqun Lin via Daniel Templeton)
2016-12-27 07:18:08 -08:00
Xiaoyu Yao
4e9029653d
HDFS-10917. Collect peer performance statistics on DataNode. Contributed by Xiaobing Zhou.
2016-12-22 23:46:58 -08:00
Mingliang Liu
e92a77099b
HADOOP-13863. Azure: Add a new SAS key mode for WASB. Contributed by Dushyanth
2016-12-22 20:15:18 -08:00
Akira Ajisaka
22befbd585
MAPREDUCE-6704. Update the documents to run MapReduce application. Contributed by Bibin A Chundatt.
2016-12-23 04:48:04 +09:00
Kai Zheng
56a13a6a59
HDFS-11216. Add remoteBytesRead counter metrics for erasure coding reconstruction task. Contributed by Sammi Chen
2016-12-22 14:18:54 +08:00
Akira Ajisaka
f6e2521eb2
HDFS-11261. Document missing NameNode metrics. Contributed by Yiqun Lin.
2016-12-21 14:17:47 +09:00
Xiao Chen
30f85d7a88
HADOOP-13911. Remove TRUSTSTORE_PASSWORD related scripts from KMS. Contributed by John Zhuge.
2016-12-20 16:02:26 -08:00
Jason Lowe
631f1daee3
HADOOP-13709. Ability to clean up subprocesses spawned by Shell when the process exits. Contributed by Eric Badger
2016-12-15 20:52:40 +00:00
Jason Lowe
169bfc0903
Revert "HADOOP-13709. Ability to clean up subprocesses spawned by Shell when the process exits. Contributed by Eric Badger"
...
This reverts commit 9947aeb60c
.
2016-12-15 20:51:24 +00:00
Xiaoyu Yao
f5e0bd30fd
HADOOP-13890. Maintain HTTP/host as SPNEGO SPN support and fix KerberosName parsing. Contributed by Xiaoyu Yao.
2016-12-14 13:45:21 -08:00
Arpit Agarwal
6ba9587d37
HDFS-10958. Add instrumentation hooks around Datanode disk IO.
2016-12-14 11:18:58 -08:00
Akira Ajisaka
72bff192cd
HDFS-11204. Document the missing options of hdfs zkfc command. Contributed by Yiqun Lin.
2016-12-14 18:50:43 +09:00
Jason Lowe
9947aeb60c
HADOOP-13709. Ability to clean up subprocesses spawned by Shell when the process exits. Contributed by Eric Badger
2016-12-13 22:55:09 +00:00
Steve Loughran
f66f61892a
HADOOP-13852 hadoop build to allow hadoop version property to be explicitly set. Contriibuted by Steve Loughran
2016-12-12 13:58:27 +00:00
Xiaoyu Yao
4c38f11cec
HADOOP-13565. KerberosAuthenticationHandler#authenticate should not rebuild SPN based on client request. Contributed by Xiaoyu Yao.
2016-12-09 21:27:04 -08:00
Wei-Chiu Chuang
b606e025f1
HADOOP-13824. FsShell can suppress the real error if no error message is present. Contributed by John Zhuge.
2016-12-09 15:22:21 -08:00
Brahma Reddy Battula
80b8023276
HADOOP-13883. Add description of -fs option in generic command usage. Contributed By Yiqun Lin.
2016-12-09 18:21:42 +05:30
Akira Ajisaka
7d8e440eee
Revert "HADOOP-13852 hadoop build to allow hadoop version property to be explicitly set. Contriibuted by Steve Loughran"
...
This reverts commit c265515725
.
2016-12-09 12:49:27 +09:00
Steve Loughran
c265515725
HADOOP-13852 hadoop build to allow hadoop version property to be explicitly set. Contriibuted by Steve Loughran
2016-12-08 17:57:15 +00:00
Brahma Reddy Battula
0ef796174e
HADOOP-13867. FilterFileSystem should override rename(.., options) to take effect of Rename options called via FilterFileSystem implementations. Contributed By Vinayakumar B.
2016-12-08 18:57:43 +05:30
Akira Ajisaka
deb4743b2c
Revert "HDFS-11140. Directory Scanner should log startup message time correctly. Contributed by Yiqun Lin."
...
This reverts commit 0857641f62
.
2016-12-08 13:37:06 +09:00
Akira Ajisaka
0857641f62
HDFS-11140. Directory Scanner should log startup message time correctly. Contributed by Yiqun Lin.
2016-12-08 13:34:45 +09:00
Ming Ma
c73e08a6da
HDFS-10206. Datanodes not sorted properly by distance when the reader isn't a datanode. (Nandakumar via mingma)
2016-12-07 08:26:09 -08:00
Karthik Kambatla
c8d0a049b0
HADOOP-13859. TestConfigurationFieldsBase fails for fields that are DEFAULT values of skipped properties. (Haibo Chen via kasha)
2016-12-06 14:10:58 -08:00
Andrew Wang
f53b481ffe
HDFS-11172. Support an erasure coding policy using RS 10 + 4. Contributed by Wei Zhou.
2016-12-06 12:49:38 -08:00
Xiao Chen
79d90b810c
HADOOP-13827. Add reencryptEncryptedKey interface to KMS.
2016-12-06 12:04:04 -08:00
Andrew Wang
7b988e8899
HADOOP-13861. Spelling errors in logging and exceptions for code. Contributed by Grant Sohn.
2016-12-05 23:18:18 -08:00
Akira Ajisaka
b2a3d6c519
HADOOP-13835. Move Google Test Framework code from mapreduce to hadoop-common. Contributed by Varun Vasudev.
2016-12-06 14:01:47 +09:00
Xiao Chen
a2b5d60220
HADOOP-13864. KMS should not require truststore password. Contributed by Mike Yoder.
2016-12-05 17:36:00 -08:00
Xiao Chen
291df5c7fb
HADOOP-13847. KMSWebApp should close KeyProviderCryptoExtension. Contributed by John Zhuge.
2016-12-05 09:35:17 -08:00
Mingliang Liu
19f373a46b
HDFS-11132. Allow AccessControlException in contract tests when getFileStatus on subdirectory of existing files. Contributed by Vishwajeet Dusane
2016-12-01 12:54:28 -08:00
Andrew Wang
1f7613be95
HADOOP-13840. Implement getUsed() for ViewFileSystem. Contributed by Manoj Govindassamy.
2016-11-30 17:55:12 -08:00
Kai Zheng
51e6c1cc3f
HDFS-10994. Support an XOR policy XOR-2-1-64k in HDFS. Contributed by Sammi Chen
2016-11-30 15:52:56 +08:00
Kai Zheng
cfd8076f81
Revert due to an error "HDFS-10994. Support an XOR policy XOR-2-1-64k in HDFS. Contributed by Sammi Chen"
...
This reverts commit 5614f847b2ef2a5b70bd9a06edc4eba06174c6.
2016-11-30 15:44:52 +08:00
Akira Ajisaka
00096dcc0c
HADOOP-13812. Upgrade Tomcat to 6.0.48. Contributed by John Zhuge.
2016-11-29 19:47:02 +09:00
Akira Ajisaka
67d9f2808e
HADOOP-13706. Update jackson from 1.9.13 to 2.x in hadoop-common-project.
2016-11-29 14:07:19 +09:00
Robert Kanter
47ca9e26fb
HADOOP-13838. KMSTokenRenewer should close providers (xiaochen via rkanter)
2016-11-28 18:08:09 -08:00
Andrew Wang
a2b1ff0257
HADOOP-13828. Implement getFileChecksum(path, length) for ViewFileSystem. Contributed by Manoj Govindassamy.
2016-11-28 11:54:43 -08:00
Kai Zheng
5d5614f847
HDFS-10994. Support an XOR policy XOR-2-1-64k in HDFS. Contributed by Sammi Chen
2016-11-28 14:34:44 +08:00
Akira Ajisaka
209e805430
HADOOP-13506. Redundant groupid warning in child projects. Contributed by Kai Sasaki.
2016-11-28 14:34:57 +09:00
Harsh J
07825f2b49
HADOOP-1381. The distance between sync blocks in SequenceFiles should be configurable rather than hard coded to 2000 bytes. Contributed by Harsh J.
2016-11-25 22:22:23 +05:30
Brahma Reddy Battula
ee3d437a33
HADOOP-13820. Replace ugi.getUsername() with ugi.getShortUserName() in viewFS. Contributed By Brahma Reddy Battula.
2016-11-25 19:54:50 +05:30
Steve Loughran
01665e456d
HADOOP-10776 Open up already widely-used APIs for delegation-token fetching & renewal to ecosystem projects. Contributed by Vinod Kumar Vavilapalli
...
Cherry picked from 24715cefe8
2016-11-24 17:54:10 +00:00
Steve Loughran
3df3fa396c
HADOOP-13833 TestSymlinkHdfsFileSystem#testCreateLinkUsingPartQualPath2 fails after HADOOP-13605. Contributed by Brahma Reddy Battula.
2016-11-24 17:44:36 +00:00
Brahma Reddy Battula
13501053dd
HADOOP-11603. Metric Snapshot log can be changed #MetricsSystemImpl.java since all the services will be initialized. Contributed By Brahma Reddy Battula.
2016-11-24 22:23:22 +05:30
Steve Loughran
abb9fa7fc6
HADOOP-13018. Make Kdiag check whether hadoop.token.files points to existent and valid files. Contributed by Ravi Prakash
2016-11-24 16:41:59 +00:00
Andrew Wang
c7a5f2906f
HADOOP-13766. Fix a typo in the comments of RPC.getProtocolVersion. Contributed by Ethan Li.
2016-11-23 17:08:38 -08:00
Mingliang Liu
860d49aa6a
HADOOP-13605. Clean up FileSystem javadocs, logging; improve diagnostics on FS load. Contributed by Steve Loughran
2016-11-23 16:42:27 -08:00
Andrew Wang
de4894936a
HDFS-11368. Erasure Coding: Deprecate replication-related config keys. Contributed by Rakesh R.
2016-11-23 16:42:06 -08:00
Andrew Wang
dd98a8005a
HDFS-11058. Implement 'hadoop fs -df' command for ViewFileSystem. Contributed by Manoj Govindassamy.
2016-11-23 16:40:39 -08:00
Jian He
3d94da1e00
HADOOP-11552. Allow handoff on the server side for RPC requests. Contributed by Siddharth Seth
2016-11-23 16:01:55 -08:00
Mingliang Liu
2bf9a15e8a
HADOOP-13166. Add getFileStatus("/") test to AbstractContractGetFileStatusTest. Contributed by Steve Loughran
2016-11-22 14:27:23 -08:00
Lei Xu
3a09e5970d
HDFS-11145. Implement getTrashRoot() for ViewFileSystem. (Manoj Govindassamy via lei)
2016-11-22 13:52:09 -08:00
Mingliang Liu
beb70fed4f
HADOOP-13655. document object store use with fs shell and distcp. Contributed by Steve Loughran
...
This closes #131
2016-11-22 13:12:23 -08:00
Brahma Reddy Battula
afcf8d38e7
HADOOP-13646. Remove outdated overview.html. Contributed By Brahma Reddy Battula.
2016-11-22 19:45:45 +05:30
Akira Ajisaka
c65d6b6541
HADOOP-13814. Sample configuration of KMS HTTP Authentication signature is misleading. Contributed by Masahiro Tanaka.
2016-11-21 11:25:11 +09:00
Wei-Chiu Chuang
c0b1a44f6c
HADOOP-13660. Upgrade commons-configuration version. Contributed by Sean Mackrory.
2016-11-17 22:48:35 -06:00
Mingliang Liu
ae8849fe37
HADOOP-11601. Enhance FS spec & tests to mandate FileStatus.getBlocksize() >0 for non-empty files. Contributed by Steve Loughran
2016-11-17 14:11:38 -08:00
Kihwal Lee
bd3735554f
HADOOP-13742. Expose NumOpenConnectionsPerUser as a metric. Brahma Reddy Battula.
2016-11-17 12:16:38 -06:00
Mingliang Liu
aab9737a05
HADOOP-13822. Use GlobalStorageStatistics.INSTANCE.reset() at FileSystem#clearStatistics(). Contribute by Brahma Reddy Battula
2016-11-16 20:08:48 -08:00
Xiao Chen
61c0bedf77
HADOOP-13815. TestKMS#testDelegationTokensOpsSimple and TestKMS#testDelegationTokensOpsKerberized Fails in Trunk.
2016-11-15 16:26:27 -08:00
Mingliang Liu
5af572b644
HADOOP-13427. Eliminate needless uses of FileSystem#{exists(), isFile(), isDirectory()}. Contributed by Steve Loughran and Mingliang Liu
2016-11-15 10:57:00 -08:00
Mingliang Liu
04014c4c73
HADOOP-13810. Add a test to verify that Configuration handles &-encoded characters. Contributed by Steve Loughran
...
This closes #158
2016-11-14 19:38:10 -08:00
Zhe Zhang
ff0b99eafe
HDFS-10872. Add MutableRate metrics for FSNamesystemLock operations. Contributed by Erik Krogen.
2016-11-14 11:05:29 -08:00
Chris Douglas
5c61ad2488
HADOOP-13037. Refactor Azure Data Lake Store as an independent FileSystem. Contributed by Vishwajeet Dusane
2016-11-11 11:15:07 -08:00
Yongjun Zhang
fd2f22adec
HADOOP-13720. Add more info to the msgs printed in AbstractDelegationTokenSecretManager. Contributed by Yongjun Zhang.
2016-11-10 22:42:59 -08:00
Yongjun Zhang
470bdaa27a
HADOOP-12718. Incorrect error message by fs -put local dir without permission. (John Zhuge via Yongjun Zhang)
2016-11-10 22:38:38 -08:00
Akira Ajisaka
8848a8a76c
HDFS-11116. Fix javac warnings caused by deprecation of APIs in TestViewFsDefaultValue. Contributed by Yiqun Lin.
2016-11-11 13:45:30 +09:00
Xiao Chen
822ae88f7d
HADOOP-13346. DelegationTokenAuthenticationHandler writes via closed writer. Contributed by Gregory Chanan and Hrishikesh Gadre.
2016-11-09 09:33:00 -08:00
Xiao Chen
367c3d4121
HADOOP-13590. Retry until TGT expires even if the UGI renewal thread encountered exception.
2016-11-09 09:07:12 -08:00
Akira Ajisaka
c074880096
HADOOP-13800. Remove unused HADOOP_AUDIT_LOGGER from hadoop-env.sh. Contributed by Yiqun Lin.
2016-11-09 22:02:40 +09:00
Andrew Wang
e1c6ef2efa
HADOOP-13789. Hadoop Common includes generated test protos in both jar and test-jar. Contributed by Sean Busbey.
2016-11-08 16:33:55 -08:00
Zhe Zhang
77c13c3857
HADOOP-13782. Make MutableRates metrics thread-local write, aggregate-on-read. Contributed by Erik Krogen.
2016-11-08 16:07:36 -08:00
Mingliang Liu
2a65eb121e
HADOOP-13802. Make generic options help more consistent, and aligned. Contributed by Grant Sohn
2016-11-08 15:40:22 -08:00
Subru Krishnan
29e3b3417c
YARN-5833. Add validation to ensure default ports are unique in Configuration. (Konstantinos Karanasos via Subru).
2016-11-08 14:38:18 -08:00
Brahma Reddy Battula
dbb133ccfc
HADOOP-13707. If kerberos is enabled while HTTP SPNEGO is not configured, some links cannot be accessed. Contributed by Yuanbo Liu.
2016-11-08 20:55:10 +05:30
Zhe Zhang
3dbad5d823
HADOOP-13804. MutableStat mean loses accuracy if add(long, long) is used. Contributed by Erik Krogen.
2016-11-07 16:08:10 -08:00
Steve Loughran
f76895573d
HADOOP-13797 Remove hardcoded absolute path for ls. Contributed by Christine Koppelt
2016-11-07 12:36:10 +00:00
Xiao Chen
d8bab3dcb6
HDFS-10756. Expose getTrashRoot to HTTPFS and WebHDFS. Contributed by Yuanbo Liu.
2016-11-04 18:06:55 -07:00
Xiaoyu Yao
95665a6eea
Revert "HADOOP-13565. KerberosAuthenticationHandler#authenticate should not rebuild SPN based on client request. Contributed by Xiaoyu Yao."
...
This reverts commit 9097e2efe4
.
2016-11-04 16:02:47 -07:00
Akira Ajisaka
de0132748d
MAPREDUCE-6796. Remove unused properties from JTConfig.java. Contributed by Haibo Chen.
2016-11-05 03:49:19 +09:00
Mingliang Liu
abfc15d5ef
HADOOP-13792. Stackoverflow for schemeless defaultFS with trailing slash. Contributed by John Zhuge
2016-11-04 10:46:27 -07:00
Xiao Chen
7154a20bcb
HADOOP-12453. Support decoding KMS Delegation Token with its own Identifier. Contributed by Xiaoyu Yao.
2016-11-03 13:09:03 -07:00
Andrew Wang
7e521c5a49
HDFS-11080. Update HttpFS to use ConfigRedactor. Contributed by Sean Mackrory.
2016-11-02 19:11:05 -07:00
Daniel Templeton
0dc2a6a3a5
HADOOP-13667. Fix typing mistake of inline document in hadoop-metrics2.properties (Contributed by Rui Gao via Daniel Templeton)
2016-11-02 06:53:33 -07:00
Arpit Agarwal
1b6ecaf016
HADOOP-13738. DiskChecker should perform some disk IO.
2016-11-01 18:02:23 -07:00
Steve Loughran
a1761a841e
HADOOP-13680. fs.s3a.readahead.range to use getLongBytes. Contributed by Abhishek Modi.
2016-10-31 20:54:46 +00:00
Wei-Chiu Chuang
112f04eb1b
HDFS-11061. Update dfs -count -t command line help and documentation. Contributed by Yiqun Lin.
2016-10-28 15:33:27 -07:00
Jason Lowe
c017171da0
HADOOP-13770. Shell.checkIsBashSupported swallowed an interrupted exception. Contributed by Wei-Chiu Chuang
2016-10-28 14:57:50 +00:00
Xiao Chen
b62bc2bbd8
HADOOP-13763. KMS REST API Documentation Decrypt URL typo. Contributed by Jeffrey E Rodriguez.
2016-10-27 18:05:40 -07:00
Robert Kanter
5877f20f9c
HADOOP-10075. Update jetty dependency to version 9 (rkanter)
2016-10-27 16:09:00 -07:00
Brahma Reddy Battula
0c837db8a8
HADOOP-13201. Print the directory paths when ViewFs denies the rename operation on internal dirs. Contributed by Tianyin Xiu
2016-10-27 19:46:41 +05:30
Masatake Iwasaki
0bdd263d82
HADOOP-13017. Implementations of InputStream.read(buffer, offset, bytes) to exit 0 if bytes==0. Contributed by Steve Loughran.
2016-10-27 15:46:59 +09:00
Andrew Wang
22ff0eff4d
HADOOP-8299. ViewFileSystem link slash mount point crashes with IndexOutOfBoundsException. Contributed by Manoj Govindassamy.
2016-10-26 14:25:03 -07:00
Chris Nauroth
1f8490a5ba
HADOOP-13502. Split fs.contract.is-blobstore flag into more descriptive flags for use by contract tests. Contributed by Chris Nauroth.
2016-10-26 08:55:42 -07:00
Chris Nauroth
9cad3e2350
HADOOP-13614. Purge some superfluous/obsolete S3 FS tests that are slowing test runs down. Contributed by Steve Loughran.
2016-10-26 08:27:26 -07:00
Wei-Chiu Chuang
d88dca844a
HADOOP-11798. Native raw erasure coder in XOR codes. Contributed by SammiChen.
2016-10-25 16:53:53 -07:00
Andrew Wang
084bdab156
HDFS-5684. Annotate o.a.h.fs.viewfs.ViewFileSystem.MountPoint as VisibleForTesting. Contributed by Manoj Govindassamy.
2016-10-25 15:35:39 -07:00
Andrew Wang
86c735bcb1
Revert "HADOOP-13696. change hadoop-common dependency scope of jsch to provided. Contributed by Yuanbo Liu."
...
This reverts commit cef61d505e
.
2016-10-25 13:45:52 -07:00
Xiao Chen
09ef97dccb
HADOOP-13669. Addendum patch 2 for KMS Server should log exceptions before throwing.
2016-10-25 09:59:12 -07:00
Chris Nauroth
309a43925c
HADOOP-13309. Document S3A known limitations in file ownership and permission model. Contributed by Chris Nauroth.
2016-10-25 09:03:03 -07:00
Chris Nauroth
d8fa1cfa67
HADOOP-13727. S3A: Reduce high number of connections to EC2 Instance Metadata Service caused by InstanceProfileCredentialsProvider. Contributed by Chris Nauroth.
2016-10-24 21:22:34 -07:00
Akira Ajisaka
dc3272bfe8
HDFS-11046. Duplicate '-' in the daemon log name.
2016-10-25 10:07:43 +09:00
Xiaoyu Yao
d0a347984d
HADOOP-13749. KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used. Contributed by Xiaoyu Yao.
2016-10-23 10:58:36 -07:00
Xiaoyu Yao
da901b6c14
Revert "HDFS-10757. KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used. Contributed by Xiaoyu Yao."
...
This reverts commit be72372248
.
2016-10-23 08:25:37 -07:00
Wei-Chiu Chuang
25438526ed
HDFS-11033. Add documents for native raw erasure coder in XOR codes. Contributed by SammiChen.
2016-10-21 16:20:07 -07:00
Xiaoyu Yao
be72372248
HDFS-10757. KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used. Contributed by Xiaoyu Yao.
2016-10-21 14:23:02 -07:00
Chris Douglas
ae8bccd509
HADOOP-13702. Add instrumented ReadWriteLock. Contributed by Jingcheng Du
2016-10-21 12:59:54 -07:00
Anu Engineer
262827cf75
HADOOP-13737. Cleanup DiskChecker interface. Contributed by Arpit Agarwal.
2016-10-20 13:35:26 -07:00
Anu Engineer
3fbf4cd5da
HADOOP-13716. Add LambdaTestUtils class for tests; fix eventual consistency problem in contract test setup. Contributed by Steve Loughran.
2016-10-20 12:33:58 -07:00
Brahma Reddy Battula
f872c6bc03
HADOOP-13236. truncate will fail when we use viewfilesystem. Contributed by Brahma Reddy Battula
2016-10-20 21:47:17 +05:30
Benoy Antony
4bca385241
HADOOP-12082 Support multiple authentication schemes via AuthenticationFilter
2016-10-18 18:32:01 -07:00
Xiao Chen
d75cbc5749
HADOOP-13693. Remove the message about HTTP OPTIONS in SPNEGO initialization message from kms audit log.
2016-10-18 18:24:59 -07:00
Xiao Chen
efdf810cf9
HADOOP-7352. FileSystem#listStatus should throw IOE upon access error. Contributed by John Zhuge.
2016-10-18 18:18:43 -07:00
Steve Loughran
6c348c5691
HADOOP-13560. S3ABlockOutputStream to support huge (many GB) file writes. Contributed by Steve Loughran
2016-10-18 21:16:02 +01:00
Kai Zheng
c023c74886
HADOOP-13061. Refactor erasure coders. Contributed by Kai Sasaki
2016-10-18 12:02:53 +06:00
Akira Ajisaka
bedfec0c10
HADOOP-13522. Add %A and %a formats for fs -stat command to print permissions. Contributed by Alex Garbarini.
2016-10-18 15:00:44 +09:00
Andrew Wang
b671ee6846
HDFS-11013. Correct typos in native erasure coding dump code. Contributed by László Bence Nagy.
2016-10-17 14:14:50 -07:00
Andrew Wang
987ee51141
HADOOP-13724. Fix a few typos in site markdown documents. Contributed by Ding Fei.
2016-10-17 13:25:58 -07:00
Andrew Wang
0f4afc8100
HADOOP-13722. Code cleanup -- ViewFileSystem and InodeTree. Contributed by Manoj Govindassamy.
2016-10-17 13:15:11 -07:00
Wei-Chiu Chuang
ed9fcbec54
HADOOP-13661. Upgrade HTrace version. Contributed by Sean Mackrory.
2016-10-17 05:04:49 -07:00
Andrew Wang
aee538be6c
HADOOP-13721. Remove stale method ViewFileSystem#getTrashCanLocation. Contributed by Manoj Govindassamy.
2016-10-14 14:08:31 -07:00
Xiaoyu Yao
dbe663d524
HADOOP-13686. Adding additional unit test for Trash (I). Contributed by Weiwei Yang.
2016-10-13 23:05:16 -07:00
Akira Ajisaka
5a5a724731
HADOOP-13417. Fix javac and checkstyle warnings in hadoop-auth package.
2016-10-14 14:45:55 +09:00
Xiao Chen
ae51b11f78
HADOOP-13669. Addendum patch for KMS Server should log exceptions before throwing.
2016-10-13 22:32:08 -07:00
Arpit Agarwal
008122b3c9
HADOOP-13710. Supress CachingGetSpaceUsed from logging interrupted exception stacktrace. Contributed by Hanisha Koneru.
2016-10-13 11:37:03 -07:00
Xiaoyu Yao
9097e2efe4
HADOOP-13565. KerberosAuthenticationHandler#authenticate should not rebuild SPN based on client request. Contributed by Xiaoyu Yao.
2016-10-13 10:52:28 -07:00
Andrew Wang
12d739a34b
HADOOP-13700. Remove unthrown IOException from TrashPolicy#initialize and #getInstance signatures.
2016-10-12 15:19:52 -07:00
Kihwal Lee
85cd06f663
HDFS-10789. Route webhdfs through the RPC call queue. Contributed by Daryn Sharp and Rushabh S Shah.
2016-10-12 15:11:42 -05:00
Xiao Chen
b84c4891f9
HADOOP-13698. Document caveat for KeyShell when underlying KeyProvider does not delete a key.
2016-10-11 17:05:00 -07:00
Andrew Wang
8a09bf7c19
HADOOP-13705. Revert HADOOP-13534 Remove unused TrashPolicy#getInstance and initialize code.
2016-10-11 13:46:07 -07:00
Wei-Chiu Chuang
4b32b1420d
HADOOP-13684. Snappy may complain Hadoop is built without snappy if libhadoop is not found. Contributed by Wei-Chiu Chuang.
2016-10-11 13:21:33 -07:00
Mingliang Liu
2fb392a587
HADOOP-13697. LogLevel#main should not throw exception if no arguments. Contributed by Mingliang Liu
2016-10-11 10:57:08 -07:00
Mingliang Liu
c874fa914d
HDFS-10985. o.a.h.ha.TestZKFailoverController should not use fixed time sleep before assertions. Contributed by Mingliang Liu
2016-10-10 13:33:07 -07:00
Xiao Chen
65912e4027
HADOOP-13669. KMS Server should log exceptions before throwing. Contributed by Suraj Acharya.
2016-10-10 12:51:12 -07:00
Andrew Wang
03060075c5
HADOOP-13699. Configuration does not substitute multiple references to the same var.
2016-10-10 12:19:26 -07:00
Steve Loughran
cef61d505e
HADOOP-13696. change hadoop-common dependency scope of jsch to provided. Contributed by Yuanbo Liu.
2016-10-10 12:32:39 +01:00
Kai Zheng
3d59b18d49
HADOOP-13641. Update UGI#spawnAutoRenewalThreadForUserCreds to reduce indentation. Contributed by Huafeng Wang
2016-10-09 15:53:36 +06:00
Kai Zheng
ec0b70716c
HADOOP-12579. Deprecate WriteableRPCEngine. Contributed by Wei Zhou
2016-10-09 15:07:03 +06:00
Xiao Chen
2e853be657
HADOOP-13627. Have an explicit KerberosAuthException for UGI to throw, text from public constants. Contributed by Xiao Chen.
2016-10-07 13:46:27 -07:00
Robert Kanter
c183b9de8d
HADOOP-12611. TestZKSignerSecretProvider#testMultipleInit occasionally fail (ebadger via rkanter)
2016-10-07 09:33:31 -07:00
Steve Loughran
ebd4f39a39
HADOOP-12977 s3a to handle delete("/", true) robustly. Contributed by Steve Loughran.
2016-10-07 12:51:40 +01:00
Chris Nauroth
1d330fbaf6
HADOOP-13150. Avoid use of toString() in output of HDFS ACL shell commands. Contributed by Chris Nauroth.
2016-10-06 13:19:16 -07:00
Chris Nauroth
2d46c3f6b7
HADOOP-13323. Downgrade stack trace on FS load from Warn to debug. Contributed by Steve Loughran.
2016-10-06 10:57:01 -07:00
Brahma Reddy Battula
35b9d7de9f
HADOOP-13690. Fix typos in core-default.xml. Contributed by Yiqun Lin
2016-10-06 18:06:08 +05:30
Brahma Reddy Battula
b90fc70d67
HDFS-10963. Reduce log level when network topology cannot find enough datanodes. Contributed by Xiao chen
2016-10-06 17:47:31 +05:30
Wei-Chiu Chuang
c5ca216915
HDFS-10683. Make class Token$PrivateToken private. Contributed by John Zhuge.
2016-10-05 17:36:50 -07:00
Mingliang Liu
00160f71b6
HADOOP-13628. Support to retrieve specific property from configuration via REST API. Contributed by Weiwei Yang
2016-10-05 16:50:01 -04:00
Akira Ajisaka
9a61b52fbe
HADOOP-13685. Document -safely option of rm command. Contributed by Xiaoyu Yao.
2016-10-05 20:41:08 +09:00
Xiao Chen
853d65a157
HDFS-10918. Add a tool to get FileEncryptionInfo from CLI. Contributed by Xiao Chen.
2016-10-03 16:01:54 -07:00
Xiao Chen
89bd6d29a6
HADOOP-13317. Add logs to KMS server-side to improve supportability. Contributed by Suraj Acharya.
2016-09-30 17:51:39 -07:00
Wei-Chiu Chuang
57aec2b46b
HADOOP-12974. Create a CachingGetSpaceUsed implementation that uses df. Contributed by Elliott Clark.
2016-09-30 12:58:37 -07:00
Chris Nauroth
1e0ea27e96
Revert "HADOOP-13081. add the ability to create multiple UGIs/subjects from one kerberos login. Contributed by Sergey Shelukhin."
...
This reverts commit 0458a2af6e
.
2016-09-29 13:59:09 -07:00
Kihwal Lee
236ac773c9
HADOOP-13537. Support external calls in the RPC call queue. Contributed by Daryn Sharp.
2016-09-29 13:27:30 -05:00
Steve Loughran
ee0c722dc8
HADOOP-13164 Optimize S3AFileSystem::deleteUnnecessaryFakeDirectories. Contributed by Rajesh Balamohan.
2016-09-29 17:01:00 +01:00
Steve Loughran
1518cb9532
HADOOP-13663 Index out of range in SysInfoWindows. Contributed by Inigo Goiri
2016-09-29 11:35:00 +01:00
Kihwal Lee
e19b37ead2
HADOOP-11780. Prevent IPC reader thread death. Contributed by Daryn Sharp.
2016-09-28 08:24:21 -05:00
Mingliang Liu
9a44a832a9
HADOOP-13658. Replace config key literal strings with names I: hadoop common. Contributed by Chen Liang
2016-09-27 17:36:53 -07:00
Wangda Tan
875062b5bc
HADOOP-13544. JDiff reports unncessarily show unannotated APIs and cause confusion while our javadocs only show annotated and public APIs. (vinodkv via wangda)
2016-09-27 11:26:45 -07:00
Brahma Reddy Battula
edf0d0f8b2
HDFS-9444. Add utility to find set of available ephemeral ports to ServerSocketUtil. Contributed by Masatake Iwasaki
2016-09-27 07:04:37 +05:30
Xiao Chen
fa397e74fe
HADOOP-13638. KMS should set UGI's Configuration object properly. Contributed by Wei-Chiu Chuang.
2016-09-26 13:00:57 -07:00
Konstantin V Shvachko
6eb700ee74
HDFS-10866. Fix Eclipse Java compile errors related to generic parameters. Contributed by Konstantin Shvachko.
2016-09-23 14:10:11 -07:00
Brahma Reddy Battula
bbdf350ff9
HDFS-10886. Replace fs.default.name with fs.defaultFS in viewfs document.
2016-09-23 19:21:34 +05:30
Mingliang Liu
e80386d69d
HADOOP-13601. Fix a log message typo in AbstractDelegationTokenSecretManager. Contributed by Mehran Hassani.
2016-09-20 13:20:01 -07:00
Kai Zheng
734d54c1a8
HDFS-10861. Refactor StripeReaders and use ECChunk version decode API. Contributed by Sammi Chen
2016-09-21 21:34:48 +08:00
Xiao Chen
ea839bd48e
HDFS-10489. Deprecate dfs.encryption.key.provider.uri for HDFS encryption zones. Contributed by Xiao Chen.
2016-09-17 22:25:39 -07:00
Kai Zheng
58bae35447
YARN-5163. Migrate TestClientToAMTokens and TestClientRMTokens tests from the old RPC engine. Contributed by Wei Zhou and Kai Zheng
2016-09-18 08:43:36 +08:00
Andrew Wang
8a40953058
HDFS-10823. Implement HttpFSFileSystem#listStatusIterator.
2016-09-16 15:37:36 -07:00
Wei-Chiu Chuang
f6f3a447bf
HADOOP-13580. If user is unauthorized, log "unauthorized" instead of "Invalid signed text:". Contributed by Wei-Chiu Chuang.
2016-09-16 14:53:30 -07:00
Sangjin Lee
fcbac00212
Revert "HADOOP-13410. RunJar adds the content of the jar twice to the classpath (Yuanbo Liu via sjlee)"
...
This reverts commit 4d3ea92f4f
.
2016-09-15 10:18:56 -07:00
Akira Ajisaka
7cad7b7046
HADOOP-13616. Broken code snippet area in Hadoop Benchmarking. Contributed by Kai Sasaki.
2016-09-15 23:42:34 +09:00
Steve Loughran
53a12fa721
HADOOP-13606 swift FS to add a service load metadata file. Contributed by Steve Loughran
2016-09-14 15:45:04 +01:00
Kai Zheng
ea0c2b8b05
HADOOP-13218. Migrate other Hadoop side tests to prepare for removing WritableRPCEngine. Contributed by Wei Zhou and Kai Zheng
2016-09-15 10:46:00 +08:00
Jing Zhao
08d8e0ba25
HADOOP-13546. Override equals and hashCode of the default retry policy to avoid connection leakage. Contributed by Xiaobing Zhou.
2016-09-13 11:12:52 -07:00
Yongjun Zhang
d2466ec3e0
HDFS-10657. testAclCLI.xml setfacl test should expect mask r-x. (John Zhuge via Yongjun Zhang)
2016-09-12 21:25:06 -07:00
Mingliang Liu
59d59667a8
HADOOP-13588. ConfServlet should respect Accept request header. Contributed by Weiwei Yang
2016-09-12 16:17:08 -07:00
Allen Wittenauer
58ed4fa544
HADOOP-13341. Deprecate HADOOP_SERVERNAME_OPTS; replace with (command)_(subcommand)_OPTS
...
This commit includes the following changes:
HADOOP-13356. Add a function to handle command_subcommand_OPTS
HADOOP-13355. Handle HADOOP_CLIENT_OPTS in a function
HADOOP-13554. Add an equivalent of hadoop_subcmd_opts for secure opts
HADOOP-13562. Change hadoop_subcommand_opts to use only uppercase
HADOOP-13358. Modify HDFS to use hadoop_subcommand_opts
HADOOP-13357. Modify common to use hadoop_subcommand_opts
HADOOP-13359. Modify YARN to use hadoop_subcommand_opts
HADOOP-13361. Modify hadoop_verify_user to be consistent with hadoop_subcommand_opts (ie more granularity)
HADOOP-13564. modify mapred to use hadoop_subcommand_opts
HADOOP-13563. hadoop_subcommand_opts should print name not actual content during debug
HADOOP-13360. Documentation for HADOOP_subcommand_OPTS
This closes apache/hadoop#126
2016-09-12 11:10:00 -07:00
Arpit Agarwal
a99bf26a08
HDFS-10830. FsDatasetImpl#removeVolumes crashes with IllegalMonitorStateException when vol being removed is in use. (Arpit Agarwal and Manoj Govindassamy)
2016-09-10 18:22:25 -07:00
Chris Douglas
9f192cc5ac
MAPREDUCE-6628. Potential memory leak in CryptoOutputStream. Contributed by Mariappan Asokan
2016-09-09 11:12:44 -07:00
Kihwal Lee
d4d076876a
HADOOP-10940. RPC client does no bounds checking of responses. Contributed by Daryn Sharp.
2016-09-09 10:39:35 -05:00
Chris Douglas
011f3b24d4
HDFS-10742. Measure lock time in FsDatasetImpl. Contributed by Chen Liang
2016-09-08 17:53:40 -07:00
Chris Douglas
1192781a78
HADOOP-13519. Make Path Serializable. Contributed by Steve Loughran
2016-09-08 17:46:12 -07:00
Allen Wittenauer
cae331186d
Revert "YARN-5567. Fix script exit code checking in NodeHealthScriptRunner#reportHealthStatus. (Yufei Gu via rchiang)"
...
This reverts commit 05ede00386
.
2016-09-08 12:40:30 -07:00
Zhe Zhang
401db4fc65
HDFS-8901. Use ByteBuffer in striping positional read. Contributed by Sammi Chen and Kai Zheng.
2016-09-08 11:54:33 -07:00
Kai Zheng
d355573f56
Revert "HADOOP-13218. Migrate other Hadoop side tests to prepare for removing WritableRPCEngine. Contributed by Wei Zhou and Kai Zheng"
...
This reverts commit 62a9667136
2016-09-08 05:50:17 +08:00
Anu Engineer
f414d5e118
HADOOP-13388. Clean up TestLocalFileSystemPermission. Contributed by Andras Bokor.
2016-09-07 11:09:41 -07:00
Xiao Chen
680be58aac
HADOOP-13558. UserGroupInformation created from a Subject incorrectly tries to renew the Kerberos ticket. Contributed by Xiao Chen.
2016-09-06 20:54:17 -07:00
Chris Nauroth
f0d5382ff3
HDFS-6962. ACL inheritance conflicts with umaskmode. Contributed by Chris Nauroth.
2016-09-06 11:02:39 -07:00
Chris Douglas
d37dc5d1b8
HDFS-9847. HDFS configuration should accept time units. Contributed by Yiqun Lin
2016-09-06 10:38:04 -07:00
Andrew Wang
f388a20943
Add CHANGES and release notes for 3.0.0-alpha1 to site
2016-09-06 09:51:55 -07:00
Kihwal Lee
39d1b1d747
HADOOP-13549. Eliminate intermediate buffer for server-side PB encoding. Contributed by Daryn Sharp.
2016-09-06 10:02:42 -05:00
Kai Zheng
62a9667136
HADOOP-13218. Migrate other Hadoop side tests to prepare for removing WritableRPCEngine. Contributed by Wei Zhou and Kai Zheng
2016-09-07 17:05:33 +08:00
Kihwal Lee
23abb09c1f
HADOOP-13547. Optimize IPC client protobuf decoding. Contributed by Daryn Sharp.
2016-09-02 11:03:18 -05:00
Kihwal Lee
76cd81f4b6
HADOOP-13465. Design Server.Call to be extensible for unified call queue. Contributed by Daryn Sharp.
2016-09-01 15:44:44 -05:00
Chris Douglas
3069df7551
FsPermission string constructor does not recognize sticky bit. Contributed by Atul Sikaria
2016-09-01 11:32:26 -07:00
Mingliang Liu
dcd21d083a
HADOOP-13375. o.a.h.security.TestGroupsCaching.testBackgroundRefreshCounters seems flaky. (Contributed by Weiwei Yang)
2016-09-01 11:03:06 -07:00
Ray Chiang
05ede00386
YARN-5567. Fix script exit code checking in NodeHealthScriptRunner#reportHealthStatus. (Yufei Gu via rchiang)
2016-08-29 15:55:33 -07:00
Mingliang Liu
6fcb04c178
HADOOP-13559. Remove close() within try-with-resources in ChecksumFileSystem/ChecksumFs classes. (Contributed by Aaron Fabbri)
2016-08-29 13:04:28 -07:00
Anu Engineer
e1ad598cef
HADOOP-7363. TestRawLocalFileSystemContract is needed. Contributed by Andras Bokor.
2016-08-29 09:26:46 -07:00
Jason Lowe
92d8f37155
HADOOP-13552. RetryInvocationHandler logs all remote exceptions. Contributed by Jason Lowe
2016-08-29 15:55:38 +00:00