24853bf32a
YARN-6768. Improve performance of yarn api record toString and fromString. Contributed by Jonathan Eagles
2017-07-24 10:19:20 -05:00
465c213439
HDFS-12094. Log torrent when none isa-l EC is used. Contributed by LiXin Ge.
2017-07-21 12:25:03 -07:00
b3269f7cc1
HADOOP-14659. UGI getShortUserName does not need to search the Subject. Contributed by Daryn Sharp.
2017-07-20 16:12:21 -05:00
c21c260392
HADOOP-14666. Tests use assertTrue(....equals(...)) instead of assertEquals()
2017-07-19 13:58:55 -07:00
df180259b0
HADOOP-14669. GenericTestUtils.waitFor should use monotonic time. Contributed by Daniel Templeton
2017-07-19 09:41:22 -05:00
2843c688bc
HADOOP-14642. wasb: add support for caching Authorization and SASKeys. Contributed by Sivaguru Sankaridurg.
2017-07-19 00:13:06 -07:00
5aa2bf231f
HADOOP-14637. GenericTestUtils.waitFor needs to check condition again after max wait time. Contributed by Daniel Templeton
2017-07-18 16:23:41 -05:00
ccaf036662
HADOOP-14539. Move commons logging APIs over to slf4j in hadoop-common. Contributed by Wenxin He.
2017-07-18 13:32:37 +09:00
02b141ac60
HDFS-11786. Add support to make copyFromLocal multi threaded. Contributed by Mukul Kumar Singh.
2017-07-16 10:59:34 -07:00
0a6d5c0cf1
HADOOP-14521. KMS client needs retry logic. Contributed by Rushabh S Shah.
2017-07-14 22:22:53 -07:00
b61ab8573e
HADOOP-14646. FileContextMainOperationsBaseTest#testListStatusFilterWithSomeMatches never runs. Contributed by Andras Bokor.
2017-07-13 21:41:43 +09:00
9144fd9e9b
HADOOP-14629. Improve exception checking in FileContext related JUnit tests. Contributed by Andras Bokor.
2017-07-12 11:35:50 +09:00
d670c3a4da
HADOOP-14535 wasb: implement high-performance random access and seek of block blobs.
...
Contributed by Thomas Marquardt
2017-07-11 21:34:27 +01:00
3a7f02b815
HDFS-12085. Reconfigure namenode heartbeat interval fails if the interval was set with time unit. Contributed by Weiwei Yang.
2017-07-11 20:40:11 +08:00
fce7951014
HADOOP-14638. Replace commons-logging APIs with slf4j in StreamPumper.
...
This closes #247
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2017-07-11 13:30:13 +09:00
f1efa14fc6
HADOOP-10829. Iteration on CredentialProviderFactory.serviceLoader is thread-unsafe. Contributed by Benoy Antony and Rakesh R.
2017-07-10 17:48:27 -07:00
09653ea098
HADOOP-14634. Remove jline from main Hadoop pom.xml.
...
Contributed by Ray Chiang.
2017-07-10 11:53:13 +01:00
f10864a820
Add release notes, changes, jdiff for 3.0.0-alpha4
2017-07-07 11:01:59 -07:00
7cd095272c
HADOOP-14587. Use GenericTestUtils.setLogLevel when available in hadoop-common. Contributed by Wenxin He.
2017-07-08 02:54:24 +09:00
8fc5dcc2a1
Revert "HADOOP-14587. Use GenericTestUtils.setLogLevel when available in hadoop-common. Contributed by Wenxin He."
...
This reverts commit 82cb2a6497
2017-07-08 02:53:18 +09:00
8153fe2bd3
HADOOP-14563. LoadBalancingKMSClientProvider#warmUpEncryptedKeys swallows IOException. Contributed by Rushabh S Shah.
2017-07-07 06:13:10 -07:00
82cb2a6497
HADOOP-14587. Use GenericTestUtils.setLogLevel when available in hadoop-common. Contributed by Wenxin He.
2017-07-07 15:00:47 +09:00
946dd25675
HADOOP-14608. KMS JMX servlet path not backwards compatible. Contributed by John Zhuge.
2017-07-05 11:16:56 -07:00
a180ba4081
HADOOP-13414. Hide Jetty Server version header in HTTP responses. Contributed by Surendra Singth Lilhore.
2017-07-05 16:05:18 +05:30
b17e655b70
HADOOP-14617. Add ReflectionUtils.logThreadInfo that accept slf4j logger API.
...
Contributed by Wenxin He.
2017-07-04 11:41:07 +01:00
f2aba1da30
HADOOP-14571. Deprecate public APIs relate to log4j1
...
This closes #244
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2017-07-04 18:55:20 +09:00
1aaa7f1eac
HADOOP-14615. Add ServiceOperations.stopQuietly that accept slf4j logger API.
...
Contributed by Wenxin He.
2017-07-04 10:48:02 +01:00
af2773f609
Updating version for 3.0.0-beta1 development
2017-06-29 17:57:40 -07:00
5a75f73893
HADOOP-14611. NetworkTopology.DEFAULT_HOST_LEVEL is unused
...
(Contributed by Chen Liang via Daniel Templeton)
2017-06-29 12:28:43 -07:00
ea1da39b19
HADOOP-14479. Erasurecode testcase failures with native enabled. Contributed by Sammi Chen
2017-06-29 11:26:36 +08:00
d6df0fdbbd
Add -E option in 'ls' to list erasure coding policy of each file and directory if applicable. Contributed by luhuichun via lei.
2017-06-28 13:47:23 -07:00
fb5ee3fafb
HADOOP-14515. Addendum. Specifically configure zookeeper-related log levels in KMS log4j.
2017-06-27 23:49:09 -07:00
379f19a2c7
HDFS-11943. [Erasure coding] Warn log frequently print to screen in doEncode/doDecode functions. Contributed by liaoyuxiangqin
2017-06-26 16:26:09 +08:00
a594f96fb1
HADOOP-14549. Use GenericTestUtils.setLogLevel when available in hadoop-tools. Contributed by wenxin he.
2017-06-26 16:41:00 +09:00
0111711d8b
HADOOP-14543. ZKFC should use getAversion() while setting the zkacl. Contributed by Brahma Reddy Battula.
2017-06-23 16:50:47 -07:00
e5db9af8a0
HADOOP-14568. GenericTestUtils#waitFor missing parameter verification.
...
Contributed by Yiqun Lin
2017-06-23 14:39:58 +01:00
092ebdf885
HADOOP-12940. Fix warnings from Spotbugs in hadoop-common.
2017-06-23 10:28:58 +09:00
8ceaac1877
HDFS-12010. TestCopyPreserveFlag fails consistently because of mismatch in access time. Contributed by Mukul Kumar Singh.
2017-06-22 15:42:50 -07:00
8dbd53ef9f
HDFS-11067. DFS#listStatusIterator(..) should throw FileNotFoundException if the directory deleted before fetching next batch of entries. Contributed by Vinayakumar B.
2017-06-22 17:37:08 +05:30
b64951905e
HADOOP-14542. Add IOUtils.cleanupWithLogger that accepts slf4j logger API. Contributed by Chen Liang.
2017-06-22 17:42:59 +09:00
e806c6e0ce
HADOOP-14146. KerberosAuthenticationHandler should authenticate with SPN in AP-REQ. Contributed by Daryn Sharp
2017-06-21 11:03:41 -05:00
1a598479a9
HDFS-11992. Replace commons-logging APIs with slf4j in FsDatasetImpl. Contributed by hu xiaodong.
2017-06-21 11:19:48 +09:00
5157f6c46e
HADOOP-14429. FTPFileSystem#getFsAction always returns FsAction.NONE. (Hongyuan Li via Yongjun Zhang)
2017-06-20 16:51:13 -07:00
45ff4d38e6
HDFS-11647. Add -E option in hdfs "count" command to show erasure policy summarization. Contributed by luhuichun.
2017-06-20 11:55:09 -07:00
2e9daa2e27
HADOOP-14533. Size of args cannot be less than zero in TraceAdmin#run as its linkedlist. Contributed by Weisen Han.
2017-06-20 20:44:31 +08:00
15964ef147
HADOOP-14515. Specifically configure zookeeper-related log levels in KMS log4j.
2017-06-19 23:12:02 -07:00
300804595e
HADOOP-14540. Replace MRv1 specific terms in HostsFileReader. Contributed by hu xiaodong.
2017-06-19 19:39:36 +09:00
7ade5124b8
HADOOP-14538. Fix TestFilterFileSystem and TestHarFileSystem failures after DistributedFileSystem.append API. Contributed by Lei (Eddy) Xu.
2017-06-19 19:09:18 +09:00
75043d3429
HADOOP-14424. Add CRC32C performance test. Contributed by LiXin Ge.
2017-06-19 09:16:45 +09:00
6460df21a0
HADOOP-14395. Provide Builder pattern for DistributedFileSystem.append. Contributed by Lei (Eddy) Xu.
2017-06-16 17:24:00 -07:00
4ebc23ba7b
HADOOP-14524. Make CryptoCodec Closeable so it can be cleaned up proactively.
2017-06-16 09:49:33 -07:00
942ecbbc98
HADOOP-14486 TestSFTPFileSystem#testGetAccessTime test failure using openJDK 1.8.0.
...
Contributed by Hongyuan Li.
2017-06-16 09:45:22 +01:00
e855cc4ed4
HADOOP-14289. Move log4j APIs over to slf4j in hadoop-common.
2017-06-16 13:17:10 +09:00
5e7cfdca7b
HADOOP-14394. Provide Builder pattern for DistributedFileSystem.create. (lei)
2017-06-15 10:59:24 -07:00
ef8edab930
HADOOP-14523. OpensslAesCtrCryptoCodec.finalize() holds excessive amounts of memory. Contributed by Misha Dmitriev.
2017-06-15 10:40:59 -07:00
d780a67864
HADOOP-14506. Add create() contract test that verifies ancestor dir creation.
...
Contributed by Sean Mackrory.
2017-06-15 14:49:34 +01:00
8633ef8e10
HADOOP-14503. Make RollingAverages a mutable metric. Contributed by Hanisha Koneru.
2017-06-12 20:43:43 -07:00
a81916ea89
HADOOP-14501. Switch from aalto-xml to woodstox to handle odd XML features (jeagles)
2017-06-12 17:07:53 -05:00
86368cc766
HADOOP-14310. RolloverSignerSecretProvider.LOG should be @VisibleForTesting
...
(Contributed by Arun Shanmugam Kumar via Daniel Templeton)
2017-06-12 09:42:16 -07:00
a2121cb0d9
HADOOP-14465. LdapGroupsMapping - support user and group search base. Contributed by Shwetha G S and Mingliang Liu
2017-06-09 14:55:07 -07:00
c4b5c32669
HADOOP-13854. KMS should log error details in KMSExceptionsProvider.
2017-06-08 22:35:31 -07:00
0202480742
HADOOP-13174. Add more debug logs for delegation tokens and authentication.
2017-06-08 21:34:15 -07:00
5672ae7b37
HDFS-11861. ipc.Client.Connection#sendRpcRequest should log request name. Contributed by John Zhuge.
2017-06-07 15:52:52 -07:00
b65100c14b
YARN-6547. Enhance SLS-based tests leveraging invariant checker.
2017-06-06 17:19:15 -07:00
19ef3a81f8
HADOOP-14485. Redundant 'final' modifier in try-with-resources statement. Contributed by wenxin he.
2017-06-06 23:11:47 +08:00
855e0477b1
HADOOP-14035. Reduce fair call queue backoff's impact on clients. Contributed by Daryn Sharp.
2017-06-06 08:35:12 -05:00
66c6fd8314
HADOOP-14431. ModifyTime of FileStatus returned by SFTPFileSystem's getFileStatus method is wrong. Contributed by Hongyuan Li.
2017-06-06 12:31:40 +08:00
6aeda55bb8
HADOOP-14428. s3a: mkdir appears to be broken. Contributed by Mingliang Liu
2017-06-05 11:26:56 -07:00
abdd609e51
HADOOP-14440. Add metrics for connections dropped. Contributed by Eric Badger.
2017-06-06 00:21:03 +08:00
7101477e47
HDFS-11383. Intern strings in BlockLocation and ExtendedBlock. Contributed by Misha Dmitriev.
2017-06-01 15:20:18 -07:00
1543d0f5be
HDFS-5042. Completed files lost after power failure. Contributed by Vinayakumar B.
2017-05-31 10:55:03 -05:00
62857be211
HADOOP-14456. Modifier 'static' is redundant for inner enums. Contributed by ZhangBing Lin.
2017-05-31 01:07:58 +08:00
bd6a2172e0
HDFS-11891. DU#refresh should print the path of the directory when an exception is caught. Contributed by Chen Liang.
2017-05-26 16:02:40 -07:00
2cd612ba8e
Update 3.0.0-alpha3 changes, release notes, jdiff.
2017-05-26 14:14:38 -07:00
16ad896d5c
Update maven version for 3.0.0-alpha4 development
2017-05-26 14:09:44 -07:00
8bf0e2d6b3
HADOOP-14430 the accessTime of FileStatus returned by SFTPFileSystem's
...
getFileStatus method is always 0.
Contributed by Hongyuan Li.
2017-05-25 15:19:58 +01:00
1ba9704eec
HADOOP-14399. Configuration does not correctly XInclude absolute file URIs.
...
Contributed by Jonathan Eagles
2017-05-25 14:59:33 +01:00
6a52b5e144
HADOOP-14180. FileSystem contract tests to replace JUnit 3 with 4. Contributed by Xiaobing Zhou and Mingliang Liu.
2017-05-25 15:36:44 +09:00
dcf4559ebd
HADOOP-14166. Reset the DecayRpcScheduler AvgResponseTime metric to zero when queue is not used. Contributed by Surendra Singh Lilhore.
2017-05-25 01:27:13 +08:00
b7a0c0e701
HADOOP-14449. The ASF Header in ComparableVersion.java and SSLHostnameVerifier.java is not correct. Contributed by ZhangBing Lin.
2017-05-25 01:03:22 +08:00
a62be38a5e
HDFS-11793. Allow to enable user defined erasure coding policy. Contributed by Sammi Chen
2017-05-24 18:45:52 +08:00
52661e0912
HDFS-11864. Document Metrics to track usage of memory for writes. Contributed by Yiqun Lin.
2017-05-23 23:52:42 +08:00
1b5451bf05
HDFS-11794. Add ec sub command -listCodec to show currently supported ec codecs. Contributed by SammiChen.
2017-05-23 17:03:28 +05:30
2a8fcf0c9a
HDFS-11863. Document missing metrics for blocks count in pending IBR. Contributed By Yiqun Lin.
2017-05-23 02:16:25 +08:00
b6f66b0da1
YARN-6584. Correct license headers in hadoop-common, hdfs, yarn and mapreduce. Contributed by Yeliang Cang.
2017-05-22 14:10:06 +05:30
c80d3bc480
HDFS-11862. Option -v missing for du command in FileSystemShell.md. Contributed by Yiqun Lin
2017-05-21 01:23:35 -07:00
1db186f662
HDFS-11803. Add -v option for du command to show header line. Contributed by Xiaobing Zhou
2017-05-19 14:21:01 -07:00
ef9e536a71
HADOOP-14434. Use MoveFileEx to allow renaming a file when the destination exists. Contributed by Lukas Majercak
2017-05-17 17:21:03 -07:00
eb7791b474
HADOOP-14427. Avoid reloading of Configuration in ViewFileSystem creation. Contributed by Vinayakumar B
2017-05-17 13:12:14 -07:00
d4aa9e3c69
HADOOP-14415. Use java.lang.AssertionError instead of junit.framework.AssertionFailedError. Contributed by Chen Liang.
2017-05-17 15:38:28 -04:00
d87a63a901
HADOOP-14412. HostsFileReader#getHostDetails is very expensive on large clusters. Contributed by Jason Lowe.
2017-05-17 08:27:45 +05:30
7bc2172248
HADOOP-14376. Memory leak when reading a compressed file using the native library. Contributed by Eli Acherkan
2017-05-12 16:54:08 -05:00
a9e24a13b7
HADOOP-14375. Remove tomcat support from hadoop-functions.sh. Contributed by John Zhuge.
2017-05-12 08:48:51 -05:00
0d5c8ed8e0
HADOOP-14401. maven-project-info-reports-plugin can be removed. Contributed by Andras Bokor.
2017-05-11 16:37:32 -05:00
09f28da2d2
HADOOP-14413. Add Javadoc comment for jitter parameter on CachingGetSpaceUsed
...
(Contributed by Erik Krogen via Daniel Templeton)
2017-05-11 12:06:06 -07:00
4aae2d40a3
HADOOP-14410. Correct spelling of 'beginning' and variants. Contributed By Dongtao Zhang
2017-05-11 23:33:45 +05:30
3873904a94
HDFS-11800. Document output of 'hdfs count -u' should contain PATHNAME. Contributed by Xiaobing Zhou
2017-05-10 14:33:33 -07:00
a5fa954684
HADOOP-14373. License error in org.apache.hadoop.metrics2.util.Servers. Contributed by hu xiaodong.
2017-05-10 05:29:47 -05:00
06ffeb8d4d
HADOOP-14405. Fix performance regression due to incorrect use of DataChecksum. Contributed by LiXin Ge.
2017-05-10 14:16:41 +09:00
f7faac8e90
HADOOP-14377. Increase Common test timeouts from 1 second to 10 seconds. Contributed by Eric Badger
2017-05-09 16:08:34 -05:00
45382bf047
AuditLogger and TestAuditLogger are dead code. Contributed by Vrushali C
2017-05-09 10:31:52 -07:00
149b903be3
HADOOP-14384. Reduce the visibility of FileSystem.newFSDataOutputStreamBuilder before the API becomes stable. (lei)
2017-05-09 10:27:17 -07:00
543aac9f28
HADOOP-14386. Rewind trunk from Guava 21.0 back to Guava 11.0.2.
2017-05-09 09:22:53 -07:00
54fd0e44b7
HDFS-11644. Support for querying outputstream capabilities. Contributed by Manoj Govindassamy.
2017-05-08 21:59:49 -07:00
ff5ec3b841
HADOOP-14383. Implement FileSystem that reads from HTTP / HTTPS endpoints.
2017-05-08 15:28:45 -07:00
e4f34ecb04
HADOOP-14390. Correct spelling of 'succeed' and variants. Contributed by Dongtao Zhang
2017-05-05 12:10:50 -07:00
4e6bbd049d
HADOOP-14382 Remove usages of MoreObjects.toStringHelper.
...
Contributed by Andrew Wang
2017-05-05 13:03:09 +01:00
c2a52ef9c2
HDFS-11643. Add shouldReplicate option to create builder. Contributed by SammiChen.
2017-05-04 11:39:14 -07:00
81092b1f11
HDFS-11722. Change Datanode file IO profiling sampling to percentage. Contributed by Hanisha Koneru.
2017-05-03 16:29:30 -07:00
30cd265134
Revert "HDFS-11488. JN log segment syncing should support HA upgrade. Contributed by Hanisha Koneru."
...
This reverts commit 08fb82d6d1
2017-05-03 16:28:47 -07:00
08fb82d6d1
HDFS-11488. JN log segment syncing should support HA upgrade. Contributed by Hanisha Koneru.
2017-05-03 15:46:08 -07:00
83dded556d
HDFS-11739. Fix regression in tests caused by YARN-679. Contributed by Steve Loughran
2017-05-03 11:22:44 -07:00
d4631e466b
HADOOP-14372. TestSymlinkLocalFS timeouts are too low. Contributed by Eric Badger.
2017-05-03 09:47:17 -05:00
8b82317fab
HADOOP-14352. Make some HttpServer2 SSL properties optional (jzhuge via rkanter)
2017-05-02 17:51:28 -07:00
cedaf4cab9
HADOOP-14306. TestLocalFileSystem tests have very low timeouts. Contributed by Eric Badger
2017-05-02 16:50:51 -05:00
dcc292d7de
HADOOP-14369. NetworkTopology calls expensive toString() when logging. Contributed by Inigo Goiri.
2017-05-02 10:51:20 -07:00
20cde55274
HADOOP-14371. License error in TestLoadBalancingKMSClientProvider.java. Contributed by hu xiaodong.
2017-05-02 23:36:54 +09:00
b7d769d020
HADOOP-14359. Remove unnecessary shading of commons-httpclient. Contributed by Wei-Chiu Chuang.
2017-05-01 15:22:28 +09:00
c735362df7
HADOOP-14363. Inconsistent default block location in FileSystem javadoc. Contributed by Chen Liang
2017-04-29 23:49:36 -07:00
6fe11f6155
HADOOP-14320. TestIPC.testIpcWithReaderQueuing fails intermittently. Contributed by Eric Badger.
2017-04-28 14:45:26 -05:00
373bb4931f
YARN-679. Add an entry point that can start any Yarn service. Contributed by Steve Loughran.
2017-04-28 10:45:02 -07:00
cb672a45a0
HDFS-11605. Allow user to customize new erasure code policies. Contributed by Huafeng Wang
2017-04-28 13:18:50 +08:00
689fb2fc66
HADOOP-14354. SysInfoWindows is not thread safe. Contributed by Inigo Goiri
2017-04-27 16:26:39 -07:00
31cf480d65
HADOOP-14309. Add PowerShell NodeFencer. Contributed by Inigo Goiri
2017-04-27 16:09:28 -07:00
bbf8cac14d
HADOOP-13200. Implement customizable and configurable erasure coders. Contributed by Tim Yao.
2017-04-27 12:39:47 -07:00
ddaeb3e497
Revert "HADOOP-13200. Implement customizable and configurable erasure coders. Contributed by Tim Yao."
...
This reverts commit 872088c6e7
2017-04-27 12:25:47 -07:00
872088c6e7
HADOOP-13200. Implement customizable and configurable erasure coders. Contributed by Tim Yao.
2017-04-27 11:59:33 -07:00
61cda39e4e
HADOOP-14346. CryptoOutputStream throws IOException if stream is closed.
...
Contributed by Pierre Lacave
(cherry picked from commit 40b9c30d64
2017-04-27 12:19:04 +01:00
edd693833b
HADOOP-14340. Enable KMS and HttpFS to exclude SSL ciphers. Contributed by John Zhuge.
2017-04-26 11:44:59 -07:00
9ccb849eb6
HADOOP-14341. Support multi-line value for ssl.server.exclude.cipher.list. Contributed by John Zhuge.
2017-04-25 22:06:51 -07:00
4ea2778acb
HADOOP-14207. "dfsadmin -refreshCallQueue" fails with DecayRpcScheduler. Contributed by Surendra Singh Lihore.
2017-04-25 18:45:56 -07:00
d11d280b8b
HADOOP-12856. FileUtil.checkDest() and RawLocalFileSystem.mkdirs() to throw stricter IOEs; RawLocalFS contract tests to verify. Contributed by Steve Loughran
2017-04-25 18:33:41 -07:00
a22fe02fba
HADOOP-14261. Some refactoring work for erasure coding raw coder. Contributed by Lin Zeng.
2017-04-21 11:35:36 -07:00
667966c13c
HADOOP-14324. Refine S3 server-side-encryption key as encryption secret; improve error reporting and diagnostics. Contributed by Steve Loughran
2017-04-20 17:13:36 -07:00
f356f0f4cf
YARN-6453. fairscheduler-statedump.log gets generated regardless of service
...
(Contributed by Yufei Gu via Daniel Templeton)
2017-04-20 14:13:07 -07:00
0344bea3fd
HADOOP-14241. Add ADLS sensitive config keys to default list. Contributed by John Zhuge.
2017-04-19 11:50:54 -07:00
d4483a2fe4
HADOOP-13997. Typo in metrics docs (Contributed by Ana Krasteva via Daniel Templeton)
2017-04-19 09:41:09 -07:00
a9f07e0d3e
HADOOP-14317. KMSWebServer$deprecateEnv may leak secret. Contributed by John Zhuge.
2017-04-18 09:29:16 -07:00
654372db85
HADOOP-14315. Python example in the rack awareness document doesn't work due to bad indentation
...
This closes #214
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2017-04-18 17:14:22 +09:00
84a8848aae
HADOOP-14318. Remove non-existent setfattr command option from FileSystemShell.md. Contributed by Doris Gu.
2017-04-18 16:43:50 +09:00
c0ca785dbb
HDFS-11652. Improve ECSchema and ErasureCodingPolicy toString, hashCode, equals.
2017-04-17 16:30:25 -07:00
b053fdc547
HADOOP-14255. S3A to delete unnecessary fake directory objects in mkdirs(). Contributed by Mingliang Liu
2017-04-12 14:30:34 -07:00
4dd6206547
HADOOP-14246. Authentication Tokens should use SecureRandom instead of Random and 256 bit secrets
...
(Conttributed by Robert Konter via Daniel Templeton)
2017-04-12 11:17:31 -07:00
b8305e6d06
HADOOP-14248. Retire SharedInstanceProfileCredentialsProvider in trunk. Contributed by Mingliang Liu.
2017-04-12 10:02:13 -07:00
23b1a7bdf1
HDFS-11163. Mover should move the file blocks to default storage once policy is unset. Contributed by Surendra Singh Lilhore.
2017-04-11 22:03:09 -07:00
f050afb578
HADOOP-13665. Erasure Coding codec should support fallback coder. Contributed by Kai Sasaki.
2017-04-11 07:32:13 -07:00
0e065f2ede
YARN-6195. Export UsedCapacity and AbsoluteUsedCapacity to JMX. Contributed by Benson Qiu
2017-04-11 08:44:18 -05:00
a5e57df3c5
HADOOP-14225. Remove xmlenc dependency
2017-04-10 11:48:40 -07:00
be144117a8
HADOOP-14293. Initialize FakeTimer with a less trivial value.
2017-04-10 11:37:01 -07:00
2ed65540a3
HADOOP-14066 VersionInfo should be marked as public API
2017-04-08 13:41:10 +01:00
56e81f2a20
HADOOP-14174. Set default ADLS access token provider type to ClientCredential. Contributed by John Zhuge.
...
Signed-off-by: John Zhuge <jzhuge@apache.org>
2017-04-07 12:04:44 -07:00
96cbb4fce2
HADOOP-14202. fix jsvc/secure user var inconsistencies
...
Signed-off-by: John Zhuge <jzhuge@apache.org>
2017-04-07 08:59:21 -07:00
95b7f1d29a
HADOOP-14276. Add a nanosecond API to Time/Timer/FakeTimer. Contributed by Erik Krogen.
2017-04-06 16:59:21 -07:00
32bb36b750
HDFS-11302. Improve Logging for SSLHostnameVerifier. Contributed by Chen Liang.
2017-04-05 17:28:00 -07:00
18432130a7
HADOOP-14104. Client should always ask namenode for kms provider path. Contributed by Rushabh S Shah.
2017-04-04 13:38:25 -07:00
6eba79232f
HADOOP-14271. Correct spelling of 'occurred' and variants. Contributed by Yeliang Cang
2017-04-03 20:13:14 -07:00
bbd68478d5
HDFS-11598. Improve -setrep for Erasure Coded files. Contributed by Yiqun Lin.
2017-04-03 07:57:28 -07:00
1309c585fb
HADOOP-14216. Addendum to Improve Configuration XML Parsing Performance (jeagles)
2017-03-30 14:14:43 -05:00
8c591b8d19
HDFS-10974. Document replication factor for EC files. Contributed by Yiqun Lin.
2017-03-30 11:16:05 -07:00
7297e82cb4
HADOOP-14250. Correct spelling of 'separate' and variants. Contributed by Doris Gu
2017-03-30 10:17:11 -07:00
4966a6e26e
HADOOP-14223. Extend FileStatus#toString() to include details like Erasure Coding and Encryption. Contributed by Manoj Govindassamy.
2017-03-29 14:37:21 -07:00
13c766b62c
HADOOP-14247. FileContextMainOperationsBaseTest should clean up test root path. Contributed by Mingliang Liu
2017-03-29 11:13:39 -07:00
523f467d93
HADOOP-14216. Improve Configuration XML Parsing Performance (jeagles)
2017-03-29 10:12:02 -05:00
6b09336438
HDFS-11577. Combine the old and the new chooseRandom for better performance. Contributed by Chen Liang.
2017-03-28 23:02:07 +08:00
253e3e78ab
HADOOP-14038. Rename ADLS credential properties. Contributed by John Zhuge.
2017-03-27 23:05:57 -07:00
448ec81fd7
HADOOP-14218. Replace assertThat with assertTrue in MetricsAsserts.
2017-03-28 14:32:40 +09:00
db2adf356a
Configuration#get return value optimization (jeagles)
2017-03-27 12:48:44 -05:00
858d597be0
Delay construction of PreCondition.check failure message in Configuration#set (jeagles)
2017-03-27 11:01:48 -05:00
6df029db36
Add COMMON/MAPREDUCE/YARN jdiff of 2.8.0 release.
2017-03-25 14:28:48 -07:00
d8e6d6df4c
Add 2.8.0 RELEASENOTEs.md and CHANGES.md.
2017-03-25 14:02:25 -07:00
84ddedc0b2
HADOOP-10101. Update guava dependency to the latest version. (ozawa)
2017-03-25 10:06:52 +09:00
332a997e10
HDFS-11170. Add builder-based create API to FileSystem. Contributed by SammiChen and Wei Zhou.
2017-03-24 12:56:46 -07:00
52b00600df
HADOOP-13715. Add isErasureCoded() API to FileStatus class. Contributed by Manoj Govindassamy.
2017-03-24 11:44:46 -07:00
d49d1862a6
YARN-6360. Prevent FS state dump logger from cramming other log files
...
(Contributed by Yufei Gu via Daniel Templeton)
2017-03-24 11:31:04 -07:00
0e556a5ba6
HADOOP-14211. FilterFs and ChRootedFs are too aggressive about enforcing 'authorityNeeded'. Contributed by Erik Krogen.
2017-03-24 11:12:02 -07:00
ab759e91b7
HDFS-10649. Remove unused PermissionStatus#applyUMask. Contributed by Chen Liang.
2017-03-23 23:31:27 -07:00
128015584d
HADOOP-14195. CredentialProviderFactory$getProviders is not thread-safe. Contributed by Vihang Karajgaonkar.
2017-03-23 13:57:08 -07:00
d35e79abc2
HADOOP-14214. DomainSocketWatcher::add()/delete() should not self interrupt while looping await(). Contributed by Mingliang Liu
2017-03-23 13:34:03 -07:00
595f62e362
HADOOP-14213. Move Configuration runtime check for hadoop-site.xml to initialization. Contributed by Jonathan Eagles
2017-03-23 09:28:10 -07:00
59d69257a8
HADOOP-9631. ViewFs should use underlying FileSystem's server side defaults. Contributed by Lohit Vijayarenu and Erik Krogen.
2017-03-22 22:22:22 -07:00
e1a99802fc
HADOOP-14169. Implement listStatusIterator, listLocatedStatus for ViewFs. Contributed by Erik Krogen.
2017-03-17 17:12:49 -07:00
92ea6d74ec
HDFS-11516. Admin command line should print message to stderr in failure case. Contributed by Kai Sasaki.
2017-03-17 11:26:02 -07:00
c04fb35c45
HADOOP-14191. Duplicate hadoop-minikdc dependency in hadoop-common module. Contributed by Xiaobing Zhou
2017-03-16 16:08:32 -07:00
09ad8effb8
HDFS-11533. reuseAddress option should be used for child channels in Portmap and SimpleTcpServer. Contributed by Mukul Kumar Singh.
2017-03-16 12:20:46 -07:00
fa67a96d7b
HADOOP-14170. FileSystemContractBaseTest is not cleaning up test directory clearly. Contributed by Mingliang Liu
2017-03-14 14:38:21 -07:00
e6cda5819b
Revert "HADOOP-14170. FileSystemContractBaseTest is not cleaning up test directory clearly. Contributed by Mingliang Liu"
...
This reverts commit b8c69557b7
2017-03-14 13:03:42 -07:00
9832ae0ed8
HDFS-11482. Add storage type demand to into DFSNetworkTopology#chooseRandom. Contributed by Chen Liang.
2017-03-13 17:30:10 -07:00
55796a0946
HDFS-11395. RequestHedgingProxyProvider#RequestHedgingInvocationHandler hides the Exception thrown from NameNode. Contributed by Nandakumar.
2017-03-13 14:24:51 -07:00
b8c69557b7
HADOOP-14170. FileSystemContractBaseTest is not cleaning up test directory clearly. Contributed by Mingliang Liu
2017-03-13 14:15:02 -07:00
04a5f5a6dc
HADOOP-14156. Fix grammar error in ConfTest.java.
...
This closes #187
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2017-03-13 16:15:53 +09:00
4db9cc70d0
YARN-6042. Dump scheduler and queue state information into FairScheduler DEBUG log. (Yufei Gu via rchiang)
2017-03-10 16:13:31 -08:00
4478273e5f
HADOOP-14062. ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled. Contributed by Steven Rand
2017-03-10 09:25:58 -08:00
fd26783aaf
HADOOP-13946. Document how HDFS updates timestamps in the FS spec; compare with object stores. Contributed by Steve Loughran
2017-03-10 00:21:20 -08:00
570827a819
HADOOP-14052. Fix dead link in KMS document. Contributed by Christina Vu.
...
Change-Id: I7093f443d93927184196f62f02cc106a2c89e9cf
2017-03-08 23:50:15 -08:00
2be8947d12
Revert "HADOOP-14062. ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled. Contributed by Steven Rand"
...
This reverts commit 241c1cc05b
2017-03-08 13:20:01 -08:00
241c1cc05b
HADOOP-14062. ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled. Contributed by Steven Rand
2017-03-08 10:48:27 -08:00
98142d2f72
Revert "HADOOP-13606 swift FS to add a service load metadata file. Contributed by Steve Loughran"
...
This reverts commit 53a12fa721
2017-03-08 09:54:22 -08:00
1f9848dfe1
HDFS-11508. Fix bind failure in SimpleTCPServer & Portmap where bind fails because socket is in TIME_WAIT state. Contributed by Mukul Kumar Singh.
2017-03-07 11:41:05 -08:00
959940b0ab
HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru.
2017-03-07 10:12:35 -08:00
686823529b
HADOOP-13930. Azure: Add Authorization support to WASB. Contributed by Sivaguru Sankaridurg and Dushyanth
2017-03-06 17:16:36 -08:00
52d7d5aa1a
Revert "HADOOP-13930. Azure: Add Authorization support to WASB. Contributed by Sivaguru Sankaridurg and Dushyanth"
...
This reverts commit 6b7cd62b8c
2017-03-06 17:10:11 -08:00
d9dc444dc7
YARN-5665. Enhance documentation for yarn.resourcemanager.scheduler.class property. (Yufei Gu via rchiang)
2017-03-06 14:02:49 -08:00
ec839b94c0
HDFS-11441. Add escaping to error message in KMS web UI. Contributed by Aaron T. Myers.
2017-03-06 10:47:15 -08:00
209ecd1a5c
HADOOP-14108. CLI MiniCluster: add an option to specify NameNode HTTP port. Contributed by Takanobu Asanuma.
2017-03-07 01:34:51 +09:00
6b7cd62b8c
HADOOP-13930. Azure: Add Authorization support to WASB. Contributed by Sivaguru Sankaridurg and Dushyanth
2017-03-03 17:09:12 -08:00
05237636d3
YARN-6274. Documentation refers to incorrect nodemanager health checker interval property. Contributed by WeiWei Yang
2017-03-03 07:57:37 -06:00
eb5a17954a
HADOOP-6801. io.sort.mb and io.sort.factor were renamed and moved to mapreduce but are still in CommonConfigurationKeysPublic.java and used in SequenceFile.java.
...
This closes #146
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2017-03-03 18:38:04 +09:00
3749152b66
HDFS-11416. Refactor out system default erasure coding policy. Contributed by Andrew Wang.
2017-03-03 09:28:03 +05:30
8f4817f2c5
Revert "HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru."
...
This reverts commit e61491d476
2017-03-02 16:20:48 -08:00
e61491d476
HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru.
2017-03-02 15:38:25 -08:00
eeca8b0c4e
HDFS-11419. HDFS specific network topology classes with storage type info included. Contributed by Chen Liang.
2017-03-02 09:21:27 -08:00
899d5c4d49
HDFS-11479. Socket re-use address option should be used in SimpleUdpServer. Contributed by Mukul Kumar Singh.
2017-03-01 12:59:02 -08:00
dcd03df9f9
HDFS-11432. Federation : Support fully qualified path for Quota/Snapshot/cacheadmin/cryptoadmin commands. Contributed by Brahma Reddy Battula.
2017-03-01 10:45:56 +05:30
258342e76c
HADOOP-14118. move jets3t into a dependency on hadoop-aws JAR.
2017-02-28 13:47:44 +09:00
9db2e0c8d4
HADOOP-14119. Remove unused imports from GzipCodec.java. Contributed by Yiqun Lin.
2017-02-27 18:39:14 +08:00
289bc50e66
HADOOP-14116:FailoverOnNetworkExceptionRetry does not wait when failover
...
on certain exception. Contributed by Jian He
2017-02-24 11:42:23 -08:00
c1a52b04d0
HDFS-11427. Rename rs-default to rs.
2017-02-24 10:58:45 -08:00
e8694deb6a
HADOOP-13817. Add a finite shell command timeout to ShellBasedUnixGroupsMapping. (harsh)
2017-02-24 21:34:00 +05:30
50decd3613
HADOOP-14097. Remove Java6 specific code from GzipCodec.java. Contributed by Elek, Marton.
2017-02-25 00:28:31 +09:00
132f758e3d
HDFS-11426. Refactor EC CLI to be similar to storage policies CLI.
2017-02-23 16:00:11 -08:00
a4d4a23785
HADOOP-13321. Deprecate FileSystem APIs that promote inefficient call patterns. Contributed by Chris Nauroth and Mingliang Liu
2017-02-23 12:55:40 -08:00
003ae00693
HDFS-11430. Separate class InnerNode from class NetworkTopology and make it extendable. Contributed by Tsz Wo Nicholas Sze
2017-02-21 15:32:46 -08:00
172b23af33
HADOOP-14077. Add ability to access jmx via proxy. Contributed by Yuanbo Liu.
2017-02-18 18:34:13 -08:00
4c26c241ad
HADOOP-13805. UGI.getCurrentUser() fails if user does not have a keytab associated. Contributed by Xiao Chen, Wei-Chiu Chuang, Yongjun Zhang.
2017-02-17 09:18:50 -08:00
5690b51ef7
HDFS-11100. Recursively deleting file protected by sticky bit should fail. Contributed by John Zhuge.
2017-02-16 05:39:37 -08:00
cc45da79fd
HADOOP-13233. help of stat is confusing. Contributed by Attila Bukor.
2017-02-13 10:14:45 -08:00
0aacd8fd25
HDFS-11403. Zookeper ACLs on NN HA enabled clusters should be handled consistently. Contributed by Hanisha Koneru.
2017-02-11 01:17:56 -08:00
0c01cf5798
HADOOP-14033. Reduce fair call queue lock contention. Contributed by Daryn Sharp.
2017-02-09 16:17:24 -06:00
b6bb99c18a
HADOOP-14034. Allow ipc layer exceptions to selectively close connections. Contributed by Daryn Sharp.
2017-02-09 10:47:29 -06:00
a0bfb41504
HADOOP-14032. Reduce fair call queue priority inversion. Contributed by Daryn Sharp.
2017-02-09 10:04:28 -06:00
eec52e158b
YARN-6145. Improve log message on fail over. Contributed by Jian He.
2017-02-08 02:11:19 -08:00
2007e0cf2a
HDFS-11210. Enhance key rolling to guarantee new KeyVersion is returned from generateEncryptedKeys after a key is rolled.
2017-02-07 20:36:11 -08:00
69b23632c4
HDFS-10860. Switch HttpFS from Tomcat to Jetty. Contributed by John Zhuge.
2017-02-07 09:36:55 -08:00
d88497d44a
HADOOP-14047. Require admin to access KMS instrumentation servlets. Contributed by John Zhuge.
2017-02-06 13:14:17 -08:00
cce35c3815
HADOOP-12097. Allow port range to be specified while starting webapp. Contributed by Varun Saxena.
2017-02-05 19:42:11 -08:00
3ea6d3517e
HDFS-11371. Document missing metrics of erasure coding. Contributed by Yiqun Lin.
2017-02-04 11:01:27 +08:00
cb8f3f3adf
HADOOP-14053. Update the link to HTrace SpanReceivers. Contributed by Yiqun Lin.
2017-02-04 10:58:08 +09:00
ba75bc7593
HADOOP-14044. Synchronization issue in delegation token cancel functionality. Contributed by Hrishikesh Gadre.
2017-02-03 17:13:53 -08:00
59c5f18784
HADOOP-13895. Make FileStatus Serializable
2017-02-01 10:19:36 -08:00
ebd40056a0
HADOOP-13992. KMS should load SSL configuration the same way as SSLFactory. Contributed by John Zhuge.
2017-01-27 10:49:26 -08:00
2034315763
HADOOP-14029. Fix KMSClientProvider for non-secure proxyuser use case. Contributed by Xiaoyu Yao.
2017-01-26 20:34:32 -08:00
ff02bdfe65
Add CHANGES, RELEASENOTES, and jdiff for 3.0.0-alpha2 release.
2017-01-25 15:39:40 -08:00
9e19f758c1
YARN-5641. Localizer leaves behind tarballs after container is complete. Contributed by Eric Badger
2017-01-25 21:41:43 +00:00
a46933e8ce
HADOOP-13988. KMSClientProvider does not work with WebHDFS and Apache Knox w/ProxyUser. Contributed by Greg Senia and Xiaoyu Yao.
2017-01-25 13:33:06 -08:00
7fc3e68a87
HADOOP-13433 Race in UGI.reloginFromKeytab. Contributed by Duo Zhang.
2017-01-25 21:29:27 +00:00
9c0a4d3e71
HADOOP-13990. Document KMS usage of CredentialProvider API. Contributed by John Zhuge.
2017-01-24 21:30:10 -08:00
b57368b6f8
HDFS-11194. Maintain aggregated peer performance metrics on NameNode.
2017-01-24 16:58:20 -08:00
a847903b6e
HADOOP-13119. Add ability to secure log servlet using proxy users. Contribute by Yuanbo Liu.
2017-01-21 15:43:18 -08:00
e015b56319
HADOOP-13956. Read ADLS credentials from Credential Provider. (John Zhuge via lei)
2017-01-20 14:48:04 +08:00
5d8b80ea9b
Preparing for 3.0.0-alpha3 development
2017-01-19 15:50:07 -08:00
f5839fd6df
YARN-6028. Add document for container metrics (Contributed by Weiwei Yang via Daniel Templeton)
2017-01-19 12:45:17 -08:00
1763467210
HADOOP-14001. Improve delegation token validity checking.
2017-01-19 17:56:39 +09:00
383aa9c9f5
HADOOP-13965. Groups should be consistent in using default group mapping class. Contributed by Yiqun Lin.
2017-01-19 09:42:56 +08:00
0eb4b513b7
HADOOP-13673. Update scripts to be smarter when running with privilege
...
Signed-off-by: Andrew Wang <wang@apache.org>
Signed-off-by: Ravi Prakash <raviprak@apache.org>
2017-01-18 14:39:05 -08:00
9130af3f74
HADOOP-13955. Replace deprecated HttpServer2 and SSLFactory constants. Contributed by John Zhuge.
2017-01-18 18:11:33 +09:00
706d630eb9
HADOOP-13976. Path globbing does not match newlines. Contributed by Eric Badger.
2017-01-17 15:10:24 -06:00
e407449ddb
HADOOP-13933. Add haadmin -getAllServiceState option to get the HA state of all the NameNodes/ResourceManagers. Contributed by Surendra Singh Lilhore.
2017-01-17 10:10:23 +09:00
d1d0b3e1fd
HDFS-11307. The rpc to portmap service for NFS has hardcoded timeout. Contributed by Mukul Kumar Singh.
2017-01-16 14:53:53 -08:00
ed09c1418d
HADOOP-13928. TestAdlFileContextMainOperationsLive.testGetFileContext1 runtime error. (John Zhuge via lei)
2017-01-15 14:02:11 +08:00
5f336512d0
HADOOP-13961. Fix compilation failure from missing hadoop-kms test jar. Contributed by Sangjin Lee and John Zhuge.
2017-01-11 15:48:50 -08:00
e648b6e138
HADOOP-13336 S3A to support per-bucket configuration. Contributed by Steve Loughran
2017-01-11 17:25:15 +00:00
be529dade1
HADOOP-13903. Improvements to KMS logging to help debug authorization errors. (Tristan Stevens via asuresh)
2017-01-11 00:26:02 -08:00
4046794a53
HDFS-11299. Support multiple Datanode File IO hooks. Contributed by Hanisha Koneru.
2017-01-10 10:43:11 -08:00
511d39e074
HADOOP-13885. Implement getLinkTarget for ViewFileSystem. Contributed by Manoj Govindassamy.
2017-01-09 18:01:37 -08:00
0a212a40fc
HADOOP-13953. Make FTPFileSystem's data connection mode and transfer mode configurable. Contributed by Xiao Chen.
2017-01-09 15:18:26 -08:00
4a659ff40f
HDFS-11282. Document the missing metrics of DataNode Volume IO operations. Contributed by Yiqun Lin.
2017-01-05 19:34:32 -08:00
5d182949ba
HADOOP-13597. Switch KMS from Tomcat to Jetty. Contributed by John Zhuge.
2017-01-05 17:21:57 -08:00
a0a2761621
HADOOP-13578. Add Codec for ZStandard Compression. Contributed by churro morales
2017-01-04 14:46:25 +00:00
01d31fe938
HADOOP-12733. Remove references to obsolete io.seqfile configuration variables. Contributed by Ray Chiang.
2017-01-04 14:10:36 +09:00
88731c731a
Revert "HADOOP-13946. Document how HDFS updates timestamps in the FS spec; compare with object stores. Contributed by Steve Loughran"
...
This reverts commit 451efb08fe
2017-01-03 14:44:26 -08:00
451efb08fe
HADOOP-13946. Document how HDFS updates timestamps in the FS spec; compare with object stores. Contributed by Steve Loughran
2017-01-03 13:08:38 -08:00
591fb15944
YARN-5529. Create new DiskValidator class with metrics (yufeigu via rkanter)
2017-01-03 12:13:32 -08:00
6938b67711
HADOOP-13883. Addendum patch to correct the message and alphabetized with the earlier patch. Contributed by Yiqun Lin.
2016-12-31 16:16:02 +05:30
0665c5f09a
HADOOP-13943. TestCommonConfigurationFields#testCompareXmlAgainstConfigurationClass fails after HADOOP-13863. Contributed by Brahma Reddy Battula.
2016-12-28 01:39:30 +09:00
ded2d08f33
HADOOP-13940. Document the missing envvars commands (Contributed by Yiqun Lin via Daniel Templeton)
2016-12-27 07:18:08 -08:00
4e9029653d
HDFS-10917. Collect peer performance statistics on DataNode. Contributed by Xiaobing Zhou.
2016-12-22 23:46:58 -08:00
e92a77099b
HADOOP-13863. Azure: Add a new SAS key mode for WASB. Contributed by Dushyanth
2016-12-22 20:15:18 -08:00
22befbd585
MAPREDUCE-6704. Update the documents to run MapReduce application. Contributed by Bibin A Chundatt.
2016-12-23 04:48:04 +09:00
56a13a6a59
HDFS-11216. Add remoteBytesRead counter metrics for erasure coding reconstruction task. Contributed by Sammi Chen
2016-12-22 14:18:54 +08:00
f6e2521eb2
HDFS-11261. Document missing NameNode metrics. Contributed by Yiqun Lin.
2016-12-21 14:17:47 +09:00
30f85d7a88
HADOOP-13911. Remove TRUSTSTORE_PASSWORD related scripts from KMS. Contributed by John Zhuge.
2016-12-20 16:02:26 -08:00
631f1daee3
HADOOP-13709. Ability to clean up subprocesses spawned by Shell when the process exits. Contributed by Eric Badger
2016-12-15 20:52:40 +00:00
169bfc0903
Revert "HADOOP-13709. Ability to clean up subprocesses spawned by Shell when the process exits. Contributed by Eric Badger"
...
This reverts commit 9947aeb60c
2016-12-15 20:51:24 +00:00
f5e0bd30fd
HADOOP-13890. Maintain HTTP/host as SPNEGO SPN support and fix KerberosName parsing. Contributed by Xiaoyu Yao.
2016-12-14 13:45:21 -08:00
6ba9587d37
HDFS-10958. Add instrumentation hooks around Datanode disk IO.
2016-12-14 11:18:58 -08:00
72bff192cd
HDFS-11204. Document the missing options of hdfs zkfc command. Contributed by Yiqun Lin.
2016-12-14 18:50:43 +09:00
9947aeb60c
HADOOP-13709. Ability to clean up subprocesses spawned by Shell when the process exits. Contributed by Eric Badger
2016-12-13 22:55:09 +00:00
f66f61892a
HADOOP-13852 hadoop build to allow hadoop version property to be explicitly set. Contriibuted by Steve Loughran
2016-12-12 13:58:27 +00:00
4c38f11cec
HADOOP-13565. KerberosAuthenticationHandler#authenticate should not rebuild SPN based on client request. Contributed by Xiaoyu Yao.
2016-12-09 21:27:04 -08:00
b606e025f1
HADOOP-13824. FsShell can suppress the real error if no error message is present. Contributed by John Zhuge.
2016-12-09 15:22:21 -08:00
80b8023276
HADOOP-13883. Add description of -fs option in generic command usage. Contributed By Yiqun Lin.
2016-12-09 18:21:42 +05:30
7d8e440eee
Revert "HADOOP-13852 hadoop build to allow hadoop version property to be explicitly set. Contriibuted by Steve Loughran"
...
This reverts commit c265515725
2016-12-09 12:49:27 +09:00
c265515725
HADOOP-13852 hadoop build to allow hadoop version property to be explicitly set. Contriibuted by Steve Loughran
2016-12-08 17:57:15 +00:00
0ef796174e
HADOOP-13867. FilterFileSystem should override rename(.., options) to take effect of Rename options called via FilterFileSystem implementations. Contributed By Vinayakumar B.
2016-12-08 18:57:43 +05:30
deb4743b2c
Revert "HDFS-11140. Directory Scanner should log startup message time correctly. Contributed by Yiqun Lin."
...
This reverts commit 0857641f62
2016-12-08 13:37:06 +09:00
0857641f62
HDFS-11140. Directory Scanner should log startup message time correctly. Contributed by Yiqun Lin.
2016-12-08 13:34:45 +09:00
c73e08a6da
HDFS-10206. Datanodes not sorted properly by distance when the reader isn't a datanode. (Nandakumar via mingma)
2016-12-07 08:26:09 -08:00
c8d0a049b0
HADOOP-13859. TestConfigurationFieldsBase fails for fields that are DEFAULT values of skipped properties. (Haibo Chen via kasha)
2016-12-06 14:10:58 -08:00
f53b481ffe
HDFS-11172. Support an erasure coding policy using RS 10 + 4. Contributed by Wei Zhou.
2016-12-06 12:49:38 -08:00
79d90b810c
HADOOP-13827. Add reencryptEncryptedKey interface to KMS.
2016-12-06 12:04:04 -08:00
7b988e8899
HADOOP-13861. Spelling errors in logging and exceptions for code. Contributed by Grant Sohn.
2016-12-05 23:18:18 -08:00
b2a3d6c519
HADOOP-13835. Move Google Test Framework code from mapreduce to hadoop-common. Contributed by Varun Vasudev.
2016-12-06 14:01:47 +09:00
a2b5d60220
HADOOP-13864. KMS should not require truststore password. Contributed by Mike Yoder.
2016-12-05 17:36:00 -08:00
291df5c7fb
HADOOP-13847. KMSWebApp should close KeyProviderCryptoExtension. Contributed by John Zhuge.
2016-12-05 09:35:17 -08:00
19f373a46b
HDFS-11132. Allow AccessControlException in contract tests when getFileStatus on subdirectory of existing files. Contributed by Vishwajeet Dusane
2016-12-01 12:54:28 -08:00
1f7613be95
HADOOP-13840. Implement getUsed() for ViewFileSystem. Contributed by Manoj Govindassamy.
2016-11-30 17:55:12 -08:00
51e6c1cc3f
HDFS-10994. Support an XOR policy XOR-2-1-64k in HDFS. Contributed by Sammi Chen
2016-11-30 15:52:56 +08:00
cfd8076f81
Revert due to an error "HDFS-10994. Support an XOR policy XOR-2-1-64k in HDFS. Contributed by Sammi Chen"
...
This reverts commit 5614f847b2ef2a5b70bd9a06edc4eba06174c6.
2016-11-30 15:44:52 +08:00
00096dcc0c
HADOOP-13812. Upgrade Tomcat to 6.0.48. Contributed by John Zhuge.
2016-11-29 19:47:02 +09:00
67d9f2808e
HADOOP-13706. Update jackson from 1.9.13 to 2.x in hadoop-common-project.
2016-11-29 14:07:19 +09:00
47ca9e26fb
HADOOP-13838. KMSTokenRenewer should close providers (xiaochen via rkanter)
2016-11-28 18:08:09 -08:00
a2b1ff0257
HADOOP-13828. Implement getFileChecksum(path, length) for ViewFileSystem. Contributed by Manoj Govindassamy.
2016-11-28 11:54:43 -08:00
5d5614f847
HDFS-10994. Support an XOR policy XOR-2-1-64k in HDFS. Contributed by Sammi Chen
2016-11-28 14:34:44 +08:00
209e805430
HADOOP-13506. Redundant groupid warning in child projects. Contributed by Kai Sasaki.
2016-11-28 14:34:57 +09:00
07825f2b49
HADOOP-1381. The distance between sync blocks in SequenceFiles should be configurable rather than hard coded to 2000 bytes. Contributed by Harsh J.
2016-11-25 22:22:23 +05:30
ee3d437a33
HADOOP-13820. Replace ugi.getUsername() with ugi.getShortUserName() in viewFS. Contributed By Brahma Reddy Battula.
2016-11-25 19:54:50 +05:30
01665e456d
HADOOP-10776 Open up already widely-used APIs for delegation-token fetching & renewal to ecosystem projects. Contributed by Vinod Kumar Vavilapalli
...
Cherry picked from 24715cefe8
2016-11-24 17:54:10 +00:00
3df3fa396c
HADOOP-13833 TestSymlinkHdfsFileSystem#testCreateLinkUsingPartQualPath2 fails after HADOOP-13605. Contributed by Brahma Reddy Battula.
2016-11-24 17:44:36 +00:00
13501053dd
HADOOP-11603. Metric Snapshot log can be changed #MetricsSystemImpl.java since all the services will be initialized. Contributed By Brahma Reddy Battula.
2016-11-24 22:23:22 +05:30
abb9fa7fc6
HADOOP-13018. Make Kdiag check whether hadoop.token.files points to existent and valid files. Contributed by Ravi Prakash
2016-11-24 16:41:59 +00:00
c7a5f2906f
HADOOP-13766. Fix a typo in the comments of RPC.getProtocolVersion. Contributed by Ethan Li.
2016-11-23 17:08:38 -08:00
860d49aa6a
HADOOP-13605. Clean up FileSystem javadocs, logging; improve diagnostics on FS load. Contributed by Steve Loughran
2016-11-23 16:42:27 -08:00
de4894936a
HDFS-11368. Erasure Coding: Deprecate replication-related config keys. Contributed by Rakesh R.
2016-11-23 16:42:06 -08:00
dd98a8005a
HDFS-11058. Implement 'hadoop fs -df' command for ViewFileSystem. Contributed by Manoj Govindassamy.
2016-11-23 16:40:39 -08:00
3d94da1e00
HADOOP-11552. Allow handoff on the server side for RPC requests. Contributed by Siddharth Seth
2016-11-23 16:01:55 -08:00
2bf9a15e8a
HADOOP-13166. Add getFileStatus("/") test to AbstractContractGetFileStatusTest. Contributed by Steve Loughran
2016-11-22 14:27:23 -08:00
3a09e5970d
HDFS-11145. Implement getTrashRoot() for ViewFileSystem. (Manoj Govindassamy via lei)
2016-11-22 13:52:09 -08:00
beb70fed4f
HADOOP-13655. document object store use with fs shell and distcp. Contributed by Steve Loughran
...
This closes #131
2016-11-22 13:12:23 -08:00
afcf8d38e7
HADOOP-13646. Remove outdated overview.html. Contributed By Brahma Reddy Battula.
2016-11-22 19:45:45 +05:30
c65d6b6541
HADOOP-13814. Sample configuration of KMS HTTP Authentication signature is misleading. Contributed by Masahiro Tanaka.
2016-11-21 11:25:11 +09:00
c0b1a44f6c
HADOOP-13660. Upgrade commons-configuration version. Contributed by Sean Mackrory.
2016-11-17 22:48:35 -06:00
ae8849fe37
HADOOP-11601. Enhance FS spec & tests to mandate FileStatus.getBlocksize() >0 for non-empty files. Contributed by Steve Loughran
2016-11-17 14:11:38 -08:00
bd3735554f
HADOOP-13742. Expose NumOpenConnectionsPerUser as a metric. Brahma Reddy Battula.
2016-11-17 12:16:38 -06:00
aab9737a05
HADOOP-13822. Use GlobalStorageStatistics.INSTANCE.reset() at FileSystem#clearStatistics(). Contribute by Brahma Reddy Battula
2016-11-16 20:08:48 -08:00
61c0bedf77
HADOOP-13815. TestKMS#testDelegationTokensOpsSimple and TestKMS#testDelegationTokensOpsKerberized Fails in Trunk.
2016-11-15 16:26:27 -08:00
5af572b644
HADOOP-13427. Eliminate needless uses of FileSystem#{exists(), isFile(), isDirectory()}. Contributed by Steve Loughran and Mingliang Liu
2016-11-15 10:57:00 -08:00
04014c4c73
HADOOP-13810. Add a test to verify that Configuration handles &-encoded characters. Contributed by Steve Loughran
...
This closes #158
2016-11-14 19:38:10 -08:00
ff0b99eafe
HDFS-10872. Add MutableRate metrics for FSNamesystemLock operations. Contributed by Erik Krogen.
2016-11-14 11:05:29 -08:00
5c61ad2488
HADOOP-13037. Refactor Azure Data Lake Store as an independent FileSystem. Contributed by Vishwajeet Dusane
2016-11-11 11:15:07 -08:00
fd2f22adec
HADOOP-13720. Add more info to the msgs printed in AbstractDelegationTokenSecretManager. Contributed by Yongjun Zhang.
2016-11-10 22:42:59 -08:00
470bdaa27a
HADOOP-12718. Incorrect error message by fs -put local dir without permission. (John Zhuge via Yongjun Zhang)
2016-11-10 22:38:38 -08:00
8848a8a76c
HDFS-11116. Fix javac warnings caused by deprecation of APIs in TestViewFsDefaultValue. Contributed by Yiqun Lin.
2016-11-11 13:45:30 +09:00
822ae88f7d
HADOOP-13346. DelegationTokenAuthenticationHandler writes via closed writer. Contributed by Gregory Chanan and Hrishikesh Gadre.
2016-11-09 09:33:00 -08:00
367c3d4121
HADOOP-13590. Retry until TGT expires even if the UGI renewal thread encountered exception.
2016-11-09 09:07:12 -08:00
c074880096
HADOOP-13800. Remove unused HADOOP_AUDIT_LOGGER from hadoop-env.sh. Contributed by Yiqun Lin.
2016-11-09 22:02:40 +09:00
e1c6ef2efa
HADOOP-13789. Hadoop Common includes generated test protos in both jar and test-jar. Contributed by Sean Busbey.
2016-11-08 16:33:55 -08:00
77c13c3857
HADOOP-13782. Make MutableRates metrics thread-local write, aggregate-on-read. Contributed by Erik Krogen.
2016-11-08 16:07:36 -08:00
2a65eb121e
HADOOP-13802. Make generic options help more consistent, and aligned. Contributed by Grant Sohn
2016-11-08 15:40:22 -08:00
29e3b3417c
YARN-5833. Add validation to ensure default ports are unique in Configuration. (Konstantinos Karanasos via Subru).
2016-11-08 14:38:18 -08:00
dbb133ccfc
HADOOP-13707. If kerberos is enabled while HTTP SPNEGO is not configured, some links cannot be accessed. Contributed by Yuanbo Liu.
2016-11-08 20:55:10 +05:30
3dbad5d823
HADOOP-13804. MutableStat mean loses accuracy if add(long, long) is used. Contributed by Erik Krogen.
2016-11-07 16:08:10 -08:00
f76895573d
HADOOP-13797 Remove hardcoded absolute path for ls. Contributed by Christine Koppelt
2016-11-07 12:36:10 +00:00
d8bab3dcb6
HDFS-10756. Expose getTrashRoot to HTTPFS and WebHDFS. Contributed by Yuanbo Liu.
2016-11-04 18:06:55 -07:00
95665a6eea
Revert "HADOOP-13565. KerberosAuthenticationHandler#authenticate should not rebuild SPN based on client request. Contributed by Xiaoyu Yao."
...
This reverts commit 9097e2efe4
2016-11-04 16:02:47 -07:00
de0132748d
MAPREDUCE-6796. Remove unused properties from JTConfig.java. Contributed by Haibo Chen.
2016-11-05 03:49:19 +09:00
abfc15d5ef
HADOOP-13792. Stackoverflow for schemeless defaultFS with trailing slash. Contributed by John Zhuge
2016-11-04 10:46:27 -07:00
7154a20bcb
HADOOP-12453. Support decoding KMS Delegation Token with its own Identifier. Contributed by Xiaoyu Yao.
2016-11-03 13:09:03 -07:00
7e521c5a49
HDFS-11080. Update HttpFS to use ConfigRedactor. Contributed by Sean Mackrory.
2016-11-02 19:11:05 -07:00
0dc2a6a3a5
HADOOP-13667. Fix typing mistake of inline document in hadoop-metrics2.properties (Contributed by Rui Gao via Daniel Templeton)
2016-11-02 06:53:33 -07:00
1b6ecaf016
HADOOP-13738. DiskChecker should perform some disk IO.
2016-11-01 18:02:23 -07:00
a1761a841e
HADOOP-13680. fs.s3a.readahead.range to use getLongBytes. Contributed by Abhishek Modi.
2016-10-31 20:54:46 +00:00
112f04eb1b
HDFS-11061. Update dfs -count -t command line help and documentation. Contributed by Yiqun Lin.
2016-10-28 15:33:27 -07:00
c017171da0
HADOOP-13770. Shell.checkIsBashSupported swallowed an interrupted exception. Contributed by Wei-Chiu Chuang
2016-10-28 14:57:50 +00:00
b62bc2bbd8
HADOOP-13763. KMS REST API Documentation Decrypt URL typo. Contributed by Jeffrey E Rodriguez.
2016-10-27 18:05:40 -07:00
5877f20f9c
HADOOP-10075. Update jetty dependency to version 9 (rkanter)
2016-10-27 16:09:00 -07:00
0c837db8a8
HADOOP-13201. Print the directory paths when ViewFs denies the rename operation on internal dirs. Contributed by Tianyin Xiu
2016-10-27 19:46:41 +05:30
0bdd263d82
HADOOP-13017. Implementations of InputStream.read(buffer, offset, bytes) to exit 0 if bytes==0. Contributed by Steve Loughran.
2016-10-27 15:46:59 +09:00
22ff0eff4d
HADOOP-8299. ViewFileSystem link slash mount point crashes with IndexOutOfBoundsException. Contributed by Manoj Govindassamy.
2016-10-26 14:25:03 -07:00
1f8490a5ba
HADOOP-13502. Split fs.contract.is-blobstore flag into more descriptive flags for use by contract tests. Contributed by Chris Nauroth.
2016-10-26 08:55:42 -07:00
9cad3e2350
HADOOP-13614. Purge some superfluous/obsolete S3 FS tests that are slowing test runs down. Contributed by Steve Loughran.
2016-10-26 08:27:26 -07:00
d88dca844a
HADOOP-11798. Native raw erasure coder in XOR codes. Contributed by SammiChen.
2016-10-25 16:53:53 -07:00
084bdab156
HDFS-5684. Annotate o.a.h.fs.viewfs.ViewFileSystem.MountPoint as VisibleForTesting. Contributed by Manoj Govindassamy.
2016-10-25 15:35:39 -07:00
86c735bcb1
Revert "HADOOP-13696. change hadoop-common dependency scope of jsch to provided. Contributed by Yuanbo Liu."
...
This reverts commit cef61d505e
2016-10-25 13:45:52 -07:00
09ef97dccb
HADOOP-13669. Addendum patch 2 for KMS Server should log exceptions before throwing.
2016-10-25 09:59:12 -07:00
309a43925c
HADOOP-13309. Document S3A known limitations in file ownership and permission model. Contributed by Chris Nauroth.
2016-10-25 09:03:03 -07:00
d8fa1cfa67
HADOOP-13727. S3A: Reduce high number of connections to EC2 Instance Metadata Service caused by InstanceProfileCredentialsProvider. Contributed by Chris Nauroth.
2016-10-24 21:22:34 -07:00
dc3272bfe8
HDFS-11046. Duplicate '-' in the daemon log name.
2016-10-25 10:07:43 +09:00
d0a347984d
HADOOP-13749. KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used. Contributed by Xiaoyu Yao.
2016-10-23 10:58:36 -07:00
da901b6c14
Revert "HDFS-10757. KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used. Contributed by Xiaoyu Yao."
...
This reverts commit be72372248
2016-10-23 08:25:37 -07:00
25438526ed
HDFS-11033. Add documents for native raw erasure coder in XOR codes. Contributed by SammiChen.
2016-10-21 16:20:07 -07:00
be72372248
HDFS-10757. KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used. Contributed by Xiaoyu Yao.
2016-10-21 14:23:02 -07:00
ae8bccd509
HADOOP-13702. Add instrumented ReadWriteLock. Contributed by Jingcheng Du
2016-10-21 12:59:54 -07:00
262827cf75
HADOOP-13737. Cleanup DiskChecker interface. Contributed by Arpit Agarwal.
2016-10-20 13:35:26 -07:00
3fbf4cd5da
HADOOP-13716. Add LambdaTestUtils class for tests; fix eventual consistency problem in contract test setup. Contributed by Steve Loughran.
2016-10-20 12:33:58 -07:00
f872c6bc03
HADOOP-13236. truncate will fail when we use viewfilesystem. Contributed by Brahma Reddy Battula
2016-10-20 21:47:17 +05:30
4bca385241
HADOOP-12082 Support multiple authentication schemes via AuthenticationFilter
2016-10-18 18:32:01 -07:00
d75cbc5749
HADOOP-13693. Remove the message about HTTP OPTIONS in SPNEGO initialization message from kms audit log.
2016-10-18 18:24:59 -07:00
efdf810cf9
HADOOP-7352. FileSystem#listStatus should throw IOE upon access error. Contributed by John Zhuge.
2016-10-18 18:18:43 -07:00
6c348c5691
HADOOP-13560. S3ABlockOutputStream to support huge (many GB) file writes. Contributed by Steve Loughran
2016-10-18 21:16:02 +01:00
c023c74886
HADOOP-13061. Refactor erasure coders. Contributed by Kai Sasaki
2016-10-18 12:02:53 +06:00
bedfec0c10
HADOOP-13522. Add %A and %a formats for fs -stat command to print permissions. Contributed by Alex Garbarini.
2016-10-18 15:00:44 +09:00
b671ee6846
HDFS-11013. Correct typos in native erasure coding dump code. Contributed by László Bence Nagy.
2016-10-17 14:14:50 -07:00
987ee51141
HADOOP-13724. Fix a few typos in site markdown documents. Contributed by Ding Fei.
2016-10-17 13:25:58 -07:00
0f4afc8100
HADOOP-13722. Code cleanup -- ViewFileSystem and InodeTree. Contributed by Manoj Govindassamy.
2016-10-17 13:15:11 -07:00
ed9fcbec54
HADOOP-13661. Upgrade HTrace version. Contributed by Sean Mackrory.
2016-10-17 05:04:49 -07:00
aee538be6c
HADOOP-13721. Remove stale method ViewFileSystem#getTrashCanLocation. Contributed by Manoj Govindassamy.
2016-10-14 14:08:31 -07:00
dbe663d524
HADOOP-13686. Adding additional unit test for Trash (I). Contributed by Weiwei Yang.
2016-10-13 23:05:16 -07:00
5a5a724731
HADOOP-13417. Fix javac and checkstyle warnings in hadoop-auth package.
2016-10-14 14:45:55 +09:00
ae51b11f78
HADOOP-13669. Addendum patch for KMS Server should log exceptions before throwing.
2016-10-13 22:32:08 -07:00
008122b3c9
HADOOP-13710. Supress CachingGetSpaceUsed from logging interrupted exception stacktrace. Contributed by Hanisha Koneru.
2016-10-13 11:37:03 -07:00
9097e2efe4
HADOOP-13565. KerberosAuthenticationHandler#authenticate should not rebuild SPN based on client request. Contributed by Xiaoyu Yao.
2016-10-13 10:52:28 -07:00
12d739a34b
HADOOP-13700. Remove unthrown IOException from TrashPolicy#initialize and #getInstance signatures.
2016-10-12 15:19:52 -07:00
85cd06f663
HDFS-10789. Route webhdfs through the RPC call queue. Contributed by Daryn Sharp and Rushabh S Shah.
2016-10-12 15:11:42 -05:00
b84c4891f9
HADOOP-13698. Document caveat for KeyShell when underlying KeyProvider does not delete a key.
2016-10-11 17:05:00 -07:00
8a09bf7c19
HADOOP-13705. Revert HADOOP-13534 Remove unused TrashPolicy#getInstance and initialize code.
2016-10-11 13:46:07 -07:00
4b32b1420d
HADOOP-13684. Snappy may complain Hadoop is built without snappy if libhadoop is not found. Contributed by Wei-Chiu Chuang.
2016-10-11 13:21:33 -07:00
2fb392a587
HADOOP-13697. LogLevel#main should not throw exception if no arguments. Contributed by Mingliang Liu
2016-10-11 10:57:08 -07:00
c874fa914d
HDFS-10985. o.a.h.ha.TestZKFailoverController should not use fixed time sleep before assertions. Contributed by Mingliang Liu
2016-10-10 13:33:07 -07:00
65912e4027
HADOOP-13669. KMS Server should log exceptions before throwing. Contributed by Suraj Acharya.
2016-10-10 12:51:12 -07:00
03060075c5
HADOOP-13699. Configuration does not substitute multiple references to the same var.
2016-10-10 12:19:26 -07:00
cef61d505e
HADOOP-13696. change hadoop-common dependency scope of jsch to provided. Contributed by Yuanbo Liu.
2016-10-10 12:32:39 +01:00
3d59b18d49
HADOOP-13641. Update UGI#spawnAutoRenewalThreadForUserCreds to reduce indentation. Contributed by Huafeng Wang
2016-10-09 15:53:36 +06:00
ec0b70716c
HADOOP-12579. Deprecate WriteableRPCEngine. Contributed by Wei Zhou
2016-10-09 15:07:03 +06:00
2e853be657
HADOOP-13627. Have an explicit KerberosAuthException for UGI to throw, text from public constants. Contributed by Xiao Chen.
2016-10-07 13:46:27 -07:00
c183b9de8d
HADOOP-12611. TestZKSignerSecretProvider#testMultipleInit occasionally fail (ebadger via rkanter)
2016-10-07 09:33:31 -07:00
ebd4f39a39
HADOOP-12977 s3a to handle delete("/", true) robustly. Contributed by Steve Loughran.
2016-10-07 12:51:40 +01:00
1d330fbaf6
HADOOP-13150. Avoid use of toString() in output of HDFS ACL shell commands. Contributed by Chris Nauroth.
2016-10-06 13:19:16 -07:00
2d46c3f6b7
HADOOP-13323. Downgrade stack trace on FS load from Warn to debug. Contributed by Steve Loughran.
2016-10-06 10:57:01 -07:00
35b9d7de9f
HADOOP-13690. Fix typos in core-default.xml. Contributed by Yiqun Lin
2016-10-06 18:06:08 +05:30
b90fc70d67
HDFS-10963. Reduce log level when network topology cannot find enough datanodes. Contributed by Xiao chen
2016-10-06 17:47:31 +05:30
c5ca216915
HDFS-10683. Make class Token$PrivateToken private. Contributed by John Zhuge.
2016-10-05 17:36:50 -07:00
00160f71b6
HADOOP-13628. Support to retrieve specific property from configuration via REST API. Contributed by Weiwei Yang
2016-10-05 16:50:01 -04:00
9a61b52fbe
HADOOP-13685. Document -safely option of rm command. Contributed by Xiaoyu Yao.
2016-10-05 20:41:08 +09:00
853d65a157
HDFS-10918. Add a tool to get FileEncryptionInfo from CLI. Contributed by Xiao Chen.
2016-10-03 16:01:54 -07:00
89bd6d29a6
HADOOP-13317. Add logs to KMS server-side to improve supportability. Contributed by Suraj Acharya.
2016-09-30 17:51:39 -07:00
57aec2b46b
HADOOP-12974. Create a CachingGetSpaceUsed implementation that uses df. Contributed by Elliott Clark.
2016-09-30 12:58:37 -07:00
1e0ea27e96
Revert "HADOOP-13081. add the ability to create multiple UGIs/subjects from one kerberos login. Contributed by Sergey Shelukhin."
...
This reverts commit 0458a2af6e
2016-09-29 13:59:09 -07:00
236ac773c9
HADOOP-13537. Support external calls in the RPC call queue. Contributed by Daryn Sharp.
2016-09-29 13:27:30 -05:00
ee0c722dc8
HADOOP-13164 Optimize S3AFileSystem::deleteUnnecessaryFakeDirectories. Contributed by Rajesh Balamohan.
2016-09-29 17:01:00 +01:00
1518cb9532
HADOOP-13663 Index out of range in SysInfoWindows. Contributed by Inigo Goiri
2016-09-29 11:35:00 +01:00
e19b37ead2
HADOOP-11780. Prevent IPC reader thread death. Contributed by Daryn Sharp.
2016-09-28 08:24:21 -05:00
9a44a832a9
HADOOP-13658. Replace config key literal strings with names I: hadoop common. Contributed by Chen Liang
2016-09-27 17:36:53 -07:00
875062b5bc
HADOOP-13544. JDiff reports unncessarily show unannotated APIs and cause confusion while our javadocs only show annotated and public APIs. (vinodkv via wangda)
2016-09-27 11:26:45 -07:00
edf0d0f8b2
HDFS-9444. Add utility to find set of available ephemeral ports to ServerSocketUtil. Contributed by Masatake Iwasaki
2016-09-27 07:04:37 +05:30
fa397e74fe
HADOOP-13638. KMS should set UGI's Configuration object properly. Contributed by Wei-Chiu Chuang.
2016-09-26 13:00:57 -07:00
6eb700ee74
HDFS-10866. Fix Eclipse Java compile errors related to generic parameters. Contributed by Konstantin Shvachko.
2016-09-23 14:10:11 -07:00
bbdf350ff9
HDFS-10886. Replace fs.default.name with fs.defaultFS in viewfs document.
2016-09-23 19:21:34 +05:30
e80386d69d
HADOOP-13601. Fix a log message typo in AbstractDelegationTokenSecretManager. Contributed by Mehran Hassani.
2016-09-20 13:20:01 -07:00
734d54c1a8
HDFS-10861. Refactor StripeReaders and use ECChunk version decode API. Contributed by Sammi Chen
2016-09-21 21:34:48 +08:00
ea839bd48e
HDFS-10489. Deprecate dfs.encryption.key.provider.uri for HDFS encryption zones. Contributed by Xiao Chen.
2016-09-17 22:25:39 -07:00
58bae35447
YARN-5163. Migrate TestClientToAMTokens and TestClientRMTokens tests from the old RPC engine. Contributed by Wei Zhou and Kai Zheng
2016-09-18 08:43:36 +08:00
8a40953058
HDFS-10823. Implement HttpFSFileSystem#listStatusIterator.
2016-09-16 15:37:36 -07:00
f6f3a447bf
HADOOP-13580. If user is unauthorized, log "unauthorized" instead of "Invalid signed text:". Contributed by Wei-Chiu Chuang.
2016-09-16 14:53:30 -07:00
fcbac00212
Revert "HADOOP-13410. RunJar adds the content of the jar twice to the classpath (Yuanbo Liu via sjlee)"
...
This reverts commit 4d3ea92f4f
2016-09-15 10:18:56 -07:00
7cad7b7046
HADOOP-13616. Broken code snippet area in Hadoop Benchmarking. Contributed by Kai Sasaki.
2016-09-15 23:42:34 +09:00
53a12fa721
HADOOP-13606 swift FS to add a service load metadata file. Contributed by Steve Loughran
2016-09-14 15:45:04 +01:00
ea0c2b8b05
HADOOP-13218. Migrate other Hadoop side tests to prepare for removing WritableRPCEngine. Contributed by Wei Zhou and Kai Zheng
2016-09-15 10:46:00 +08:00
08d8e0ba25
HADOOP-13546. Override equals and hashCode of the default retry policy to avoid connection leakage. Contributed by Xiaobing Zhou.
2016-09-13 11:12:52 -07:00
d2466ec3e0
HDFS-10657. testAclCLI.xml setfacl test should expect mask r-x. (John Zhuge via Yongjun Zhang)
2016-09-12 21:25:06 -07:00
59d59667a8
HADOOP-13588. ConfServlet should respect Accept request header. Contributed by Weiwei Yang
2016-09-12 16:17:08 -07:00
58ed4fa544
HADOOP-13341. Deprecate HADOOP_SERVERNAME_OPTS; replace with (command)_(subcommand)_OPTS
...
This commit includes the following changes:
HADOOP-13356. Add a function to handle command_subcommand_OPTS
HADOOP-13355. Handle HADOOP_CLIENT_OPTS in a function
HADOOP-13554. Add an equivalent of hadoop_subcmd_opts for secure opts
HADOOP-13562. Change hadoop_subcommand_opts to use only uppercase
HADOOP-13358. Modify HDFS to use hadoop_subcommand_opts
HADOOP-13357. Modify common to use hadoop_subcommand_opts
HADOOP-13359. Modify YARN to use hadoop_subcommand_opts
HADOOP-13361. Modify hadoop_verify_user to be consistent with hadoop_subcommand_opts (ie more granularity)
HADOOP-13564. modify mapred to use hadoop_subcommand_opts
HADOOP-13563. hadoop_subcommand_opts should print name not actual content during debug
HADOOP-13360. Documentation for HADOOP_subcommand_OPTS
This closes apache/hadoop#126
2016-09-12 11:10:00 -07:00
a99bf26a08
HDFS-10830. FsDatasetImpl#removeVolumes crashes with IllegalMonitorStateException when vol being removed is in use. (Arpit Agarwal and Manoj Govindassamy)
2016-09-10 18:22:25 -07:00
9f192cc5ac
MAPREDUCE-6628. Potential memory leak in CryptoOutputStream. Contributed by Mariappan Asokan
2016-09-09 11:12:44 -07:00
d4d076876a
HADOOP-10940. RPC client does no bounds checking of responses. Contributed by Daryn Sharp.
2016-09-09 10:39:35 -05:00
011f3b24d4
HDFS-10742. Measure lock time in FsDatasetImpl. Contributed by Chen Liang
2016-09-08 17:53:40 -07:00
1192781a78
HADOOP-13519. Make Path Serializable. Contributed by Steve Loughran
2016-09-08 17:46:12 -07:00
cae331186d
Revert "YARN-5567. Fix script exit code checking in NodeHealthScriptRunner#reportHealthStatus. (Yufei Gu via rchiang)"
...
This reverts commit 05ede00386
2016-09-08 12:40:30 -07:00
401db4fc65
HDFS-8901. Use ByteBuffer in striping positional read. Contributed by Sammi Chen and Kai Zheng.
2016-09-08 11:54:33 -07:00
d355573f56
Revert "HADOOP-13218. Migrate other Hadoop side tests to prepare for removing WritableRPCEngine. Contributed by Wei Zhou and Kai Zheng"
...
This reverts commit 62a9667136
2016-09-08 05:50:17 +08:00
f414d5e118
HADOOP-13388. Clean up TestLocalFileSystemPermission. Contributed by Andras Bokor.
2016-09-07 11:09:41 -07:00
680be58aac
HADOOP-13558. UserGroupInformation created from a Subject incorrectly tries to renew the Kerberos ticket. Contributed by Xiao Chen.
2016-09-06 20:54:17 -07:00
f0d5382ff3
HDFS-6962. ACL inheritance conflicts with umaskmode. Contributed by Chris Nauroth.
2016-09-06 11:02:39 -07:00
d37dc5d1b8
HDFS-9847. HDFS configuration should accept time units. Contributed by Yiqun Lin
2016-09-06 10:38:04 -07:00
f388a20943
Add CHANGES and release notes for 3.0.0-alpha1 to site
2016-09-06 09:51:55 -07:00
39d1b1d747
HADOOP-13549. Eliminate intermediate buffer for server-side PB encoding. Contributed by Daryn Sharp.
2016-09-06 10:02:42 -05:00
62a9667136
HADOOP-13218. Migrate other Hadoop side tests to prepare for removing WritableRPCEngine. Contributed by Wei Zhou and Kai Zheng
2016-09-07 17:05:33 +08:00
23abb09c1f
HADOOP-13547. Optimize IPC client protobuf decoding. Contributed by Daryn Sharp.
2016-09-02 11:03:18 -05:00
76cd81f4b6
HADOOP-13465. Design Server.Call to be extensible for unified call queue. Contributed by Daryn Sharp.
2016-09-01 15:44:44 -05:00
3069df7551
FsPermission string constructor does not recognize sticky bit. Contributed by Atul Sikaria
2016-09-01 11:32:26 -07:00
dcd21d083a
HADOOP-13375. o.a.h.security.TestGroupsCaching.testBackgroundRefreshCounters seems flaky. (Contributed by Weiwei Yang)
2016-09-01 11:03:06 -07:00
05ede00386
YARN-5567. Fix script exit code checking in NodeHealthScriptRunner#reportHealthStatus. (Yufei Gu via rchiang)
2016-08-29 15:55:33 -07:00
6fcb04c178
HADOOP-13559. Remove close() within try-with-resources in ChecksumFileSystem/ChecksumFs classes. (Contributed by Aaron Fabbri)
2016-08-29 13:04:28 -07:00
e1ad598cef
HADOOP-7363. TestRawLocalFileSystemContract is needed. Contributed by Andras Bokor.
2016-08-29 09:26:46 -07:00
92d8f37155
HADOOP-13552. RetryInvocationHandler logs all remote exceptions. Contributed by Jason Lowe
2016-08-29 15:55:38 +00:00
81485dbfc1
Revert "HADOOP-13465. Design Server.Call to be extensible for unified call queue. Contributed by Daryn Sharp."
...
This reverts commit d288a0ba83
2016-08-25 16:04:54 -05:00
d288a0ba83
HADOOP-13465. Design Server.Call to be extensible for unified call queue. Contributed by Daryn Sharp.
2016-08-25 11:44:13 -05:00
52b25fe6ae
HADOOP-13533. Do not require user to set HADOOP_SSH_OPTS to a non-null string, allow setting of an empty string. (Albert Chu via aw) closes #121
...
Signed-off-by: Allen Wittenauer <aw@apache.org>
2016-08-25 07:11:06 -07:00
601599b036
HADOOP-13532. Fix typo in hadoop_connect_to_hosts error message (Albert Chu via aw) closes #120
2016-08-25 06:58:42 -07:00
ab3b727b5f
HADOOP-13534. Remove unused TrashPolicy#getInstance and initialize code. Contributed by Yiqun Lin.
2016-08-25 13:54:57 +09:00
3476156807
HADOOP-13396. Allow pluggable audit loggers in KMS. Contributed by Xiao Chen
2016-08-24 10:14:46 -07:00
092b4d5bfd
HADOOP-13538. Deprecate getInstance and initialize methods with Path in TrashPolicy. Contributed by Yiqun Lin.
2016-08-24 16:47:52 +09:00
c37346d0e3
HADOOP-12726. Unsupported FS operations should throw UnsupportedOperationException. Contributed by Daniel Templeton.
2016-08-23 14:12:52 -07:00
8aae8d6bf0
HADOOP-13497. fix wrong command in CredentialProviderAPI.md. Contributed by Yuanbo Liu.
2016-08-24 00:03:27 +09:00
f0efea490e
HDFS-8986. Add option to -du to calculate directory space usage excluding snapshots. Contributed by Xiao Chen.
2016-08-23 04:14:24 -07:00
c49333becf
HDFS-8312. Added permission check for moving file to Trash. (Weiwei Yang via Eric Yang)
2016-08-22 18:29:56 -07:00
4070caad70
HADOOP-13526. Add detailed logging in KMS for the authentication failure of proxy user. Contributed by Suraj Acharya.
2016-08-22 18:09:35 -07:00
f4d4d3474c
HADOOP-13487. Hadoop KMS should load old delegation tokens from Zookeeper on startup. Contributed by Xiao Chen.
2016-08-22 14:42:13 -07:00
115ecb52a8
HADOOP-13527. Add Spark to CallerContext LimitedPrivate scope. (Contributed by Weiqing Yang)
2016-08-21 09:40:29 -07:00
99603e9022
HADOOP-13428. Fixed hadoop-common build files to generate jdiff by working around a jdiff-bug. Contributed by Wangda Tan.
2016-08-19 19:08:53 -07:00
763f0497bb
HADOOP-13252. Tune S3A provider plugin mechanism. Contributed by Steve Loughran.
2016-08-19 10:48:10 -07:00
03a9343d57
HADOOP-12765. HttpServer2 should switch to using the non-blocking SslSelectChannelConnector to prevent performance degradation when handling SSL connections. Contributed by Min Shen.
2016-08-19 09:22:49 -07:00
8179f9a493
HDFS-10645. Make block report size as a metric and add this metric to datanode web ui. Contributed by Yuanbo Liu.
2016-08-19 16:15:00 +09:00
dbcaf999d9
HADOOP-13504. Refactor jni_common to conform to C89 restrictions imposed by Visual Studio 2010. Contributed by Sammi Chen
2016-08-19 11:18:15 +08:00
c5c3e81b49
HADOOP-13503. Improve SaslRpcClient failure logging. Contributed by Xiaobing Zhou.
2016-08-18 14:55:26 -07:00
0f51eae0c0
HADOOP-13512. ReloadingX509TrustManager should keep reloading in case of exception. (Contributed by Mingliang Liu)
2016-08-18 14:10:37 -07:00
0da69c324d
YARN-4676. Automatic and Asynchronous Decommissioning Nodes Status Tracking. Contributed by Diniel Zhi.
...
(cherry picked from commit d464483bf7
2016-08-18 07:27:23 -07:00
040c185d62
HADOOP-13405 doc for fs.s3a.acl.default indicates incorrect values. Contributed by Shen Yinjie
2016-08-18 14:36:55 +01:00
c57523163f
HADOOP-11786. Fix Javadoc typos in org.apache.hadoop.fs.FileSystem. Contributed by Andras Bokor.
2016-08-17 15:00:14 -07:00
23532716fc
HADOOP-13470. GenericTestUtils$LogCapturer is flaky. (Contributed by Mingliang Liu)
2016-08-16 17:33:04 -07:00
27a6e09c4e
Revert "HADOOP-13470. GenericTestUtils$LogCapturer is flaky. (Contributed by Mingliang Liu)"
...
This reverts commit 9336a0495f
2016-08-16 16:25:37 -07:00
Jason Lowe
Wei-Chiu Chuang
Kihwal Lee
Daniel Templeton
Jitendra Pandey
Akira Ajisaka
Anu Engineer
Xiao Chen
Masatake Iwasaki
Steve Loughran
Yiqun Lin
wenxinhe
Andrew Wang
John Zhuge
Vinayakumar B
Kai Zheng
Lei Xu
Arpit Agarwal
Daryn Sharp
Yongjun Zhang
Brahma Reddy Battula
Jonathan Eagles
Mingliang Liu
Carlo Curino
Rakesh Radhakrishnan
Sunil G
Chris Douglas
Rohith Sharma K S
Haohui Mai
Robert Kanter
Eric Payne
Junping Du
John Zhuge
Xiaoyu Yao
Kengo Seki
Chris Nauroth
Allen Wittenauer
Zhe Zhang
Tsuyoshi Ozawa
Ravi Prakash
Erik Krogen
Chen Liang
Jing Zhao
Andrey Dyatlov
Ray Chiang
Jian He
Harsh J
Xuan
Eric Yang
Jason Lowe
Arun Suresh
Ming Ma
Karthik Kambatla
Robert Kanter
Subru Krishnan
Benoy Antony
Wangda Tan
Konstantin V Shvachko
Sangjin Lee
Albert Chu
Vinod Kumar Vavilapalli (I am also known as @tshooter.)