Commit Graph

4218 Commits

Author SHA1 Message Date
Andrew Wang c2a52ef9c2 HDFS-11643. Add shouldReplicate option to create builder. Contributed by SammiChen. 2017-05-04 11:39:14 -07:00
Arpit Agarwal 81092b1f11 HDFS-11722. Change Datanode file IO profiling sampling to percentage. Contributed by Hanisha Koneru. 2017-05-03 16:29:30 -07:00
Arpit Agarwal 30cd265134 Revert "HDFS-11488. JN log segment syncing should support HA upgrade. Contributed by Hanisha Koneru."
This reverts commit 08fb82d6d1.
2017-05-03 16:28:47 -07:00
Arpit Agarwal 08fb82d6d1 HDFS-11488. JN log segment syncing should support HA upgrade. Contributed by Hanisha Koneru. 2017-05-03 15:46:08 -07:00
Mingliang Liu 83dded556d HDFS-11739. Fix regression in tests caused by YARN-679. Contributed by Steve Loughran 2017-05-03 11:22:44 -07:00
Kihwal Lee d4631e466b HADOOP-14372. TestSymlinkLocalFS timeouts are too low. Contributed by Eric Badger. 2017-05-03 09:47:17 -05:00
Robert Kanter 8b82317fab HADOOP-14352. Make some HttpServer2 SSL properties optional (jzhuge via rkanter) 2017-05-02 17:51:28 -07:00
Jason Lowe cedaf4cab9 HADOOP-14306. TestLocalFileSystem tests have very low timeouts. Contributed by Eric Badger 2017-05-02 16:50:51 -05:00
Andrew Wang dcc292d7de HADOOP-14369. NetworkTopology calls expensive toString() when logging. Contributed by Inigo Goiri. 2017-05-02 10:51:20 -07:00
Akira Ajisaka 20cde55274
HADOOP-14371. License error in TestLoadBalancingKMSClientProvider.java. Contributed by hu xiaodong. 2017-05-02 23:36:54 +09:00
Mingliang Liu c735362df7 HADOOP-14363. Inconsistent default block location in FileSystem javadoc. Contributed by Chen Liang 2017-04-29 23:49:36 -07:00
Eric Payne 6fe11f6155 HADOOP-14320. TestIPC.testIpcWithReaderQueuing fails intermittently. Contributed by Eric Badger. 2017-04-28 14:45:26 -05:00
Junping Du 373bb4931f YARN-679. Add an entry point that can start any Yarn service. Contributed by Steve Loughran. 2017-04-28 10:45:02 -07:00
Kai Zheng cb672a45a0 HDFS-11605. Allow user to customize new erasure code policies. Contributed by Huafeng Wang 2017-04-28 13:18:50 +08:00
Chris Douglas 689fb2fc66 HADOOP-14354. SysInfoWindows is not thread safe. Contributed by Inigo Goiri 2017-04-27 16:26:39 -07:00
Chris Douglas 31cf480d65 HADOOP-14309. Add PowerShell NodeFencer. Contributed by Inigo Goiri 2017-04-27 16:09:28 -07:00
Wei-Chiu Chuang bbf8cac14d HADOOP-13200. Implement customizable and configurable erasure coders. Contributed by Tim Yao. 2017-04-27 12:39:47 -07:00
Wei-Chiu Chuang ddaeb3e497 Revert "HADOOP-13200. Implement customizable and configurable erasure coders. Contributed by Tim Yao."
This reverts commit 872088c6e7.
2017-04-27 12:25:47 -07:00
Wei-Chiu Chuang 872088c6e7 HADOOP-13200. Implement customizable and configurable erasure coders. Contributed by Tim Yao. 2017-04-27 11:59:33 -07:00
Steve Loughran 61cda39e4e
HADOOP-14346. CryptoOutputStream throws IOException if stream is closed.
Contributed by Pierre Lacave

(cherry picked from commit 40b9c30d64)
2017-04-27 12:19:04 +01:00
John Zhuge edd693833b HADOOP-14340. Enable KMS and HttpFS to exclude SSL ciphers. Contributed by John Zhuge. 2017-04-26 11:44:59 -07:00
John Zhuge 9ccb849eb6 HADOOP-14341. Support multi-line value for ssl.server.exclude.cipher.list. Contributed by John Zhuge. 2017-04-25 22:06:51 -07:00
Xiaoyu Yao 4ea2778acb HADOOP-14207. "dfsadmin -refreshCallQueue" fails with DecayRpcScheduler. Contributed by Surendra Singh Lihore. 2017-04-25 18:45:56 -07:00
Mingliang Liu d11d280b8b HADOOP-12856. FileUtil.checkDest() and RawLocalFileSystem.mkdirs() to throw stricter IOEs; RawLocalFS contract tests to verify. Contributed by Steve Loughran 2017-04-25 18:33:41 -07:00
Andrew Wang a22fe02fba HADOOP-14261. Some refactoring work for erasure coding raw coder. Contributed by Lin Zeng. 2017-04-21 11:35:36 -07:00
Mingliang Liu 667966c13c HADOOP-14324. Refine S3 server-side-encryption key as encryption secret; improve error reporting and diagnostics. Contributed by Steve Loughran 2017-04-20 17:13:36 -07:00
Daniel Templeton f356f0f4cf YARN-6453. fairscheduler-statedump.log gets generated regardless of service
(Contributed by Yufei Gu via Daniel Templeton)
2017-04-20 14:13:07 -07:00
John Zhuge 0344bea3fd HADOOP-14241. Add ADLS sensitive config keys to default list. Contributed by John Zhuge. 2017-04-19 11:50:54 -07:00
Daniel Templeton d4483a2fe4 HADOOP-13997. Typo in metrics docs (Contributed by Ana Krasteva via Daniel Templeton) 2017-04-19 09:41:09 -07:00
Kengo Seki 654372db85
HADOOP-14315. Python example in the rack awareness document doesn't work due to bad indentation
This closes #214

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2017-04-18 17:14:22 +09:00
Akira Ajisaka 84a8848aae
HADOOP-14318. Remove non-existent setfattr command option from FileSystemShell.md. Contributed by Doris Gu. 2017-04-18 16:43:50 +09:00
Andrew Wang c0ca785dbb HDFS-11652. Improve ECSchema and ErasureCodingPolicy toString, hashCode, equals. 2017-04-17 16:30:25 -07:00
Mingliang Liu b053fdc547 HADOOP-14255. S3A to delete unnecessary fake directory objects in mkdirs(). Contributed by Mingliang Liu 2017-04-12 14:30:34 -07:00
Chris Nauroth b8305e6d06 HADOOP-14248. Retire SharedInstanceProfileCredentialsProvider in trunk. Contributed by Mingliang Liu. 2017-04-12 10:02:13 -07:00
Chris Nauroth 23b1a7bdf1 HDFS-11163. Mover should move the file blocks to default storage once policy is unset. Contributed by Surendra Singh Lilhore. 2017-04-11 22:03:09 -07:00
Wei-Chiu Chuang f050afb578 HADOOP-13665. Erasure Coding codec should support fallback coder. Contributed by Kai Sasaki. 2017-04-11 07:32:13 -07:00
Jason Lowe 0e065f2ede YARN-6195. Export UsedCapacity and AbsoluteUsedCapacity to JMX. Contributed by Benson Qiu 2017-04-11 08:44:18 -05:00
Chris Douglas a5e57df3c5 HADOOP-14225. Remove xmlenc dependency 2017-04-10 11:48:40 -07:00
Andrew Wang be144117a8 HADOOP-14293. Initialize FakeTimer with a less trivial value. 2017-04-10 11:37:01 -07:00
Steve Loughran 2ed65540a3
HADOOP-14066 VersionInfo should be marked as public API 2017-04-08 13:41:10 +01:00
John Zhuge 56e81f2a20 HADOOP-14174. Set default ADLS access token provider type to ClientCredential. Contributed by John Zhuge.
Signed-off-by: John Zhuge <jzhuge@apache.org>
2017-04-07 12:04:44 -07:00
Allen Wittenauer 96cbb4fce2 HADOOP-14202. fix jsvc/secure user var inconsistencies
Signed-off-by: John Zhuge <jzhuge@apache.org>
2017-04-07 08:59:21 -07:00
Zhe Zhang 95b7f1d29a HADOOP-14276. Add a nanosecond API to Time/Timer/FakeTimer. Contributed by Erik Krogen. 2017-04-06 16:59:21 -07:00
Xiaoyu Yao 32bb36b750 HDFS-11302. Improve Logging for SSLHostnameVerifier. Contributed by Chen Liang. 2017-04-05 17:28:00 -07:00
Andrew Wang 18432130a7 HADOOP-14104. Client should always ask namenode for kms provider path. Contributed by Rushabh S Shah. 2017-04-04 13:38:25 -07:00
Chris Douglas 6eba79232f HADOOP-14271. Correct spelling of 'occurred' and variants. Contributed by Yeliang Cang 2017-04-03 20:13:14 -07:00
Wei-Chiu Chuang bbd68478d5 HDFS-11598. Improve -setrep for Erasure Coded files. Contributed by Yiqun Lin. 2017-04-03 07:57:28 -07:00
Jonathan Eagles 1309c585fb HADOOP-14216. Addendum to Improve Configuration XML Parsing Performance (jeagles) 2017-03-30 14:14:43 -05:00
Wei-Chiu Chuang 8c591b8d19 HDFS-10974. Document replication factor for EC files. Contributed by Yiqun Lin. 2017-03-30 11:16:05 -07:00
Chris Douglas 7297e82cb4 HADOOP-14250. Correct spelling of 'separate' and variants. Contributed by Doris Gu 2017-03-30 10:17:11 -07:00