Commit Graph

4297 Commits

Author SHA1 Message Date
Andrew Wang a22fe02fba HADOOP-14261. Some refactoring work for erasure coding raw coder. Contributed by Lin Zeng. 2017-04-21 11:35:36 -07:00
Mingliang Liu 667966c13c HADOOP-14324. Refine S3 server-side-encryption key as encryption secret; improve error reporting and diagnostics. Contributed by Steve Loughran 2017-04-20 17:13:36 -07:00
Daniel Templeton f356f0f4cf YARN-6453. fairscheduler-statedump.log gets generated regardless of service
(Contributed by Yufei Gu via Daniel Templeton)
2017-04-20 14:13:07 -07:00
John Zhuge 0344bea3fd HADOOP-14241. Add ADLS sensitive config keys to default list. Contributed by John Zhuge. 2017-04-19 11:50:54 -07:00
Daniel Templeton d4483a2fe4 HADOOP-13997. Typo in metrics docs (Contributed by Ana Krasteva via Daniel Templeton) 2017-04-19 09:41:09 -07:00
John Zhuge a9f07e0d3e HADOOP-14317. KMSWebServer$deprecateEnv may leak secret. Contributed by John Zhuge. 2017-04-18 09:29:16 -07:00
Kengo Seki 654372db85
HADOOP-14315. Python example in the rack awareness document doesn't work due to bad indentation
This closes #214

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2017-04-18 17:14:22 +09:00
Akira Ajisaka 84a8848aae
HADOOP-14318. Remove non-existent setfattr command option from FileSystemShell.md. Contributed by Doris Gu. 2017-04-18 16:43:50 +09:00
Andrew Wang c0ca785dbb HDFS-11652. Improve ECSchema and ErasureCodingPolicy toString, hashCode, equals. 2017-04-17 16:30:25 -07:00
Mingliang Liu b053fdc547 HADOOP-14255. S3A to delete unnecessary fake directory objects in mkdirs(). Contributed by Mingliang Liu 2017-04-12 14:30:34 -07:00
Daniel Templeton 4dd6206547 HADOOP-14246. Authentication Tokens should use SecureRandom instead of Random and 256 bit secrets
(Conttributed by Robert Konter via Daniel Templeton)
2017-04-12 11:17:31 -07:00
Chris Nauroth b8305e6d06 HADOOP-14248. Retire SharedInstanceProfileCredentialsProvider in trunk. Contributed by Mingliang Liu. 2017-04-12 10:02:13 -07:00
Chris Nauroth 23b1a7bdf1 HDFS-11163. Mover should move the file blocks to default storage once policy is unset. Contributed by Surendra Singh Lilhore. 2017-04-11 22:03:09 -07:00
Wei-Chiu Chuang f050afb578 HADOOP-13665. Erasure Coding codec should support fallback coder. Contributed by Kai Sasaki. 2017-04-11 07:32:13 -07:00
Jason Lowe 0e065f2ede YARN-6195. Export UsedCapacity and AbsoluteUsedCapacity to JMX. Contributed by Benson Qiu 2017-04-11 08:44:18 -05:00
Chris Douglas a5e57df3c5 HADOOP-14225. Remove xmlenc dependency 2017-04-10 11:48:40 -07:00
Andrew Wang be144117a8 HADOOP-14293. Initialize FakeTimer with a less trivial value. 2017-04-10 11:37:01 -07:00
Steve Loughran 2ed65540a3
HADOOP-14066 VersionInfo should be marked as public API 2017-04-08 13:41:10 +01:00
John Zhuge 56e81f2a20 HADOOP-14174. Set default ADLS access token provider type to ClientCredential. Contributed by John Zhuge.
Signed-off-by: John Zhuge <jzhuge@apache.org>
2017-04-07 12:04:44 -07:00
Allen Wittenauer 96cbb4fce2 HADOOP-14202. fix jsvc/secure user var inconsistencies
Signed-off-by: John Zhuge <jzhuge@apache.org>
2017-04-07 08:59:21 -07:00
Zhe Zhang 95b7f1d29a HADOOP-14276. Add a nanosecond API to Time/Timer/FakeTimer. Contributed by Erik Krogen. 2017-04-06 16:59:21 -07:00
Xiaoyu Yao 32bb36b750 HDFS-11302. Improve Logging for SSLHostnameVerifier. Contributed by Chen Liang. 2017-04-05 17:28:00 -07:00
Andrew Wang 18432130a7 HADOOP-14104. Client should always ask namenode for kms provider path. Contributed by Rushabh S Shah. 2017-04-04 13:38:25 -07:00
Chris Douglas 6eba79232f HADOOP-14271. Correct spelling of 'occurred' and variants. Contributed by Yeliang Cang 2017-04-03 20:13:14 -07:00
Wei-Chiu Chuang bbd68478d5 HDFS-11598. Improve -setrep for Erasure Coded files. Contributed by Yiqun Lin. 2017-04-03 07:57:28 -07:00
Jonathan Eagles 1309c585fb HADOOP-14216. Addendum to Improve Configuration XML Parsing Performance (jeagles) 2017-03-30 14:14:43 -05:00
Wei-Chiu Chuang 8c591b8d19 HDFS-10974. Document replication factor for EC files. Contributed by Yiqun Lin. 2017-03-30 11:16:05 -07:00
Chris Douglas 7297e82cb4 HADOOP-14250. Correct spelling of 'separate' and variants. Contributed by Doris Gu 2017-03-30 10:17:11 -07:00
Andrew Wang 4966a6e26e HADOOP-14223. Extend FileStatus#toString() to include details like Erasure Coding and Encryption. Contributed by Manoj Govindassamy. 2017-03-29 14:37:21 -07:00
Mingliang Liu 13c766b62c HADOOP-14247. FileContextMainOperationsBaseTest should clean up test root path. Contributed by Mingliang Liu 2017-03-29 11:13:39 -07:00
Jonathan Eagles 523f467d93 HADOOP-14216. Improve Configuration XML Parsing Performance (jeagles) 2017-03-29 10:12:02 -05:00
Yiqun Lin 6b09336438 HDFS-11577. Combine the old and the new chooseRandom for better performance. Contributed by Chen Liang. 2017-03-28 23:02:07 +08:00
John Zhuge 253e3e78ab HADOOP-14038. Rename ADLS credential properties. Contributed by John Zhuge. 2017-03-27 23:05:57 -07:00
Akira Ajisaka 448ec81fd7
HADOOP-14218. Replace assertThat with assertTrue in MetricsAsserts. 2017-03-28 14:32:40 +09:00
Jonathan Eagles db2adf356a Configuration#get return value optimization (jeagles) 2017-03-27 12:48:44 -05:00
Jonathan Eagles 858d597be0 Delay construction of PreCondition.check failure message in Configuration#set (jeagles) 2017-03-27 11:01:48 -05:00
Junping Du 6df029db36 Add COMMON/MAPREDUCE/YARN jdiff of 2.8.0 release. 2017-03-25 14:28:48 -07:00
Junping Du d8e6d6df4c Add 2.8.0 RELEASENOTEs.md and CHANGES.md. 2017-03-25 14:02:25 -07:00
Tsuyoshi Ozawa 84ddedc0b2 HADOOP-10101. Update guava dependency to the latest version. (ozawa) 2017-03-25 10:06:52 +09:00
Andrew Wang 332a997e10 HDFS-11170. Add builder-based create API to FileSystem. Contributed by SammiChen and Wei Zhou. 2017-03-24 12:56:46 -07:00
Andrew Wang 52b00600df HADOOP-13715. Add isErasureCoded() API to FileStatus class. Contributed by Manoj Govindassamy. 2017-03-24 11:44:46 -07:00
Daniel Templeton d49d1862a6 YARN-6360. Prevent FS state dump logger from cramming other log files
(Contributed by Yufei Gu via Daniel Templeton)
2017-03-24 11:31:04 -07:00
Andrew Wang 0e556a5ba6 HADOOP-14211. FilterFs and ChRootedFs are too aggressive about enforcing 'authorityNeeded'. Contributed by Erik Krogen. 2017-03-24 11:12:02 -07:00
John Zhuge ab759e91b7 HDFS-10649. Remove unused PermissionStatus#applyUMask. Contributed by Chen Liang. 2017-03-23 23:31:27 -07:00
John Zhuge 128015584d HADOOP-14195. CredentialProviderFactory$getProviders is not thread-safe. Contributed by Vihang Karajgaonkar. 2017-03-23 13:57:08 -07:00
Mingliang Liu d35e79abc2 HADOOP-14214. DomainSocketWatcher::add()/delete() should not self interrupt while looping await(). Contributed by Mingliang Liu 2017-03-23 13:34:03 -07:00
Ravi Prakash 595f62e362 HADOOP-14213. Move Configuration runtime check for hadoop-site.xml to initialization. Contributed by Jonathan Eagles 2017-03-23 09:28:10 -07:00
Zhe Zhang 59d69257a8 HADOOP-9631. ViewFs should use underlying FileSystem's server side defaults. Contributed by Lohit Vijayarenu and Erik Krogen. 2017-03-22 22:22:22 -07:00
Erik Krogen e1a99802fc HADOOP-14169. Implement listStatusIterator, listLocatedStatus for ViewFs. Contributed by Erik Krogen. 2017-03-17 17:12:49 -07:00
Andrew Wang 92ea6d74ec HDFS-11516. Admin command line should print message to stderr in failure case. Contributed by Kai Sasaki. 2017-03-17 11:26:02 -07:00