Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,918 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

17918 Commits

Author SHA1 Message Date
Chris Douglas c9364b3bce HADOOP-14742. Document multi-URI replication Inode for ViewFS. Contributed by Gera Shegalov 
(cherry picked from commit ddb67ca707)
 2018-03-12 13:47:01 -07:00
Inigo Goiri 2bda1ffe72 HDFS-11399. Many tests fails in Windows due to injecting disk failures. Contributed by Yiqun Lin. 
(cherry picked from commit ac627f561f)
 2018-03-12 10:06:20 -07:00
Steve Loughran 41a3f378bc HADOOP-15297. Make S3A etag => checksum feature optional. 
Contributed by Steve Loughran.

(cherry picked from commit dd05871b8b)
 2018-03-12 14:02:36 +00:00
Billie Rinaldi 8f27c35da8 YARN-7523. Introduce description and version field in Service record. Contributed by Chandni Singh 
(cherry picked from commit e1f5251f3c)
 2018-03-10 07:53:20 -08:00
Wangda Tan 4b9eb2188b Updated timeline reader to use AuthenticationFilter 
Change-Id: I961771589180c1eb377d36c37a79aa23754effbf
(cherry picked from commit 837338788eb903d0e8bbb1230694782a707891be)
 2018-03-09 23:01:11 -08:00
Owen O'Malley 4cd4219206 Revert "HADOOP-13119. Add ability to secure log servlet using proxy users. Contribute by Yuanbo Liu." 
This reverts commit a847903b6e.

Change-Id: I3122a2142f5bdf8507dece930e447556a43cd9ae
(cherry picked from commit 8fad3ec76070ccfcd3ed80feaba4355077bc6f5c)
 2018-03-09 23:01:11 -08:00
Owen O'Malley 26540a64d4 Revert "HADOOP-14077. Add ability to access jmx via proxy. Contributed by Yuanbo Liu." 
This reverts commit 172b23af33.

(cherry picked from commit d0d2d4c51e9534e08893ae14cf3fff7b2ee70b1d)
 2018-03-09 23:01:11 -08:00
Yiqun Lin 60c6ded483 HDFS-13240. RBF: Update some inaccurate document descriptions. Contributed by Yiqun Lin. 
(cherry picked from commit 4743d4a2c7)
 2018-03-10 11:30:52 +08:00
Inigo Goiri 86a1c89754 HDFS-13232. RBF: ConnectionPool should return first usable connection. Contributed by Ekanth S. 
(cherry picked from commit 8133cd5305)
 2018-03-09 18:25:46 -08:00
Inigo Goiri 4d41f933a2 HDFS-13212. RBF: Fix router location cache issue. Contributed by Weiwei Wu. 
(cherry picked from commit afe1a3ccd5)
 2018-03-09 17:19:50 -08:00
Hanisha Koneru c337c97c63 HDFS-13244. Add stack, conf, metrics links to utilities dropdown in NN webUI. Contributed by Bharat Viswanadham. 
(cherry picked from commit 4eeff62f69)
 2018-03-09 15:48:28 -08:00
Lokesh Jain 0f76690c73
HDFS-13190. Document WebHDFS support for snapshot diff 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
Signed-off-by: Xiaoyu Yao <xyao@apache.org>
(cherry picked from commit 7b0dc31020)
 2018-03-09 15:07:16 -08:00
Hanisha Koneru 32e8290e20 HDFS-11394. Support for getting erasure coding policy through WebHDFS#FileStatus. 
(cherry picked from commit 9a082fbe6e)
 2018-03-09 13:21:39 -08:00
Jason Lowe af48a2a0f3 MAPREDUCE-6930. mapreduce.map.cpu.vcores and mapreduce.reduce.cpu.vcores are both present twice in mapred-default.xml. Contributed by Sen Zhao 
(cherry picked from commit 32fa3a63e0)
 2018-03-09 10:43:08 -06:00
Steve Loughran 2958666e04 HADOOP-15277. Remove .FluentPropertyBeanIntrospector from CLI operation log output. 
Contributed by Steve Loughran.

(cherry picked from commit 3f7bd46797)
 2018-03-09 10:44:53 +00:00
Yiqun Lin 9368f7fbab HDFS-13233. RBF: MountTableResolver doesn't return the correct mount point of the given path. Contributed by wangzhiyuan. 
(cherry picked from commit 122805b43a)
 2018-03-09 15:44:35 +08:00
Sunil G f313e59494 YARN-7944. [UI2] Remove master node link from headers of application pages. Contributed by Yesha Vora. 
(cherry picked from commit 113f401f41)
 2018-03-08 23:54:15 +05:30
Inigo Goiri e27ee2302c HDFS-13232. RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns. Contributed by Chao Sun. 
(cherry picked from commit 0c2b969e01)
 2018-03-08 09:32:51 -08:00
Steve Loughran ba0184376e HADOOP-15273.distcp can't handle remote stores with different checksum algorithms. 
Contributed by Steve Loughran.

(cherry picked from commit 7ef4d942dd)
 2018-03-08 11:25:05 +00:00
Steve Loughran f0b486f6ae HADOOP-15292. Distcp's use of pread is slowing it down. 
Contributed by Virajith Jalaparti.

(cherry picked from commit 3bd6b1fd85)
 2018-03-08 11:18:33 +00:00
Yiqun Lin 56f14cb5fb HADOOP-15296. Fix a wrong link for RBF in the top page. Contributed by Takanobu Asanuma. 
(cherry picked from commit 4cc9a6d9bb)
 2018-03-08 16:04:20 +08:00
Hanisha Koneru 885d46a245 HDFS-13225. StripeReader#checkMissingBlocks() 's IOException info is incomplete. Contributed by lufei. 
(cherry picked from commit 19ae4429f9)
 2018-03-07 14:21:04 -08:00
Steve Loughran 1dedc68f9d HADOOP-15267. S3A multipart upload fails when SSE-C encryption is enabled. 
Contributed by Anis Elleuch.
 2018-03-07 18:50:27 +00:00
Jason Lowe c0986b1b7e YARN-7677. Docker image cannot set HADOOP_CONF_DIR. Contributed by Jim Brennan 
(cherry picked from commit d69b31f7f7)
 2018-03-07 09:21:54 -06:00
Yiqun Lin 8262b63c8c HDFS-13214. RBF: Complete document of Router configuration. Contributed by Yiqun Lin. 
(cherry picked from commit 58ea2d7a65)
 2018-03-07 15:29:16 +08:00
Xiaoyu Yao 07a966ede3 HDFS-13109. Support fully qualified hdfs path in EZ commands. Contributed by Hanisha Koneru. 
(cherry picked from commit edf9445708)
 2018-03-06 18:29:42 -08:00
Allen Wittenauer 1a8e6a52a5
HADOOP-15279. increase maven heap size recommendations 
Signed-off-by: Jason Lowe <jlowe@apache.org>
Signed-off-by: Chris Douglas <cdouglas@apache.org>
(cherry picked from commit d4cc50f622)
 2018-03-06 13:55:11 -08:00
Xiao Chen 2d93a7381e HDFS-13170. Port webhdfs unmaskedpermission parameter to HTTPFS. Contributed by Stephen O'Donnell. 
(cherry picked from commit 92c15e19272a8bb59f8704c44d4cd713d3a58bcb)
 2018-03-06 09:58:01 -08:00
Steve Loughran e8ecd4fa1d HADOOP-15289. FileStatus.readFields() assertion incorrect. 
Contributed by Steve Loughran.

(cherry picked from commit 12ecb55ffe)
 2018-03-06 10:06:11 +00:00
Sen Zhao 429e9d6c19
YARN-7736. Fix itemization in YARN federation document 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 245751ffdc)
 2018-03-05 11:54:49 -08:00
Steve Loughran 1901987ffe HADOOP-13761. S3Guard: implement retries for DDB failures and throttling; translate exceptions. 
Contributed by Aaron Fabbri.

(cherry picked from commit 8110d6a0d5)
 2018-03-05 14:08:12 +00:00
Ajay Kumar 92e2e6c22e
HADOOP-15286. Remove unused imports from TestKMSWithZK.java 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 3dc30bc24e)
 2018-03-04 07:19:33 -08:00
Xiao Chen d35baf157e HDFS-13040. Kerberized inotify client fails despite kinit properly. Contributed by Istvan Fajth, Wei-Chiu Chuang, Xiao Chen. 
(cherry picked from commit c75105f07b)
 2018-03-02 16:47:19 -08:00
Gergely Novák 162e99c696
MAPREDUCE-7023. TestHadoopArchiveLogs.testCheckFilesAndSeedApps fails on rerun 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit e99a1e7767)
 2018-03-02 16:21:41 -08:00
Jason Lowe 9e5ac217ac YARN-7511. NPE in ContainerLocalizer when localization failed for running container. Contributed by Tao Yang 
(cherry picked from commit 83798f15f8)
 2018-03-02 10:00:59 -06:00
Weiwei Yang 46b14efb05 MAPREDUCE-7059. Downward Compatibility issue: MR job fails because of unknown setErasureCodingPolicy method from 3.x client to HDFS 2.x cluster. Contributed by Jiandan Yang. 2018-03-02 10:33:17 +08:00
Sunil G 37b8b24dfb YARN-7637. GPU volume creation command fails when work preserving is disabled at NM. Contributed by Zian Chen. 
(cherry picked from commit 22928c0c60)
 2018-03-01 22:40:11 +05:30
Billie Rinaldi 5621254bd0 YARN-7958. ServiceMaster should only wait for recovery of containers with id that match the current application id. Contributed by Chandni Singh 
(cherry picked from commit 5ed689e33a)
 2018-03-01 08:01:38 -08:00
Nanda kumar 749abde043
HADOOP-15275. Incorrect javadoc for return type of RetryPolicy#shouldRetry 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 55d04a6db1)
 2018-03-01 19:04:23 +09:00
Anu Engineer f0c70a3494 HADOOP-15007. Stabilize and document Configuration <tag> element. Contributed by Ajay Kumar. 2018-02-28 10:46:20 -08:00
Xiaoyu Yao a795302539 HDFS-13081. Datanode#checkSecureConfig should allow SASL and privileged HTTP. Contributed by Ajay Kumar. 
(cherry picked from commit f20e10b2dd)
 2018-02-28 09:47:57 -08:00
Xiaoyu Yao b241491173 HDFS-13114. CryptoAdmin#ReencryptZoneCommand should resolve Namespace info from path. Contributed by Hanisha Koneru. 
(cherry picked from commit 90fbe5c6834a6685e65542fa69e396fad2678927)
 2018-02-28 08:38:32 -08:00
Steve Loughran abfe1eaf29 HADOOP-15263. hadoop cloud-storage module to mark hadoop-common as provided; add azure-datalake. 
Contributed by Steve Loughran

(cherry picked from commit edc9f1451b)
 2018-02-28 14:43:10 +00:00
Steve Loughran b580196a16 HADOOP-15264. AWS "shaded" SDK 1.271 is pulling in netty 4.1.17. 
Contributed by Steve Loughran.
 2018-02-28 13:09:22 +00:00
Yiqun Lin d975c104f5 HDFS-13194. CachePool permissions incorrectly checked. Contributed by Jianfei Jiang. 
(cherry picked from commit a9c14b1119)
 2018-02-28 10:20:32 +08:00
Inigo Goiri b375bcfd6b HDFS-13199. RBF: Fix the hdfs router page missing label icon issue. Contributed by maobaolong. 
(cherry picked from commit d86f301d46)
 2018-02-27 17:40:29 -08:00
Tsz-Wo Nicholas Sze 3141e17d83 HDFS-13143. SnapshotDiff - snapshotDiffReport might be inconsistent if the snapshotDiff calculation happens between a snapshot and the current tree. Contributed by Shashikant Banerjee 2018-02-27 15:38:05 -08:00
Tsz-Wo Nicholas Sze 7abcea0378 HDFS-12998. SnapshotDiff - Provide an iterator-based listing API for calculating snapshotDiff. Contributed by Shashikant Banerjee 2018-02-27 15:37:48 -08:00
Wangda Tan 164ad48fa7 YARN-7959. Add .vm extension to PlacementConstraints.md to ensure proper filtering. (Weiwei Yang via wangda) 
Change-Id: I34ec516994a5de7accaa5ef7044e443b340bd294
(cherry picked from commit 0d516b30769471d9114214b3a518e2146ff2f25e)
 2018-02-27 13:20:05 -08:00
Wangda Tan 6798adb12d YARN-7893. Document the FPGA isolation feature. (Zhankun Tang via wangda) 
Change-Id: I8723320377a4bd0a7db168670d183ef5543caa67
(cherry picked from commit c2af2f16718bd1d38ceb05e354f34d7bef89127d)
 2018-02-27 13:19:57 -08:00