Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,915 Commits 326 Branches 371 Tags
Commit Graph

17915 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Billie Rinaldi
8f27c35da8 YARN-7523. Introduce description and version field in Service record. Contributed by Chandni Singh 
(cherry picked from commit e1f5251f3c0d6e74af1b52eda6633b728804fe2a)
 2018-03-10 07:53:20 -08:00
Wangda Tan
4b9eb2188b Updated timeline reader to use AuthenticationFilter 
Change-Id: I961771589180c1eb377d36c37a79aa23754effbf
(cherry picked from commit 837338788eb903d0e8bbb1230694782a707891be)
 2018-03-09 23:01:11 -08:00
Owen O'Malley
4cd4219206 Revert "HADOOP-13119. Add ability to secure log servlet using proxy users. Contribute by Yuanbo Liu." 
This reverts commit a847903b6e64c6edb11d852b91f2c816b1253eb3.

Change-Id: I3122a2142f5bdf8507dece930e447556a43cd9ae
(cherry picked from commit 8fad3ec76070ccfcd3ed80feaba4355077bc6f5c)
 2018-03-09 23:01:11 -08:00
Owen O'Malley
26540a64d4 Revert "HADOOP-14077. Add ability to access jmx via proxy. Contributed by Yuanbo Liu." 
This reverts commit 172b23af33554b7d58fd41b022d983bcc2433da7.

(cherry picked from commit d0d2d4c51e9534e08893ae14cf3fff7b2ee70b1d)
 2018-03-09 23:01:11 -08:00
Yiqun Lin
60c6ded483 HDFS-13240. RBF: Update some inaccurate document descriptions. Contributed by Yiqun Lin. 
(cherry picked from commit 4743d4a2c70a213a41804a24c776e6db00e1b90d)
 2018-03-10 11:30:52 +08:00
Inigo Goiri
86a1c89754 HDFS-13232. RBF: ConnectionPool should return first usable connection. Contributed by Ekanth S. 
(cherry picked from commit 8133cd5305d7913453abb2d48da12f672c0ce334)
 2018-03-09 18:25:46 -08:00
Inigo Goiri
4d41f933a2 HDFS-13212. RBF: Fix router location cache issue. Contributed by Weiwei Wu. 
(cherry picked from commit afe1a3ccd56a12fec900360a8a2855c080728e65)
 2018-03-09 17:19:50 -08:00
Hanisha Koneru
c337c97c63 HDFS-13244. Add stack, conf, metrics links to utilities dropdown in NN webUI. Contributed by Bharat Viswanadham. 
(cherry picked from commit 4eeff62f6925991bca725b1ede5308055817de80)
 2018-03-09 15:48:28 -08:00
Lokesh Jain
0f76690c73
HDFS-13190. Document WebHDFS support for snapshot diff 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
Signed-off-by: Xiaoyu Yao <xyao@apache.org>
(cherry picked from commit 7b0dc310208ee5bc191c9accb3d1312513145653)
 2018-03-09 15:07:16 -08:00
Hanisha Koneru
32e8290e20 HDFS-11394. Support for getting erasure coding policy through WebHDFS#FileStatus. 
(cherry picked from commit 9a082fbe6e302df7139b65a23be9a39acd87715d)
 2018-03-09 13:21:39 -08:00
Jason Lowe
af48a2a0f3 MAPREDUCE-6930. mapreduce.map.cpu.vcores and mapreduce.reduce.cpu.vcores are both present twice in mapred-default.xml. Contributed by Sen Zhao 
(cherry picked from commit 32fa3a63e0e7d8bfb3d3b9b3c500ecb3a4874ecf)
 2018-03-09 10:43:08 -06:00
Steve Loughran
2958666e04 HADOOP-15277. Remove .FluentPropertyBeanIntrospector from CLI operation log output. 
Contributed by Steve Loughran.

(cherry picked from commit 3f7bd467979042161897a7c91c5b094b83164f75)
 2018-03-09 10:44:53 +00:00
Yiqun Lin
9368f7fbab HDFS-13233. RBF: MountTableResolver doesn't return the correct mount point of the given path. Contributed by wangzhiyuan. 
(cherry picked from commit 122805b43acff2b094bd984fa76dbc8d2e110edd)
 2018-03-09 15:44:35 +08:00
Sunil G
f313e59494 YARN-7944. [UI2] Remove master node link from headers of application pages. Contributed by Yesha Vora. 
(cherry picked from commit 113f401f41ee575cb303ceb647bc243108d93a04)
 2018-03-08 23:54:15 +05:30
Inigo Goiri
e27ee2302c HDFS-13232. RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns. Contributed by Chao Sun. 
(cherry picked from commit 0c2b969e0161a068bf9ae013c4b95508dfb90a8a)
 2018-03-08 09:32:51 -08:00
Steve Loughran
ba0184376e HADOOP-15273.distcp can't handle remote stores with different checksum algorithms. 
Contributed by Steve Loughran.

(cherry picked from commit 7ef4d942dd96232b0743a40ed25f77065254f94d)
 2018-03-08 11:25:05 +00:00
Steve Loughran
f0b486f6ae HADOOP-15292. Distcp's use of pread is slowing it down. 
Contributed by Virajith Jalaparti.

(cherry picked from commit 3bd6b1fd85c44354c777ef4fda6415231505b2a4)
 2018-03-08 11:18:33 +00:00
Yiqun Lin
56f14cb5fb HADOOP-15296. Fix a wrong link for RBF in the top page. Contributed by Takanobu Asanuma. 
(cherry picked from commit 4cc9a6d9bb34329d6de30706d5432c7cb675bb88)
 2018-03-08 16:04:20 +08:00
Hanisha Koneru
885d46a245 HDFS-13225. StripeReader#checkMissingBlocks() 's IOException info is incomplete. Contributed by lufei. 
(cherry picked from commit 19ae4429f9a2807548bb4b9ff296521fbdbbb2bc)
 2018-03-07 14:21:04 -08:00
Steve Loughran
1dedc68f9d HADOOP-15267. S3A multipart upload fails when SSE-C encryption is enabled. 
Contributed by Anis Elleuch.
 2018-03-07 18:50:27 +00:00
Jason Lowe
c0986b1b7e YARN-7677. Docker image cannot set HADOOP_CONF_DIR. Contributed by Jim Brennan 
(cherry picked from commit d69b31f7f70f296ddd180e004fa0f827c2f737f2)
 2018-03-07 09:21:54 -06:00
Yiqun Lin
8262b63c8c HDFS-13214. RBF: Complete document of Router configuration. Contributed by Yiqun Lin. 
(cherry picked from commit 58ea2d7a65ccd8b7775021bae1d24b9e5561e67b)
 2018-03-07 15:29:16 +08:00
Xiaoyu Yao
07a966ede3 HDFS-13109. Support fully qualified hdfs path in EZ commands. Contributed by Hanisha Koneru. 
(cherry picked from commit edf9445708ffb7a9e59cb933e049b540f99add1e)
 2018-03-06 18:29:42 -08:00
Allen Wittenauer
1a8e6a52a5
HADOOP-15279. increase maven heap size recommendations 
Signed-off-by: Jason Lowe <jlowe@apache.org>
Signed-off-by: Chris Douglas <cdouglas@apache.org>
(cherry picked from commit d4cc50f62279dc4d607cd05c16de480a76f05880)
 2018-03-06 13:55:11 -08:00
Xiao Chen
2d93a7381e HDFS-13170. Port webhdfs unmaskedpermission parameter to HTTPFS. Contributed by Stephen O'Donnell. 
(cherry picked from commit 92c15e19272a8bb59f8704c44d4cd713d3a58bcb)
 2018-03-06 09:58:01 -08:00
Steve Loughran
e8ecd4fa1d HADOOP-15289. FileStatus.readFields() assertion incorrect. 
Contributed by Steve Loughran.

(cherry picked from commit 12ecb55ffee2b89108eea2565e7ad955ea1fabe7)
 2018-03-06 10:06:11 +00:00
Sen Zhao
429e9d6c19
YARN-7736. Fix itemization in YARN federation document 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 245751ffdc4229715a0c031f57f20748ed16d8a6)
 2018-03-05 11:54:49 -08:00
Steve Loughran
1901987ffe HADOOP-13761. S3Guard: implement retries for DDB failures and throttling; translate exceptions. 
Contributed by Aaron Fabbri.

(cherry picked from commit 8110d6a0d59e7dc2ddb25fa424fab188c5e9ce35)
 2018-03-05 14:08:12 +00:00
Ajay Kumar
92e2e6c22e
HADOOP-15286. Remove unused imports from TestKMSWithZK.java 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 3dc30bc24e50343efe1f514b923d27a0786d3ac1)
 2018-03-04 07:19:33 -08:00
Xiao Chen
d35baf157e HDFS-13040. Kerberized inotify client fails despite kinit properly. Contributed by Istvan Fajth, Wei-Chiu Chuang, Xiao Chen. 
(cherry picked from commit c75105f07b4cdbc2773435fc1125446233113c15)
 2018-03-02 16:47:19 -08:00
Gergely Novák
162e99c696
MAPREDUCE-7023. TestHadoopArchiveLogs.testCheckFilesAndSeedApps fails on rerun 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit e99a1e77671fa0e74a652bc2221bbe01d1a579d3)
 2018-03-02 16:21:41 -08:00
Jason Lowe
9e5ac217ac YARN-7511. NPE in ContainerLocalizer when localization failed for running container. Contributed by Tao Yang 
(cherry picked from commit 83798f15f8602ef580a7885876de114b2425da89)
 2018-03-02 10:00:59 -06:00
Weiwei Yang
46b14efb05 MAPREDUCE-7059. Downward Compatibility issue: MR job fails because of unknown setErasureCodingPolicy method from 3.x client to HDFS 2.x cluster. Contributed by Jiandan Yang. 2018-03-02 10:33:17 +08:00
Sunil G
37b8b24dfb YARN-7637. GPU volume creation command fails when work preserving is disabled at NM. Contributed by Zian Chen. 
(cherry picked from commit 22928c0c60de3ccbd6b27ac3a410e7566ce4136b)
 2018-03-01 22:40:11 +05:30
Billie Rinaldi
5621254bd0 YARN-7958. ServiceMaster should only wait for recovery of containers with id that match the current application id. Contributed by Chandni Singh 
(cherry picked from commit 5ed689e33ac0becfc36d5fa424466bb1732aa59b)
 2018-03-01 08:01:38 -08:00
Nanda kumar
749abde043
HADOOP-15275. Incorrect javadoc for return type of RetryPolicy#shouldRetry 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 55d04a6db10d0e58cfe0ff82fa646bb6ba57aaac)
 2018-03-01 19:04:23 +09:00
Anu Engineer
f0c70a3494 HADOOP-15007. Stabilize and document Configuration <tag> element. Contributed by Ajay Kumar. 2018-02-28 10:46:20 -08:00
Xiaoyu Yao
a795302539 HDFS-13081. Datanode#checkSecureConfig should allow SASL and privileged HTTP. Contributed by Ajay Kumar. 
(cherry picked from commit f20e10b2dd59f99d9af009bbbb60a067b9893e69)
 2018-02-28 09:47:57 -08:00
Xiaoyu Yao
b241491173 HDFS-13114. CryptoAdmin#ReencryptZoneCommand should resolve Namespace info from path. Contributed by Hanisha Koneru. 
(cherry picked from commit 90fbe5c6834a6685e65542fa69e396fad2678927)
 2018-02-28 08:38:32 -08:00
Steve Loughran
abfe1eaf29 HADOOP-15263. hadoop cloud-storage module to mark hadoop-common as provided; add azure-datalake. 
Contributed by Steve Loughran

(cherry picked from commit edc9f1451b4af79069cd4b1d608b0fa68648ee72)
 2018-02-28 14:43:10 +00:00
Steve Loughran
b580196a16 HADOOP-15264. AWS "shaded" SDK 1.271 is pulling in netty 4.1.17. 
Contributed by Steve Loughran.
 2018-02-28 13:09:22 +00:00
Yiqun Lin
d975c104f5 HDFS-13194. CachePool permissions incorrectly checked. Contributed by Jianfei Jiang. 
(cherry picked from commit a9c14b11193adeaa31389578f4cb90fa79cad8c3)
 2018-02-28 10:20:32 +08:00
Inigo Goiri
b375bcfd6b HDFS-13199. RBF: Fix the hdfs router page missing label icon issue. Contributed by maobaolong. 
(cherry picked from commit d86f301d464683f8d392dad50e83f50d823e862e)
 2018-02-27 17:40:29 -08:00
Tsz-Wo Nicholas Sze
3141e17d83 HDFS-13143. SnapshotDiff - snapshotDiffReport might be inconsistent if the snapshotDiff calculation happens between a snapshot and the current tree. Contributed by Shashikant Banerjee 2018-02-27 15:38:05 -08:00
Tsz-Wo Nicholas Sze
7abcea0378 HDFS-12998. SnapshotDiff - Provide an iterator-based listing API for calculating snapshotDiff. Contributed by Shashikant Banerjee 2018-02-27 15:37:48 -08:00
Wangda Tan
164ad48fa7 YARN-7959. Add .vm extension to PlacementConstraints.md to ensure proper filtering. (Weiwei Yang via wangda) 
Change-Id: I34ec516994a5de7accaa5ef7044e443b340bd294
(cherry picked from commit 0d516b30769471d9114214b3a518e2146ff2f25e)
 2018-02-27 13:20:05 -08:00
Wangda Tan
6798adb12d YARN-7893. Document the FPGA isolation feature. (Zhankun Tang via wangda) 
Change-Id: I8723320377a4bd0a7db168670d183ef5543caa67
(cherry picked from commit c2af2f16718bd1d38ceb05e354f34d7bef89127d)
 2018-02-27 13:19:57 -08:00
Arpit Agarwal
ab2674a1ee MAPREDUCE-7061. SingleCluster setup document needs to be updated. Contributed by Bharat Viswanadham. 2018-02-27 10:27:48 -08:00
Arpit Agarwal
7da0b78cf2 HDFS-13181. DiskBalancer: Add an configuration for valid plan hours . Contributed by Bharat Viswanadham. 2018-02-27 10:18:21 -08:00
Billie Rinaldi
b22eaa05a1 MAPREDUCE-7010. Make Job History File Permissions configurable. Contributed by Gergely Novák 2018-02-27 08:50:02 -08:00