Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,926 Commits 326 Branches 371 Tags
Commit Graph

17926 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Chris Douglas
032f05ea90 HDFS-13271. WebHDFS: Add constructor in SnapshottableDirectoryStatus with HdfsFileStatus as argument. Contributed by Lokesh Jain 
(cherry picked from commit b2b9ce585984a1791a8af3e2287c75c75b95586f)
 2018-03-13 09:44:30 -07:00
Xiaoyu Yao
509d6b1fe0 HDFS-13141. WebHDFS: Add support for getting snasphottable directory list. Contributed by Lokesh Jain. 
(cherry picked from commit c927054687c77e5ef16ee7e0a0f36bbb7fc8a464)
 2018-03-12 20:49:03 -07:00
Chris Douglas
09940b1eb3 HADOOP-14696. parallel tests don't work for Windows. Contributed by Allen Wittenauer 
(cherry picked from commit 45d1b0fdcc04a86be91a9b72073cdc30bec04d3b)
 2018-03-12 20:06:04 -07:00
Yiqun Lin
c966731742 HDFS-13226. RBF: Throw the exception if mount table entry validated failed. Contributed by maobaolong. 
(cherry picked from commit 19292bc264cada5117ec76063d36cc88159afdf4)
 2018-03-13 11:04:51 +08:00
Yiqun Lin
e908a52f19 HDFS-13253. RBF: Quota management incorrect parent-child relationship judgement. Contributed by Yiqun Lin. 
(cherry picked from commit 7fab787de72756863a91c2358da5c611afdb80e9)
 2018-03-13 10:31:53 +08:00
Akira Ajisaka
b01f8fd2bc
HDFS-12156. TestFSImage fails without -Pnative 
(cherry picked from commit 319defafc105c0d0b69b83828b578d9c453036f5)
 2018-03-13 11:27:28 +09:00
Inigo Goiri
c73f34fead HDFS-13241. RBF: TestRouterSafemode failed if the port 8888 is in use. Contributed by maobaolong. 
(cherry picked from commit 91c82c90f05ea75fe59c6ffad3dc3fcac1429e9e)
 2018-03-12 17:29:11 -07:00
Chris Douglas
75d3699a00 HDFS-12677. Extend TestReconstructStripedFile with a random EC policy. Contributed by Takanobu Asanuma 
(cherry picked from commit 39a5fbae479ecee3a563e2f4eb937471fbf666f8)
 2018-03-12 14:30:06 -07:00
Chris Douglas
c9364b3bce HADOOP-14742. Document multi-URI replication Inode for ViewFS. Contributed by Gera Shegalov 
(cherry picked from commit ddb67ca707de896cd0ba5cda3c0d1a2d9edca968)
 2018-03-12 13:47:01 -07:00
Inigo Goiri
2bda1ffe72 HDFS-11399. Many tests fails in Windows due to injecting disk failures. Contributed by Yiqun Lin. 
(cherry picked from commit ac627f561f0946e98a650850fb507536cbd2f2c4)
 2018-03-12 10:06:20 -07:00
Steve Loughran
41a3f378bc HADOOP-15297. Make S3A etag => checksum feature optional. 
Contributed by Steve Loughran.

(cherry picked from commit dd05871b8b57303fe0b0c652e03257b59c191802)
 2018-03-12 14:02:36 +00:00
Billie Rinaldi
8f27c35da8 YARN-7523. Introduce description and version field in Service record. Contributed by Chandni Singh 
(cherry picked from commit e1f5251f3c0d6e74af1b52eda6633b728804fe2a)
 2018-03-10 07:53:20 -08:00
Wangda Tan
4b9eb2188b Updated timeline reader to use AuthenticationFilter 
Change-Id: I961771589180c1eb377d36c37a79aa23754effbf
(cherry picked from commit 837338788eb903d0e8bbb1230694782a707891be)
 2018-03-09 23:01:11 -08:00
Owen O'Malley
4cd4219206 Revert "HADOOP-13119. Add ability to secure log servlet using proxy users. Contribute by Yuanbo Liu." 
This reverts commit a847903b6e64c6edb11d852b91f2c816b1253eb3.

Change-Id: I3122a2142f5bdf8507dece930e447556a43cd9ae
(cherry picked from commit 8fad3ec76070ccfcd3ed80feaba4355077bc6f5c)
 2018-03-09 23:01:11 -08:00
Owen O'Malley
26540a64d4 Revert "HADOOP-14077. Add ability to access jmx via proxy. Contributed by Yuanbo Liu." 
This reverts commit 172b23af33554b7d58fd41b022d983bcc2433da7.

(cherry picked from commit d0d2d4c51e9534e08893ae14cf3fff7b2ee70b1d)
 2018-03-09 23:01:11 -08:00
Yiqun Lin
60c6ded483 HDFS-13240. RBF: Update some inaccurate document descriptions. Contributed by Yiqun Lin. 
(cherry picked from commit 4743d4a2c70a213a41804a24c776e6db00e1b90d)
 2018-03-10 11:30:52 +08:00
Inigo Goiri
86a1c89754 HDFS-13232. RBF: ConnectionPool should return first usable connection. Contributed by Ekanth S. 
(cherry picked from commit 8133cd5305d7913453abb2d48da12f672c0ce334)
 2018-03-09 18:25:46 -08:00
Inigo Goiri
4d41f933a2 HDFS-13212. RBF: Fix router location cache issue. Contributed by Weiwei Wu. 
(cherry picked from commit afe1a3ccd56a12fec900360a8a2855c080728e65)
 2018-03-09 17:19:50 -08:00
Hanisha Koneru
c337c97c63 HDFS-13244. Add stack, conf, metrics links to utilities dropdown in NN webUI. Contributed by Bharat Viswanadham. 
(cherry picked from commit 4eeff62f6925991bca725b1ede5308055817de80)
 2018-03-09 15:48:28 -08:00
Lokesh Jain
0f76690c73
HDFS-13190. Document WebHDFS support for snapshot diff 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
Signed-off-by: Xiaoyu Yao <xyao@apache.org>
(cherry picked from commit 7b0dc310208ee5bc191c9accb3d1312513145653)
 2018-03-09 15:07:16 -08:00
Hanisha Koneru
32e8290e20 HDFS-11394. Support for getting erasure coding policy through WebHDFS#FileStatus. 
(cherry picked from commit 9a082fbe6e302df7139b65a23be9a39acd87715d)
 2018-03-09 13:21:39 -08:00
Jason Lowe
af48a2a0f3 MAPREDUCE-6930. mapreduce.map.cpu.vcores and mapreduce.reduce.cpu.vcores are both present twice in mapred-default.xml. Contributed by Sen Zhao 
(cherry picked from commit 32fa3a63e0e7d8bfb3d3b9b3c500ecb3a4874ecf)
 2018-03-09 10:43:08 -06:00
Steve Loughran
2958666e04 HADOOP-15277. Remove .FluentPropertyBeanIntrospector from CLI operation log output. 
Contributed by Steve Loughran.

(cherry picked from commit 3f7bd467979042161897a7c91c5b094b83164f75)
 2018-03-09 10:44:53 +00:00
Yiqun Lin
9368f7fbab HDFS-13233. RBF: MountTableResolver doesn't return the correct mount point of the given path. Contributed by wangzhiyuan. 
(cherry picked from commit 122805b43acff2b094bd984fa76dbc8d2e110edd)
 2018-03-09 15:44:35 +08:00
Sunil G
f313e59494 YARN-7944. [UI2] Remove master node link from headers of application pages. Contributed by Yesha Vora. 
(cherry picked from commit 113f401f41ee575cb303ceb647bc243108d93a04)
 2018-03-08 23:54:15 +05:30
Inigo Goiri
e27ee2302c HDFS-13232. RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns. Contributed by Chao Sun. 
(cherry picked from commit 0c2b969e0161a068bf9ae013c4b95508dfb90a8a)
 2018-03-08 09:32:51 -08:00
Steve Loughran
ba0184376e HADOOP-15273.distcp can't handle remote stores with different checksum algorithms. 
Contributed by Steve Loughran.

(cherry picked from commit 7ef4d942dd96232b0743a40ed25f77065254f94d)
 2018-03-08 11:25:05 +00:00
Steve Loughran
f0b486f6ae HADOOP-15292. Distcp's use of pread is slowing it down. 
Contributed by Virajith Jalaparti.

(cherry picked from commit 3bd6b1fd85c44354c777ef4fda6415231505b2a4)
 2018-03-08 11:18:33 +00:00
Yiqun Lin
56f14cb5fb HADOOP-15296. Fix a wrong link for RBF in the top page. Contributed by Takanobu Asanuma. 
(cherry picked from commit 4cc9a6d9bb34329d6de30706d5432c7cb675bb88)
 2018-03-08 16:04:20 +08:00
Hanisha Koneru
885d46a245 HDFS-13225. StripeReader#checkMissingBlocks() 's IOException info is incomplete. Contributed by lufei. 
(cherry picked from commit 19ae4429f9a2807548bb4b9ff296521fbdbbb2bc)
 2018-03-07 14:21:04 -08:00
Steve Loughran
1dedc68f9d HADOOP-15267. S3A multipart upload fails when SSE-C encryption is enabled. 
Contributed by Anis Elleuch.
 2018-03-07 18:50:27 +00:00
Jason Lowe
c0986b1b7e YARN-7677. Docker image cannot set HADOOP_CONF_DIR. Contributed by Jim Brennan 
(cherry picked from commit d69b31f7f70f296ddd180e004fa0f827c2f737f2)
 2018-03-07 09:21:54 -06:00
Yiqun Lin
8262b63c8c HDFS-13214. RBF: Complete document of Router configuration. Contributed by Yiqun Lin. 
(cherry picked from commit 58ea2d7a65ccd8b7775021bae1d24b9e5561e67b)
 2018-03-07 15:29:16 +08:00
Xiaoyu Yao
07a966ede3 HDFS-13109. Support fully qualified hdfs path in EZ commands. Contributed by Hanisha Koneru. 
(cherry picked from commit edf9445708ffb7a9e59cb933e049b540f99add1e)
 2018-03-06 18:29:42 -08:00
Allen Wittenauer
1a8e6a52a5
HADOOP-15279. increase maven heap size recommendations 
Signed-off-by: Jason Lowe <jlowe@apache.org>
Signed-off-by: Chris Douglas <cdouglas@apache.org>
(cherry picked from commit d4cc50f62279dc4d607cd05c16de480a76f05880)
 2018-03-06 13:55:11 -08:00
Xiao Chen
2d93a7381e HDFS-13170. Port webhdfs unmaskedpermission parameter to HTTPFS. Contributed by Stephen O'Donnell. 
(cherry picked from commit 92c15e19272a8bb59f8704c44d4cd713d3a58bcb)
 2018-03-06 09:58:01 -08:00
Steve Loughran
e8ecd4fa1d HADOOP-15289. FileStatus.readFields() assertion incorrect. 
Contributed by Steve Loughran.

(cherry picked from commit 12ecb55ffee2b89108eea2565e7ad955ea1fabe7)
 2018-03-06 10:06:11 +00:00
Sen Zhao
429e9d6c19
YARN-7736. Fix itemization in YARN federation document 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 245751ffdc4229715a0c031f57f20748ed16d8a6)
 2018-03-05 11:54:49 -08:00
Steve Loughran
1901987ffe HADOOP-13761. S3Guard: implement retries for DDB failures and throttling; translate exceptions. 
Contributed by Aaron Fabbri.

(cherry picked from commit 8110d6a0d59e7dc2ddb25fa424fab188c5e9ce35)
 2018-03-05 14:08:12 +00:00
Ajay Kumar
92e2e6c22e
HADOOP-15286. Remove unused imports from TestKMSWithZK.java 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 3dc30bc24e50343efe1f514b923d27a0786d3ac1)
 2018-03-04 07:19:33 -08:00
Xiao Chen
d35baf157e HDFS-13040. Kerberized inotify client fails despite kinit properly. Contributed by Istvan Fajth, Wei-Chiu Chuang, Xiao Chen. 
(cherry picked from commit c75105f07b4cdbc2773435fc1125446233113c15)
 2018-03-02 16:47:19 -08:00
Gergely Novák
162e99c696
MAPREDUCE-7023. TestHadoopArchiveLogs.testCheckFilesAndSeedApps fails on rerun 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit e99a1e77671fa0e74a652bc2221bbe01d1a579d3)
 2018-03-02 16:21:41 -08:00
Jason Lowe
9e5ac217ac YARN-7511. NPE in ContainerLocalizer when localization failed for running container. Contributed by Tao Yang 
(cherry picked from commit 83798f15f8602ef580a7885876de114b2425da89)
 2018-03-02 10:00:59 -06:00
Weiwei Yang
46b14efb05 MAPREDUCE-7059. Downward Compatibility issue: MR job fails because of unknown setErasureCodingPolicy method from 3.x client to HDFS 2.x cluster. Contributed by Jiandan Yang. 2018-03-02 10:33:17 +08:00
Sunil G
37b8b24dfb YARN-7637. GPU volume creation command fails when work preserving is disabled at NM. Contributed by Zian Chen. 
(cherry picked from commit 22928c0c60de3ccbd6b27ac3a410e7566ce4136b)
 2018-03-01 22:40:11 +05:30
Billie Rinaldi
5621254bd0 YARN-7958. ServiceMaster should only wait for recovery of containers with id that match the current application id. Contributed by Chandni Singh 
(cherry picked from commit 5ed689e33ac0becfc36d5fa424466bb1732aa59b)
 2018-03-01 08:01:38 -08:00
Nanda kumar
749abde043
HADOOP-15275. Incorrect javadoc for return type of RetryPolicy#shouldRetry 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 55d04a6db10d0e58cfe0ff82fa646bb6ba57aaac)
 2018-03-01 19:04:23 +09:00
Anu Engineer
f0c70a3494 HADOOP-15007. Stabilize and document Configuration <tag> element. Contributed by Ajay Kumar. 2018-02-28 10:46:20 -08:00
Xiaoyu Yao
a795302539 HDFS-13081. Datanode#checkSecureConfig should allow SASL and privileged HTTP. Contributed by Ajay Kumar. 
(cherry picked from commit f20e10b2dd59f99d9af009bbbb60a067b9893e69)
 2018-02-28 09:47:57 -08:00
Xiaoyu Yao
b241491173 HDFS-13114. CryptoAdmin#ReencryptZoneCommand should resolve Namespace info from path. Contributed by Hanisha Koneru. 
(cherry picked from commit 90fbe5c6834a6685e65542fa69e396fad2678927)
 2018-02-28 08:38:32 -08:00