Commit Graph

131 Commits

Author SHA1 Message Date
Andrew Wang bcd402ae38 HADOOP-11312. Fix unit tests to not use uppercase key names. 2014-11-18 10:47:46 -08:00
Brandon Li 351c5561c2 HDFS-7146. NFS ID/Group lookup requires SSSD enumeration on the server. Contributed by Yongjun Zhang 2014-11-17 13:23:53 -08:00
Brandon Li 99d9d0c2d1 HDFS-7387. NFS may only do partial commit due to a race between COMMIT and write. Contributed by Brandon Li 2014-11-11 13:03:31 -08:00
Haohui Mai 2cc868dede HADOOP-11296. Nfs3FileAttributes should not change the values of rdev, nlink and size in the constructor. Contributed by Brandon Li. 2014-11-10 15:42:58 -08:00
Jing Zhao 27f106e226 HDFS-7356. Use DirectoryListing.hasMore() directly in nfs. Contributed by Li Lu. 2014-11-04 15:04:26 -08:00
Haohui Mai 05b66ca074 HADOOP-11247. Fix a couple javac warnings in NFS. Contributed by Brandon Li. 2014-10-29 17:54:26 -07:00
Brandon Li 72a556d3b0 HADOOP-11195. Move Id-Name mapping in NFS to the hadoop-common area for better maintenance. Contributed by Yongjun Zhang 2014-10-29 11:05:29 -07:00
Brandon Li d71d40a63d HDFS-7180. NFSv3 gateway frequently gets stuck due to GC. Contributed by Brandon Li 2014-10-22 21:27:01 -07:00
Brandon Li 4e134a02a4 HDFS-7215.Add JvmPauseMonitor to NFS gateway. Contributed by Brandon Li 2014-10-21 11:49:10 -07:00
Brandon Li b6f9d5538c HDFS-7259. Unresponseive NFS mount point due to deferred COMMIT response. Contributed by Brandon Li 2014-10-21 10:20:29 -07:00
Haohui Mai 875aa797ca HDFS-6894. Add XDR parser method for each NFS response. Contributed by Brandon Li. 2014-10-01 13:18:56 -07:00
Colin Patrick Mccabe 25fd69a8f9 HDFS-7096. Fix TestRpcProgramNfs3 to use DFS_ENCRYPTION_KEY_PROVIDER_URI (clamb via cmccabe) 2014-09-19 09:20:25 -07:00
Andrew Wang 70be56d093 HDFS-7003. Add NFS Gateway support for reading and writing to encryption zones. (clamb via wang) 2014-09-18 14:57:25 -07:00
Haohui Mai 08a9ac7098 HDFS-6942. Fix typos in log messages. Contributed by Ray Chiang. 2014-09-02 16:22:18 -07:00
brandonli cd9182d8b5 HDFS-6892. Add XDR packaging method for each NFS request. Contributed by Brandon Li 2014-08-27 11:06:01 -07:00
Brandon Li 7b28f363b1 HDFS-6890. NFS readdirplus doesn't return dotdot attributes. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619500 13f79535-47bb-0310-9956-ffa450edef68
2014-08-21 17:53:54 +00:00
Aaron Myers 894b4e427f HDFS-6850. Move NFS out of order write unit tests into TestWrites class. Contributed by Zhe Zhang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618091 13f79535-47bb-0310-9956-ffa450edef68
2014-08-15 02:33:24 +00:00
Brandon Li b760f20af1 HDFS-6582. Missing null check in RpcProgramNfs3#read(XDR, SecurityHandler). Contributed by Abhiraj Butala
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617366 13f79535-47bb-0310-9956-ffa450edef68
2014-08-11 21:34:02 +00:00
Brandon Li c9aa747437 HDFS-6451. NFS should not return NFS3ERR_IO for AccessControlException. Contributed by Abhiraj Butala
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615702 13f79535-47bb-0310-9956-ffa450edef68
2014-08-04 17:40:02 +00:00
Brandon Li 2a5f1029a5 HDFS-6455. NFS: Exception should be added in NFS log for invalid separator in nfs.exports.allowed.hosts. Contributed by Abhiraj Butala
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612947 13f79535-47bb-0310-9956-ffa450edef68
2014-07-23 21:22:50 +00:00
Brandon Li c5686addb1 HDFS-6703. NFS: Files can be deleted from a read-only mount. Contributed by Srikanth Upputuri
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612702 13f79535-47bb-0310-9956-ffa450edef68
2014-07-22 20:53:50 +00:00
Alejandro Abdelnur 64ed72a047 HADOOP-10817. ProxyUsers configuration should support configurable prefixes. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611780 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 19:42:01 +00:00
Brandon Li e896de98f2 HDFS-6689. NFS doesn't return correct lookup access for direcories. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611135 13f79535-47bb-0310-9956-ffa450edef68
2014-07-16 18:52:03 +00:00
Aaron Myers 5f880f79d2 HADOOP-10701. NFS should not validate the access premission only based on the user's primary group. Contributed by Harsh J.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606042 13f79535-47bb-0310-9956-ffa450edef68
2014-06-27 12:00:55 +00:00
Aaron Myers 9ff3836a36 HDFS-6549. Add support for accessing the NFS gateway from the AIX NFS client. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604022 13f79535-47bb-0310-9956-ffa450edef68
2014-06-19 19:39:29 +00:00
Brandon Li eb93f73ea8 HDFS-6553. Add missing DeprecationDeltas for NFS Kerberos configurations. Contributed by Stephen Chu
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603677 13f79535-47bb-0310-9956-ffa450edef68
2014-06-18 23:51:49 +00:00
Brandon Li 2ecab65e3e HDFS-6439. NFS should not reject NFS requests to the NULL procedure whether port monitoring is enabled or not. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603622 13f79535-47bb-0310-9956-ffa450edef68
2014-06-18 20:45:53 +00:00
Haohui Mai 22cbcd16cb HADOOP-10717. Revert r1603571.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603620 13f79535-47bb-0310-9956-ffa450edef68
2014-06-18 20:37:25 +00:00
Steve Loughran bae5837d3b HADOOP-10717. Missing JSP support in Jetty
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603534 13f79535-47bb-0310-9956-ffa450edef68
2014-06-18 17:08:45 +00:00
Brandon Li 42391d260d HDFS-6056. Clean up NFS config settings. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598782 13f79535-47bb-0310-9956-ffa450edef68
2014-05-30 23:53:00 +00:00
Brandon Li c55947343e HDFS-6462. NFS: fsstat request fails with the secure hdfs. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598405 13f79535-47bb-0310-9956-ffa450edef68
2014-05-29 21:16:04 +00:00
Arpit Agarwal 4a4868e523 HADOOP-10448. Support pluggable mechanism to specify proxy user settings (Contributed by Benoy Antony)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598396 13f79535-47bb-0310-9956-ffa450edef68
2014-05-29 20:52:01 +00:00
Brandon Li 0ec6fc9e3c HDFS-6411. nfs-hdfs-gateway mount raises I/O error and hangs when a unauthorized user attempts to access it. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597895 13f79535-47bb-0310-9956-ffa450edef68
2014-05-27 22:58:55 +00:00
Brandon Li 1c867b1de8 HDFS-6416. Use Time#monotonicNow in OpenFileCtx and OpenFileCtxCatch to avoid system clock bugs. Contributed by Abhiraj Butala
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597868 13f79535-47bb-0310-9956-ffa450edef68
2014-05-27 20:21:33 +00:00
Aaron Myers da3992b4e3 HDFS-6406. Add capability for NFS gateway to reject connections from unprivileged ports. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1595351 13f79535-47bb-0310-9956-ffa450edef68
2014-05-16 21:23:03 +00:00
Haohui Mai d777cb8996 HADOOP-10563. Remove the dependency of jsp in trunk. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1592069 13f79535-47bb-0310-9956-ffa450edef68
2014-05-02 22:26:02 +00:00
Aaron Myers 7bad941152 HDFS-6281. Provide option to use the NFS Gateway without having to use the Hadoop portmapper. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589914 13f79535-47bb-0310-9956-ffa450edef68
2014-04-25 00:16:47 +00:00
Brandon Li a5b37c6ed1 HDFS-6181. Fix the wrong property names in NFS user guide. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1585563 13f79535-47bb-0310-9956-ffa450edef68
2014-04-07 18:55:49 +00:00
Brandon Li 3bfd18c6b0 HDFS-6050. NFS does not handle exceptions correctly in a few places. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1581055 13f79535-47bb-0310-9956-ffa450edef68
2014-03-24 20:49:30 +00:00
Brandon Li 842aa2bc94 HDFS-6080. Improve NFS gateway performance by making rtmax and wtmax configurable. Contributed by Abin Shahab
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577319 13f79535-47bb-0310-9956-ffa450edef68
2014-03-13 21:03:59 +00:00
Aaron Myers 6adf7a0ecb HDFS-5898. Allow NFS gateway to login/relogin from its kerberos keytab. Contributed by Abin Shahab.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1574693 13f79535-47bb-0310-9956-ffa450edef68
2014-03-05 22:20:39 +00:00
Brandon Li 983f11ba2d HDFS-5913. Nfs3Utils#getWccAttr() should check attr parameter against null. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1568076 13f79535-47bb-0310-9956-ffa450edef68
2014-02-13 22:41:29 +00:00
Brandon Li c7e265bf26 HDFS-5886. Potential null pointer deference in RpcProgramNfs3#readlink(). Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1566468 13f79535-47bb-0310-9956-ffa450edef68
2014-02-09 23:15:48 +00:00
Jing Zhao 1f7dd7811a HDFS-5804. HDFS NFS Gateway fails to mount and proxy when using Kerberos. Contributed by Abin Shahab.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1563323 13f79535-47bb-0310-9956-ffa450edef68
2014-01-31 23:00:34 +00:00
Brandon Li 1be8ee2424 HDFS-5649. Unregister NFS and Mount service when NFS gateway is shutting down. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1556405 13f79535-47bb-0310-9956-ffa450edef68
2014-01-07 23:43:04 +00:00
Brandon Li 5792d59da3 HDFS-5657. race condition causes writeback state error in NFS gateway. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1551691 13f79535-47bb-0310-9956-ffa450edef68
2013-12-17 20:40:15 +00:00
Brandon Li 5ea533c2bf HDFS-5563. NFS gateway should commit the buffered data when read request comes after write to the same file. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1546233 13f79535-47bb-0310-9956-ffa450edef68
2013-11-27 23:41:15 +00:00
Brandon Li 82d0e820d0 HDFS-5407. Fix typos in DFSClientCache. Contributed by Haohui Mai
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1544362 13f79535-47bb-0310-9956-ffa450edef68
2013-11-21 23:08:40 +00:00
Brandon Li a379a7bbb9 HDFS-5288. Close idle connections in portmap. Contributed by Haohui Mai
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1544352 13f79535-47bb-0310-9956-ffa450edef68
2013-11-21 22:43:55 +00:00
Brandon Li a2200a6417 HDFS-5519. COMMIT handler should update the commit status after sync. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1542437 13f79535-47bb-0310-9956-ffa450edef68
2013-11-16 00:57:26 +00:00
Andrew Wang 646fcc8a56 HDFS-5495. Remove further JUnit3 usages from HDFS. Contributed by Jarek Jarcec Cecho.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1540914 13f79535-47bb-0310-9956-ffa450edef68
2013-11-12 01:56:56 +00:00
Brandon Li ec9ec0084e HDFS-5469. Add configuration property for the sub-directroy export path. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1540443 13f79535-47bb-0310-9956-ffa450edef68
2013-11-10 04:07:39 +00:00
Brandon Li 3fccdec6e0 HDFS-5364. Add OpenFileCtx cache. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1539834 13f79535-47bb-0310-9956-ffa450edef68
2013-11-07 21:49:13 +00:00
Brandon Li 16c6755554 HDFS-5252. Stable write is not handled correctly in someplace. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1539740 13f79535-47bb-0310-9956-ffa450edef68
2013-11-07 18:02:37 +00:00
Brandon Li 05f35518f1 HDFS-5171. NFS should create input stream for a file and try to share it with multiple read requests. Contributed by Haohui Mai
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1535586 13f79535-47bb-0310-9956-ffa450edef68
2013-10-24 23:40:34 +00:00
Brandon Li a9befa6f0a HDFS-5330. fix readdir and readdirplus for large directories. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1532539 13f79535-47bb-0310-9956-ffa450edef68
2013-10-15 21:23:00 +00:00
Brandon Li 7429debd86 HDFS-5337. should do hsync for a commit request even there is no pending writes. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530835 13f79535-47bb-0310-9956-ffa450edef68
2013-10-10 00:52:54 +00:00
Brandon Li 5c02d2f622 HDFS-5281. COMMIT request should not block. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530461 13f79535-47bb-0310-9956-ffa450edef68
2013-10-08 23:40:21 +00:00
Brandon Li caa4abd30c HDFS-5259. Support client which combines appended data with old data before sends it to NFS server. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1529730 13f79535-47bb-0310-9956-ffa450edef68
2013-10-07 02:57:24 +00:00
Brandon Li 25cdbdb71a HDFS-5230. Introduce RpcInfo to decouple XDR classes from the RPC API. Contributed by Haohui Mai
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1527726 13f79535-47bb-0310-9956-ffa450edef68
2013-09-30 19:21:17 +00:00
Brandon Li e4154fc83a HDFS-5256. Use guava LoadingCache to implement DFSClientCache. Contributed by Haohui Mai
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1527452 13f79535-47bb-0310-9956-ffa450edef68
2013-09-30 06:06:06 +00:00
Brandon Li 027419832c HDFS-5268. NFS write commit verifier is not set in a few places. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1527087 13f79535-47bb-0310-9956-ffa450edef68
2013-09-27 21:28:06 +00:00
Brandon Li 3582026204 HDFS-5246. Make Hadoop nfs server port and mount daemon port configurable. Contributed by Jinghui Wang
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1526316 13f79535-47bb-0310-9956-ffa450edef68
2013-09-25 21:59:35 +00:00
Brandon Li e3088e4aef HDFS-5249. Fix dumper thread which may die silently. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1525770 13f79535-47bb-0310-9956-ffa450edef68
2013-09-24 04:11:15 +00:00
Jing Zhao 28e3d09230 HDFS-4971. Move IO operations out of locking in OpenFileCtx. Contributed by Jing Zhao and Brandon Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1525681 13f79535-47bb-0310-9956-ffa450edef68
2013-09-23 20:02:38 +00:00
Brandon Li d8d3d3eaed HDFS-5234 Move RpcFrameDecoder out of the public API. Contributed by Haohui Mai
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1525104 13f79535-47bb-0310-9956-ffa450edef68
2013-09-20 19:03:51 +00:00
Jing Zhao 5e18410e06 HDFS-5212. Refactor RpcMessage and NFS3Response to support different types of authentication information. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1524298 13f79535-47bb-0310-9956-ffa450edef68
2013-09-18 06:08:23 +00:00
Alejandro Abdelnur 27e7feb777 HADOOP-9961. versions of a few transitive dependencies diverged between hadoop subprojects. (rvs via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1523596 13f79535-47bb-0310-9956-ffa450edef68
2013-09-16 11:30:47 +00:00
Brandon Li a56a4b6ef0 HDFS-5199 Add more debug trace for NFS READ and WRITE. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1523140 13f79535-47bb-0310-9956-ffa450edef68
2013-09-13 23:14:52 +00:00
Brandon Li ede10b8a1f HDFS-5067 Support symlink operations in NFS gateway. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1522774 13f79535-47bb-0310-9956-ffa450edef68
2013-09-13 04:21:46 +00:00
Jing Zhao 613979c8fd HDFS-5085. Refactor o.a.h.nfs to support different types of authentications. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1521601 13f79535-47bb-0310-9956-ffa450edef68
2013-09-10 19:29:45 +00:00
Brandon Li cbca166831 HDFS-5136 MNT EXPORT should give the full group list which can mount the exports. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1519222 13f79535-47bb-0310-9956-ffa450edef68
2013-08-31 21:12:22 +00:00
Brandon Li 30b8ef91a3 HDFS-5078 Support file append in NFSv3 gateway to enable data streaming to HDFS. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1518292 13f79535-47bb-0310-9956-ffa450edef68
2013-08-28 17:23:55 +00:00
Brandon Li 15632cd76f HDFS-4947 Add NFS server export table to control export by hostname or IP range. Contributed by Jing Zhao
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1517040 13f79535-47bb-0310-9956-ffa450edef68
2013-08-23 21:14:43 +00:00
Brandon Li 270eaceba8 HDFS-5069 Include hadoop-nfs and hadoop-hdfs-nfs into hadoop dist for NFS deployment. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1516232 13f79535-47bb-0310-9956-ffa450edef68
2013-08-21 17:54:08 +00:00
Sanford Ryza f6a1f4d1e0 HADOOP-9879. Move the version info of zookeeper dependencies to hadoop-project/pom (Karthik Kambatla via Sandy Ryza)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1515711 13f79535-47bb-0310-9956-ffa450edef68
2013-08-20 06:24:22 +00:00
Brandon Li c9b89de0ea HDFS-5110 Change FSDataOutputStream to HdfsDataOutputStream for opened streams to fix type cast error. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1515624 13f79535-47bb-0310-9956-ffa450edef68
2013-08-19 21:54:51 +00:00
Brandon Li 84454c7d74 HDFS-5071 Change hdfs-nfs parent project to hadoop-project. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1511502 13f79535-47bb-0310-9956-ffa450edef68
2013-08-07 21:22:12 +00:00
Jing Zhao 58d75576c4 HDFS-4962. Use enum for nfs constants. Contributed by Tsz Wo (Nicholas) SZE.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1501851 13f79535-47bb-0310-9956-ffa450edef68
2013-07-10 17:01:28 +00:00
Brandon Li 2c9e837f1b HDFS-4948. mvn site for hadoop-hdfs-nfs fails. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1499152 13f79535-47bb-0310-9956-ffa450edef68
2013-07-02 23:45:39 +00:00
Brandon Li 37f587563a HDFS-4762 Provide HDFS based NFSv3 and Mountd implementation. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1499029 13f79535-47bb-0310-9956-ffa450edef68
2013-07-02 17:31:58 +00:00