Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
7,410 Commits 326 Branches 371 Tags
Commit Graph

7410 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Andrew Wang
ef693b541c HDFS-6970. Move startFile EDEK retries to the DFSClient. (wang) 
(cherry picked from commit 20a076bafce548298729bab4fb81d12f829e8f7e)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
 2014-09-18 17:41:22 -07:00
Colin Patrick Mccabe
d329237990 HDFS-6727. Refresh data volumes on DataNode based on configuration changes (Lei Xu via Colin Patrick McCabe) 
(cherry picked from commit fe38d2e9b5ac7e13f97cd2d3d2a984ab6bbaaf77)
 2014-09-18 16:53:07 -07:00
Alejandro Abdelnur
22f4ef4fa9 KMS: Support for multiple Kerberos principals. (tucu) 
(cherry picked from commit fad4cd85b313a1d2378adcf03cad67e946a12cd5)
 2014-09-18 16:04:18 -07:00
Karthik Kambatla
372bf54072 MAPREDUCE-6086. mapreduce.job.credentials.binary should allow all URIs. (Zhihai Xu via kasha) 
(cherry picked from commit 52945a33cc3fcb3b961cce0e7e3ca01291f2a223)
 2014-09-18 15:47:21 -07:00
cnauroth
039f56e739 HADOOP-11105. Update CHANGES.txt. 
(cherry picked from commit 1b4b46004acca1fcb2c291933c1cd3f75e9918b3)
 2014-09-18 15:41:57 -07:00
cnauroth
bf26b9be39 HADOOP-11105. MetricsSystemImpl could leak memory in registered callbacks. Contributed by Chuan Liu. 
(cherry picked from commit 1942364ef14396e9bd94a87c0d901ff9abe1d42a)
 2014-09-18 15:38:38 -07:00
Jason Lowe
44c7113133 MAPREDUCE-5891. Improved shuffle error handling across NM restarts. Contributed by Junping Du 
(cherry picked from commit 2c3da25fd718b3a9c1ed67f05b577975ae613f4e)
 2014-09-18 22:01:42 +00:00
Andrew Wang
47c9dcfe8e HDFS-7003. Add NFS Gateway support for reading and writing to encryption zones. (clamb via wang) 
(cherry picked from commit 70be56d093022de9953e14a92dfa1a146bd9a290)
 2014-09-18 14:57:33 -07:00
Andrew Wang
5bc71071d1 HADOOP-11106. Document considerations of HAR and Encryption. (clamb via wang) 
(cherry picked from commit fe2f54d4cbd4b02bc3b8f642d0689b17dbfe169b)
 2014-09-18 14:51:27 -07:00
Jian He
4cabeef931 YARN-2563. Fixed YarnClient to call getTimeLineDelegationToken only if the Token is not present. Contributed by Zhijie Shen 
(cherry picked from commit eb92cc67dfaa51212fc5315b8db99effd046a154)
 2014-09-18 14:41:14 -07:00
Jason Lowe
d9273a9547 YARN-2561. MR job client cannot reconnect to AM after NM restart. Contributed by Junping Du 
(cherry picked from commit a337f0e3549351344bce70cb23ddc0a256c894b0)
 2014-09-18 21:36:20 +00:00
Jason Lowe
4b4e44a8aa MAPREDUCE-6090. mapred hsadmin getGroups fails to connect in some cases. Contributed by Robert Kanter 
(cherry picked from commit 1cf31980474bf9ac28e51b6f014eae09eda9e15f)
 2014-09-18 21:02:13 +00:00
Jason Lowe
44c22c3d8d YARN-2363. Submitted applications occasionally lack a tracking URL. Contributed by Jason Lowe 
(cherry picked from commit 9ea7b6c063c0bdd4551962e21d0173f671e9df03)
 2014-09-18 20:15:46 +00:00
Colin Patrick Mccabe
2b1c9c6210 HDFS-7047. Expose FileStatus#isEncrypted in libhdfs (cmccabe) 
(cherry picked from commit 570b8b468e1a75ad29c674699f0f4fe34d919ed9)
 2014-09-18 11:42:53 -07:00
Vinod Kumar Vavilapalli
d24ef142b7 YARN-2001. Added a time threshold for RM to wait before starting container allocations after restart/failover. Contributed by Jian He. 
(cherry picked from commit 485c96e3cb9b0b05d6e490b4773506da83ebc61d)
 2014-09-18 11:04:27 -07:00
Vinod Kumar Vavilapalli
514bfeafd9 YARN-1779. Fixed AMRMClient to handle AMRMTokens correctly across ResourceManager work-preserving-restart or failover. Contributed by Jian He. 
(cherry picked from commit a3d9934f916471a845dc679449d08f94dead550d)
 2014-09-18 10:17:24 -07:00
Jian He
d61cdd66db YARN-2559. Fixed NPE in SystemMetricsPublisher when retrieving FinalApplicationStatus. Contributed by Zhijie Shen 
(cherry picked from commit ee21b13cbd4654d7181306404174329f12193613)
 2014-09-17 21:44:49 -07:00
Andrew Wang
008e2f68f1 HDFS-7078. Fix listEZs to work correctly with snapshots. (wang) 
(cherry picked from commit 0ecefe60179968984b1892a14411566b7a0c8df3)
 2014-09-17 21:28:15 -07:00
Andrew Wang
b477d30e63 HDFS-7004. Update KeyProvider instantiation to create by URI. (wang) 
(cherry picked from commit 10e8602f32b553a1424f1a9b5f9f74f7b68a49d1)
 2014-09-17 20:15:42 -07:00
Andrew Wang
b05da10d0d Move some HDFS JIRAs to the correct CHANGES.txt 2014-09-17 18:08:24 -07:00
Andrew Wang
a3aab30d6f HADOOP-11040. Return value of read(ByteBuffer buf) in CryptoInputStream is incorrect in some cases. (Yi Liu via wang) 
(cherry picked from commit 47e5e19831a363aa4d675fd23ab0d06e86809094)
 2014-09-17 18:03:06 -07:00
Alejandro Abdelnur
d3efebf4aa HADOOP-11016. KMS should support signing cookies with zookeeper secret manager. (tucu) 
(cherry picked from commit 123f20d42f6acffcde05392d689acd91a82462db)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2014-09-17 15:30:56 -07:00
Jian He
3746b1e905 YARN-2558. Updated ContainerTokenIdentifier#read/write to use ContainerId#getContainerId. Contributed by Tsuyoshi OZAWA. 
(cherry picked from commit f4886111aa573ec928de69e8ca9328d480bf673e)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2014-09-17 15:22:02 -07:00
Colin Patrick Mccabe
0ad613c369 HDFS-7075. hadoop-fuse-dfs fails because it cannot find JavaKeyStoreProvider$Factory. (cmccabe) 
(cherry picked from commit f23024852502441fc259012664e444e5e51c604a)
 2014-09-17 14:28:05 -07:00
Colin Patrick Mccabe
6cb8ed0d22 HDFS-6843. Create FileStatus isEncrypted() method (clamb via cmccabe) 
(cherry picked from commit e3803d002c660f18a5c2ecf32344fd6f3f491a5b)
 2014-09-17 13:36:41 -07:00
Andrew Wang
5e54aae62b HDFS-6705. Create an XAttr that disallows the HDFS admin from accessing a file. (clamb via wang) 
(cherry picked from commit ea4e2e843ecadd8019ea35413f4a34b97a424923)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
 2014-09-17 11:26:17 -07:00
Alejandro Abdelnur
6857c291af HADOOP-11099. KMS return HTTP UNAUTHORIZED 401 on ACL failure. (tucu) 
(cherry picked from commit e4ddb6da15420d5c13ec7ec99fed1e44b32290b0)
 2014-09-17 11:08:25 -07:00
Alejandro Abdelnur
1c847fdd61 HADOOP-11062. CryptoCodec testcases requiring OpenSSL should be run only if -Pnative is used. (asuresh via tucu) 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/pom.xml
 2014-09-16 23:37:21 -07:00
Alejandro Abdelnur
75bd79231c HADOOP-11097. kms docs say proxyusers, not proxyuser for config params. (clamb via tucu) 2014-09-16 23:21:17 -07:00
Alejandro Abdelnur
94a1e68aa5 HADOOP-11096. KMS: KeyAuthorizationKeyProvider should verify the keyversion belongs to the keyname on decrypt. (tucu) 2014-09-16 23:21:17 -07:00
junping_du
c6b9768b36 YARN-1250. Addendum 
(cherry picked from commit 0e7d1dbf9ab732dd04dccaacbf273e9ac437eba5)
 2014-09-16 18:30:31 -07:00
junping_du
1e1f4c2fdf YARN-1250. Generic history service should support application-acls. (Contributed by Zhijie Shen) 
(cherry picked from commit 90a0c03f0a696d32e871a5da4560828edea8cfa9)
 2014-09-16 18:30:06 -07:00
Andrew Wang
aeac86bc8a HADOOP-10922. User documentation for CredentialShell. Contributed by Larry McCay. 
(cherry picked from commit b6d3230e41c78750b6dfd679f24852f22947b5a5)
 2014-09-16 17:15:37 -07:00
Andrew Wang
fcd181bde1 HDFS-6789. TestDFSClientFailover.testFileContextDoesntDnsResolveLogicalURI and TestDFSClientFailover.testDoesntDnsResolveLogicalURI failing on jdk7. Contributed by Akira Ajisaka. 
(cherry picked from commit a044407b5c3a2914a055812cb570218f69edae9b)
 2014-09-16 17:03:52 -07:00
Andrew Wang
23f34b75e4 HDFS-6851. Refactor EncryptionZoneWithId and EncryptionZone. (clamb via wang) 
(cherry picked from commit 33ce887c20ec806ace02063e42599c3db76b536a)
 2014-09-16 16:57:06 -07:00
Benoy Antony
215216abeb HDFS-6799. The invalidate method in SimulatedFSDataset failed to remove (invalidate) blocks from the file system. Contributed by Megasthenis Asteris. 2014-09-16 16:27:25 -07:00
Alejandro Abdelnur
5d897026e4 HDFS-7006. Test encryption zones with KMS. (Anthony Young-Garner and tucu) 2014-09-16 14:37:04 -07:00
Colin Patrick Mccabe
9be338911b HDFS-6880. Adding tracing to DataNode data transfer protocol (iwasakims via cmccabe) 
(cherry picked from commit 56119fec96abbcc44c5dd82fdb694d2c3b53feb3)
 2014-09-16 13:59:58 -07:00
XuanGong
03fdbd7899 YARN-2557. Add a parameter "attempt_Failures_Validity_Interval" into 
DistributedShell. Contributed by Xuan Gong
 2014-09-16 11:01:26 -07:00
Vinod Kumar Vavilapalli
9d34dc87e1 YARN-2531. Added a configuration for admins to be able to override app-configs and enforce/not-enforce strict control of per-container cpu usage. Contributed by Varun Vasudev. 
(cherry picked from commit 9f6891d9ef7064d121305ca783eb62586c8aa018)
 2014-09-16 10:15:37 -07:00
Kihwal Lee
08abb320a7 HDFS-6965. NN continues to issue block locations for DNs with full 
disks. Contributed by Rushabh Shah.
(cherry picked from commit 0c26412be4b3ec40130b7200506c957f0402ecbc)
 2014-09-16 09:06:43 -05:00
Alejandro Abdelnur
1023196cea HADOOP-10868. Addendum 2014-09-15 19:39:12 -07:00
Alejandro Abdelnur
e59f6771e8 HADOOP-10868. AuthenticationFilter should support externalizing the secret for signing and provide rotation support. (rkanter via tucu) 2014-09-15 17:10:43 -07:00
Colin Patrick Mccabe
f80b10e1e7 HADOOP-11091. Eliminate old configuration parameter names from s3a (dsw via cmccabe) 
(cherry picked from commit 0ac760a58d96b36ab30e9d60679bbea6365ef120)
 2014-09-15 16:50:10 -07:00
Colin Patrick Mccabe
b4d9aca066 HDFS-6912. SharedFileDescriptorFactory should not allocate sparse files (cmccabe) 
(cherry picked from commit 8008f0e8191b1c7adbed96ed4c380208e3a37692)
 2014-09-15 14:51:59 -07:00
Kihwal Lee
e6e31fbbba HDFS-7059. HAadmin transtionToActive with forceActive option can show 
confusing message. Contributed by Rushabh Shah.
(cherry picked from commit 2f847b3357448184aaec935052f34d116ad3a42c)
 2014-09-15 16:30:22 -05:00
Jian He
1c3f837835 YARN-2529. Generic history service RPC interface doesn't work when service authorization is enabled. Contributed by Zhijie Shen 
(cherry picked from commit 88e329fdfb27c11f1964c0345188bcf328c95fd6)
 2014-09-15 13:15:07 -07:00
cnauroth
aaef460e7a YARN-2549. TestContainerLaunch fails due to classpath problem with hamcrest classes. Contributed by Chris Nauroth. 
(cherry picked from commit 9d4ec97c95b51c6f99112030da91950551b22b9c)
 2014-09-15 11:54:41 -07:00
Andrew Wang
d595557859 HDFS-7032. Add WebHDFS support for reading and writing to encryption zones. Contributed by Charles Lamb. 
(cherry picked from commit 43b03030084839db041d0337013806aaeef12aaa)
 2014-09-15 10:24:38 -07:00
Aaron T. Myers
a0c54aeb00 HADOOP-10400. Incorporate new S3A FileSystem implementation. Contributed by Jordan Mendelson and Dave Wang. 2014-09-15 08:30:42 -07:00