7189 Commits

Author SHA1 Message Date
Alejandro Abdelnur
d3efebf4aa HADOOP-11016. KMS should support signing cookies with zookeeper secret manager. (tucu)
(cherry picked from commit 123f20d42f6acffcde05392d689acd91a82462db)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2014-09-17 15:30:56 -07:00
Jian He
3746b1e905 YARN-2558. Updated ContainerTokenIdentifier#read/write to use ContainerId#getContainerId. Contributed by Tsuyoshi OZAWA.
(cherry picked from commit f4886111aa573ec928de69e8ca9328d480bf673e)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
2014-09-17 15:22:02 -07:00
Colin Patrick Mccabe
0ad613c369 HDFS-7075. hadoop-fuse-dfs fails because it cannot find JavaKeyStoreProvider$Factory. (cmccabe)
(cherry picked from commit f23024852502441fc259012664e444e5e51c604a)
2014-09-17 14:28:05 -07:00
Colin Patrick Mccabe
6cb8ed0d22 HDFS-6843. Create FileStatus isEncrypted() method (clamb via cmccabe)
(cherry picked from commit e3803d002c660f18a5c2ecf32344fd6f3f491a5b)
2014-09-17 13:36:41 -07:00
Andrew Wang
5e54aae62b HDFS-6705. Create an XAttr that disallows the HDFS admin from accessing a file. (clamb via wang)
(cherry picked from commit ea4e2e843ecadd8019ea35413f4a34b97a424923)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
2014-09-17 11:26:17 -07:00
Alejandro Abdelnur
6857c291af HADOOP-11099. KMS return HTTP UNAUTHORIZED 401 on ACL failure. (tucu)
(cherry picked from commit e4ddb6da15420d5c13ec7ec99fed1e44b32290b0)
2014-09-17 11:08:25 -07:00
Alejandro Abdelnur
1c847fdd61 HADOOP-11062. CryptoCodec testcases requiring OpenSSL should be run only if -Pnative is used. (asuresh via tucu)
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/pom.xml
2014-09-16 23:37:21 -07:00
Alejandro Abdelnur
75bd79231c HADOOP-11097. kms docs say proxyusers, not proxyuser for config params. (clamb via tucu) 2014-09-16 23:21:17 -07:00
Alejandro Abdelnur
94a1e68aa5 HADOOP-11096. KMS: KeyAuthorizationKeyProvider should verify the keyversion belongs to the keyname on decrypt. (tucu) 2014-09-16 23:21:17 -07:00
junping_du
c6b9768b36 YARN-1250. Addendum
(cherry picked from commit 0e7d1dbf9ab732dd04dccaacbf273e9ac437eba5)
2014-09-16 18:30:31 -07:00
junping_du
1e1f4c2fdf YARN-1250. Generic history service should support application-acls. (Contributed by Zhijie Shen)
(cherry picked from commit 90a0c03f0a696d32e871a5da4560828edea8cfa9)
2014-09-16 18:30:06 -07:00
Andrew Wang
aeac86bc8a HADOOP-10922. User documentation for CredentialShell. Contributed by Larry McCay.
(cherry picked from commit b6d3230e41c78750b6dfd679f24852f22947b5a5)
2014-09-16 17:15:37 -07:00
Andrew Wang
fcd181bde1 HDFS-6789. TestDFSClientFailover.testFileContextDoesntDnsResolveLogicalURI and TestDFSClientFailover.testDoesntDnsResolveLogicalURI failing on jdk7. Contributed by Akira Ajisaka.
(cherry picked from commit a044407b5c3a2914a055812cb570218f69edae9b)
2014-09-16 17:03:52 -07:00
Andrew Wang
23f34b75e4 HDFS-6851. Refactor EncryptionZoneWithId and EncryptionZone. (clamb via wang)
(cherry picked from commit 33ce887c20ec806ace02063e42599c3db76b536a)
2014-09-16 16:57:06 -07:00
Benoy Antony
215216abeb HDFS-6799. The invalidate method in SimulatedFSDataset failed to remove (invalidate) blocks from the file system. Contributed by Megasthenis Asteris. 2014-09-16 16:27:25 -07:00
Alejandro Abdelnur
5d897026e4 HDFS-7006. Test encryption zones with KMS. (Anthony Young-Garner and tucu) 2014-09-16 14:37:04 -07:00
Colin Patrick Mccabe
9be338911b HDFS-6880. Adding tracing to DataNode data transfer protocol (iwasakims via cmccabe)
(cherry picked from commit 56119fec96abbcc44c5dd82fdb694d2c3b53feb3)
2014-09-16 13:59:58 -07:00
XuanGong
03fdbd7899 YARN-2557. Add a parameter "attempt_Failures_Validity_Interval" into
DistributedShell. Contributed by Xuan Gong
2014-09-16 11:01:26 -07:00
Vinod Kumar Vavilapalli
9d34dc87e1 YARN-2531. Added a configuration for admins to be able to override app-configs and enforce/not-enforce strict control of per-container cpu usage. Contributed by Varun Vasudev.
(cherry picked from commit 9f6891d9ef7064d121305ca783eb62586c8aa018)
2014-09-16 10:15:37 -07:00
Kihwal Lee
08abb320a7 HDFS-6965. NN continues to issue block locations for DNs with full
disks. Contributed by Rushabh Shah.
(cherry picked from commit 0c26412be4b3ec40130b7200506c957f0402ecbc)
2014-09-16 09:06:43 -05:00
Alejandro Abdelnur
1023196cea HADOOP-10868. Addendum 2014-09-15 19:39:12 -07:00
Alejandro Abdelnur
e59f6771e8 HADOOP-10868. AuthenticationFilter should support externalizing the secret for signing and provide rotation support. (rkanter via tucu) 2014-09-15 17:10:43 -07:00
Colin Patrick Mccabe
f80b10e1e7 HADOOP-11091. Eliminate old configuration parameter names from s3a (dsw via cmccabe)
(cherry picked from commit 0ac760a58d96b36ab30e9d60679bbea6365ef120)
2014-09-15 16:50:10 -07:00
Colin Patrick Mccabe
b4d9aca066 HDFS-6912. SharedFileDescriptorFactory should not allocate sparse files (cmccabe)
(cherry picked from commit 8008f0e8191b1c7adbed96ed4c380208e3a37692)
2014-09-15 14:51:59 -07:00
Kihwal Lee
e6e31fbbba HDFS-7059. HAadmin transtionToActive with forceActive option can show
confusing message. Contributed by Rushabh Shah.
(cherry picked from commit 2f847b3357448184aaec935052f34d116ad3a42c)
2014-09-15 16:30:22 -05:00
Jian He
1c3f837835 YARN-2529. Generic history service RPC interface doesn't work when service authorization is enabled. Contributed by Zhijie Shen
(cherry picked from commit 88e329fdfb27c11f1964c0345188bcf328c95fd6)
2014-09-15 13:15:07 -07:00
cnauroth
aaef460e7a YARN-2549. TestContainerLaunch fails due to classpath problem with hamcrest classes. Contributed by Chris Nauroth.
(cherry picked from commit 9d4ec97c95b51c6f99112030da91950551b22b9c)
2014-09-15 11:54:41 -07:00
Andrew Wang
d595557859 HDFS-7032. Add WebHDFS support for reading and writing to encryption zones. Contributed by Charles Lamb.
(cherry picked from commit 43b03030084839db041d0337013806aaeef12aaa)
2014-09-15 10:24:38 -07:00
Aaron T. Myers
a0c54aeb00 HADOOP-10400. Incorporate new S3A FileSystem implementation. Contributed by Jordan Mendelson and Dave Wang. 2014-09-15 08:30:42 -07:00
Andrew Wang
dd3e28d434 HDFS-7061. Add test to verify encryption zone creation after NameNode restart without saving namespace. Contributed by Stephen Chu.
(cherry picked from commit fc741b5d78e7e006355e17b1b5839f502e37261b)
2014-09-14 23:49:26 -07:00
Vinod Kumar Vavilapalli
5cdb24d4b1 YARN-611. Added an API to let apps specify an interval beyond which AM failures should be ignored towards counting max-attempts. Contributed by Xuan Gong.
(cherry picked from commit 14e2639fd0d53f7e0b58f2f4744af44983d4e867)
2014-09-13 18:05:02 -07:00
Zhijie Shen
99ccd842d8 YARN-2528. Relaxed http response split vulnerability protection for the origins header and made it accept multiple origins in CrossOriginFilter. Contributed by Jonathan Eagles.
(cherry picked from commit 98588cf044d9908ecf767257c09a52cf17aa2ec2)
2014-09-12 21:35:49 -07:00
Jian He
09ad86d70c YARN-2542. Fixed NPE when retrieving ApplicationReport from TimeLineServer. Contributed by Zhijie Shen
(cherry picked from commit a0ad975ea1e70f9532cf6cb6c1d9d92736ca0ebc)
2014-09-12 15:28:10 -07:00
XuanGong
add5ac6a73 YARN-2456. Possible livelock in CapacityScheduler when RM is recovering
apps. Contributed by Jian He
2014-09-12 15:24:02 -07:00
cnauroth
5afc3f1dad HADOOP-11088. Unittest TestKeyShell, TestCredShell and TestKMS assume UNIX path separator for JECKS key store path. Contributed by Xiaoyu Yao.
(cherry picked from commit 957414d4cb57cb8172070cc53530b7da78b8c9ca)
2014-09-12 14:50:37 -07:00
Jonathan Eagles
546a708acc YARN-2547. Cross Origin Filter throws UnsupportedOperationException upon destroy (Mit Desai via jeagles)
(cherry picked from commit 54e5794806bd856da0277510efe63656eed23146)
2014-09-12 15:41:31 -05:00
Jian He
f21a5236e5 YARN-2229. Changed the integer field of ContainerId to be long type. Contributed by Tsuyoshi OZAWA
(cherry picked from commit 3122daa80261b466e309e88d88d1e2c030525e3f)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/preemption/CheckpointAMPreemptionPolicy.java
2014-09-12 10:45:42 -07:00
Jason Lowe
7e69dc8771 YARN-2484. FileSystemRMStateStore#readFile/writeFile should close FSData(In|Out)putStream in final block. Contributed by Tsuyoshi OZAWA
(cherry picked from commit 78b048393a80a9bd1399d08525590bb211a32d8c)
2014-09-12 14:10:51 +00:00
Zhijie Shen
466bdf79c5 YARN-2538. Added logs when RM sends roll-overed AMRMToken to AM. Contributed by Xuan Gong.
(cherry picked from commit 469ea3dcef6e427d02fd08b859b2789cc25189f9)
2014-09-11 22:21:59 -07:00
Jian He
f580586ab7 YARN-2541. Fixed ResourceManagerRest.apt.vm table syntax error. Contributed by Jian He
(cherry picked from commit 5633da2a018efcfac03cc1dd65af79bce2f1a11b)
2014-09-11 21:31:56 -07:00
cnauroth
993ede4db3 HDFS-7051. TestDataNodeRollingUpgrade#isBlockFileInPrevious assumes Unix file path separator. Contributed by Chris Nauroth.
(cherry picked from commit d6ce26986e79d770bc7588649373f2ae3bf15f94)
2014-09-11 20:58:54 -07:00
junping_du
efa9ab3638 YARN-2033. Merging generic-history into the Timeline Store (Contributed by Zhijie Shen)
(cherry picked from commit 6b8b1608e64e300e4e1d23c60476febaca29ca38)
2014-09-12 10:08:06 +08:00
Karthik Kambatla
d22cd065ed Update CHANGES.txt to set the release date for 2.5.1
(cherry picked from commit 17ffbe08642c622f099dd1cd9cb9e008ba98ea52)
2014-09-11 17:36:06 -07:00
Colin Patrick Mccabe
5e4cb3d04c HADOOP-11074. Move s3-related FS connector code to hadoop-aws. (David S. Wang via Colin Patrick McCabe)
(cherry picked from commit 5ec7fcd9dd6bb86858c6e2583321bb9a615bd392)
2014-09-11 15:00:47 -07:00
Alejandro Abdelnur
2924de58ce HADOOP-11083. After refactoring of HTTP proxyuser to common, doAs param is case sensitive. (tucu) 2014-09-11 13:54:59 -07:00
Jason Lowe
b4ab7aa110 HADOOP-11085. Excessive logging by org.apache.hadoop.util.Progress when value is NaN. Contributed by Mit Desai
(cherry picked from commit 581176cdc868b8701a761b5a0d52f771cbba709a)
2014-09-11 19:54:05 +00:00
cnauroth
ac296f9522 HDFS-7042. Upgrade fails for Windows HA cluster due to file locks held during rename in JournalNode. Contributed by Chris Nauroth.
(cherry picked from commit 80ac6aabcea9f808fd55504cdaef2da7b50da7f1)
2014-09-11 12:17:19 -07:00
Karthik Kambatla
6f8b2a8e2e YARN-2534. FairScheduler: Potential integer overflow calculating totalMaxShare. (Zhihai Xu via kasha)
(cherry picked from commit c11ada5ea6d17321626e5a9a4152ff857d03aee2)
2014-09-11 12:06:28 -07:00
Steve Loughran
fb804ed46c HADOOP-10373 create tools/hadoop-amazon for aws/EMR support (stevel)
(cherry picked from commit 59384dfb710f42d2a419c1b7db5a1a62a39be5f3)
2014-09-11 11:43:52 -07:00
Steve Loughran
731de8ec45 HADOOP-9540. Expose the InMemoryS3 and S3N FilesystemStores implementations for Unit testing. Hari
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1479985 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit fa56ccfd530565e33323cac7b5ebecef73703d12)
2014-09-11 11:27:12 -07:00