Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,023 Commits 326 Branches 371 Tags
Commit Graph

8023 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Colin Patrick Mccabe
9be338911b HDFS-6880. Adding tracing to DataNode data transfer protocol (iwasakims via cmccabe) 
(cherry picked from commit 56119fec96abbcc44c5dd82fdb694d2c3b53feb3)
 2014-09-16 13:59:58 -07:00
XuanGong
03fdbd7899 YARN-2557. Add a parameter "attempt_Failures_Validity_Interval" into 
DistributedShell. Contributed by Xuan Gong
 2014-09-16 11:01:26 -07:00
Vinod Kumar Vavilapalli
9d34dc87e1 YARN-2531. Added a configuration for admins to be able to override app-configs and enforce/not-enforce strict control of per-container cpu usage. Contributed by Varun Vasudev. 
(cherry picked from commit 9f6891d9ef7064d121305ca783eb62586c8aa018)
 2014-09-16 10:15:37 -07:00
Kihwal Lee
08abb320a7 HDFS-6965. NN continues to issue block locations for DNs with full 
disks. Contributed by Rushabh Shah.
(cherry picked from commit 0c26412be4b3ec40130b7200506c957f0402ecbc)
 2014-09-16 09:06:43 -05:00
Alejandro Abdelnur
1023196cea HADOOP-10868. Addendum 2014-09-15 19:39:12 -07:00
Alejandro Abdelnur
e59f6771e8 HADOOP-10868. AuthenticationFilter should support externalizing the secret for signing and provide rotation support. (rkanter via tucu) 2014-09-15 17:10:43 -07:00
Colin Patrick Mccabe
f80b10e1e7 HADOOP-11091. Eliminate old configuration parameter names from s3a (dsw via cmccabe) 
(cherry picked from commit 0ac760a58d96b36ab30e9d60679bbea6365ef120)
 2014-09-15 16:50:10 -07:00
Colin Patrick Mccabe
b4d9aca066 HDFS-6912. SharedFileDescriptorFactory should not allocate sparse files (cmccabe) 
(cherry picked from commit 8008f0e8191b1c7adbed96ed4c380208e3a37692)
 2014-09-15 14:51:59 -07:00
Kihwal Lee
e6e31fbbba HDFS-7059. HAadmin transtionToActive with forceActive option can show 
confusing message. Contributed by Rushabh Shah.
(cherry picked from commit 2f847b3357448184aaec935052f34d116ad3a42c)
 2014-09-15 16:30:22 -05:00
Jian He
1c3f837835 YARN-2529. Generic history service RPC interface doesn't work when service authorization is enabled. Contributed by Zhijie Shen 
(cherry picked from commit 88e329fdfb27c11f1964c0345188bcf328c95fd6)
 2014-09-15 13:15:07 -07:00
cnauroth
aaef460e7a YARN-2549. TestContainerLaunch fails due to classpath problem with hamcrest classes. Contributed by Chris Nauroth. 
(cherry picked from commit 9d4ec97c95b51c6f99112030da91950551b22b9c)
 2014-09-15 11:54:41 -07:00
Andrew Wang
d595557859 HDFS-7032. Add WebHDFS support for reading and writing to encryption zones. Contributed by Charles Lamb. 
(cherry picked from commit 43b03030084839db041d0337013806aaeef12aaa)
 2014-09-15 10:24:38 -07:00
Aaron T. Myers
a0c54aeb00 HADOOP-10400. Incorporate new S3A FileSystem implementation. Contributed by Jordan Mendelson and Dave Wang. 2014-09-15 08:30:42 -07:00
Andrew Wang
dd3e28d434 HDFS-7061. Add test to verify encryption zone creation after NameNode restart without saving namespace. Contributed by Stephen Chu. 
(cherry picked from commit fc741b5d78e7e006355e17b1b5839f502e37261b)
 2014-09-14 23:49:26 -07:00
Vinod Kumar Vavilapalli
5cdb24d4b1 YARN-611. Added an API to let apps specify an interval beyond which AM failures should be ignored towards counting max-attempts. Contributed by Xuan Gong. 
(cherry picked from commit 14e2639fd0d53f7e0b58f2f4744af44983d4e867)
 2014-09-13 18:05:02 -07:00
Zhijie Shen
99ccd842d8 YARN-2528. Relaxed http response split vulnerability protection for the origins header and made it accept multiple origins in CrossOriginFilter. Contributed by Jonathan Eagles. 
(cherry picked from commit 98588cf044d9908ecf767257c09a52cf17aa2ec2)
 2014-09-12 21:35:49 -07:00
Jian He
09ad86d70c YARN-2542. Fixed NPE when retrieving ApplicationReport from TimeLineServer. Contributed by Zhijie Shen 
(cherry picked from commit a0ad975ea1e70f9532cf6cb6c1d9d92736ca0ebc)
 2014-09-12 15:28:10 -07:00
XuanGong
add5ac6a73 YARN-2456. Possible livelock in CapacityScheduler when RM is recovering 
apps. Contributed by Jian He
 2014-09-12 15:24:02 -07:00
cnauroth
5afc3f1dad HADOOP-11088. Unittest TestKeyShell, TestCredShell and TestKMS assume UNIX path separator for JECKS key store path. Contributed by Xiaoyu Yao. 
(cherry picked from commit 957414d4cb57cb8172070cc53530b7da78b8c9ca)
 2014-09-12 14:50:37 -07:00
Jonathan Eagles
546a708acc YARN-2547. Cross Origin Filter throws UnsupportedOperationException upon destroy (Mit Desai via jeagles) 
(cherry picked from commit 54e5794806bd856da0277510efe63656eed23146)
 2014-09-12 15:41:31 -05:00
Jian He
f21a5236e5 YARN-2229. Changed the integer field of ContainerId to be long type. Contributed by Tsuyoshi OZAWA 
(cherry picked from commit 3122daa80261b466e309e88d88d1e2c030525e3f)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/preemption/CheckpointAMPreemptionPolicy.java
 2014-09-12 10:45:42 -07:00
Jason Lowe
7e69dc8771 YARN-2484. FileSystemRMStateStore#readFile/writeFile should close FSData(In|Out)putStream in final block. Contributed by Tsuyoshi OZAWA 
(cherry picked from commit 78b048393a80a9bd1399d08525590bb211a32d8c)
 2014-09-12 14:10:51 +00:00
Zhijie Shen
466bdf79c5 YARN-2538. Added logs when RM sends roll-overed AMRMToken to AM. Contributed by Xuan Gong. 
(cherry picked from commit 469ea3dcef6e427d02fd08b859b2789cc25189f9)
 2014-09-11 22:21:59 -07:00
Jian He
f580586ab7 YARN-2541. Fixed ResourceManagerRest.apt.vm table syntax error. Contributed by Jian He 
(cherry picked from commit 5633da2a018efcfac03cc1dd65af79bce2f1a11b)
 2014-09-11 21:31:56 -07:00
cnauroth
993ede4db3 HDFS-7051. TestDataNodeRollingUpgrade#isBlockFileInPrevious assumes Unix file path separator. Contributed by Chris Nauroth. 
(cherry picked from commit d6ce26986e79d770bc7588649373f2ae3bf15f94)
 2014-09-11 20:58:54 -07:00
junping_du
efa9ab3638 YARN-2033. Merging generic-history into the Timeline Store (Contributed by Zhijie Shen) 
(cherry picked from commit 6b8b1608e64e300e4e1d23c60476febaca29ca38)
 2014-09-12 10:08:06 +08:00
Karthik Kambatla
d22cd065ed Update CHANGES.txt to set the release date for 2.5.1 
(cherry picked from commit 17ffbe08642c622f099dd1cd9cb9e008ba98ea52)
 2014-09-11 17:36:06 -07:00
Colin Patrick Mccabe
5e4cb3d04c HADOOP-11074. Move s3-related FS connector code to hadoop-aws. (David S. Wang via Colin Patrick McCabe) 
(cherry picked from commit 5ec7fcd9dd6bb86858c6e2583321bb9a615bd392)
 2014-09-11 15:00:47 -07:00
Alejandro Abdelnur
2924de58ce HADOOP-11083. After refactoring of HTTP proxyuser to common, doAs param is case sensitive. (tucu) 2014-09-11 13:54:59 -07:00
Jason Lowe
b4ab7aa110 HADOOP-11085. Excessive logging by org.apache.hadoop.util.Progress when value is NaN. Contributed by Mit Desai 
(cherry picked from commit 581176cdc868b8701a761b5a0d52f771cbba709a)
 2014-09-11 19:54:05 +00:00
cnauroth
ac296f9522 HDFS-7042. Upgrade fails for Windows HA cluster due to file locks held during rename in JournalNode. Contributed by Chris Nauroth. 
(cherry picked from commit 80ac6aabcea9f808fd55504cdaef2da7b50da7f1)
 2014-09-11 12:17:19 -07:00
Karthik Kambatla
6f8b2a8e2e YARN-2534. FairScheduler: Potential integer overflow calculating totalMaxShare. (Zhihai Xu via kasha) 
(cherry picked from commit c11ada5ea6d17321626e5a9a4152ff857d03aee2)
 2014-09-11 12:06:28 -07:00
Steve Loughran
fb804ed46c HADOOP-10373 create tools/hadoop-amazon for aws/EMR support (stevel) 
(cherry picked from commit 59384dfb710f42d2a419c1b7db5a1a62a39be5f3)
 2014-09-11 11:43:52 -07:00
Steve Loughran
731de8ec45 HADOOP-9540. Expose the InMemoryS3 and S3N FilesystemStores implementations for Unit testing. Hari 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1479985 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit fa56ccfd530565e33323cac7b5ebecef73703d12)
 2014-09-11 11:27:12 -07:00
Andrew Wang
6151c2bea7 HDFS-7045. Fix NameNode deadlock when opening file under /.reserved path. Contributed by Yi Liu. 
(cherry picked from commit 1e684995d7ac20d1c27ca1c1bef37dd2ee00e630)
 2014-09-11 10:59:24 -07:00
Andrew Wang
c90e15c559 HDFS-6621. Hadoop Balancer prematurely exits iterations. Contributed by Rafal Wodjdyla and Benjamin Bowman. 
(cherry picked from commit d1dab6cc63abf5d44533ad9b39e32c582327627b)
 2014-09-11 10:32:57 -07:00
Andrew Wang
0fae8a0e14 HDFS-6966. Add additional unit tests for encryption zones. Contributed by Stephen Chu. 
(cherry picked from commit bf64fce78c5474f4d6ead839c4de18c8401a54d6)
 2014-09-11 10:26:21 -07:00
Jason Lowe
6f8abe7efe MAPREDUCE-6070. yarn.app.am.resource.mb/cpu-vcores affects uber mode but is not documented. Contributed by Tsuyoshi OZAWA 
(cherry picked from commit 9e28e089c6bcb0b264751bdfa1f994ce002ef2de)
 2014-09-11 16:20:51 +00:00
Vinod Kumar Vavilapalli
a2a61eec6d YARN-2440. Enabled Nodemanagers to limit the aggregate cpu usage across all containers to a preconfigured limit. Contributed by Varun Vasudev. 
(cherry picked from commit 4be95175cdb58ff12a27ab443d609d3b46da7bfa)
 2014-09-10 19:24:14 -07:00
Jian He
ceae7be6b2 YARN-415. Capture aggregate memory allocation at the app-level for chargeback. Contributed by Eric Payne & Andrey Klochkov 
(cherry picked from commit 83be3ad44484bf8a24cb90de4b9c26ab59d226a8)
 2014-09-10 18:22:07 -07:00
XuanGong
5ca99b5297 Fix CHANGES.txt. Credit Mayank Bansal for his contributions on YARN-2459 2014-09-10 15:21:41 -07:00
Jason Lowe
e6f108c99b MAPREDUCE-6075. HistoryServerFileSystemStateStore can create zero-length files. Contributed by Jason Lowe 
(cherry picked from commit 17a025d9dda9949f191b650e3ef96090880f568a)
 2014-09-10 22:12:24 +00:00
Alejandro Abdelnur
88e5549d90 HADOOP-10758. KMS: add ACLs on per key basis. (tucu) 2014-09-10 14:27:22 -07:00
Jian He
f58a076dbc YARN-2158. Fixed TestRMWebServicesAppsModification#testSingleAppKill test failure. Contributed by Varun Vasudev 
(cherry picked from commit cbfe26370b85161c79fdd48bf69c95d5725d8f6a)
 2014-09-10 12:48:40 -07:00
XUAN
b91ef0c502 YARN-2459. RM crashes if App gets rejected for any reason and HA is enabled. Contributed by Jian He 2014-09-10 11:51:57 -07:00
Vinod Kumar Vavilapalli
b4b59ef749 YARN-2448. Changed ApplicationMasterProtocol to expose RM-recognized resource types to the AMs. Contributed by Varun Vasudev. 
(cherry picked from commit b67d5ba7842cc10695d987f217027848a5a8c3d8)
 2014-09-10 10:17:30 -07:00
Karthik Kambatla
a19694f19d YARN-1458. FairScheduler: Zero weight can lead to livelock. (Zhihai Xu via kasha) 
(cherry picked from commit 3072c83b38fd87318d502a7d1bc518963b5ccdf7)
 2014-09-10 08:33:31 -07:00
Alejandro Abdelnur
e42b889bdb HADOOP-9989. Bug introduced in HADOOP-9374, which parses the -tokenCacheFile as binary file but set it to the configuration as JSON file. (zxu via tucu) 2014-09-09 22:20:49 -07:00
Alejandro Abdelnur
d0e2116502 HADOOP-11077. NPE if hosts not specified in ProxyUsers. (gchanan via tucu) 2014-09-09 22:20:43 -07:00
Alejandro Abdelnur
16a4558fda HDFS-6776. Using distcp to copy data between insecure and secure cluster via webdhfs doesn't work. (yzhangal via tucu) 2014-09-09 22:20:36 -07:00