Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,342 Commits 326 Branches 371 Tags
Commit Graph

11342 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Jason Lowe
0a94c6d9da YARN-5317. testAMRestartNotLostContainerCompleteMsg may fail. Contributed by sandflee 
(cherry picked from commit 10b704c5946afe7bfd4a6be40192ce7ca745d817)
 2016-07-12 20:39:09 +00:00
Jason Lowe
9d08ca1ed7 YARN-4393. Fix intermittent test failure for TestResourceLocalizationService#testFailedDirsResourceRelease (Varun Saxana via rohithsharmaks) 
(cherry picked from commit 791c1639ae0b351e0bf0b2ecec854dc72ab07935)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2016-07-12 19:25:07 +00:00
Junping Du
a0ddc5b3a5 New addendum to YARN-5080. Cannot obtain logs using YARN CLI -am for either KILLED or RUNNING AM. 
(cherry picked from commit 7705812c7e3a9f3f774130e25443fda249c08c9c)
(cherry picked from commit 54812841e2f26275c2d993c73af45a9bbae3e3bf)
 2016-07-12 08:37:47 -07:00
Jian He
23eb3c7ceb YARN-5270. Solve miscellaneous issues caused by YARN-4844. Contributed by Wangda Tan 2016-07-11 22:38:35 -07:00
Andrew Wang
4e7e48cdc1 HDFS-10300. TestDistCpSystem should share MiniDFSCluster. Contributed by John Zhuge. 
(cherry picked from commit f292624bd8dbdc1841f225a34346d0392fa76a47)
(cherry picked from commit 38b1eafdbcbd91bd806b842729b84d84f3600524)
 2016-07-11 18:06:45 -07:00
Akira Ajisaka
1b7691b4c1 HADOOP-13297. Add missing dependency in setting maven-remote-resource-plugin to fix builds. Contributed by Sean Busbey. 
(cherry picked from commit 7bd5d4272cd686e06c5d5fcc489b69312dacb47b)
(cherry picked from commit 02b037f6257e7379b6bbd656ccbe4472d3f46c40)
 2016-07-11 17:23:22 -07:00
Steve Loughran
310c08454f HADOOP-13139 Branch-2: S3a to use thread pool that blocks clients. Contributed by Pieter Reuse. 2016-07-11 17:21:14 +01:00
Varun Saxena
f685973e21 YARN-5037. Fix random failure of TestRMRestart#testQueueMetricsOnRMRestart (sandflee via Varun Saxena). 2016-07-11 09:39:06 +05:30
Akira Ajisaka
a8cfcce542 Revert "HADOOP-10465. Fix use of generics within SortedMapWritable. Contributed by Bertrand Dechoux." 
This reverts commit 1d175f0f3f80a066a6de71213392d288329d837f.
 2016-07-09 21:01:07 -07:00
Junping Du
25ea7cc373 Fix OOM issue in DistributedShell. Contributed by Jian He. 
(cherry picked from commit 9bdb5bebea1183ec2f697ee3e55392df4fe697bb)
(cherry picked from commit 7db796562c0a512bb626c207b6ed0169e3bbe92f)
 2016-07-09 05:12:21 -07:00
Yongjun Zhang
96e68e722f HDFS-10512. VolumeScanner may terminate due to NPE in DataNode.reportBadBlocks. Contributed by Wei-Chiu Chuang and Yiqun Lin. 
(cherry picked from commit da6f1b88dd47e22b24d44f6fc8bbee73e85746f7)
 2016-07-08 22:20:27 -07:00
Varun Saxena
845daee463 YARN-5318. Fix intermittent test failure of TestRMAdminService#testRefreshNodesResourceWithFileSystemBasedConfigurationProvider. (Jun Gong via Varun Saxena). 2016-07-09 01:54:22 +05:30
Junping Du
8645e4ac3b YARN-4939. The decommissioning Node should keep alive during NM restart. Contributed by sandflee. 
(cherry picked from commit 30ee57ceb1e80c30ea3adfe7736d4d4c7d5c8386)
(cherry picked from commit 5c0386d535c9e9b68f5b72cc8a44c634b64a5825)
 2016-07-08 06:06:56 -07:00
Vinod Kumar Vavilapalli
e4a62a233d YARN-5314. Fixed a ConcurrentModificationException in ATS v1.5 EntityGroupFSTimelineStore. Contributed by Li Lu. 
(cherry picked from commit 673e5e02feba9171498a518c06ae70639c5f8854)
 2016-07-07 22:42:19 -07:00
Akira Ajisaka
5522a46f4c HADOOP-13320. Fix arguments check in documentation for WordCount v2.0. Contributed by niccolo becchi. 
(cherry picked from commit 9d46a49c746b9e1ef552dbb10d1e22f87db68c76)
(cherry picked from commit b3b81b4f0e1cd0b37ab2dfdf3e7301e0ef3e0676)
 2016-07-07 15:32:20 -07:00
Jitendra Pandey
9c7ce389c7 HADOOP-13283. Support reset operation for new global storage statistics and per FS storage stats. Contributed by Mingliang Liu. 2016-07-07 15:04:47 -07:00
Uma Maheswara Rao G
097022e172 HDFS-10592:Fix intermittent test failure of TestNameNodeResourceChecker#testCheckThatNameNodeResourceMonitorIsRunning. Contributed by Rakesh R 
(cherry picked from commit ab092c56c251f27a9426e3c69a784417fdf9a26e)
 2016-07-07 14:02:25 -07:00
Andrew Wang
80a342e961 HADOOP-13350. Additional fix to LICENSE and NOTICE. Contributed by Xiao Chen. 
(cherry picked from commit 0e0f45f0ec3d8279610e8af25f60f4abb668d55a)
(cherry picked from commit 8f500942d64cb9541c5bc5eb064e8af2de22e235)
 2016-07-07 10:44:31 -07:00
Andrew Wang
f826d92909 HDFS-10488. Update WebHDFS documentation regarding CREATE and MKDIR default permissions. Contributed by Wellington Chevreuil. 
(cherry picked from commit 647b084738b26dcf0c0c4afa4ec3039e6aca2d61)
 2016-07-07 10:37:16 -07:00
Akira Ajisaka
4fba09d7e8 HDFS-10582. Change deprecated configuration fs.checkpoint.dir to dfs.namenode.checkpoint.dir in HDFS Commands Doc. Contributed by Pan Yuxuan. 
(cherry picked from commit a3f93beaa19d9acb7b1db2958102d0004b0eee46)
(cherry picked from commit 8a9440298db2c3943cbe399c68e247adeefa28b0)
 2016-07-06 17:54:44 -07:00
Varun Saxena
22ca536b0c YARN-5286. Add RPC port info in RM web service's response when getting app status. (Jun Gong via Varun Saxena). 2016-07-06 09:31:48 +05:30
Vinod Kumar Vavilapalli
4ea87cb38c YARN-5214. Fixed locking in DirectoryCollection to avoid hanging NMs when various code-paths hit slow disks. Contributed by Junping Du. 
(cherry picked from commit ce9c006430d13a28bc1ca57c5c70cc1b7cba1692)
 2016-07-05 17:12:37 -07:00
Akira Ajisaka
4b263b30c2 HDFS-10589. Javadoc for HAState#HAState and HAState#setStateInternal contains non-existent params. Contributed by shenyinjie. 
(cherry picked from commit 8b4b5259d5088360476b4582c4cf7b0e7973eff3)
(cherry picked from commit 0401adcaca5f2e9680bc2dc3602af8696d204f21)
 2016-07-04 07:15:54 -07:00
Jitendra Pandey
bc7fd76a1f HADOOP-13305. Define common statistics names across schemes. Contributed by Mingliang Liu. 2016-07-01 15:37:32 -07:00
Jian He
4437e6f336 YARN-5023. TestAMRestart#testShouldNotCountFailureToMaxAttemptRetry fails. Contributed by sandflee 
(cherry picked from commit c35a5a7a8d85b42498e6981a6b1f09f2bdd56459)
 2016-07-01 14:29:47 -07:00
Vinayakumar B
2c6e7f221e HADOOP-13314. Remove 'package-info.java' from 'test\java\org\apache\hadoop\fs\shell\' to remove eclipse compile error (Contributed by Vinayakumar B) 
(cherry picked from commit c25021fb7196f498ccf1319dbd0c7f948f8518c1)
(cherry picked from commit 1458e66593511acfe4c2cd36853339bccc6fd93d)
 2016-07-01 12:23:23 +05:30
Andrew Wang
ae2ab601c0 HADOOP-12345. Pad hostname correctly in CredentialsSys.java. Contributed by Pradeep Nayak Udupi Kadbet. 
(cherry picked from commit 846ada2de33f9840d6e60fd7339ecc2d71f277c7)
(cherry picked from commit af581c0e2306970f4965f64cbbc2255c8bfc2191)
 2016-06-29 17:32:52 -07:00
Masatake Iwasaki
b5dbd3b5ed HADOOP-12242. Add in-page TOC to filesystem specification pages. (iwasakims) 
(cherry picked from commit 5c07c573db06481c89f1c9ad062e2d2aa19feaa0)
 2016-06-30 07:30:37 +09:00
Steve Loughran
52dbafecc5 HADOOP-12229 Fix inconsistent subsection titles in filesystem.md. Contributed by Masatake Iwasaki 2016-06-29 14:31:13 +01:00
Steve Loughran
f4f0c5074d HADOOP-13239 Deprecate s3:// in branch-2 2016-06-29 13:16:10 +01:00
Yongjun Zhang
4a57c03f30 HDFS-10396. Using -diff option with DistCp may get "Comparison method violates its general contract" exception. Contributed by Yongjun Zhang. 
(cherry picked from commit 8113855b3af913e6dcd09626953c64d43168efbd)
 2016-06-28 23:34:44 -07:00
Vinayakumar B
f44d7782f6 HDFS-10440. Improve DataNode web UI (Contributed by Weiwei Yang) 
(cherry picked from commit 2a0082c51da7cbe2770eddb5f72cd7f8d72fa5f6)
(cherry picked from commit 1e347631817d882353bfb91d68f109cb8232e8c4)
 2016-06-28 16:55:57 +05:30
Andrew Wang
47c13c4f7d HADOOP-13316. Enforce Kerberos authentication for required ops in DelegationTokenAuthenticator. Contributed by Xiao Chen. 
(cherry picked from commit 7d2070493e07198896bc49135bc84ef00499a375)
(cherry picked from commit 22eb53eb715deb95cb3fcc16cdf327e1406b9c64)
 2016-06-27 18:46:59 -07:00
Andrew Wang
59a70977c3 HADOOP-13251. Authenticate with Kerberos credentials when renewing KMS delegation token. Contributed by Xiao Chen. 
(cherry picked from commit 771f798edf97b27ae003395118c0317b484df6ee)

 Conflicts:
	hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMS.java

(cherry picked from commit d8a69c873725b681b06b116cdd10bdb3c2082963)
 2016-06-27 18:29:58 -07:00
Akira Ajisaka
a0f6109907 MAPREDUCE-6542. HistoryViewer uses SimpleDateFormat, but SimpleDateFormat is not threadsafe. Contributed by zhangyubiao. 2016-06-27 15:19:21 -07:00
Arpit Agarwal
f7bd302550 HADOOP-13263. Reload cached groups in background after expiry. (Contributed bt Stephen O'Donnell) 2016-06-27 09:51:16 -07:00
Tsz-Wo Nicholas Sze
ce788c207f HADOOP-13227. AsyncCallHandler should use an event driven architecture to handle async calls. 2016-06-25 15:51:45 +08:00
Jing Zhao
e251654ee4 HADOOP-13249. RetryInvocationHandler need wrap InterruptedException in IOException when call Thread.sleep. Contributed by Zhihai Xu. 
(cherry picked from commit 0bbb4ddd793063c87927035969884a34f60f2076)
 2016-06-25 15:51:35 +08:00
Akira Ajisaka
5af2af15ef HADOOP-13067. cleanup the dockerfile. Contributed by Allen Wittenauer. 
(cherry picked from commit b59b8b7351c8212a7ea05777fbe0eb7afb53bf62)
 2016-06-25 10:42:54 +09:00
Colin Patrick Mccabe
2d681a9246 Fix accidental revert of HADOOP-13072: WindowsGetSpaceUsed constructor should be public (Vinayakumar B via cmccabe) 
(cherry picked from commit 975786492c42b8aebc6dc247bdcdb4768d99d641)
(cherry picked from commit e751bb4497879d66ec771e6f9e08937a3164516b)
 2016-06-24 09:47:41 -07:00
Akira Ajisaka
ae5dc10ecd MAPREDUCE-6725. Javadoc for CLI#listEvents() contains no-existent param. Contributed by shenyinjie. 
(cherry picked from commit 0f23cd497b0baa0899c7565cd94e2f27dbc7c0ff)
(cherry picked from commit 2830ee5f0fdbdf8123d0dd0858baf2c059a3f96f)
 2016-06-25 00:27:35 +09:00
Andrew Wang
f28c270c96 Revert "HADOOP-13228. Add delegation token to the connection in DelegationTokenAuthenticator. Contributed by Xiao Chen." 
This reverts commit 4ad9ca85fbde69369264f089c0195f90232dc3bd.
 2016-06-23 11:09:06 -07:00
Akira Ajisaka
5c07aee0b0 HADOOP-13307. add rsync to Dockerfile so that precommit archive works. Contributed by Allen Wittenauer. 
(cherry picked from commit 85209cc59152bcd7070b0a654af7d64105d36a6b)
(cherry picked from commit fb13ab07270067062998381b238ba9def87aa304)
 2016-06-23 15:24:22 +09:00
Allen Wittenauer
d4474d7d09 HADOOP-13245. Fix up some misc create-release issues (aw) 
(cherry picked from commit e2f640942b722e35490cf146c0268517da5a28b1)
(cherry picked from commit 2a956baaabe4a86a63fc181c3a07b2f4c4ee2a75)
 2016-06-23 15:16:33 +09:00
Jing Zhao
d17265f467 HDFS-10556. DistCpOptions should be validated automatically. Contributed by Mingliang Liu. 
(cherry picked from commit 856bc4e28b356f31d3c48eed2c352fb9010232d7)
 2016-06-22 15:22:54 -07:00
Masatake Iwasaki
9c46f99cc6 HADOOP-12588. addendum patch to fix intermittent failure of TestGangliaMetrics. (iwasakims) 
(cherry picked from commit 67089875f0ea2a47cca0c237fccf239bf6fe2d53)
 2016-06-22 23:49:04 +09:00
Steve Loughran
1eb45180a6 HADOOP-13203 S3A: Support fadvise "random" mode for high performance readPositioned() reads. Contributed by Rajesh Balamohan and stevel. 2016-06-22 15:41:52 +01:00
Akira Ajisaka
700dacf8c4 HDFS-7597. DelegationTokenIdentifier should cache the TokenIdentifier to UGI mapping. Contributed by Daryn Sharp, Bob Hansen, and Xiao Chen. 
(cherry picked from commit d433b16ce6d74f1a44bc29446c74b1cb5f8a10fa)
(cherry picked from commit ad50a64ded1ba0c32d7bc89e5100f3b4d86a790c)
 2016-06-22 11:02:48 +09:00
Chris Nauroth
e30b7112ed HADOOP-13287. TestS3ACredentials#testInstantiateFromURL fails if AWS secret key contains +. Contributed by Chris Nauroth. 
(cherry picked from commit b2c596cdda7c129951074bc53b4b9ecfedbf080a)
(cherry picked from commit e6ebe9ab4e38651b39c926d98b1d3d01e6a9ed71)
 2016-06-21 11:34:46 -07:00
Akira Ajisaka
6fefb8f4a4 HADOOP-13296. Cleanup javadoc for Path. Contributed by Daniel Templeton. 
(cherry picked from commit e15cd43369eb6d478844f25897e4a86065c62168)
(cherry picked from commit 65b4f2682e4b1803a4fd7348bd518b8723724686)
 2016-06-21 20:17:42 +09:00