Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,444 Commits 326 Branches 371 Tags
Commit Graph

12444 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Daniel Templeton
b8bebb8607 YARN-5774. MR Job stuck in ACCEPTED status without any progress in Fair Scheduler 
if set yarn.scheduler.minimum-allocation-mb to 0. (Contributed by Yufei Gu via Daniel Templeton)

(cherry picked from commit 25f9872be63423ada6a18481eaad2888e731fdac)
 2016-11-29 10:12:10 -08:00
Akira Ajisaka
0c895e8a62 HADOOP-13812. Upgrade Tomcat to 6.0.48. Contributed by John Zhuge. 
(cherry picked from commit 00096dcc0c23af38e697cd7c6c29e3f00d744e54)
 2016-11-29 19:50:53 +09:00
Robert Kanter
285edf691d HADOOP-13838. KMSTokenRenewer should close providers (xiaochen via rkanter) 
(cherry picked from commit 47ca9e26fba4a639e43bee5bfc001ffc4b42330d)
 2016-11-28 18:12:53 -08:00
Mingliang Liu
1b831d8e01 HADOOP-13823. s3a rename: fail if dest file exists. Contributed by Steve Loughran 
(cherry picked from commit d60a60be8aa450c44d3be69d26c88025e253ac0c)
 2016-11-28 16:35:18 -08:00
Brahma Reddy Battula
1c0fa25dc1 HADOOP-13820. Replace ugi.getUsername() with ugi.getShortUserName() in viewFS. Contributed By Brahma Reddy Battula. 
(cherry picked from commit ee3d437a33c2106ea416078e722ff6184106a0bc)
 2016-11-25 20:00:46 +05:30
Steve Loughran
9701ab48e8 HADOOP-12804. Read Proxy Password from Credential Providers in S3 FileSystem. Contributed by Larry McCay. 2016-11-25 13:34:11 +00:00
Akira Ajisaka
6fe5ffd05d HDFS-11174. Wrong HttpFS test command in doc. Contributed by John Zhuge. 
(cherry picked from commit bb1b5e083b6f32646412b292d061ce5721f5dbe1)
 2016-11-25 21:29:28 +09:00
Akira Ajisaka
0df7f5cdf6 HDFS-11175. Document uppercase key names are not supported in TransparentEncryption.md. Contributed by Yiqun Lin. 
(cherry picked from commit 636f7547b7067c315cf5448d77e49a8fe55651b3)
 2016-11-25 17:50:14 +09:00
Steve Loughran
2c2e77b3bb HADOOP-10776 Open up already widely-used APIs for delegation-token fetching & renewal to ecosystem projects. Contributed by Vinod Kumar Vavilapalli 2016-11-24 17:52:05 +00:00
Steve Loughran
36cc8dcdca HADOOP-13833 TestSymlinkHdfsFileSystem#testCreateLinkUsingPartQualPath2 fails after HADOOP-13605. Contributed by Brahma Reddy Battula. 2016-11-24 17:44:14 +00:00
Brahma Reddy Battula
1edabc4a46 HADOOP-11603. Metric Snapshot log can be changed #MetricsSystemImpl.java since all the services will be initialized. Contributed By Brahma Reddy Battula. 
(cherry picked from commit 13501053dd95f41ac14091f5bbd79bcb2a3896a3)
 2016-11-24 22:24:45 +05:30
Steve Loughran
89614f5355 HADOOP-13018. Make Kdiag check whether hadoop.token.files points to existent and valid files. Contributed by Ravi Prakash 2016-11-24 16:41:35 +00:00
Sunil
c28dc5e5a4 YARN-4206. Add Application timeouts in Application report and CLI. Contributed by Rohith Sharma K S. 
(cherry picked from commit eb0a483ed07399c7a06ed9db4bfbec382de470da)
 2016-11-24 18:27:50 +05:30
Sunil
7b676c5632 YARN-5649. Add REST endpoints for updating application timeouts. Contributed by Rohith Sharma K S 2016-11-24 17:37:36 +05:30
Rohith Sharma K S
6b47a7fb8e YARN-5920. Fix deadlock in TestRMHA.testTransitionedToStandbyShouldNotHang. Contributed by Varun Saxena. 
(cherry picked from commit e15c20edba1e9a23475ee6a4dfbadbdb8c1f668a)
 2016-11-24 12:19:19 +05:30
Rohith Sharma K S
87bb3c51d6 Reverting for fixing compilation errors in branch-2. 
Revert "YARN-5649. Add REST endpoints for updating application timeouts. Contributed by Rohith Sharma K S"

This reverts commit 43796580421346f254d066c0c58ae13937cdbd45.
 2016-11-24 09:18:07 +05:30
Mingliang Liu
57b17ae800 HADOOP-13605. Clean up FileSystem javadocs, logging; improve diagnostics on FS load. Contributed by Steve Loughran 2016-11-23 17:15:55 -08:00
Jian He
4379658042 YARN-5649. Add REST endpoints for updating application timeouts. Contributed by Rohith Sharma K S 2016-11-23 16:27:12 -08:00
Jian He
accd9136e4 HADOOP-11552. Allow handoff on the server side for RPC requests. Contributed by Siddharth Seth 
(cherry picked from commit 3d94da1e00fc6238fad458e415219f87920f1fc3)
 2016-11-23 16:17:36 -08:00
Steve Loughran
f3fff5c2e1 HADOOP-13801 regression: ITestS3AMiniYarnCluster failing. Contributed by Steve Loughran 2016-11-23 21:37:04 +00:00
Rohith Sharma K S
2d068f1793 YARN-5865. Retrospect updateApplicationPriority api to handle state store exception in align with YARN-5611. Contributed by Sunil G. 2016-11-23 23:29:39 +05:30
Naganarasimha
2d94f938c5 YARN-4330. MiniYARNCluster is showing multiple Failed to instantiate default resource calculator warning messages. Contributed by Varun Saxena 
(cherry picked from commit 3541ed80685f25486f33ef0f553854ccbdeb51d4)
 2016-11-23 14:14:56 +05:30
Naganarasimha
b96ed43897 YARN-5911. DrainDispatcher does not drain all events on stop even if setDrainEventsOnStop is true. Contributed by Varun Saxena. 
(cherry picked from commit 466756416214a4bbc77af8a29da1a33e01106864)
 2016-11-23 09:36:43 +05:30
Mingliang Liu
c11e0ef621 HADOOP-13166. Add getFileStatus("/") test to AbstractContractGetFileStatusTest. Contributed by Steve Loughran 
(cherry picked from commit 2bf9a15e8a1ac92923b45130c3369720d4a76fe1)
 2016-11-22 14:31:25 -08:00
Mingliang Liu
cae4a8c05d HADOOP-13050. Upgrade to AWS SDK 10.11+. Contributed by Chris Nauroth and Steve Loughran 2016-11-22 14:05:58 -08:00
Mingliang Liu
9af7d1e298 HADOOP-13655. document object store use with fs shell and distcp. Contributed by Steve Loughran 2016-11-22 13:19:32 -08:00
Daniel Templeton
06f5d27bd6 YARN-5722. FairScheduler hides group resolution exceptions when assigning queue (Contributed by Wilfred Spiegelenburg via Daniel Templeton) 
(cherry picked from commit 83cc7263af632939dc3b2ee58d8f03f98ed4d96a)
 2016-11-22 11:17:39 -08:00
Brahma Reddy Battula
2207a84a7d HADOOP-13646. Remove outdated overview.html. Contributed By Brahma Reddy Battula. 
(cherry picked from commit afcf8d38e750f935c06629e641a1321b79c4cace)
 2016-11-22 20:32:30 +05:30
Rohith Sharma K S
4b289d567e MAPREDUCE-6793. io.sort.factor code default and mapred-default.xml values inconsistent. Contributed by Gera Shegalov. 
(cherry picked from commit 683e0c71fe09600a24bdd7b707a613fe70ff1f6e)
 2016-11-21 22:11:59 +05:30
Kihwal Lee
774b0cd845 HDFS-10966. Enhance Dispatcher logic on deciding when to give up a source DataNode. Contributed by Mark Wagner and Zhe Zhang. 2016-11-21 10:39:04 -06:00
Jason Lowe
38024eb8f7 YARN-5859. TestResourceLocalizationService#testParallelDownloadAttemptsForPublicResource sometimes fails. Contributed by Eric Badger 
(cherry picked from commit 009452bb6dbe5dffb0b304d67a2f360fe0eee1e2)
 2016-11-21 16:37:59 +00:00
Steve Loughran
589596f6c7 HADOOP-12705 Upgrade Jackson 2.2.3 to 2.7.8 2016-11-21 16:16:14 +00:00
Brahma Reddy Battula
aa76fe4132 HDFS-11101. TestDFSShell#testMoveWithTargetPortEmpty fails intermittently. Contributed By Brahma Reddy Battula. 
(cherry picked from commit f92206774899b84e8abaecdf97399b65e0995ed8)
 2016-11-21 19:36:10 +05:30
Brahma Reddy Battula
f3649deca5 HDFS-11144. TestFileCreationDelete#testFileCreationDeleteParent fails wind bind exception. Contributed By Brahma Reddy Battula. 
(cherry picked from commit c68dad18ab5cdf01f3dea1bb5988f896609956b4)
 2016-11-21 10:59:23 +05:30
Akira Ajisaka
d29e3d0f52 HADOOP-13814. Sample configuration of KMS HTTP Authentication signature is misleading. Contributed by Masahiro Tanaka. 
(cherry picked from commit c65d6b65415742288b53f8e38314b71794e47ecc)
 2016-11-21 11:28:33 +09:00
Varun Saxena
ca3b40306b MAPREDUCE-6801. Fix flaky TestKill.testKillJob (Haibo Chen via Varun Saxena) 
(cherry picked from commit 7584fbf4cbafd34fac4b362cefe4e06cec16a2af)
 2016-11-19 01:39:47 +05:30
Wei-Chiu Chuang
c5a3ec493b YARN-5271. ATS client doesn't work with Jersey 2 on the classpath. Contributed by Weiwei Yang. 
(cherry picked from commit 09520cb439f8b002e3f2f3d8f5080ffc34f4bd5c)
 2016-11-17 22:23:58 -06:00
Subru Krishnan
e5a5a5a618 YARN-5904. Reduce the number of default server threads for AMRMProxyService. 
(cherry picked from commit 140b9939da71ec51c178162501740a429b344cac)
 2016-11-17 18:27:17 -08:00
Junping Du
a8ad6b6171 YARN-3538. TimelineWebService doesn't catch runtime exception. Contributed by Steve Loughran and Tsuyoshi Ozawa. 
(cherry picked from commit f05a9ceb4a9623517aa1c8d995805e26ae1bde5a)
 2016-11-17 16:56:21 -08:00
Mingliang Liu
92767f956f HADOOP-11601. Enhance FS spec & tests to mandate FileStatus.getBlocksize() >0 for non-empty files. Contributed by Steve Loughran 
(cherry picked from commit ae8849fe378e11b9db642ef7784c8e6a08199b96)

This closes #50
 2016-11-17 14:26:44 -08:00
Kihwal Lee
d3fa53a52b HADOOP-13742. Expose NumOpenConnectionsPerUser as a metric. Brahma Reddy Battula. 
(cherry picked from commit bd3735554fa5c3bc064c57ec78f4308430b14b48)
 2016-11-17 12:19:23 -06:00
Brahma Reddy Battula
3e5a85f35e HDFS-11134. Fix bind exception threw in TestRenameWhileOpen. Contributed By Yiqun Lin. 
(cherry picked from commit b2d4b7b1b902aa830d44889d7747a4e1b816ab9d)
 2016-11-17 10:24:21 +05:30
Mingliang Liu
47526a25cc HADOOP-13822. Use GlobalStorageStatistics.INSTANCE.reset() at FileSystem#clearStatistics(). Contribute by Brahma Reddy Battula 
(cherry picked from commit aab9737a058c0bdeeb17c173e530b7e571315a56)
 2016-11-16 20:09:07 -08:00
Rohith Sharma K S
bbe993238d YARN-5870. Expose getApplications API in YarnClient with GetApplicationsRequest parameter. Contributed by Jian He. 
(cherry picked from commit ce2847e79441881eeca888b581c7be2cc3ac74f4)
 2016-11-17 08:54:33 +05:30
Jason Lowe
46b7d6233c YARN-5836. Malicious AM can kill containers of other apps running in any node its containers are running. Contributed by Botong Huang 
(cherry picked from commit 59bfcbf3579e45ddf96db3aafccf669c8e03648f)
 2016-11-16 22:25:15 +00:00
Varun Saxena
6cb1fda99d YARN-5891. yarn rmadmin -help contains a misspelled ResourceManager (Grant Sohn via Varun Saxena) 
(cherry picked from commit 6a11877ab5b4e81769dc097e91198abd994d103f)
 2016-11-17 03:28:08 +05:30
Arpit Agarwal
da8c24bbad HDFS-11114. Support for running async disk checks in DataNode. 2016-11-16 13:38:15 -08:00
Mingliang Liu
57a0f84860 HDFS-11105. TestRBWBlockInvalidation#testRWRInvalidation fails intermittently. Contributed by Yiqun Lin 
(cherry picked from commit c90891e7b3afaa66dbca967b83a9997e80e893d8)
 2016-11-16 13:06:25 -08:00
Varun Saxena
bcfa6d5384 MAPREDUCE-6811. TestPipeApplication#testSubmitter fails after HADOOP-13802 (Brahma Reddy Battula via Varun Saxena) 
(cherry picked from commit b8690a9d25cb212d53a92bfa1f76a33b8c74413c)
 2016-11-17 00:55:12 +05:30
Varun Saxena
2893316dd0 YARN-5843. Incorrect documentation for timeline service entityType/events REST end points (Bibin A Chundatt via Varun Saxena) 
(cherry picked from commit c8bc7a84758f360849b96c2e19c8c41b7e9dbb65)
 2016-11-17 00:52:08 +05:30