Commit Graph

15639 Commits

Author SHA1 Message Date
Naganarasimha e2f77ca77b Revert "YARN-5921. Incorrect synchronization in RMContextImpl#setHAServiceState/getHAServiceState. Contributed by Varun Saxena."
This reverts commit 9f2960be19.
2016-11-27 23:32:59 +05:30
Naganarasimha 9f2960be19 YARN-5921. Incorrect synchronization in RMContextImpl#setHAServiceState/getHAServiceState. Contributed by Varun Saxena. 2016-11-27 23:31:27 +05:30
Harsh J 07825f2b49 HADOOP-1381. The distance between sync blocks in SequenceFiles should be configurable rather than hard coded to 2000 bytes. Contributed by Harsh J. 2016-11-25 22:22:23 +05:30
Brahma Reddy Battula ee3d437a33 HADOOP-13820. Replace ugi.getUsername() with ugi.getShortUserName() in viewFS. Contributed By Brahma Reddy Battula. 2016-11-25 19:54:50 +05:30
Akira Ajisaka bb1b5e083b HDFS-11174. Wrong HttpFS test command in doc. Contributed by John Zhuge. 2016-11-25 21:28:29 +09:00
Akira Ajisaka 636f7547b7 HDFS-11175. Document uppercase key names are not supported in TransparentEncryption.md. Contributed by Yiqun Lin. 2016-11-25 17:48:54 +09:00
Steve Loughran 01665e456d HADOOP-10776 Open up already widely-used APIs for delegation-token fetching & renewal to ecosystem projects. Contributed by Vinod Kumar Vavilapalli
Cherry picked from 24715cefe8
2016-11-24 17:54:10 +00:00
Steve Loughran 3df3fa396c HADOOP-13833 TestSymlinkHdfsFileSystem#testCreateLinkUsingPartQualPath2 fails after HADOOP-13605. Contributed by Brahma Reddy Battula. 2016-11-24 17:44:36 +00:00
Brahma Reddy Battula 13501053dd HADOOP-11603. Metric Snapshot log can be changed #MetricsSystemImpl.java since all the services will be initialized. Contributed By Brahma Reddy Battula. 2016-11-24 22:23:22 +05:30
Steve Loughran abb9fa7fc6 HADOOP-13018. Make Kdiag check whether hadoop.token.files points to existent and valid files. Contributed by Ravi Prakash 2016-11-24 16:41:59 +00:00
Sunil eb0a483ed0 YARN-4206. Add Application timeouts in Application report and CLI. Contributed by Rohith Sharma K S. 2016-11-24 18:18:42 +05:30
Rohith Sharma K S e15c20edba YARN-5920. Fix deadlock in TestRMHA.testTransitionedToStandbyShouldNotHang. Contributed by Varun Saxena. 2016-11-24 12:18:38 +05:30
Daniel Templeton 10468529a9 YARN-4752. Improved preemption in FairScheduler. (kasha)
Contains:
YARN-5605. Preempt containers (all on one node) to meet the requirement of starved applications
YARN-5821. Drop left-over preemption-related code and clean up method visibilities in the Schedulable hierarchy
YARN-5783. Verify identification of starved applications.
YARN-5819. Verify fairshare and minshare preemption
YARN-5885. Cleanup YARN-4752 branch for merge

Change-Id: Iee0962377d019dd64dc69a020725d2eaf360858c
2016-11-23 19:48:59 -10:00
Andrew Wang c7a5f2906f HADOOP-13766. Fix a typo in the comments of RPC.getProtocolVersion. Contributed by Ethan Li. 2016-11-23 17:08:38 -08:00
Mingliang Liu 860d49aa6a HADOOP-13605. Clean up FileSystem javadocs, logging; improve diagnostics on FS load. Contributed by Steve Loughran 2016-11-23 16:42:27 -08:00
Andrew Wang de4894936a HDFS-11368. Erasure Coding: Deprecate replication-related config keys. Contributed by Rakesh R. 2016-11-23 16:42:06 -08:00
Andrew Wang dd98a8005a HDFS-11058. Implement 'hadoop fs -df' command for ViewFileSystem. Contributed by Manoj Govindassamy. 2016-11-23 16:40:39 -08:00
Jian He 1f12867a69 YARN-5649. Add REST endpoints for updating application timeouts. Contributed by Rohith Sharma K S 2016-11-23 16:25:39 -08:00
Jian He 3d94da1e00 HADOOP-11552. Allow handoff on the server side for RPC requests. Contributed by Siddharth Seth 2016-11-23 16:01:55 -08:00
Steve Loughran 0de0c32ddd HADOOP-13801 regression: ITestS3AMiniYarnCluster failing. Contributed by Steve Loughran 2016-11-23 21:37:39 +00:00
Arun Suresh 005850b28f YARN-5918. Handle Opportunistic scheduling allocate request failure when NM is lost. (Bibin A Chundatt via asuresh) 2016-11-23 09:53:31 -08:00
Naganarasimha 3541ed8068 YARN-4330. MiniYARNCluster is showing multiple Failed to instantiate default resource calculator warning messages. Contributed by Varun Saxena 2016-11-23 14:12:23 +05:30
Naganarasimha 4667564162 YARN-5911. DrainDispatcher does not drain all events on stop even if setDrainEventsOnStop is true. Contributed by Varun Saxena. 2016-11-23 08:49:48 +05:30
Anu Engineer ffe937a1f2 HDFS-11154. Block Storage: store server state to persistent storage. Contributed by Chen Liang 2016-11-22 17:41:13 -08:00
Mingliang Liu 2bf9a15e8a HADOOP-13166. Add getFileStatus("/") test to AbstractContractGetFileStatusTest. Contributed by Steve Loughran 2016-11-22 14:27:23 -08:00
Mingliang Liu af791b774b HADOOP-13050. Upgrade to AWS SDK 10.11+. Contributed by Chris Nauroth and Steve Loughran 2016-11-22 14:00:35 -08:00
Lei Xu 3a09e5970d HDFS-11145. Implement getTrashRoot() for ViewFileSystem. (Manoj Govindassamy via lei) 2016-11-22 13:52:09 -08:00
Mingliang Liu beb70fed4f HADOOP-13655. document object store use with fs shell and distcp. Contributed by Steve Loughran
This closes #131
2016-11-22 13:12:23 -08:00
Daniel Templeton 83cc7263af YARN-5722. FairScheduler hides group resolution exceptions when assigning queue (Contributed by Wilfred Spiegelenburg via Daniel Templeton) 2016-11-22 11:16:00 -08:00
Arpit Agarwal 613b902b98 HDFS-11148. Update DataNode to use StorageLocationChecker at startup. 2016-11-22 10:50:25 -08:00
Brahma Reddy Battula afcf8d38e7 HADOOP-13646. Remove outdated overview.html. Contributed By Brahma Reddy Battula. 2016-11-22 19:45:45 +05:30
Rohith Sharma K S a926f895c1 YARN-5865. Retrospect updateApplicationPriority api to handle state store exception in align with YARN-5611. Contributed by Sunil G. 2016-11-22 14:49:15 +05:30
Akira Ajisaka 6f8074298d YARN-5713. Update jackson from 1.9.13 to 2.x in hadoop-yarn. 2016-11-22 10:20:31 +09:00
Rohith Sharma K S 683e0c71fe MAPREDUCE-6793. io.sort.factor code default and mapred-default.xml values inconsistent. Contributed by Gera Shegalov. 2016-11-21 22:10:57 +05:30
Jason Lowe 009452bb6d YARN-5859. TestResourceLocalizationService#testParallelDownloadAttemptsForPublicResource sometimes fails. Contributed by Eric Badger 2016-11-21 16:36:08 +00:00
Steve Loughran 3eb7b68687 HADOOP-12705 Upgrade Jackson 2.2.3 to 2.7.8 2016-11-21 16:18:17 +00:00
Kihwal Lee 49a09179e3 HDFS-10966. Enhance Dispatcher logic on deciding when to give up a source DataNode. Contributed by Mark Wagner and Zhe Zhang. 2016-11-21 10:13:24 -06:00
Brahma Reddy Battula f922067748 HDFS-11101. TestDFSShell#testMoveWithTargetPortEmpty fails intermittently. Contributed By Brahma Reddy Battula. 2016-11-21 19:34:52 +05:30
Brahma Reddy Battula c68dad18ab HDFS-11144. TestFileCreationDelete#testFileCreationDeleteParent fails wind bind exception. Contributed By Brahma Reddy Battula. 2016-11-21 10:58:34 +05:30
Akira Ajisaka d232625f73 HDFS-11113. Document dfs.client.read.striped configuration in hdfs-default.xml. Contributed by Rakesh R. 2016-11-21 14:05:15 +09:00
Akira Ajisaka c65d6b6541 HADOOP-13814. Sample configuration of KMS HTTP Authentication signature is misleading. Contributed by Masahiro Tanaka. 2016-11-21 11:25:11 +09:00
Anu Engineer 334113adab HDFS-11138. Block Storage: add block storage server. Contributed by Chen Liang 2016-11-18 15:49:01 -08:00
Anu Engineer cb6b6b47b6 HDFS-11133. Ozone: Add allocateContainer RPC. Contributed by Anu Engineer 2016-11-18 12:24:41 -08:00
Varun Saxena 7584fbf4cb MAPREDUCE-6801. Fix flaky TestKill.testKillJob (Haibo Chen via Varun Saxena) 2016-11-19 01:37:59 +05:30
Anu Engineer 5ceca1b33a HDFS-11126. Ozone: Add small file support RPC. Contributed by Anu Engineer. 2016-11-18 10:32:46 -08:00
Kai Zheng f6ffa11635 HDFS-11117. Refactor striped file tests to allow flexibly test erasure coding policy. Contributed by Sammi Chen 2016-11-18 16:08:59 +06:00
Wei-Chiu Chuang c0b1a44f6c HADOOP-13660. Upgrade commons-configuration version. Contributed by Sean Mackrory. 2016-11-17 22:48:35 -06:00
Wei-Chiu Chuang 09520cb439 YARN-5271. ATS client doesn't work with Jersey 2 on the classpath. Contributed by Weiwei Yang. 2016-11-17 22:17:23 -06:00
Subru Krishnan 140b9939da YARN-5904. Reduce the number of default server threads for AMRMProxyService. 2016-11-17 18:26:25 -08:00
Junping Du f05a9ceb4a YARN-3538. TimelineWebService doesn't catch runtime exception. Contributed by Steve Loughran and Tsuyoshi Ozawa. 2016-11-17 16:55:39 -08:00