Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,209 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

17209 Commits

Author SHA1 Message Date
Sunil G 8827d93ca1 YARN-7030. [YARN-3926] Performance optimizations in Resource and ResourceUtils class. Contributed by Wangda Tan. 
(cherry picked from commit a6989af1d9)
 2017-10-31 15:06:17 -07:00
Sunil G 1ba85a9305 YARN-6610. [YARN-3926] DominantResourceCalculator#getResourceAsValue dominant param is updated to handle multiple resources. Contributed by Daniel Templeton. 
(cherry picked from commit a0030c8c6f)
 2017-10-31 15:06:17 -07:00
Sunil G 5231c43bdb YARN-6892. [YARN-3926] Improve API implementation in Resources and DominantResourceCalculator class. Contributed by Sunil G. 
(cherry picked from commit 2b51b262ab)
 2017-10-31 15:06:16 -07:00
Yufei Gu 9c4505f3fa YARN-6994. [YARN-3926] Remove last uses of Long from resource types code. (Daniel Templeton via Yufei Gu) 
(cherry picked from commit d5e9939ebb)
 2017-10-31 15:06:16 -07:00
Daniel Templeton 99c292403d YARN-6788. [YARN-3926] Improve performance of resource profile branch 
(Contributed by Sunil Govindan via Daniel Templeton)

(cherry picked from commit 3aeaafecb8)
 2017-10-31 15:06:16 -07:00
Sunil G 58f2c07028 YARN-6786. [YARN-3926] ResourcePBImpl imports cleanup. Contributed by Yeliang Cang. 
(cherry picked from commit 4e5632d28e)
 2017-10-31 15:06:16 -07:00
Sunil G 5fa0dc35c3 YARN-6761. Fix build for YARN-3926 branch. Contributed by Varun Vasudev. 
(cherry picked from commit ca2808d8bb)
 2017-10-31 15:06:16 -07:00
Sunil G 48ddb8f5b4 YARN-6445. [YARN-3926] Performance improvements in resource profile branch with respect to SLS. Contributed by Varun Vasudev. 
(cherry picked from commit 58da54640e)
 2017-10-31 15:06:16 -07:00
Sunil G bda5486dad YARN-6232. Update resource usage and preempted resource calculations to take into account all resource types. Contributed by Varun Vasudev. 
(cherry picked from commit dae65f3bef)
 2017-10-31 15:06:16 -07:00
Sunil G 4045ef047d YARN-5588. [Partial backport] [YARN-3926] Add support for resource profiles in distributed shell. Contributed by Varun Vasudev. 
(cherry picked from commit 7805deed48)
 2017-10-31 15:06:16 -07:00
Arun Suresh a9fa0349a0 YARN-5587. [Partial backport] Add support for resource profiles. (vvasudev via asuresh) 
(cherry picked from commit 6708ac3301)
 2017-10-31 15:06:16 -07:00
Rohith Sharma K S 3d1b59e04a YARN-5586. Update the Resources class to consider all resource types. Contributed by Varun Vasudev. 
(cherry picked from commit 239c1824a0)
 2017-10-31 15:06:16 -07:00
Rohith Sharma K S feb6d00e2a YARN-5242. Update DominantResourceCalculator to consider all resource types in calculations. Contributed by Varun Vasudev. 
(cherry picked from commit 9e4ba6aff5)
 2017-10-31 15:06:16 -07:00
Varun Vasudev 16beac12ad YARN-4830. Add support for resource types in the nodemanager. Contributed by Varun Vasudev. 
(cherry picked from commit 759114b006)
 2017-10-31 15:06:16 -07:00
Arun Suresh 92ca475fdc YARN-4829. Add support for binary units in Resource class.(vvasudev via asuresh) 
(cherry picked from commit 7ba698997b)
 2017-10-31 15:06:16 -07:00
Varun Vasudev f1f9b83e4c YARN-4715. Add support to read resource types from a config file. Contributed by Varun Vasudev. 
(cherry picked from commit ceb12c59a3)
 2017-10-31 15:06:15 -07:00
Wangda Tan 33fabe1e10 YARN-4172. Extend DominantResourceCalculator to account for all resources. (Varun Vasudev via wangda) 
(cherry picked from commit 32c91223f1)
 2017-10-31 15:06:15 -07:00
Wangda Tan 68da5218b7 YARN-4081. Add support for multiple resource types in the Resource class. (Varun Vasudev via wangda) 
(cherry picked from commit 1bbab7c157)
 2017-10-31 15:06:15 -07:00
Chris Douglas b5f66b005c Revert "HDFS-7878. API - expose a unique file identifier." 
This reverts commit 1ce0eb7d23.
 2017-10-31 13:56:41 -07:00
Carlo Curino 1fbc72704e YARN-3661. Basic Federation UI. (Contributed by Inigo Goiri via curino) 
(cherry picked from commit ceca9694f9)
 2017-10-31 13:42:36 -07:00
Haibo Chen e785e83270 YARN-7389. Make TestResourceManager Scheduler agnostic. (Robert Kanter via Haibo Chen) 
(cherry picked from commit d7f3737f3b)
 2017-10-31 13:41:44 -07:00
Wei-Chiu Chuang cba1fa496b HADOOP-14880. [KMS] Document&test missing KMS client side configs. Contributed by Gabor Bota. 
(cherry picked from commit 97c70c7ac6)
 2017-10-31 12:54:53 -07:00
Chen Liang af52a585f0 HADOOP-14915. method name is incorrect in ConfServlet. Contributed by Bharat Viswanadham. 
(cherry picked from commit 563dcdfc1d)
 2017-10-31 12:54:28 -07:00
Wei-Chiu Chuang 0b3e3e4895 HADOOP-14948. Document missing config key hadoop.treat.subject.external. Contributed by Ajay Kumar. 
(cherry picked from commit e906108fc9)
 2017-10-31 12:54:03 -07:00
Wei-Chiu Chuang 1347e83c90 HDFS-12485. expunge may fail to remove trash from encryption zone. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 8dbc8909c9)
 2017-10-31 12:52:58 -07:00
Manoj Govindassamy 166c75a0eb HDFS-12544. SnapshotDiff - support diff generation on any snapshot root descendant directory. 
(cherry picked from commit 075dd45a24)
 2017-10-31 12:50:54 -07:00
Manoj Govindassamy 1375c7205f HDFS-12573. Divide the total blocks metrics into replicated and erasure coded. Contributed by Takanobu Asanuma. 
(cherry picked from commit 78af6cdc53)
 2017-10-31 12:50:21 -07:00
Manoj Govindassamy 014184127e HDFS-12614. FSPermissionChecker#getINodeAttrs() throws NPE when INodeAttributesProvider configured. 
(cherry picked from commit b406d8e375)
 2017-10-31 12:49:41 -07:00
Wei-Chiu Chuang 579612c9d2 HDFS-12619. Do not catch and throw unchecked exceptions if IBRs fail to process. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 4ab0c8f96a)
 2017-10-31 12:49:08 -07:00
Akira Ajisaka 143dbf8497 HDFS-12622. Fix enumerate in HDFSErasureCoding.md. Contributed by Yiqun Lin. 
(cherry picked from commit dc63a6a52b)
 2017-10-31 12:48:29 -07:00
Subru Krishnan 0d9503d6b5 YARN-6413. FileSystem based Yarn Registry implementation. (Ellen Hui via Subru). 
(cherry picked from commit ed24da3dd7)
 2017-10-31 12:08:32 -07:00
Andrew Wang ae08fe518b Revert "HDFS-12499. dfs.namenode.shared.edits.dir property is currently namenode specific key. Contributed by Bharat Viswanadham." 
This reverts commit f09725537e.
 2017-10-31 10:46:19 -07:00
Inigo Goiri e259030066 HDFS-12699. TestMountTable fails with Java 7. Contributed by Inigo Goiri. 
(cherry picked from commit 982bd2a5bf)
 2017-10-31 10:23:06 -07:00
Arpit Agarwal f09725537e HDFS-12499. dfs.namenode.shared.edits.dir property is currently namenode specific key. Contributed by Bharat Viswanadham. 2017-10-31 10:08:05 -07:00
Chris Douglas 1ce0eb7d23 HDFS-7878. API - expose a unique file identifier. 
(cherry picked from commit d015e0bbd5)
 2017-10-31 09:46:39 -07:00
Jason Lowe 75605766fd HADOOP-14919. BZip2 drops records when reading data in splits. Contributed by Jason Lowe 
(cherry picked from commit 2fae63aa60)
 2017-10-31 09:32:02 -05:00
Akira Ajisaka da6ab7727c
YARN-7379. Moving logging APIs over to slf4j in hadoop-yarn-client. Contributed by Yeliang Cang. 
(cherry picked from commit c02d2ba50d)
 2017-10-31 17:11:18 +09:00
Akira Ajisaka 6bbfa158d7
YARN-7407. Moving logging APIs over to slf4j in hadoop-yarn-applications. Contributed by Yeliang Cang. 
(cherry picked from commit 785f1b0d11)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/Client.java
 2017-10-31 16:45:12 +09:00
Junping Du b9a4bf0c46 HADOOP-14990. Clean up jdiff xml files added for 2.8.2 release. 
(cherry picked from commit a8083aaa6f)
 2017-10-30 15:28:58 -07:00
Chris Douglas 85be67ebe4 HADOOP-14992. Upgrade Avro patch version. Contributed by Bharat Viswanadham 
(cherry picked from commit e4878a59b3)
 2017-10-30 09:49:34 -07:00
Yufei Gu d9f027adbc YARN-6747. TestFSAppStarvation.testPreemptionEnable fails intermittently. (Contributed by Miklos Szegedi) 
(cherry picked from commit d4811c8cfa)
 2017-10-29 16:48:07 -07:00
Arun Suresh 6b4319cc50 YARN-7299. Fix TestDistributedScheduler. (asuresh) 
(cherry picked from commit 9c5c68745e)
 2017-10-27 23:15:37 -07:00
Arun Suresh b30eb17c75 YARN-7178. Add documentation for Container Update API. (asuresh) 
(cherry picked from commit 24f8c5cce3)
 2017-10-27 22:58:34 -07:00
Chris Douglas 77ad73501c HADOOP-14991. Add missing figures to Resource Estimator tool. Contributed by Rui Li 
(cherry picked from commit 139cc752d2)
 2017-10-27 22:00:44 -07:00
Chris Douglas 1660a638f0 HADOOP-14986. Enforce JDK limitations. 
(cherry picked from commit b50def3697)
 2017-10-27 21:39:27 -07:00
Chris Douglas 34512b2d7a HDFS-12582. Replace HdfsFileStatus constructor with a builder pattern. Contributed by Bharat Viswanadham 
(cherry picked from commit d55a84951a)
 2017-10-27 15:36:18 -07:00
Jason Lowe 00345eed50 YARN-7244. ShuffleHandler is not aware of disks that are added. Contributed by Kuhu Shukla 
(cherry picked from commit 665bb147aa)
 2017-10-27 17:00:31 -05:00
Rohith Sharma K S d9b636f2f4 YARN-7289. Application lifetime does not work with FairScheduler. Contributed by Miklos Szegedi. 
(cherry picked from commit 5c799ecf09)
 2017-10-27 23:14:55 +05:30
Sunil G e084d43550 YARN-7375. Possible NPE in RMWebapp when HA is enabled and the active RM fails. Contributed by Chandni Singh. 
(cherry picked from commit 792388e1c0)
 2017-10-27 20:54:58 +05:30
Arpit Agarwal 2510fc1801 HDFS-9914. Fix configurable WebhDFS connect/read timeout. Contributed by Xiaoyu Yao. 2017-10-27 07:49:18 -07:00