Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,079 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

18079 Commits

Author SHA1 Message Date
Zhankun Tang e9aa1789c2 YARN-9584. Should put initializeProcessTrees method call before get pid. Contributed by Wanqiang Ji. 
(cherry picked from commit 67414a1a80)
 2019-06-18 13:27:37 +08:00
Wangda Tan 16b70619a2 YARN-8086. ManagedParentQueue with no leaf queues cause JS error in new UI. (Suma Shivaprasad via wangda) 
Change-Id: I6d82af91adec02698afddde6883b1fe1924e6041
(cherry picked from commit e7e20190df)
 2018-03-29 15:19:49 -07:00
Sunil G a891f812da YARN-8076. Support to specify application tags in distributed shell. Contributed by Weiwei Yang. 
(cherry picked from commit 431076f637)
(cherry picked from commit 04161bad78)
 2018-03-29 09:48:25 -07:00
Eric Yang c1d3c2a227 YARN-8069. Clean up example hostnames for RegistryDNS. 
Contributed by Billie Rinaldi

(cherry picked from commit 3d185d62fc)
(cherry picked from commit 570d7f3072)
 2018-03-29 09:48:15 -07:00
Arpit Agarwal dd69817424 HDFS-13314. NameNode should optionally exit if it detects FsImage corruption. Contributed by Arpit Agarwal. 
(cherry picked from commit d54e19a913)
 2018-03-29 09:47:43 -07:00
Chris Douglas 84efa46de9 HADOOP-15320. Remove customized getFileBlockLocations for hadoop-azure and hadoop-azure-datalake. Contributed by Shanyu Zhao 
(cherry picked from commit 081c350188)
(cherry picked from commit ac16e8f4d3)
 2018-03-29 09:47:35 -07:00
Zhe Zhang 44125f459f YARN-7623. Fix the CapacityScheduler Queue configuration documentation. Contributed by Jonathan Hung. 
(cherry picked from commit 0b1c2b5fe1)
(cherry picked from commit 0db6b8c93c)
 2018-03-29 09:47:27 -07:00
Subru Krishnan f39f395060 YARN-8010. Add config in FederationRMFailoverProxy to not bypass facade cache when failing over. (Botong Huang via Subru). 
(cherry picked from commit 09999d7e01)
(cherry picked from commit a0091ec4b3)
 2018-03-29 09:47:19 -07:00
Subru Krishnan b56f657940 Revert "YARN-8010. Add config in FederationRMFailoverProxy to not bypass facade cache when failing over. (Botong Huang via Subru)." 
This reverts commit 85eebf1beb.

(cherry picked from commit ed49f59e18)
 2018-03-29 09:46:44 -07:00
Wangda Tan 7a01bfd201 YARN-6629. NPE occurred when container allocation proposal is applied but its resource requests are removed before. (Tao Yang via wangda) 
Change-Id: I805880f90b3f6798ec96ed8e8e75755f390a9ad5
(cherry picked from commit 47f711eebc)
(cherry picked from commit a2b4daab55)
 2018-03-29 09:46:17 -07:00
Yiqun Lin 44ebe55314 HDFS-13347. RBF: Cache datanode reports. Contributed by Inigo Goiri. 
(cherry picked from commit a71656c1c1)
(cherry picked from commit 99766992e6)
 2018-03-29 09:46:11 -07:00
Sunil G b5fd90c3a8 YARN-8075. DShell does not fail when we ask more GPUs than available even though AM throws 'InvalidResourceRequestException'. Contributed by Wangda Tan. 
(cherry picked from commit d1e378d02b)
(cherry picked from commit 6c904388f4)
 2018-03-29 09:46:06 -07:00
Subru Krishnan 276a5ca632 YARN-8010. Add config in FederationRMFailoverProxy to not bypass facade cache when failing over. (Botong Huang via Subru). 
(cherry picked from commit 2a2ef15caf)
(cherry picked from commit 85eebf1beb)
 2018-03-29 09:45:58 -07:00
Wei-Chiu Chuang 762126fac8 HADOOP-15312. Undocumented KeyProvider configuration keys. Contributed by LiXin Ge. 
(cherry picked from commit 3fe41c65d8)
(cherry picked from commit 1176a128d6)
 2018-03-29 09:45:51 -07:00
Inigo Goiri 2a5fad183e HDFS-13352. RBF: Add xsl stylesheet for hdfs-rbf-default.xml. Contributed by Takanobu Asanuma. 
(cherry picked from commit 4cef01147f)
(cherry picked from commit c1fc87dcce)
 2018-03-29 09:45:36 -07:00
Jitendra Pandey 7155ef28f9 HADOOP-14067. VersionInfo should load version-info.properties from its own classloader. Contributed by Thejas M Nair. 
(cherry picked from commit 91b98ad03a)
 2018-03-29 09:45:29 -07:00
Haibo Chen 7580c529a1 YARN-7794. SLSRunner is not loading timeline service jars, causing failure. (Yufei Gu via Haibo Chen) 
(cherry picked from commit fcea5a4d79)
(cherry picked from commit e00e08365e)
 2018-03-29 09:45:22 -07:00
Wangda Tan 3c826d379d YARN-8072. RM log is getting flooded with MemoryPlacementConstraintManager info logs. (Zian Chen via wangda) 
Change-Id: I2567f4669ad868e13c4301fe44c4bde85bb92c37
(cherry picked from commit 24bc5e0e4d)
(cherry picked from commit dc99611878)
 2018-03-29 09:45:16 -07:00
Wangda Tan b600608b2d YARN-8068. Application Priority field causes NPE in app timeline publish when Hadoop 2.7 based clients to 2.8+ (Sunil G via wangda) 
Change-Id: I7910bd1064a1b4dbbe2084080c060822ea6f3b48
(cherry picked from commit 9eef19b2ad)
(cherry picked from commit 62b9537332)
 2018-03-29 09:45:09 -07:00
Wangda Tan 0b7eed5e34 YARN-8062. yarn rmadmin -getGroups returns group from which the user has been removed. (Sunil G via wangda) 
Change-Id: I80ed63846502bf7751b890b6c6c6a7c0679e2b4a
(cherry picked from commit 5d381570f8)
(cherry picked from commit 54da6a0d78)
 2018-03-29 09:45:03 -07:00
Inigo Goiri aa66e7cc27 HDFS-13204. RBF: Optimize name service safe mode icon. Contributed by liuhongtong. 
(cherry picked from commit 947b282984)
(cherry picked from commit 0dc16559ee)
 2018-03-29 09:44:57 -07:00
Yiqun Lin 8890bba13a HDFS-13291. RBF: Implement available space based OrderResolver. Contributed by Yiqun Lin. 
(cherry picked from commit cfc3a1c8f0)
(cherry picked from commit 1e01ddfe4f)
 2018-03-29 09:44:50 -07:00
Wangda Tan 5f5f5a6eb1 YARN-8070. Yarn Service API site doc broken due to unwanted character in YarnServiceAPI.md (Gour Saha via wangda) 
Change-Id: I22428b2f128d16e79ebbdeaf32869566963d0c6f
(cherry picked from commit 24f75e097a)
(cherry picked from commit c98dd3bf18)
 2018-03-29 09:44:42 -07:00
weiy 640b03e068 HDFS-12512. RBF: Add WebHDFS. 
(cherry picked from commit 6e31a09084)
(cherry picked from commit d17aa8d052)
 2018-03-29 09:41:52 -07:00
Rohith Sharma K S 4ecb50a8ab YARN-7986. ATSv2 REST API queries do not return results for uppercase application tags. Contributed by Charan Hebri. 
(cherry picked from commit 75fc05f369)
(cherry picked from commit 91791a8abd)
 2018-03-29 09:41:36 -07:00
Sunil G c30b026997 YARN-8063. DistributedShellTimelinePlugin wrongly check for entityId instead of entityType. Contributed by Rohith Sharma K S. 
(cherry picked from commit 22c5ddb7c4)
(cherry picked from commit e10e6c9012)
 2018-03-29 09:41:20 -07:00
Inigo Goiri a9515dae7d HDFS-12792. RBF: Test Router-based federation using HDFSContract. Contributed by Inigo Goiri. 
(cherry picked from commit e196d158a2)
(cherry picked from commit 59ab86311c)
 2018-03-29 09:41:09 -07:00
Arpit Agarwal a30a863c7f HADOOP-15334. Upgrade Maven surefire plugin. Contributed by Arpit Agarwal. 
(cherry picked from commit d82e846fa4)
 2018-03-29 09:40:05 -07:00
Kihwal Lee c05dd318bf HDFS-13195. DataNode conf page cannot display the current value after reconfig. Contributed by maobaolong. 
(cherry picked from commit 66461ed98b)
(cherry picked from commit c245ecedda)
 2018-03-29 09:39:57 -07:00
Inigo Goiri 05b9f0f5b7 HDFS-13318. RBF: Fix FindBugs in hadoop-hdfs-rbf. Contributed by Ekanth S. 
(cherry picked from commit 3d0ee8b804)
(cherry picked from commit 485348a337)
 2018-03-29 09:39:46 -07:00
Konstantin V Shvachko 3018aa64ae HDFS-12884. BlockUnderConstructionFeature.truncateBlock should be of type BlockInfo. Contributed by chencan. 
(cherry picked from commit 8d898ab25f)
(cherry picked from commit 21db4e9efe)
 2018-03-29 09:39:11 -07:00
Jason Lowe dc075b727a YARN-8054. Improve robustness of the LocalDirsHandlerService MonitoringTimerTask thread. Contributed by Jonathan Eagles 
(cherry picked from commit 5aa7052e31)
(cherry picked from commit 5d4b2c31a1)
 2018-03-29 09:38:50 -07:00
Yiqun Lin d7d35fd4f0 HDFS-13250. RBF: Router to manage requests across multiple subclusters. Contributed by Inigo Goiri. 
(cherry picked from commit 2caba999bb)
(cherry picked from commit 0db4b587c6)
 2018-03-29 09:38:42 -07:00
Yiqun Lin 94b826d2c7 HDFS-13307. RBF: Improve the use of setQuota command. Contributed by liuhongtong. 
(cherry picked from commit 69fe4407eb)
(cherry picked from commit 131546002d)
 2018-03-29 09:37:47 -07:00
Sunil G 8443bb2ffb YARN-8085. ResourceProfilesManager should be set in RMActiveServiceContext. Contributed by Tao Yang. 
(cherry picked from commit 7a59d60e0c)
 2018-03-29 21:43:34 +05:30
Lei Xu 704d43603b Update 3.0.1 jdiff file and jdiff stable api version 2018-03-23 11:58:14 -07:00
Lei Xu b6a10e2b2b Update releasenotes and changelogs for 3.0.1 release 2018-03-23 11:57:45 -07:00
Wangda Tan b72856287c Updated index.md.vm for 3.1.0 release 
Change-Id: Idc5ab7167562b8bc99d32c27af4744e45fa7473e
 2018-03-21 16:53:43 -07:00
Rohith Sharma K S 4d020c49a9 YARN-7581. HBase filters are not constructed correctly in ATSv2. Contributed by Habio Chen. 
(cherry picked from commit 29acea5000)
(cherry picked from commit bbfe36d686)
 2018-03-21 16:49:47 -07:00
Haibo Chen dfcafa84ac YARN-8053. Add hadoop-distcp in exclusion in hbase-server dependencies for timelineservice-hbase packages. (Rohith Sharma K S via Haibo Chen) 
(cherry picked from commit 3ff6977d3e)
 2018-03-21 16:41:10 -07:00
Wangda Tan 0972780c47 Preparing for 3.1.0 release 
Change-Id: I9865da5d4c9437248e136b1161e0868567ab014d
 2018-03-20 11:34:03 -07:00
Inigo Goiri 9b96e7522b HDFS-13268. TestWebHdfsFileContextMainOperations fails on Windows. Contributed by Xiao Liang. 
(cherry picked from commit fe224ff972)
 2018-03-20 11:20:37 -07:00
weiy c804b28462 HDFS-13215. RBF: Move Router to its own module. 2018-03-19 23:05:33 -07:00
Sammi Chen 5acc13f340 HADOOP-15262. AliyunOSS: move files under a directory in parallel when rename a directory. Contributed by Jinhu Wu. 
(cherry picked from commit d67a5e2dec)
(cherry picked from commit 2285afb32e)
(cherry picked from commit 322520eb76)
(cherry picked from commit 7985c5fdc9)
 2018-03-20 14:03:17 +08:00
Inigo Goiri 7eb0bdbd32 HDFS-13296. GenericTestUtils generates paths with drive letter in Windows and fail webhdfs related test cases. Contributed by Xiao Liang. 
(cherry picked from commit e65ff1c8be)
 2018-03-19 17:20:36 -07:00
Jason Lowe a4f0dbcb44 YARN-8027. Setting hostname of docker container breaks for --net=host in docker 1.13. Contributed by Jim Brennan 
(cherry picked from commit f480367af6)
 2018-03-19 17:44:06 -05:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) 0bd99621c5 Preparing for 3.1.0 development 2018-03-19 15:16:54 -07:00
Yufei Gu 49c747ab18 YARN-8039. Clean up log dir configuration in TestLinuxContainerExecutorWithMocks.testStartLocalizer. Contributed by Miklos Szegedi. 2018-03-16 16:25:33 -07:00
Inigo Goiri 08ff1586d5 HDFS-12886. Ignore minReplication for block recovery. Contributed by Lukas Majercak. 2018-03-16 10:29:19 -07:00
Weiwei Yang 154cfb2b62 YARN-7636. Re-reservation count may overflow when cluster resource exhausted for a long time. contributed by Tao Yang. 2018-03-16 18:57:31 +08:00