Commit Graph

18322 Commits

Author SHA1 Message Date
Wei Yan 5d50f716e7 HDFS-13466. RBF: Add more router-related information to the UI.
(cherry picked from commit e4313e7e47)
2018-04-17 15:03:12 -07:00
Inigo Goiri 4be0fa28da HDFS-13462. Add BIND_HOST configuration for JournalNode's HTTP and RPC Servers. Contributed by Lukas Majercak.
(cherry picked from commit c9b33514b8)
2018-04-17 14:20:23 -07:00
Bharat Viswanadham fc11555caf HDFS-13129. Add a test for DfsAdmin refreshSuperUserGroupsConfiguration. Contributed by Mukul Kumar Singh
(cherry picked from commit a68b04370f)
2018-04-17 12:41:54 -07:00
Jason Lowe 42aef3b655 YARN-7996. Allow user supplied Docker client configurations with YARN native services. Contributed by Shane Kumpf
(cherry picked from commit 1d6e43da51)
2018-04-17 11:32:58 -05:00
Inigo Goiri 8f300c9ce1 YARN-8165. Incorrect queue name logging in AbstractContainerAllocator. Contributed by Weiwei Yan.
(cherry picked from commit dd5e18c4ae)
2018-04-17 15:28:13 +05:30
Sunil G d5adc59017 YARN-8126. Support auto-spawning of admin configured services during bootstrap of RM. Contributed by Rohith Sharma K S.
(cherry picked from commit 427ad7ecc4)
2018-04-17 15:25:31 +05:30
Yiqun Lin 1d776f22f9 HDFS-13435. RBF: Improve the error loggings for printing the stack trace.
(cherry picked from commit c4d3636c21)
2018-04-17 11:25:14 +08:00
Virajith Jalaparti 70830d9f9c HDFS-13311. RBF: TestRouterAdminCLI#testCreateInvalidEntry fails on Windows. Contributed by Inigo Goiri 2018-04-16 16:06:25 -07:00
Arpit Agarwal 43a2af5569 HDFS-13439. Add test case for read block operation when it is moved. Contributed by Ajay Kumar. 2018-04-16 14:18:41 -07:00
Xiao Chen 805e33b62c HDFS-13056. Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts. Contributed by Dennis Huo. 2018-04-16 11:58:10 -07:00
Eric Yang 2911b5406b YARN-8060. Added default readiness check for service components.
Contributed by Billie Rinaldi

(cherry picked from 2d0662cfd5)
2018-04-16 14:53:42 -04:00
Eric Yang 20453488e8 YARN-8032. Added ability to configure failure validity interval for YARN service.
Contributed by Chandni Singh

(cherry-picked from 647058efc0)
2018-04-16 14:52:09 -04:00
Eric Yang 148322ca72 YARN-8142. Improve SIGTERM handling for YARN Service Application Master.
Contributed by Billie Rinaldi

(cherry picked from commit 9031a76d44)
2018-04-14 12:10:37 -07:00
Wangda Tan 6ee62e6b1c YARN-8138. Add unit test to validate queue priority preemption works under node partition. (Zian Chen via wangda)
Change-Id: Ibebfab98a714c12c2dc643b6d7b9754a7f813632
2018-04-14 11:04:49 -07:00
Wangda Tan 0b88683627 YARN-7142. Support placement policy in yarn native services. (Gour Saha via wangda)
Change-Id: I166c67a7a34430627c17365f60bac75b6da1b434
(cherry picked from commit a0bde7d525)
2018-04-14 11:01:59 -07:00
Rohith Sharma K S eb1026dffa YARN-8156. Increase the default value of yarn.timeline-service.app-collector.linger-period.ms. Contributed by Charan Hebri.
(cherry picked from commit 669eb7bdea)
2018-04-14 10:57:02 +05:30
Wei-Chiu Chuang ca8bb322be HDFS-13330. ShortCircuitCache#fetchOrCreate never retries. Contributed by Gabor Bota.
(cherry picked from commit e66e287efe)
2018-04-13 12:18:49 -07:00
Wangda Tan 994c7d66e0 YARN-8091. Revisit checkUserAccessToQueue RM REST API. (wangda)
Change-Id: I5fab3fe229c34e967487b7327c7b3c8ddf7cb795
2018-04-13 10:19:10 -07:00
Wangda Tan 7031a853f4 YARN-8048. Support auto-spawning of admin configured services during bootstrap of RM (Rohith Sharma K S via wangda)
Change-Id: I2d8d61ccad55e1118009294d7e17822df3cd0fd5
2018-04-13 10:18:48 -07:00
Sunil G d98c3ca5fd YARN-8040. [UI2] New YARN UI webapp does not respect current pathname for REST api. Contributed by Sunil G. 2018-04-13 10:18:39 -07:00
Sunil G 21717db6a0 YARN-8028. Support authorizeUserAccessToQueue in RMWebServices. Contributed by Wangda Tan. 2018-04-13 10:18:12 -07:00
Wangda Tan c962371430 YARN-1151. Ability to configure auxiliary services from HDFS-based JAR files. (Xuan Gong via wangda)
Change-Id: Ied37ff11e507fc86847753ba79486652c8fadfe9
2018-04-13 10:17:47 -07:00
Takanobu Asanuma 077eda66ad MAPREDUCE-7066. TestQueue fails on Java9
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-04-13 10:17:34 -07:00
Wei-Chiu Chuang 696d786063 HDFS-11900. Hedged reads thread pool creation not synchronized. Contributed by John Zhuge. 2018-04-13 10:16:23 -07:00
Xiaoyu Yao 867135af28 HDFS-11043. TestWebHdfsTimeouts fails. Contributed by Xiaoyu Yao and Chao Sun. 2018-04-13 10:14:47 -07:00
Yongjun Zhang 56acbe476b HDFS-13315. Add a test for the issue reported in HDFS-11481 which is fixed by HDFS-10997. Contributed by Yongjun Zhang. 2018-04-13 10:14:24 -07:00
Sean Mackrory 2b46bd3f45 HADOOP-15332. Fix typos in hadoop-aws markdown docs. Contributed by Gabor Bota. 2018-04-13 10:13:56 -07:00
Yufei Gu 6891da1e75 HADOOP-15331. Fix a race condition causing parsing error of java.io.BufferedInputStream in class org.apache.hadoop.conf.Configuration. Contributed by Miklos Szegedi. 2018-04-13 10:13:34 -07:00
fang zhenyi 922a0db13c HADOOP-15330. Remove jdk1.7 profile from hadoop-annotations module
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-04-13 10:12:27 -07:00
Yufei Gu 9014f98b60 HADOOP-15062. TestCryptoStreamsWithOpensslAesCtrCryptoCodec fails on Debian 9. Contributed by Miklos Szegedi. 2018-04-13 10:12:01 -07:00
Chris Douglas ffc39ec3ab HADOOP-14667. Flexible Visual Studio support. Contributed by Allen Wittenauer 2018-04-13 10:11:35 -07:00
Bharat Viswanadham 8df8cad019 HDFS-13438. Fix javadoc in FsVolumeList#removeVolume. Contributed by Shashikant Banerjee.
(cherry picked from commit fa8b88ab2b)
2018-04-13 09:05:24 -07:00
Yiqun Lin 16763d8229 HDFS-13418. NetworkTopology should be configurable when enable DFSNetworkTopology. Contributed by Tao Jie.
(cherry picked from commit 0725953efe)
2018-04-13 17:57:15 +08:00
Erik Krogen e343be46f8 HADOOP-14970. MiniHadoopClusterManager doesn't respect lack of format option. Contributed by Erik Krogen
(cherry picked from commit 1a407bc990)
2018-04-12 23:31:18 -07:00
Weiwei Yang 84531ad9b6 YARN-8153. Guaranteed containers always stay in SCHEDULED on NM after restart. Contributed by Yang Wang. 2018-04-13 13:29:43 +08:00
Weiwei Yang 7be71ec55b YARN-8154. Fix missing titles in PlacementConstraints document. Contributed by Weiwei Yang. 2018-04-13 13:10:05 +08:00
Bharat Viswanadham b652e915fb HADOOP-15379. Make IrqHandler.bind() public. Contributed by Ajay Kumar
(cherry picked from commit ec1e8c1a8c)
2018-04-12 21:55:40 -07:00
Akira Ajisaka 5531c31f16
HDFS-13436. Fix javadoc of package-info.java
(cherry picked from commit 9b0b9f2af2)
2018-04-13 13:24:42 +09:00
Eric Yang a375fe8263 YARN-7984. Improved YARN service stop/destroy and clean up.
Contributed by Billie Rinaldi

(cherry picked from commit d553799030)
2018-04-12 18:19:58 -07:00
Wangda Tan 035e0f97ea MAPREDUCE-7077. Pipe mapreduce job fails with Permission denied for jobTokenPassword. (Akira Ajisaka via wangda)
Change-Id: Ie8f01425d58409fa3661f768205b7616128c8aa4
2018-04-12 14:33:33 -07:00
Eric Yang 150085cc64 YARN-8018. Added support for initiating yarn service upgrade.
Contributed by Chandni Singh

(cherry picked from commit 27d60a1634)
2018-04-12 17:08:27 -04:00
Billie Rinaldi 23179c06a3 YARN-7936. Add default service AM Xmx. Contributed by Jian He
(cherry picked from commit 53b3e59473)
2018-04-12 12:43:30 -07:00
Eric E Payne 9693d8b99d YARN-8147. TestClientRMService#testGetApplications sporadically fails. Contributed by Jason Lowe
(cherry picked from commit 18844599ae)
2018-04-12 17:58:41 +00:00
Eric E Payne f955d52f39 YARN-8120. JVM can crash with SIGSEGV when exiting due to custom leveldb logger. Contributed by Jason Lowe.
(cherry picked from commit 6bb128dfb8)
2018-04-12 16:11:57 +00:00
Inigo Goiri 671e407ced Revert "HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs all the time. Contributed by Jinglun."
This reverts commit 8c9dab978e.
2018-04-12 08:43:12 -07:00
Akira Ajisaka 5f4762d950
HDFS-7101. Potential null dereference in DFSck#doWork(). Contributed by skrho and Ted Yu.
(cherry picked from commit 113af12cfb)
2018-04-12 17:48:14 +09:00
Akira Ajisaka 2d82a21b84
HDFS-13427. Fix the section titles of transparent encryption document.
(cherry picked from commit c7cd362afd)
2018-04-12 10:46:14 +09:00
Billie Rinaldi 11f1d49823 YARN-7221. Add security check for privileged docker container. Contributed by Eric Yang
(cherry picked from commit 933477e9e0)
2018-04-11 12:15:00 -07:00
Inigo Goiri 3c1cd08f04 HDFS-13386. RBF: Wrong date information in list file(-ls) result. Contributed by Dibyendu Karmakar.
(cherry picked from commit 18de6f2042)
2018-04-11 12:03:40 -07:00
Inigo Goiri d032112e6b HDFS-13428. RBF: Remove LinkedList From StateStoreFileImpl.java. Contributed by BELUGA BEHR.
(cherry picked from commit 6a881cd842fb4eab596a386b39670ea03536891a)
2018-04-11 10:41:13 -07:00