Commit Graph

18979 Commits

Author SHA1 Message Date
Inigo Goiri 6a69239d86 YARN-8163. Add support for Node Labels in opportunistic scheduling. Contributed by Abhishek Modi. 2018-05-04 14:59:59 -07:00
Rushabh Shah 4cdbdce752 HADOOP-14841 Kms client should disconnect if unable to get output stream from connection. Contributed by Rushabh S Shah 2018-05-04 15:36:13 -05:00
Aaron Fabbri 96c843f64b
HADOOP-15444 ITestS3GuardToolDynamo should only run with -Ddynamo (Aaron Fabbri) 2018-05-04 11:34:45 -07:00
Eric Yang 8cdb032aff YARN-8223. Improved yarn auxiliary service to load jar file from HDFS.
Contributed by Zian Chen
2018-05-04 12:36:31 -04:00
Billie Rinaldi 6795f8072f YARN-8079. Support static and archive unmodified local resources in service AM. Contributed by Suma Shivaprasad 2018-05-04 09:27:07 -07:00
Billie Rinaldi 502914ca32 YARN-7818. Remove privileged operation warnings during container launch for the ContainerRuntimes. Contributed by Shane Kumpf 2018-05-04 08:53:55 -07:00
Inigo Goiri a3b416f69d HDFS-13525. RBF: Add unit test TestStateStoreDisabledNameservice. Contributed by Yiqun Lin. 2018-05-03 11:24:57 -07:00
Eric Yang 7698737207 YARN-8226. Improved anti-affinity description in YARN Service doc.
Contributed by Gour Saha
2018-05-03 13:35:40 -04:00
Eric Yang 7fe3214d4b YARN-7961. Improve status message for YARN service.
Contributed by Gour Saha
2018-05-03 13:27:07 -04:00
Rohith Sharma K S ee2ce923a9 YARN-8217. RmAuthenticationFilterInitializer and TimelineAuthenticationFilterInitializer should use Configuration.getPropsWithPrefix instead of iterator. Contributed by Suma Shivaprasad. 2018-05-03 14:43:40 +05:30
Sean Mackrory 85381c7b60 HADOOP-15434. Upgrade to ADLS SDK that exposes current timeout. 2018-05-02 21:30:31 -06:00
Inigo Goiri e6a80e476d YARN-8151. Yarn RM Epoch should wrap around. Contributed by Young Chen. 2018-05-02 17:23:17 -07:00
Daniel Templeton 87c23ef643 HDFS-13481. TestRollingFileSystemSinkWithHdfs#testFlushThread: test failed intermittently
(Contributed by Gabor Bota via Daniel Templeton)

Change-Id: I9921981dfa69669fe7912dd2a31ae8b638283204
2018-05-02 17:13:40 -07:00
Eric Yang f4d280f02b YARN-8194. Fixed reinitialization error for LinuxContainerExecutor.
Contributed by Chandni Singh
2018-05-02 20:07:19 -04:00
Anu Engineer 6b63a0af9b HDDS-15. Add memory profiler support to Genesis. Contributed by Anu Engineer. 2018-05-02 12:54:49 -07:00
Konstantinos Karanasos 3b34fca4b5 YARN-8113. Update placement constraints doc with application namespaces and inter-app constraints. Contributed by Weiwei Yang. 2018-05-02 11:49:56 -07:00
Eric Yang 883f68222a YARN-8209. Fixed NPE in Yarn Service deletion.
Contributed by Eric Badger
2018-05-02 14:33:31 -04:00
James Clampffer 19ae588fde HDFS-11807. libhdfs++: Get minidfscluster tests running under valgrind. Contributed by Anatoli Shein. 2018-05-02 11:49:12 -04:00
Steve Loughran fe649bb305 HADOOP-12071. conftest is not documented.
Contributed by Kengo Seki.
2018-05-02 13:33:56 +01:00
Weiwei Yang 251f528814 YARN-8222. Fix potential NPE when gets RMApp from RM context. Contributed by Tao Yang. 2018-05-02 17:54:46 +08:00
Yiqun Lin 3265b55119
YARN-6385. Fix checkstyle warnings in TestFileSystemApplicationHistoryStore
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-05-02 18:14:02 +09:00
Jason Lowe e07156e8b0
HADOOP-15406. hadoop-nfs dependencies for mockito and junit are not test scope
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-05-02 17:30:10 +09:00
BELUGA BEHR 33768724ff
HADOOP-15377. Improve debug messages in MetricsConfig.java
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-05-02 17:09:22 +09:00
Bibin A Chundatt 1a95a4524a
MAPREDUCE-7073. Optimize TokenCache#obtainTokensForNamenodesInternal
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-05-02 16:14:28 +09:00
Yiqun Lin 37269261d1 HDFS-13488. RBF: Reject requests when a Router is overloaded. Contributed by Inigo Goiri. 2018-05-02 14:49:39 +08:00
Steve Loughran 8f42dafcf8 HADOOP-15250. Split-DNS MultiHomed Server Network Cluster Network IPC Client Bind Addr Wrong
Contributed by Ajay Kumar
2018-05-01 22:32:40 +01:00
Jason Lowe 68c6ec719d MAPREDUCE-7086. Add config to allow FileInputFormat to ignore directories when recursive=false. Contributed by Sergey Shelukhin 2018-05-01 16:19:53 -05:00
Eric Yang 24eeea8b18 YARN-7799. Improved YARN service jar file handling.
Contributed by Billie Rinaldi
2018-05-01 16:46:34 -04:00
Inigo Goiri 9e2cfb2d3f HDFS-13503. Fix TestFsck test failures on Windows. Contributed by Xiao Liang. 2018-05-01 08:12:46 -07:00
Billie Rinaldi 4e1382aca4 YARN-2674. Fix distributed shell AM container relaunch during RM work preserving restart. Contributed by Shane Kumpf 2018-05-01 07:27:47 -07:00
Sunil G d6139c5106 YARN-8187. [UI2] Individual Node page does not contain breadcrumb trail. Contributed by Zian Chen. 2018-05-01 14:01:34 +05:30
Anu Engineer f0c3dc4cf4 HDDS-13. Refactor StorageContainerManager into seperate RPC endpoints. Contributed by Anu Engineer. 2018-04-30 21:41:10 -07:00
Weiwei Yang 2d319e3793 YARN-8212. Pending backlog for async allocation threads should be configurable. Contributed by Tao Yang. 2018-05-01 09:47:10 +08:00
Eric Yang a966ec6e23 YARN-8228. Added hostname length check for docker container.
Contributed by Shane Kumpf
2018-04-30 19:12:53 -04:00
Aaron Fabbri 919865a34b
HADOOP-15239 S3ABlockOutputStream.flush() be no-op when stream closed. Contributed by Gabor Bota. 2018-04-30 16:02:57 -07:00
Inigo Goiri fc074a359c HDFS-13283. Percentage based Reserved Space Calculation for DataNode. Contributed by Lukas Majercak. 2018-04-30 13:28:33 -07:00
Konstantinos Karanasos 9b09555451 YARN-8195. Fix constraint cardinality check in the presence of multiple target allocation tags. Contributed by Weiwei Yang. 2018-04-30 11:54:30 -07:00
Anu Engineer 3d43474f75 HDDS-11. Fix findbugs exclude rules for ozone and hdds projects. Contributed by Elek, Marton. 2018-04-30 09:20:58 -07:00
Inigo Goiri eb7fe1d588 HDFS-13509. Bug fix for breakHardlinks() of ReplicaInfo/LocalReplica, and fix TestFileAppend failures on Windows. Contributed by Xiao Liang. 2018-04-28 09:05:30 -07:00
Weiwei Yang 2c95eb8111 YARN-8225. YARN precommit build failing in TestPlacementConstraintTransformations. Contributed by Shane Kumpf. 2018-04-28 17:37:37 +08:00
Inigo Goiri 484440602c HDFS-13508. RBF: Normalize paths (automatically) when adding, updating, removing or listing mount table entries. Contributed by Ekanth S. 2018-04-27 16:28:17 -07:00
Inigo Goiri f469628bba HDFS-13434. RBF: Fix dead links in RBF document. Contributed by Chetna Chaudhari. 2018-04-27 15:13:47 -07:00
Wangda Tan 92c5331423 YARN-8005. Add unit tests for queue priority with dominant resource calculator. (Zian Chen via wangda)
Change-Id: I17a645f20869a1e5d86fa7a325c93fec908b91dc
2018-04-27 13:08:43 -07:00
Wangda Tan b1833d9ba2 YARN-8210. AMRMClient logging on every heartbeat to track updation of AM RM token causes too many log lines to be generated in AM logs. (Suma Shivaprasad via wangda)
Change-Id: I70edd6e301fd5e78d479e1882aedc9332a0827aa
2018-04-27 13:07:38 -07:00
Rohith Sharma K S ef3ecc308d YARN-8221. RMWebServices also need to honor yarn.resourcemanager.display.per-user-apps. Contributed by Sunil G. 2018-04-27 22:58:10 +05:30
Wei-Chiu Chuang bff3d7b0cf HADOOP-15382. Log kinit output in credential renewal thread. Contributed by Gabor Bota. 2018-04-27 10:05:55 -07:00
Eric Yang 24a5ccbf4b YARN-7781. Update YARN service documentation.
Contributed by Gour Saha
2018-04-27 12:38:30 -04:00
Eric Yang 14b47990af YARN-8204. Added a flag to disable YARN service upgrade.
Contributed by Chandni Singh
2018-04-27 12:24:43 -04:00
Billie Rinaldi 9ab3f97089 YARN-8211. Yarn registry dns log finds BufferUnderflowException on port ping. Contributed by Eric Yang 2018-04-27 07:58:43 -07:00
Billie Rinaldi 914d6b5cb1 YARN-8208. Add log statement for Docker client configuration file at INFO level. Contributed by Yesha Vora 2018-04-27 06:10:32 -07:00