Commit Graph

20762 Commits

Author SHA1 Message Date
Surendra Singh Lilhore 75291e6d53 HADOOP-15869. BlockDecompressorStream#decompress should not return -1 in case of IOException. Contributed by Surendra Singh Lilhore 2018-11-13 20:22:58 +05:30
Brahma Reddy Battula e7b63baca1 HDFS-14070. Refactor NameNodeWebHdfsMethods to allow better extensibility. Contributed by CR Hota 2018-11-13 12:45:44 +05:30
Takanobu Asanuma a67642c377 HADOOP-15912. start-build-env.sh still creates an invalid /etc/sudoers.d/hadoop-build-${USER_ID} file entry after HADOOP-15802. Contributed by Akira Ajisaka. 2018-11-13 13:57:07 +09:00
Akira Ajisaka 703b2860a4
HADOOP-15923. create-release script should set max-cache-ttl as well as default-cache-ttl for gpg-agent. 2018-11-13 13:40:43 +09:00
Yiqun Lin f8713f8ade HDDS-831. TestOzoneShell in integration-test is flaky. Contributed by Nanda kumar. 2018-11-13 10:38:27 +08:00
Eric Yang 4c465f5535 YARN-8761. Service AM support for decommissioning component instances.
Contributed by Billie Rinaldi
2018-11-12 19:53:10 -05:00
Arpit Agarwal b6d4e19f34 HDFS-14065. Failed Storage Locations shows nothing in the Datanode Volume Failures. Contributed by Ayush Saxena. 2018-11-12 15:31:42 -08:00
Giovanni Matteo Fumarola e269c3fb5a YARN-8997. [Submarine] Small refactors of modifier, condition check and redundant local variables. Contributed by Zhankun Tang. 2018-11-12 15:06:43 -08:00
Jitendra Pandey f944f33832 HDDS-709. Modify Close Container handling sequence on datanodes. Contributed by Shashikant Banerjee. 2018-11-12 14:08:39 -08:00
Billie Rinaldi 1f9c4f32e8 YARN-8776. Implement Container Exec feature in LinuxContainerExecutor. Contributed by Eric Yang 2018-11-12 10:42:30 -08:00
Nanda kumar 18fe65d756 HDDS-576. Move ContainerWithPipeline creation to RPC endpoint.
Contributed by Nanda kumar.
2018-11-12 23:33:11 +05:30
Sunil G 42f3a7082a YARN-8877. [CSI] Extend service spec to allow setting resource attributes. Contributed by Weiwei Yang. 2018-11-12 21:09:30 +05:30
Steve Loughran 3c9d97b8f7
HADOOP-15110. Gauges are getting logged in exceptions from AutoRenewalThreadForUserCreds.
Contributed by LiXin Ge.
2018-11-12 12:58:05 +00:00
Weiwei Yang c741109522 YARN-8987. Usability improvements node-attributes CLI. Contributed by Bibin A Chundatt. 2018-11-12 18:18:23 +08:00
Márton Elek 9c32b50d61 HDDS-767. OM should not search for STDOUT root logger for audit logging. Contributed by Dinesh Chitlangia. 2018-11-12 10:54:41 +01:00
Sunil G 4e7284443e YARN-8902. [CSI] Add volume manager that manages CSI volume lifecycle. Contributed by Weiwei Yang. 2018-11-12 11:57:02 +05:30
Botong Huang b5ec85d966 YARN-8933. [AMRMProxy] Fix potential empty fields in allocation response, move SubClusterTimeout to FederationInterceptor. Contributed by Botong Huang. 2018-11-11 11:12:53 -08:00
Eric Yang 2664248797 YARN-9002. Improve keytab loading for YARN Service.
Contributed by Gour Saha
2018-11-10 01:52:19 -05:00
Tsz Wo Nicholas Sze 298d2502b0 HDDS-826. Update Ratis to 0.3.0-6f3419a-SNAPSHOT. 2018-11-09 18:35:40 -08:00
Nanda kumar 9fe50b4991 HDDS-733. Create container if not exist, as part of chunk write.
Contributed by Lokesh Jain.
2018-11-10 00:08:17 +05:30
Akira Ajisaka a736b5da15
HADOOP-15916. Upgrade Maven Surefire plugin to 3.0.0-M1. 2018-11-10 00:24:56 +09:00
Da Zhou 9dbb2b67c6
HADOOP-15812. ABFS: Improve AbfsRestOperationException format to ensure full msg can be displayed on console.
Author:    Da Zhou <da.zhou@microsoft.com>
2018-11-09 11:06:23 +00:00
Bharat Viswanadham 47194fefdd HDDS-823. OzoneRestClient is failing with NPE on getKeyDetails call. Contributed by Bharat Viswanadham. 2018-11-08 21:28:04 -08:00
Bharat Viswanadham 66bf62404a HDDS-812. TestEndPoint#testCheckVersionResponse is failing. Contributed by Hanisha Koneru. 2018-11-08 17:52:09 -08:00
Haibo Chen 524a7523c4 YARN-8990. Fix fair scheduler race condition in app submit and queue cleanup. (Contributed by Wilfred Spiegelenburg) 2018-11-08 16:02:48 -08:00
Giovanni Matteo Fumarola 89b49167a5 HADOOP-15903. Allow HttpServer2 to discover resources in /static when symlinks are used. Contributed by Inigo Goiri. 2018-11-08 14:52:24 -08:00
Shashikant Banerjee 31614bcc7c HDDS-806. Update Ratis to latest snapshot version in ozone. Contributed by Tsz Wo Nicholas Sze and Mukul Kumar Singh. 2018-11-09 00:05:45 +05:30
Kitti Nanasi 8d99648c20 HDFS-14039. ec -listPolicies doesn't show correct state for the default policy when the default is not RS(6,3). Contributed by Kitti Nanasi.
Signed-off-by: Xiao Chen <xiao@apache.org>
2018-11-08 10:01:19 -08:00
Junhua Gu 724c15007b
HADOOP-15846. ABFS: fix mask related bugs in setAcl, modifyAclEntries and removeAclEntries.
Contributed by Junhua Gu.

(cherry picked from commit 66715005f9)
2018-11-08 17:21:40 +00:00
Yiqun Lin 9317a61f3c HDDS-802. Container State Manager should get open pipelines for allocating container. Contributed by Lokesh Jain. 2018-11-08 23:41:43 +08:00
Nanda kumar c80f753b0e HDDS-737. Introduce Incremental Container Report.
Contributed by Nanda kumar.
2018-11-08 18:33:38 +05:30
Weiwei Yang e1bbf7dcdf YARN-8988. Reduce the verbose log on RM heartbeat path when distributed node-attributes is enabled. Contributed by Tao Yang. 2018-11-08 17:47:18 +08:00
Weiwei Yang f8c72d7b3a YARN-8880. Add configurations for pluggable plugin framework. Contributed by Zhankun Tang. 2018-11-08 12:23:00 +08:00
Weiwei Yang c96cbe8659 YARN-8977. Remove unnecessary type casting when calling AbstractYarnScheduler#getSchedulerNode. Contributed by Wanqiang Ji. 2018-11-07 22:42:22 +08:00
Jason Lowe 0b6625a973 MAPREDUCE-7148. Fast fail jobs when exceeds dfs quota limitation. Contributed by Wang Yan 2018-11-07 08:20:49 -06:00
Takanobu Asanuma 8dc1f6dbf7 YARN-8866. Fix a parsing error for crossdomain.xml. 2018-11-07 18:26:07 +09:00
Weiwei Yang e6444f1c64 HADOOP-15907. Add missing maven modules in BUILDING.txt. Contributed Wanqiang Ji. 2018-11-07 16:45:16 +08:00
Yiqun Lin addec29297 HDDS-809. Refactor SCMChillModeManager. 2018-11-07 13:54:08 +08:00
Weiwei Yang 482716e5a4 YARN-8976. Remove redundant modifiers in interface ApplicationConstants. Contributed by Zhankun Tang. 2018-11-07 10:48:07 +08:00
Akira Ajisaka 951c98f890
YARN-8233. NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null. Contributed by Tao Yang. 2018-11-07 11:17:35 +09:00
Jason Lowe ba1f9d66d9 MAPREDUCE-7156. NullPointerException when reaching max shuffle connections. Contributed by Peter Bacsko 2018-11-06 17:55:51 -06:00
Eric Yang 08d69d91f2 YARN-8957. Add Serializable interface to ComponentContainers.
Contributed by Zhankun Tang
2018-11-06 14:46:05 -05:00
Inigo Goiri 887244de4a HDFS-14048. DFSOutputStream close() throws exception on subsequent call after DataNode restart. Contributed by Erik Krogen. 2018-11-06 11:18:15 -08:00
Anu Engineer 00a67f770e HDDS-810. Move the "\r\n" at the chunk end in TestSignedChunksInputStream#singlechunkwithoutend.
Contributed by Chencan.
2018-11-06 10:42:19 -08:00
Inigo Goiri f0ce072934 HDFS-14051. Refactor NameNodeHttpServer#initWebHdfs to specify local keytab. Contributed by CR Hota. 2018-11-06 10:05:58 -08:00
Márton Elek 3d5cc1138a HDDS-798. Storage-class is showing incorrectly. Contributed by Bharat Viswanadham. 2018-11-06 18:28:54 +01:00
Daniel Templeton 349168c4b3 HDFS-14047. [libhdfs++] Fix hdfsGetLastExceptionRootCause bug in test_libhdfs_threaded.c
(Contributed by Antoli Shein via Daniel Templeton)

Change-Id: Ia5546fd5f8270f285c373b9023a9bd9835059845
2018-11-06 09:22:27 -08:00
Jason Lowe ab6aa4c726 YARN-8865. RMStateStore contains large number of expired RMDelegationToken. Contributed by Wilfred Spiegelenburg 2018-11-06 08:40:59 -06:00
Akira Ajisaka 49412a1289
HDDS-811. [JDK 11] Fix compilation failures with jdk 11. Contributed by Lokesh Jain. 2018-11-06 21:26:43 +09:00
Akira Ajisaka 78e43bccf6
HADOOP-15902. [JDK 11] Specify the HTML version of Javadoc to 4.01. Contributed by Takanobu Asanuma. 2018-11-06 20:44:05 +09:00