Commit Graph

20799 Commits

Author SHA1 Message Date
Akira Ajisaka 499c70eda5
MAPREDUCE-7166. map-only job should ignore node lost event when task is already succeeded. Contributed by Lei Li. 2018-12-20 10:09:50 +09:00
Takanobu Asanuma d963575918 HDFS-13661. Ls command with e option fails when the filesystem is not HDFS. 2018-12-20 10:03:33 +09:00
Billie Rinaldi 2e544dc921 YARN-9129. Ensure flush after printing to log plus additional cleanup. Contributed by Eric Yang 2018-12-19 16:45:23 -08:00
Eric Yang e815fd9c49 YARN-9126. Fix container clean up for reinitialization.
Contributed by Chandni Singh
2018-12-19 14:55:56 -05:00
Arpit Agarwal cf571133b8 HDDS-893. pipeline status is ALLOCATED in scmcli listPipelines command. Contributed by Lokesh Jain. 2018-12-19 13:42:06 +05:30
Arpit Agarwal b1ce9aa3b3 HDDS-940. Remove dead store to local variable in OmMetadataManagerImpl. Contributed by Dinesh Chitlangia. 2018-12-19 12:30:40 +05:30
Eric Yang ccdd982e51 YARN-9084. Reset container state and defer readiness check for upgrade.
Contributed by Chandni Singh
2018-12-18 18:02:03 -05:00
Eric Yang c7a5a4435e YARN-9075. Add ability to register/remove auxiliary service without restart node manager.
Contributed by Billie Rinaldi
2018-12-18 17:05:51 -05:00
Billie Rinaldi a6e9d27c29 YARN-9117. Add a check for insecure setup for container terminal. Contributed by Eric Yang 2018-12-18 12:49:10 -08:00
Bharat Viswanadham 12c139d7de HDDS-933. Add documentation for genconf tool under Tools section. Contributed by Dinesh Chitlangia. 2018-12-18 11:40:32 -08:00
Bharat Viswanadham 2f6bc25044 HDDS-911. Make TestOzoneManager unit tests independent. Contributed by Elek Marton. 2018-12-18 10:52:29 -08:00
Billie Rinaldi c5c73182e5 YARN-9072. Send exit command to terminate docker exec on connection close. Contributed by Eric Yang 2018-12-18 10:06:33 -08:00
Bharat Viswanadham 99b5061265 HDDS-914. Add Grafana support to ozoneperf docker container. Contributed by Dinesh Chitlangia. 2018-12-18 09:59:13 -08:00
Shashikant Banerjee b51e9e4317 HDDS-912. Update ozone to latest ratis snapshot build (0.4.0-3b0be02-SNAPSHOT). Contributed by Lokesh Jain. 2018-12-18 18:21:17 +05:30
Shashikant Banerjee 4ff1c46d95 HDDS-925. Rename ChunkGroupOutputStream to KeyOutputStream and ChunkOutputStream to BlockOutputStream. Contributed by Shashikant Banerjee. 2018-12-18 18:03:46 +05:30
Shashikant Banerjee ee10ba26dd HDDS-539. Ozone datanode command ignores the invalid options. Contributed by Vinicius Higa Murakami. 2018-12-18 16:10:27 +05:30
Xiaoyu Yao 94b368f29f HDDS-99. Adding SCM Audit log. Contributed by Dinesh Chitlangia. 2018-12-17 15:40:22 -08:00
Anu Engineer 5426653819 HDDS-908: NPE in TestOzoneRpcClient.
Contributed by Ajay Kumar.
2018-12-17 12:18:47 -08:00
Eric Yang 71e0b0d800 YARN-9040. Fixed memory leak in LevelDBCacheTimelineStore and DBIterator.
Contributed by Tarun Parimi
2018-12-17 12:04:25 -05:00
Da Zhou 346c0c8aff
HADOOP-16004. ABFS: Convert 404 error response in AbfsInputStream and AbfsOutPutStream to FileNotFoundException.
Contributed by Da Zhou.
2018-12-17 11:15:20 +00:00
Da Zhou 62df60737c
HADOOP-15972 ABFS: reduce list page size to to 500.
Contributed by Da Zhou.

(cherry picked from commit d09dbcc8fb)
2018-12-17 11:10:22 +00:00
Da Zhou b2523d8100
HADOOP-15969. ABFS: getNamespaceEnabled can fail blocking user access thru ACLs.
Contributed by Da Zhou.
2018-12-17 11:04:40 +00:00
Surendra Singh Lilhore 788e7473a4 HDFS-14096. [SPS] : Add Support for Storage Policy Satisfier in ViewFs. Contributed by Ayush Saxena. 2018-12-17 11:24:57 +05:30
Vidura Mudalige 04c03476c9
YARN-9095. Removed Unused field from Resource: NUM_MANDATORY_RESOURCES
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-12-15 16:07:27 +09:00
Billie Rinaldi 4f622337ee YARN-9091. Improve terminal message when connection is refused. Contributed by Eric Yang 2018-12-14 19:55:50 -08:00
Billie Rinaldi 42297f7d99 YARN-8963. Add flag to disable interactive shell. Contributed by Eric Yang 2018-12-14 18:44:36 -08:00
Billie Rinaldi aab310978f YARN-9089. Add Terminal Link to Service component instance page for UI2. Contributed by Eric Yang 2018-12-14 18:38:03 -08:00
Gabor Bota 1ea29b7385
HADOOP-16000. Remove TLSv1 and SSLv2Hello from the default value of hadoop.ssl.enabled.protocols
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-12-15 10:53:52 +09:00
Akira Ajisaka 26e55d4ceb
YARN-9122. Add table of contents to YARN Service API document. Contributed by Zhankun Tang. 2018-12-15 10:29:47 +09:00
Eric Yang b2d7204ed0 YARN-9125. Fixed Carriage Return detection in Docker container launch command.
Contributed by Billie Rinaldi
2018-12-14 17:52:26 -05:00
Billie Rinaldi ca90b2480e YARN-9032. Support sh shell for interactive container shell at command line. Contributed by Eric Yang 2018-12-14 14:08:22 -08:00
Giovanni Matteo Fumarola 00d5e631b5 HDFS-14006. Refactor name node to allow different token verification implementations. Contributed by CR Hota. 2018-12-14 11:10:54 -08:00
Giovanni Matteo Fumarola f858f18554 HDFS-14088. RequestHedgingProxyProvider can throw NullPointerException when failover due to no lock on currentUsedProxy. Contributed by Yuxuan Wang. 2018-12-14 11:04:36 -08:00
Giovanni Matteo Fumarola cb3382f667 HDFS-14145. TestBlockStorageMovementAttemptedItems#testNoBlockMovementAttemptFinishedReportAdded fails sporadically in Trunk. Contributed by Ayush Saxena. 2018-12-14 10:59:02 -08:00
Zsolt Venczel aa12859890 HDFS-14121. Log message about the old hosts file format is misleading
(Contributed by Zsolt Venczel via Daniel Templeton)

Change-Id: I7ff548f6c82e0aeb08a7a50ca7c2c827db8726bb
2018-12-14 13:54:57 +01:00
Akira Ajisaka ca379e1c43
HDFS-13970. Use MultiMap for CacheManager Directives to simplify the code. Contributed by BELUGA BEHR. 2018-12-14 14:36:26 +09:00
Daniel Templeton 4aa0609fb0 HDFS-13985. Clearer error message for ReplicaNotFoundException
(Contributed by Adam Antal via Daniel Templeton)

Change-Id: I68ae7a5bedecbc204c161fc3b3ce8878fe5d493d
2018-12-13 16:21:45 +01:00
Mukul Kumar Singh 92d44b2ad0 HDDS-876. Add blockade tests for flaky network. Contributed by Nilotpal Nandi. 2018-12-13 13:35:40 +05:30
Akira Ajisaka e0d75088f2
MAPREDUCE-7170. Doc typo in PluggableShuffleAndPluggableSort.md. Contributed by Zhaohui Xin. 2018-12-13 16:26:25 +09:00
Billie Rinaldi 72e7c6a489 YARN-8962. Add ability to use interactive shell with normal yarn container. Contributed by Eric Yang 2018-12-12 18:18:57 -08:00
Wangda Tan 37eb919c59 YARN-8885. [DevicePlugin] Support NM APIs to query device resource allocation. (Zhankun Tang via wangda)
Change-Id: I2a9870709b512af1ac6c09c9701d0b3c0791ff32
2018-12-12 11:45:47 -08:00
Wangda Tan 9fba6cc247 YARN-9112. [Submarine] Support polling applicationId when it's not ready in cluster. (Zhankun Tang via wangda)
Change-Id: I73d73f3d631b28fb9866faa56571839b13824a97
2018-12-12 11:44:58 -08:00
Wangda Tan 61bdcb7b2b YARN-9015. [DevicePlugin] Add an interface for device plugin to provide customized scheduler. (Zhankun Tang via wangda)
Change-Id: Ib2e4ae47a6f29bb3082c1f8520cf5a52ca720979
2018-12-12 11:44:22 -08:00
Wangda Tan c771fe6e10 YARN-8714. [Submarine] Support files/tarballs to be localized for a training job. (Zhankun Tang via wangda)
Change-Id: I845131273e52a9d81dbc813ea6d4af06b205e334
2018-12-12 11:43:23 -08:00
Wangda Tan 8a5361116e YARN-9078. [Submarine] Clean up the code of CliUtils#parseResourcesString. (Zhankun Tang via wangda)
Change-Id: I21ac5757b6115d55ec3157ba25db1b65bc85a37b
2018-12-12 11:42:44 -08:00
Giovanni Matteo Fumarola 561b61cfb1 HDFS-14144. TestPred fails in Trunk. Contributed by Ayush Saxena. 2018-12-12 11:16:16 -08:00
Giovanni Matteo Fumarola 76efeacd5f HADOOP-15995. Add ldap.bind.password.alias in LdapGroupsMapping to distinguish aliases when using multiple providers through CompositeGroupsMapping. Contributed by Lukas Majercak. 2018-12-12 11:10:24 -08:00
Sean Mackrory 82b798581d HADOOP-15988. DynamoDBMetadataStore#innerGet should support empty directory flag when using authoritative listings. Contributed by Gabor Bota. 2018-12-12 09:30:13 -07:00
Márton Elek d44b37d7ac HDDS-889. MultipartUpload: Support uploading a part file in ozone. Contributed by Bharat Viswanadham. 2018-12-12 14:16:21 +01:00
Sunil G 5a03c8b9ba YARN-9114. [UI2] log service redirect url need to support user name. Contributed by Akhil PB 2018-12-12 14:19:49 +05:30