Commit Graph

21500 Commits

Author SHA1 Message Date
Suma Shivaprasad a106d2dc9d YARN-8783. Improve the documentation for the docker.trusted.registries configuration. Contributed by Eric Yang. 2019-02-26 10:19:06 -08:00
Abhishek Modi 52b2eab575
HADOOP-16093. Move DurationInfo from hadoop-aws to hadoop-common org.apache.hadoop.util.
Contributed by Abhishek Modi
2019-02-26 17:10:41 +00:00
Da Zhou 3988e75ca3
HADOOP-16136. ABFS: Should only transform username to short name
Contributed by Da Zhou.
2019-02-26 15:37:24 +00:00
Márton Elek 585cebf26b
HDDS-1104. Use picocli with Ozone genesis tool. Contributed by Lokesh Jain. 2019-02-26 16:11:55 +01:00
Xiaoyu Yao 9e0f3d1c52 HDDS-1038. Support Service Level Authorization for Ozone. Contributed by Xiaoyu Yao and Ajay Kumar. 2019-02-26 06:02:10 -08:00
Surendra Singh Lilhore 59ba3552d3 HDFS-14299. ViewFs: Correct error message for read only operations. Contributed by hu xiaodong. 2019-02-26 12:40:32 +05:30
Weiwei Yang c6ea28c480 YARN-9331. [YARN-8851] Fix a bug that lacking cgroup initialization when bootstrap DeviceResourceHandlerImpl. Contributed by Zhankun Tang. 2019-02-26 10:05:31 +08:00
Konstantin V Shvachko a6ab37192a HDFS-14130. [SBN read] Make ZKFC ObserverNode aware. Contributed by xiangheng and Konstantin Shvachko. 2019-02-25 14:35:02 -08:00
Anu Engineer 9de34d2990 HDDS-1151. Propagate the tracing id in ScmBlockLocationProtocol.
Contributed by Elek, Marton.
2019-02-25 13:50:37 -08:00
Inigo Goiri ba4e7bd192 HADOOP-16125. Support multiple bind users in LdapGroupsMapping. Contributed by Lukas Majercak. 2019-02-25 13:39:13 -08:00
Tsz Wo Nicholas Sze 0edb0c51dc HADOOP-16126. ipc.Client.stop() may sleep too long to wait for all connections. 2019-02-25 13:15:28 -08:00
Giovanni Matteo Fumarola 95372657fc YARN-9287. Consecutive StringBuilder append should be reuse. Contributed by Ayush Saxena. 2019-02-25 11:45:37 -08:00
Vinayakumar B f4ae00c530 HDFS-7133. Support clearing namespace quota on '/'. Contributed by Ayush Saxena." 2019-02-26 00:36:14 +05:30
Weiwei Yang 3e1739d589 YARN-9329. updatePriority is blocked when using FairScheduler. Contributed by Jiandan Yang. 2019-02-26 00:08:13 +08:00
Sunil G 6cec90653d YARN-9168. DistributedShell client timeout should be -1 by default. Contributed by Zhankun Tang. 2019-02-25 15:28:45 +05:30
Márton Elek a5eb7ce651
HDDS-1170. Fix the FindBugs issue in OzoneClientAdapterFactory. Contributed by Anu Engineer. 2019-02-25 10:41:43 +01:00
Sunil G 5e91ebd91a YARN-9121. Replace GpuDiscoverer.getInstance() to a readable object for easy access control. Contributed by Szilard Nemeth. 2019-02-25 11:30:46 +05:30
Anu Engineer 92b1fdcece HDDS-1070. Adding Node and Pipeline related metrics in SCM.
Contributed by Nandakumar.
2019-02-24 15:39:41 -08:00
Anu Engineer 3aa0a57ea0 HDDS-1152. Add trace information for the client side of the datanode writes
Contributed by Elek, Marton.
2019-02-24 15:20:34 -08:00
Anu Engineer 5c1f946071 HDDS-1145. Add optional web server to the Ozone freon test tool.
Contributed by Elek, Marton.
2019-02-24 15:04:25 -08:00
Anu Engineer 416b730f34 HDDS-1115. Provide ozone specific top-level pom.xml.
Contributed by Elek, Marton.
2019-02-24 14:40:52 -08:00
Anu Engineer fc5c83b2ca HDDS-1090. Add a recipe to the ozone docs about using Spark, OzoneFS, and K8s.
Contributed by Elek, Marton.
2019-02-24 14:02:30 -08:00
Anu Engineer 236b105e41 HDDS-1089. Disable OzoneFSStorageStatistics for hadoop versions older than 2.8.
Contributed by Elek, Marton.
2019-02-24 13:53:38 -08:00
Anu Engineer d82014b70a HDDS-1149. Change the default ozone.client.checksum.type.
Contributed by Bharat Viswanadham.
2019-02-24 13:22:36 -08:00
Anu Engineer 8387bbdfb5 HDDS-1154. Add tracing to the client side of StorageContainerLocationProtocol and OzoneManagerProtocol.
Contributed by Elek, Marton.
2019-02-24 13:13:37 -08:00
Anu Engineer 021f8deef0 HDDS-1168.Use random ports in TestBlockManager and TestDeletedBlockLog.
Contributed by Nandakumar.
2019-02-24 12:36:03 -08:00
Weiwei Yang 9cd5c5447f YARN-9316. TestPlacementConstraintsUtil#testInterAppConstraintsByAppID fails intermittently. Contributed by Prabhu Joseph. 2019-02-24 22:42:27 +08:00
Weiwei Yang 50094d7fef YARN-9300. Lazy preemption should trigger an update on queue preemption metrics for CapacityScheduler. Contributed by Tao Yang. 2019-02-24 22:17:29 +08:00
Sunil G dddcfa4d9f YARN-8821. [YARN-8851] GPU hierarchy/topology scheduling support based on pluggable device framework. Contributed by Zhankun Tang. 2019-02-24 14:37:06 +05:30
Bharat Viswanadham 106bdc6c04
HDDS-1120. Add a config to disable checksum verification during read. 2019-02-23 21:37:55 -08:00
Anu Engineer 490206e4b4 HDDS-1155.Fix failing unit test methods of TestDeadNodeHandler.
Contributed by Nandakumar.
2019-02-23 21:13:47 -08:00
Anu Engineer c1e5b19212 HDDS-1147. Fix failing unit tests in TestOzoneManager.
Contributed by Nandakumar.
2019-02-23 20:56:24 -08:00
Anu Engineer fb546d1807 HDDS-1167. Error in hadoop-ozone/dev-support/checks/checkstyle.sh.
Contributed by Nandakumar.
2019-02-23 20:45:01 -08:00
Anu Engineer 014e17af78 HDDS-1166. Fix checkstyle line length issues.
Contributed by Nandakumar.
2019-02-23 20:31:39 -08:00
Bharat Viswanadham 1b87668a3b HDDS-1165. Document generation in maven should be configured on execution level. Contributed by Anu Engineer. 2019-02-23 10:44:46 -08:00
Hanisha Koneru d0e21ac16b HDDS-1158. TestOzoneManagerHA.testTwoOMNodesDown is failing with ratis error. 2019-02-23 10:20:28 -08:00
Yongjun Zhang f7a27cdee4 HDFS-14118. Support using DNS to resolve nameservices to IP addresses. Contributed by Fengnan Li. 2019-02-23 09:35:36 -08:00
Sahil Takiar f19c844e75 HDFS-14285. libhdfs hdfsRead copies entire array even if its only partially filled. Contributed by Sahil Takiar.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-02-22 17:54:32 -08:00
George Huang 9daf43c6fa HADOOP-16129. Misc. bug fixes for KMS Benchmark. Contributed by George Huang.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-02-22 17:52:09 -08:00
Eric Yang 05bce33d6e YARN-9244. Document docker registry deployment with direct S3 driver.
Contributed by Suma Shivaprasad
2019-02-22 19:13:52 -05:00
Erik Krogen bad3ffd290 HDFS-14279. [SBN read] Fix race condition in ObserverReadProxyProvider. Contributed by Erik Krogen. 2019-02-22 13:58:49 -08:00
Bharat Viswanadham 70579805c9 HDDS-1148. After allocating container, we are not adding to container DB. 2019-02-23 01:50:49 +05:30
Surendra Singh Lilhore 7d3b567194 HDFS-14298. Improve log messages of ECTopologyVerifier. Contributed by Kitti Nanasi. 2019-02-23 01:08:15 +05:30
bibinchundatt ed13cf8406 YARN-9317. Avoid repeated YarnConfiguration#timelineServiceV2Enabled check. Contributed by Prabhu Joseph 2019-02-22 21:01:34 +05:30
Sunil G 95fbbfed75 YARN-9118. Handle exceptions with parsing user defined GPU devices in GpuDiscoverer. Contributed by Szilard Nemeth. 2019-02-22 20:22:17 +05:30
Sunil G 9636fe4114 YARN-8891. Documentation of the pluggable device framework. Contributed by Zhankun Tang. 2019-02-22 20:00:13 +05:30
Weiwei Yang 9c88695bcd YARN-9238. Avoid allocating opportunistic containers to previous/removed/non-exist application attempt. Contributed by lujie. 2019-02-22 20:58:33 +08:00
Weiwei Yang 632d5e8a98 YARN-9156. Improve debug message in device plugin method compatibility check of ResourcePluginManager. Contributed by Zhankun Tang. 2019-02-22 11:27:30 +08:00
Elek, Márton 28d0bf9f67 HDDS-1161. Disable failing test which are tracked by a separated jira. Contributed by Elek, Marton. 2019-02-21 13:57:05 -08:00
Bharat Viswanadham d33f0666f6
HDDS-1141. Update DBCheckpointSnapshot to DBCheckpoint.
* HDDS-1141.Update DBCheckpointSnapshot to DBCheckpoint.

* fix test failures in TestOzoneConfigurationFields
2019-02-21 13:29:10 -08:00