Commit Graph

19252 Commits

Author SHA1 Message Date
Haibo Chen 86bc6425d4 YARN-8191. Fair scheduler: queue deletion without RM restart. (Gergo Repas via Haibo Chen) 2018-05-24 17:12:34 -07:00
Eric Yang d9852eb589 YARN-8357. Fixed NPE when YARN service is saved and not deployed.
Contributed by Chandni Singh
2018-05-24 16:32:13 -04:00
Eric Yang 7ff5a40218 YARN-8316. Improved diagnostic message for ATS unavailability for YARN Service.
Contributed by Billie Rinaldi
2018-05-24 16:26:02 -04:00
Xiaoyu Yao 2d19e7d08f HDDS-80. Remove SendContainerCommand from SCM. Contributed by Nanda Kumar. 2018-05-24 11:10:30 -07:00
Andrew Wang c9b63deb53 HDFS-13611. Unsafe use of Text as a ConcurrentHashMap key in PBHelperClient. 2018-05-24 09:56:23 -07:00
Shane Kumpf 1388de18ad YARN-6919. Add default volume mount list. Contributed by Eric Badger 2018-05-24 09:30:39 -06:00
Mukul Kumar Singh 774daa8d53 HDDS-45. Removal of old OzoneRestClient. Contributed by Lokesh Jain. 2018-05-24 15:53:42 +05:30
Rohith Sharma K S c05b5d424b YARN-8319. More YARN pages need to honor yarn.resourcemanager.display.per-user-apps. Contributed by Sunil G. 2018-05-24 14:19:46 +05:30
Rohith Sharma K S 4cc0c9b0ba YARN-8346. Upgrading to 3.1 kills running containers with error 'Opportunistic container queue is full'. Contributed by Jason Lowe. 2018-05-24 12:23:47 +05:30
Yiqun Lin 7a87add4ea HDFS-13598. Reduce unnecessary byte-to-string transform operation in INodesInPath#toString. Contributed by Gabor Bota. 2018-05-24 10:57:35 +08:00
Haibo Chen d996479954 YARN-4599. Set OOM control for memory cgroups. (Miklos Szegedi via Haibo Chen) 2018-05-23 16:35:37 -07:00
Inigo Goiri f09dc73001 YARN-8327. Fix TestAggregatedLogFormat#testReadAcontainerLogs1 on Windows. Contributed by Giovanni Matteo Fumarola. 2018-05-23 15:59:30 -07:00
Inigo Goiri d72615611c YARN-8348. Incorrect and missing AfterClass in HBase-tests to fix NPE failures. Contributed by Giovanni Matteo Fumarola. 2018-05-23 14:43:59 -07:00
Inigo Goiri e99e5bf104 YARN-8344. Missing nm.stop() in TestNodeManagerResync to fix testKillContainersOnResync. Contributed by Giovanni Matteo Fumarola. 2018-05-23 14:15:26 -07:00
Inigo Goiri cddbbe5f69 HDFS-13493. Reduce the HttpServer2 thread count on DataNodes. Contributed by Erik Krogen. 2018-05-23 12:12:08 -07:00
Inigo Goiri e30938af12 YARN-8336. Fix potential connection leak in SchedConfCLI and YarnWebServiceUtils. Contributed by Giovanni Matteo Fumarola. 2018-05-23 11:55:31 -07:00
Inigo Goiri c13dea87d9 HDFS-13587. TestQuorumJournalManager fails on Windows. Contributed by Anbang Hu. 2018-05-23 11:36:03 -07:00
Arpit Agarwal 51ce02bb54 HADOOP-15486. Make NetworkTopology#netLock fair. Contributed by Nanda kumar. 2018-05-23 10:30:12 -07:00
Robert Kanter aa23d49fc8 HADOOP-15457. Add Security-Related HTTP Response Header in WEBUIs. (kanwaljeets via rkanter) 2018-05-23 10:24:09 -07:00
Bharat Viswanadham bc6d9d4c79 HDFS-13589: Add dfsAdmin command to query if upgrade is finalized. Contributed by Hanisha Koneru 2018-05-23 10:15:40 -07:00
Anu Engineer 699a6918ac HDDS-110. Checkstyle is not working in the HDDS precommit hook.
Contributed by Elek, Marton.
2018-05-23 10:01:53 -07:00
Inigo Goiri c0c9b7a8ef HDFS-13588. Fix TestFsDatasetImpl test failures on Windows. Contributed by Xiao Liang. 2018-05-23 09:46:35 -07:00
Anu Engineer e83b943fed HDDS-44. Ozone: start-ozone.sh fail to start datanode because of incomplete classpaths.
Contributed by Mukul Kumar Singh.
2018-05-23 09:29:35 -07:00
Mukul Kumar Singh 63fc5873ce HDDS-84. The root directory of ozone.tar.gz should contain the version string. Contributed by Elek, Marton. 2018-05-23 21:07:37 +05:30
Rohith Sharma K S f61e3e752e YARN-8297. Incorrect ATS Url used for Wire encrypted cluster.(addendum). Contributed by Sunil G. 2018-05-23 18:31:03 +05:30
Shane Kumpf 9837ca9cc7 YARN-8285. Remove unused environment variables from the Docker runtime. Contributed by Eric Badger 2018-05-23 06:43:44 -06:00
Sammi Chen 34e8b9f9a8 HDFS-13540. DFSStripedInputStream should only allocate new buffers when reading. Contributed by Xiao Chen. 2018-05-23 19:10:09 +08:00
Mukul Kumar Singh fed2bef647 HDDS-85. Send Container State Info while sending the container report from Datanode to SCM. Contributed by Shashikant Banerjee. 2018-05-23 14:15:35 +05:30
Akira Ajisaka 745f203e57
Additional check when unpacking archives. Contributed by Jason Lowe and Akira Ajisaka. 2018-05-23 17:16:23 +09:00
Andrew Wang 1d2640b613 HDFS-13601. Optimize ByteString conversions in PBHelper. 2018-05-22 23:55:20 -07:00
Anu Engineer 5a9140690a HDDS-49. Standalone protocol should use grpc in place of netty.
Contributed by Mukul Kumar Singh.
2018-05-22 19:56:15 -07:00
Miklos Szegedi 3e5f7ea986 YARN-8310. Handle old NMTokenIdentifier, AMRMTokenIdentifier, and ContainerTokenIdentifier formats. Contributed by Robert Kanter. 2018-05-22 18:10:33 -07:00
Xiaoyu Yao 68c7fd8e60 HDDS-79. Remove ReportState from SCMHeartbeatRequestProto. Contributed by Nanda kumar. 2018-05-22 15:46:59 -07:00
Anu Engineer 43be9ab44f HDDS-89. Addendum Patch-1. Create ozone specific inline documentation as part of the build.
Contributed by Elek, Marton.
2018-05-22 14:29:06 -07:00
Robert Kanter b22f56c471 YARN-8273. Log aggregation does not warn if HDFS quota in target directory is exceeded (grepas via rkanter) 2018-05-22 14:24:38 -07:00
Wangda Tan 83f53e5c62 YARN-8332. Incorrect min/max allocation property name in resource types doc. (Weiwei Yang via wangda)
Change-Id: If74f1ceed9c045a2cb2d6593741278b65ac44a9f
2018-05-22 13:33:33 -07:00
Wangda Tan bd15d2396e YARN-8290. SystemMetricsPublisher.appACLsUpdated should be invoked after application information is published to ATS to avoid "User is not set in the application report" Exception. (Eric Yang via wangda)
Change-Id: I0ac6ddd19740d1aa7dd07111cd11af71ddc2fcaf
2018-05-22 13:33:33 -07:00
Anu Engineer 523f602f81 HDDS-89. Addendum Patch. Create ozone specific inline documentation as part of the build
Contributed by Elek, Marton.
2018-05-22 13:20:42 -07:00
Anu Engineer 60821fb20e HDDS-74. Rename name of properties related to configuration tags.
Contributed by Sandeep Nemuri.
2018-05-22 11:38:11 -07:00
Anu Engineer 481bfdb94f HDDS-89. Create ozone specific inline documentation as part of the build.
Contributed by Elek, Marton.
2018-05-22 10:49:10 -07:00
Eric Yang 6176d2b35c YARN-7960. Added security flag no-new-privileges for YARN Docker integration.
Contributed by Eric Badger
2018-05-22 13:44:58 -04:00
Kihwal Lee bcc8e76bad HADOOP-15450. Avoid fsync storm triggered by DiskChecker and handle disk full situation. Contributed by Arpit Agarwal. 2018-05-22 11:20:51 -05:00
Jason Lowe 5f11288e41 YARN-8206. Sending a kill does not immediately kill docker containers. Contributed by Eric Badger 2018-05-22 09:27:08 -05:00
Mukul Kumar Singh 57c2feb0d3 HADOOP-15474. Rename properties introduced for <tags>. Contributed by Zsolt Venczel. 2018-05-22 13:33:31 +05:30
Xiaoyu Yao 5e88126776 HDDS-82. Merge ContainerData and ContainerStatus classes. Contributed by Bharat Viswanadham. 2018-05-21 16:09:24 -07:00
Eric E Payne 0b4c44bdee YARN-8179: Preemption does not happen due to natural_termination_factor when DRF is used. Contributed by Kyungwan Nam. 2018-05-21 20:14:58 +00:00
Mukul Kumar Singh 132a547dea HDDS-71. Send ContainerType to Datanode during container creation. Contributed by Bharat Viswanadham. 2018-05-21 23:08:20 +05:30
Rushabh Shah 73e9120ad7 Skip the proxy user check if the ugi has not been initialized. Contributed by Daryn Sharp 2018-05-21 12:33:00 -05:00
Haibo Chen f48fec83d0 YARN-8248. Job hangs when a job requests a resource that its queue does not have. (Szilard Nemeth via Haibo Chen) 2018-05-21 08:10:41 -07:00
Bharat Viswanadham 3d2d9dbcaa HDDS-87:Fix test failures with uninitialized storageLocation field in storageReport Contributed by Shashikant Banerjee 2018-05-21 08:01:51 -07:00