Commit Graph

19323 Commits

Author SHA1 Message Date
Bharat Viswanadham 998e2850a3 HDDS-155:Implement KeyValueContainer and adopt new disk layout for the containers. Contributed by Bharat Viswanadham 2018-06-14 20:54:54 -07:00
Hanisha Koneru 9a5552bf76 HDDS-156. Implement HDDSVolume to manage volume state 2018-06-14 13:28:41 -07:00
Arpit Agarwal 418cff4820 Merge remote-tracking branch 'apache-commit/trunk' into HDDS-48 2018-06-14 09:38:20 -07:00
Rohith Sharma K S 9119b3cf8f YARN-8155. Improve ATSv2 client logging in RM and NM publisher. Contributed by Abhishek Modi. 2018-06-14 12:38:10 +05:30
Anu Engineer ddd09d59f3 HDDS-163. Add Datanode heartbeat dispatcher in SCM.
Contributed by Nandakumar.
2018-06-13 20:18:22 -07:00
Anu Engineer 7547740e5c HDDS-161. Add functionality to queue ContainerClose command from SCM Heartbeat Response to Ratis.
Contributed by Shashikant Banerjee.
2018-06-13 18:48:59 -07:00
Eric Yang 22994889dc YARN-8259. Improve privileged docker container liveliness checks.
Contributed by Shane Kumpf
2018-06-13 19:24:31 -04:00
Eric Yang 69b0596897 YARN-8411. Restart stopped system service during RM start.
Contributed by Billie Rinaldi
2018-06-13 19:05:52 -04:00
Xiaoyu Yao 7566e0ec5f HDDS-159. RestClient: Implement list operations for volume, bucket and keys. Contributed by Lokesh Jain. 2018-06-13 11:43:18 -07:00
Anu Engineer 43baa036ae HDDS-109. Add reconnect logic for XceiverClientGrpc.
Contributed by Lokesh Jain.
2018-06-13 09:50:10 -07:00
Yiqun Lin 8e7548d33b HDFS-13641. Add metrics for edit log tailing. Contributed by Chao Sun. 2018-06-13 20:05:55 +08:00
Sunil G 6307962b93 YARN-8404. Timeline event publish need to be async to avoid Dispatcher thread leak in case ATS is down. Contributed by Rohith Sharma K S 2018-06-13 16:09:16 +05:30
Jitendra Pandey f4c7c91123 HADOOP-15483. Upgrade jquery to version 3.3.1. Contributed by Lokesh Jain, Mukul Kumar Singh and Sunil Govindan. 2018-06-13 00:36:02 -07:00
Weiwei Yang 29024a6203 YARN-8394. Improve data locality documentation for Capacity Scheduler. Contributed by Weiwei Yang. 2018-06-13 09:28:05 +08:00
Eric Yang 108da85320 HADOOP-15527. Improve delay check for stopping processes.
Contributed by Vinod Kumar Vavilapalli
2018-06-12 20:40:32 -04:00
Arun Suresh 5670e89b2e MAPREDUCE-7101. Add config parameter to allow JHS to alway scan user dir irrespective of modTime. (Thomas Marquardt via asuresh) 2018-06-12 15:36:52 -07:00
Inigo Goiri aeaf9fec62 HADOOP-15532. TestBasicDiskValidator fails with NoSuchFileException. Contributed by Giovanni Matteo Fumarola. 2018-06-12 14:16:14 -07:00
Gera Shegalov 04b74eddc6 MAPREDUCE-7108. TestFileOutputCommitter fails on Windows. (Zuoming Zhang via gera) 2018-06-12 11:21:51 -07:00
Xiao Chen a16623df21 HADOOP-15307. NFS: flavor AUTH_SYS should use VerifierNone. Contributed by Gabor Bota. 2018-06-12 11:16:24 -07:00
Inigo Goiri c35481594f YARN-8422. TestAMSimulator failing with NPE. Contributed by Giovanni Matteo Fumarola. 2018-06-12 10:59:50 -07:00
Inigo Goiri 6e756e8a62 HADOOP-15529. ContainerLaunch#testInvalidEnvVariableSubstitutionType is not supported in Windows. Contributed by Giovanni Matteo Fumarola. 2018-06-12 10:24:34 -07:00
Haibo Chen 10d0e4be6e YARN-8325. Miscellaneous QueueManager code clean up. (Szilard Nemeth via Haibo Chen) 2018-06-12 10:11:30 -07:00
Haibo Chen 24a89825f0 YARN-6931. Make the aggregation interval in AppLevelTimelineCollector configurable. (Abhishek Modi via Haibo Chen) 2018-06-12 10:03:34 -07:00
Xiaoyu Yao e9ea902299 HDDS-130. TestGenerateOzoneRequiredConfigurations should use GenericTestUtils#getTempPath to set output directory. Contributed by Sandeep Nemuri. 2018-06-12 09:03:55 -07:00
Akira Ajisaka 652bcbb3e4
YARN-8363. Upgrade commons-lang version to 3.7 in hadoop-yarn-project. Contributed by Takanobu Asanuma. 2018-06-13 00:35:37 +09:00
Anu Engineer 5c7ad52573 HDDS-111. Include tests for Rest Client in TestVolume and TestBucket.
Contributed by Lokesh Jain.
2018-06-12 08:25:18 -07:00
Mukul Kumar Singh aa7614c5f3 HDDS-158. DatanodeStateMachine endPoint task throws NullPointerException. Contributed by Nanda Kumar. 2018-06-12 20:36:23 +05:30
Sunil G b3612dd90c YARN-8419. [UI2] User cannot submit a new service as submit button is always disabled. Contributed by Suma Shivaprasad. 2018-06-12 17:40:41 +05:30
Rohith Sharma K S 95303f50d3 YARN-8413. Flow activity page is failing with 'Timeline server failed with an error'. Contributed by Sunil Govindan. 2018-06-12 17:14:22 +05:30
Rohith Sharma K S 2df73dace0 YARN-8405. RM zk-state-store.parent-path ACLs has been changed since HADOOP-14773. Contributed by Íñigo Goiri. 2018-06-12 17:13:09 +05:30
Inigo Goiri 2b2f672022 YARN-8370. Some Node Manager tests fail on Windows due to improper path/file separator. Contributed by Anbang Hu. 2018-06-11 19:25:56 -07:00
Xiaoyu Yao 23bfd9f7e4 HDDS-72. Add deleteTransactionId field in ContainerInfo. Contributed by Lokesh Jain. 2018-06-11 16:02:32 -07:00
Yongjun Zhang 7c3dc39083 Update CHANGES, RELEASENOTES, and jdiff for 3.0.3 release.
(cherry picked from commit 5a82f10e32)
2018-06-11 15:13:18 -07:00
Bharat Viswanadham 7e228e54c5 HDDS-136:Rename dbPath,containerFilePath. Contributed by Bharat Viswanadham 2018-06-11 13:14:03 -07:00
Hanisha Koneru 0e437f9b17 Revert "Create Version File in Datanode. Contributed by Bharat Viswanadham."
This reverts commit f26d3466d7.
2018-06-11 12:15:39 -07:00
Inigo Goiri 2e5cfe6df3 HDFS-13653. Make dfs.client.failover.random.order a per nameservice configuration. Contributed by Ekanth Sethuramalingam. 2018-06-11 11:20:29 -07:00
Haibo Chen 180b3c960b YARN-8321. AllocationFileLoaderService.getAllocationFile() should be declared as VisibleForTest. (Szilard Nemeth via Haibo Chen) 2018-06-11 11:19:33 -07:00
Haibo Chen 676dcffff5 YARN-8322. Change log level when there is an IOException when the allocation file is loaded. (Szilard Nemeth via Haibo Chen) 2018-06-11 11:16:21 -07:00
Haibo Chen c190ac2be8 YARN-8323. FairScheduler.allocConf should be declared as volatile. (Szilard Nemeth via Haibo Chen) 2018-06-11 11:12:44 -07:00
Bharat Viswanadham 143dd560bf HDDS-133:Change format of .container files to Yaml. Contributed by Bharat Viswanadham 2018-06-11 09:04:54 -07:00
Sammi Chen 18201b882a HADOOP-15499. Performance severe drops when running RawErasureCoderBenchmark with NativeRSRawErasureCoder. Contributed by Sammi Chen. 2018-06-11 13:53:37 +08:00
Bharat Viswanadham ccfb816d39 HDFS-13667:Typo: Marking all datandoes as stale. Contributed by Nanda Kumar 2018-06-09 16:43:03 -07:00
Steve Loughran ef0118b91e
HADOOP-15520. Add tests for various org.apache.hadoop.util classes.
Contributed by Arash Nabili
2018-06-09 15:33:38 +01:00
Arpit Agarwal 000a678396 HDFS-12670. can't renew HDFS tokens with only the hdfs client jar. Contributed by Arpit Agarwal. 2018-06-08 17:57:12 -07:00
Chao Sun fba1c42adc HDFS-13664. Refactor ConfiguredFailoverProxyProvider to make inheritance easier. Contributed by Chao Sun. 2018-06-08 16:36:42 -07:00
Xiao Chen cf4108313d HDFS-13642. Creating a file with block size smaller than EC policy's cell size should fail. 2018-06-08 15:14:11 -07:00
Anu Engineer a1272448bf HDDS-157. Upgrade common-langs version to 3.7 in HDDS and Ozone.
Contributed by Takanobu Asanuma.
2018-06-08 10:27:01 -07:00
Jitendra Pandey c42dcc7c47 HADOOP-15482. Upgrade jackson-databind to version 2.9.5. Contributed by Lokesh Jain. 2018-06-07 23:00:26 -07:00
Inigo Goiri 3b88fe25ba YARN-8359. Exclude containermanager.linux test classes on Windows. Contributed by Jason Lowe. 2018-06-07 17:13:03 -07:00
Robert Kanter 351cf87c92 Disable mounting cgroups by default (miklos.szegedi@cloudera.com via rkanter) 2018-06-07 17:09:34 -07:00