Commit Graph

21808 Commits

Author SHA1 Message Date
Eric Yang accb811e57 YARN-6929. Improved partition algorithm for yarn remote-app-log-dir.
Contributed by Prabhu Joseph
2019-04-30 17:04:59 -04:00
Márton Elek dead9b4049
HDDS-1384. TestBlockOutputStreamWithFailures is failing
Closes #750
2019-04-30 14:27:39 +02:00
Ben Roling 0af4011580
HADOOP-16221. S3Guard: add option to fail operation on metadata write failure. 2019-04-30 11:53:26 +01:00
Zhankun Tang 7fbaa7d66f YARN-9476. [YARN-9473] Create unit tests for VE plugin. Contributed by Peter Bacsko. 2019-04-30 11:06:44 +08:00
Zhankun Tang 24f218aef8 SUBMARINE-64. Improve TonY runtime's document. Contributed by Keqiu Hu. 2019-04-30 10:54:25 +08:00
Ajay Kumar 382a962d8d
Revert "HDDS-973. HDDS/Ozone fail to build on Windows."
This reverts commit 5dae1a0c66.
2019-04-29 19:46:20 -07:00
Arpit Agarwal 4b4200f1f8
HDFS-13677. Dynamic refresh Disk configuration results in overwriting VolumeMap. Contributed by xuzq. 2019-04-29 14:49:35 -07:00
Ajay Yadav 95790bb7e5
HDDS-1430. NPE if secure ozone if KMS uri is not defined. Contributed by Ajay Kumar. (#752) 2019-04-29 14:07:23 -07:00
Elek, Márton 59816dff94 HDDS-1462. Fix content and format of Ozone documentation. Contributed by Elek, Marton. (#767) 2019-04-29 13:28:19 -07:00
Siddharth 5bca062d0e HDDS-1476. Fix logIfNeeded logic in EndPointStateMachine. (#779) 2019-04-29 12:05:38 -07:00
Xiaoyu Yao a96d16a843
HDDS-1455. Inconsistent naming convention with Ozone Kerberos configuration. Contributed by Xiaoyu Yao. (#762) 2019-04-29 11:18:11 -07:00
Ajay Yadav dbce729b24 HDDS-1472. Add retry to kinit command in smoketests. Contributed by Ajay Kumar. (#778) 2019-04-29 07:46:01 -07:00
Da Zhou 1cef194a28
HADOOP-16242. ABFS: add bufferpool to AbfsOutputStream.
Contributed by Da Zhou.
2019-04-29 13:27:28 +01:00
Ajay Yadav b434f558ca
HDDS-1471. Update ratis dependency to 0.3.0. Contributed by Ajay Kumar. (#777) 2019-04-28 20:57:59 -07:00
Bharat Viswanadham 43b2a4b77b
HDDS-1456. Stop the datanode, when any datanode statemachine state is… (#769) 2019-04-26 14:25:34 -07:00
Hanisha Koneru 37582705fa
HDDS-1403. KeyOutputStream writes fails after max retries while writing to a closed container (#753) 2019-04-26 10:39:03 -07:00
Lokesh Jain 556eafd01a
HDDS-1460: Add the optmizations of HDDS-1300 to BasicOzoneFileSystem (#765) 2019-04-26 17:29:50 +05:30
Siddharth Wagle c35abcd831
HDDS-999. Make the DNS resolution in OzoneManager more resilient
Closes #758
2019-04-26 12:38:24 +02:00
Eric Badger 79d3d35398 YARN-9486. Docker container exited with failure does not get clean up correctly. Contributed by Eric Yang 2019-04-26 01:21:28 +00:00
Zhankun Tang b5dcf64f97 SUBMARINE-44. Upgrade Docker image's tensorflow version to 1.13.1. Contributed by Zac Zhou. 2019-04-25 17:58:26 +08:00
Zhankun Tang 0b3d41bdee SUBMARINE-54. Add test coverage for YarnServiceJobSubmitter and make it ready for extension for PyTorch. Contributed by Szilard Nemeth. 2019-04-25 12:52:24 +08:00
Akira Ajisaka afe6613ee6
MAPREDUCE-7200. Remove stale eclipse templates. Contributed by Wanqiang Ji. 2019-04-25 11:18:39 +09:00
Sean Mackrory a703dae25e HADOOP-16222. Fix new deprecations after guava 27.0 update in trunk. Contributed by Gabor Bota. 2019-04-24 10:39:00 -06:00
Ben Roling e1c5ddf2aa
HADOOP-16252. Add prefix to dynamo tables in tests.
Contributed by Ben Roling.
2019-04-24 14:55:58 +01:00
Eric Yang e95c055d91
HDDS-1457. Sequence of configuring Ozone File System instruction needs some work. Contributed by Eric Yang. 2019-04-24 15:52:51 +02:00
Kitti Nanasi 3f787cd506
HDDS-1192. Support -conf command line argument in GenericCli
Closes #713
2019-04-24 15:34:49 +02:00
Xiaoyu Yao 64f30da428 HDDS-1450. Fix nightly run failures after HDDS-976. Contributed by Xiaoyu Yao. (#757) 2019-04-23 21:38:23 -07:00
Giovanni Matteo Fumarola 3f2f4186f6 YARN-9424. Change getDeclaredMethods to getMethods in FederationClientInterceptor#invokeConcurrent. Contributed by Shen Yinjie. 2019-04-23 19:58:41 -07:00
Akira Ajisaka 9d400627c2 YARN-9081. Update jackson from 1.9.13 to 2.x in hadoop-yarn-services-core.
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
2019-04-24 09:50:25 +09:00
Giovanni Matteo Fumarola fec9bf4b0b YARN-9501. TestCapacitySchedulerOvercommit#testReducePreemptAndCancel fails intermittent. Contributed by Prabhu Joseph. 2019-04-23 15:42:56 -07:00
Giovanni Matteo Fumarola 4a0ba24959 YARN-9491. TestApplicationMasterServiceFair#ApplicationMasterServiceTestBase.testUpdateTrackingUrl fails intermittent. Contributed by Prabhu Joseph. 2019-04-23 15:27:04 -07:00
Inigo Goiri c504eee0c2 YARN-9339. Apps pending metric incorrect after moving app to a new queue. Contributed by Abhishek Modi. 2019-04-23 12:40:44 -07:00
Siddharth 59ded7641f HDDS-1411. Add unit test to check if SCM correctly sends close commands for containers in closing state after a restart. (#755) 2019-04-23 21:04:14 +05:30
Nanda kumar 7e1f8d3a1b
HDDS-1368. Cleanup old ReplicationManager code from SCM. 2019-04-23 17:35:39 +05:30
Zhankun Tang 8a95ea61e1 YARN-9475. [YARN-9473] Create basic VE plugin. Contributed by Peter Bacsko. 2019-04-23 17:33:58 +08:00
Zhankun Tang e79a9c12c1 SUBMARINE-40. Add TonY runtime to Submarine. Contributed by Keqiu Hu. 2019-04-23 15:45:42 +08:00
Weiwei Yang 1c8046d67e YARN-9325. TestQueueManagementDynamicEditPolicy fails intermittent. Contributed by Prabhu Joseph. 2019-04-23 14:21:13 +08:00
Anu Engineer f4ab9370f5 HADOOP-16026:Replace incorrect use of system property user.name.
Contributed by Dinesh Chitlangia.
2019-04-22 14:02:13 -07:00
Eric Yang a54c1e3ace YARN-8551. Project setup for MaWo application.
Contributed by Yesha Vora
2019-04-22 16:56:26 -04:00
Inigo Goiri fb1c549139 HDFS-14374. Expose total number of delegation tokens in AbstractDelegationTokenSecretManager. Contributed by CR Hota. 2019-04-22 13:32:08 -07:00
Erik Krogen 174b7d3126 HDFS-14435. [SBN Read] Enable ObserverReadProxyProvider to gracefully handle StandbyException when fetching HAServiceState. Contributed by Erik Krogen. 2019-04-22 13:29:56 -07:00
Inigo Goiri 5321235fe8 HDFS-14445. TestTrySendErrorReportWhenNNThrowsIOException fails in trunk. Contributed by Ayush Saxena. 2019-04-22 13:23:42 -07:00
Inigo Goiri 96e3027e46 YARN-2889. Limit the number of opportunistic container allocated per AM heartbeat. Contributed by Abhishek Modi. 2019-04-22 09:49:03 -07:00
Erik Krogen 1ddb48872f HADOOP-16265. Fix bug causing Configuration#getTimeDuration to use incorrect units when the default value is used. Contributed by starphin. 2019-04-22 08:16:57 -07:00
Weiwei Yang adefd37105 YARN-9495. Fix findbugs warnings in hadoop-yarn-server-resourcemanager module. Contributed by Tao Yang. 2019-04-20 21:51:00 +08:00
Billie Rinaldi 317fcbabe3 YARN-9254. Add support for storing application catalog data to HDFS. Contributed by Eric Yang 2019-04-19 10:29:57 -07:00
Inigo Goiri aeadb9432f YARN-9448. Fix Opportunistic Scheduling for node local allocations. Contributed by Abhishek Modi. 2019-04-19 09:41:06 -07:00
Chen, Junjie 518f47bf9b HDDS-976: Parse network topology from yaml file. Contributed by Junjie Chen. (#661)
Signed-off-by: Xiaoyu Yao <xyao@apache.org>
2019-04-18 16:53:25 -07:00
Eric Yang ef97a20831 YARN-8622. Fixed container-executor compilation on MacOSX.
Contributed by Siyao Meng
2019-04-18 18:59:21 -04:00
Eric Yang df76cdc895 YARN-6695. Fixed NPE in publishing appFinished events to ATSv2.
Contributed by Prabhu Joseph
2019-04-18 12:29:37 -04:00