Commit Graph

22250 Commits

Author SHA1 Message Date
Elek, Márton 1fc359fc10 HDDS-1607. Create smoketest for non-secure mapreduce example (#869)
* HDDS-1607. Create smoketest for non-secure mapreduce example.

* remove hardcoded project version
2019-06-04 01:18:02 -05:00
Zhankun Tang 606061aa14 YARN-9595. FPGA plugin: NullPointerException in FpgaNodeResourceUpdateHandler.updateConfiguredResource(). Contributed by Peter Bacsko. 2019-06-04 09:56:59 +08:00
Mukul Kumar Singh 277e9a835b Opening of rocksDB in datanode fails with "No locks available"
Signed-off-by: Nanda kumar <nanda@apache.org>
2019-06-04 02:12:44 +05:30
avijayanhwx 21de9af903 HDDS-1625 : ConcurrentModificationException when SCM has containers of different owners. (#883) 2019-06-04 01:15:04 +05:30
Shashikant Banerjee f3271126fc HDDS-1558. IllegalArgumentException while processing container Reports.
Signed-off-by: Nanda kumar <nanda@apache.org>
2019-06-04 00:59:02 +05:30
Weiwei Yang bd2590d71b YARN-9580. Fulfilled reservation information in assignment is lost when transferring in ParentQueue#assignContainers. Contributed by Tao Yang. 2019-06-03 22:59:02 +08:00
Sunil G 59719dc560 YARN-8906. [UI2] NM hostnames not displayed correctly in Node Heatmap Chart. Contributed by Akhil PB. 2019-06-03 15:53:23 +05:30
Sunil G 7f46dda513 YARN-8947. [UI2] Active User info missing from UI2. Contributed by Akhil PB. 2019-06-03 12:24:35 +05:30
Márton Elek 2a97a37d9e
Revert "HDDS-1597. Remove hdds-server-scm dependency from ozone-common. (#860)"
This reverts commit baee71551d.
2019-06-03 08:34:19 +02:00
Weiwei Yang 4530f4500d YARN-9507. Fix NPE in NodeManager#serviceStop on startup failure. Contributed by Bilwa S T. 2019-06-03 14:09:37 +08:00
Sunil G 2185249481 Preparing for submarine-0.3.0 development 2019-06-03 10:41:25 +05:30
Sunil G 08363db093 SUBMARINE-87. Add an apache rat check script for submarine. Contributed by Zhankun Tang. 2019-06-03 09:41:17 +05:30
Giovanni Matteo Fumarola 2210897609 YARN-9592. Use Logger format in ContainersMonitorImpl. Contributed by Inigo Goiri. 2019-05-31 17:35:49 -07:00
Ajay Yadav c1d2d92187 HDDS-1540. Implement addAcl,removeAcl,setAcl,getAcl for Bucket. Contributed by Ajay Kumar. (#874) 2019-05-31 14:08:28 -07:00
Eric Yang 4cb559ea7b YARN-9027. Fixed LevelDBCacheTimelineStore initialization.
Contributed by Prabhu Joseph
2019-05-31 14:31:44 -04:00
Márton Elek 1ae062c818
HDDS-1382. Create customized CSI server for Ozone
Closes #693
2019-05-31 13:35:58 +02:00
Sunil G 52128e352a YARN-9543. [UI2] Handle ATSv2 server down or failures cases gracefully in YARN UI v2. Contributed by Zoltan Siegl and Akhil P B. 2019-05-31 12:29:44 +05:30
Sunil G e49162f4b3 YARN-9545. Create healthcheck REST endpoint for ATSv2. Contributed by Zoltan Siegl. 2019-05-31 10:28:09 +05:30
Sunil G 7861a5eb1a YARN-9033. ResourceHandlerChain#bootstrap is invoked twice during NM start if LinuxContainerExecutor enabled. Contributed by Zhankun Tang. 2019-05-31 10:22:26 +05:30
Takanobu Asanuma 35f1014b3e HDFS-13654. Use a random secret when a secret file doesn't exist in HttpFS. This should be default. 2019-05-31 10:29:24 +09:00
Xiaoyu Yao 219e286722
HDDS-1608. Support Ozone Prefix ACLs in OM metadata table. Contributed by Xiaoyu Yao. (#875) 2019-05-30 16:44:38 -07:00
Kihwal Lee 9122b9b649 HDFS-14521. Suppress setReplication logging. Contributed by Kihwal Lee 2019-05-30 17:28:45 -05:00
Bharat Viswanadham c965f7f499
HDDS-1551. Implement Bucket Write Requests to use Cache and DoubleBuffer. (#850) 2019-05-30 15:28:15 -07:00
He Xiaoqiao 33c62f8f4e HDFS-14497. Write lock held by metasave impact following RPC processing. Contributed by He Xiaoqiao.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-05-30 13:30:35 -07:00
Shweta Yakkali 6f5a36c13c HADOOP-13656. fs -expunge to take a filesystem. Contributed by Shweta.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-05-30 13:21:58 -07:00
Giovanni Matteo Fumarola f1552f6edb YARN-9553. Fix NPE in EntityGroupFSTimelineStore#getEntityTimelines. Contributed by Prabhu Joseph. 2019-05-30 11:42:27 -07:00
Sunil G 30c6dd92e1 YARN-9452. Fix TestDistributedShell and TestTimelineAuthFilterForV2 failures. Contributed by Prabhu Joseph. 2019-05-30 22:32:41 +05:30
Elek, Márton baee71551d HDDS-1597. Remove hdds-server-scm dependency from ozone-common. (#860) 2019-05-30 09:20:16 -07:00
avijayanhwx 33419a980a HDDS-1568 : Add RocksDB metrics to OM. Contributed by Aravindan Vijayan 2019-05-30 08:48:14 -07:00
dineshchitlangia 0b907bc0e8 HDDS-1581. Atleast one of the metadata dir config property must be tagged as REQUIRED. 2019-05-30 08:39:19 -07:00
Márton Elek 1b041d4fd4
HDDS-1497. Refactor blockade Tests. Contributed by Nilotpal Nandi. 2019-05-30 16:46:06 +02:00
Shashikant Banerjee 8c8cb2d6aa HDDS-1502. Fix the compilation issue with commit 18c1eebc08. 2019-05-30 18:44:22 +05:30
Shashikant Banerjee 18c1eebc08 HDDS-1502. Add metrics for Ozone Ratis performance.Contributed by Shashikant Banerjee(#833). 2019-05-30 16:17:45 +05:30
Zhankun Tang 2b303e9d5f SUBMARINE-86. Bump TonY version to pick up a docker related fix & Update documentation. Contributed by Keqiu Hu. 2019-05-30 16:25:37 +08:00
Ajay Yadav 12be6ff2ff HDDS-1539. Implement addAcl,removeAcl,setAcl,getAcl for Volume. Contributed Ajay Kumar. (#847) 2019-05-29 23:18:06 -07:00
Wanqiang Ji d23e8e9232
HADOOP-16334. Fix yetus-wrapper not working when HADOOP_YETUS_VERSION >= 0.9.0
This closes #864

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2019-05-30 15:11:05 +09:00
Ayush Saxena c1caab40f2 HDFS-14512. ONE_SSD policy will be violated while write data with DistributedFileSystem.create(....favoredNodes). Contributed by Ayush Saxena.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-05-29 20:56:38 -07:00
Xudong Cao 9ad7cad205 HDDS-1530. Freon support big files larger than 2GB and add --bufferSize and --validateWrites options. Contributed by Xudong Cao. (#830) 2019-05-29 15:57:48 -07:00
Xiaoyu Yao 0ead2090a6 HDDS-1542. Create Radix tree to support ozone prefix ACLs. Contributed by Xiaoyu Yao. 2019-05-29 22:39:27 +02:00
Bharat Viswanadham 751f0df710 HDDS-1231. Add ChillMode metrics. Contributed by Bharat Viswanadham. 2019-05-29 20:55:44 +02:00
Ahmed Hussein abf76ac371 YARN-9563. Resource report REST API could return NaN or Inf (Ahmed Hussein via jeagles)
Signed-off-by: Jonathan Eagles <jeagles@gmail.com>
2019-05-29 11:24:08 -05:00
Eric E Payne 3c63551101 YARN-8625. Aggregate Resource Allocation for each job is not present in ATS. Contributed by Prabhu Joseph. 2019-05-29 16:05:39 +00:00
Weiwei Yang 544876fe12 YARN-8693. Add signalToContainer REST API for RMWebServices. Contributed by Tao Yang. 2019-05-29 16:34:48 +08:00
Akira Ajisaka afd844059c HADOOP-16331. Fix ASF License check in pom.xml
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
2019-05-29 17:25:13 +09:00
supratimdeka 346c2b7980 HDDS-1559. Include committedBytes to determine Out of Space in VolumeChoosingPolicy. Contributed by Supratim Deka (#841) 2019-05-28 20:48:14 -07:00
Xiaoyu Yao 7f2e87a419
HDDS-1604. ContainerReader#initializeUsedBytes leaks DB reference. Co… (#866) 2019-05-28 18:39:23 -07:00
Steve Loughran 0c73dba3a6
HADOOP-16332. Remove S3A dependency on http core.
Contributed by Steve Loughran.

Change-Id: I53209c993a405fefdb5e1b692d5a56d027d3b845
2019-05-28 22:50:37 +01:00
Elek, Márton 79d14d0d42 HDDS-1341. TestContainerReplication#testContainerReplication fails intermittently. Contributed by Elek, Marton. (#862) 2019-05-28 14:40:45 -07:00
Eric Yang d78854b928 HDFS-14434. Ignore user.name query parameter in secure WebHDFS.
Contributed by KWON BYUNGCHANG
2019-05-28 17:31:35 -04:00
Xiaoyu Yao fb0b39f4bf
HDDS-1536. testSCMSafeModeRestrictedOp is failing consistently. Contributed by Xiaoyu Yao. (#865) 2019-05-28 14:02:36 -07:00