Commit Graph

22615 Commits

Author SHA1 Message Date
Vivek Ratnavel Subramanian ef2da40a70
HDDS-1640. Reduce the size of recon jar file
Closes #907
2019-06-05 07:51:23 +02:00
Zhankun Tang cd17cc2868 SUBMARINE-89. Add submarine-src profile to generate source package. Contributed by Sunil Govindan. 2019-06-05 10:44:44 +08:00
Sunil G 96d818a2f7 SUBMARINE-88. rat.sh regex pattern not working issue while using lower version of grep in ubuntu16.04. Contributed by Zhankun Tang. 2019-06-05 07:48:24 +05:30
Wanqiang Ji e7e30a5f8b
MAPREDUCE-7210. Replace `mapreduce.job.counters.limit` with `mapreduce.job.counters.max` in mapred-default.xml
This closes #878

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2019-06-05 10:45:23 +09:00
Eric Yang d45669cd3c YARN-7537. Add ability to load hbase config from distributed file system.
Contributed by Prabhu Joseph
2019-06-04 19:26:06 -04:00
avijayanhwx 1a78794227 HDDS-1624 : Refactor operations inside the bucket lock in OM key write. (#882) 2019-06-04 15:41:37 -07:00
Bharat Viswanadham 580b639908
HDDS-1600. Add userName and IPAddress as part of OMRequest. (#857) 2019-06-04 12:31:44 -07:00
Elek, Márton 97607f3dce HDDS-1510. Classpath files are deployed to the maven repository as pom/jar files. Contributed by Elek, Marton. (#900) 2019-06-04 10:38:37 -07:00
bshashikant e4b4fec66f HDDS-1224. Restructure code to validate the response from server in the Read path (#806) 2019-06-04 10:37:02 -07:00
huzheng ea3b0a1844 HDFS-14535. The default 8KB buffer in requestFileDescriptors#BufferedOutputStream is causing lots of heap allocation in HBase when using short-circut read 2019-06-04 08:48:05 -07:00
Steve Loughran 827a84778a
HADOOP-16266. Add more fine-grained processing time metrics to the RPC layer -follow-on patch.
This follow-on patch to HADOOP-16266 fixes up the problem where logs were being full of
stack traces because the timeout passed down to select was in nanos, whereas the API
expected millis.

Contributed by Erik Krogen.

Change-Id: I5c6e9ddf68127b1d7e0ca0e179d036eb9941e445
2019-06-04 15:56:47 +01:00
Elek, Márton 50909a7aa0 HDDS-1641. Csi server fails because transitive Netty dependencies (#906) 2019-06-04 09:18:15 -05:00
Zhankun Tang 799115967d SUBMARINE-82. Fix english grammar mistakes in documentation. Contributed by Szilard Nemeth. 2019-06-04 14:44:37 +08:00
Elek, Márton 5d5081eff8 HDDS-1631. Fix auditparser smoketests (#892) 2019-06-04 01:30:43 -05:00
Elek, Márton e140a45046 HDDS-1629. Tar file creation can be optional for non-dist builds. Contributed by Elek, Marton. (#887) 2019-06-04 01:20:45 -05:00
Elek, Márton 1fc359fc10 HDDS-1607. Create smoketest for non-secure mapreduce example (#869)
* HDDS-1607. Create smoketest for non-secure mapreduce example.

* remove hardcoded project version
2019-06-04 01:18:02 -05:00
Zhankun Tang 606061aa14 YARN-9595. FPGA plugin: NullPointerException in FpgaNodeResourceUpdateHandler.updateConfiguredResource(). Contributed by Peter Bacsko. 2019-06-04 09:56:59 +08:00
Mukul Kumar Singh 277e9a835b Opening of rocksDB in datanode fails with "No locks available"
Signed-off-by: Nanda kumar <nanda@apache.org>
2019-06-04 02:12:44 +05:30
avijayanhwx 21de9af903 HDDS-1625 : ConcurrentModificationException when SCM has containers of different owners. (#883) 2019-06-04 01:15:04 +05:30
Shashikant Banerjee f3271126fc HDDS-1558. IllegalArgumentException while processing container Reports.
Signed-off-by: Nanda kumar <nanda@apache.org>
2019-06-04 00:59:02 +05:30
Weiwei Yang bd2590d71b YARN-9580. Fulfilled reservation information in assignment is lost when transferring in ParentQueue#assignContainers. Contributed by Tao Yang. 2019-06-03 22:59:02 +08:00
Sunil G 59719dc560 YARN-8906. [UI2] NM hostnames not displayed correctly in Node Heatmap Chart. Contributed by Akhil PB. 2019-06-03 15:53:23 +05:30
Sunil G 7f46dda513 YARN-8947. [UI2] Active User info missing from UI2. Contributed by Akhil PB. 2019-06-03 12:24:35 +05:30
Márton Elek 2a97a37d9e
Revert "HDDS-1597. Remove hdds-server-scm dependency from ozone-common. (#860)"
This reverts commit baee71551d.
2019-06-03 08:34:19 +02:00
Weiwei Yang 4530f4500d YARN-9507. Fix NPE in NodeManager#serviceStop on startup failure. Contributed by Bilwa S T. 2019-06-03 14:09:37 +08:00
Sunil G 2185249481 Preparing for submarine-0.3.0 development 2019-06-03 10:41:25 +05:30
Sunil G 08363db093 SUBMARINE-87. Add an apache rat check script for submarine. Contributed by Zhankun Tang. 2019-06-03 09:41:17 +05:30
Giovanni Matteo Fumarola 2210897609 YARN-9592. Use Logger format in ContainersMonitorImpl. Contributed by Inigo Goiri. 2019-05-31 17:35:49 -07:00
Ajay Yadav c1d2d92187 HDDS-1540. Implement addAcl,removeAcl,setAcl,getAcl for Bucket. Contributed by Ajay Kumar. (#874) 2019-05-31 14:08:28 -07:00
Eric Yang 4cb559ea7b YARN-9027. Fixed LevelDBCacheTimelineStore initialization.
Contributed by Prabhu Joseph
2019-05-31 14:31:44 -04:00
Márton Elek 1ae062c818
HDDS-1382. Create customized CSI server for Ozone
Closes #693
2019-05-31 13:35:58 +02:00
Sunil G 52128e352a YARN-9543. [UI2] Handle ATSv2 server down or failures cases gracefully in YARN UI v2. Contributed by Zoltan Siegl and Akhil P B. 2019-05-31 12:29:44 +05:30
Sunil G e49162f4b3 YARN-9545. Create healthcheck REST endpoint for ATSv2. Contributed by Zoltan Siegl. 2019-05-31 10:28:09 +05:30
Sunil G 7861a5eb1a YARN-9033. ResourceHandlerChain#bootstrap is invoked twice during NM start if LinuxContainerExecutor enabled. Contributed by Zhankun Tang. 2019-05-31 10:22:26 +05:30
Takanobu Asanuma 35f1014b3e HDFS-13654. Use a random secret when a secret file doesn't exist in HttpFS. This should be default. 2019-05-31 10:29:24 +09:00
Xiaoyu Yao 219e286722
HDDS-1608. Support Ozone Prefix ACLs in OM metadata table. Contributed by Xiaoyu Yao. (#875) 2019-05-30 16:44:38 -07:00
Kihwal Lee 9122b9b649 HDFS-14521. Suppress setReplication logging. Contributed by Kihwal Lee 2019-05-30 17:28:45 -05:00
Bharat Viswanadham c965f7f499
HDDS-1551. Implement Bucket Write Requests to use Cache and DoubleBuffer. (#850) 2019-05-30 15:28:15 -07:00
He Xiaoqiao 33c62f8f4e HDFS-14497. Write lock held by metasave impact following RPC processing. Contributed by He Xiaoqiao.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-05-30 13:30:35 -07:00
Shweta Yakkali 6f5a36c13c HADOOP-13656. fs -expunge to take a filesystem. Contributed by Shweta.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-05-30 13:21:58 -07:00
Giovanni Matteo Fumarola f1552f6edb YARN-9553. Fix NPE in EntityGroupFSTimelineStore#getEntityTimelines. Contributed by Prabhu Joseph. 2019-05-30 11:42:27 -07:00
Sunil G 30c6dd92e1 YARN-9452. Fix TestDistributedShell and TestTimelineAuthFilterForV2 failures. Contributed by Prabhu Joseph. 2019-05-30 22:32:41 +05:30
Elek, Márton baee71551d HDDS-1597. Remove hdds-server-scm dependency from ozone-common. (#860) 2019-05-30 09:20:16 -07:00
avijayanhwx 33419a980a HDDS-1568 : Add RocksDB metrics to OM. Contributed by Aravindan Vijayan 2019-05-30 08:48:14 -07:00
dineshchitlangia 0b907bc0e8 HDDS-1581. Atleast one of the metadata dir config property must be tagged as REQUIRED. 2019-05-30 08:39:19 -07:00
Márton Elek 1b041d4fd4
HDDS-1497. Refactor blockade Tests. Contributed by Nilotpal Nandi. 2019-05-30 16:46:06 +02:00
Shashikant Banerjee 8c8cb2d6aa HDDS-1502. Fix the compilation issue with commit 18c1eebc08. 2019-05-30 18:44:22 +05:30
Shashikant Banerjee 18c1eebc08 HDDS-1502. Add metrics for Ozone Ratis performance.Contributed by Shashikant Banerjee(#833). 2019-05-30 16:17:45 +05:30
Zhankun Tang 2b303e9d5f SUBMARINE-86. Bump TonY version to pick up a docker related fix & Update documentation. Contributed by Keqiu Hu. 2019-05-30 16:25:37 +08:00
Ajay Yadav 12be6ff2ff HDDS-1539. Implement addAcl,removeAcl,setAcl,getAcl for Volume. Contributed Ajay Kumar. (#847) 2019-05-29 23:18:06 -07:00