Commit Graph

22285 Commits

Author SHA1 Message Date
supratimdeka 9d6842501c HDDS-1454. GC other system pause events can trigger pipeline destroy for all the nodes in the cluster. Contributed by Supratim Deka (#852) 2019-06-19 20:11:16 +05:30
Wei-Chiu Chuang d3ac516665 Revert "HDFS-13287. TestINodeFile#testGetBlockType results in NPE when run alone. Contributed by Virajith Jalaparti."
This reverts commit a1c3868c4f.
2019-06-19 06:27:02 -07:00
Wei-Chiu Chuang 48e564f7e2 HDFS-14537. Journaled Edits Cache is not cleared when formatting the JN. Contributed by Ranith Sardar. 2019-06-18 22:28:21 -07:00
Virajith Jalaparti a1c3868c4f HDFS-13287. TestINodeFile#testGetBlockType results in NPE when run alone. Contributed by Virajith Jalaparti.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-06-18 22:17:49 -07:00
Bharat Viswanadham f9ee97de98
HDFS-14398. Update HAState.java to fix typos. Contributed by Nikhil Navadiya. 2019-06-18 21:58:37 -07:00
Hanisha Koneru 2dfa932818
HDDS-1684. OM should create Ratis related dirs only if ratis is enabled (#965) 2019-06-18 16:08:48 -07:00
Vivek Ratnavel Subramanian 37bd5bb342 HDDS-1702. Optimize Ozone Recon build time (#982) 2019-06-18 14:44:23 -07:00
Elek, Marton 81ec909411 HDFS-14078. Admin helper fails to prettify NullPointerExceptions. Contributed by Elek, Marton.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-06-18 12:01:26 -07:00
avijayanhwx 71edfce187 HDDS-1699. Update RocksDB version to 6.0.1 (#980) 2019-06-18 11:13:13 -07:00
Eric Yang b14f0569bb YARN-9574. Update hadoop-yarn-applications-mawo artifactId to match directory name.
Contributed by Wanqiang Ji

(cherry picked from commit 5f758a69ede8fafd214857a74f5d3b46198094c4)
2019-06-18 13:51:12 -04:00
Shweta Yakkali 3c1a1ceea9 HDFS-14487. Missing Space in Client Error Message (Contributed by Shweta Yakkali via Daniel Templeton)
Change-Id: I0f8ce74a35ab24fe94fd0e57d8247bb3fa575e6f
2019-06-18 10:21:22 -07:00
Inigo Goiri 3ab77d9bc9 HDFS-14201. Ability to disallow safemode NN to become active. Contributed by Xiao Liang and He Xiaoqiao. 2019-06-18 09:58:29 -07:00
Vivek Ratnavel Subramanian fb1ce0d50a HDDS-1670. Add limit support to /api/containers and /api/containers/{id} endpoints (#954) 2019-06-18 08:51:16 -07:00
Wei-Chiu Chuang 335c1c9938 HDFS-14010. Pass correct DF usage to ReservedSpaceCalculator builder. Contributed by Virajith Jalaparti. 2019-06-18 00:35:48 -07:00
Márton Elek e188bb12b0
HDDS-1694. TestNodeReportHandler is failing with NPE
Closes #978
2019-06-18 08:55:38 +02:00
Shweta Yakkali dd4a7633ec HADOOP-16156. [Clean-up] Remove NULL check before instanceof and fix checkstyle in InnerNodeImpl. Contributed by Shweta Yakkali.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-06-17 23:47:57 -07:00
Oleg Danilov 54cdde38c7 HDFS-12314. Typo in the TestDataNodeHotSwapVolumes.testAddOneNewVolume(). Contributed by Oleg Danilov. 2019-06-17 23:11:25 -07:00
Oleg Danilov d41310a15d HDFS-12315. Use Path instead of String to check closedFiles set. Contributed by Oleg Danilov. 2019-06-17 23:06:02 -07:00
Adam Antal 56c621c68f HADOOP-15914. hadoop jar command has no help argument. Contributed by Adam Antal.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-06-17 22:56:00 -07:00
Wanqiang Ji eb6be4643f YARN-9630. [UI2] Add a link in docs's top page
Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>
2019-06-18 14:54:21 +09:00
Wei-Chiu Chuang 098c325a78 HDFS-14340. Lower the log level when can't get postOpAttr. Contributed by Anuhan Torgonshar. 2019-06-17 22:45:52 -07:00
Wei-Chiu Chuang f1c239c6a4 HADOOP-9157. Better option for curl in hadoop-auth-examples. Contributed by Andras Bokor. 2019-06-17 21:51:33 -07:00
Weiwei Yang e3172221ea HDFS-12770. Add doc about how to disable client socket cache. Contributed by Weiwei Yang.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-06-17 21:48:16 -07:00
Zhankun Tang 67414a1a80 YARN-9584. Should put initializeProcessTrees method call before get pid. Contributed by Wanqiang Ji. 2019-06-18 12:23:52 +08:00
Wei-Chiu Chuang 62ad9885ea HDFS-13730. BlockReaderRemote.sendReadResult throws NPE. Contributed by Yuanbo Liu. 2019-06-17 20:18:53 -07:00
Wei-Chiu Chuang 10311c30b0 HADOOP-14807. should prevent the possibility of NPE about ReconfigurableBase.java. Contributed by hu xiaodong. 2019-06-17 19:55:56 -07:00
Wei-Chiu Chuang 1e92db5a1e HDFS-11949. Add testcase for ensuring that FsShell cann't move file to the target directory that file exists. Contributed by legend. 2019-06-17 18:29:34 -07:00
Akira Ajisaka a95e87d827 HDFS-11950. Disable libhdfs zerocopy test on Mac. Contributed by Akira Ajisaka.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-06-17 17:03:25 -07:00
Santosh Marella 6822193ee6 HDFS-12914. Block report leases cause missing blocks until next report. Contributed by Santosh Marella, He Xiaoqiao.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Co-authored-by: He Xiaoqiao <hexiaoqiao@apache.org>
2019-06-17 16:20:30 -07:00
Wei-Chiu Chuang 7314185c4a Revert "HDFS-12914. Block report leases cause missing blocks until next report. Contributed by Santosh Marella, He Xiaoqiao."
This reverts commit ae4143a529.
2019-06-17 16:18:48 -07:00
Wei-Chiu Chuang a50c35bb81 Revert "HDFS-12914. Addendum patch. Block report leases cause missing blocks until next report. Contributed by Santosh Marella, He Xiaoqiao."
This reverts commit cdc5de6448.
2019-06-17 16:18:37 -07:00
Wei-Chiu Chuang f9a7b442fd HDFS-14465. When the Block expected replications is larger than the number of DataNodes, entering maintenance will never exit. Contributed by Yicong Cai. 2019-06-17 15:18:17 -07:00
Xudong Cao 3d020e914f HDDS-1532. Improve the concurrent testing framework of Freon. (#957) 2019-06-17 11:09:05 -07:00
S O'Donnell 22b36dd311
HDDS-1660. Use Picocli for Ozone Manager
Closes #925
2019-06-17 14:13:50 +02:00
Zhankun Tang 304a47e22c YARN-9608. DecommissioningNodesWatcher should get lists of running applications on node from RMNode. Contributed by Abhishek Modi. 2019-06-17 17:09:56 +08:00
Bharat Viswanadham ba681bb80e
HDDS-1692. RDBTable#iterator should disabled caching of the keys during iterator. (#975) 2019-06-16 22:00:39 -07:00
mpicker90 cc1630288e HDFS-14556: Spelling Mistake "gloablly" (#938) 2019-06-16 18:32:42 -07:00
Da Zhou 1da09bd9d5
HADOOP-16376. ABFS: Override access() to no-op.
Contributed by Da Zhou.

Change-Id: Ia0024bba32250189a87eb6247808b2473c331ed0
2019-06-16 19:20:46 +01:00
Gabor Bota f9cc9e1621
HADOOP-16279. S3Guard: Implement time-based (TTL) expiry for entries (and tombstones).
Contributed by Gabor Bota.

Change-Id: I73a2d2861901dedfe7a0e783b310fbb95e7c1af9
2019-06-16 17:05:01 +01:00
Bharat Viswanadham e70aeb4d7e
HDDS-1601. Implement updating lastAppliedIndex after buffer flush to OM DB. (#972) 2019-06-15 13:47:07 -07:00
Adam Antal 8370a0ae16 HDFS-14203. Refactor OIV Delimited output entry building mechanism. Contributed by Adam Antal.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-06-15 06:47:10 -07:00
cxorm 076618677d HADOOP-16336. finish variable is unused in ZStandardCompressor. Contributed by cxorm. 2019-06-14 20:05:20 -07:00
Eric Yang cda9f33745 YARN-8499 ATSv2 Generalize TimelineStorageMonitor.
Contributed by Prabhu Joseph
2019-06-14 18:59:14 -04:00
dineshchitlangia c7554ffd5c HADOOP-16373. Fix typo in FileSystemShell#test documentation (#968) 2019-06-14 14:36:04 -07:00
Giovanni Matteo Fumarola b24efa11ea HDFS-14549. EditLogTailer shouldn't output full stack trace when interrupted. Contributed by Inigo Goiri. 2019-06-14 13:37:23 -07:00
Santosh Marella cdc5de6448 HDFS-12914. Addendum patch. Block report leases cause missing blocks until next report. Contributed by Santosh Marella, He Xiaoqiao.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Co-authored-by: He Xiaoqiao <hexiaoqiao@apache.org>
2019-06-14 13:01:39 -07:00
Santosh Marella ae4143a529 HDFS-12914. Block report leases cause missing blocks until next report. Contributed by Santosh Marella, He Xiaoqiao.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Co-authored-by: He Xiaoqiao <hexiaoqiao@apache.org>
2019-06-14 10:42:54 -07:00
Eric Yang 3ba090f436 HADOOP-16366. Fixed ProxyUserAuthenticationFilterInitializer for timeline server.
Contributed by Prabhu Joseph
2019-06-14 12:54:16 -04:00
dineshchitlangia 9ebbda342f
HADOOP-16372. Fix typo in DFSUtil getHttpPolicy method
Closes #967
2019-06-14 16:09:37 +02:00
Inigo Goiri 4f455290b1 HDFS-14560. Allow block replication parameters to be refreshable. Contributed by Stephen O'Donnell. 2019-06-13 18:26:53 -07:00