Commit Graph

6432 Commits

Author SHA1 Message Date
Anu Engineer 167ab4df0d HDFS-11712. Ozone: Reuse ObjectMapper instance to improve the performance. Contributed by Yiqun Lin. 2017-05-03 14:25:41 -07:00
Mingliang Liu 83dded556d HDFS-11739. Fix regression in tests caused by YARN-679. Contributed by Steve Loughran 2017-05-03 11:22:44 -07:00
Weiwei Yang 6def74c6ca HDFS-11725. Ozone: Revise create container CLI specification and implementation. Contributed by Weiwei Yang 2017-05-03 11:21:15 +08:00
Erik Krogen d9014bda93 HDFS-11717. Add unit test for HDFS-11709 StandbyCheckpointer should handle non-existing legacyOivImageDir gracefully. Contributed by Erik Krogen. 2017-05-02 18:34:11 -07:00
Weiwei Yang 4b0f51306a HDFS-11728. Ozone: add the DB names to OzoneConsts. Contributed by Chen Liang. 2017-05-02 11:02:26 +08:00
Xiaoyu Yao 1058b40843 HDFS-11593. Change SimpleHttpProxyHandler#exceptionCaught log level from info to debug. Contributed by Xiaobing Zhou. 2017-05-01 16:12:51 -07:00
Kihwal Lee 4cfc866436 HDFS-11714. Newly added NN storage directory won't get initialized and cause space exhaustion. Contributed by Kihwal Lee. 2017-05-01 17:29:25 -05:00
Kihwal Lee 07b98e7830 HDFS-11609. Some blocks can be permanently lost if nodes are decommissioned while dead. Contributed by Kihwal Lee. 2017-05-01 14:19:02 -05:00
Anu Engineer c3f397eead HDFS-11675. Ozone: SCM CLI: Implement delete container command. Contributed by Weiwei Yang. 2017-05-01 09:26:35 -07:00
Lei Xu 19a7e94ee4 HDFS-11718. DFSStripedOutputStream hsync/hflush should not throw UnsupportedOperationException. (Manoj Govindassamy via lei)
Change-Id: I4cc226b80c64a0d900a3b1ce71e51f051cd29c22
2017-04-28 17:06:14 -07:00
Kai Zheng cb672a45a0 HDFS-11605. Allow user to customize new erasure code policies. Contributed by Huafeng Wang 2017-04-28 13:18:50 +08:00
Wei-Chiu Chuang bbf8cac14d HADOOP-13200. Implement customizable and configurable erasure coders. Contributed by Tim Yao. 2017-04-27 12:39:47 -07:00
Wei-Chiu Chuang ddaeb3e497 Revert "HADOOP-13200. Implement customizable and configurable erasure coders. Contributed by Tim Yao."
This reverts commit 872088c6e7.
2017-04-27 12:25:47 -07:00
Wei-Chiu Chuang 872088c6e7 HADOOP-13200. Implement customizable and configurable erasure coders. Contributed by Tim Yao. 2017-04-27 11:59:33 -07:00
Zhe Zhang d8a3309830 HDFS-11709. StandbyCheckpointer should handle an non-existing legacyOivImageDir gracefully. Contributed by Erik Krogen. 2017-04-27 09:50:30 -07:00
Konstantin V Shvachko 28eb2aabeb HDFS-11384. Balancer disperses getBlocks calls to avoid NameNode's rpc queue saturation. Contributed by Konstantin V Shvachko. 2017-04-26 17:28:49 -07:00
Chen Liang 50dd3a5cfa HDFS-11627. Block Storage: Cblock cache should register with flusher to upload blocks to containers. Contributed by Mukul Kumar Singh. 2017-04-26 10:36:56 -07:00
Akira Ajisaka 93fa48fcf2
HDFS-11417. Add datanode admin command to get the storage info. Contributed by Surendra Singh Lilhore. 2017-04-26 17:43:29 +09:00
Chris Douglas 2f73396b59 HDFS-6708. StorageType should be encoded in the block token. Contributed by Ewan Higgs 2017-04-25 23:57:00 -07:00
Xiaoyu Yao 4ea2778acb HADOOP-14207. "dfsadmin -refreshCallQueue" fails with DecayRpcScheduler. Contributed by Surendra Singh Lihore. 2017-04-25 18:45:56 -07:00
Jason Lowe e4321ec843 HDFS-11691. Add a proper scheme to the datanode links in NN web UI. Contributed by Kihwal Lee 2017-04-25 17:30:42 -05:00
Yongjun Zhang 20e3ae260b HDFS-11402. HDFS Snapshots should capture point-in-time copies of OPEN files. (Manoj Govindassamy via Yongjun Zhang) 2017-04-21 20:35:48 -07:00
Kai Zheng b0803388fc HDFS-11604. Define and parse erasure code policies. Contributed by Lin Zeng 2017-04-21 13:33:33 +08:00
Chen Liang eae8c2a469 HDFS-11667. Block Storage:Handling flushing of incomplete block id buffers during shutdown. Contributed by Mukul Kumar Singh. 2017-04-20 13:50:29 -07:00
Xiaoyu Yao a2c6f594ba HDFS-11668. Ozone: misc improvements for SCM CLI. Contributed by Weiwei Yang. 2017-04-20 11:32:13 -07:00
Yiqun Lin 9154d77ca8 HDFS-11666. Ozone: Fix compile error due to inconsistent package name. Contributed by Yiqun Lin. 2017-04-20 14:22:59 +08:00
Xiaoyu Yao 8ec13a397f HDFS-11504. Ozone: SCM: Add Block APIs. Contributed by Xiaoyu Yao. 2017-04-19 22:34:49 -07:00
Andrew Wang 74a723852d HDFS-11660. TestFsDatasetCache#testPageRounder fails intermittently with AssertionError. 2017-04-19 18:10:04 -07:00
Andrew Wang c1549352cf HDFS-11671. TestReconstructStripedBlocks#test2RecoveryTasksForSameBlockGroup fails. 2017-04-19 13:49:56 -07:00
Weiwei Yang 0bf416ac40 HDFS-11649. Ozone: SCM: CLI: Add shell code placeholder classes. Contributed by Chen Liang. 2017-04-19 11:43:14 +08:00
Anu Engineer d889437c27 HDFS-11658. Ozone: SCM daemon is unable to be started via CLI. Contributed by Weiwei Yang. 2017-04-17 19:09:11 -07:00
Anu Engineer 368424b465 HDFS-11581. Ozone: Support force delete a container. Contributed by Yuanbo Liu. 2017-04-17 17:58:54 -07:00
Konstantin V Shvachko 8dfcd95d58 HDFS-11634. Optimize BlockIterator when interating starts in the middle. Contributed by Konstantin V Shvachko. 2017-04-17 16:56:24 -07:00
Zhe Zhang ad49098eb3 HDFS-11615. FSNamesystemLock metrics can be inaccurate due to millisecond precision. Contributed by Erik Krogen. 2017-04-17 16:22:33 -07:00
Anu Engineer 350220bfb3 HDFS-11631. Block Storage : allow cblock server to be started from hdfs commandline. Contributed by Chen Liang. 2017-04-17 15:54:39 -07:00
Anu Engineer 49c92ea73d HDFS-11657. Ozone: Add unit test for storage container metrics. Contributed by Yiqun Lin. 2017-04-17 12:44:29 -07:00
Anu Engineer 1a418ef2c0 HDFS-11582. Block Storage : add SCSI target access daemon. Contributed by Chen Liang. 2017-04-13 13:25:53 -07:00
Anu Engineer 3231ead84b Merge branch 'trunk' into HDFS-7240 2017-04-12 16:36:41 -07:00
Anu Engineer 6556445792 HDFS-11569. Ozone: Implement listKey function for KeyManager. Contributed by Weiwei Yang. 2017-04-12 15:36:56 -07:00
Andrew Wang a7312715a6 HDFS-10996. Ability to specify per-file EC policy at create time. Contributed by SammiChen. 2017-04-12 12:27:34 -07:00
Andrew Wang 966b1b5b44 HDFS-11565. Use compact identifiers for built-in ECPolicies in HdfsFileStatus. 2017-04-12 12:24:32 -07:00
Chen Liang cedacf12c9 HDFS-11642. Block Storage: fix TestCBlockCLI and TestCBlockServerPersistence cleanup. Contributed by Xiaoyu Yao. 2017-04-12 12:09:10 -07:00
Anu Engineer abce613356 HDFS-11645. DataXceiver thread should log the actual error when getting InvalidMagicNumberException. Contributed by Chen Liang. 2017-04-12 11:40:58 -07:00
Kihwal Lee d4c01dde49 HDFS-11648. Lazy construct the IIP pathname. Contributed by Daryn Sharp. 2017-04-12 13:29:24 -05:00
Chen Liang f4dec00896 HDFS-11635. Block Storage: Add metrics for Container Flushes. Contributed by Mukul Kumar Singh. 2017-04-12 10:38:30 -07:00
Chris Nauroth 23b1a7bdf1 HDFS-11163. Mover should move the file blocks to default storage once policy is unset. Contributed by Surendra Singh Lilhore. 2017-04-11 22:03:09 -07:00
Hanisha Koneru 62e4573efb HDFS-11630. TestThrottledAsyncCheckerTimeout fails intermittently in Jenkins builds. Contributed by Hanisha Koneru. 2017-04-11 21:36:24 -07:00
Mingliang Liu 3a91376707 HDFS-11558. BPServiceActor thread name is too long. Contributed by Xiaobing Zhou 2017-04-11 15:29:38 -07:00
Xiaoyu Yao a2ff806d2e HDFS-11062. Ozone:SCM: Remove null command. Contributed by Yuanbo Liu. 2017-04-11 13:33:40 -07:00
Wei-Chiu Chuang f050afb578 HADOOP-13665. Erasure Coding codec should support fallback coder. Contributed by Kai Sasaki. 2017-04-11 07:32:13 -07:00
Yiqun Lin 2fd568fdd4 HDFS-11637. Fix javac warning caused by the deprecated key used in TestDFSClientRetries#testFailuresArePerOperation. Contributed by Yiqun Lin. 2017-04-11 19:40:09 +08:00
Chris Douglas a5e57df3c5 HADOOP-14225. Remove xmlenc dependency 2017-04-10 11:48:40 -07:00
Andrew Wang e8bdad7385 HDFS-11623. Move system erasure coding policies into hadoop-hdfs-client. 2017-04-07 16:46:28 -07:00
Andrew Wang 203edc026c HDFS-11633. FSImage failover disables all erasure coding policies. Contributed by Wei-Chiu Chuang. 2017-04-07 15:46:11 -07:00
Chen Liang 349a19b2ad HDFS-11618. Block Storage: Add Support for Direct I/O. Contributed by Mukul Kumar Singh. 2017-04-07 10:01:19 -07:00
Allen Wittenauer 96cbb4fce2 HADOOP-14202. fix jsvc/secure user var inconsistencies
Signed-off-by: John Zhuge <jzhuge@apache.org>
2017-04-07 08:59:21 -07:00
Xiaoyu Yao 0eacd4c13b HDFS-11608. HDFS write crashed with block size greater than 2 GB. Contributed by Xiaobing Zhou. 2017-04-06 16:11:55 -07:00
Xiaoyu Yao a49fac5302 HDFS-11362. StorageDirectory should initialize a non-null default StorageDirType. Contribute by Hanisha Koneru. 2017-04-06 14:33:16 -07:00
Arpit Agarwal 8c57aeb5b4 HDFS-11131. TestThrottledAsyncChecker#testCancellation is flaky. 2017-04-05 17:54:30 -07:00
Andrew Wang 539ef5aa2e HFDS-11596. hadoop-hdfs-client jar is in the wrong directory in release tarball. Contributed by Yuanbo Liu. 2017-04-05 16:04:09 -07:00
Xiaobing Zhou 3db8d68d63 HDFS-11628. Clarify the behavior of HDFS Mover in documentation. Contributed by Xiaobing Zhou. 2017-04-05 15:33:08 -07:00
Anu Engineer 7ce1090558 HDFS-11006. Ozone: support setting chunk size in streaming API. Contributed by Yiqun Lin. 2017-04-05 11:07:28 -07:00
Anu Engineer bc2c5d2d61 HDFS-11625. Ozone: Fix UT failures that caused by hard coded datanode data dirs. Contributed by Weiwei Yang. 2017-04-05 10:11:44 -07:00
Andrew Wang 9e0e430f18 HDFS-11538. Move ClientProtocol HA proxies into hadoop-hdfs-client. Contributed by Huafeng Wang. 2017-04-04 23:05:24 -07:00
Akira Ajisaka 8cb7325527
HDFS-9651. Add missing robots.txt files. 2017-04-05 12:47:45 +09:00
Akira Ajisaka 09e6caec3d
HDFS-9651. All web UIs should include a robots.txt file. Contributed by Lars Francke. 2017-04-05 12:45:28 +09:00
Andrew Wang 18432130a7 HADOOP-14104. Client should always ask namenode for kms provider path. Contributed by Rushabh S Shah. 2017-04-04 13:38:25 -07:00
Anu Engineer adc651044c Merge branch 'trunk' into HDFS-7240 2017-04-04 12:50:22 -07:00
Anu Engineer 38dddad74e HDFS-11620. Ozone: Allocate container for MiniOzone cluster fails because of insufficient space error. Contributed by Mukul Kumar Singh. 2017-04-04 10:09:40 -07:00
Anu Engineer 3bc2e1d992 HDFS-11619. Ozone: Unit tests running failed in Windows. Contributed by Yiqun Lin. 2017-04-04 09:57:56 -07:00
Chris Douglas 6eba79232f HADOOP-14271. Correct spelling of 'occurred' and variants. Contributed by Yeliang Cang 2017-04-03 20:13:14 -07:00
Anu Engineer ec4d25fc53 HDFS-11566. Ozone: Document missing metrics for container operations. Contributed by Yiqun Lin. 2017-04-03 15:01:23 -07:00
Anu Engineer 68eab679e3 HDFS-11564. Ozone: SCM: Add Comparable Metric Support. Contributed by Anu Engineer. 2017-04-03 13:33:11 -07:00
Anu Engineer 558b478ff2 HDFS-11519. Ozone: Implement XceiverServerSpi and XceiverClientSpi using Ratis. Contributed by Tsz Wo Nicholas Sze. 2017-04-03 12:40:06 -07:00
Wei-Chiu Chuang bbd68478d5 HDFS-11598. Improve -setrep for Erasure Coded files. Contributed by Yiqun Lin. 2017-04-03 07:57:28 -07:00
Wei-Chiu Chuang bc7aff7cec HDFS-11515. -du throws ConcurrentModificationException. Contributed by Istvan Fajth, Wei-Chiu Chuang. 2017-04-03 07:35:09 -07:00
Chen Liang d00c07c675 HDFS-11591. Block Storage: fix TestCBlockServer test cleanup. Contributed by Xiaoyu Yao 2017-03-31 14:41:05 -07:00
Hanisha Koneru 73835c73e2 HDFS-11560. Expose slow disks via NameNode JMX. Contributed by Hanisha Koneru. 2017-03-31 13:50:29 -07:00
Arpit Agarwal 5485d93bda HDFS-11603. Improve slow mirror/disk warnings in BlockReceiver. 2017-03-31 12:10:27 -07:00
Hanisha Koneru 28cdc5a8dc HDFS-11551. Handle SlowDiskReport from DataNode at the NameNode. Contributed by Hanisha Koneru. 2017-03-30 22:41:26 -07:00
Yongjun Zhang bf3fb585aa HADOOP-11794. Enable distcp to copy blocks in parallel. Contributed by Yongjun Zhang, Wei-Chiu Chuang, Xiao Chen, Rosie Li. 2017-03-30 17:38:56 -07:00
Yongjun Zhang 144f1cf765 Revert "HADOOP-11794. Enable distcp to copy blocks in parallel. Contributed by Yongjun Zhang, Wei-Chiu Chuang, Xiao Chen."
This reverts commit 064c8b25ec.
2017-03-30 17:38:18 -07:00
Yongjun Zhang 064c8b25ec HADOOP-11794. Enable distcp to copy blocks in parallel. Contributed by Yongjun Zhang, Wei-Chiu Chuang, Xiao Chen. 2017-03-30 17:01:15 -07:00
Anu Engineer fbfdf69904 HDFS-11594. Ozone: close container should call compactDB. Contributed by Anu Engineer. 2017-03-30 16:53:28 -07:00
Mingliang Liu e5f0622a6f HDFS-11592. Closing a file has a wasteful preconditions in NameNode. Contributed by Eric Badger 2017-03-30 15:44:21 -07:00
Wei-Chiu Chuang 8c591b8d19 HDFS-10974. Document replication factor for EC files. Contributed by Yiqun Lin. 2017-03-30 11:16:05 -07:00
Andrew Wang 4966a6e26e HADOOP-14223. Extend FileStatus#toString() to include details like Erasure Coding and Encryption. Contributed by Manoj Govindassamy. 2017-03-29 14:37:21 -07:00
Xiaoyu Yao 1590b9f7ea HDFS-11567. Ozone: SCM: Support update container. Contributed by Weiwei Yang. 2017-03-29 12:19:31 -07:00
Daniel Templeton 15e3873dc3 HDFS-11571. Typo in DataStorage exception message (Contributed by Anna Budai via Daniel Templeton) 2017-03-29 10:56:36 -07:00
Rakesh Radhakrishnan 84d787b9d5 HDFS-11541. Call RawErasureEncoder and RawErasureDecoder release() methods. Contributed by SammiChen. 2017-03-29 11:41:48 +05:30
Xiaoyu Yao 8617fda2c6 HDFS-11537. Block Storage : add cache layer. Contributed by Chen Liang. 2017-03-28 19:21:37 -07:00
Yiqun Lin 6b09336438 HDFS-11577. Combine the old and the new chooseRandom for better performance. Contributed by Chen Liang. 2017-03-28 23:02:07 +08:00
Anu Engineer 8f4d8c43f8 HDFS-11548. Ozone: SCM: Add node pool management API. Contributed by Xiaoyu Yao 2017-03-27 17:59:49 -07:00
Masatake Iwasaki 64ea62c1cc HDFS-11486. Client close() should not fail fast if the last block is being decommissioned. Contributed by Wei-Chiu Chuang and Yiqun Lin. 2017-03-28 09:13:44 +09:00
Anu Engineer 33dfb72fa3 HDFS-11355. Block Storage : Merge configuration into ozone configuration classes. Contributed by Chen Liang. 2017-03-27 15:26:13 -07:00
Anu Engineer ed14373a9f HDFS-11550. Ozone: Add a check to prevent removing a container that has keys in it. Contributed by Weiwei Yang. 2017-03-27 08:38:57 -07:00
Wei-Chiu Chuang 46d37a65cf HDFS-10506. Addendum patch to include missing changes. Contributed by Akira Ajisaka. 2017-03-27 05:23:45 -07:00
Yiqun Lin 96e2ab8144 HDFS-11555. Fix typos in class OfflineImageReconstructor. Contributed by Yiqun Lin. 2017-03-27 19:23:37 +08:00
Junping Du d174c06b01 Add HDFS jdiff for 2.8.0 release. 2017-03-25 14:05:20 -07:00
Tsuyoshi Ozawa 84ddedc0b2 HADOOP-10101. Update guava dependency to the latest version. (ozawa) 2017-03-25 10:06:52 +09:00
Hanisha Koneru 1f66524432 HDFS-11570. Unit test for NameNodeStatusMXBean. Contributed by Hanisha Koneru. 2017-03-24 14:44:25 -07:00
Xiaobing Zhou 1168ece596 HDFS-11534. Add counters for number of blocks in pending IBR. Contributed by Xiaobing Zhou. 2017-03-24 14:33:44 -07:00
Andrew Wang 332a997e10 HDFS-11170. Add builder-based create API to FileSystem. Contributed by SammiChen and Wei Zhou. 2017-03-24 12:56:46 -07:00
Andrew Wang 52b00600df HADOOP-13715. Add isErasureCoded() API to FileStatus class. Contributed by Manoj Govindassamy. 2017-03-24 11:44:46 -07:00
Ravi Prakash d4f73e7e27 HDFS-11574. Spelling mistakes in the Java source. Contributed by Hu Xiaodong. 2017-03-24 09:38:17 -07:00
Anu Engineer e867baa220 HDFS-11361. Block Storage: add cache interface. Contributed by Chen Liang. 2017-03-23 14:33:23 -07:00
Anu Engineer 302948531f HDFS-11559. Ozone: MiniOzoneCluster prints too many log messages by default. Contributed by Tsz Wo Nicholas Sze. 2017-03-21 22:08:02 -07:00
Anu Engineer 36b20e9fbf HDFS-11496. Ozone: Merge with trunk needed a ignore duplicate entry in pom file due to shading. Contributed by Tsz Wo Nicholas Sze. 2017-03-21 15:23:56 -07:00
Anu Engineer a9f92c4666 HDFS-11162. Block Storage: add command line tool. Contributed by Chen Liang. 2017-03-21 15:06:18 -07:00
Anu Engineer 6b5dee9c38 HDFS-11492. Ozone: Add the ability to handle sendContainerReport Command. Contributed by Anu Engineer. 2017-03-21 10:43:27 -07:00
Yiqun Lin 3b908f71c5 HDFS-11358. DiskBalancer: Report command supports reading nodes from host file. Contributed by Yiqun Lin. 2017-03-21 17:44:17 +08:00
Arpit Agarwal e7c8da614c HDFS-11545. Propagate DataNode's slow disks info to the NameNode via Heartbeats. Contributed by Hanisha Koneru. 2017-03-20 21:54:58 -07:00
Chris Douglas b104f3a282 HDFS-6648. Order of namenodes in ConfiguredFailoverProxyProvider is undefined. Contributed by Inigo Goiri 2017-03-20 17:15:13 -07:00
Anu Engineer 603f2c18ec HDFS-11444. Ozone: Fix datanode ID handling in MiniOzoneCluster. Contributed by Weiwei Yang. 2017-03-20 13:18:26 -07:00
Arpit Agarwal ffa160ddb8 HDFS-11547. Add logs for slow BlockReceiver while writing data to disk. Contributed by Xiaobing Zhou. 2017-03-17 19:02:24 -07:00
Hanisha Koneru 7f8e928400 HDFS-11517. Expose slow disks via DataNode JMX. Contributed by Hanisha Koneru 2017-03-17 15:42:25 -07:00
Andrew Wang 92ea6d74ec HDFS-11516. Admin command line should print message to stderr in failure case. Contributed by Kai Sasaki. 2017-03-17 11:26:02 -07:00
Andrew Wang 4812518b23 HDFS-10530. BlockManager reconstruction work scheduling should correctly adhere to EC block placement policy. Contributed by Manoj Govindassamy and Rui Gao. 2017-03-16 15:07:38 -07:00
Kihwal Lee ba62b50eba HDFS-10601. Improve log message to include hostname when the NameNode is in safemode. Contributed by Kuhu Shukla. 2017-03-16 10:54:59 -05:00
Hanisha Koneru d69a82c89c HDFS-11511. Support Timeout when checking single disk. Contributed by Hanisha Koneru. 2017-03-15 18:01:45 -07:00
Chen Liang 615ac09499 HDFS-11419. DFSTopologyNodeImpl#chooseRandom optimizations. Contributed by Chen Liang. 2017-03-15 12:28:22 -07:00
Yiqun Lin 4416a07c9c HDFS-11420. Edit file should not be processed by the same type processor in OfflineEditsViewer. Contributed by Yiqun Lin. 2017-03-15 18:05:03 +08:00
Xiaoyu Yao 65487b579e HDFS-11491. Ozone: SCM: Add close container RPC. Contributed by Anu Engineer. 2017-03-14 21:28:44 -07:00
Andrew Wang cc1292e73a HDFS-9705. Refine the behaviour of getFileChecksum when length = 0. Contributed by Kai Zheng and SammiChen. 2017-03-14 16:41:10 -07:00
Anu Engineer 39058dd601 HDFS-11469. Ozone: SCM: Container allocation based on node report. Contributed by Xiaoyu Yao. 2017-03-14 11:54:26 -07:00
Andrew Wang 7515e75103 HDFS-11505. Do not enable any erasure coding policies by default. Contributed by Manoj Govindassamy. 2017-03-14 11:47:25 -07:00
Yiqun Lin 023b941e3b HDFS-11526. Fix confusing block recovery message. Contributed by Yiqun Lin. 2017-03-14 17:49:48 +08:00
Chen Liang 9832ae0ed8 HDFS-11482. Add storage type demand to into DFSNetworkTopology#chooseRandom. Contributed by Chen Liang. 2017-03-13 17:30:10 -07:00
Jing Zhao 55796a0946 HDFS-11395. RequestHedgingProxyProvider#RequestHedgingInvocationHandler hides the Exception thrown from NameNode. Contributed by Nandakumar. 2017-03-13 14:24:51 -07:00
Yiqun Lin 79924266f8 HDFS-11512. Increase timeout on TestShortCircuitLocalRead#testSkipWithVerifyChecksum. Contributed by Eric Badger. 2017-03-13 18:22:30 +08:00
Xiaoyu Yao 8eca9824cf HDFS-11071. Ozone: SCM: Move SCM config keys to ScmConfig. Contributed by Weiwei Yang. 2017-03-10 16:24:24 -08:00
Lei Xu 6d356b6b4d HDFS-11340. DataNode reconfigure for disks doesn't remove the failed volumes. (Manoj Govindassamy via lei) 2017-03-10 14:37:13 -08:00
Andrew Wang 819808a016 HDFS-11506. Move ErasureCodingPolicyManager#getSystemDefaultPolicy to test code. Contributed by Manoj Govindassamy. 2017-03-09 17:29:11 -08:00
Tsz-Wo Nicholas Sze fbc8099b63 HDFS-11513. Ozone: Separate XceiverServer and XceiverClient into interfaces and implementations. 2017-03-09 11:03:20 -08:00
Masatake Iwasaki 385d2cb777 HDFS-11499. Decommissioning stuck because of failing recovery. Contributed by Lukas Majercak and Manoj Govindassamy. 2017-03-09 21:13:50 +09:00
Anu Engineer 5e95bdeef2 HDFS-10928. Ozone:SCM: Support MXBean for SCM and NodeManager. Contributed by Weiwei Yang. 2017-03-08 18:52:57 -08:00
Andrew Wang 33a38a5341 HDFS-11314. Enforce set of enabled EC policies on the NameNode. 2017-03-08 16:41:44 -08:00
Andrew Wang 5ca6ef0c26 HDFS-10983. OIV tool should make an EC file explicit. Contributed by Manoj Govindassamy. 2017-03-08 15:36:19 -08:00
Anu Engineer cc63937e31 merge trunk to HDFS-7240 2017-03-08 15:34:04 -08:00
Andrew Wang 6b6c61ee74 HDFS-11152. Start erasure coding policy ID number from 1 instead of 0 to void potential unexpected errors. Contributed by SammiChen. 2017-03-08 15:34:04 -08:00
Arpit Agarwal 647de3c41e HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru. 2017-03-08 15:34:01 -08:00
Arpit Agarwal 79b8d7ed38 HDFS-10838. Last full block report received time for each DN should be easily discoverable. Contributed by Surendra Singh Lilhore. 2017-03-08 15:33:59 -08:00
Andrew Wang 52a53fe71f HDFS-11498. Make RestCsrfPreventionHandler and WebHdfsHandler compatible with Netty 4.0. 2017-03-08 15:33:59 -08:00
Yiqun Lin b13878cf50 HDFS-8741. Proper error msg to be printed when invalid operation type is given to WebHDFS operations. Contributed by Surendra Singh Lilhore. 2017-03-08 15:33:58 -08:00
Mingliang Liu 370f4da168 HDFS-11494. Log message when DN is not selected for block replication. Contributed by Yiqun Lin 2017-03-08 15:33:56 -08:00
Jing Zhao 09cfa79dbd HDFS-11476. Fix NPE in FsDatasetImpl#checkAndUpdate. Contributed by Xiaobing Zhou. 2017-03-08 15:33:55 -08:00
Andrew Wang 4a09ed01a8 HDFS-8112. Relax permission checking for EC related operations. 2017-03-08 15:33:55 -08:00
Anu Engineer 4074123636 HDFS-11196. Ozone: Improve logging and error handling in the container layer. Contributed by Anu Engineer. 2017-03-08 09:36:20 -08:00
Andrew Wang 5addacb1e3 HDFS-11152. Start erasure coding policy ID number from 1 instead of 0 to void potential unexpected errors. Contributed by SammiChen. 2017-03-08 08:47:38 -08:00
Anu Engineer dac2b9e7d9 HDFS-11509. Ozone: Fix TestEndpoint test regression. Contributed by Anu Engineer. 2017-03-07 22:38:11 -08:00