Commit Graph

16115 Commits

Author SHA1 Message Date
Lei Xu 19a7e94ee4 HDFS-11718. DFSStripedOutputStream hsync/hflush should not throw UnsupportedOperationException. (Manoj Govindassamy via lei)
Change-Id: I4cc226b80c64a0d900a3b1ce71e51f051cd29c22
2017-04-28 17:06:14 -07:00
Daniel Templeton 2e52789edf YARN-2962. ZKRMStateStore: Limit the number of znodes under a znode (Contributed by Varun Sexena via Daniel Templeton) 2017-04-28 13:30:28 -07:00
Eric Payne fdf5192bbb YARN-6536. TestAMRMClient.testAMRMClientWithSaslEncryption fails intermittently. Contributed by Jason Lowe. 2017-04-28 15:20:35 -05:00
Eric Payne 6fe11f6155 HADOOP-14320. TestIPC.testIpcWithReaderQueuing fails intermittently. Contributed by Eric Badger. 2017-04-28 14:45:26 -05:00
Robert Kanter 68e45f554b YARN-6472. Improve Java sandbox regex (gphillips via rkanter) 2017-04-28 11:01:50 -07:00
Junping Du 373bb4931f YARN-679. Add an entry point that can start any Yarn service. Contributed by Steve Loughran. 2017-04-28 10:45:02 -07:00
Kai Zheng cb672a45a0 HDFS-11605. Allow user to customize new erasure code policies. Contributed by Huafeng Wang 2017-04-28 13:18:50 +08:00
Robert Kanter 371b6467dc YARN-5894. fixed license warning caused by de.ruedigermoeller:fst:jar:2.24 (haibochen via rkanter) 2017-04-27 17:49:38 -07:00
Chris Douglas 689fb2fc66 HADOOP-14354. SysInfoWindows is not thread safe. Contributed by Inigo Goiri 2017-04-27 16:26:39 -07:00
Chris Douglas 31cf480d65 HADOOP-14309. Add PowerShell NodeFencer. Contributed by Inigo Goiri 2017-04-27 16:09:28 -07:00
Junping Du 94607214ce YARN-6534. ResourceManager failed due to TimelineClient try to init SSLFactory even https is not enabled. Contributed by Rohith Sharma K S.
(cherry picked from commit 09e36ff59c05b8bd54d346d1103de0a7300875c6)
2017-04-27 13:11:32 -07:00
Wei-Chiu Chuang bbf8cac14d HADOOP-13200. Implement customizable and configurable erasure coders. Contributed by Tim Yao. 2017-04-27 12:39:47 -07:00
Wei-Chiu Chuang ddaeb3e497 Revert "HADOOP-13200. Implement customizable and configurable erasure coders. Contributed by Tim Yao."
This reverts commit 872088c6e7.
2017-04-27 12:25:47 -07:00
Wei-Chiu Chuang 872088c6e7 HADOOP-13200. Implement customizable and configurable erasure coders. Contributed by Tim Yao. 2017-04-27 11:59:33 -07:00
Zhe Zhang d8a3309830 HDFS-11709. StandbyCheckpointer should handle an non-existing legacyOivImageDir gracefully. Contributed by Erik Krogen. 2017-04-27 09:50:30 -07:00
Steve Loughran 61cda39e4e
HADOOP-14346. CryptoOutputStream throws IOException if stream is closed.
Contributed by Pierre Lacave

(cherry picked from commit 40b9c30d64)
2017-04-27 12:19:04 +01:00
Varun Saxena 793bbf216d YARN-6455. Enhance the timelinewriter.flush() race condition fix (Haibo Chen via Varun Saxena) 2017-04-27 15:01:58 +05:30
Akira Ajisaka 62579b69a0
HADOOP-11614. Remove httpclient dependency from hadoop-openstack. Contributed by Akira Ajisaka, Brahma Reddy Battula, and Steve Loughran. 2017-04-27 16:57:08 +09:00
Akira Ajisaka 249cb210f5
HDFS-11697. Add javadoc for storage policy and erasure coding policy. Contributed by Kai Sasaki. 2017-04-27 16:12:27 +09:00
Akira Ajisaka 3ed3062fe3
MAPREDUCE-6881. Fix warnings from Spotbugs in hadoop-mapreduce. Contributed by Weiwei Yang. 2017-04-27 15:45:33 +09:00
Konstantin V Shvachko 28eb2aabeb HDFS-11384. Balancer disperses getBlocks calls to avoid NameNode's rpc queue saturation. Contributed by Konstantin V Shvachko. 2017-04-26 17:28:49 -07:00
Mingliang Liu 8b5f2c372e HADOOP-14351. Azure: RemoteWasbAuthorizerImpl and RemoteSASKeyGeneratorImpl should not use Kerberos interactive user cache. Contributed by Santhosh G Nayak 2017-04-26 13:47:18 -07:00
Haibo Chen 4f3ca0396a YARN-6510. Fix profs stat file warning caused by process names that includes parenthesis. (Wilfred Spiegelenburg via Haibo Chen) 2017-04-26 11:46:55 -07:00
John Zhuge edd693833b HADOOP-14340. Enable KMS and HttpFS to exclude SSL ciphers. Contributed by John Zhuge. 2017-04-26 11:44:59 -07:00
Chen Liang 50dd3a5cfa HDFS-11627. Block Storage: Cblock cache should register with flusher to upload blocks to containers. Contributed by Mukul Kumar Singh. 2017-04-26 10:36:56 -07:00
Akira Ajisaka 93fa48fcf2
HDFS-11417. Add datanode admin command to get the storage info. Contributed by Surendra Singh Lilhore. 2017-04-26 17:43:29 +09:00
Chris Douglas 2f73396b59 HDFS-6708. StorageType should be encoded in the block token. Contributed by Ewan Higgs 2017-04-25 23:57:00 -07:00
Akira Ajisaka 8a99eba96d
Revert "YARN-5007. Remove deprecated constructors of MiniYARNCluster and MiniMRYarnCluster. Contributed by Andras Bokor."
This reverts commit 34ab8e73d4.
2017-04-26 15:34:23 +09:00
John Zhuge 9ccb849eb6 HADOOP-14341. Support multi-line value for ssl.server.exclude.cipher.list. Contributed by John Zhuge. 2017-04-25 22:06:51 -07:00
Mingliang Liu e4c32bccde HADOOP-14349. Rename ADLS CONTRACT_ENABLE_KEY. Contributed by Mingliang Liu 2017-04-25 20:54:56 -07:00
Xiaoyu Yao 4ea2778acb HADOOP-14207. "dfsadmin -refreshCallQueue" fails with DecayRpcScheduler. Contributed by Surendra Singh Lihore. 2017-04-25 18:45:56 -07:00
Mingliang Liu d11d280b8b HADOOP-12856. FileUtil.checkDest() and RawLocalFileSystem.mkdirs() to throw stricter IOEs; RawLocalFS contract tests to verify. Contributed by Steve Loughran 2017-04-25 18:33:41 -07:00
Robert Kanter 475f933b41 YARN-6423. Queue metrics doesn't work for Fair Scheduler in SLS (yufeigu via rkanter) 2017-04-25 16:26:09 -07:00
Jason Lowe e4321ec843 HDFS-11691. Add a proper scheme to the datanode links in NN web UI. Contributed by Kihwal Lee 2017-04-25 17:30:42 -05:00
Wangda Tan 2ba21d6376 YARN-6392. Add submit time to Application Summary log. (Zhihai Xu via wangda) 2017-04-24 13:17:35 -07:00
Steve Loughran 5f934f8386
HADOOP-14305 S3A SSE tests won't run in parallel: Bad request in directory GetFileStatus.
Contributed by Steve Moist.
2017-04-24 20:33:19 +01:00
Haibo Chen 8ac50e1322 YARN-6500. Do not mount inaccessible cgroups directories in CgroupsLCEResourcesHandler. (Miklos Szegedi via Haibo Chen) 2017-04-24 11:37:52 -07:00
Eric Payne 52adf71914 YARN-5617. AMs only intended to run one attempt can be run more than once? Contributed by Jason Lowe. 2017-04-24 12:03:28 -05:00
Sunil G 561718e05d YARN-6291. Introduce query parameters (sort, filter, etc.) for tables to keep state on refresh/navigation in new YARN UI. Contributed by Gergely Novák. 2017-04-24 13:28:57 +05:30
John Zhuge fda86ef2a3 HDFS-11529. Add libHDFS API to return last exception. Contributed by Sailesh Mukil. 2017-04-22 02:56:48 -07:00
Yongjun Zhang 20e3ae260b HDFS-11402. HDFS Snapshots should capture point-in-time copies of OPEN files. (Manoj Govindassamy via Yongjun Zhang) 2017-04-21 20:35:48 -07:00
Robert Kanter 3721cfe1fb MAPREDUCE-6871. Allow users to specify racks and nodes for strict locality for AMs (rkanter) 2017-04-21 16:12:01 -07:00
Yongjun Zhang 5078df7be3 HDFS-11689. New exception thrown by DFSClient%isHDFSEncryptionEnabled broke hacky hive code. Contributed by Yongjun Zhang. 2017-04-21 13:36:31 -07:00
Andrew Wang a22fe02fba HADOOP-14261. Some refactoring work for erasure coding raw coder. Contributed by Lin Zeng. 2017-04-21 11:35:36 -07:00
Kai Zheng b0803388fc HDFS-11604. Define and parse erasure code policies. Contributed by Lin Zeng 2017-04-21 13:33:33 +08:00
Wangda Tan de69d6e811 YARN-6363. Extending SLS: Synthetic Load Generator. (Carlo Curino via wangda) 2017-04-20 21:54:30 -07:00
Mingliang Liu 667966c13c HADOOP-14324. Refine S3 server-side-encryption key as encryption secret; improve error reporting and diagnostics. Contributed by Steve Loughran 2017-04-20 17:13:36 -07:00
Daniel Templeton f356f0f4cf YARN-6453. fairscheduler-statedump.log gets generated regardless of service
(Contributed by Yufei Gu via Daniel Templeton)
2017-04-20 14:13:07 -07:00
Chen Liang eae8c2a469 HDFS-11667. Block Storage:Handling flushing of incomplete block id buffers during shutdown. Contributed by Mukul Kumar Singh. 2017-04-20 13:50:29 -07:00
Xiaoyu Yao a2c6f594ba HDFS-11668. Ozone: misc improvements for SCM CLI. Contributed by Weiwei Yang. 2017-04-20 11:32:13 -07:00