Commit Graph

16123 Commits

Author SHA1 Message Date
Yongjun Zhang 5078df7be3 HDFS-11689. New exception thrown by DFSClient%isHDFSEncryptionEnabled broke hacky hive code. Contributed by Yongjun Zhang. 2017-04-21 13:36:31 -07:00
Andrew Wang a22fe02fba HADOOP-14261. Some refactoring work for erasure coding raw coder. Contributed by Lin Zeng. 2017-04-21 11:35:36 -07:00
Kai Zheng b0803388fc HDFS-11604. Define and parse erasure code policies. Contributed by Lin Zeng 2017-04-21 13:33:33 +08:00
Wangda Tan de69d6e811 YARN-6363. Extending SLS: Synthetic Load Generator. (Carlo Curino via wangda) 2017-04-20 21:54:30 -07:00
Mingliang Liu 667966c13c HADOOP-14324. Refine S3 server-side-encryption key as encryption secret; improve error reporting and diagnostics. Contributed by Steve Loughran 2017-04-20 17:13:36 -07:00
Daniel Templeton f356f0f4cf YARN-6453. fairscheduler-statedump.log gets generated regardless of service
(Contributed by Yufei Gu via Daniel Templeton)
2017-04-20 14:13:07 -07:00
Chen Liang eae8c2a469 HDFS-11667. Block Storage:Handling flushing of incomplete block id buffers during shutdown. Contributed by Mukul Kumar Singh. 2017-04-20 13:50:29 -07:00
Xiaoyu Yao a2c6f594ba HDFS-11668. Ozone: misc improvements for SCM CLI. Contributed by Weiwei Yang. 2017-04-20 11:32:13 -07:00
Sunil G c0cf11e107 YARN-6402. Move 'Long Running Services' to an independent tab at top level for new Yarn UI. Contributed by Akhil PB. 2017-04-20 12:33:53 +05:30
Yiqun Lin 9154d77ca8 HDFS-11666. Ozone: Fix compile error due to inconsistent package name. Contributed by Yiqun Lin. 2017-04-20 14:22:59 +08:00
Xiaoyu Yao 8ec13a397f HDFS-11504. Ozone: SCM: Add Block APIs. Contributed by Xiaoyu Yao. 2017-04-19 22:34:49 -07:00
Andrew Wang 74a723852d HDFS-11660. TestFsDatasetCache#testPageRounder fails intermittently with AssertionError. 2017-04-19 18:10:04 -07:00
Andrew Wang c1549352cf HDFS-11671. TestReconstructStripedBlocks#test2RecoveryTasksForSameBlockGroup fails. 2017-04-19 13:49:56 -07:00
Daniel Templeton 46940d92e2 YARN-6302. Fail the node if Linux Container Executor is not configured properly
(Contributed by Miklos Szegedi via Daniel Templeton)
2017-04-19 12:23:49 -07:00
Allen Wittenauer 394589f385 HADOOP-14316. Switch from Findbugs to Spotbugs (aw) 2017-04-19 12:13:40 -07:00
John Zhuge 0344bea3fd HADOOP-14241. Add ADLS sensitive config keys to default list. Contributed by John Zhuge. 2017-04-19 11:50:54 -07:00
Daniel Templeton dd43b895c2 YARN-6202. Configuration item Dispatcher.DISPATCHER_EXIT_ON_ERROR_KEY is disregarded
(Contributed by Yufei Gu via Daniel Templeton)
2017-04-19 11:44:55 -07:00
Andrew Wang 7e075a50e3 YARN-6365. Get static SLS html resources from classpath. Contributed by Yufei Gu. 2017-04-19 11:08:59 -07:00
Daniel Templeton 41ac190dba YARN-6438. Code can be improved in ContainersMonitorImpl.java
(Contributed by Miklos Szegedi via Daniel Templeton)
2017-04-19 10:53:08 -07:00
Daniel Templeton 15acdbdba2 YARN-3427. Remove deprecated methods from ResourceCalculatorProcessTree
(Contributed by Miklos Szegedi via Daniel Templeton)
2017-04-19 10:31:14 -07:00
Daniel Templeton d4483a2fe4 HADOOP-13997. Typo in metrics docs (Contributed by Ana Krasteva via Daniel Templeton) 2017-04-19 09:41:09 -07:00
Sunil G 9ff25408bc YARN-6164. Expose Queue Configurations per Node Label through YARN client api. Contributed by Benson Qiu. 2017-04-19 20:39:09 +05:30
Steve Loughran 6b015d00c9
HADOOP-14321. explicitly exclude s3a root dir ITests from parallel runs.
Contributed by Steve Loughran
2017-04-19 10:21:44 +01:00
John Zhuge 8c81a16a1f HDFS-11531. Expose hedged read metrics via libHDFS API. Contributed by Sailesh Mukil. 2017-04-18 21:11:07 -07:00
Weiwei Yang 0bf416ac40 HDFS-11649. Ozone: SCM: CLI: Add shell code placeholder classes. Contributed by Chen Liang. 2017-04-19 11:43:14 +08:00
Chris Douglas af8e9842d2 YARN-6451. Add RM monitor validating metrics invariants. Contributed by Carlo Curino 2017-04-18 10:29:44 -07:00
John Zhuge a9f07e0d3e HADOOP-14317. KMSWebServer$deprecateEnv may leak secret. Contributed by John Zhuge. 2017-04-18 09:29:16 -07:00
John Zhuge ca2488c009 HDFS-11665. HttpFSServerWebServer$deprecateEnv may leak secret. Contributed by John Zhuge. 2017-04-18 09:28:52 -07:00
Kengo Seki 654372db85
HADOOP-14315. Python example in the rack awareness document doesn't work due to bad indentation
This closes #214

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2017-04-18 17:14:22 +09:00
Akira Ajisaka 84a8848aae
HADOOP-14318. Remove non-existent setfattr command option from FileSystemShell.md. Contributed by Doris Gu. 2017-04-18 16:43:50 +09:00
Anu Engineer d889437c27 HDFS-11658. Ozone: SCM daemon is unable to be started via CLI. Contributed by Weiwei Yang. 2017-04-17 19:09:11 -07:00
Anu Engineer 368424b465 HDFS-11581. Ozone: Support force delete a container. Contributed by Yuanbo Liu. 2017-04-17 17:58:54 -07:00
Konstantin V Shvachko 8dfcd95d58 HDFS-11634. Optimize BlockIterator when interating starts in the middle. Contributed by Konstantin V Shvachko. 2017-04-17 16:56:24 -07:00
Andrew Wang c0ca785dbb HDFS-11652. Improve ECSchema and ErasureCodingPolicy toString, hashCode, equals. 2017-04-17 16:30:25 -07:00
Zhe Zhang ad49098eb3 HDFS-11615. FSNamesystemLock metrics can be inaccurate due to millisecond precision. Contributed by Erik Krogen. 2017-04-17 16:22:33 -07:00
Anu Engineer 350220bfb3 HDFS-11631. Block Storage : allow cblock server to be started from hdfs commandline. Contributed by Chen Liang. 2017-04-17 15:54:39 -07:00
Junping Du 6ed9d36224 YARN-6304. Skip rm.transitionToActive call to RM if RM is already active. Contributed by Rohith Sharma K S. 2017-04-17 15:51:10 -07:00
Anu Engineer 49c92ea73d HDFS-11657. Ozone: Add unit test for storage container metrics. Contributed by Yiqun Lin. 2017-04-17 12:44:29 -07:00
Haibo Chen f1de2c8560 MAPREDUCE-6875. Rename mapred-site.xml.template to mapred-site.xml. (Yuanbo Liu via Haibo Chen) 2017-04-17 12:25:30 -07:00
Haibo Chen ac3cfdf3e5 MAPREDUCE-6673. Add a test example job that grows in memory usage over time (Karthik Kambatla via Haibo Chen)
Change-Id: Iccfc8c67c38c526cc61726d87bfcbcf69ac36fea
2017-04-17 11:15:39 -05:00
Arun Suresh 0ac17dc644 HADOOP-14311. Add python2.7-dev to Dockerfile (Allen Wittenauer via asuresh) 2017-04-14 16:56:16 -07:00
Jason Lowe 4168805502 YARN-6480. Timeout is too aggressive for TestAMRestart.testPreemptedAMRestartOnRMRestart. Contributed by Eric Badger 2017-04-14 17:15:48 -05:00
Karthik Kambatla 8a1d7480f7 YARN-6433. Only accessible cgroup mount directories should be selected for a controller. (Miklos Szegedi via kasha) 2017-04-14 15:07:14 -07:00
Eric Payne a41f8dd58e YARN-5994. TestCapacityScheduler.testAMLimitUsage fails intermittently. Contributed by Eric Badger 2017-04-14 10:53:09 -05:00
Anu Engineer 1a418ef2c0 HDFS-11582. Block Storage : add SCSI target access daemon. Contributed by Chen Liang. 2017-04-13 13:25:53 -07:00
Anu Engineer 3231ead84b Merge branch 'trunk' into HDFS-7240 2017-04-12 16:36:41 -07:00
Mingliang Liu 0cab57223e HADOOP-14274. Azure: Simplify Ranger-WASB policy model. Contributed by Sivaguru Sankaridurg 2017-04-12 16:07:10 -07:00
Anu Engineer 6556445792 HDFS-11569. Ozone: Implement listKey function for KeyManager. Contributed by Weiwei Yang. 2017-04-12 15:36:56 -07:00
Mingliang Liu b053fdc547 HADOOP-14255. S3A to delete unnecessary fake directory objects in mkdirs(). Contributed by Mingliang Liu 2017-04-12 14:30:34 -07:00
Karthik Kambatla c3375175d6 YARN-6432. FairScheduler: Reserve preempted resources for corresponding applications. (Miklos Szegedi via kasha) 2017-04-12 14:21:20 -07:00