Commit Graph

16268 Commits

Author SHA1 Message Date
Steve Loughran 605b29d3de HADOOP-14430 the accessTime of FileStatus returned by SFTPFileSystem's
getFileStatus method is always 0.
Contributed by Hongyuan Li.
2017-06-08 10:44:45 -07:00
Steve Loughran 0d55cc6a37 HADOOP-14399. Configuration does not correctly XInclude absolute file URIs.
Contributed by Jonathan Eagles
2017-06-08 10:44:45 -07:00
Varun Vasudev d1d5f6fdab Addendum patch to fix Docker sanitization. 2017-06-08 10:44:45 -07:00
Akira Ajisaka 70fac5d1d5 YARN-6141. ppc64le on Linux doesn't trigger __linux get_executable codepath. Contributed by Sonia Garudi and Ayappan. 2017-06-08 10:44:45 -07:00
Akira Ajisaka 527c9dde40 HADOOP-14180. FileSystem contract tests to replace JUnit 3 with 4. Contributed by Xiaobing Zhou and Mingliang Liu. 2017-06-08 10:44:45 -07:00
Wei-Chiu Chuang df1496a39b HADOOP-14426. Upgrade Kerby version from 1.0.0-RC2 to 1.0.0. Contributed by Jiajia Li. 2017-06-08 10:44:45 -07:00
Wei-Chiu Chuang c90e190507 Revert "HDFS-10797. Disk usage summary of snapshots causes renamed blocks to get counted twice. Contributed by Sean Mackrory."
This reverts commit 6a38d118d8.
2017-06-08 10:44:45 -07:00
Wei-Chiu Chuang 71626483f4 Revert "HDFS-11515. -du throws ConcurrentModificationException. Contributed by Istvan Fajth, Wei-Chiu Chuang."
This reverts commit bc7aff7cec.
2017-06-08 10:44:44 -07:00
Arpit Agarwal 0646fb2fa5 HDFS-11877. FileJournalManager#getLogFile should ignore in progress edit logs during JN sync. Contributed by Hanisha Koneru. 2017-06-08 10:44:44 -07:00
Jing Zhao a02b908e6a HDFS-11823. Extend TestDFSStripedIutputStream/TestDFSStripedOutputStream with a random EC policy. Contributed by Takanobu Asanuma. 2017-06-08 10:44:44 -07:00
Brahma Reddy Battula 49ea48078b HADOOP-14166. Reset the DecayRpcScheduler AvgResponseTime metric to zero when queue is not used. Contributed by Surendra Singh Lilhore. 2017-06-08 10:44:44 -07:00
Brahma Reddy Battula ddfdfbdbd1 HADOOP-14449. The ASF Header in ComparableVersion.java and SSLHostnameVerifier.java is not correct. Contributed by ZhangBing Lin. 2017-06-08 10:44:44 -07:00
Jason Lowe 88e00969c2 YARN-6615. AmIpFilter drops query parameters on redirect. Contributed by Wilfred Spiegelenburg 2017-06-08 10:44:44 -07:00
Kai Zheng 6d09cf72e7 HDFS-11793. Allow to enable user defined erasure coding policy. Contributed by Sammi Chen 2017-06-08 10:44:44 -07:00
Brahma Reddy Battula e164da06aa HDFS-11864. Document Metrics to track usage of memory for writes. Contributed by Yiqun Lin. 2017-06-08 10:44:44 -07:00
Rakesh Radhakrishnan 0e93e5c482 HDFS-11794. Add ec sub command -listCodec to show currently supported ec codecs. Contributed by SammiChen. 2017-06-08 10:44:44 -07:00
Arpit Agarwal 641d6c0822 HDFS-11419. Performance analysis of new DFSNetworkTopology#chooseRandom. Contributed by Chen Liang. 2017-06-08 10:44:43 -07:00
Arpit Agarwal 8348d2b13b HDFS-11866. JournalNode Sync should be off by default in hdfs-default.xml. Contributed by Hanisha Koneru. 2017-06-08 10:44:43 -07:00
Wangda Tan 4a8814b7e1 YARN-6493. Print requested node partition in assignContainer logs. (Jonathan Hung via wangda)
Change-Id: Ib20326daac10acad363befb0ae0998441fa5b32d
2017-06-08 10:44:43 -07:00
Wangda Tan 56785ab28d YARN-2113. Add cross-user preemption within CapacityScheduler's leaf-queue. (Sunil G via wangda)
Change-Id: I9b19f69788068be05b3295247cdd7b972f8a573c
2017-06-08 10:44:43 -07:00
Brahma Reddy Battula 9b09503c8b HDFS-11849. JournalNode startup failure exception should be logged in log file. Contributed By Surendra Singh Lilhore. 2017-06-08 10:44:43 -07:00
Brahma Reddy Battula 811b451229 HDFS-11863. Document missing metrics for blocks count in pending IBR. Contributed By Yiqun Lin. 2017-06-08 10:44:43 -07:00
Sunil G 8ec366b0f8 YARN-6584. Correct license headers in hadoop-common, hdfs, yarn and mapreduce. Contributed by Yeliang Cang. 2017-06-08 10:44:43 -07:00
Yufei Gu c87683d5fd YARN-6111. Rumen input does't work in SLS. Contributed by Yufei Gu. 2017-06-08 10:44:43 -07:00
Sunil G 29cbb8cb77 YARN-5705. Show timeline data from ATS v2 in new web UI. Contributed by Akhil PB. 2017-06-08 10:44:43 -07:00
Mingliang Liu aab300609e HDFS-11862. Option -v missing for du command in FileSystemShell.md. Contributed by Yiqun Lin 2017-06-08 10:44:42 -07:00
Jian He 952b26d7c5 YARN-6627. Use deployed webapp folder to launch new YARN UI. Contributed by Sunil G 2017-06-08 10:44:42 -07:00
Robert Kanter faf36776c7 YARN-6602. Impersonation does not work if standby RM is contacted first (rkanter) 2017-06-08 10:44:42 -07:00
Yufei Gu 7851ae12cf YARN-6249. TestFairSchedulerPreemption fails inconsistently. (Tao Jie via Yufei Gu) 2017-06-08 10:44:42 -07:00
Mingliang Liu 08d32a76bf HDFS-11803. Add -v option for du command to show header line. Contributed by Xiaobing Zhou 2017-06-08 10:44:42 -07:00
Yufei Gu 9bc4df69ee YARN-6540. Resource Manager is spelled "Resource Manger" in ResourceManagerRestart.md and ResourceManagerHA.md. (Grant Sohn via Yufei Gu) 2017-06-08 10:44:42 -07:00
Mingliang Liu d1b23b3dca HADOOP-14432. S3A copyFromLocalFile to be robust, tested. Contributed by Steve Loughran 2017-06-08 10:44:42 -07:00
Eric Payne 3b481de001 YARN-6618. TestNMLeveldbStateStoreService#testCompactionCycle can fail if compaction occurs more than once. Contributed by Jason Lowe. 2017-06-08 10:44:42 -07:00
Chris Douglas 83fef23141 HADOOP-11869. Suppress ParameterNumber checkstyle violations for overridden methods. Contributed by Jonathan Eagles 2017-06-08 10:44:42 -07:00
Yongjun Zhang 1252aa3781 HADOOP-14407. DistCp - Introduce a configurable copy buffer size. (Omkar Aradhya K S via Yongjun Zhang) 2017-06-08 10:44:42 -07:00
Sunil G 8bee566786 YARN-6560. SLS doesn't honor node total resource specified in sls-runner.xml. Contributed by Wangda Tan. 2017-06-08 10:44:42 -07:00
Steve Loughran bbd9e9d7d5 HADOOP-11572. s3a delete() operation fails during a concurrent delete of child entries.
Contributed by Steve Loughran.

(cherry picked from commit 2ac5aab8d7)
2017-06-08 10:44:42 -07:00
Varun Vasudev 244274bff2 Sanitize arguments before launching Docker containers. 2017-06-08 10:44:41 -07:00
Varun Vasudev da43530012 Validate docker image name before launching container. 2017-06-08 10:44:41 -07:00
Chris Douglas 714963f003 YARN-6577. Remove unused ContainerLocalization classes. Contributed by ZhangBing Lin 2017-06-08 10:44:41 -07:00
Arpit Agarwal c3f029c1d8 HDFS-11842. TestDataNodeOutlierDetectionViaMetrics UT fails intermittently. Controbuted by Hanisha Koneru. 2017-06-08 10:44:41 -07:00
Chris Douglas 27845d5269 HADOOP-14434. Use MoveFileEx to allow renaming a file when the destination exists. Contributed by Lukas Majercak 2017-06-08 10:44:41 -07:00
Mingliang Liu 37d7afc29b HADOOP-14427. Avoid reloading of Configuration in ViewFileSystem creation. Contributed by Vinayakumar B 2017-06-08 10:44:41 -07:00
Akira Ajisaka cdf35ee06b HADOOP-14415. Use java.lang.AssertionError instead of junit.framework.AssertionFailedError. Contributed by Chen Liang. 2017-06-08 10:44:41 -07:00
Akira Ajisaka d423ac2604 MAPREDUCE-6459. Native task crashes when merging spilled file on ppc64. Contributed by Tao Jie and Ayappan. 2017-06-08 10:44:41 -07:00
Akira Ajisaka f560d46e3a HADOOP-14419. Remove findbugs report from docs profile. Contributed by Andras Bokor. 2017-06-08 10:44:41 -07:00
Rohith Sharma K S a1ad4ea273 HADOOP-14412. HostsFileReader#getHostDetails is very expensive on large clusters. Contributed by Jason Lowe. 2017-06-08 10:44:41 -07:00
Arpit Agarwal 5ea7e16fa4 HDFS-11827. NPE is thrown when log level changed in BlockPlacementPolicyDefault#chooseRandom() method. Contributed by xupeng. 2017-06-08 10:44:41 -07:00
Robert Kanter e774688409 YARN-6447. Provide container sandbox policies for groups (gphillips via rkanter) 2017-06-08 10:44:41 -07:00
Robert Kanter 3defe7d85b YARN-6535. Program needs to exit when SLS finishes. (yufeigu via rkanter) 2017-06-08 10:44:41 -07:00