Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,038 Commits 326 Branches 371 Tags
Commit Graph

12038 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Chris Nauroth
e19f910245 HADOOP-13169. Randomize file list in SimpleCopyListing. Contributed by Rajesh Balamohan. 
(cherry picked from commit 98bdb5139769eb55893971b43b9c23da9513a784)
 2016-09-19 15:16:56 -07:00
Jason Lowe
035f5f8f1d YARN-5540. Scheduler spends too much time looking at empty priorities. Contributed by Jason Lowe 
(cherry picked from commit 7558dbbb481eab055e794beb3603bbe5671a4b4c)
 2016-09-19 20:33:59 +00:00
Jian He
9942ca2bf0 YARN-3141. Improve locks in SchedulerApplicationAttempt/FSAppAttempt/FiCaSchedulerApp. Contributed by Wangda Tan 
(cherry picked from commit b8a30f2f170ffbd590e7366c3c944ab4919e40df)
 2016-09-19 17:08:57 +08:00
Arun Suresh
dfaac56433 YARN-5637. Changes in NodeManager to support Container rollback and commit. (asuresh) 
(cherry picked from commit 3552c2b99dff4f21489ff284f9dcba40e897a1e5)
 2016-09-18 11:06:38 -07:00
Arun Suresh
00759f50be YARN-5657. Fix TestDefaultContainerExecutor. (asuresh) 
(cherry picked from commit f67237cbe7bc48a1b9088e990800b37529f1db2a)
 2016-09-17 09:32:55 -07:00
Naganarasimha
20729ead91 YARN-5642. Typos in 9 log messages. Contributed by Mehran Hassani 2016-09-17 10:37:42 +05:30
Naganarasimha
fa80972efb MAPREDUCE-6777. Typos in 4 log messages. Contributed by Mehran Hassani 2016-09-17 10:21:13 +05:30
Naganarasimha
656b520dc6 YARN-4232. TopCLI console support for HA mode. Contributed by Bibin A Chundatt 
(cherry picked from commit ade7c2bc9ccf09d843ccb3dfa56c1453a9e87318)
 2016-09-17 09:54:29 +05:30
Andrew Wang
b03a0be7a3 HDFS-10823. Implement HttpFSFileSystem#listStatusIterator. 
(cherry picked from commit 8a40953058d50d421d62b71067a13b626b3cba1f)
 2016-09-16 15:37:49 -07:00
Wei-Chiu Chuang
031d5f6c5b HADOOP-13580. If user is unauthorized, log "unauthorized" instead of "Invalid signed text:". Contributed by Wei-Chiu Chuang. 
(cherry picked from commit f6f3a447bf3b2900a2e9a0615ad9877f9310e062)
 2016-09-16 14:53:50 -07:00
Wei-Chiu Chuang
40089eadf5 HADOOP-13412. Move dev-support/checkstyle/suppressions.xml to hadoop-build-tools. Contributed by John Zhuge. 
(cherry picked from commit cd099a63d58c6981c45db2b169430d4935e43bd1)
 2016-09-16 14:42:13 -07:00
Steve Loughran
523bc88a28 HADOOP-13160. Suppress checkstyle JavadocPackage check for test source. John Zhuge via stevel 
(cherry picked from commit dcbb7009b6f94e655724f6a0320723e1279ebc79)
 2016-09-16 14:39:00 -07:00
Wei-Chiu Chuang
1a2c771501 HADOOP-13411. Checkstyle suppression by annotation or comment. Contributed by John Zhuge. 
(cherry picked from commit 0e68e14d5506288bbda02cfc755babf1e9875187)
 2016-09-16 14:17:20 -07:00
Akira Ajisaka
214b6d16d5 HDFS-10862. Typos in 4 log messages. Contributed by Mehran Hassani. 
(cherry picked from commit b09a03cd7d26cf96ec26a81ba11f00778241eb3e)
 2016-09-16 16:12:19 +09:00
Wangda Tan
ee101e49fa YARN-4091. Add REST API to retrieve scheduler activity. (Chen Ge via wangda) 2016-09-15 14:49:03 -07:00
Arun Suresh
16aecc699d YARN-5620. Core changes in NodeManager to support re-initialization of Containers with new launchContext. (asuresh) 
(cherry picked from commit 40b5a59b726733df456330a26f03d5174cc0bc1c)
 2016-09-15 08:11:14 -07:00
Akira Ajisaka
e485ace0dd HADOOP-13616. Broken code snippet area in Hadoop Benchmarking. Contributed by Kai Sasaki. 
(cherry picked from commit 7cad7b704644f260688eb0d4d92413f3a8630f25)
 2016-09-15 23:43:20 +09:00
Arpit Agarwal
853e1e6946 HDFS-10805. Reduce runtime for append test. Contributed by Gergely Novak. 2016-09-14 09:31:24 -07:00
Steve Loughran
3b9268cfba HADOOP-13606 swift FS to add a service load metadata file. Contributed by Steve Loughran 2016-09-14 15:44:45 +01:00
Akira Ajisaka
3f36ac9f33 HADOOP-13598. Add eol=lf for unix format files in .gitattributes. Contributed by Yiqun Lin. 
(cherry picked from commit 696bc0e0abe57051470da0cbd539ddf21cc60da9)
 2016-09-14 11:15:27 +09:00
Jing Zhao
55600b38a8 HADOOP-13546. Override equals and hashCode of the default retry policy to avoid connection leakage. Contributed by Xiaobing Zhou. 
(cherry picked from commit 08d8e0ba259f01465a83d8db09466dfd46b7ec81)
 2016-09-13 11:13:37 -07:00
Andrew Wang
abaad976cd HDFS-10837. Standardize serializiation of WebHDFS DirectoryListing. 
(cherry picked from commit db6d243cf89d25fefbffd4c8721e14d9246b5a16)
 2016-09-13 11:02:43 -07:00
Jason Lowe
4f2f0eb0bb YARN-5630. NM fails to start after downgrade from 2.8 to 2.7. Contributed by Jason Lowe 
(cherry picked from commit e7933097354a246b080b46f1a4ca2ef0f39f3b38)
 2016-09-13 14:43:21 +00:00
Rohith Sharma K S
8c8ff0cfa3 YARN-5631. Missing refreshClusterMaxPriority usage in rmadmin help message. Contributed by Kai Sasaki. 
(cherry picked from commit 729de3e6b6ae1fcfe1c6bec7102d758ad489df47)
 2016-09-13 15:27:20 +05:30
Akira Ajisaka
764cf431ca HDFS-10856. Update the comment of BPServiceActor$Scheduler#scheduleNextBlockReport. Contributed by Yiqun Lin. 
(cherry picked from commit f0876b8b60c19aa25e0417ac0f419a3a82bf210b)
 2016-09-13 14:51:04 +09:00
Yongjun Zhang
223ce108a1 HDFS-10657. testAclCLI.xml setfacl test should expect mask r-x. (John Zhuge via Yongjun Zhang) 
(cherry picked from commit d2466ec3e01b5ef2a0bde738232c5ad6d2d956eb)
 2016-09-12 21:46:09 -07:00
Arpit Agarwal
6948691ad1 HDFS-10830. FsDatasetImpl#removeVolumes crashes with IllegalMonitorStateException when vol being removed is in use. (Arpit Agarwal and Manoj Govindassamy) 2016-09-10 18:22:15 -07:00
Arpit Agarwal
012b266e5e HDFS-10742. Measure lock time in FsDatasetImpl. Contributed by Chen Liang. 2016-09-10 18:04:00 -07:00
Arpit Agarwal
ad0ac6cced HDFS-10682. Replace FsDatasetImpl object lock with a separate lock object. (Contributed by Chen Liang) 2016-09-10 17:48:27 -07:00
Xiao Chen
bb6d866207 HDFS-9781. FsDatasetImpl#getBlockReports can occasionally throw NullPointerException. Contributed by Manoj Govindassamy. 2016-09-09 18:25:35 -07:00
Andrew Wang
f448ce2a89 HDFS-10832. Propagate ACL bit and isEncrypted bit in HttpFS FileStatus permissions. 
(cherry picked from commit cba973f036a2c8fcc21a5826b8306247ec154c7b)
 2016-09-09 12:16:08 -07:00
Chris Douglas
806a8dea38 MAPREDUCE-6628. Potential memory leak in CryptoOutputStream. Contributed by Mariappan Asokan 
(cherry picked from commit 9f192cc5ac4a6145e2eeaecba0a754d31e601898)
 2016-09-09 11:14:30 -07:00
Steve Loughran
6a016faf59 HADOOP-13540 improve section on troubleshooting s3a auth problems. Contributed by Steve Loughran 2016-09-09 18:54:34 +01:00
Kihwal Lee
d234990208 HADOOP-10940. RPC client does no bounds checking of responses. Contributed by Daryn Sharp. 
(cherry picked from commit d4d076876a8d0002bd3a73491d8459d11cb4896c)
 2016-09-09 10:46:37 -05:00
Andrew Wang
72ea641468 HDFS-10831. Add log when URLConnectionFactory.openConnection failed. Contributed by yunjiong zhao. 
(cherry picked from commit b07c266dca7f303c793b432a0738d593728cf2b3)
 2016-09-08 18:30:26 -07:00
Akira Ajisaka
c0756dfef6 HDFS-10847. Complete the document for FileDistribution processor in OfflineImageViewer. Contributed by Yiqun Lin. 
(cherry picked from commit 20a20c2f6e1b3b8aa6a58a824ad3aadc349dc761)
 2016-09-09 01:35:36 +09:00
Akira Ajisaka
fe6dd66174 HDFS-10778. Add -format option to make the output of FileDistribution processor human-readable in OfflineImageViewer. 
(cherry picked from commit 63f594892ecd4687e37a99790288e36eb278849f)
 2016-09-08 15:18:25 +09:00
Steve Loughran
5f8b6f0313 HADOOP-13541 explicitly declare the Joda time version S3A depends on. Contributed by Stevel Loughran 2016-09-07 12:24:15 +01:00
Karthik Kambatla
a064375e68 YARN-5616. Clean up WeightAdjuster. (Yufei Gu via kasha) 
(cherry picked from commit c0e492e50fa98d423c8a61c94d2d1f9553558b6d)
 2016-09-06 22:40:49 -07:00
Xiao Chen
d157733082 HADOOP-13558. UserGroupInformation created from a Subject incorrectly tries to renew the Kerberos ticket. Contributed by Xiao Chen. 
(cherry picked from commit 680be58aac03a9ffab6b07c8fde9602ddb9dc858)
 2016-09-06 20:54:38 -07:00
Arpit Agarwal
f9415b7a7e HDFS-9038. DFS reserved space is erroneously counted towards non-DFS used. (Brahma Reddy Battula) 2016-09-06 13:44:22 -07:00
Xiao Chen
3025992bd3 HDFS-10841. Remove duplicate or unused variable in appendFile(). Contributed by Kihwal Lee. 
(cherry picked from commit f6c0b7543f612de756ff0c03e9a2c6e33b496a36)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirAppendOp.java
 2016-09-06 11:52:30 -07:00
Chris Nauroth
e28930a38b HADOOP-13447. Refactor S3AFileSystem to support introduction of separate metadata repository and tests. Contributed by Chris Nauroth. 
(cherry picked from commit d152557cf7f4d2288524c222fcbaf152bdc038b0)
 2016-09-06 09:40:41 -07:00
Kihwal Lee
614f9a62c4 HADOOP-13549. Eliminate intermediate buffer for server-side PB encoding. Contributed by Daryn Sharp. 
(cherry picked from commit 39d1b1d747b1e325792b897b3264272f32b756a9)
 2016-09-06 10:15:57 -05:00
Varun Vasudev
ec3a651b17 YARN-5576. Allow resource localization while container is running. Contributed by Jian He. 2016-09-06 20:07:54 +05:30
Rohith Sharma K S
de9f046598 YARN-5608. TestAMRMClient.setup() fails with ArrayOutOfBoundsException. Contributed by Daniel Templeton. 
(cherry picked from commit f9557127b3660e138cab8d9535a589677809384a)
 2016-09-06 14:13:41 +05:30
Karthik Kambatla
a5748eec7b YARN-5264. Store all queue-specific information in FSQueue. (Yufei Gu via kasha) 
(cherry picked from commit f6ea9be5473ab66798b0536317d2f32c5348eb57)
 2016-09-02 15:02:20 -07:00
Ray Chiang
4ee1729cb0 YARN-5549. AMLauncher#createAMContainerLaunchContext() should not log the command to be launched indiscriminately. (Daniel Templeton via rchiang) 2016-09-02 14:57:05 -07:00
Andrew Wang
40eab77562 HDFS-10833. Fix JSON errors in WebHDFS.md examples. 
(cherry picked from commit cbd909ce2a5ac1da258f756fa1f93e84dd20b926)
 2016-09-02 14:50:41 -07:00
Lei Xu
d6bfb2176c HDFS-10822. Log DataNodes in the write pipeline. John Zhuge via Lei Xu 
(cherry picked from commit 5a8c5064d1a1d596b1f5c385299a86ec6ab9ad1e)
 2016-09-02 11:02:38 -07:00