Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
13,376 Commits 326 Branches 371 Tags
Commit Graph

13376 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Steve Loughran
2ac5aab8d7
HADOOP-11572. s3a delete() operation fails during a concurrent delete of child entries. 
Contributed by Steve Loughran.
 2017-05-18 15:38:46 +01:00
Varun Vasudev
cd1a04e3c6 Sanitize arguments before launching Docker containers. 2017-05-18 11:46:03 +05:30
Varun Vasudev
603a0a316c Validate docker image name before launching container. 2017-05-18 11:31:12 +05:30
Chris Douglas
3d2afb209c YARN-6577. Remove unused ContainerLocalization classes. Contributed by ZhangBing Lin 
(cherry picked from commit b23fcc86c670aa896151a2bd8878154d7bb45d13)
 2017-05-17 20:40:20 -07:00
Arpit Agarwal
3db695d400 HDFS-11842. TestDataNodeOutlierDetectionViaMetrics UT fails intermittently. Controbuted by Hanisha Koneru. 2017-05-17 19:38:54 -07:00
Chris Douglas
4bb0565443 HADOOP-14434. Use MoveFileEx to allow renaming a file when the destination exists. Contributed by Lukas Majercak 
(cherry picked from commit ef9e536a7137d209985d25a4769712c2db2c52bf)
 2017-05-17 17:24:36 -07:00
Mingliang Liu
94755e2d6d HADOOP-14427. Avoid reloading of Configuration in ViewFileSystem creation. Contributed by Vinayakumar B 
(cherry picked from commit eb7791b4743c593ac7d0f0d08962132723ffe3c6)
 2017-05-17 13:21:34 -07:00
Akira Ajisaka
b295924d49
HADOOP-14419. Remove findbugs report from docs profile. Contributed by Andras Bokor. 
(cherry picked from commit e6f6682aa864635b9f70b387872701c064455ad5)
 2017-05-17 07:41:47 -04:00
Rohith Sharma K S
379e5bd26f HADOOP-14412. HostsFileReader#getHostDetails is very expensive on large clusters. Contributed by Jason Lowe. 2017-05-17 08:27:50 +05:30
Arpit Agarwal
0e95ff78c3 HDFS-11827. NPE is thrown when log level changed in BlockPlacementPolicyDefault#chooseRandom() method. Contributed by xupeng. 2017-05-16 19:51:17 -07:00
Kihwal Lee
82ea3f4545 HDFS-11641. Reduce cost of audit logging by using FileStatus instead of HdfsFileStatus. Contributed by Daryn Sharp. 2017-05-16 15:45:41 -05:00
Mingliang Liu
f3015425d0 HADOOP-14416. Path starting with 'wasb:///' not resolved correctly while authorizing with WASB-Ranger. Contributed by Sivaguru Sankaridurg 
(cherry picked from commit b415c6fe743242acf1d1d3eb7ea7091d90d2c0d4)
 2017-05-16 11:28:12 -07:00
Jian He
82751ff0cb YARN-6306. NMClient API change for container upgrade. Contributed by Arun Suresh 2017-05-16 10:49:12 -07:00
Akira Ajisaka
c17cb03a23
HDFS-11833. HDFS architecture documentation descibes outdated placement policy. Contributed by Chen Liang. 
(cherry picked from commit 1d1c52b42feae5a4271ef4b771d0d8de43e83c15)
 2017-05-16 11:53:55 -04:00
Jason Lowe
feb7e92121 YARN-6603. NPE in RMAppsBlock. Contributed by Jason Lowe 
(cherry picked from commit 489f85933c508bc26de607b921e56e23b979fce8)
 2017-05-16 09:28:42 -05:00
John Zhuge
da7c900fe3 HDFS-11816. Update default SSL cipher list for HttpFS. Contributed by John Zhuge. 2017-05-15 16:26:39 -07:00
John Zhuge
2be559b842 HADOOP-14417. Update default SSL cipher list for KMS. Contributed by John Zhuge. 2017-05-15 16:24:45 -07:00
Jonathan Eagles
d370edc6aa YARN-6598. History server getApplicationReport NPE when fetching report for pre-2.8 job (Jason Lowe via jeagles) 
(cherry picked from commit c48f2976a3de60b95c4a5ada4f0131c4cdde177a)
 2017-05-15 10:32:47 -05:00
Andrew Wang
18b89e902b HDFS-11644. Support for querying outputstream capabilities. Contributed by Manoj Govindassamy. 2017-05-13 21:41:11 -07:00
Jason Lowe
aeca471ec1 HDFS-11818. TestBlockManager.testSufficientlyReplBlocksUsesNewRack fails intermittently. Contributed by Nathan Roberts 2017-05-12 17:47:17 -05:00
Jason Lowe
955e8316d5 HADOOP-14376. Memory leak when reading a compressed file using the native library. Contributed by Eli Acherkan 
(cherry picked from commit 7bc217224891b7f7f0a2e35e37e46b36d8c5309d)
 2017-05-12 16:55:49 -05:00
Haibo Chen
6284cc4663 YARN-6580. Incorrect logger for FairSharePolicy. (Vrushali C via Haibo Chen) 
(cherry picked from commit 6c35001b9f93fd85a02c3465e87bfd1612f4cce9)
 2017-05-12 13:07:17 -07:00
Vinayakumar B
53d9f56a18 HDFS-11674. reserveSpaceForReplicas is not released if append request failed due to mirror down and replica recovered (Contributed by Vinayakumar B) 
(cherry picked from commit 1411612aa4e70c704b941723217ed4efd8a0125b)
 2017-05-12 07:44:11 +05:30
Daniel Templeton
717f03ecf7 YARN-6380. FSAppAttempt keeps redundant copy of the queue 
(cherry picked from commit 90cb5b4635b7a0849912458afad052f569131a59)
 2017-05-11 13:48:46 -07:00
Min Shen
9310d24b08 YARN-5543. ResourceManager SchedulingMonitor could potentially terminate the preemption checker thread. Contributed by Min Shen. 
(cherry picked from commit 2ada100da7cfe12946e43da2929bd80c2a8bd833)
 2017-05-11 13:29:02 -07:00
Daniel Templeton
7213c935c6 HADOOP-14413. Add Javadoc comment for jitter parameter on CachingGetSpaceUsed 
(Contributed by Erik Krogen via Daniel Templeton)

(cherry picked from commit 09f28da2d2aae1487bae85ff110794f8346f92a4)
 2017-05-11 12:06:39 -07:00
Brahma Reddy Battula
3766e54893 HADOOP-14410. Correct spelling of 'beginning' and variants. Contributed By Dongtao Zhang 
(cherry picked from commit 4aae2d40a3e2e732e09b4b8a82623cacc0dc8861)
 2017-05-11 23:38:18 +05:30
Allen Wittenauer
5ef3f97c58 HADOOP-11703. git should ignore .DS_Store files on Mac OS X (Abin Shahab via aw) 
(cherry picked from commit 344d7cb6dcd3b1752c82b62271799be9e4e10416)
 2017-05-10 19:52:25 -07:00
Mingliang Liu
586126956b HADOOP-14361. Azure: NativeAzureFileSystem.getDelegationToken() call fails sometimes when invoked concurrently. Contributed by Santhosh G Nayak 
(cherry picked from commit eed731496f63537350206274af09d2118b116a17)
 2017-05-10 15:05:54 -07:00
Daniel Templeton
df3d7415c0 YARN-6571. Fix JavaDoc issues in SchedulingPolicy 
(Contributed by Weiwei Yang via Daniel Templeton)

(cherry picked from commit 18d54b5ae2f76513548c453e05cdd6d87777cd06)
 2017-05-10 14:37:36 -07:00
Mingliang Liu
214f3abe23 HDFS-11800. Document output of 'hdfs count -u' should contain PATHNAME. Contributed by Xiaobing Zhou 
(cherry picked from commit 3873904a943fbbd5dcfd154e923b90c0610ed05b)
 2017-05-10 14:34:11 -07:00
Kihwal Lee
dfaaa14a47 HDFS-11755. Underconstruction blocks can be considered missing. Contributed by Nathan Roberts. 2017-05-10 14:20:26 -05:00
Jason Lowe
0a4021387f HDFS-11745. Increase HDFS test timeouts from 1 second to 10 seconds. Contributed by Eric Badger 
(cherry picked from commit fab73748a1ce982904d332e6ddd46169f186ad54)
 2017-05-10 13:03:33 -05:00
Jason Lowe
48b5faa705 MAPREDUCE-6882. Increase MapReduce test timeouts from 1 second to 10 seconds. Contributed by Eric Badger 
(cherry picked from commit 1e71fe8c42b7945170c47023e82a0412397ff57e)
 2017-05-10 09:58:51 -05:00
Jason Lowe
3230dd1ab6 YARN-6552. Increase YARN test timeouts from 1 second to 10 seconds. Contributed by Eric Badger 
(cherry picked from commit 6099deebcb0ea23adc0f0c62db749c8f528869e9)
 2017-05-10 08:48:47 -05:00
Akira Ajisaka
d9c3c78b78
HADOOP-14373. License error in org.apache.hadoop.metrics2.util.Servers. Contributed by hu xiaodong. 
(cherry picked from commit a5fa954684f517bdf0a50f3fa7a0314f24cc7049)
 2017-05-10 05:30:37 -05:00
Masatake Iwasaki
05dda3063b HADOOP-14405. Fix performance regression due to incorrect use of DataChecksum. Contributed by LiXin Ge. 
(cherry picked from commit 06ffeb8d4d705d14e8755364099286ac4ed3bb83)
 2017-05-10 14:19:40 +09:00
Karthik Kambatla
3403ed3148 YARN-3742. YARN RM will shut down if ZKClient creation times out. (Daniel Templeton via kasha) 
(cherry picked from commit 166be0ee95d5ef976f074342656b289b41a11ccd)
 2017-05-09 14:44:39 -07:00
Jason Lowe
f9ba4ef7d5 HADOOP-14377. Increase Common test timeouts from 1 second to 10 seconds. Contributed by Eric Badger 
(cherry picked from commit f7faac8e90efaed4fbe9975c97e1b861c32cc3a3)

Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestGlobPattern.java
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/TestUserGroupInformation.java
 2017-05-09 16:16:49 -05:00
Daniel Templeton
486a160735 YARN-5301. NM mount cpu cgroups failed on some systems 
(Contributed by Miklos Szegedi via Daniel Templeton)

(cherry picked from commit a2f680493f040704e2b85108e286731ee3860a52)
 2017-05-09 12:56:28 -07:00
Lei Xu
4a95cff95d HADOOP-14384. Reduce the visibility of FileSystem.newFSDataOutputStreamBuilder before the API becomes stable. (lei) 
(cherry picked from commit 149b903be30e2b973691c30ee02f0d5b53ca0abc)
 2017-05-09 10:28:21 -07:00
Daniel Templeton
920a3078f6 YARN-6302. Fail the node if Linux Container Executor is not configured properly 
(Contributed by Miklos Szegedi via Daniel Templeton)
 2017-05-09 10:08:07 -07:00
Akira Ajisaka
753954f7be
HADOOP-14374. License error in GridmixTestUtils.java. Contributed by lixinglong. 
(cherry picked from commit c60164fb60d3d8afb0fb8410936ccc231c4593f9)
 2017-05-09 05:39:02 -05:00
Subru Krishnan
d8f0d409b9 YARN-6281. Cleanup when AMRMProxy fails to initialize a new interceptor chain. (Botong Huang via Subru) 
(cherry picked from commit 57a9afbd45b7ef8e6021cc58f96bd0074bf1389d)
(cherry picked from commit 749e5c09b9990590c282ea944e24735b795351fc)
 2017-05-08 16:58:42 -07:00
Subru Krishnan
7511cfb842 YARN-6234. Support multiple attempts on the node when AMRMProxy is enabled. (Giovanni Matteo Fumarola via Subru). 
(cherry picked from commit cd9ff27ffc9369820d0c39200a11bf00e6a767c8)
 2017-05-08 16:42:15 -07:00
Haibo Chen
86fcb8a66c YARN-6457. Allow custom SSL configuration to be supplied in WebApps. (Sanjay M Pujare via Haibo Chen) 
(cherry picked from commit 1769b12a773dc6c83f13663a77da33fa78878730)
 2017-05-08 15:47:01 -07:00
Haohui Mai
b8870d8159 HADOOP-14383. Implement FileSystem that reads from HTTP / HTTPS endpoints. 2017-05-08 15:28:30 -07:00
Jason Lowe
6ca0c134e4 YARN-3839. Quit throwing NMNotYetReadyException. Contributed by Manikandan R 
(cherry picked from commit 424887ecb7d11a72837f2757ed3ff9e0fe8c5b5d)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/TestContainerManagerRecovery.java
 2017-05-08 17:25:11 -05:00
Kihwal Lee
0d9322aa5b HDFS-11702. Remove indefinite caching of key provider uri in DFSClient. Contributed by Rushabh S Shah. 
(cherry picked from commit cef2815cf48154fe82f44082dcbdce6373c81284)
 2017-05-08 08:29:03 -05:00
Subru Krishnan
36d97e7aa8 YARN-6565. Fix memory leak and finish app trigger in AMRMProxy. (Botong Huang via Subru). 
(cherry picked from commit d6eed5acca222a281401c1d524824f0460ea7826)
 2017-05-05 16:28:51 -07:00