Commit Graph

13406 Commits

Author SHA1 Message Date
Jason Lowe 955e8316d5 HADOOP-14376. Memory leak when reading a compressed file using the native library. Contributed by Eli Acherkan
(cherry picked from commit 7bc2172248)
2017-05-12 16:55:49 -05:00
Haibo Chen 6284cc4663 YARN-6580. Incorrect logger for FairSharePolicy. (Vrushali C via Haibo Chen)
(cherry picked from commit 6c35001b9f)
2017-05-12 13:07:17 -07:00
Vinayakumar B 53d9f56a18 HDFS-11674. reserveSpaceForReplicas is not released if append request failed due to mirror down and replica recovered (Contributed by Vinayakumar B)
(cherry picked from commit 1411612aa4)
2017-05-12 07:44:11 +05:30
Daniel Templeton 717f03ecf7 YARN-6380. FSAppAttempt keeps redundant copy of the queue
(cherry picked from commit 90cb5b4635)
2017-05-11 13:48:46 -07:00
Min Shen 9310d24b08 YARN-5543. ResourceManager SchedulingMonitor could potentially terminate the preemption checker thread. Contributed by Min Shen.
(cherry picked from commit 2ada100da7)
2017-05-11 13:29:02 -07:00
Daniel Templeton 7213c935c6 HADOOP-14413. Add Javadoc comment for jitter parameter on CachingGetSpaceUsed
(Contributed by Erik Krogen via Daniel Templeton)

(cherry picked from commit 09f28da2d2)
2017-05-11 12:06:39 -07:00
Brahma Reddy Battula 3766e54893 HADOOP-14410. Correct spelling of 'beginning' and variants. Contributed By Dongtao Zhang
(cherry picked from commit 4aae2d40a3)
2017-05-11 23:38:18 +05:30
Allen Wittenauer 5ef3f97c58 HADOOP-11703. git should ignore .DS_Store files on Mac OS X (Abin Shahab via aw)
(cherry picked from commit 344d7cb6dc)
2017-05-10 19:52:25 -07:00
Mingliang Liu 586126956b HADOOP-14361. Azure: NativeAzureFileSystem.getDelegationToken() call fails sometimes when invoked concurrently. Contributed by Santhosh G Nayak
(cherry picked from commit eed731496f)
2017-05-10 15:05:54 -07:00
Daniel Templeton df3d7415c0 YARN-6571. Fix JavaDoc issues in SchedulingPolicy
(Contributed by Weiwei Yang via Daniel Templeton)

(cherry picked from commit 18d54b5ae2f76513548c453e05cdd6d87777cd06)
2017-05-10 14:37:36 -07:00
Mingliang Liu 214f3abe23 HDFS-11800. Document output of 'hdfs count -u' should contain PATHNAME. Contributed by Xiaobing Zhou
(cherry picked from commit 3873904a94)
2017-05-10 14:34:11 -07:00
Kihwal Lee dfaaa14a47 HDFS-11755. Underconstruction blocks can be considered missing. Contributed by Nathan Roberts. 2017-05-10 14:20:26 -05:00
Jason Lowe 0a4021387f HDFS-11745. Increase HDFS test timeouts from 1 second to 10 seconds. Contributed by Eric Badger
(cherry picked from commit fab73748a1)
2017-05-10 13:03:33 -05:00
Jason Lowe 48b5faa705 MAPREDUCE-6882. Increase MapReduce test timeouts from 1 second to 10 seconds. Contributed by Eric Badger
(cherry picked from commit 1e71fe8c42)
2017-05-10 09:58:51 -05:00
Jason Lowe 3230dd1ab6 YARN-6552. Increase YARN test timeouts from 1 second to 10 seconds. Contributed by Eric Badger
(cherry picked from commit 6099deebcb)
2017-05-10 08:48:47 -05:00
Akira Ajisaka d9c3c78b78
HADOOP-14373. License error in org.apache.hadoop.metrics2.util.Servers. Contributed by hu xiaodong.
(cherry picked from commit a5fa954684)
2017-05-10 05:30:37 -05:00
Masatake Iwasaki 05dda3063b HADOOP-14405. Fix performance regression due to incorrect use of DataChecksum. Contributed by LiXin Ge.
(cherry picked from commit 06ffeb8d4d)
2017-05-10 14:19:40 +09:00
Karthik Kambatla 3403ed3148 YARN-3742. YARN RM will shut down if ZKClient creation times out. (Daniel Templeton via kasha)
(cherry picked from commit 166be0ee95)
2017-05-09 14:44:39 -07:00
Jason Lowe f9ba4ef7d5 HADOOP-14377. Increase Common test timeouts from 1 second to 10 seconds. Contributed by Eric Badger
(cherry picked from commit f7faac8e90)

Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestGlobPattern.java
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/TestUserGroupInformation.java
2017-05-09 16:16:49 -05:00
Daniel Templeton 486a160735 YARN-5301. NM mount cpu cgroups failed on some systems
(Contributed by Miklos Szegedi via Daniel Templeton)

(cherry picked from commit a2f680493f)
2017-05-09 12:56:28 -07:00
Lei Xu 4a95cff95d HADOOP-14384. Reduce the visibility of FileSystem.newFSDataOutputStreamBuilder before the API becomes stable. (lei)
(cherry picked from commit 149b903be3)
2017-05-09 10:28:21 -07:00
Daniel Templeton 920a3078f6 YARN-6302. Fail the node if Linux Container Executor is not configured properly
(Contributed by Miklos Szegedi via Daniel Templeton)
2017-05-09 10:08:07 -07:00
Akira Ajisaka 753954f7be
HADOOP-14374. License error in GridmixTestUtils.java. Contributed by lixinglong.
(cherry picked from commit c60164fb60)
2017-05-09 05:39:02 -05:00
Subru Krishnan d8f0d409b9 YARN-6281. Cleanup when AMRMProxy fails to initialize a new interceptor chain. (Botong Huang via Subru)
(cherry picked from commit 57a9afbd45b7ef8e6021cc58f96bd0074bf1389d)
(cherry picked from commit 749e5c09b9)
2017-05-08 16:58:42 -07:00
Subru Krishnan 7511cfb842 YARN-6234. Support multiple attempts on the node when AMRMProxy is enabled. (Giovanni Matteo Fumarola via Subru).
(cherry picked from commit cd9ff27ffc)
2017-05-08 16:42:15 -07:00
Haibo Chen 86fcb8a66c YARN-6457. Allow custom SSL configuration to be supplied in WebApps. (Sanjay M Pujare via Haibo Chen)
(cherry picked from commit 1769b12a77)
2017-05-08 15:47:01 -07:00
Haohui Mai b8870d8159 HADOOP-14383. Implement FileSystem that reads from HTTP / HTTPS endpoints. 2017-05-08 15:28:30 -07:00
Jason Lowe 6ca0c134e4 YARN-3839. Quit throwing NMNotYetReadyException. Contributed by Manikandan R
(cherry picked from commit 424887ecb7)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/TestContainerManagerRecovery.java
2017-05-08 17:25:11 -05:00
Kihwal Lee 0d9322aa5b HDFS-11702. Remove indefinite caching of key provider uri in DFSClient. Contributed by Rushabh S Shah.
(cherry picked from commit cef2815cf4)
2017-05-08 08:29:03 -05:00
Subru Krishnan 36d97e7aa8 YARN-6565. Fix memory leak and finish app trigger in AMRMProxy. (Botong Huang via Subru).
(cherry picked from commit d6eed5acca)
2017-05-05 16:28:51 -07:00
Sidharta S 6186d2e742 YARN-6374. Improve test coverage and add utility classes for common Docker operations. Contributed by Shane Kumpf 2017-05-04 14:41:04 -07:00
Lei Xu 1f30a8a105 HDFS-11687. Add new public encryption APIs required by Hive. (lei)
Change-Id: I4a23a00de63ad18022312ceb1f306a87d032d07c
(cherry picked from commit 25f5d9ad5e)
2017-05-04 12:07:29 -07:00
Arpit Agarwal 89baea96d5 HDFS-11722. Change Datanode file IO profiling sampling to percentage. Contributed by Hanisha Koneru. 2017-05-03 16:30:01 -07:00
Arpit Agarwal 4b7d1ff326 Revert "HDFS-11488. JN log segment syncing should support HA upgrade. Contributed by Hanisha Koneru."
This reverts commit dfc6ef42c4.
2017-05-03 16:29:44 -07:00
Arpit Agarwal dfc6ef42c4 HDFS-11488. JN log segment syncing should support HA upgrade. Contributed by Hanisha Koneru. 2017-05-03 15:53:43 -07:00
Mingliang Liu 616413ecb2 HDFS-11739. Fix regression in tests caused by YARN-679. Contributed by Steve Loughran
(cherry picked from commit 83dded556d)
2017-05-03 11:23:15 -07:00
Kihwal Lee f843c8ccf5 HADOOP-14372. TestSymlinkLocalFS timeouts are too low. Contributed by Eric Badger.
(cherry picked from commit d4631e466b)
2017-05-03 09:49:17 -05:00
Erik Krogen 9d6b873d3c HDFS-11717. Add unit test for HDFS-11709 StandbyCheckpointer should handle non-existing legacyOivImageDir gracefully. Contributed by Erik Krogen.
(cherry picked from commit d9014bda93)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestStandbyCheckpoints.java
2017-05-02 18:39:37 -07:00
Jason Lowe 9e9c3a511c HADOOP-14306. TestLocalFileSystem tests have very low timeouts. Contributed by Eric Badger
(cherry picked from commit cedaf4cab9)
2017-05-02 16:52:52 -05:00
Daniel Templeton b337a1da31 YARN-6481. Yarn top shows negative container number in FS
(Contributed by Tao Jie via Daniel Templeton)

(cherry picked from commit 9f0aea0ee2)
2017-05-02 13:15:18 -07:00
Naganarasimha 5e28311341 YARN-6519. Fix warnings from Spotbugs in hadoop-yarn-server-resourcemanager. Contributed by Weiwei Yang. 2017-05-03 00:36:33 +05:30
Andrew Wang 484bab3944 HADOOP-14369. NetworkTopology calls expensive toString() when logging. Contributed by Inigo Goiri.
(cherry picked from commit dcc292d7de)
2017-05-02 10:53:57 -07:00
Akira Ajisaka 036624900b
HADOOP-14371. License error in TestLoadBalancingKMSClientProvider.java. Contributed by hu xiaodong.
(cherry picked from commit 20cde55274)
2017-05-02 23:39:00 +09:00
Subru Krishnan 6d53224afc YARN-5331. Extend RLESparseResourceAllocation with period for supporting recurring reservations in YARN ReservationSystem. (Sangeetha Abdu Jyothi via Subru).
(cherry picked from commit 6bf42e48ef)
2017-05-01 18:49:14 -07:00
Subru Krishnan 2030f408e0 YARN-6542. Fix the logger in TestAlignedPlanner and TestGreedyReservationAgent.
(cherry picked from commit e514fc432a)
2017-05-01 18:31:08 -07:00
Subru Krishnan 0eae1c6368 YARN-4359. Update LowCost agents logic to take advantage of YARN-4358. (Jonathan Yaniv and Ishai Menache via Subru).
(cherry picked from commit a3a615eeab)
2017-05-01 18:30:58 -07:00
Xiaoyu Yao 3e7f97fb0b HDFS-11593. Change SimpleHttpProxyHandler#exceptionCaught log level from info to debug. Contributed by Xiaobing Zhou.
(cherry picked from commit 1058b40843)
2017-05-01 16:13:30 -07:00
Kihwal Lee f77d138725 HDFS-11714. Newly added NN storage directory won't get initialized and cause space exhaustion. Contributed by Kihwal Lee. 2017-05-01 17:33:24 -05:00
Kihwal Lee 6a6d0ece99 HDFS-11609. Some blocks can be permanently lost if nodes are decommissioned while dead. Contributed by Kihwal Lee. 2017-05-01 14:20:37 -05:00
Steve Loughran 5ca4f0f82e YARN-524 TestYarnVersionInfo failing if generated properties doesn't include an SVN URL
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1463300 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 7c65dbb938)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
2017-05-01 08:58:12 -05:00