Commit Graph

12397 Commits

Author SHA1 Message Date
Wei-Chiu Chuang caad191c0e Revert "HDFS-10797. Disk usage summary of snapshots causes renamed blocks to get counted twice. Contributed by Sean Mackrory."
This reverts commit 998e44a972.
2017-05-24 18:12:03 -07:00
Wei-Chiu Chuang 6c50341ea8 Revert "HDFS-11515. -du throws ConcurrentModificationException. Contributed by Istvan Fajth, Wei-Chiu Chuang."
This reverts commit f9d3bb3b83.
2017-05-24 18:11:42 -07:00
Amar Kamat 425d597d48 HADOOP-7851. Configuration.getClasses() never returns the default value. (amarrk)
(cherry picked from commit 82d57ee7fe)
2017-05-24 17:06:26 -07:00
Brahma Reddy Battula d9492839d0 HADOOP-14166. Reset the DecayRpcScheduler AvgResponseTime metric to zero when queue is not used. Contributed by Surendra Singh Lilhore.
(cherry picked from commit dcf4559ebd)
2017-05-25 01:28:36 +08:00
Brahma Reddy Battula cf4e6d6b1d HADOOP-14449. The ASF Header in ComparableVersion.java and SSLHostnameVerifier.java is not correct. Contributed by ZhangBing Lin.
(cherry picked from commit b7a0c0e701)
2017-05-25 01:09:20 +08:00
Jason Lowe 7ef01c7c49 YARN-6615. AmIpFilter drops query parameters on redirect. Contributed by Wilfred Spiegelenburg 2017-05-24 11:27:21 -05:00
Brahma Reddy Battula 462c6fb5b1 HDFS-11864. Document Metrics to track usage of memory for writes. Contributed by Yiqun Lin.
(cherry picked from commit 52661e0912)
2017-05-24 23:47:20 +08:00
Brahma Reddy Battula a7f063576c HDFS-11849. JournalNode startup failure exception should be logged in log file. Contributed By Surendra Singh Lilhore.
(cherry picked from commit 9cab42cc79)
2017-05-24 23:45:57 +08:00
Yiqun Lin 94a80974d3 HDFS-11377. Balancer hung due to no available mover threads. Contributed by yunjiong zhao.
(cherry picked from commit 9cbbd1eae8)
2017-05-22 17:11:52 -07:00
Wangda Tan 836e8f3e69 YARN-6493. Print requested node partition in assignContainer logs. (Jonathan Hung via wangda)
Change-Id: I3c5c012eb8d0887a4a37d58662bc37aac07ea86e
2017-05-22 14:57:54 -07:00
Xuan cef5ef2377 YARN-4612. Fix rumen and scheduler load simulator handle killed tasks
properly. Contributed by Ming Ma.

(cherry picked from commit 4efdf3a979)
2017-05-21 12:51:16 -07:00
Eric Payne 71d91d53bf YARN-6618. TestNMLeveldbStateStoreService#testCompactionCycle can fail if compaction occurs more than once. Contributed by Jason Lowe.
(cherry picked from commit 19482e0d09)
2017-05-19 11:36:18 -05:00
Varun Vasudev 23bbbce63e Sanitize arguments before launching Docker containers. 2017-05-18 12:03:52 +05:30
Varun Vasudev 51e65cc710 Validate docker image name before launching container. 2017-05-18 11:53:16 +05:30
Chris Douglas 9791ecc9d8 YARN-6577. Remove unused ContainerLocalization classes. Contributed by ZhangBing Lin
(cherry picked from commit b23fcc86c6)
(cherry picked from commit 3d2afb209c)
2017-05-17 20:42:27 -07:00
Chris Douglas 475b50b44c HADOOP-14434. Use MoveFileEx to allow renaming a file when the destination exists. Contributed by Lukas Majercak
(cherry picked from commit ef9e536a71)
(cherry picked from commit 4bb0565443)
2017-05-17 17:25:08 -07:00
Rohith Sharma K S c61956dd1e HADOOP-14412. HostsFileReader#getHostDetails is very expensive on large clusters. Contributed by Jason Lowe. 2017-05-17 08:26:17 +05:30
Kihwal Lee 95e8f4c80d HDFS-11641. Reduce cost of audit logging by using FileStatus instead of HdfsFileStatus. Contributed by Daryn Sharp.
(cherry picked from commit 82ea3f4545)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
2017-05-16 15:55:53 -05:00
Akira Ajisaka 9b595ba40b
HDFS-11833. HDFS architecture documentation descibes outdated placement policy. Contributed by Chen Liang.
(cherry picked from commit 1d1c52b42f)
(cherry picked from commit c17cb03a23)
2017-05-16 11:54:27 -04:00
Jason Lowe c2d7c12477 YARN-6603. NPE in RMAppsBlock. Contributed by Jason Lowe
(cherry picked from commit 489f85933c)
2017-05-16 09:29:18 -05:00
Jonathan Eagles c992cf638e YARN-6598. History server getApplicationReport NPE when fetching report for pre-2.8 job (Jason Lowe via jeagles) 2017-05-15 12:10:12 -05:00
Jason Lowe f42222a75b HDFS-11818. TestBlockManager.testSufficientlyReplBlocksUsesNewRack fails intermittently. Contributed by Nathan Roberts
(cherry picked from commit aeca471ec1)
2017-05-12 17:48:00 -05:00
Jason Lowe dfa2657abf HADOOP-14376. Memory leak when reading a compressed file using the native library. Contributed by Eli Acherkan
(cherry picked from commit 7bc2172248)
2017-05-12 16:59:21 -05:00
Vinayakumar B b121e047b4 HDFS-11674. reserveSpaceForReplicas is not released if append request failed due to mirror down and replica recovered (Contributed by Vinayakumar B)
(cherry picked from commit 1411612aa4)
(cherry picked from commit 53d9f56a18)
2017-05-12 07:47:57 +05:30
Min Shen aae0600a67 YARN-5543. ResourceManager SchedulingMonitor could potentially terminate the preemption checker thread. Contributed by Min Shen.
(cherry picked from commit 2ada100da7)
2017-05-11 13:31:02 -07:00
Allen Wittenauer d4ab50f9b0 HADOOP-11703. git should ignore .DS_Store files on Mac OS X (Abin Shahab via aw)
(cherry picked from commit 344d7cb6dc)
2017-05-10 19:55:37 -07:00
Kihwal Lee a8f209dee7 HDFS-11755. Underconstruction blocks can be considered missing. Contributed by Nathan Roberts. 2017-05-10 14:22:17 -05:00
Jason Lowe ef120bed7b HDFS-11745. Increase HDFS test timeouts from 1 second to 10 seconds. Contributed by Eric Badger
(cherry picked from commit fab73748a1)
2017-05-10 13:03:48 -05:00
Jason Lowe 030d521a69 MAPREDUCE-6882. Increase MapReduce test timeouts from 1 second to 10 seconds. Contributed by Eric Badger
(cherry picked from commit 1e71fe8c42)
2017-05-10 09:59:10 -05:00
Jason Lowe f32db1be1e YARN-6552. Increase YARN test timeouts from 1 second to 10 seconds. Contributed by Eric Badger
(cherry picked from commit 6099deebcb)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/cli/TestLogsCLI.java
2017-05-10 08:53:33 -05:00
Akira Ajisaka 4f8dd60e49
HADOOP-14373. License error in org.apache.hadoop.metrics2.util.Servers. Contributed by hu xiaodong.
(cherry picked from commit a5fa954684)
(cherry picked from commit d9c3c78b78)
2017-05-10 05:30:55 -05:00
Masatake Iwasaki 59702efb78 HADOOP-14405. Fix performance regression due to incorrect use of DataChecksum. Contributed by LiXin Ge.
(cherry picked from commit 06ffeb8d4d)
2017-05-10 14:45:23 +09:00
Jason Lowe 7489f0fd1a HADOOP-14377. Increase Common test timeouts from 1 second to 10 seconds. Contributed by Eric Badger
(cherry picked from commit f9ba4ef7d5)

Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/service/TestCompositeService.java
2017-05-09 16:23:31 -05:00
Lei Xu 5b8564f986 HDFS-11687. Add new public encryption APIs required by Hive. (lei)
Change-Id: I4a23a00de63ad18022312ceb1f306a87d032d07c
(cherry picked from commit 25f5d9ad5e)
(cherry picked from commit 1f30a8a105)
2017-05-09 12:11:48 -07:00
Haibo Chen 3799625e90 YARN-6457. Allow custom SSL configuration to be supplied in WebApps. (Sanjay M Pujare via Haibo Chen)
(cherry picked from commit 1769b12a77)
(cherry picked from commit 86fcb8a66c)
2017-05-09 08:52:37 -07:00
Akira Ajisaka 8007d024b8
HADOOP-14374. License error in GridmixTestUtils.java. Contributed by lixinglong.
(cherry picked from commit c60164fb60)
(cherry picked from commit 753954f7be)
2017-05-09 05:39:26 -05:00
Varun Vasudev 341457a0f2 YARN-4562. YARN WebApp ignores the configuration passed to it for keystore settings. Contributed by Sergey Shelukhin.
(cherry picked from commit 07920acc16)
(cherry picked from commit 4baee3eb67)
2017-05-09 10:59:15 +05:30
Kihwal Lee f8b6aa1ed1 HADOOP-13437. KMS should reload whitelist and default key ACLs when hot-reloading. Contributed by Xiao Chen.
(cherry picked from commit 9daa9979a1)
2017-05-08 08:36:53 -05:00
Kihwal Lee 9d8d3a84bd HDFS-11702. Remove indefinite caching of key provider uri in DFSClient. Contributed by Rushabh S Shah.
(cherry picked from commit cef2815cf4)
2017-05-08 08:31:18 -05:00
Xiaoyu Yao a80ac0822b HADOOP-14207. "dfsadmin -refreshCallQueue" fails with DecayRpcScheduler. Contributed by Surendra Singh Lihore.
(cherry picked from commit 918dee10f56861d15bb6644edcefb4246a3e00a4)
(cherry picked from commit 81883e3150c42e866ba9e68d68b734f2772344b2)
2017-05-04 16:03:39 -07:00
Kihwal Lee 103dfae7b9 HADOOP-14372. TestSymlinkLocalFS timeouts are too low. Contributed by Eric Badger.
(cherry picked from commit d4631e466b)
2017-05-03 09:49:50 -05:00
Erik Krogen bcafaf2c61 HDFS-11717. Add unit test for HDFS-11709 StandbyCheckpointer should handle non-existing legacyOivImageDir gracefully. Contributed by Erik Krogen.
(cherry picked from commit d9014bda93)
(cherry picked from commit 9d6b873d3c)
2017-05-02 18:44:26 -07:00
Jason Lowe e4af087d92 HADOOP-14306. TestLocalFileSystem tests have very low timeouts. Contributed by Eric Badger
(cherry picked from commit cedaf4cab9)
2017-05-02 16:54:00 -05:00
Karthik Kambatla dd46bc0f54 YARN-5343. TestContinuousScheduling#testSortedNodes fails intermittently. (Yufei Gu via kasha)
(cherry picked from commit 7992c0b42c)
2017-05-02 16:46:10 -05:00
Karthik Kambatla d382a21423 YARN-4812. TestFairScheduler#testContinuousScheduling fails intermittently. (kasha)
(cherry picked from commit f84af8bd58)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestContinuousScheduling.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestFairScheduler.java
2017-05-02 16:40:46 -05:00
Ming Ma d1ae1fb449 HDFS-9922. Upgrade Domain placement policy status marks a good block in violation when there are decommissioned nodes. (Chris Trezzo via mingma)
(cherry picked from commit b48f27e794)
(cherry picked from commit 32b115da1d)
2017-05-02 12:48:51 -07:00
Andrew Wang ab511286fd HADOOP-14369. NetworkTopology calls expensive toString() when logging. Contributed by Inigo Goiri.
(cherry picked from commit dcc292d7de)
(cherry picked from commit 484bab3944)
2017-05-02 10:53:59 -07:00
Ming Ma 305a9d886a HDFS-9016. Display upgrade domain information in fsck. 2017-05-02 09:52:16 -07:00
Akira Ajisaka 42fa35d531
HADOOP-14371. License error in TestLoadBalancingKMSClientProvider.java. Contributed by hu xiaodong.
(cherry picked from commit 20cde55274)
(cherry picked from commit 036624900b)
2017-05-02 23:39:25 +09:00
Ming Ma c4c5533216 HDFS-9005. Provide configuration support for upgrade domain. 2017-05-02 06:53:32 -07:00