Commit Graph

9541 Commits

Author SHA1 Message Date
Kihwal Lee 71d0e4fca7 HDFS-10763. Open files can leak permanently due to inconsistent lease update. Contributed by Kihwal Lee. 2016-08-15 17:40:07 -05:00
Kihwal Lee 7519956c30 HDFS-9696. Garbage snapshot records linger forever. Adding an entry to CHANGES.txt. 2016-08-15 15:50:54 -05:00
Kihwal Lee e3b809a284 HDFS-9696. Garbage snapshot records linger forever. Contributed by Kihwal Lee
(cherry picked from commit 83e57e083f)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestSaveNamespace.java

(cherry picked from commit 4766a3153d)
2016-08-15 13:17:02 -05:00
Zhe Zhang 13414be1a1 HDFS-9888. Allow reseting KerberosName in unit tests. Contributed by Xiao Chen.
(cherry picked from commit 3e8099a45a)
(cherry picked from commit 00ff3d737c)
(cherry picked from commit 9c1c48c0d4)
2016-08-11 16:40:02 -07:00
Akira Ajisaka 1038e6b476 HDFS-10336. TestBalancer failing intermittently because of not reseting UserGroupInformation completely. Contributed by Yiqun Lin.
(cherry picked from commit 932aed64d7)
(cherry picked from commit 0529da7239)
(cherry picked from commit f29d0739d7)
2016-08-11 16:21:35 -07:00
Zhe Zhang 7f78740885 HDFS-9804. Allow long-running Balancer to login with keytab. Contributed by Xiao Chen.
(cherry picked from commit ccff6035f5)
(cherry picked from commit 7d402692b4)
(cherry picked from commit b8b4ea67d8)
2016-08-11 16:18:40 -07:00
Jason Lowe c2d3af39f1 YARN-5382. RM does not audit log kill request for active applications. Contributed by Vrushali C 2016-08-10 19:18:02 +00:00
Yuanbo Liu e88546596d HDFS-10694. processReport() should print blockReportId in each log message. Contributed by Yuanbo Liu.
(cherry picked from commit 6dfa4fb16e449a248f2f3cf43a6be59dd8e1ac78)
2016-08-10 11:14:33 -07:00
Jason Lowe f5754fe5bc YARN-5483. Optimize RMAppAttempt#pullJustFinishedContainers. Contributed by sandflee 2016-08-10 18:12:07 +00:00
Jason Lowe 5580626ea0 YARN-5262. Optimize sending RMNodeFinishedContainersPulledByAMEvent for every AM heartbeat. Contributed by Rohith Sharma K S
(cherry picked from commit 26b5e6116f)
2016-08-09 22:20:22 +00:00
Konstantin V Shvachko bfc261f2a0 HDFS-10693. metaSave should print blocks, not LightWeightHashSet. Contributed by Yuanbo Liu.
(cherry picked from commit 4d3af47f27)
2016-08-07 15:02:51 -07:00
Jason Lowe 7bbd3cf650 YARN-4573. Fix test failure in TestRMAppTransitions#testAppRunningKill and testAppKilledKilled. (Takashi Ohnishi via rohithsharmaks)
(cherry picked from commit c01bee0108)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
2016-08-05 20:12:23 +00:00
Arpit Agarwal 9669779f2c HADOOP-13434. Add bash quoting to Shell class. (Owen O'Malley) 2016-08-03 14:28:44 -07:00
Jason Lowe 2bf4e76370 HADOOP-10980. TestActiveStandbyElector fails occasionally in trunk. Contributed by Eric Badger
(cherry picked from commit c82745432a)

Conflicts:

	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ha/ActiveStandbyElector.java
2016-08-03 20:27:15 +00:00
Jason Lowe 47e1eabf79 YARN-5469. Increase timeout of TestAmFilter.testFilter. Contributed by Eric Badger
(cherry picked from commit db4a61dc61)
2016-08-03 19:55:59 +00:00
Jason Lowe 22b9a6ce4a YARN-4717. TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IllegalArgumentException from cleanup (templedf via rkanter)
(cherry picked from commit 22ca176dfe)
2016-08-03 19:37:23 +00:00
Jason Lowe 4948fce1c1 YARN-5462. TestNodeStatusUpdater.testNodeStatusUpdaterRetryAndNMShutdown fails intermittently. Contributed by Eric Badger
(cherry picked from commit db646540f0)
2016-08-03 19:21:27 +00:00
Konstantin V Shvachko a8886dcc20 HDFS-8780. Follow up commit to add missing lines from porting to branch-2.7. 2016-08-02 13:26:36 -07:00
Konstantin V Shvachko 0c3282b35c Revert "HDFS-10301. Interleaving processing of storages from repeated block reports causes false zombie storage detection, removes valid blocks. Contributed by Vinitha Gankidi."
This reverts commit a76eb7fa34.
2016-08-02 10:53:06 -07:00
Vinitha Reddy Gankidi a76eb7fa34 HDFS-10301. Interleaving processing of storages from repeated block reports causes false zombie storage detection, removes valid blocks. Contributed by Vinitha Gankidi. 2016-07-30 17:01:49 -07:00
Akira Ajisaka 379d587d23 HDFS-10691. FileDistribution fails in hdfs oiv command due to ArrayIndexOutOfBoundsException. Contributed by Yiqun Lin. 2016-07-30 08:29:55 +09:00
Vinayakumar B 2371ed0551 HDFS-8682. Should not remove decommissioned node,while calculating the number of live/dead decommissioned node. (Contributed by J. Andreina)
(cherry picked from commit fdb56f74f3)
2016-07-29 16:07:33 -07:00
Konstantin V Shvachko fb00663aaa HDFS-8780. Fetching live/dead datanode list with arg true for removeDecommissionNode,returns list with decom node. (Contributed by J.Andreina)
(cherry picked from commit 2893da4f53)
2016-07-29 15:56:12 -07:00
Wangda Tan 6cb2e9733d Backport Doclet fixes from YARN-3426 2016-07-27 16:41:55 -07:00
Haohui Mai 63711c3960 HADOOP-11814. Reformat hadoop-annotations, o.a.h.classification.tools. Contributed by Li Lu.
(cherry picked from commit dc0282d64c)
2016-07-27 16:41:55 -07:00
Masatake Iwasaki b904a7fd00 HDFS-9601. NNThroughputBenchmark.BlockReportStats should handle NotReplicatedYetException on adding block. (iwasakims) 2016-07-28 00:45:13 +09:00
Jason Lowe 4edff93c7c MAPREDUCE-6744. Increase timeout on TestDFSIO tests. Contributed by Eric Badger
(cherry picked from commit 703fdf86c6)
2016-07-25 21:59:48 +00:00
Rohith Sharma K S 400a6144e2 YARN-5092. TestRMDelegationTokens fails intermittently. Contributed by Jason Lowe. 2016-07-22 20:57:35 +05:30
Jing Zhao 2a5b8e5b3a HDFS-10653. Optimize conversion from path string to components. Contributed by Daryn Sharp.
(cherry picked from commit bd3dcf46e2)
(cherry picked from commit 6a7fe835f1)
2016-07-21 11:30:06 -07:00
Jason Lowe 9938010264 YARN-3707. RM Web UI queue filter doesn't work. Contributed by Wangda Tan
(cherry picked from commit 446d51591e)
(cherry picked from commit 03af057a47)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
2016-07-21 18:17:29 +00:00
Jason Lowe 5220d4dc27 HADOOP-11149. Increase the timeout of TestZKFailoverController. Contributed by Steve Loughran.
(cherry picked from commit 579f9030da)

Conflicts:

	hadoop-common-project/hadoop-common/CHANGES.txt
2016-07-21 15:01:56 +00:00
Varun Vasudev 1b8641a3c3 YARN-5309. Fix SSLFactory truststore reloader thread leak in TimelineClientImpl. Contributed by Weiwei Yang. 2016-07-20 13:06:31 +05:30
Akira Ajisaka a6798991f0 HADOOP-12991. Conflicting default ports in DelegateToFileSystem. Contributed by Kai Sasaki.
(cherry picked from commit dc065dd64c)
(cherry picked from commit 8fe2c450b3)
2016-07-19 16:07:40 -07:00
Akira Ajisaka 833117c219 HADOOP-13202. Avoid possible overflow in org.apache.hadoop.util.bloom.BloomFilter#getNBytes. Contributed by Kai Sasaki.
(cherry picked from commit c2bcffb34e)
(cherry picked from commit 09375baad1)
2016-07-18 11:52:43 -07:00
Tsuyoshi Ozawa 65adabd0d1 HADOOP-13298. Fix the leftover L&N files in hadoop-build-tools/src/main/resources/META-INF/. (ozawa)
(cherry picked from commit ea9f43781e)
2016-07-16 08:20:43 +09:00
Arpit Agarwal c35c1e6703 HDFS-10623. Remove unused import of httpclient.HttpConnection from TestWebHdfsTokens. (Contributed by Hanisha Koneru) 2016-07-14 13:01:15 -07:00
Zhe Zhang 45ed97e0d2 HADOOP-13290. Appropriate use of generics in FairCallQueue. Contributed by Jonathan Hung.
(cherry picked from commit 728bf7f698)
(cherry picked from commit b95f1af8a9)
(cherry picked from commit cbd885b6fa)
2016-07-13 16:49:54 -07:00
Zhe Zhang c7e1e92c1a HDFS-10544. Balancer doesn't work with IPFailoverProxyProvider.
(cherry picked from commit 087290e6b1)
(cherry picked from commit 5b4e916b3c)
(cherry picked from commit af94dfaa53)
2016-07-13 14:36:26 -07:00
Arpit Agarwal 771033babd HADOOP-12570. HDFS Secure Mode Documentation updates. (Arpit Agarwal) 2016-07-13 13:02:01 -07:00
Tsuyoshi Ozawa 7c5e7433e1 HADOOP-11361. Fix a race condition in MetricsSourceAdapter.updateJmxCache. Contributed by Vinayakumar B, Yongjun Zhang, and Brahma Reddy Battula. (ozawa)
Updated CHANGES.txt

(cherry picked from commit 77ffe76212)
2016-07-13 21:49:02 +09:00
Varun Saxena 954dac6860 YARN-5353. ResourceManager can leak delegation tokens when they are shared across apps. (Jason Lowe via Varun Saxena). 2016-07-13 07:31:49 +05:30
Vinod Kumar Vavilapalli c454639abf HADOOP-13312. Updated CHANGES.txt to reflect all the changes in branch-2.7. Contributed by Akira Ajisaka. 2016-07-12 15:41:22 -07:00
Jason Lowe f8f995629d YARN-4393. Fix intermittent test failure for TestResourceLocalizationService#testFailedDirsResourceRelease (Varun Saxana via rohithsharmaks)
(cherry picked from commit 791c1639ae)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
2016-07-12 19:30:53 +00:00
Akira Ajisaka e8c253d500 HADOOP-13297. Add missing dependency in setting maven-remote-resource-plugin to fix builds. Contributed by Sean Busbey.
(cherry picked from commit 7bd5d4272c)
(cherry picked from commit 02b037f625)
2016-07-11 17:24:35 -07:00
Jason Lowe 6759cbc56a HADOOP-13362. DefaultMetricsSystem leaks the source name when a source unregisters. Contributed by Junping Du 2016-07-11 20:58:40 +00:00
Andrew Wang 830516b8c5 HADOOP-13350. Additional fix to LICENSE and NOTICE. Contributed by Xiao Chen. 2016-07-07 10:45:01 -07:00
Andrew Wang 5ebebc6524 HDFS-10488. Update WebHDFS documentation regarding CREATE and MKDIR default permissions. Contributed by Wellington Chevreuil.
(cherry picked from commit 728623242f)
2016-07-07 10:38:33 -07:00
Yongjun Zhang 81f0d56c57 HDFS-10396. Using -diff option with DistCp may get "Comparison method violates its general contract" exception. Contributed by Yongjun Zhang.
(cherry picked from commit 8113855b3a)
2016-06-28 23:45:19 -07:00
Chris Douglas 7595d89612 HADOOP-12636. Prevent ServiceLoader failure init for unused FileSystems. Contributed by Inigo Goiri.
Cherry picked from commit #8652cce5b2
2016-06-27 14:32:42 +01:00
Masatake Iwasaki 01f5e609a2 HADOOP-12588. addendum patch to fix intermittent failure of TestGangliaMetrics. (iwasakims)
(cherry picked from commit 67089875f0)
2016-06-22 23:52:44 +09:00