Commit Graph

11377 Commits

Author SHA1 Message Date
mattf-horton c96cb3fd48 HADOOP-13382. Remove unneeded commons-httpclient dependencies from POM files in Hadoop and sub-projects, while adding it in to the only place it is still needed, hadoop-openstack. Contributed by Matt Foley. 2016-07-21 16:01:05 -07:00
Chris Nauroth af3c860bb1 HADOOP-13240. TestAclCommands.testSetfaclValidations fail. Contributed by John Zhuge.
(cherry picked from commit 43cf6b101d)
(cherry picked from commit 382bcf21e7)
2016-07-21 14:12:47 -07:00
Jakob Homan 9442e1d48e HADOOP-12009. Clarify FileSystem.listStatus() sorting order & fix FileSystemContractBaseTest:testListStatus. backport to 2.8 2016-07-21 21:50:25 +01:00
Akira Ajisaka 3dcbd2df56 MAPREDUCE-6738. TestJobListCache.testAddExisting failed intermittently in slow VM testbed. Contributed by Junping Du.
(cherry picked from commit ecff7d0359)
(cherry picked from commit f4d94f2246)
2016-07-21 11:38:26 -07:00
Jing Zhao 6a7fe835f1 HDFS-10653. Optimize conversion from path string to components. Contributed by Daryn Sharp.
(cherry picked from commit bd3dcf46e2)
2016-07-21 11:29:27 -07:00
Akira Ajisaka 2f14d585c4 HDFS-10287. MiniDFSCluster should implement AutoCloseable. Contributed by Andras Bokor.
(cherry picked from commit fcde6940e0)
(cherry picked from commit 1222889f1a)
2016-07-21 11:28:46 -07:00
Rohith Sharma K S 7234fce25b YARN-5092. TestRMDelegationTokens fails intermittently. Contributed by Jason Lowe.
(cherry picked from commit 557a245d83)
2016-07-21 12:49:52 +05:30
Rohith Sharma K S cdcd131d5f YARN-1126. Add validation of users input nodes-states options to nodes CLI. Contributed by Wei Yan.
(cherry picked from commit be34b2a8fd)
2016-07-21 12:25:14 +05:30
Akira Ajisaka 66f3056090 YARN-4883. Make consistent operation name in AdminService. Contributed by Kai Sasaki.
(cherry picked from commit c63afdbe14)
(cherry picked from commit 2bf5c4eb1a)
2016-07-20 16:52:22 -07:00
Allen Wittenauer 35885e9540 HDFS-9852. hdfs dfs -setfacl error message is misleading (Wei-Chiu Chuang via aw)
(cherry picked from commit b3649adf6a)
(cherry picked from commit 84c785036f)
2016-07-20 11:30:52 -07:00
Vinod Kumar Vavilapalli 8c5101ea6d YARN-5340. Fixed a race condition in RollingLevelDBTimelineStore that caused loss of Timeline events. Contributed by Li Lu.
(cherry picked from commit 1c9d2ab503)
2016-07-20 08:39:19 -07:00
Steve Loughran c177823ebe HADOOP-13387 users always get told off for using S3 —even when not using it. Contributed by stevel. 2016-07-20 14:01:17 +01:00
Steve Loughran 0f1e02a298 HADOOP-13212 Provide an option to set the socket buffers in S3AFileSystem (Rajesh Balamohan) 2016-07-20 13:42:19 +01:00
Varun Vasudev 478a2bb185 YARN-5309. Fix SSLFactory truststore reloader thread leak in TimelineClientImpl. Contributed by Weiwei Yang. 2016-07-20 13:02:34 +05:30
Akira Ajisaka f2508d78b2 HADOOP-12991. Conflicting default ports in DelegateToFileSystem. Contributed by Kai Sasaki.
(cherry picked from commit dc065dd64c)
(cherry picked from commit 8fe2c450b3)
2016-07-19 16:06:35 -07:00
Akira Ajisaka 91f47ab5f9 HDFS-10620. StringBuilder created and appended even if logging is disabled. Contributed by Staffan Friberg.
(cherry picked from commit f7dabe3add)
(cherry picked from commit 2685e16f38)
2016-07-19 15:19:02 -07:00
Akira Ajisaka d8181a8cb8 HDFS-10603. Fix flaky tests in org.apache.hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot. Contributed by Yiqun Lin.
(cherry picked from commit fc570b55b9)
(cherry picked from commit c92601e981)
2016-07-19 13:52:17 -07:00
Akira Ajisaka cf79ac5fa9 HADOOP-13202. Avoid possible overflow in org.apache.hadoop.util.bloom.BloomFilter#getNBytes. Contributed by Kai Sasaki.
(cherry picked from commit c2bcffb34e)
(cherry picked from commit 09375baad1)
2016-07-18 11:50:53 -07:00
Tsuyoshi Ozawa e3c4989d74 HADOOP-13298. Fix the leftover L&N files in hadoop-build-tools/src/main/resources/META-INF/. (ozawa)
(cherry picked from commit ea9f43781e)
2016-07-16 08:11:30 +09:00
Jitendra Pandey a363277be5 HADOOP-13368. DFSOpsCountStatistics$OpType#fromSymbol and s3a.Statistic#fromSymbol should be O(1) operation. Contributed by Mingliang Liu. 2016-07-15 14:32:20 -07:00
Wangda Tan 343633a6e8 YARN-4484. Available Resource calculation for a queue is not correct when used with labels. (Sunil G via wangda)
(cherry picked from commit 24db9167f1)
(cherry picked from commit e34e1aa4fe)
2016-07-15 11:46:17 -07:00
Akira Ajisaka 83126ac90d HDFS-10628. Log HDFS Balancer exit message to its own log. Contributed by Jiayi Zhou.
(cherry picked from commit c48e9d608c)
(cherry picked from commit 6171498375)
2016-07-15 11:43:54 -07:00
Akira Ajisaka bc21763da4 HADOOP-13289. Remove unused variables in TestFairCallQueue. Contributed by Ye Zhou.
(cherry picked from commit 1381483233)
(cherry picked from commit 2231ef22f5)
2016-07-14 23:15:53 -07:00
Akira Ajisaka 6a04d9ab63 HADOOP-13351. TestDFSClientSocketSize buffer size tests are flaky. Contributed by Aaron Fabbri and Mingliang Liu.
(cherry picked from commit 5537c6b234)
(cherry picked from commit c9f5348bbf)
2016-07-14 14:42:55 -07:00
Akira Ajisaka 2f7857baea YARN-5159. Wrong Javadoc tag in MiniYarnCluster. Contributed by Andras Bokor.
(cherry picked from commit 6cf017558a)
(cherry picked from commit 6664077727)
2016-07-14 10:46:11 -07:00
Zhe Zhang cbd885b6fa HADOOP-13290. Appropriate use of generics in FairCallQueue. Contributed by Jonathan Hung.
(cherry picked from commit 728bf7f698)
(cherry picked from commit b95f1af8a9)
2016-07-13 16:47:01 -07:00
Akira Ajisaka 213b7f40de HADOOP-13366. Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc. Contributed by Rakesh R.
(cherry picked from commit 505ce88437)
(cherry picked from commit ee1e45e4b2)
2016-07-13 13:10:27 -07:00
Tsuyoshi Ozawa fa9ff4997e HADOOP-11361. Fix a race condition in MetricsSourceAdapter.updateJmxCache. Contributed by Vinayakumar B, Yongjun Zhang, and Brahma Reddy Battula. (ozawa)
(cherry picked from commit 77ffe76212)
2016-07-13 21:41:11 +09:00
Zhe Zhang af94dfaa53 HDFS-10544. Balancer doesn't work with IPFailoverProxyProvider.
(cherry picked from commit 087290e6b1)
(cherry picked from commit 5b4e916b3c)
2016-07-12 23:28:16 -07:00
Varun Saxena f87866446d YARN-5353. ResourceManager can leak delegation tokens when they are shared across apps. (Jason Lowe via Varun Saxena). 2016-07-13 07:40:10 +05:30
Lei Xu d1d280fcfa HADOOP-13315. FileContext#umask is not initialized properly. (John Zhuge via lei)
(cherry picked from commit a290a98b6a)
2016-07-12 16:51:55 -07:00
Robert Kanter ba83b62d36 MAPREDUCE-6625. TestCLI#testGetJob fails occasionally (haibochen via rkanter)
(cherry picked from commit ad256beb50)
2016-07-12 16:31:24 -07:00
Jitendra Pandey 35108025e7 HDFS-10579. HDFS web interfaces lack configs for X-FRAME-OPTIONS protection. Contributed by Anu Engineer.
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java
2016-07-12 14:38:34 -07:00
Jitendra Pandey 324923e1bc HADOOP-13352. Make X-FRAME-OPTIONS configurable in HttpServer2. Contributed by Anu Engineer. 2016-07-12 14:38:20 -07:00
Robert Kanter 2e2caeb50e HADOOP-12964. Http server vulnerable to clickjacking (haibochen via rkanter)
(cherry picked from commit 042a3ae960)
2016-07-12 14:37:57 -07:00
Jason Lowe 0a94c6d9da YARN-5317. testAMRestartNotLostContainerCompleteMsg may fail. Contributed by sandflee
(cherry picked from commit 10b704c594)
2016-07-12 20:39:09 +00:00
Jason Lowe 9d08ca1ed7 YARN-4393. Fix intermittent test failure for TestResourceLocalizationService#testFailedDirsResourceRelease (Varun Saxana via rohithsharmaks)
(cherry picked from commit 791c1639ae)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
2016-07-12 19:25:07 +00:00
Junping Du a0ddc5b3a5 New addendum to YARN-5080. Cannot obtain logs using YARN CLI -am for either KILLED or RUNNING AM.
(cherry picked from commit 7705812c7e)
(cherry picked from commit 54812841e2)
2016-07-12 08:37:47 -07:00
Jian He 23eb3c7ceb YARN-5270. Solve miscellaneous issues caused by YARN-4844. Contributed by Wangda Tan 2016-07-11 22:38:35 -07:00
Andrew Wang 4e7e48cdc1 HDFS-10300. TestDistCpSystem should share MiniDFSCluster. Contributed by John Zhuge.
(cherry picked from commit f292624bd8)
(cherry picked from commit 38b1eafdbc)
2016-07-11 18:06:45 -07:00
Akira Ajisaka 1b7691b4c1 HADOOP-13297. Add missing dependency in setting maven-remote-resource-plugin to fix builds. Contributed by Sean Busbey.
(cherry picked from commit 7bd5d4272c)
(cherry picked from commit 02b037f625)
2016-07-11 17:23:22 -07:00
Steve Loughran 310c08454f HADOOP-13139 Branch-2: S3a to use thread pool that blocks clients. Contributed by Pieter Reuse. 2016-07-11 17:21:14 +01:00
Varun Saxena f685973e21 YARN-5037. Fix random failure of TestRMRestart#testQueueMetricsOnRMRestart (sandflee via Varun Saxena). 2016-07-11 09:39:06 +05:30
Akira Ajisaka a8cfcce542 Revert "HADOOP-10465. Fix use of generics within SortedMapWritable. Contributed by Bertrand Dechoux."
This reverts commit 1d175f0f3f.
2016-07-09 21:01:07 -07:00
Junping Du 25ea7cc373 Fix OOM issue in DistributedShell. Contributed by Jian He.
(cherry picked from commit 9bdb5bebea)
(cherry picked from commit 7db796562c)
2016-07-09 05:12:21 -07:00
Yongjun Zhang 96e68e722f HDFS-10512. VolumeScanner may terminate due to NPE in DataNode.reportBadBlocks. Contributed by Wei-Chiu Chuang and Yiqun Lin.
(cherry picked from commit da6f1b88dd)
2016-07-08 22:20:27 -07:00
Varun Saxena 845daee463 YARN-5318. Fix intermittent test failure of TestRMAdminService#testRefreshNodesResourceWithFileSystemBasedConfigurationProvider. (Jun Gong via Varun Saxena). 2016-07-09 01:54:22 +05:30
Junping Du 8645e4ac3b YARN-4939. The decommissioning Node should keep alive during NM restart. Contributed by sandflee.
(cherry picked from commit 30ee57ceb1)
(cherry picked from commit 5c0386d535)
2016-07-08 06:06:56 -07:00
Vinod Kumar Vavilapalli e4a62a233d YARN-5314. Fixed a ConcurrentModificationException in ATS v1.5 EntityGroupFSTimelineStore. Contributed by Li Lu.
(cherry picked from commit 673e5e02fe)
2016-07-07 22:42:19 -07:00
Akira Ajisaka 5522a46f4c HADOOP-13320. Fix arguments check in documentation for WordCount v2.0. Contributed by niccolo becchi.
(cherry picked from commit 9d46a49c74)
(cherry picked from commit b3b81b4f0e)
2016-07-07 15:32:20 -07:00