Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,966 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

11966 Commits

Author SHA1 Message Date
Varun Saxena fedcce2f4c YARN-6068. Log aggregation get failed when NM restart even with recovery (Junping Du via Varun Saxena) 
(cherry picked from commit f59e36b4ce)
 2017-01-09 11:27:48 +05:30
Junping Du e7ad66b55b HADOOP-13958. Bump up release year to 2017. Contributed by Junping Du. 
(cherry picked from commit 94f1d06f20)
(cherry picked from commit 7b5b57e5b2)
 2017-01-08 15:49:10 -08:00
Junping Du 031ad740b9 MAPREDUCE-6711. JobImpl fails to handle preemption events on state COMMITTING. Contributed by Prabhu Joseph. 
(cherry picked from commit 679478d0c6)
(cherry picked from commit bf87c523ab)
 2017-01-07 22:08:07 -08:00
Jason Lowe 8ffe5eb7bd MAPREDUCE-6682. TestMRCJCFileOutputCommitter fails intermittently Contributed by Akira Ajisaka. 
(cherry picked from commit 8f1c374bec)

Conflicts:

	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestMRTimelineEventHandling.java
 2017-01-06 18:55:48 +00:00
Chris Nauroth 15e89634a5 HDFS-9483. Documentation does not cover use of "swebhdfs" as URL scheme for SSL-secured WebHDFS. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit 4c8f9e1302)
(cherry picked from commit 9c61858ee7)
 2017-01-05 15:05:12 -08:00
Wei-Chiu Chuang 162c6cc9f4 HDFS-11160. VolumeScanner reports write-in-progress replicas as corrupt incorrectly. Contributed by Wei-Chiu Chuang and Yongjun Zhang. 
(cherry picked from commit 0cb99db9d9)

Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBlockScanner.java
 2017-01-05 13:29:43 -08:00
Vinod Kumar Vavilapalli 9721735ce9 HADOOP-12406. Fixed AbstractMapWritable.readFields to use the thread's ClassLoader to load class instead of System ClassLoader. Contributed by Nadeem Douba. 
(cherry picked from commit 069c6c62de)
(cherry picked from commit 4041d2b49e)
 2017-01-05 13:23:47 -08:00
Junping Du 689d19575f YARN-4990. Re-direction of a particular log file within in a container in NM UI does not redirect properly. Contributed by Xuan Gong. 
(cherry picked from commit 736f54b727)
 2017-01-05 20:37:56 +00:00
Jason Lowe 2adce1b361 YARN-5246. NMWebAppFilter web redirects drop query parameters. Contributed by Varun Vasudev. 
(cherry picked from commit d0162f2040)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/util/WebAppUtils.java
 2017-01-05 20:28:26 +00:00
Rohith Sharma K S 0c1615c368 MAPREDUCE-6662. Clear ASF Warnings on test data files. Contributed by Vinayakumar B 
(cherry picked from commit 0ef8bbfd87)
(cherry picked from commit f22ce96b50)
 2017-01-05 18:03:48 +09:00
Haohui Mai e690cd5011 HDFS-11280. Allow WebHDFS to reuse HTTP connections to NN. Contributed by Zheng Shao. 2017-01-04 21:15:01 -08:00
Jian He 42d1b38989 YARN-4164. Changed updateApplicationPriority API to return the updated application priority. Contributed by Rohith Sharma K S 2017-01-04 15:43:06 -08:00
Jian He ca66bedeff YARN-4832. NM side resource value should get updated if change applied in RM side. Contributed by Junping Du 
(cherry picked from commit 264c06a438)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceTrackerService.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/MockNM.java
 2017-01-04 15:09:14 -08:00
Varun Saxena 2b4950b094 MAPREDUCE-6801. Fix flaky TestKill.testKillJob (Haibo Chen via Varun Saxena) 
(cherry picked from commit 7584fbf4cb)
 2017-01-04 18:29:21 +00:00
Robert Kanter d738f4b652 MAPREDUCE-6675. TestJobImpl.testUnusableNode failed (haibochen via rkanter) 
(cherry picked from commit 9d3fcdfbb3)
 2017-01-04 18:18:29 +00:00
Masatake Iwasaki a631247c2a HADOOP-12605. Fix intermittent failure of TestIPC.testIpcWithReaderQueuing (iwasakims) 
(cherry picked from commit 9eec6cbedc)
 2017-01-04 18:04:43 +00:00
Junping Du 7aa95bcdd5 Addendum patch to YARN-3866: fix incompatible API change. 2017-01-04 00:05:09 -08:00
Akira Ajisaka 58a1753373 HADOOP-12733. Remove references to obsolete io.seqfile configuration variables. Contributed by Ray Chiang. 
(cherry picked from commit 01d31fe938)
(cherry picked from commit 3e2d26a97f)
 2017-01-04 14:20:04 +09:00
Wangda Tan ebafe075d6 YARN-6029. CapacityScheduler deadlock when ParentQueue#getQueueUserAclInfo is called by one thread and LeafQueue#assignContainers is releasing excessive reserved container is called by another thread. (Tao Yang via wangda) 2017-01-03 16:21:46 -08:00
Mingliang Liu a58a1b55bf Revert "HADOOP-13946. Document how HDFS updates timestamps in the FS spec; compare with object stores. Contributed by Steve Loughran" 
This reverts commit d61af93bef.
 2017-01-03 14:45:46 -08:00
Mingliang Liu d61af93bef HADOOP-13946. Document how HDFS updates timestamps in the FS spec; compare with object stores. Contributed by Steve Loughran 
(cherry picked from commit 451efb08fe)
 2017-01-03 13:09:53 -08:00
Brahma Reddy Battula 7392a5a72c Revert "HDFS-11280. Allow WebHDFS to reuse HTTP connections to NN. Contributed by Zheng Shao." 
This reverts commit 0ff9efcf37.
 2017-01-03 19:30:45 +05:30
Brahma Reddy Battula b8be8f0d4f HADOOP-13883. Addendum patch to correct the message and alphabetized with the earlier patch. Contributed by Yiqun Lin. 2016-12-31 16:27:17 +05:30
Haohui Mai 0ff9efcf37 HDFS-11280. Allow WebHDFS to reuse HTTP connections to NN. Contributed by Zheng Shao. 2016-12-31 01:07:41 -08:00
Jian He d7b80f1b02 YARN-5709. Cleanup leader election configs and pluggability. Contributed by Karthik Kambatla 2016-12-29 16:24:17 -08:00
Wangda Tan 1e886e7520 YARN-4567. Fix javadoc of ResourceManager.java failing on Java 8. (stevel) 2016-12-29 16:05:47 -08:00
Daniel Templeton 747be79b22 HDFS-11278. Add missing @Test annotation for TestSafeMode.testSafeModeUtils() (Contributed by Lukas Majercak via Daniel Templeton) 
(cherry picked from commit ce3613c965)
(cherry picked from commit af266c8c85)
 2016-12-28 20:11:56 -08:00
Junping Du 5f36b62265 Revert "MAPREDUCE-5875. Make Counter limits consistent across JobClient, MRAppMaster, and YarnChild. (Gera Shegalov via kasha)" 
This reverts commit 7bfd9e068d.

Conflicts:
	hadoop-mapreduce-project/CHANGES.txt
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/JobSubmitter.java
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/jobhistory/HistoryViewer.java
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/CompletedJob.java
 2016-12-28 17:37:20 -08:00
Junping Du 8755a6f5ac Revert "MAPREDUCE-6199. AbstractCounters are not reset completely on deserialization (adhoot via rkanter)" 
This reverts commit f9341c1e2c.

Conflicts:
	hadoop-mapreduce-project/CHANGES.txt
 2016-12-28 17:13:04 -08:00
Junping Du e8d7801319 Revert "MAPREDUCE-6286. A typo in HistoryViewer makes some code useless, which causes counter limits are not reset correctly. Contributed by Zhihai Xu." 
This reverts commit 7c72c7f529.

Conflicts:
	hadoop-mapreduce-project/CHANGES.txt
 2016-12-28 17:05:17 -08:00
Sunil G e253633009 YARN-6024. Capacity Scheduler 'continuous reservation looking' doesn't work when sum of queue's used and reserved resources is equal to max. Contributed by Wangda Tan. 
(cherry picked from commit f6715b26b6)
 2016-12-28 16:06:13 +05:30
Brahma Reddy Battula 218ed0a96b HDFS-11252. TestFileTruncate#testTruncateWithDataNodesRestartImmediately can fail with BindException. Contributed by Yiqun Lin. 
(cherry picked from commit 0ddb8defad)
 2016-12-28 10:43:21 +05:30
Mingliang Liu 9a976f3859 HDFS-11270. Document the missing options of NameNode bootstrap command. Contributed by Yiqun Lin 
(cherry picked from commit c0e0ef2969)
 2016-12-27 11:41:34 -08:00
Akira Ajisaka 0caa114183 HDFS-11272. Refine the assert messages in TestFSDirAttrOp. Contributed by Jimmy Xiang. 
(cherry picked from commit ea547529cb)
(cherry picked from commit cd331556f6)
 2016-12-26 17:17:40 +09:00
Akira Ajisaka daa475ff72 HDFS-11250. Fix a typo in ReplicaUnderRecovery#setRecoveryID. Contributed by Yiqun Lin. 
(cherry picked from commit 8f218ea284)
(cherry picked from commit 1b39268233)
 2016-12-26 16:53:14 +09:00
Akira Ajisaka 704560d95f HDFS-11271. Typo in NameNode UI. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 483cd06ad4)
(cherry picked from commit a779b4ab8f)
 2016-12-26 16:38:14 +09:00
Akira Ajisaka 8e4479dda3 YARN-4994. Use MiniYARNCluster with try-with-resources in tests. Contributed by Andras Bokor. 
(cherry picked from commit ae401539ea)
(cherry picked from commit 522bc98026)

 Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/TestHedgingRequestRMFailoverProxyProvider.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/cli/TestYarnCLI.java
 2016-12-23 04:15:39 +09:00
Akira Ajisaka 990e272f96 HDFS-11258. Addendum patch to fix compile issue. Contributed by Jimmy Xiang. 
(cherry picked from commit 16c4dcad85)
 2016-12-23 03:58:10 +09:00
Haohui Mai 72a8c8dc6f HDFS-11258. File mtime change could not save to editlog. Contributed by Jimmy Xiang. 2016-12-21 14:22:27 -08:00
Akira Ajisaka ae053df2d8 HDFS-11261. Document missing NameNode metrics. Contributed by Yiqun Lin. 
(cherry picked from commit f6e2521eb2)
(cherry picked from commit 897b4a6a77)
 2016-12-21 14:20:39 +09:00
Xuan e0401e0781 YARN-4559. Make leader elector and zk store share the same curator 
client. Contributed by Jian He

(cherry picked from commit 890a2ebd1a)
(cherry picked from commit be3322792f)
 2016-12-20 16:15:59 -08:00
Mingliang Liu 059d33bb8b HDFS-11094. Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter. Contributed by Eric Badger 
(cherry picked from commit 012d28a1fa)
 2016-12-20 14:29:33 -08:00
Xiao Chen aec0d06a34 HDFS-11195. Return error when appending files by webhdfs rest api fails. Contributed by Yuanbo Liu. 
(cherry picked from commit 5b7acdd206)
 2016-12-20 12:27:44 -08:00
Brahma Reddy Battula a43bbea3c8 HDFS-11263. ClassCastException when we use Bzipcodec for Fsimage compression. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 1b401f6a73)
 2016-12-20 21:16:54 +05:30
Akira Ajisaka 1e3304ad23 HDFS-11262. Remove unused variables in FSImage.java. Contributed by Jagadesh Kiran N. 
(cherry picked from commit d2026ae9e6)
(cherry picked from commit a95acbcb6e)
 2016-12-20 14:37:57 +09:00
Akira Ajisaka 07a221e6aa HDFS-11249. Redundant toString() in DFSConfigKeys.java. Contributed by Jagadesh Kiran N. 
(cherry picked from commit 36947f79ba)
(cherry picked from commit eaa50a1087)
 2016-12-16 00:41:03 +09:00
Xiaoyu Yao 691a32c6f6 HADOOP-13890. Maintain HTTP/host as SPNEGO SPN support and fix KerberosName parsing. Contributed by Xiaoyu Yao. 
(cherry picked from commit f5e0bd30fd)
(cherry picked from commit 85083567be)
 2016-12-14 14:01:32 -08:00
Akira Ajisaka 901bc5eef5 HDFS-11204. Document the missing options of hdfs zkfc command. Contributed by Yiqun Lin. 
(cherry picked from commit 72bff192cd)
(cherry picked from commit 190b2dca62)
 2016-12-14 18:54:39 +09:00
Andrew Wang 158292fd7e HDFS-10684. WebHDFS DataNode calls fail without parameter createparent. Contributed by John Zhuge. 
(cherry picked from commit fbdbbd57cd)
(cherry picked from commit 6b795c34d0)
 2016-12-13 18:01:40 -08:00
Xuan 120f3a0ff9 YARN-4438. Implement RM leader election with curator. Contributed by Jian He 
(cherry picked from commit 89022f8d4b)
(cherry picked from commit 2cbbf76c3d)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2016-12-13 13:30:15 -08:00