Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,868 Commits 326 Branches 371 Tags
Commit Graph

10868 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Zhe Zhang
223b47b398 HDFS-9347. Invariant assumption in TestQuorumJournalManager.shutdown() is wrong. Contributed by Wei-Chiu Chuang. 
Change-Id: Idde8522e11c77f82b376e0c90a9bf33d163d5cb9
 2015-12-18 16:05:21 -08:00
Jian He
1147b086d9 YARN-4164. Changed updateApplicationPriority API to return the updated application priority. Contributed by Rohith Sharma K S 2015-12-18 14:14:31 -08:00
Colin Patrick Mccabe
31d2fb91fc HDFS-9350. Avoid creating temprorary strings in Block.toString() and getBlockName() (Staffan Friberg via cmccabe) 
(cherry picked from commit e63388fdf22b5fd20ca00f9fad9f40656f117d95)
 2015-12-18 10:05:12 -08:00
Andrew Wang
71fb205735 HDFS-8477. describe dfs.ha.zkfc.port in hdfs-default.xml. Contributed by Kanaka Kumar Avvaru. 
(cherry picked from commit 058cfddebbbbdad367bafbd13485df70b4cc50c8)
 2015-12-18 09:14:23 -08:00
Vinayakumar B
c887bcd1f0 HDFS-9393. After choosing favored nodes, choosing nodes for remaining replicas should go through BlockPlacementPolicy (Contributed by J.Andreina) 
(cherry picked from commit bfadf11b36e9d97e03d6ed1e71829907c2301412)
 2015-12-18 11:39:46 +05:30
Akira Ajisaka
af49823499 HADOOP-12657. Add a option to skip newline on empty files with getMerge -nl. Contributed by Kanaka Kumar Avvaru. 
(cherry picked from commit 061c05cc05ff6257b14c5c4f25cbcec2d184cda7)
 2015-12-18 14:00:07 +09:00
Akira Ajisaka
e06c291245 HADOOP-12588. Fix intermittent test failure of TestGangliaMetrics. Contributed by Masatake Iwasaki. 
(cherry picked from commit bd5e207432c54cc75fd8c040e232241678987e53)
 2015-12-18 13:12:56 +09:00
cnauroth
7e5306e795 HDFS-9571. Fix ASF Licence warnings in Jenkins reports. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 6da9deec204a4fa69dfc2d891ce934979d59b0ab)
 2015-12-17 16:26:08 -08:00
Kihwal Lee
3c0ae5914c HDFS-9533. seen_txid in the shared edits directory is modified during bootstrapping. Contributed by Kihwal Lee. 
(cherry picked from commit 5cb1e0118b173a95c1f7bdfae1e58d7833d61c26)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ha/BootstrapStandby.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestBootstrapStandby.java
 2015-12-17 17:23:06 -06:00
Junping Du
6d2914a697 YARN-3226. UI changes for decommissioning node. Contributed by Sunil G. 
(cherry picked from commit 1de56b0448d332717c8316c621b4f6af542a85cc)
 2015-12-17 15:21:42 -08:00
cnauroth
294d0f6f6a HDFS-9572. Prevent DataNode log spam if a client connects on the data transfer port but sends no data. Contributed by Chris Nauroth 
(cherry picked from commit 03bab8dea163a9ee45d09d2a0483d45cf6fe57c9)
 2015-12-17 14:05:05 -08:00
Arpit Agarwal
c0733db768 HDFS-9515. NPE when MiniDFSCluster#shutdown is invoked on uninitialized reference. (Contributed by Wei-Chiu Chuang) 2015-12-17 13:57:12 -08:00
cnauroth
a40ff6d4fb Revert "HDFS-9569. Log the name of the fsimage being loaded for better supportability. Contributed by Yongjun Zhang." 
This reverts commit 03e10f1fb3fade650cb054ddf5f3a152871b8c0f.
 2015-12-17 13:53:25 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
d9b9a75928 YARN-1856. Added cgroups based memory monitoring for containers as another alternative to custom memory-monitoring. Contributed by Varun Vasudev. 
(cherry picked from commit 4e7d32c0db69882cde854ef581056142a997c005)
 2015-12-17 12:13:56 -08:00
Allen Wittenauer
a5c74cd921 HDFS-9570. Minor typos, grammar, and case sensitivity cleanup in HdfsPermissionsGuide.md's (Travis Campbell via aw) 
(cherry picked from commit 8d278d8d2e5a8a53308608a8fbc6ba96228e53ef)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-12-17 11:40:58 -08:00
cnauroth
940026fc6b HDFS-9552. Document types of permission checks performed for HDFS operations. Contributed by Chris Nauroth. 
(cherry picked from commit 724e71f63b35695482642ed7aedacd70d08e6cb1)
 2015-12-17 10:43:54 -08:00
Arpit Agarwal
0c1d1e311c HDFS-9565. TestDistributedFileSystem.testLocatedFileStatusStorageIdsTypes is flaky due to race condition. (Contributed by Wei-Chiu Chuang) 2015-12-17 10:37:58 -08:00
Kihwal Lee
03e10f1fb3 HDFS-9569. Log the name of the fsimage being loaded for better supportability. Contributed by Yongjun Zhang. 
(cherry picked from commit eb6939cea0343840c62b930d4adb377f5eaf879f)
 2015-12-17 10:30:58 -06:00
Konstantin V Shvachko
3d0222eafd Update CHANGES.txt to move HDFS-9516 to 2.7.3 section. 2015-12-16 23:24:34 -08:00
Uma Mahesh
3be39d0229 HDFS-9198. Coalesce IBR processing in the NN. (Daryn Sharp via umamahesh) 
(cherry picked from commit f741476146574550a1a208d58ef8be76639e5ddc)
 2015-12-16 22:04:19 -08:00
Uma Mahesh
e82135df87 Revert this commit as there is compilation issue with this patch in branch-2 "HDFS-9198. Coalesce IBR processing in the NN. (Daryn Sharp via umamahesh)" 
This reverts commit 991ce3d6300fe742862f07397f5474b1ed8eb9a4.
 2015-12-16 19:18:30 -08:00
Uma Mahesh
991ce3d630 HDFS-9198. Coalesce IBR processing in the NN. (Daryn Sharp via umamahesh) 
(cherry picked from commit f741476146574550a1a208d58ef8be76639e5ddc)
 2015-12-16 18:25:29 -08:00
Andrew Wang
c7cb29defe HDFS-9300. TestDirectoryScanner.testThrottle() is still a little flakey. Contributed by Daniel Templeton. 
(cherry picked from commit 3c0adac88c3cddb821a732aea02bc068cafd7ea8)
 2015-12-16 16:21:16 -08:00
Xuan
5891d6ed55 MAPREDUCE-6566. Add retry support to mapreduce CLI tool. Contributed by Varun Vasudev 
(cherry picked from commit d4e766de931c1cc478561a211215c517ba1f341c)
 2015-12-16 15:29:33 -08:00
Jason Lowe
fad2c5b862 YARN-4461. Redundant nodeLocalityDelay log in LeafQueue. Contributed by Eric Payne 
(cherry picked from commit 91828fef6b9314f72d1f973f00e81404dc6bba91)
 2015-12-16 23:23:19 +00:00
Vinod Kumar Vavilapalli
74a011d73a Revert "MAPREDUCE-6566. Add retry support to mapreduce CLI tool. Contributed by Varun Vasudev" 
This reverts commit 3b10ff6a6f7becea181506c306a52973602b0481.
 2015-12-16 15:12:24 -08:00
Vinod Kumar Vavilapalli
36781a3a5a HADOOP-12415. Fixed pom files to correctly include compile-time dependency on netty. (Tom Zeng via cos) 
Addendum commit to include CHANGES.txt entry.

(cherry picked from commit ce16541c62728f69634111dc2ddb321690d3d29b)
 2015-12-16 14:41:25 -08:00
Wangda Tan
5060fd1840 YARN-4416. Deadlock due to synchronised get Methods in AbstractCSQueue. (Naganarasimha G R via wangda) 
(cherry picked from commit 9b856d9787be5ec88ef34574b9b98755d7b669ea)
 2015-12-16 13:29:08 -08:00
Wangda Tan
2f5435acbd YARN-4225. Add preemption status to yarn queue -status for capacity scheduler. (Eric Payne via wangda) 
(cherry picked from commit 7faa406f27f687844c941346f59a27a375af3233)
 2015-12-16 13:29:02 -08:00
Wangda Tan
9f4a6ec663 YARN-4293. ResourceUtilization should be a part of yarn node CLI. (Sunil G via wangda) 
(cherry picked from commit 79c41b1d83e981ae74cb8b58ffcf7907b7612ad4)
 2015-12-16 13:28:56 -08:00
Siddharth Seth
433212ef87 YARN-4207. Add a non-judgemental YARN app completion status. Contributed by Rich Haase. 
(cherry picked from commit 0f708d465fbc4260f2c36e8067e27cd8b285fde7)
 2015-12-16 11:35:38 -08:00
cnauroth
e8e3737ce8 HDFS-9557. Reduce object allocation in PB conversion. Contributed by Daryn Sharp. 
(cherry picked from commit c470c8953d4927043b6383fad8e792289c634c09)
 2015-12-16 11:11:27 -08:00
Junping Du
1a2ef845b5 YARN-4452. NPE when submit Unmanaged application. Contributed by Naganarasimha G R. 
(cherry picked from commit 50bd067e1d63d4c80dc1e7bf4024bfaf42cf4416)
 2015-12-16 10:58:40 -08:00
Zhihai Xu
65cbac9de4 Update CHANGES.txt to move MAPREDUCE-6436 from YARN to MAPREDUCE 
(cherry picked from commit 7092d47fc0b3b792dd31f967c01d460dc089f60b)
 2015-12-15 21:49:22 -08:00
Uma Mahesh
dd3867ab9f HADOOP-12639. Improve JavaDoc for getTrimmedStrings. (BELUGA BEHR via umamahesh) 
(cherry picked from commit ae67c8424c188a2b00920108e6104690137c61b7)
 2015-12-15 15:19:27 -08:00
Andrew Wang
2796c1099f HDFS-8894. Set SO_KEEPALIVE on DN server sockets. Contributed by Kanaka Kumar Avvaru. 
(cherry picked from commit 49949a4bb03aa81cbb9115e91ab1c61cc6dc8a62)
 2015-12-15 14:39:04 -08:00
Jing Zhao
e0abb0a4e7 HDFS-9371. Code cleanup for DatanodeManager. Contributed by Jing Zhao. 
(cherry picked from commit 8602692338d6f493647205e0241e4116211fab75)
 2015-12-15 11:02:04 -08:00
Zhihai Xu
83c72ce9f6 Update CHANGES.txt to add YARN-3857 and YARN-3535 to branch-2.6 
(cherry picked from commit 0c3a53e5a978140e56b9ebbc82c8d04fc978e640)
 2015-12-15 01:51:48 -08:00
Zhihai Xu
da7bde60c0 MAPREDUCE-6436. JobHistory cache issue. Contributed by Kai Sasaki 
(cherry picked from commit 5b7078d06921893200163a3d29c8901c3c0107cb)
 2015-12-15 01:03:10 -08:00
Plamen Jeliazkov
15124c86d8 HDFS-9516. Truncate file fails with data dirs on multiple disks. Contributed by Plamen Jeliazkov. 2015-12-15 00:39:42 -08:00
Zhihai Xu
be50df687b YARN-4440. FSAppAttempt#getAllowedLocalityLevelByTime should init the lastScheduler time. Contributed by Lin Yiqun 
(cherry picked from commit 2aaed1032719e978660d1f14a8ed299e83b5f65e)
 2015-12-15 00:21:13 -08:00
Xuan
992f65dd8b YARN-4439. Clarify NMContainerStatus#toString method. Contributed by 
Jian He

(cherry picked from commit d8a45425eba372cdebef3be50436b6ddf1c4e192)
 2015-12-14 15:42:07 -08:00
Jian He
72544db3cd YARN-4402. TestNodeManagerShutdown And TestNodeManagerResync fails with bind exception. Contributed by Brahma Reddy Battula 2015-12-14 14:59:18 -08:00
Jian He
34e86d8d47 YARN-4403. (AM/NM/Container)LivelinessMonitor should use monotonic time when calculating period. Contributed by Junping Du 2015-12-14 13:52:04 -08:00
Lei Xu
6df45118e5 Revert "Revert "HDFS-8860. Remove unused Replica copyOnWrite code (Lei (Eddy) Xu via Colin P. McCabe)"" 
This reverts commit fb909554a8dfdc8b6244842d3b5ecb8eabc7f99a.
 2015-12-14 11:26:32 -08:00
Wangda Tan
c915a658c8 YARN-4418. AM Resource Limit per partition can be updated to ResourceUsage as well. (Sunil G via wangda) 
(cherry picked from commit 07b0fb996a32020678bd2ce482b672f0434651f0)
 2015-12-14 11:25:00 -08:00
Jing Zhao
e02ad5a618 HDFS-9535. Newly completed blocks in IBR should not be considered under-replicated too quickly. Contributed by Mingliang Liu. 
(cherry picked from commit e53456981474d6e16e3c134e3777b3588dc6fedf)
 2015-12-14 11:18:28 -08:00
Wangda Tan
9f979107c2 YARN-4309. Add container launch related debug information to container logs when a container fails. (Varun Vasudev via wangda) 
(cherry picked from commit dfcbbddb0963c89c0455d41223427165b9f9e537)
 2015-12-14 11:13:51 -08:00
Lei Xu
0852d3562a HDFS-9281. Change TestDeleteBlockPool to not explicitly use File to check block pool existence. (lei) 
(cherry picked from commit db975af5fae506eb3d586bd9201f76adb3fd1281)
 2015-12-14 11:01:48 -08:00
Wangda Tan
a1a723fdff YARN-3946. Update exact reason as to why a submitted app is in ACCEPTED state to app's diagnostic message. (Naganarasimha G R via wangda) 
(cherry picked from commit 6cb0af3c39a5d49cb2f7911ee21363a9542ca2d7)
 2015-12-14 10:54:20 -08:00