Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,541 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

9541 Commits

Author SHA1 Message Date
Xuan 43ea501e33 YARN-4612. Fix rumen and scheduler load simulator handle killed tasks 
properly. Contributed by Ming Ma.

(cherry picked from commit 4efdf3a979)
 2017-05-21 13:00:32 -07:00
Karthik Kambatla 94031b1978 YARN-4367. SLS webapp doesn't load. (kasha) 2017-05-21 11:42:38 -07:00
Varun Vasudev 6feef1b039 YARN-4302. SLS not able start due to NPE in SchedulerApplicationAttempt. Contributed by Bibin A Chundatt. 
(cherry picked from commit c28e16b40c)
 2017-05-21 11:31:23 -07:00
Konstantin V Shvachko eecc68d4d8 HDFS-9726. Refactor IBR code to a new class. Contributed by Tsz-Wo Nicholas Sze. Backport HDFS-11839 by Vinitha Reddy Gankidi. 
(cherry picked from commit 494b6c7c4b)
 2017-05-18 18:09:36 -07:00
rohithsharmaks 0a4d8f6584 YARN-4109. Exception on RM scheduler page loading with labels. (Mohammad Shahid Khan via rohithsharmaks) 
(cherry picked from commit 8c180a13c8)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2017-05-18 17:26:30 -07:00
Konstantin V Shvachko 42c2d36ba6 MAPREDUCE-6304. Specifying node labels when submitting MR jobs. Contributed by Naganarasimha G R. Backport by Inigo Goiri. 
(cherry picked from commit 3164e7d838)
 2017-05-18 00:20:15 -07:00
Konstantin V Shvachko 2c3f6aedf1 HDFS-7990. IBR delete ack should not be delayed. Contributed by Daryn Sharp. Backport HDFS-11838 by Vinitha Gankidi. 
(cherry picked from commit 60882ab26d)
 2017-05-17 23:58:27 -07:00
Chris Douglas 2b58fb8b03 HADOOP-14434. Use MoveFileEx to allow renaming a file when the destination exists. Contributed by Lukas Majercak 
(cherry picked from commit ef9e536a71)
(cherry picked from commit 4bb0565443)
(cherry picked from commit 475b50b44c)
 2017-05-17 17:30:20 -07:00
Konstantin V Shvachko 0823fb72a9 HDFS-8498. Blocks can be committed with wrong size. Contributed by Jing Zhao. Backport HDFS-11732 by Zhe Zhang. 2017-05-16 11:03:12 -07:00
Brahma Reddy Battula 3004358639 HDFS-8312. Trash does not descent into child directories to check for permissions. Contributed By Weiwei Yang via Eric Yang. 2017-05-16 23:27:57 +05:30
Brahma Reddy Battula b95d63cdac HDFS-10987. Make Decommission less expensive when lot of blocks present. Contributed By Brahma Reddy Battula. 2017-05-16 10:50:51 +05:30
Jason Lowe 3252064eac HADOOP-14376. Memory leak when reading a compressed file using the native library. Contributed by Eli Acherkan 
(cherry picked from commit 7bc2172248)
 2017-05-12 17:04:31 -05:00
Vinayakumar B b0b6de38c9 HDFS-11674. reserveSpaceForReplicas is not released if append request failed due to mirror down and replica recovered (Contributed by Vinayakumar B) 2017-05-12 14:26:28 +05:30
Min Shen 28b947603b YARN-5543. ResourceManager SchedulingMonitor could potentially terminate the preemption checker thread. Contributed by Min Shen and Jonathan Hung. 
(cherry picked from commit 2ada100da7)
Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/SchedulingMonitor.java
 2017-05-11 13:47:12 -07:00
Brahma Reddy Battula 764fd3ed49 HDFS-9902. Support different values of dfs.datanode.du.reserved per storage type. Contributed By Brahma Reddy Battula. 2017-05-11 10:22:59 +05:30
Chris Douglas db72660f30 HADOOP-12173. NetworkTopology::add calls toString always. Contributed by Inigo Goiri 
(cherry picked from commit e59f6fad6a)

# Conflicts:
#	hadoop-common-project/hadoop-common/CHANGES.txt
 2017-05-10 20:48:38 -07:00
Konstantin V Shvachko f30484e042 Update CHANGES.txt for HADOOP-11703. 2017-05-10 20:01:43 -07:00
Allen Wittenauer 879dc57145 HADOOP-11703. git should ignore .DS_Store files on Mac OS X (Abin Shahab via aw) 
(cherry picked from commit 344d7cb6dc)
 2017-05-10 19:57:11 -07:00
Konstantin V Shvachko 834d4217b7 HADOOP-12975. Add jitter to CachingGetSpaceUsed's thread (Elliott Clark via Colin P. McCabe). 
HADOOP-14408. Backport contributed by Erik Krogen.

(cherry picked from commit bf780406f2)
(cherry picked from commit 56c997a1a6)
(cherry picked from commit 04682cc6b0)
 2017-05-10 19:16:01 -07:00
Akira Ajisaka f052976ff1
HDFS-11795. Fix ASF License warnings in branch-2.7. Contributed by Yiqun Lin. 2017-05-10 14:17:00 -05:00
Brahma Reddy Battula 48c5e37abf HDFS-11373. Backport HDFS-11258 and HDFS-11272(File mtime change could not save to editlog). (Contributed by Jimmy Xiang, backported by Akira Ajisaka) 2017-05-10 11:06:57 +05:30
Akira Ajisaka 2875462c2b
HADOOP-14100. Upgrade Jsch jar to latest version to fix vulnerability in old versions. Contributed by Vinayakumar B and Brahma Reddy Battula. 2017-05-09 11:47:28 -05:00
Akira Ajisaka 9088f8358a
Update CHANGES.txt for YARN-6457 branch-2.7. 2017-05-09 11:41:08 -05:00
Akira Ajisaka 6599e57a79
HDFS-11766. Fix findbugs warning in branch-2.7. Contributed by Chen Liang. 2017-05-09 11:22:57 -05:00
Haibo Chen f8e893f7ea YARN-6457. Allow custom SSL configuration to be supplied in WebApps. (Sanjay M Pujare via Haibo Chen) 
(cherry picked from commit 1769b12a77)
(cherry picked from commit 86fcb8a66c)
 2017-05-09 08:56:56 -07:00
Akira Ajisaka 0187892151
HADOOP-14374. License error in GridmixTestUtils.java. Contributed by lixinglong. 
(cherry picked from commit c60164fb60)
(cherry picked from commit 753954f7be)
 2017-05-09 05:43:12 -05:00
Varun Vasudev 0a149f3413 YARN-4562. YARN WebApp ignores the configuration passed to it for keystore settings. Contributed by Sergey Shelukhin. 
Added CHANGES.txt entry

(cherry picked from commit 07920acc16)
(cherry picked from commit 4baee3eb67)
 2017-05-09 10:51:31 +05:30
Konstantin V Shvachko c7c410898e Update CHANGES.txt for HDFS-11717 branch-2.7. 2017-05-02 22:30:18 -07:00
Erik Krogen a00cef6079 HDFS-11717. Add unit test for HDFS-11709 StandbyCheckpointer should handle non-existing legacyOivImageDir gracefully. Contributed by Erik Krogen. 
(cherry picked from commit d9014bda93)
(cherry picked from commit 9d6b873d3c)
 2017-05-02 18:46:58 -07:00
Akira Ajisaka 60e74edd05
HADOOP-14371. License error in TestLoadBalancingKMSClientProvider.java. Contributed by hu xiaodong. 
(cherry picked from commit 20cde55274)
(cherry picked from commit 036624900b)
 2017-05-02 23:41:17 +09:00
Kihwal Lee 130a0e2156 HDFS-11714. Newly added NN storage directory won't get initialized and cause space exhaustion. Contributed by Kihwal Lee. 
Added a CHANGES.txt entry
(cherry picked from commit f77d138725)
 2017-05-01 17:36:58 -05:00
Kihwal Lee 139327d34b HDFS-11609. Some blocks can be permanently lost if nodes are decommissioned while dead. Contributed by Kihwal Lee. 2017-05-01 14:31:59 -05:00
Zhe Zhang 8ad9efbe14 HDFS-8873. Allow the directoryScanner to be rate-limited. Contributed by Daniel Templeton. 2017-04-27 15:04:10 -07:00
Konstantin V Shvachko 5e67eb7560 Update CHANGES.txt for HDFS-11384 branch-2.7. 2017-04-27 12:23:41 -07:00
Konstantin V Shvachko cf5abf8a7c HDFS-11384. Balancer disperses getBlocks calls to avoid NameNode's rpc queue saturation. Contributed by Konstantin V Shvachko. 
(cherry picked from commit 28eb2aabeb)
# Conflicts:
#	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Dispatcher.java
#	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancer.java
 2017-04-27 11:57:36 -07:00
Zhe Zhang bec23593b5 HDFS-11709. StandbyCheckpointer should handle an non-existing legacyOivImageDir gracefully. Contributed by Erik Krogen. 
(cherry picked from commit d8a3309830)
(cherry picked from commit fc46f398d9)
(cherry picked from commit 70f18911c7)
 2017-04-27 09:56:14 -07:00
Brahma Reddy Battula ac12063eeb HDFS-10455. Logging the username when deny the setOwner operation. Contributed by Rakesh R. 
(cherry picked from commit 1c5708f6de)
(cherry picked from commit c895f08936)
 2017-04-26 15:59:21 -07:00
Konstantin V Shvachko 54bbdb4c02 Update CHANGES.txt for HDFS-11634. 2017-04-18 13:20:21 -07:00
Konstantin V Shvachko 5a714fee43 HDFS-11634. Optimize BlockIterator when interating starts in the middle. Contributed by Konstantin V Shvachko. 
(cherry picked from commit 8dfcd95d58)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/DatanodeDescriptor.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestGetBlocks.java
 2017-04-17 17:39:29 -07:00
Zhe Zhang ccd24f0917 HDFS-11615. FSNamesystemLock metrics can be inaccurate due to millisecond precision. Contributed by Erik Krogen. 
(cherry picked from commit ad49098eb3)
(cherry picked from commit 051ab77806)
(cherry picked from commit 07047335a3)
 2017-04-17 16:55:24 -07:00
John Zhuge fac5bdc023 HADOOP-14195. CredentialProviderFactory$getProviders is not thread-safe. Contributed by Vihang Karajgaonkar. 
(cherry picked from commit 128015584d)
(cherry picked from commit a92f654aa2)
 2017-04-12 20:05:15 -07:00
Steve Loughran 7a3f9e8fac HADOOP-14066 VersionInfo should be marked as public API 
(cherry picked from commit 2ed65540a3)
 2017-04-11 15:06:48 -07:00
Arpit Agarwal 9f4585c95f HDFS-11608. HDFS write crashed with block size greater than 2 GB. Contributed by Xiaobing Zhou. 2017-04-11 11:43:25 -07:00
Arpit Agarwal f2d1d3d159 Revert "HDFS-11551. Handle SlowDiskReport from DataNode at the NameNode. Contributed by Xiaobing Zhou." 
This reverts commit ac76dc10dd.
 2017-04-11 11:42:57 -07:00
Xiaobing Zhou ac76dc10dd HDFS-11551. Handle SlowDiskReport from DataNode at the NameNode. Contributed by Xiaobing Zhou. 2017-04-11 11:16:36 -07:00
Andrew Wang 60a3a63990 HADOOP-14293. Initialize FakeTimer with a less trivial value. 
(cherry picked from commit be144117a8)
(cherry picked from commit dab1deb9a0)
 2017-04-10 11:37:38 -07:00
Zhe Zhang e5d5d0ddb5 HADOOP-14276. Add a nanosecond API to Time/Timer/FakeTimer. Contributed by Erik Krogen. 
(cherry picked from commit 95b7f1d29a)
(cherry picked from commit c85026038a)
(cherry picked from commit ef8b30dd4b)
 2017-04-07 10:59:44 -07:00
Xiaobing Zhou ea38aa727a HDFS-11628. Clarify the behavior of HDFS Mover in documentation. Contributed by Xiaobing Zhou. 2017-04-05 15:34:40 -07:00
Zhe Zhang 79f7bfbf22 MAPREDUCE-6873. MR Job Submission Fails if MR framework application path not on defaultFS. Contributed by Erik Krogen. 
(cherry picked from commit de7efd2687)
(cherry picked from commit 3f5dc51ec9)
(cherry picked from commit 0acf2bca9c)
 2017-03-29 22:35:12 -07:00
Masatake Iwasaki 0ece3c8dd9 HDFS-11486. Client close() should not fail fast if the last block is being decommissioned. Contributed by Wei-Chiu Chuang and Yiqun Lin. 
(cherry picked from commit ca3ede5fda)
 2017-03-28 18:17:45 +09:00