Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,557 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

9557 Commits

Author SHA1 Message Date
Steve Loughran f225b5514f HADOOP-13026 Should not wrap IOExceptions into a AuthenticationException in KerberosAuthenticator. Xuan Gong via stevel 2017-05-24 19:00:18 -07:00
Vinayakumar B b6afb4a951 HDFS-6291. FSImage may be left unclosed in BootstrapStandby#doRun() ( Contributed by Sanghyun Yun) 
(cherry picked from commit e5e492a963)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2017-05-24 18:47:31 -07:00
Amar Kamat 61ba70c978 HADOOP-7851. Configuration.getClasses() never returns the default value. (amarrk) 
(cherry picked from commit 82d57ee7fe)
 2017-05-24 17:19:54 -07:00
Konstantin V Shvachko 2b067895a1 Commit missing file TestBatchIbr for HDFS-9710 backport. 2017-05-24 12:21:48 -07:00
Konstantin V Shvachko ac1b8ff78f HDFS-9710. DN can be configured to send block receipt IBRs in batches. Contributed by Tsz-Wo Nicholas Sze. 
Backport HDFS-11837 by Vinitha Reddy Gankidi

(cherry picked from commit 5b95971f8a)
 2017-05-24 11:42:52 -07:00
Jason Lowe f99a48aa63 YARN-6615. AmIpFilter drops query parameters on redirect. Contributed by Wilfred Spiegelenburg 
(cherry picked from commit 7ef01c7c49)
 2017-05-24 11:31:39 -05:00
Konstantin V Shvachko 6d657054eb Update CHANGES.txt for HDFS-11377. 2017-05-23 15:02:30 -07:00
Brahma Reddy Battula 7ae1bc3c20 HDFS-11864. Document Metrics to track usage of memory for writes. Contributed by Yiqun Lin. 
(cherry picked from commit 52661e0912)
 2017-05-24 00:04:25 +08:00
Brahma Reddy Battula 0b53e9f9af Update CHANGES.txt for HDFS-11849 2017-05-23 23:31:03 +08:00
Wangda Tan cf3bf3c17b Update CHANGES.txt for YARN-6493 
Change-Id: I61fbb26c4e7abb5ee4817856eb7c65f072e9d764
 2017-05-22 22:22:42 -07:00
Yiqun Lin f46781261f HDFS-11377. Balancer hung due to no available mover threads. Contributed by yunjiong zhao. 
(cherry picked from commit 9cbbd1eae8)
 2017-05-22 17:44:12 -07:00
Wangda Tan e9575d7dae YARN-6493. Print requested node partition in assignContainer logs. (Jonathan Hung via wangda) 
Change-Id: I6b045ebf0be09bcc73d4bf009ca60a59f9626916
 2017-05-22 15:04:09 -07:00
Brahma Reddy Battula cecedcf558 HDFS-11849. JournalNode startup failure exception should be logged in log file. Contributed By Surendra Singh Lilhore. 
(cherry picked from commit 9cab42cc79)
 2017-05-23 02:52:41 +08:00
Akira Ajisaka 8a0e5e3b70 HDFS-10715. NPE when applying AvailableSpaceBlockPlacementPolicy. Contributed by Guangbin Zhu. 
(cherry picked from commit ef432579a7)
(cherry picked from commit 6863866127)

# Conflicts:
#	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/AvailableSpaceBlockPlacementPolicy.java
 2017-05-21 17:47:51 -07:00
Kihwal Lee 9440ec2771 HDFS-8131. Implement a space balanced block placement policy. Contributed by Liu Shaohui. 
(cherry picked from commit de30d66b26)

# Conflicts:
#	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
 2017-05-21 17:19:54 -07:00
Konstantin V Shvachko 321f730ca8 HDFS-9412. getBlocks occupies FSLock and takes too long to complete. Contributed by He Tianyi. Backport HDFS-11855 by Vinitha Reddy Gankidi. 
(cherry picked from commit 67523ffcf4)
(cherry picked from commit a6d0e9e56a)
 2017-05-21 13:56:44 -07:00
Xuan 43ea501e33 YARN-4612. Fix rumen and scheduler load simulator handle killed tasks 
properly. Contributed by Ming Ma.

(cherry picked from commit 4efdf3a979)
 2017-05-21 13:00:32 -07:00
Karthik Kambatla 94031b1978 YARN-4367. SLS webapp doesn't load. (kasha) 2017-05-21 11:42:38 -07:00
Varun Vasudev 6feef1b039 YARN-4302. SLS not able start due to NPE in SchedulerApplicationAttempt. Contributed by Bibin A Chundatt. 
(cherry picked from commit c28e16b40c)
 2017-05-21 11:31:23 -07:00
Konstantin V Shvachko eecc68d4d8 HDFS-9726. Refactor IBR code to a new class. Contributed by Tsz-Wo Nicholas Sze. Backport HDFS-11839 by Vinitha Reddy Gankidi. 
(cherry picked from commit 494b6c7c4b)
 2017-05-18 18:09:36 -07:00
rohithsharmaks 0a4d8f6584 YARN-4109. Exception on RM scheduler page loading with labels. (Mohammad Shahid Khan via rohithsharmaks) 
(cherry picked from commit 8c180a13c8)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2017-05-18 17:26:30 -07:00
Konstantin V Shvachko 42c2d36ba6 MAPREDUCE-6304. Specifying node labels when submitting MR jobs. Contributed by Naganarasimha G R. Backport by Inigo Goiri. 
(cherry picked from commit 3164e7d838)
 2017-05-18 00:20:15 -07:00
Konstantin V Shvachko 2c3f6aedf1 HDFS-7990. IBR delete ack should not be delayed. Contributed by Daryn Sharp. Backport HDFS-11838 by Vinitha Gankidi. 
(cherry picked from commit 60882ab26d)
 2017-05-17 23:58:27 -07:00
Chris Douglas 2b58fb8b03 HADOOP-14434. Use MoveFileEx to allow renaming a file when the destination exists. Contributed by Lukas Majercak 
(cherry picked from commit ef9e536a71)
(cherry picked from commit 4bb0565443)
(cherry picked from commit 475b50b44c)
 2017-05-17 17:30:20 -07:00
Konstantin V Shvachko 0823fb72a9 HDFS-8498. Blocks can be committed with wrong size. Contributed by Jing Zhao. Backport HDFS-11732 by Zhe Zhang. 2017-05-16 11:03:12 -07:00
Brahma Reddy Battula 3004358639 HDFS-8312. Trash does not descent into child directories to check for permissions. Contributed By Weiwei Yang via Eric Yang. 2017-05-16 23:27:57 +05:30
Brahma Reddy Battula b95d63cdac HDFS-10987. Make Decommission less expensive when lot of blocks present. Contributed By Brahma Reddy Battula. 2017-05-16 10:50:51 +05:30
Jason Lowe 3252064eac HADOOP-14376. Memory leak when reading a compressed file using the native library. Contributed by Eli Acherkan 
(cherry picked from commit 7bc2172248)
 2017-05-12 17:04:31 -05:00
Vinayakumar B b0b6de38c9 HDFS-11674. reserveSpaceForReplicas is not released if append request failed due to mirror down and replica recovered (Contributed by Vinayakumar B) 2017-05-12 14:26:28 +05:30
Min Shen 28b947603b YARN-5543. ResourceManager SchedulingMonitor could potentially terminate the preemption checker thread. Contributed by Min Shen and Jonathan Hung. 
(cherry picked from commit 2ada100da7)
Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/SchedulingMonitor.java
 2017-05-11 13:47:12 -07:00
Brahma Reddy Battula 764fd3ed49 HDFS-9902. Support different values of dfs.datanode.du.reserved per storage type. Contributed By Brahma Reddy Battula. 2017-05-11 10:22:59 +05:30
Chris Douglas db72660f30 HADOOP-12173. NetworkTopology::add calls toString always. Contributed by Inigo Goiri 
(cherry picked from commit e59f6fad6a)

# Conflicts:
#	hadoop-common-project/hadoop-common/CHANGES.txt
 2017-05-10 20:48:38 -07:00
Konstantin V Shvachko f30484e042 Update CHANGES.txt for HADOOP-11703. 2017-05-10 20:01:43 -07:00
Allen Wittenauer 879dc57145 HADOOP-11703. git should ignore .DS_Store files on Mac OS X (Abin Shahab via aw) 
(cherry picked from commit 344d7cb6dc)
 2017-05-10 19:57:11 -07:00
Konstantin V Shvachko 834d4217b7 HADOOP-12975. Add jitter to CachingGetSpaceUsed's thread (Elliott Clark via Colin P. McCabe). 
HADOOP-14408. Backport contributed by Erik Krogen.

(cherry picked from commit bf780406f2)
(cherry picked from commit 56c997a1a6)
(cherry picked from commit 04682cc6b0)
 2017-05-10 19:16:01 -07:00
Akira Ajisaka f052976ff1
HDFS-11795. Fix ASF License warnings in branch-2.7. Contributed by Yiqun Lin. 2017-05-10 14:17:00 -05:00
Brahma Reddy Battula 48c5e37abf HDFS-11373. Backport HDFS-11258 and HDFS-11272(File mtime change could not save to editlog). (Contributed by Jimmy Xiang, backported by Akira Ajisaka) 2017-05-10 11:06:57 +05:30
Akira Ajisaka 2875462c2b
HADOOP-14100. Upgrade Jsch jar to latest version to fix vulnerability in old versions. Contributed by Vinayakumar B and Brahma Reddy Battula. 2017-05-09 11:47:28 -05:00
Akira Ajisaka 9088f8358a
Update CHANGES.txt for YARN-6457 branch-2.7. 2017-05-09 11:41:08 -05:00
Akira Ajisaka 6599e57a79
HDFS-11766. Fix findbugs warning in branch-2.7. Contributed by Chen Liang. 2017-05-09 11:22:57 -05:00
Haibo Chen f8e893f7ea YARN-6457. Allow custom SSL configuration to be supplied in WebApps. (Sanjay M Pujare via Haibo Chen) 
(cherry picked from commit 1769b12a77)
(cherry picked from commit 86fcb8a66c)
 2017-05-09 08:56:56 -07:00
Akira Ajisaka 0187892151
HADOOP-14374. License error in GridmixTestUtils.java. Contributed by lixinglong. 
(cherry picked from commit c60164fb60)
(cherry picked from commit 753954f7be)
 2017-05-09 05:43:12 -05:00
Varun Vasudev 0a149f3413 YARN-4562. YARN WebApp ignores the configuration passed to it for keystore settings. Contributed by Sergey Shelukhin. 
Added CHANGES.txt entry

(cherry picked from commit 07920acc16)
(cherry picked from commit 4baee3eb67)
 2017-05-09 10:51:31 +05:30
Konstantin V Shvachko c7c410898e Update CHANGES.txt for HDFS-11717 branch-2.7. 2017-05-02 22:30:18 -07:00
Erik Krogen a00cef6079 HDFS-11717. Add unit test for HDFS-11709 StandbyCheckpointer should handle non-existing legacyOivImageDir gracefully. Contributed by Erik Krogen. 
(cherry picked from commit d9014bda93)
(cherry picked from commit 9d6b873d3c)
 2017-05-02 18:46:58 -07:00
Akira Ajisaka 60e74edd05
HADOOP-14371. License error in TestLoadBalancingKMSClientProvider.java. Contributed by hu xiaodong. 
(cherry picked from commit 20cde55274)
(cherry picked from commit 036624900b)
 2017-05-02 23:41:17 +09:00
Kihwal Lee 130a0e2156 HDFS-11714. Newly added NN storage directory won't get initialized and cause space exhaustion. Contributed by Kihwal Lee. 
Added a CHANGES.txt entry
(cherry picked from commit f77d138725)
 2017-05-01 17:36:58 -05:00
Kihwal Lee 139327d34b HDFS-11609. Some blocks can be permanently lost if nodes are decommissioned while dead. Contributed by Kihwal Lee. 2017-05-01 14:31:59 -05:00
Zhe Zhang 8ad9efbe14 HDFS-8873. Allow the directoryScanner to be rate-limited. Contributed by Daniel Templeton. 2017-04-27 15:04:10 -07:00
Konstantin V Shvachko 5e67eb7560 Update CHANGES.txt for HDFS-11384 branch-2.7. 2017-04-27 12:23:41 -07:00