Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,658 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

9658 Commits

Author SHA1 Message Date
Konstantin V Shvachko 18065c2b68 Set the release date for 2.7.5 2017-12-15 14:35:53 -08:00
Konstantin V Shvachko 2c5c89fa48 Set the release date for 2.7.5-RC1 2017-12-07 16:19:44 -08:00
Konstantin V Shvachko 110c514013 Update CHANGES.txt for HADOOP-14867, HADOOP-14919, HDFS-12578, HDFS-12596, HDFS-8829, MAPREDUCE-6937, MAPREDUCE-6975, YARN-6959, YARN-7084 2017-12-07 15:06:57 -08:00
Tsuyoshi Ozawa 922728db1a MAPREDUCE-6165. [JDK8] TestCombineFileInputFormat failed on JDK8. Contributed by Akira AJISAKA. 
(cherry picked from commit 551615fa13)
(cherry picked from commit 4e96175b33)
 2017-12-07 13:29:28 -08:00
Konstantin V Shvachko f124ab6107 Set the release date for 2.7.5 2017-12-01 19:14:32 -08:00
Konstantin V Shvachko e378389729 Preparing for release 2.7.5 2017-12-01 18:58:33 -08:00
Konstantin V Shvachko 85eb32b12d HDFS-12638. Delete copy-on-truncate block along with the original block, when deleting a file being truncated. Contributed by Konstantin Shvachko. 
(cherry picked from commit 60fd0d7fd7)
 2017-11-30 19:22:01 -08:00
Konstantin V Shvachko 7252e18c30 HDFS-12832. INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit. Contribuited by Konstantin Shvachko. 
(cherry picked from commit d331762f24)
 2017-11-28 18:07:39 -08:00
Zhe Zhang 0da13b90f7 HDFS-12823. Backport HDFS-9259 "Make SO_SNDBUF size configurable at DFSClient" to branch-2.7. (Erik Krogen via zhz) 2017-11-17 16:48:32 -08:00
Colin Patrick Mccabe 6f876f419d HDFS-8829. Make SO_RCVBUF and SO_SNDBUF size configurable for DataTransferProtocol sockets and allow configuring auto-tuning (He Tianyi via Colin P. McCabe) 
Change-Id: I77dc71aaf9e14ef743f2a2cbebeec04a4f628c78
(cherry picked from commit 7b5cf5352e)
(cherry picked from commit 149d731559)
 2017-11-14 17:02:56 -08:00
Arun Suresh feb886f209 Fixing Job History Server Configuration parsing. (Jason Lowe via asuresh) 
(cherry picked from commit b3df744fb6)
 2017-11-09 15:26:37 -08:00
Naganarasimha 0c86dc8217 MAPREDUCE-6975. Logging task counters. Contributed by Prabhu Joseph. 
(cherry picked from commit 61bbdc511e)
 2017-11-06 14:12:24 +05:30
Jason Lowe 17e7c9d8b9 HADOOP-14919. BZip2 drops records when reading data in splits. Contributed by Jason Lowe 
(cherry picked from commit 2fae63aa60)
 2017-10-31 09:36:28 -05:00
Naganarasimha bfa736b778 Remove parent's env vars from child processes. Contributed by Vinayakumar B. 2017-10-25 11:12:30 +05:30
Zhe Zhang 3b45c278a5 Revert "HDFS-12502. nntop should support a category based on FilesInGetListingOps." 
This reverts commit 53a261a7ed.
 2017-10-24 15:03:34 -07:00
Zhe Zhang 53a261a7ed HDFS-12502. nntop should support a category based on FilesInGetListingOps. 
(cherry picked from commit 60bfee270e)
(cherry picked from commit aecf6c50d3)
(cherry picked from commit 87f4407396)
(cherry picked from commit f1ff21e00c)
 2017-10-19 00:22:45 -07:00
Xiaoyu Yao 5ef106af99 HDFS-10984. Expose nntop output as metrics. Contributed by Siddharth Wagle. 
(cherry picked from commit 61f0490a73)
(cherry picked from commit 6f2de54eb1)
 2017-10-19 00:16:08 -07:00
Arpit Agarwal c06851235a HDFS-12420. Add an option to disallow 'namenode format -force'. Contributed by Ajay Kumar. 
(cherry picked from commit b6942cbe9b)
(cherry picked from commit 5897095d53)
(cherry picked from commit 0aa1b62b39)
(cherry picked from commit dcdb3f250c)
 2017-10-17 23:57:11 -07:00
Xiao Chen 754a375d77 HDFS-12596. Add TestFsck#testFsckCorruptWhenOneReplicaIsCorrupt back to branch-2.7. 2017-10-13 14:24:04 -07:00
Xiao Chen d101b980a1 HDFS-12578. TestDeadDatanode#testNonDFSUsedONDeadNodeReReg failing in branch-2.7. Contributed by Ajay Kumar. 2017-10-13 14:24:04 -07:00
Jing Zhao 171a0bd517 HDFS-9003. ForkJoin thread pool leaks. Contributed by Kihwal Lee. 
(cherry picked from commit de928d566a)
(cherry picked from commit 1d56325a80)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2017-10-02 16:21:04 -07:00
Xiao Chen 0613956156 Update CHANGES.txt for HDFS-8865 2017-10-02 16:21:04 -07:00
Xiao Chen 21db218fd5 HDFS-8865. Improve quota initialization performance. Contributed by Kihwal Lee. 2017-10-02 15:27:55 -07:00
Eric Payne 90aae39a2a YARN-7084. TestSchedulingMonitor#testRMStarts fails sporadically. Contributed by Jason Lowe. 
(cherry picked from commit 7f6118f918)
 2017-09-29 11:06:57 -05:00
Jason Lowe ffe42e62c9 HADOOP-14902. LoadGenerator#genFile write close timing is incorrectly calculated. Contributed by Hanisha Koneru 
(cherry picked from commit 6f789fe057)

Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/loadGenerator/LoadGenerator.java
 2017-09-28 16:48:03 -05:00
Jason Lowe 150222c0c8 HADOOP-14881. LoadGenerator should use Time.monotonicNow() to measure durations. Contributed by Bharat Viswanadham 
(cherry picked from commit ac05a51bbb)
 2017-09-28 16:33:21 -05:00
Jason Lowe 897c10c82a YARN-5195. RM intermittently crashed with NPE while handling APP_ATTEMPT_REMOVED event when async-scheduling enabled in CapacityScheduler. Contributed by sandflee and Jonathan Hung 2017-09-21 15:33:38 -05:00
Konstantin V Shvachko ee7a94e4e8 HDFS-12323. Add CHANGES.txt 2017-09-15 14:34:25 -07:00
Erik Krogen f644b8757f HDFS-12323. NameNode terminates after full GC thinking QJM unresponsive if full GC is much longer than timeout. Contributed by Erik Krogen. 
(cherry picked from commit 90894c7262)
 2017-09-15 14:08:58 -07:00
Kihwal Lee 0507a013ee HDFS-10711. Optimize FSPermissionChecker group membership check. Contributed by Daryn Sharp. 
(cherry picked from commit 43d1279df0)
 2017-09-13 18:09:27 -07:00
Jason Lowe b637f95cf3 MAPREDUCE-6957. shuffle hangs after a node manager connection timeout. Contributed by Jooseong Kim 
(cherry picked from commit e63a2d4d33)
 2017-09-13 17:33:38 -05:00
Jason Lowe 98986d179a Update CHANGES.txt for HADOOP-14827 2017-09-13 17:29:46 -05:00
Arpit Agarwal 74e7c9b643 HADOOP-14867. Update HDFS Federation setup document, for incorrect property name for secondary name node http address. Contributed by Bharat Viswanadham. 2017-09-13 12:56:08 -07:00
Varun Saxena e89de1f829 MAPREDUCE-6750. Fix TestHSAdminServer#testRefreshSuperUserGroups (Kihwal Lee via Varun Saxena) 
(cherry picked from commit c4b77aed7e)
 2017-09-08 10:56:41 -07:00
Kihwal Lee b40b8a0add HDFS-10738. Fix TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration test failure. Contributed by Rakesh R. 
(cherry picked from commit 0f701f433d)
(cherry picked from commit 7f1879abe6)
 2017-09-08 10:52:58 -07:00
Kihwal Lee aa760e960c HADOOP-13442. Optimize UGI group lookups. Contributed by Daryn Sharp. 
(cherry picked from commit 9422515239)
 2017-09-08 10:49:50 -07:00
Andrew Wang 0dca198f09 HDFS-12131. Add some of the FSNamesystem JMX values as metrics. Contributed by Erik Krogen. 
(cherry picked from commit f4c6b00a9f)
 2017-09-06 15:18:28 -07:00
Jason Lowe 03892df215 HADOOP-14827. Allow StopWatch to accept a Timer parameter for tests. Contributed by Erik Krogen 
(cherry picked from commit dd814946f6)
 2017-09-06 16:17:43 -05:00
Colin Patrick Mccabe c2350ec42d HDFS-9107. Prevent NN's unrecoverable death spiral after full GC (Daryn Sharp via Colin P. McCabe) 
(cherry-picked from 4e7c6a653f)
 2017-08-30 16:15:03 -07:00
Jing Zhao 70df729a1e HDFS-8797. WebHdfsFileSystem creates too many connections for pread. Contributed by Jing Zhao. 
(cherry picked from commit e91ccfad07)
 2017-08-30 15:43:34 -07:00
Konstantin V Shvachko abd741a3f1 MAPREDUCE-6931. Remove TestDFSIO "Total Throughput" calculation. Contributed by Dennis Huo. 
(cherry picked from commit 3e0e2033cc)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/fs/TestDFSIO.java
 2017-08-30 15:02:34 -07:00
Haohui Mai 39d357451a HDFS-9153. Pretty-format the output for DFSIO. Contributed by Kai Zheng. 2017-08-30 14:55:05 -07:00
Haibo Chen 3f5c67df77 MAPREDUCE-6937. Backport MAPREDUCE-6870 to branch-2 while preserving compatibility. (Peter Bacsko via Haibo Chen) 2017-08-30 09:39:50 -07:00
Jian He 8e675d93df YARN-6959. RM may allocate wrong AM Container for new attempt. Contributed by Yuqi Wang 2017-08-17 11:22:01 -07:00
Kihwal Lee ae854076c7 HDFS-12157. Do fsyncDirectory(..) outside of FSDataset lock. Contributed by Vinayakumar B. 2017-08-09 09:36:08 -05:00
Konstantin V Shvachko 4ed7df2c50 Set the release date for 2.7.4. 2017-08-05 13:56:08 -07:00
Masatake Iwasaki c521acdc50 HADOOP-14702. Fix formatting issue and regression caused by conversion from APT to Markdown. Contributed by Doris Gu. 
(cherry picked from commit d9a07b3904)

Conflicts:
	hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md

(cherry picked from commit a01d92156d)

Conflicts:
	hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md
 2017-08-02 06:51:00 +00:00
Konstantin V Shvachko 7be489822c Preparing for 2.7.5 development 2017-07-27 21:05:02 -07:00
Brahma Reddy Battula f90b9d2b25 HDFS-11896. Non-dfsUsed will be doubled on dead node re-registration. Contributed by Brahma Reddy Battula. 
(cherry picked from commit c4a85c694f)
 2017-07-27 12:40:09 -07:00
Sean Busbey b51623503f HADOOP-14686. Add patchprocess/ to .gitignore. Contributed by Sean Busbey. 2017-07-26 16:27:48 -07:00