Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,556 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

9556 Commits

Author SHA1 Message Date
Andrew Wang 165febbc84 HDFS-10991. Export hdfsTruncateFile symbol in libhdfs. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit dacd3ec66b)
(cherry picked from commit 67f0319db6)
 2016-10-11 15:08:53 -07:00
Tsz-Wo Nicholas Sze b23b60e7b4 HDFS-8824. Do not use small blocks for balancing the cluster. 
(cherry-picked from commit 61b9e5f7ff)
 2016-10-07 11:01:29 -07:00
Zhe Zhang 47fcae7da8 HDFS-10745. Directly resolve paths into INodesInPath. Contributed by Daryn Sharp.. 2016-10-06 09:39:59 -07:00
Brahma Reddy Battula 23d4351174 adding entry for HADOOP-13670 in changes.txt 2016-10-06 20:01:31 +05:30
Brahma Reddy Battula 7e241cfcba HADOOP-13670. Update CHANGES.txt to reflect all the changes in branch-2.7. Contributed by Brahma Reddy Battula 2016-10-06 17:56:45 +05:30
Wei-Chiu Chuang 039c3a7351 HDFS-10609. Uncaught InvalidEncryptionKeyException during pipeline recovery may abort downstream applications. Contributed by Wei-Chiu Chuang. 2016-10-05 13:29:20 -07:00
Jason Lowe 599146d10b MAPREDUCE-6741. Add MR support to redact job conf properties. Contributed by Haibo Chen 
(cherry picked from commit f1b74a3d9f)

Conflicts:

	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
 2016-10-05 15:33:23 +00:00
Zhe Zhang 5c99959b2d HDFS-10896. Move lock logging logic from FSNamesystem into FSNamesystemLock. Contributed by Erik Krogen. 2016-10-04 16:52:56 -07:00
Kihwal Lee 3eff0873f6 HDFS-10878. TestDFSClientRetries#testIdempotentAllocateBlockAndClose throws ConcurrentModificationException. Contributed by Rushabh S Shah. 
Modified CHANGES.txt
(cherry picked from commit 382307cbdd)
 2016-10-04 11:17:59 -05:00
Arpit Agarwal c08346ea2d HDFS-10713. Throttle FsNameSystem lock warnings. Contributed by Hanisha Koneru. 
(cherry-picked from a349c54603)
 2016-09-30 16:18:23 -07:00
Jason Lowe 7a2d602ae0 MAPREDUCE-6771. RMContainerAllocator sends container diagnostics event after corresponding completion event. Contributed by Haibo Chen 2016-09-29 16:05:41 +00:00
Kihwal Lee 031125b8ff HADOOP-11780. Prevent IPC reader thread death. Contributed by Daryn Sharp. 
(cherry picked from commit e19b37ead2)
 2016-09-28 10:49:29 -05:00
Mingliang Liu bdc97f74fe HDFS-10915. Fix time measurement bug in TestDatanodeRestart. Contributed by Xiaobing Zhou 
(cherry picked from commit 6437ba18c5)
 2016-09-27 20:49:30 -07:00
Brahma Reddy Battula 5c3294d00f HDFS-10889. Remove outdated Fault Injection Framework documentaion. Contributed by Brahma Reddy Battula 
(cherry picked from commit df1d0f5d56)
 2016-09-27 19:48:32 +05:30
Brahma Reddy Battula 1190f837c8 adding the entry in CHANGE.txt for HDFS-9885 2016-09-27 10:58:31 +05:30
Brahma Reddy Battula ff4fb48da1 HDFS-9885. Correct the distcp counters name while displaying counters. Contributed by Surendra Singh Lilhore 
(cherry picked from commit e17a4970be)
 2016-09-27 10:53:51 +05:30
Brahma Reddy Battula aaff2033b9 HADOOP-12597. In kms-site.xml configuration hadoop.security.keystore.JavaKeyStoreProvider.password should be updated with new name. ( Contributed by Surendra Singh Lilhore via Brahma Reddy Battula) 2016-09-26 22:31:31 +05:30
Konstantin V Shvachko 66ee9f554e HDFS-10843. Add missing file to commit 4b5806217e. 2016-09-23 11:13:25 -07:00
Konstantin V Shvachko 4b5806217e HDFS-10843. Update space quota when a UC block is completed rather than committed. Contributed by Erik Krogen. 
(cherry picked from commit a5bb88c8e0)
 2016-09-23 10:56:15 -07:00
Mingliang Liu 2a1e48bd2f HADOOP-13601. Fix a log message typo in AbstractDelegationTokenSecretManager. Contributed by Mehran Hassani. 
(cherry picked from commit e80386d69d)
 2016-09-20 13:25:01 -07:00
Jason Lowe d6c36c2954 YARN-5540. Scheduler spends too much time looking at empty priorities. Contributed by Jason Lowe 2016-09-19 20:37:22 +00:00
Xiao Chen 81ac06039e HADOOP-13558. UserGroupInformation created from a Subject incorrectly tries to renew the Kerberos ticket. Contributed by Xiao Chen. 
(cherry picked from commit 680be58aac)
(cherry picked from commit d157733082)

Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/TestUserGroupInformation.java

(cherry picked from commit a7f1dc8aa8)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/UserGroupInformation.java
 2016-09-19 12:56:02 -07:00
Kihwal Lee a8b7817739 HDFS-9621. Consolidate FSDirStatAndListingOp#createFileStatus to let its INodesInPath parameter always include the target INode. Contributed by Jing Zhao. 
(cherry picked from commit 313f03bfda)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java

(cherry picked from commit c2708bc5fb)
 2016-09-15 11:05:52 -07:00
Haohui Mai 6f44510d87 HDFS-8200. Refactor FSDirStatAndListingOp. Contributed by Haohui Mai. 
(cherry picked from commit 01acf3a3af)
 2016-09-15 10:54:15 -07:00
Kihwal Lee 199ccd4915 HDFS-10744. Internally optimize path component resolution. Contributed by Daryn Sharp. 
(cherry picked from commit 1ef8d7a638)
(cherry picked from commit 3dac73080a)
 2016-09-13 21:58:58 -07:00
Tsz-Wo Nicholas Sze 9afc6615b0 In Balancer, the target task should be removed when its size < 0. Contributed by Yiqun Lin 
(cherry picked from commit cefa21e98a)
 2016-09-12 23:28:34 -07:00
Kihwal Lee a39a9fc46b HDFS-10673. Optimize FSPermissionChecker's internal path usage. Contributed by Daryn Sharp. 
(cherry picked from commit 438a9f047e)
(cherry picked from commit 09b06a6e9e)
(cherry picked from commit f09b04b3f5)
 2016-09-12 15:57:48 -07:00
Tsz-Wo Nicholas Sze 32d810133c HDFS-8818. Changes the global moveExecutor to per datanode executors and changes MAX_SIZE_TO_MOVE to be configurable. 
(cherry picked from commit ac8d153046)
 2016-09-12 15:01:58 -07:00
Xiaoyu Yao d7da70332f HDFS-9019. Adding informative message to sticky bit permission denied exception. Contributed by Xiaoyu Yao. 
(cherry picked from commit 970daaa5e4)
(cherry picked from commit b2465690a1)
 2016-09-12 13:16:31 -07:00
Yongjun Zhang e6c162a394 HDFS-10276. HDFS should not expose path info that user has no permission to see. (Yuanbo Liu via Yongjun Zhang) 
(cherry picked from commit 5ea6fd85c7)
(cherry picked from commit 3e4c7906c2)
 2016-09-12 13:02:56 -07:00
Yongjun Zhang 97e4b13038 HDFS-5802. NameNode does not check for inode type before traversing down a path. (Xiao Chen via Yongjun Zhang) 
(cherry picked from commit 9859fd006b)
 2016-09-12 12:58:00 -07:00
Akira Ajisaka e807fde448 HADOOP-13579. Fix source-level compatibility after HADOOP-11252. Contributed by Tsuyoshi Ozawa. 2016-09-09 14:27:57 +09:00
Arpit Agarwal 607801b2ff HDFS-9038. DFS reserved space is erroneously counted towards non-DFS used. (Brahma Reddy Battula) 2016-09-08 13:40:01 -07:00
Kihwal Lee 67204f2834 HDFS-10662. Optimize UTF8 string/byte conversions. Contributed by Daryn Sharp. 
(cherry picked from commit 6ae39199da)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirWriteFileOp.java

(cherry picked from commit 77b61d1f4e)
(cherry picked from commit 58df27b873)
 2016-09-01 15:09:02 -07:00
Zhe Zhang 6793ef0de6 HDFS-10817. Add Logging for Long-held NN Read Locks. Contributed by Erik Krogen. 
(cherry picked from commit 6f4b0d33ca)
(cherry picked from commit f87e2f5d05)
(cherry picked from commit 7adbd569a6)
 2016-08-31 23:57:38 -07:00
Kihwal Lee 73ba5a0170 HDFS-10674. Optimize creating a full path from an inode. Contributed by Daryn Sharp. 
(cherry picked from commit 22ef5286bc)
(cherry picked from commit a5d12d9c1f)
(cherry picked from commit e53f6fde46)
 2016-08-31 15:30:45 -07:00
Kihwal Lee d3c6120576 HDFS-10656. Optimize conversion of byte arrays back to path string. Contributed by Daryn Sharp. 
(cherry picked from commit bebf10d245)
(cherry picked from commit ab7072838f)
(cherry picked from commit 7b5e12229d)
 2016-08-31 15:29:26 -07:00
Daryn Sharp 319a6005e6 HDFS-10655. Fix path related byte array conversion bugs. (daryn) 
(cherry picked from commit 9f473cf903)
(cherry picked from commit ecb143ed21)
 2016-08-30 15:52:18 -07:00
Zhe Zhang 85a067fd6b HDFS-10809. getNumEncryptionZones causes NPE in branch-2.7. Contributed by Vinitha Reddy Gankidi. 2016-08-30 11:46:52 -07:00
Jason Lowe d499a8cccf MAPREDUCE-4784. TestRecovery occasionally fails. Contributed by Haibo Chen 
(cherry picked from commit f70f522e80)
 2016-08-30 14:11:49 +00:00
Kihwal Lee a9479f8f2c HADOOP-12418. TestRPC.testRPCInterruptedSimple fails intermittently. Contributed Kihwal Lee. 
Cherry-picked from 01b103f4ff
 2016-08-30 12:52:31 +00:00
Zhe Zhang 32a86f199c YARN-5550. TestYarnCLI#testGetContainers should format according to CONTAINER_PATTERN. Contributed by Jonathan Hung. 
(cherry picked from commit ed6ff5cd78)
(cherry picked from commit 3ad4f0823c)
(cherry picked from commit 765139e4da)
 2016-08-29 14:52:09 -07:00
Yongjun Zhang 4fd2adbc5f HDFS-10625. VolumeScanner to report why a block is found bad. Contributed by Rushabh S Shah and Yiqun Lin. 
(cherry picked from commit 5d1609ddf2)
 2016-08-29 14:25:49 -07:00
Jason Lowe a852800d2f MAPREDUCE-6768. TestRecovery.testSpeculative failed with NPE. Contributed by Haibo Chen 
(cherry picked from commit 44d0af2611)
 2016-08-29 20:02:47 +00:00
Mingliang Liu 3112a2447f HDFS-10807. Doc about upgrading to a version of HDFS with snapshots may be confusing. (Contributed by Mingliang Liu) 2016-08-29 10:22:55 -07:00
Zhe Zhang 1d01704060 HADOOP-12765. HttpServer2 should switch to using the non-blocking SslSelectChannelConnector to prevent performance degradation when handling SSL connections. Contributed by Min Shen. Branch-2 patch contributed by Wei-Chiu Chuang. 
(cherry picked from commit dfcbc12026)
(cherry picked from commit 8bc33bf343)
 2016-08-29 10:10:47 -07:00
Zhe Zhang 4f43607311 HDFS-10798. Make the threshold of reporting FSNamesystem lock contention configurable. Contributed by Erik Krogen. 
(cherry picked from commit 407b519fb1)
(cherry picked from commit f3a4cbcc60)
(cherry picked from commit 96cf681b5d)
 2016-08-26 14:34:28 -07:00
Kihwal Lee 8593225e85 HDFS-8915. TestFSNamesystem.testFSLockGetWaiterCount fails intermittently. Contributed by Masatake Iwasaki. 
(cherry picked from commit 13fb1b50e6)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSNamesystem.java
Updated CHANGES.txt
 2016-08-26 10:09:57 -05:00
Jing Zhao 8aa18534d9 HDFS-9467. Fix data race accessing writeLockHeldTimeStamp in FSNamesystem. Contributed by Mingliang Liu. 
(cherry picked from commit e556c35b05)
(cherry picked from commit 288cf8437b)
 2016-08-25 10:34:43 -07:00
Haohui Mai 0d8a1636ef HDFS-9145. Tracking methods that hold FSNamesytemLock for too long. Contributed by Mingliang Liu. 
(cherry picked from commit 5c5362980c)
 2016-08-25 10:18:50 -07:00