Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,654 Commits 326 Branches 371 Tags
Commit Graph

11654 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Akira Ajisaka
c0699a1f55 HADOOP-13685. Document -safely option of rm command. Contributed by Xiaoyu Yao. 
(cherry picked from commit 9a61b52fbefd2970af78bb283ae174d462d57a13)
(cherry picked from commit bdbb75e083218e11d8c8e34d38e4dc859b444c97)
 2016-10-05 20:41:51 +09:00
Varun Saxena
3656b84085 YARN-5491. Fix random failure of TestCapacityScheduler#testCSQueueBlocked (Bibin A Chundatt via Varun Saxena) 
(cherry picked from commit d677b68c2599445fff56db4df26448a8bad0f5dd)
 2016-10-04 20:57:01 +00:00
Kihwal Lee
d03240e0bf HDFS-10956. Remove rename/delete performance penalty when not using snapshots. Contributed by Daryn Sharp. 
(cherry picked from commit 44f48ee96ee6b2a3909911c37bfddb0c963d5ffc)
 2016-10-04 15:29:39 -05:00
Chris Nauroth
4ea1e73e5b HADOOP-13674. S3A can provide a more detailed error message when accessing a bucket through an incorrect S3 endpoint. Contributed by Chris Nauroth. 
(cherry picked from commit 88b9444a81081da9b168d2e290f9552b58a4d8c6)
(cherry picked from commit 213f0ad7f0e846cf8023b12cf8e5f804950b1aa1)
 2016-10-04 10:37:10 -07:00
Kihwal Lee
33cafc9fcd HDFS-10878. TestDFSClientRetries#testIdempotentAllocateBlockAndClose throws ConcurrentModificationException. Contributed by Rushabh S Shah. 
(cherry picked from commit 382307cbdd94107350fe6fad1acf87d63c9be9d6)
 2016-10-04 11:13:39 -05:00
Brahma Reddy Battula
253e2442e4 HDFS-10947. Correct the API name for truncate in webhdfs document. Contributed by Surendra Singh Lilhore 
(cherry picked from commit ef7f06f7d1561db13bd3b07a5f62815ec29e1cdf)
 2016-10-04 18:53:12 +05:30
Brahma Reddy Battula
1ae35b6fff HDFS-10944. Correct the javadoc of dfsadmin#disallowSnapshot. Contributed by Jagadesh Kiran N 
(cherry picked from commit 5ea0210c7fea1324973e7f69256bc53f31ee4cf7)
 2016-10-04 18:39:31 +05:30
Mingliang Liu
438402a710 HDFS-10934. TestDFSShell#testStat fails intermittently. Contributed by Eric Badger 
(cherry picked from commit f61e3d13e9610cbd09886359553f27d6480f6735)
 2016-10-03 22:44:22 -04:00
Mingliang Liu
11ea5a59c2 HDFS-10810. setreplication removing block from underconstrcution temporarily. Contributed by Brahma Reddy Battula 
(cherry picked from commit d963ecb9185b8fcfba86bec8420a8daf7140a071)
 2016-10-03 22:04:49 -04:00
Xiao Chen
bf043e63f9 HDFS-10918. Add a tool to get FileEncryptionInfo from CLI. Contributed by Xiao Chen. 
(cherry picked from commit 853d65a157362661ccab10379c2d82e780382f83)
 2016-10-03 16:02:11 -07:00
Xiaoyu Yao
b0b29de8ab HDFS-10690. Optimize insertion/removal of replica in ShortCircuitCache. Contributed by Fenghua Hu. 
(cherry picked from commit 607705c488fa5263d851cee578a2d319e6e52ecd)
 2016-10-03 11:05:58 -07:00
Naganarasimha
90443140a5 YARN-4855. Should check if node exists when replace nodelabels. Contributeed by Tao Jie 2016-10-03 13:29:18 -04:00
Kihwal Lee
52c534cd0f HDFS-10940. Reduce performance penalty of block caching when not used. Contributed by Daryn Sharp. 
(cherry picked from commit 03b797a6ac2b1f99c6baebf4729bae22aa267692)
 2016-10-03 11:42:06 -05:00
Kihwal Lee
84b20d1c18 HDFS-10945. Fix the Findbugwaring FSNamesystem#renameTo() in branch-2. Contributed by Brahma Reddy Battula. 2016-10-03 11:09:40 -05:00
Jason Lowe
515727f46f YARN-4543. Fix random test failure in TestNodeStatusUpdater.testStopReentrant. (Akihiro Suda via rohithsharmaks) 
(cherry picked from commit ac686668031ee9837deed3f3566f09f33c437870)
 2016-10-03 16:06:17 +00:00
Kihwal Lee
3a89a8814f HDFS-10619. Cache path in InodesInPath. Contributed by Daryn Sharp. 
(cherry picked from commit 90020624b05230ad4a7fbd666d0177ecb107a4d6)
 2016-10-03 09:26:41 -05:00
Arpit Agarwal
c31d23db35 Revert "HDFS-10923. Make InstrumentedLock require ReentrantLock." 
This reverts commit 9d4e0168d5f0e9211049252981f0f8e705e98fc7.
 2016-09-30 23:12:16 -07:00
Arpit Agarwal
9d4e0168d5 HDFS-10923. Make InstrumentedLock require ReentrantLock. 2016-09-30 23:04:30 -07:00
Xiao Chen
b1eb21e940 HADOOP-13317. Add logs to KMS server-side to improve supportability. Contributed by Suraj Acharya. 
(cherry picked from commit 89bd6d29a62afd7ed8ff87bcc29d17b1cb53dcb6)
 2016-09-30 17:52:17 -07:00
Kihwal Lee
bfc7f0630b HDFS-10851. FSDirStatAndListingOp: stop passing path as string. Contributed by Daryn Sharp. 
(cherry picked from commit 2551ff80b7eb3e13194ec47db64cf9ee940b9ab0)
 2016-09-30 16:02:26 -05:00
Zhe Zhang
345debf22e HDFS-10896. Move lock logging logic from FSNamesystem into FSNamesystemLock. Contributed by Erik Krogen. 
(cherry-picked from commit 434c5ea75dc3d87513e49290ac9999148ff5163c)
 2016-09-30 13:43:49 -07:00
Wei-Chiu Chuang
9a79c54867 HADOOP-12974. Create a CachingGetSpaceUsed implementation that uses df. Contributed by Elliott Clark. 
(cherry picked from commit 57aec2b46b0e46b73a1f49927e30e2c41138d535)
(cherry picked from commit a6863e5334569fa92e70cc4d84afb545f993c8d3)
 2016-09-30 13:29:59 -07:00
Kihwal Lee
f5b193b482 HDFS-10850. getEZForPath should NOT throw FNF. Contributed by Andrew Wang. 
(cherry picked from commit 0670149c88852cd7c4d6774bff06c7c588558739)
 2016-09-30 09:16:13 -05:00
Akira Ajisaka
7016dfe590 HADOOP-13640. Fix findbugs warning in VersionInfoMojo.java. Contributed by Yuanbo Liu. 
(cherry picked from commit 82c55dcbc8e3d5314aae9f8f600c660759213e45)
(cherry picked from commit 25df276c6b24db46070c9885e48e363cc92d1b6f)

Conflicts:
    hadoop-maven-plugins/src/main/java/org/apache/hadoop/maven/plugin/versioninfo/VersionInfoMojo.java
 2016-09-30 18:20:17 +09:00
Chris Nauroth
1085b3ee45 Revert "HADOOP-13081. add the ability to create multiple UGIs/subjects from one kerberos login. Contributed by Sergey Shelukhin." 
This reverts commit 06df0cd87f5517e778cf0d97614035e126e2fb80.
 2016-09-29 13:58:35 -07:00
Kihwal Lee
d60b4648dc HADOOP-13537. Support external calls in the RPC call queue. Contributed by Daryn Sharp. 
(cherry picked from commit 236ac773c964fa21d6d5f1496023cd61818dd3b1)
(cherry picked from commit 92336ea37e64c48ca84dbb71d84e4d78aaa29438)
 2016-09-29 13:58:17 -05:00
Jason Lowe
db93a64eca MAPREDUCE-6771. RMContainerAllocator sends container diagnostics event after corresponding completion event. Contributed by Haibo Chen 
(cherry picked from commit c52ad9ee86f5033caca02a7af6aeccfc5c87a99e)
 2016-09-29 15:51:36 +00:00
Steve Loughran
1c8e388181 HADOOP-13663 Index out of range in SysInfoWindows. Contributed by Inigo Goiri 2016-09-29 11:35:54 +01:00
Chris Nauroth
b7b06a5f34 HADOOP-13599. s3a close() to be non-synchronized, so avoid risk of deadlock on shutdown. Contributed by Steve Loughran. 
(cherry picked from commit 47f80922dc7cb2fa6d084e6fb1f354c4ec1d4c69)
(cherry picked from commit 1f1e47e41198760b0ddddceb489f2de2b569f38a)
 2016-09-28 16:21:10 -07:00
Mingliang Liu
7467628d43 HDFS-10892. Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat'. Contributed by Mingliang Liu 
(cherry picked from commit 84c626407925e03ee2ef11faba9324d5c55b8e93)
 2016-09-28 16:09:42 -07:00
Kihwal Lee
5294eec729 HDFS-10779. Rename does not need to re-solve destination. Contributed by Daryn Sharp. 
(cherry picked from commit 5f34402adae191232fe78e62990396ca07f314bb)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
 2016-09-28 18:03:58 -05:00
Andrew Wang
c4f81f199f HDFS-10914. Move remnants of oah.hdfs.client to hadoop-hdfs-client. 
(cherry picked from commit 92e5e9159850c01635091ea6ded0d8ee76691a9a)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/client/HdfsAdmin.java

(cherry picked from commit 9ddaa29301ea8ae2e3cb0f1e031343d5b91f92ee)
 2016-09-28 16:03:02 -07:00
Arpit Agarwal
76f92277c3 HDFS-10824. MiniDFSCluster#storageCapacities has no effects on real capacity. Contributed by Xiaobing Zhou. 2016-09-28 15:56:39 -07:00
Kihwal Lee
7091753bd2 HADOOP-11780. Prevent IPC reader thread death. Contributed by Daryn Sharp. 
(cherry picked from commit e19b37ead23805c7ed45bdcbfa7fdc8898cde7b2)
 2016-09-28 10:03:24 -05:00
Brahma Reddy Battula
5f754e8638 HDFS-9444. Add utility to find set of available ephemeral ports to ServerSocketUtil. Contributed by Masatake Iwasaki 
(cherry picked from commit e9a34ae29c7390f3ffcbeee02dc5faa26fca482a)
 2016-09-28 11:16:40 +05:30
Mingliang Liu
6da9a3c603 HDFS-10915. Fix time measurement bug in TestDatanodeRestart. Contributed by Xiaobing Zhou 
(cherry picked from commit 6437ba18c5c26bc271a63aff5ea03756f43dd9a3)
 2016-09-27 20:47:04 -07:00
Mingliang Liu
ecb5f282ea HADOOP-13658. Replace config key literal strings with names I: hadoop common. Contributed by Chen Liang 
(cherry picked from commit 9a44a832a99eb967aa4e34338dfa75baf35f9845)
 2016-09-27 17:42:01 -07:00
Wangda Tan
69f91d8c48 HADOOP-13544. JDiff reports unncessarily show unannotated APIs and cause confusion while our javadocs only show annotated and public APIs. (vinodkv via wangda) 
(cherry picked from commit 875062b5bc789158290bf93dadc71b5328ca4fee)
(cherry picked from commit 269401dc83699e4de7b99e794eeb7646a7f3fc93)
 2016-09-27 11:46:49 -07:00
Rohith Sharma K S
4f6facb90d YARN-5631. Missing refreshClusterMaxPriority usage in rmadmin help message. Contributed by Kai Sasaki. 2016-09-27 23:07:43 +05:30
Arpit Agarwal
3f5482bb69 HDFS-10828. Fix usage of FsDatasetImpl object lock in ReplicaMap. (Arpit Agarwal) 2016-09-27 10:02:27 -07:00
Masatake Iwasaki
756dbc505e HDFS-10426. TestPendingInvalidateBlock failed in trunk. Contributed by Yiqun Lin. 
(cherry picked from commit f55eb981dd408ca61d49488f83c99c1fc1f83134)
 2016-09-28 01:47:31 +09:00
Arpit Agarwal
a349c54603 HDFS-10713. Throttle FsNameSystem lock warnings. Contributed by Hanisha Koneru. 2016-09-27 09:05:53 -07:00
Brahma Reddy Battula
5bc297c58f HDFS-10889. Remove outdated Fault Injection Framework documentaion. Contributed by Brahma Reddy Battula 
(cherry picked from commit df1d0f5d56f375e82b0219a19675a7b6052aaf30)
 2016-09-27 19:35:57 +05:30
Naganarasimha
63ca9f5441 YARN-5660. Wrong audit constants are used in Get/Put of priority in RMWebService. Contributed by Rohith Sharma K S 
(cherry picked from commit ebf528c443f3931c8b0f92ee76615fc203141675)
 2016-09-27 16:46:52 +05:30
Brahma Reddy Battula
686cbf45d4 HDFS-9885. Correct the distcp counters name while displaying counters. Contributed by Surendra Singh Lilhore 
(cherry picked from commit e17a4970bea8213660bb6c550104783069153236)
 2016-09-27 10:49:04 +05:30
Wei-Chiu Chuang
f0f3b6a66a HDFS-10609. Uncaught InvalidEncryptionKeyException during pipeline recovery may abort downstream applications. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 3ae652f82110a52bf239f3c1849b48981558eb19)
(cherry picked from commit bde787db23dd38388dac045d421394006ba63bed)
 2016-09-26 14:46:02 -07:00
Xiao Chen
09964a1629 HADOOP-13638. KMS should set UGI's Configuration object properly. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit fa397e74fe988bcbb05c816de73eb738794ace4b)

Conflicts:
	hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMS.java

(cherry picked from commit 06187e4f98c70b12fbf61c21580ccded27c87185)

Conflicts:
	hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMS.java
 2016-09-26 13:04:29 -07:00
Brahma Reddy Battula
fa042ff9af HADOOP-12597. In kms-site.xml configuration hadoop.security.keystore.JavaKeyStoreProvider.password should be updated with new name. ( Contributed by Surendra Singh Lilhore via Brahma Reddy Battula) 2016-09-26 23:19:36 +05:30
Akira Ajisaka
ece3ca0cba YARN-5663. Small refactor in ZKRMStateStore. Contributed by Oleksii Dymytrov. 
(cherry picked from commit 14a696f369f7e3802587f57c8fff3aa51b5ab576)
(cherry picked from commit 74f2df16a919711cbd10464d11851110c1728edf)
 2016-09-26 15:01:39 +09:00
Naganarasimha
4c2b20ca3e YARN-3877. YarnClientImpl.submitApplication swallows exceptions. Contributed by Varun Saxena 
(cherry picked from commit e4e72db5f9f305b493138ab36f073fe5d1750ad8)
 2016-09-25 17:42:08 +05:30