Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,756 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

11756 Commits

Author SHA1 Message Date
Jason Lowe f1b74a3d9f MAPREDUCE-6741. Add MR support to redact job conf properties. Contributed by Haibo Chen 2016-10-05 15:24:10 +00:00
Steve Loughran f66863f848 HADOOP-12667 s3a to support createNonRecursive API. Contributed by Sean Mackrory 2016-10-05 15:01:52 +01:00
Akira Ajisaka c0699a1f55 HADOOP-13685. Document -safely option of rm command. Contributed by Xiaoyu Yao. 
(cherry picked from commit 9a61b52fbe)
(cherry picked from commit bdbb75e083)
 2016-10-05 20:41:51 +09:00
Varun Saxena 3656b84085 YARN-5491. Fix random failure of TestCapacityScheduler#testCSQueueBlocked (Bibin A Chundatt via Varun Saxena) 
(cherry picked from commit d677b68c25)
 2016-10-04 20:57:01 +00:00
Kihwal Lee d03240e0bf HDFS-10956. Remove rename/delete performance penalty when not using snapshots. Contributed by Daryn Sharp. 
(cherry picked from commit 44f48ee96e)
 2016-10-04 15:29:39 -05:00
Chris Nauroth 4ea1e73e5b HADOOP-13674. S3A can provide a more detailed error message when accessing a bucket through an incorrect S3 endpoint. Contributed by Chris Nauroth. 
(cherry picked from commit 88b9444a81)
(cherry picked from commit 213f0ad7f0)
 2016-10-04 10:37:10 -07:00
Kihwal Lee 33cafc9fcd HDFS-10878. TestDFSClientRetries#testIdempotentAllocateBlockAndClose throws ConcurrentModificationException. Contributed by Rushabh S Shah. 
(cherry picked from commit 382307cbdd)
 2016-10-04 11:13:39 -05:00
Brahma Reddy Battula 253e2442e4 HDFS-10947. Correct the API name for truncate in webhdfs document. Contributed by Surendra Singh Lilhore 
(cherry picked from commit ef7f06f7d1)
 2016-10-04 18:53:12 +05:30
Brahma Reddy Battula 1ae35b6fff HDFS-10944. Correct the javadoc of dfsadmin#disallowSnapshot. Contributed by Jagadesh Kiran N 
(cherry picked from commit 5ea0210c7f)
 2016-10-04 18:39:31 +05:30
Mingliang Liu 438402a710 HDFS-10934. TestDFSShell#testStat fails intermittently. Contributed by Eric Badger 
(cherry picked from commit f61e3d13e9)
 2016-10-03 22:44:22 -04:00
Mingliang Liu 11ea5a59c2 HDFS-10810. setreplication removing block from underconstrcution temporarily. Contributed by Brahma Reddy Battula 
(cherry picked from commit d963ecb918)
 2016-10-03 22:04:49 -04:00
Xiao Chen bf043e63f9 HDFS-10918. Add a tool to get FileEncryptionInfo from CLI. Contributed by Xiao Chen. 
(cherry picked from commit 853d65a157)
 2016-10-03 16:02:11 -07:00
Xiaoyu Yao b0b29de8ab HDFS-10690. Optimize insertion/removal of replica in ShortCircuitCache. Contributed by Fenghua Hu. 
(cherry picked from commit 607705c488)
 2016-10-03 11:05:58 -07:00
Naganarasimha 90443140a5 YARN-4855. Should check if node exists when replace nodelabels. Contributeed by Tao Jie 2016-10-03 13:29:18 -04:00
Kihwal Lee 52c534cd0f HDFS-10940. Reduce performance penalty of block caching when not used. Contributed by Daryn Sharp. 
(cherry picked from commit 03b797a6ac)
 2016-10-03 11:42:06 -05:00
Kihwal Lee 84b20d1c18 HDFS-10945. Fix the Findbugwaring FSNamesystem#renameTo() in branch-2. Contributed by Brahma Reddy Battula. 2016-10-03 11:09:40 -05:00
Jason Lowe 515727f46f YARN-4543. Fix random test failure in TestNodeStatusUpdater.testStopReentrant. (Akihiro Suda via rohithsharmaks) 
(cherry picked from commit ac68666803)
 2016-10-03 16:06:17 +00:00
Kihwal Lee 3a89a8814f HDFS-10619. Cache path in InodesInPath. Contributed by Daryn Sharp. 
(cherry picked from commit 90020624b0)
 2016-10-03 09:26:41 -05:00
Arpit Agarwal c31d23db35 Revert "HDFS-10923. Make InstrumentedLock require ReentrantLock." 
This reverts commit 9d4e0168d5.
 2016-09-30 23:12:16 -07:00
Arpit Agarwal 9d4e0168d5 HDFS-10923. Make InstrumentedLock require ReentrantLock. 2016-09-30 23:04:30 -07:00
Xiao Chen b1eb21e940 HADOOP-13317. Add logs to KMS server-side to improve supportability. Contributed by Suraj Acharya. 
(cherry picked from commit 89bd6d29a6)
 2016-09-30 17:52:17 -07:00
Kihwal Lee bfc7f0630b HDFS-10851. FSDirStatAndListingOp: stop passing path as string. Contributed by Daryn Sharp. 
(cherry picked from commit 2551ff80b7)
 2016-09-30 16:02:26 -05:00
Zhe Zhang 345debf22e HDFS-10896. Move lock logging logic from FSNamesystem into FSNamesystemLock. Contributed by Erik Krogen. 
(cherry-picked from commit 434c5ea75d)
 2016-09-30 13:43:49 -07:00
Wei-Chiu Chuang 9a79c54867 HADOOP-12974. Create a CachingGetSpaceUsed implementation that uses df. Contributed by Elliott Clark. 
(cherry picked from commit 57aec2b46b)
(cherry picked from commit a6863e5334)
 2016-09-30 13:29:59 -07:00
Kihwal Lee f5b193b482 HDFS-10850. getEZForPath should NOT throw FNF. Contributed by Andrew Wang. 
(cherry picked from commit 0670149c88)
 2016-09-30 09:16:13 -05:00
Akira Ajisaka 7016dfe590 HADOOP-13640. Fix findbugs warning in VersionInfoMojo.java. Contributed by Yuanbo Liu. 
(cherry picked from commit 82c55dcbc8)
(cherry picked from commit 25df276c6b)

Conflicts:
    hadoop-maven-plugins/src/main/java/org/apache/hadoop/maven/plugin/versioninfo/VersionInfoMojo.java
 2016-09-30 18:20:17 +09:00
Chris Nauroth 1085b3ee45 Revert "HADOOP-13081. add the ability to create multiple UGIs/subjects from one kerberos login. Contributed by Sergey Shelukhin." 
This reverts commit 06df0cd87f.
 2016-09-29 13:58:35 -07:00
Kihwal Lee d60b4648dc HADOOP-13537. Support external calls in the RPC call queue. Contributed by Daryn Sharp. 
(cherry picked from commit 236ac773c9)
(cherry picked from commit 92336ea37e)
 2016-09-29 13:58:17 -05:00
Jason Lowe db93a64eca MAPREDUCE-6771. RMContainerAllocator sends container diagnostics event after corresponding completion event. Contributed by Haibo Chen 
(cherry picked from commit c52ad9ee86)
 2016-09-29 15:51:36 +00:00
Steve Loughran 1c8e388181 HADOOP-13663 Index out of range in SysInfoWindows. Contributed by Inigo Goiri 2016-09-29 11:35:54 +01:00
Chris Nauroth b7b06a5f34 HADOOP-13599. s3a close() to be non-synchronized, so avoid risk of deadlock on shutdown. Contributed by Steve Loughran. 
(cherry picked from commit 47f80922dc)
(cherry picked from commit 1f1e47e411)
 2016-09-28 16:21:10 -07:00
Mingliang Liu 7467628d43 HDFS-10892. Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat'. Contributed by Mingliang Liu 
(cherry picked from commit 84c6264079)
 2016-09-28 16:09:42 -07:00
Kihwal Lee 5294eec729 HDFS-10779. Rename does not need to re-solve destination. Contributed by Daryn Sharp. 
(cherry picked from commit 5f34402ada)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
 2016-09-28 18:03:58 -05:00
Andrew Wang c4f81f199f HDFS-10914. Move remnants of oah.hdfs.client to hadoop-hdfs-client. 
(cherry picked from commit 92e5e91598)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/client/HdfsAdmin.java

(cherry picked from commit 9ddaa29301ea8ae2e3cb0f1e031343d5b91f92ee)
 2016-09-28 16:03:02 -07:00
Arpit Agarwal 76f92277c3 HDFS-10824. MiniDFSCluster#storageCapacities has no effects on real capacity. Contributed by Xiaobing Zhou. 2016-09-28 15:56:39 -07:00
Kihwal Lee 7091753bd2 HADOOP-11780. Prevent IPC reader thread death. Contributed by Daryn Sharp. 
(cherry picked from commit e19b37ead2)
 2016-09-28 10:03:24 -05:00
Brahma Reddy Battula 5f754e8638 HDFS-9444. Add utility to find set of available ephemeral ports to ServerSocketUtil. Contributed by Masatake Iwasaki 
(cherry picked from commit e9a34ae29c)
 2016-09-28 11:16:40 +05:30
Mingliang Liu 6da9a3c603 HDFS-10915. Fix time measurement bug in TestDatanodeRestart. Contributed by Xiaobing Zhou 
(cherry picked from commit 6437ba18c5)
 2016-09-27 20:47:04 -07:00
Mingliang Liu ecb5f282ea HADOOP-13658. Replace config key literal strings with names I: hadoop common. Contributed by Chen Liang 
(cherry picked from commit 9a44a832a9)
 2016-09-27 17:42:01 -07:00
Wangda Tan 69f91d8c48 HADOOP-13544. JDiff reports unncessarily show unannotated APIs and cause confusion while our javadocs only show annotated and public APIs. (vinodkv via wangda) 
(cherry picked from commit 875062b5bc)
(cherry picked from commit 269401dc83)
 2016-09-27 11:46:49 -07:00
Rohith Sharma K S 4f6facb90d YARN-5631. Missing refreshClusterMaxPriority usage in rmadmin help message. Contributed by Kai Sasaki. 2016-09-27 23:07:43 +05:30
Arpit Agarwal 3f5482bb69 HDFS-10828. Fix usage of FsDatasetImpl object lock in ReplicaMap. (Arpit Agarwal) 2016-09-27 10:02:27 -07:00
Masatake Iwasaki 756dbc505e HDFS-10426. TestPendingInvalidateBlock failed in trunk. Contributed by Yiqun Lin. 
(cherry picked from commit f55eb981dd)
 2016-09-28 01:47:31 +09:00
Arpit Agarwal a349c54603 HDFS-10713. Throttle FsNameSystem lock warnings. Contributed by Hanisha Koneru. 2016-09-27 09:05:53 -07:00
Brahma Reddy Battula 5bc297c58f HDFS-10889. Remove outdated Fault Injection Framework documentaion. Contributed by Brahma Reddy Battula 
(cherry picked from commit df1d0f5d56)
 2016-09-27 19:35:57 +05:30
Naganarasimha 63ca9f5441 YARN-5660. Wrong audit constants are used in Get/Put of priority in RMWebService. Contributed by Rohith Sharma K S 
(cherry picked from commit ebf528c443)
 2016-09-27 16:46:52 +05:30
Brahma Reddy Battula 686cbf45d4 HDFS-9885. Correct the distcp counters name while displaying counters. Contributed by Surendra Singh Lilhore 
(cherry picked from commit e17a4970be)
 2016-09-27 10:49:04 +05:30
Wei-Chiu Chuang f0f3b6a66a HDFS-10609. Uncaught InvalidEncryptionKeyException during pipeline recovery may abort downstream applications. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 3ae652f821)
(cherry picked from commit bde787db23)
 2016-09-26 14:46:02 -07:00
Xiao Chen 09964a1629 HADOOP-13638. KMS should set UGI's Configuration object properly. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit fa397e74fe)

Conflicts:
	hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMS.java

(cherry picked from commit 06187e4f98)

Conflicts:
	hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMS.java
 2016-09-26 13:04:29 -07:00
Brahma Reddy Battula fa042ff9af HADOOP-12597. In kms-site.xml configuration hadoop.security.keystore.JavaKeyStoreProvider.password should be updated with new name. ( Contributed by Surendra Singh Lilhore via Brahma Reddy Battula) 2016-09-26 23:19:36 +05:30