Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,124 Commits 326 Branches 371 Tags
Commit Graph

12124 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Varun Vasudev
3ce02387ea YARN-5704. Provide config knobs to control enabling/disabling new/work in progress features in container-executor. Contributed by Sidharta Seethana. 
(cherry picked from commit 0992708d790b5bd3dab85987b7ad7c6fc2cc4b18)
 2016-10-05 15:32:50 +05:30
Kihwal Lee
b565fa8e05 HDFS-10956. Remove rename/delete performance penalty when not using snapshots. Contributed by Daryn Sharp. 
(cherry picked from commit 44f48ee96ee6b2a3909911c37bfddb0c963d5ffc)
 2016-10-04 15:26:42 -05:00
Chris Nauroth
213f0ad7f0 HADOOP-13674. S3A can provide a more detailed error message when accessing a bucket through an incorrect S3 endpoint. Contributed by Chris Nauroth. 
(cherry picked from commit 88b9444a81081da9b168d2e290f9552b58a4d8c6)
 2016-10-04 10:37:04 -07:00
Kihwal Lee
a9a2f64e56 HDFS-10878. TestDFSClientRetries#testIdempotentAllocateBlockAndClose throws ConcurrentModificationException. Contributed by Rushabh S Shah. 
(cherry picked from commit 382307cbdd94107350fe6fad1acf87d63c9be9d6)
 2016-10-04 11:10:29 -05:00
Brahma Reddy Battula
560e524f93 HDFS-10947. Correct the API name for truncate in webhdfs document. Contributed by Surendra Singh Lilhore 
(cherry picked from commit ef7f06f7d1561db13bd3b07a5f62815ec29e1cdf)
 2016-10-04 18:51:40 +05:30
Brahma Reddy Battula
c9df3c5f21 HDFS-10944. Correct the javadoc of dfsadmin#disallowSnapshot. Contributed by Jagadesh Kiran N 
(cherry picked from commit 5ea0210c7fea1324973e7f69256bc53f31ee4cf7)
 2016-10-04 18:37:43 +05:30
Mingliang Liu
612aa0cc0b HDFS-10934. TestDFSShell#testStat fails intermittently. Contributed by Eric Badger 
(cherry picked from commit f61e3d13e9610cbd09886359553f27d6480f6735)
 2016-10-03 22:47:09 -04:00
Mingliang Liu
d963ecb918 HDFS-10810. setreplication removing block from underconstrcution temporarily. Contributed by Brahma Reddy Battula 2016-10-03 21:59:31 -04:00
Xiao Chen
d9b686a2bd HDFS-10918. Add a tool to get FileEncryptionInfo from CLI. Contributed by Xiao Chen. 
(cherry picked from commit 853d65a157362661ccab10379c2d82e780382f83)
 2016-10-03 16:02:07 -07:00
Karthik Kambatla
1578781fe9 YARN-4767. Network issues can cause persistent RM UI outage. (Daniel Templeton via kasha) 
(cherry picked from commit 736d33cddd88a0cec925a451940b2523999a9c51)
 2016-10-03 14:36:14 -07:00
Xiaoyu Yao
6f3744195d HDFS-10690. Optimize insertion/removal of replica in ShortCircuitCache. Contributed by Fenghua Hu. 
(cherry picked from commit 607705c488fa5263d851cee578a2d319e6e52ecd)
 2016-10-03 11:00:15 -07:00
Karthik Kambatla
876fc2e61a MAPREDUCE-6638. Do not attempt to recover progress from previous job attempts if spill encryption is enabled. (Haibo Chen via kasha) 
(cherry picked from commit de7a0a92ca1983b35ca4beb7ab712fd700a9e6e0)
 2016-10-03 10:30:44 -07:00
Kihwal Lee
03b797a6ac HDFS-10940. Reduce performance penalty of block caching when not used. Contributed by Daryn Sharp. 
(cherry picked from commit 744208431f7365bf054e6b773b86af2583001e1d)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirStatAndListingOp.java
 2016-10-03 11:41:19 -05:00
Kihwal Lee
ebfbce3b5f HDFS-10945. Fix the Findbugwaring FSNamesystem#renameTo() in branch-2. Contributed by Brahma Reddy Battula. 2016-10-03 10:48:14 -05:00
Kihwal Lee
2ee47f02cf HDFS-10619. Cache path in InodesInPath. Contributed by Daryn Sharp. 
(cherry picked from commit 90020624b05230ad4a7fbd666d0177ecb107a4d6)
 2016-10-03 09:20:08 -05:00
Karthik Kambatla
f8c2c7b2c0 YARN-5672. FairScheduler: Wrong queue name in log when adding application. (Wilfred Spiegelenburg via kasha) 
(cherry picked from commit 0da54e8848764c71a31473516d23ada582013f8c)
 2016-10-03 06:04:09 -07:00
Naganarasimha
04f594dbea YARN-4855. Should check if node exists when replace nodelabels. Contributeed by Tao Jie 
(cherry picked from commit 6e130c308cf1b97e8386b6a43c26d72d2850119c)
 2016-10-03 02:13:46 -04:00
Karthik Kambatla
57726eed83 YARN-5678. Log demand as demand in FSLeafQueue and FSParentQueue. (Yufei Gu via kasha) 
(cherry picked from commit 82857037b6e960dccdaf9e6b1b238411498a0dfe)
 2016-10-02 22:10:07 -07:00
Arpit Agarwal
6dd747b6bc Revert "HDFS-10923. Make InstrumentedLock require ReentrantLock." 
This reverts commit 9873ed32c63a62b39760126a123ed759c3222eb9.
 2016-09-30 23:12:07 -07:00
Arpit Agarwal
9873ed32c6 HDFS-10923. Make InstrumentedLock require ReentrantLock. 2016-09-30 23:04:22 -07:00
Subru Krishnan
9f43f89899 YARN-5384. Expose priority in ReservationSystem submission APIs. (Sean Po via Subru). 
(cherry picked from commit 3a3697deab3e3397082222deb66fb613d86ff9ae)
 2016-09-30 19:43:29 -07:00
Xiao Chen
1ed23a134c HADOOP-13317. Add logs to KMS server-side to improve supportability. Contributed by Suraj Acharya. 
(cherry picked from commit 89bd6d29a62afd7ed8ff87bcc29d17b1cb53dcb6)
 2016-09-30 17:52:13 -07:00
Kihwal Lee
2551ff80b7 HDFS-10851. FSDirStatAndListingOp: stop passing path as string. Contributed by Daryn Sharp. 2016-09-30 15:59:40 -05:00
Robert Kanter
56ec975ea9 YARN-5693. Reduce loglevel to Debug in ContainerManagementProtocolProxy and AMRMClientImpl (yufeigu via rkanter) 
(cherry picked from commit 2549ee9d4c4ddd3ebccdebb8623df30c0a8f27d2)
 2016-09-30 13:35:58 -07:00
Zhe Zhang
dfca0f4abb HDFS-10896. Move lock logging logic from FSNamesystem into FSNamesystemLock. Contributed by Erik Krogen. 
(cherry-picked from commit 434c5ea75dc3d87513e49290ac9999148ff5163c)
 2016-09-30 13:30:31 -07:00
Wei-Chiu Chuang
a6863e5334 HADOOP-12974. Create a CachingGetSpaceUsed implementation that uses df. Contributed by Elliott Clark. 
(cherry picked from commit 57aec2b46b0e46b73a1f49927e30e2c41138d535)
 2016-09-30 13:00:04 -07:00
Kihwal Lee
10222cd54e HDFS-10850. getEZForPath should NOT throw FNF. Contributed by Andrew Wang. 
(cherry picked from commit 0670149c88852cd7c4d6774bff06c7c588558739)
 2016-09-30 08:58:38 -05:00
Akira Ajisaka
25df276c6b HADOOP-13640. Fix findbugs warning in VersionInfoMojo.java. Contributed by Yuanbo Liu. 
(cherry picked from commit 82c55dcbc8e3d5314aae9f8f600c660759213e45)
 2016-09-30 18:18:26 +09:00
Li Lu
919c0802fa YARN-4205. Addendum patch to fix branch-2. 2016-09-29 15:41:31 -07:00
Chris Nauroth
cf954d7a48 Revert "HADOOP-13081. add the ability to create multiple UGIs/subjects from one kerberos login. Contributed by Sergey Shelukhin." 
This reverts commit ec522a19076314f309ef475a8fdf08ec840dafae.
 2016-09-29 13:58:55 -07:00
Kihwal Lee
92336ea37e HADOOP-13537. Support external calls in the RPC call queue. Contributed by Daryn Sharp. 
(cherry picked from commit 236ac773c964fa21d6d5f1496023cd61818dd3b1)
 2016-09-29 13:54:30 -05:00
Steve Loughran
896df3f55a HADOOP-13164 Optimize S3AFileSystem::deleteUnnecessaryFakeDirectories. Contributed by Rajesh Balamohan. 2016-09-29 17:00:34 +01:00
Jason Lowe
c52ad9ee86 MAPREDUCE-6771. RMContainerAllocator sends container diagnostics event after corresponding completion event. Contributed by Haibo Chen 2016-09-29 15:50:50 +00:00
Jian He
39f896e1a1 YARN-4205. Add a service for monitoring application life time out. Contributed by Rohith Sharma K S 
(cherry picked from commit 2ae5a3a5bf5ea355370469a53eeccff0b5220081)
 2016-09-29 22:06:36 +08:00
Steve Loughran
2b6b4fd779 HADOOP-13663 Index out of range in SysInfoWindows. Contributed by Inigo Goiri 2016-09-29 11:35:37 +01:00
Chris Nauroth
1f1e47e411 HADOOP-13599. s3a close() to be non-synchronized, so avoid risk of deadlock on shutdown. Contributed by Steve Loughran. 
(cherry picked from commit 47f80922dc7cb2fa6d084e6fb1f354c4ec1d4c69)
 2016-09-28 16:21:00 -07:00
Mingliang Liu
a7c1636296 HDFS-10892. Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat'. Contributed by Mingliang Liu 
(cherry picked from commit 84c626407925e03ee2ef11faba9324d5c55b8e93)
 2016-09-28 16:09:09 -07:00
Robert Kanter
85724268c2 MAPREDUCE-6718. add progress log to JHS during startup (haibochen via rkanter) 
(cherry picked from commit 0d6778d800ff16366911e3b064f3af6162dee2e4)
 2016-09-28 16:04:48 -07:00
Andrew Wang
b12f004474 HDFS-10914. Move remnants of oah.hdfs.client to hadoop-hdfs-client. 
(cherry picked from commit 92e5e9159850c01635091ea6ded0d8ee76691a9a)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/client/HdfsAdmin.java
 2016-09-28 16:03:16 -07:00
Robert Kanter
4f8c7f819c YARN-5400. addendum patch to fix JDK 7 issue 2016-09-28 16:01:18 -07:00
Kihwal Lee
087c61192d HDFS-10779. Rename does not need to re-solve destination. Contributed by Daryn Sharp. 
(cherry picked from commit 5f34402adae191232fe78e62990396ca07f314bb)
 2016-09-28 17:58:53 -05:00
Arpit Agarwal
50888471d9 HDFS-10824. MiniDFSCluster#storageCapacities has no effects on real capacity. Contributed by Xiaobing Zhou. 2016-09-28 15:56:08 -07:00
Robert Kanter
bc91e33d5e YARN-5400. Light cleanup in ZKRMStateStore (templedf via rkanter) 
(cherry picked from commit bcb2528a51c33e4caff8d744c5e14c1accfc47d0)
 2016-09-28 14:57:14 -07:00
Kihwal Lee
baf8aac05c HADOOP-11780. Prevent IPC reader thread death. Contributed by Daryn Sharp. 
(cherry picked from commit e19b37ead23805c7ed45bdcbfa7fdc8898cde7b2)
 2016-09-28 09:46:42 -05:00
Varun Vasudev
3f1d3e3177 YARN-5662. Provide an option to enable ContainerMonitor. Contributed by Jian He. 
(cherry picked from commit bc2656f09f857fdbc39da6b060cee453d2dec4dc)
 2016-09-28 15:27:09 +05:30
Brahma Reddy Battula
e9a34ae29c HDFS-9444. Add utility to find set of available ephemeral ports to ServerSocketUtil. Contributed by Masatake Iwasaki 2016-09-28 10:50:50 +05:30
Mingliang Liu
54ca505c41 HDFS-10915. Fix time measurement bug in TestDatanodeRestart. Contributed by Xiaobing Zhou 
(cherry picked from commit 6437ba18c5c26bc271a63aff5ea03756f43dd9a3)
 2016-09-27 20:42:47 -07:00
Mingliang Liu
34ee18d73d HADOOP-13658. Replace config key literal strings with names I: hadoop common. Contributed by Chen Liang 
(cherry picked from commit 9a44a832a99eb967aa4e34338dfa75baf35f9845)
 2016-09-27 17:39:36 -07:00
Wangda Tan
379c2b3e5b YARN-3142. Improve locks in AppSchedulingInfo. (Varun Saxena via wangda) 
(cherry picked from commit 1831be8e737fd423a9f3d590767b944147e85641)
 2016-09-27 12:05:00 -07:00
Wangda Tan
269401dc83 HADOOP-13544. JDiff reports unncessarily show unannotated APIs and cause confusion while our javadocs only show annotated and public APIs. (vinodkv via wangda) 
(cherry picked from commit 875062b5bc789158290bf93dadc71b5328ca4fee)
 2016-09-27 11:27:25 -07:00