Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,453 Commits 326 Branches 371 Tags
Commit Graph

9453 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Akira Ajisaka
c594904eca HDFS-11174. Wrong HttpFS test command in doc. Contributed by John Zhuge. 
(cherry picked from commit bb1b5e083b6f32646412b292d061ce5721f5dbe1)
(cherry picked from commit 6fe5ffd05d41727552834e54695d69a26eddd8d8)
 2016-11-25 21:31:11 +09:00
Mingliang Liu
48a2dacc68 HADOOP-13655. document object store use with fs shell and distcp. Contributed by Steve Loughran 
(cherry picked from commit ed9dcdae57cf3f97e563b149ecfc9ee65368094b)
 2016-11-22 13:30:26 -08:00
Kihwal Lee
01ad9dee08 HDFS-10966. Enhance Dispatcher logic on deciding when to give up a source DataNode. Contributed by Mark Wagner and Zhe Zhang. 2016-11-21 16:58:12 -06:00
Xiaoyu Yao
0da0bf0de2 HDFS-10941. Improve BlockManager#processMisReplicatesAsync log. Contributed by Chen Liang. 
(cherry picked from commit 4484b48498b2ab2a40a404c487c7a4e875df10dc)
(cherry picked from commit c443ecb267b25577f7abc058b0b5e13592d4c040)
 2016-11-18 09:52:02 -08:00
Konstantin V Shvachko
f6e517c6cc Updated CHANGES.txt for HDFS-11087. 2016-11-15 11:10:44 -08:00
Varun Saxena
8517f34793 Updated CHANGES.txt for YARN-4328. 2016-11-15 18:57:39 +05:30
Naganarasimha
501e1e1f92 YARN-4355. NPE while processing localizer heartbeat. Contributed by Varun Saxena & Jonathan Hung (addendum for changes.txt) 2016-11-15 18:25:52 +05:30
Naganarasimha
7d87e11be4 YARN-4355. NPE while processing localizer heartbeat. Contributed by Varun Saxena & Jonathan Hung 2016-11-15 17:36:14 +05:30
Zhe Zhang
ec0f854ba0 Add CHANGES.txt entry for HDFS-10872. 2016-11-14 23:14:35 -08:00
Zhe Zhang
cc1979b2a0 HDFS-10872. Add MutableRate metrics for FSNamesystemLock operations. Contributed by Erik Krogen. 2016-11-14 23:09:12 -08:00
Wei-Chiu Chuang
81bf6f2834 HDFS-11056. Concurrent append and read operations lead to checksum error. Contributed by Wei-Chiu Chuang. 2016-11-14 11:57:51 -08:00
Erik Krogen
c997fc629d HDFS-11087. NamenodeFsck should check if the output writer is still writable. Contributed by Erik Krogen. 
(cherry picked from commit 98d9e9c4c823d865ddfc017e71c82d12c8328e53)
 2016-11-13 15:04:34 -08:00
Anu Engineer
95edf265b3 HDFS-8307. Spurious DNS Queries from hdfs shell. Contributed by Andres Perez 2016-11-10 14:38:53 -08:00
Zhe Zhang
d762730367 HADOOP-13782. Make MutableRates metrics thread-local write, aggregate-on-read. Contributed by Erik Krogen. 
(cherry picked from commit 77c13c385774c51766fe505397fa916754ac08d4)
(cherry picked from commit 758638d08d3337159dd3e9fa651093d0430b399a)
(cherry picked from commit d93dc01e3dc0b9d5ce8c8105120cf01d0c66b473)
 2016-11-08 16:15:44 -08:00
Zhe Zhang
64657cd675 HADOOP-13804. MutableStat mean loses accuracy if add(long, long) is used. Contributed by Erik Krogen. 
(cherry picked from commit 3dbad5d823b8bf61b643dd1057165044138b99e0)
(cherry picked from commit b245e9ce2f20bb84690bffe902a60d5e96130cdb)
(cherry picked from commit 384b7b71a3d22bcc27bbdb9002ad700015b86eab)
 2016-11-07 16:22:16 -08:00
Jason Lowe
c1a6f4f2ee YARN-5837. NPE when getting node status of a decommissioned node after an RM restart. Contributed by Robert Kanter 2016-11-04 22:41:11 +00:00
yliu
49f983633a HADOOP-12483. Maintain wrapped SASL ordering for postponed IPC responses. (Daryn Sharp via yliu) 
(cherry picked from commit 2c0dbf728a9ade29eb5c86e798bd6d75de956e5a)
 2016-11-01 22:56:25 -07:00
Zhe Zhang
e6ee3e2597 HADOOP-10300. Allowed deferred sending of call responses. Contributed by Daryn Sharp. 2016-11-01 22:24:40 -07:00
Jason Lowe
5194a9bb6f YARN-5001. Aggregated Logs root directory is created with wrong group if nonexistent. Contributed by Haibo Chen 
(cherry picked from commit 76893a41003d57d94eb1a5f486010815266046af)
 2016-11-01 20:26:07 +00:00
Zhe Zhang
49f059125a Addendum of HDFS-8709: update CHANGES.TXT. 2016-10-31 15:17:21 -07:00
Andrew Wang
85708329c8 HDFS-8709. Clarify automatic sync in FSEditLog#logEdit. 
(cherry picked from commit 5fddc5177ddad07a735d49c15a63cfc5f74d0891)
(cherry picked from commit efe9ae9fc68e4eec4b7388b971c520328e95fe76)
(cherry picked from commit 3b8cc7c21615d07e62251fd1b9c80f696f590a8f)
 2016-10-31 15:08:52 -07:00
Zhe Zhang
c10428bb7e HADOOP-12325. RPC Metrics : Add the ability track and log slow RPCs. Contributed by Anu Engineer. 2016-10-31 11:43:46 -07:00
Arpit Agarwal
c60cbb3396 HADOOP-10597. RPC Server signals backoff to clients when all request queues are full. (Contributed by Ming Ma) 
(cherry picked from commit edbeefdb052bffd0a3ba2f00c8a5a376017fbf33)
 2016-10-31 11:25:08 -07:00
Carlo Curino
2de984ac3d YARN-3432. Cluster metrics have wrong Total Memory when there is reserved memory on CS. (Brahma Reddy Battula via curino) 
(cherry picked from commit 892a8348fceb42069ea9877251c413fe33415e16)
 2016-10-30 23:28:13 +05:30
Jason Lowe
5aa26aa66e MAPREDUCE-6724. Single shuffle to memory must not exceed Integer#MAX_VALUE. (Haibo Chen via gera) 
(cherry picked from commit 0a405c4f71b0697c8ecab6ce7de82a403baafad7)
 2016-10-28 14:43:40 +00:00
Erik Krogen
d002e4d10b HDFS-9500. Fix software version counts for DataNodes during rolling upgrade. Contributed by Erik Krogen. 
(cherry picked from commit f3ac1f41b8fa82a0ac87a207d7afa2061d90a9bd)
 2016-10-27 16:10:26 -07:00
Varun Saxena
edaa37177b YARN-4328. Fix findbugs warnings in resourcemanager (Akira Ajisaka via Varun Saxena) 2016-10-28 03:08:59 +05:30
Kihwal Lee
a49510f697 HDFS-11069. Tighten the authorization of datanode RPC. Contributed by Kihwal Lee 
Updated CHANGES.txt
(cherry picked from commit ae48c496dce8d0eae4571fc64e6850d602bae688)
 2016-10-27 14:23:20 -05:00
Brahma Reddy Battula
616d634525 HADOOP-13201. Print the directory paths when ViewFs denies the rename operation on internal dirs. Contributed by Tianyin Xiu 
(cherry picked from commit 0c837db8a874079dd5db83a7eef9c4d2b9d0e9ff)
 2016-10-27 19:57:00 +05:30
Mingliang Liu
cd07a8858c HDFS-10921. TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode. Contributed by Eric Badger 
(cherry picked from commit 55e1fb8e3221941321e6f5e04b334246c5f23027)
 2016-10-26 14:18:16 -07:00
Kihwal Lee
fdd645be6b HDFS-11053. Unnecessary superuser check in versionRequest(). Contributed by Kihwal Lee. 
Updated CHANGES.txt
(cherry picked from commit e90af4a89ba2741aeca20ead47699587b14f0de8)
 2016-10-26 09:19:45 -05:00
Zhe Zhang
c05d701161 HDFS-11015. Enforce timeout in balancer. Contributed by Kihwal Lee. 
(cherry picked from commit f6367c5f44a88cb5eb7edffb015b10b657504a61)
(cherry picked from commit ff806cbfc7f5d1bdccd51a1802b6d69f4777219e)
(cherry picked from commit 262518fa5b2f0e06c9d9158ec8b37a2ac3cc6981)
 2016-10-25 11:50:51 -07:00
Brahma Reddy Battula
d05e737b84 HADOOP-13236. truncate will fail when we use viewfilesystem. Contributed by Brahma Reddy Battula 
(cherry picked from commit f872c6bc0390415f13e95b99749b0b1a690991b7)
 2016-10-21 06:21:46 +05:30
Steve Loughran
897cf09b40 Revert "HADOOP-13236. truncate will fail when we use viewfilesystem. Contributed by Brahma Reddy Battula" 
This reverts commit f6d8746f2e809a1889a0bcccc8c6f1ecdad13481.
 2016-10-20 19:48:56 +01:00
Brahma Reddy Battula
f6d8746f2e HADOOP-13236. truncate will fail when we use viewfilesystem. Contributed by Brahma Reddy Battula 
(cherry picked from commit f872c6bc0390415f13e95b99749b0b1a690991b7)
 2016-10-20 21:54:09 +05:30
Kihwal Lee
6ae7b9f800 HDFS-10627. Volume Scanner marks a block as "suspect" even if the exception is network-related. Contributed by Rushabh S Shah. 
Updated CHANGES.txt
(cherry picked from commit 5c0bffddc0cb824a8a2751bcd0dc3e15ce081727)
 2016-10-20 11:09:20 -05:00
Brahma Reddy Battula
1e5c40b5b4 HDFS-9444. Add utility to find set of available ephemeral ports to ServerSocketUtil. Contributed by Masatake Iwasaki 
(cherry picked from commit e9a34ae29c7390f3ffcbeee02dc5faa26fca482a)
(cherry picked from commit 5f754e8638d5a35ab12765edec6561228312f71c)
 2016-10-18 10:50:19 -07:00
Konstantin V Shvachko
4aea760676 Update CHANGES.txt for HDFS-10712 and HDFS-10301. (shv) 2016-10-18 10:37:01 -07:00
Masatake Iwasaki
fd3df4bb04 HDFS-9333. Some tests using MiniDFSCluster errored complaining port in use. (iwasakims) 
(cherry picked from commit 964e546ab1dba5f5d53b209ec6c9a70a85654765)

 Conflicts:
  hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestBlockTokenWithDFSStriped.java

(cherry picked from commit 1b91ebb7145860ecda394d764da5fc7063406fee)
(cherry picked from commit 1524e6320659df7d066ac96fd2c190d7a7c5b932)
 2016-10-18 10:32:16 -07:00
Robert Kanter
bd16763591 HADOOP-12259. Utility to Dynamic port allocation (brahmareddy via rkanter) 
(cherry picked from commit ee233ec95ce8cfc8309d3adc072d926cd85eba08)
(cherry picked from commit 731ed9cad81f91e9da18148f0c4757a38ca406f6)
 2016-10-18 10:25:52 -07:00
Xiao Chen
d053d1c3ff HDFS-10879. TestEncryptionZonesWithKMS#testReadWrite fails intermittently. Contributed by Xiao Chen. 
(cherry picked from commit d31bef575478fe78c0600fb602e117e4b81c9887)
(cherry picked from commit 11ed4f5d40effcdb26461a393379c6bddaa29bed)
 2016-10-18 10:16:30 -07:00
Wei-Chiu Chuang
f27cf17f7e HADOOP-13535. Add jetty6 acceptor startup issue workaround to branch-2. Contributed by Min Shen. 
(cherry picked from commit 23984e17870bcff6fffd8e1ca185fd37e2352b29)
(cherry picked from commit 6ca5ffe4b52c13e71027c465c9a757724f6b091d)
 2016-10-18 10:03:46 -07:00
Yongjun Zhang
b2dfab4326 HDFS-10512. VolumeScanner may terminate due to NPE in DataNode.reportBadBlocks. Contributed by Wei-Chiu Chuang and Yiqun Lin. 
(cherry picked from commit da6f1b88dd47e22b24d44f6fc8bbee73e85746f7)
(cherry picked from commit 96e68e722f0fe99d1609b38377014c04ef5b6640)
 2016-10-18 09:09:06 -07:00
Vinitha Reddy Gankidi
86f291f057 HDFS-10712. TestDataNodeVolumeFailure should pass not null BlockReportContext. Contributed by Vinitha Gankidi. 2016-10-17 19:08:52 -07:00
Vinitha Reddy Gankidi
1fcaba9b14 HDFS-10301. Remove FBR tracking state to fix false zombie storage detection for interleaving block reports. Contributed by Vinitha Gankidi. 
(cherry picked from commit 391ce535a739dc92cb90017d759217265a4fd969)
 2016-10-17 18:37:44 -07:00
Akira Ajisaka
8eb0b6f39c HDFS-11002. Fix broken attr/getfattr/setfattr links in ExtendedAttributes.md. Contributed by Mingliang Liu. 
(cherry picked from commit 901eca004d0e7e413b109a93128892176c808d61)
(cherry picked from commit 43cf0b29732ebafb8b5b23b06d6015fe4c7777b4)
 2016-10-13 14:32:47 +09:00
Naganarasimha
ac395be019 YARN-3877. YarnClientImpl.submitApplication swallows exceptions. Contributed by Varun Saxena 
(cherry picked from commit e4e72db5f9f305b493138ab36f073fe5d1750ad8)
(cherry picked from commit 4c2b20ca3e98d5f63e29d734595d693ad3a20529)
 2016-10-11 16:29:43 -07:00
Andrew Wang
165febbc84 HDFS-10991. Export hdfsTruncateFile symbol in libhdfs. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit dacd3ec66b111be24131957c986f0c748cf9ea26)
(cherry picked from commit 67f0319db667ed724a3c19cc2ab745ef661fc5f8)
 2016-10-11 15:08:53 -07:00
Tsz-Wo Nicholas Sze
b23b60e7b4 HDFS-8824. Do not use small blocks for balancing the cluster. 
(cherry-picked from commit 61b9e5f7ff15daa0efd09e98efd70351f474c8cb)
 2016-10-07 11:01:29 -07:00
Zhe Zhang
47fcae7da8 HDFS-10745. Directly resolve paths into INodesInPath. Contributed by Daryn Sharp.. 2016-10-06 09:39:59 -07:00