Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,541 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

9541 Commits

Author SHA1 Message Date
Anu Engineer 95edf265b3 HDFS-8307. Spurious DNS Queries from hdfs shell. Contributed by Andres Perez 2016-11-10 14:38:53 -08:00
Zhe Zhang d762730367 HADOOP-13782. Make MutableRates metrics thread-local write, aggregate-on-read. Contributed by Erik Krogen. 
(cherry picked from commit 77c13c3857)
(cherry picked from commit 758638d08d)
(cherry picked from commit d93dc01e3d)
 2016-11-08 16:15:44 -08:00
Zhe Zhang 64657cd675 HADOOP-13804. MutableStat mean loses accuracy if add(long, long) is used. Contributed by Erik Krogen. 
(cherry picked from commit 3dbad5d823)
(cherry picked from commit b245e9ce2f)
(cherry picked from commit 384b7b71a3)
 2016-11-07 16:22:16 -08:00
Jason Lowe c1a6f4f2ee YARN-5837. NPE when getting node status of a decommissioned node after an RM restart. Contributed by Robert Kanter 2016-11-04 22:41:11 +00:00
yliu 49f983633a HADOOP-12483. Maintain wrapped SASL ordering for postponed IPC responses. (Daryn Sharp via yliu) 
(cherry picked from commit 2c0dbf728a)
 2016-11-01 22:56:25 -07:00
Zhe Zhang e6ee3e2597 HADOOP-10300. Allowed deferred sending of call responses. Contributed by Daryn Sharp. 2016-11-01 22:24:40 -07:00
Jason Lowe 5194a9bb6f YARN-5001. Aggregated Logs root directory is created with wrong group if nonexistent. Contributed by Haibo Chen 
(cherry picked from commit 76893a4100)
 2016-11-01 20:26:07 +00:00
Zhe Zhang 49f059125a Addendum of HDFS-8709: update CHANGES.TXT. 2016-10-31 15:17:21 -07:00
Andrew Wang 85708329c8 HDFS-8709. Clarify automatic sync in FSEditLog#logEdit. 
(cherry picked from commit 5fddc5177d)
(cherry picked from commit efe9ae9fc6)
(cherry picked from commit 3b8cc7c21615d07e62251fd1b9c80f696f590a8f)
 2016-10-31 15:08:52 -07:00
Zhe Zhang c10428bb7e HADOOP-12325. RPC Metrics : Add the ability track and log slow RPCs. Contributed by Anu Engineer. 2016-10-31 11:43:46 -07:00
Arpit Agarwal c60cbb3396 HADOOP-10597. RPC Server signals backoff to clients when all request queues are full. (Contributed by Ming Ma) 
(cherry picked from commit edbeefdb05)
 2016-10-31 11:25:08 -07:00
Carlo Curino 2de984ac3d YARN-3432. Cluster metrics have wrong Total Memory when there is reserved memory on CS. (Brahma Reddy Battula via curino) 
(cherry picked from commit 892a8348fc)
 2016-10-30 23:28:13 +05:30
Jason Lowe 5aa26aa66e MAPREDUCE-6724. Single shuffle to memory must not exceed Integer#MAX_VALUE. (Haibo Chen via gera) 
(cherry picked from commit 0a405c4f71)
 2016-10-28 14:43:40 +00:00
Erik Krogen d002e4d10b HDFS-9500. Fix software version counts for DataNodes during rolling upgrade. Contributed by Erik Krogen. 
(cherry picked from commit f3ac1f41b8)
 2016-10-27 16:10:26 -07:00
Varun Saxena edaa37177b YARN-4328. Fix findbugs warnings in resourcemanager (Akira Ajisaka via Varun Saxena) 2016-10-28 03:08:59 +05:30
Kihwal Lee a49510f697 HDFS-11069. Tighten the authorization of datanode RPC. Contributed by Kihwal Lee 
Updated CHANGES.txt
(cherry picked from commit ae48c496dc)
 2016-10-27 14:23:20 -05:00
Brahma Reddy Battula 616d634525 HADOOP-13201. Print the directory paths when ViewFs denies the rename operation on internal dirs. Contributed by Tianyin Xiu 
(cherry picked from commit 0c837db8a8)
 2016-10-27 19:57:00 +05:30
Mingliang Liu cd07a8858c HDFS-10921. TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode. Contributed by Eric Badger 
(cherry picked from commit 55e1fb8e32)
 2016-10-26 14:18:16 -07:00
Kihwal Lee fdd645be6b HDFS-11053. Unnecessary superuser check in versionRequest(). Contributed by Kihwal Lee. 
Updated CHANGES.txt
(cherry picked from commit e90af4a89b)
 2016-10-26 09:19:45 -05:00
Zhe Zhang c05d701161 HDFS-11015. Enforce timeout in balancer. Contributed by Kihwal Lee. 
(cherry picked from commit f6367c5f44)
(cherry picked from commit ff806cbfc7)
(cherry picked from commit 262518fa5b)
 2016-10-25 11:50:51 -07:00
Brahma Reddy Battula d05e737b84 HADOOP-13236. truncate will fail when we use viewfilesystem. Contributed by Brahma Reddy Battula 
(cherry picked from commit f872c6bc03)
 2016-10-21 06:21:46 +05:30
Steve Loughran 897cf09b40 Revert "HADOOP-13236. truncate will fail when we use viewfilesystem. Contributed by Brahma Reddy Battula" 
This reverts commit f6d8746f2e.
 2016-10-20 19:48:56 +01:00
Brahma Reddy Battula f6d8746f2e HADOOP-13236. truncate will fail when we use viewfilesystem. Contributed by Brahma Reddy Battula 
(cherry picked from commit f872c6bc03)
 2016-10-20 21:54:09 +05:30
Kihwal Lee 6ae7b9f800 HDFS-10627. Volume Scanner marks a block as "suspect" even if the exception is network-related. Contributed by Rushabh S Shah. 
Updated CHANGES.txt
(cherry picked from commit 5c0bffddc0)
 2016-10-20 11:09:20 -05:00
Brahma Reddy Battula 1e5c40b5b4 HDFS-9444. Add utility to find set of available ephemeral ports to ServerSocketUtil. Contributed by Masatake Iwasaki 
(cherry picked from commit e9a34ae29c)
(cherry picked from commit 5f754e8638)
 2016-10-18 10:50:19 -07:00
Konstantin V Shvachko 4aea760676 Update CHANGES.txt for HDFS-10712 and HDFS-10301. (shv) 2016-10-18 10:37:01 -07:00
Masatake Iwasaki fd3df4bb04 HDFS-9333. Some tests using MiniDFSCluster errored complaining port in use. (iwasakims) 
(cherry picked from commit 964e546ab1)

 Conflicts:
  hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestBlockTokenWithDFSStriped.java

(cherry picked from commit 1b91ebb714)
(cherry picked from commit 1524e63206)
 2016-10-18 10:32:16 -07:00
Robert Kanter bd16763591 HADOOP-12259. Utility to Dynamic port allocation (brahmareddy via rkanter) 
(cherry picked from commit ee233ec95c)
(cherry picked from commit 731ed9cad8)
 2016-10-18 10:25:52 -07:00
Xiao Chen d053d1c3ff HDFS-10879. TestEncryptionZonesWithKMS#testReadWrite fails intermittently. Contributed by Xiao Chen. 
(cherry picked from commit d31bef575478fe78c0600fb602e117e4b81c9887)
(cherry picked from commit 11ed4f5d40)
 2016-10-18 10:16:30 -07:00
Wei-Chiu Chuang f27cf17f7e HADOOP-13535. Add jetty6 acceptor startup issue workaround to branch-2. Contributed by Min Shen. 
(cherry picked from commit 23984e1787)
(cherry picked from commit 6ca5ffe4b5)
 2016-10-18 10:03:46 -07:00
Yongjun Zhang b2dfab4326 HDFS-10512. VolumeScanner may terminate due to NPE in DataNode.reportBadBlocks. Contributed by Wei-Chiu Chuang and Yiqun Lin. 
(cherry picked from commit da6f1b88dd)
(cherry picked from commit 96e68e722f)
 2016-10-18 09:09:06 -07:00
Vinitha Reddy Gankidi 86f291f057 HDFS-10712. TestDataNodeVolumeFailure should pass not null BlockReportContext. Contributed by Vinitha Gankidi. 2016-10-17 19:08:52 -07:00
Vinitha Reddy Gankidi 1fcaba9b14 HDFS-10301. Remove FBR tracking state to fix false zombie storage detection for interleaving block reports. Contributed by Vinitha Gankidi. 
(cherry picked from commit 391ce535a7)
 2016-10-17 18:37:44 -07:00
Akira Ajisaka 8eb0b6f39c HDFS-11002. Fix broken attr/getfattr/setfattr links in ExtendedAttributes.md. Contributed by Mingliang Liu. 
(cherry picked from commit 901eca004d)
(cherry picked from commit 43cf0b2973)
 2016-10-13 14:32:47 +09:00
Naganarasimha ac395be019 YARN-3877. YarnClientImpl.submitApplication swallows exceptions. Contributed by Varun Saxena 
(cherry picked from commit e4e72db5f9)
(cherry picked from commit 4c2b20ca3e)
 2016-10-11 16:29:43 -07:00
Andrew Wang 165febbc84 HDFS-10991. Export hdfsTruncateFile symbol in libhdfs. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit dacd3ec66b)
(cherry picked from commit 67f0319db6)
 2016-10-11 15:08:53 -07:00
Tsz-Wo Nicholas Sze b23b60e7b4 HDFS-8824. Do not use small blocks for balancing the cluster. 
(cherry-picked from commit 61b9e5f7ff)
 2016-10-07 11:01:29 -07:00
Zhe Zhang 47fcae7da8 HDFS-10745. Directly resolve paths into INodesInPath. Contributed by Daryn Sharp.. 2016-10-06 09:39:59 -07:00
Brahma Reddy Battula 23d4351174 adding entry for HADOOP-13670 in changes.txt 2016-10-06 20:01:31 +05:30
Brahma Reddy Battula 7e241cfcba HADOOP-13670. Update CHANGES.txt to reflect all the changes in branch-2.7. Contributed by Brahma Reddy Battula 2016-10-06 17:56:45 +05:30
Wei-Chiu Chuang 039c3a7351 HDFS-10609. Uncaught InvalidEncryptionKeyException during pipeline recovery may abort downstream applications. Contributed by Wei-Chiu Chuang. 2016-10-05 13:29:20 -07:00
Jason Lowe 599146d10b MAPREDUCE-6741. Add MR support to redact job conf properties. Contributed by Haibo Chen 
(cherry picked from commit f1b74a3d9f)

Conflicts:

	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
 2016-10-05 15:33:23 +00:00
Zhe Zhang 5c99959b2d HDFS-10896. Move lock logging logic from FSNamesystem into FSNamesystemLock. Contributed by Erik Krogen. 2016-10-04 16:52:56 -07:00
Kihwal Lee 3eff0873f6 HDFS-10878. TestDFSClientRetries#testIdempotentAllocateBlockAndClose throws ConcurrentModificationException. Contributed by Rushabh S Shah. 
Modified CHANGES.txt
(cherry picked from commit 382307cbdd)
 2016-10-04 11:17:59 -05:00
Arpit Agarwal c08346ea2d HDFS-10713. Throttle FsNameSystem lock warnings. Contributed by Hanisha Koneru. 
(cherry-picked from a349c54603)
 2016-09-30 16:18:23 -07:00
Jason Lowe 7a2d602ae0 MAPREDUCE-6771. RMContainerAllocator sends container diagnostics event after corresponding completion event. Contributed by Haibo Chen 2016-09-29 16:05:41 +00:00
Kihwal Lee 031125b8ff HADOOP-11780. Prevent IPC reader thread death. Contributed by Daryn Sharp. 
(cherry picked from commit e19b37ead2)
 2016-09-28 10:49:29 -05:00
Mingliang Liu bdc97f74fe HDFS-10915. Fix time measurement bug in TestDatanodeRestart. Contributed by Xiaobing Zhou 
(cherry picked from commit 6437ba18c5)
 2016-09-27 20:49:30 -07:00
Brahma Reddy Battula 5c3294d00f HDFS-10889. Remove outdated Fault Injection Framework documentaion. Contributed by Brahma Reddy Battula 
(cherry picked from commit df1d0f5d56)
 2016-09-27 19:48:32 +05:30
Brahma Reddy Battula 1190f837c8 adding the entry in CHANGE.txt for HDFS-9885 2016-09-27 10:58:31 +05:30