Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,465 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

9465 Commits

Author SHA1 Message Date
Masatake Iwasaki 04ccb1bec5 HADOOP-13839. Fix outdated tracing documentation. Contributed by Elek, Marton. 2017-01-05 09:24:15 +09:00
Brahma Reddy Battula a3f4ee53c8 Revert "HDFS-11280. Allow WebHDFS to reuse HTTP connections to NN. Contributed by Zheng Shao." 
This reverts commit d90f7412f2.
 2017-01-03 19:32:39 +05:30
Haohui Mai d90f7412f2 HDFS-11280. Allow WebHDFS to reuse HTTP connections to NN. Contributed by Zheng Shao. 2016-12-31 01:12:28 -08:00
Sunil 7820eeb267 YARN-6024. Capacity Scheduler 'continuous reservation looking' doesn't work when sum of queue's used and reserved resources is equal to max. Contributed by Wangda Tan. 2016-12-28 16:02:39 +05:30
Brahma Reddy Battula 3e0bd9951f HDFS-11263. ClassCastException when we use Bzipcodec for Fsimage compression. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 1b401f6a73)
 2016-12-20 21:30:18 +05:30
Wei-Chiu Chuang bbf380a493 HDFS-11160. VolumeScanner reports write-in-progress replicas as corrupt incorrectly. Contributed by Wei-Chiu Chuang and Yongjun Zhang. 
(cherry picked from commit 0cb99db9d9)

Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBlockScanner.java

(cherry picked from commit 18be0447cde622dfaaad27f7c2b9cccb30469fef)

Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/FsVolumeSpi.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsVolumeImpl.java
 2016-12-16 13:40:20 -08:00
Wei-Chiu Chuang 2123b664ca HDFS-11229. HDFS-11056 failed to close meta file. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 292bd78b44)
(cherry picked from commit fa3b2bee61)
 2016-12-10 09:34:05 -08:00
Kihwal Lee deae1f8323 HADOOP-11859. PseudoAuthenticationHandler fails with httpcomponents v4.4. Contributed by Eugene Koifman. 
(cherry picked from commit db4419df6b)
 2016-12-09 11:05:04 -06:00
Jian He c95ab6b895 YARN-5694. ZKRMStateStore can prevent the transition to standby if the ZK node is unreachable. Contributed by Daniel Templeton 2016-12-05 13:49:49 -08:00
Akira Ajisaka 6d8df4e81e HDFS-11180. Intermittent deadlock in NameNode when failover happens. 2016-12-03 11:11:50 +09:00
Akira Ajisaka 45bc79d135 HADOOP-13812. Upgrade Tomcat to 6.0.48. Contributed by John Zhuge. 
(cherry picked from commit 00096dcc0c)
(cherry picked from commit 0c895e8a62)
 2016-11-29 19:59:33 +09:00
Kihwal Lee ba10a055e4 HADOOP-13742. Expose NumOpenConnectionsPerUser as a metric. Brahma Reddy Battula. 
(cherry picked from commit bd3735554f)
(cherry picked from commit 0fb1306f93)
 2016-11-28 15:37:45 -08:00
Akira Ajisaka c594904eca HDFS-11174. Wrong HttpFS test command in doc. Contributed by John Zhuge. 
(cherry picked from commit bb1b5e083b)
(cherry picked from commit 6fe5ffd05d)
 2016-11-25 21:31:11 +09:00
Mingliang Liu 48a2dacc68 HADOOP-13655. document object store use with fs shell and distcp. Contributed by Steve Loughran 
(cherry picked from commit ed9dcdae57)
 2016-11-22 13:30:26 -08:00
Kihwal Lee 01ad9dee08 HDFS-10966. Enhance Dispatcher logic on deciding when to give up a source DataNode. Contributed by Mark Wagner and Zhe Zhang. 2016-11-21 16:58:12 -06:00
Xiaoyu Yao 0da0bf0de2 HDFS-10941. Improve BlockManager#processMisReplicatesAsync log. Contributed by Chen Liang. 
(cherry picked from commit 4484b48498)
(cherry picked from commit c443ecb267)
 2016-11-18 09:52:02 -08:00
Konstantin V Shvachko f6e517c6cc Updated CHANGES.txt for HDFS-11087. 2016-11-15 11:10:44 -08:00
Varun Saxena 8517f34793 Updated CHANGES.txt for YARN-4328. 2016-11-15 18:57:39 +05:30
Naganarasimha 501e1e1f92 YARN-4355. NPE while processing localizer heartbeat. Contributed by Varun Saxena & Jonathan Hung (addendum for changes.txt) 2016-11-15 18:25:52 +05:30
Naganarasimha 7d87e11be4 YARN-4355. NPE while processing localizer heartbeat. Contributed by Varun Saxena & Jonathan Hung 2016-11-15 17:36:14 +05:30
Zhe Zhang ec0f854ba0 Add CHANGES.txt entry for HDFS-10872. 2016-11-14 23:14:35 -08:00
Zhe Zhang cc1979b2a0 HDFS-10872. Add MutableRate metrics for FSNamesystemLock operations. Contributed by Erik Krogen. 2016-11-14 23:09:12 -08:00
Wei-Chiu Chuang 81bf6f2834 HDFS-11056. Concurrent append and read operations lead to checksum error. Contributed by Wei-Chiu Chuang. 2016-11-14 11:57:51 -08:00
Erik Krogen c997fc629d HDFS-11087. NamenodeFsck should check if the output writer is still writable. Contributed by Erik Krogen. 
(cherry picked from commit 98d9e9c4c8)
 2016-11-13 15:04:34 -08:00
Anu Engineer 95edf265b3 HDFS-8307. Spurious DNS Queries from hdfs shell. Contributed by Andres Perez 2016-11-10 14:38:53 -08:00
Zhe Zhang d762730367 HADOOP-13782. Make MutableRates metrics thread-local write, aggregate-on-read. Contributed by Erik Krogen. 
(cherry picked from commit 77c13c3857)
(cherry picked from commit 758638d08d)
(cherry picked from commit d93dc01e3d)
 2016-11-08 16:15:44 -08:00
Zhe Zhang 64657cd675 HADOOP-13804. MutableStat mean loses accuracy if add(long, long) is used. Contributed by Erik Krogen. 
(cherry picked from commit 3dbad5d823)
(cherry picked from commit b245e9ce2f)
(cherry picked from commit 384b7b71a3)
 2016-11-07 16:22:16 -08:00
Jason Lowe c1a6f4f2ee YARN-5837. NPE when getting node status of a decommissioned node after an RM restart. Contributed by Robert Kanter 2016-11-04 22:41:11 +00:00
yliu 49f983633a HADOOP-12483. Maintain wrapped SASL ordering for postponed IPC responses. (Daryn Sharp via yliu) 
(cherry picked from commit 2c0dbf728a)
 2016-11-01 22:56:25 -07:00
Zhe Zhang e6ee3e2597 HADOOP-10300. Allowed deferred sending of call responses. Contributed by Daryn Sharp. 2016-11-01 22:24:40 -07:00
Jason Lowe 5194a9bb6f YARN-5001. Aggregated Logs root directory is created with wrong group if nonexistent. Contributed by Haibo Chen 
(cherry picked from commit 76893a4100)
 2016-11-01 20:26:07 +00:00
Zhe Zhang 49f059125a Addendum of HDFS-8709: update CHANGES.TXT. 2016-10-31 15:17:21 -07:00
Andrew Wang 85708329c8 HDFS-8709. Clarify automatic sync in FSEditLog#logEdit. 
(cherry picked from commit 5fddc5177d)
(cherry picked from commit efe9ae9fc6)
(cherry picked from commit 3b8cc7c21615d07e62251fd1b9c80f696f590a8f)
 2016-10-31 15:08:52 -07:00
Zhe Zhang c10428bb7e HADOOP-12325. RPC Metrics : Add the ability track and log slow RPCs. Contributed by Anu Engineer. 2016-10-31 11:43:46 -07:00
Arpit Agarwal c60cbb3396 HADOOP-10597. RPC Server signals backoff to clients when all request queues are full. (Contributed by Ming Ma) 
(cherry picked from commit edbeefdb05)
 2016-10-31 11:25:08 -07:00
Carlo Curino 2de984ac3d YARN-3432. Cluster metrics have wrong Total Memory when there is reserved memory on CS. (Brahma Reddy Battula via curino) 
(cherry picked from commit 892a8348fc)
 2016-10-30 23:28:13 +05:30
Jason Lowe 5aa26aa66e MAPREDUCE-6724. Single shuffle to memory must not exceed Integer#MAX_VALUE. (Haibo Chen via gera) 
(cherry picked from commit 0a405c4f71)
 2016-10-28 14:43:40 +00:00
Erik Krogen d002e4d10b HDFS-9500. Fix software version counts for DataNodes during rolling upgrade. Contributed by Erik Krogen. 
(cherry picked from commit f3ac1f41b8)
 2016-10-27 16:10:26 -07:00
Varun Saxena edaa37177b YARN-4328. Fix findbugs warnings in resourcemanager (Akira Ajisaka via Varun Saxena) 2016-10-28 03:08:59 +05:30
Kihwal Lee a49510f697 HDFS-11069. Tighten the authorization of datanode RPC. Contributed by Kihwal Lee 
Updated CHANGES.txt
(cherry picked from commit ae48c496dc)
 2016-10-27 14:23:20 -05:00
Brahma Reddy Battula 616d634525 HADOOP-13201. Print the directory paths when ViewFs denies the rename operation on internal dirs. Contributed by Tianyin Xiu 
(cherry picked from commit 0c837db8a8)
 2016-10-27 19:57:00 +05:30
Mingliang Liu cd07a8858c HDFS-10921. TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode. Contributed by Eric Badger 
(cherry picked from commit 55e1fb8e32)
 2016-10-26 14:18:16 -07:00
Kihwal Lee fdd645be6b HDFS-11053. Unnecessary superuser check in versionRequest(). Contributed by Kihwal Lee. 
Updated CHANGES.txt
(cherry picked from commit e90af4a89b)
 2016-10-26 09:19:45 -05:00
Zhe Zhang c05d701161 HDFS-11015. Enforce timeout in balancer. Contributed by Kihwal Lee. 
(cherry picked from commit f6367c5f44)
(cherry picked from commit ff806cbfc7)
(cherry picked from commit 262518fa5b)
 2016-10-25 11:50:51 -07:00
Brahma Reddy Battula d05e737b84 HADOOP-13236. truncate will fail when we use viewfilesystem. Contributed by Brahma Reddy Battula 
(cherry picked from commit f872c6bc03)
 2016-10-21 06:21:46 +05:30
Steve Loughran 897cf09b40 Revert "HADOOP-13236. truncate will fail when we use viewfilesystem. Contributed by Brahma Reddy Battula" 
This reverts commit f6d8746f2e.
 2016-10-20 19:48:56 +01:00
Brahma Reddy Battula f6d8746f2e HADOOP-13236. truncate will fail when we use viewfilesystem. Contributed by Brahma Reddy Battula 
(cherry picked from commit f872c6bc03)
 2016-10-20 21:54:09 +05:30
Kihwal Lee 6ae7b9f800 HDFS-10627. Volume Scanner marks a block as "suspect" even if the exception is network-related. Contributed by Rushabh S Shah. 
Updated CHANGES.txt
(cherry picked from commit 5c0bffddc0)
 2016-10-20 11:09:20 -05:00
Brahma Reddy Battula 1e5c40b5b4 HDFS-9444. Add utility to find set of available ephemeral ports to ServerSocketUtil. Contributed by Masatake Iwasaki 
(cherry picked from commit e9a34ae29c)
(cherry picked from commit 5f754e8638)
 2016-10-18 10:50:19 -07:00
Konstantin V Shvachko 4aea760676 Update CHANGES.txt for HDFS-10712 and HDFS-10301. (shv) 2016-10-18 10:37:01 -07:00