Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,472 Commits 326 Branches 371 Tags
Commit Graph

9472 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Akira Ajisaka
b0b3966851 HDFS-11290. TestFSNameSystemMBean should wait until JMX cache is cleared. Contributed by Erik Krogen. 
(cherry picked from commit b1a9ec856b572894e769f052aea2340fc3f23c78)
(cherry picked from commit db47bd15dd80a4a5727607832c16635cb0ec7726)
 2017-01-24 14:19:21 +09:00
Eric Yang
b13492a0ab HADOOP-13119. Add ability to secure log servlet using proxy users. Contribute by Yuanbo Liu. 
(cherry picked from commit a847903b6e64c6edb11d852b91f2c816b1253eb3)
 2017-01-21 15:50:42 -08:00
Akira Ajisaka
1cf20b37ed HADOOP-14001. Improve delegation token validity checking. 
(cherry picked from commit 176346721006a03f41d028560e9e29b5931d5be2)
(cherry picked from commit c6c29d0080964e55ff84246af1e4149d1ef3162a)
 2017-01-19 18:07:54 +09:00
Vinitha Reddy Gankidi
a6625e69a2 HDFS-10733. NameNode terminated after full GC thinking QJM is unresponsive. Contributed by Vinitha Gankidi. 2017-01-18 12:59:37 -08:00
Junping Du
8f2fa65a8e HADOOP-13958. Bump up release year to 2017. Contributed by Junping Du. 
(cherry picked from commit 94f1d06f205eb5679475569b932eb2792f53d891)
(cherry picked from commit 7b5b57e5b2b5d33fd73ddf65d3a16f703801953a)
 2017-01-08 15:49:42 -08:00
Junping Du
01dff41699 MAPREDUCE-6711. JobImpl fails to handle preemption events on state COMMITTING. Contributed by Prabhu Joseph. 
(cherry picked from commit 679478d0c643defb3759a2ecd3c704315edee124)
(cherry picked from commit bf87c523ab5ffd1d5a94e74639be5de7821a6c5b)
(cherry picked from commit 031ad740b934d5fe67495bec34237aad3cc83815)
 2017-01-07 22:14:44 -08:00
Haohui Mai
977fb0c524 HDFS-11280. Allow WebHDFS to reuse HTTP connections to NN. Contributed by Zheng Shao. 2017-01-04 21:16:20 -08:00
Masatake Iwasaki
04ccb1bec5 HADOOP-13839. Fix outdated tracing documentation. Contributed by Elek, Marton. 2017-01-05 09:24:15 +09:00
Brahma Reddy Battula
a3f4ee53c8 Revert "HDFS-11280. Allow WebHDFS to reuse HTTP connections to NN. Contributed by Zheng Shao." 
This reverts commit d90f7412f2162550d3cc9a3ae33f330e7114bc5c.
 2017-01-03 19:32:39 +05:30
Haohui Mai
d90f7412f2 HDFS-11280. Allow WebHDFS to reuse HTTP connections to NN. Contributed by Zheng Shao. 2016-12-31 01:12:28 -08:00
Sunil
7820eeb267 YARN-6024. Capacity Scheduler 'continuous reservation looking' doesn't work when sum of queue's used and reserved resources is equal to max. Contributed by Wangda Tan. 2016-12-28 16:02:39 +05:30
Brahma Reddy Battula
3e0bd9951f HDFS-11263. ClassCastException when we use Bzipcodec for Fsimage compression. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 1b401f6a734df4e23a79b3bd89c816a1fc0de574)
 2016-12-20 21:30:18 +05:30
Wei-Chiu Chuang
bbf380a493 HDFS-11160. VolumeScanner reports write-in-progress replicas as corrupt incorrectly. Contributed by Wei-Chiu Chuang and Yongjun Zhang. 
(cherry picked from commit 0cb99db9d91d113e7fbe229f90a61a33433cecb9)

Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBlockScanner.java

(cherry picked from commit 18be0447cde622dfaaad27f7c2b9cccb30469fef)

Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/FsVolumeSpi.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsVolumeImpl.java
 2016-12-16 13:40:20 -08:00
Wei-Chiu Chuang
2123b664ca HDFS-11229. HDFS-11056 failed to close meta file. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 292bd78b4494ba1a1073b32b3f89d95e72f3204d)
(cherry picked from commit fa3b2bee618c72bae57890f011b475522fe2ff47)
 2016-12-10 09:34:05 -08:00
Kihwal Lee
deae1f8323 HADOOP-11859. PseudoAuthenticationHandler fails with httpcomponents v4.4. Contributed by Eugene Koifman. 
(cherry picked from commit db4419df6bc72e9a1ddd90bac4dd7dcf0fb05479)
 2016-12-09 11:05:04 -06:00
Jian He
c95ab6b895 YARN-5694. ZKRMStateStore can prevent the transition to standby if the ZK node is unreachable. Contributed by Daniel Templeton 2016-12-05 13:49:49 -08:00
Akira Ajisaka
6d8df4e81e HDFS-11180. Intermittent deadlock in NameNode when failover happens. 2016-12-03 11:11:50 +09:00
Akira Ajisaka
45bc79d135 HADOOP-13812. Upgrade Tomcat to 6.0.48. Contributed by John Zhuge. 
(cherry picked from commit 00096dcc0c23af38e697cd7c6c29e3f00d744e54)
(cherry picked from commit 0c895e8a62b4b69a020a5f004e97323520a1b1d0)
 2016-11-29 19:59:33 +09:00
Kihwal Lee
ba10a055e4 HADOOP-13742. Expose NumOpenConnectionsPerUser as a metric. Brahma Reddy Battula. 
(cherry picked from commit bd3735554fa5c3bc064c57ec78f4308430b14b48)
(cherry picked from commit 0fb1306f9329be7bc793a342daaaa08b2fe16f4a)
 2016-11-28 15:37:45 -08:00
Akira Ajisaka
c594904eca HDFS-11174. Wrong HttpFS test command in doc. Contributed by John Zhuge. 
(cherry picked from commit bb1b5e083b6f32646412b292d061ce5721f5dbe1)
(cherry picked from commit 6fe5ffd05d41727552834e54695d69a26eddd8d8)
 2016-11-25 21:31:11 +09:00
Mingliang Liu
48a2dacc68 HADOOP-13655. document object store use with fs shell and distcp. Contributed by Steve Loughran 
(cherry picked from commit ed9dcdae57cf3f97e563b149ecfc9ee65368094b)
 2016-11-22 13:30:26 -08:00
Kihwal Lee
01ad9dee08 HDFS-10966. Enhance Dispatcher logic on deciding when to give up a source DataNode. Contributed by Mark Wagner and Zhe Zhang. 2016-11-21 16:58:12 -06:00
Xiaoyu Yao
0da0bf0de2 HDFS-10941. Improve BlockManager#processMisReplicatesAsync log. Contributed by Chen Liang. 
(cherry picked from commit 4484b48498b2ab2a40a404c487c7a4e875df10dc)
(cherry picked from commit c443ecb267b25577f7abc058b0b5e13592d4c040)
 2016-11-18 09:52:02 -08:00
Konstantin V Shvachko
f6e517c6cc Updated CHANGES.txt for HDFS-11087. 2016-11-15 11:10:44 -08:00
Varun Saxena
8517f34793 Updated CHANGES.txt for YARN-4328. 2016-11-15 18:57:39 +05:30
Naganarasimha
501e1e1f92 YARN-4355. NPE while processing localizer heartbeat. Contributed by Varun Saxena & Jonathan Hung (addendum for changes.txt) 2016-11-15 18:25:52 +05:30
Naganarasimha
7d87e11be4 YARN-4355. NPE while processing localizer heartbeat. Contributed by Varun Saxena & Jonathan Hung 2016-11-15 17:36:14 +05:30
Zhe Zhang
ec0f854ba0 Add CHANGES.txt entry for HDFS-10872. 2016-11-14 23:14:35 -08:00
Zhe Zhang
cc1979b2a0 HDFS-10872. Add MutableRate metrics for FSNamesystemLock operations. Contributed by Erik Krogen. 2016-11-14 23:09:12 -08:00
Wei-Chiu Chuang
81bf6f2834 HDFS-11056. Concurrent append and read operations lead to checksum error. Contributed by Wei-Chiu Chuang. 2016-11-14 11:57:51 -08:00
Erik Krogen
c997fc629d HDFS-11087. NamenodeFsck should check if the output writer is still writable. Contributed by Erik Krogen. 
(cherry picked from commit 98d9e9c4c823d865ddfc017e71c82d12c8328e53)
 2016-11-13 15:04:34 -08:00
Anu Engineer
95edf265b3 HDFS-8307. Spurious DNS Queries from hdfs shell. Contributed by Andres Perez 2016-11-10 14:38:53 -08:00
Zhe Zhang
d762730367 HADOOP-13782. Make MutableRates metrics thread-local write, aggregate-on-read. Contributed by Erik Krogen. 
(cherry picked from commit 77c13c385774c51766fe505397fa916754ac08d4)
(cherry picked from commit 758638d08d3337159dd3e9fa651093d0430b399a)
(cherry picked from commit d93dc01e3dc0b9d5ce8c8105120cf01d0c66b473)
 2016-11-08 16:15:44 -08:00
Zhe Zhang
64657cd675 HADOOP-13804. MutableStat mean loses accuracy if add(long, long) is used. Contributed by Erik Krogen. 
(cherry picked from commit 3dbad5d823b8bf61b643dd1057165044138b99e0)
(cherry picked from commit b245e9ce2f20bb84690bffe902a60d5e96130cdb)
(cherry picked from commit 384b7b71a3d22bcc27bbdb9002ad700015b86eab)
 2016-11-07 16:22:16 -08:00
Jason Lowe
c1a6f4f2ee YARN-5837. NPE when getting node status of a decommissioned node after an RM restart. Contributed by Robert Kanter 2016-11-04 22:41:11 +00:00
yliu
49f983633a HADOOP-12483. Maintain wrapped SASL ordering for postponed IPC responses. (Daryn Sharp via yliu) 
(cherry picked from commit 2c0dbf728a9ade29eb5c86e798bd6d75de956e5a)
 2016-11-01 22:56:25 -07:00
Zhe Zhang
e6ee3e2597 HADOOP-10300. Allowed deferred sending of call responses. Contributed by Daryn Sharp. 2016-11-01 22:24:40 -07:00
Jason Lowe
5194a9bb6f YARN-5001. Aggregated Logs root directory is created with wrong group if nonexistent. Contributed by Haibo Chen 
(cherry picked from commit 76893a41003d57d94eb1a5f486010815266046af)
 2016-11-01 20:26:07 +00:00
Zhe Zhang
49f059125a Addendum of HDFS-8709: update CHANGES.TXT. 2016-10-31 15:17:21 -07:00
Andrew Wang
85708329c8 HDFS-8709. Clarify automatic sync in FSEditLog#logEdit. 
(cherry picked from commit 5fddc5177ddad07a735d49c15a63cfc5f74d0891)
(cherry picked from commit efe9ae9fc68e4eec4b7388b971c520328e95fe76)
(cherry picked from commit 3b8cc7c21615d07e62251fd1b9c80f696f590a8f)
 2016-10-31 15:08:52 -07:00
Zhe Zhang
c10428bb7e HADOOP-12325. RPC Metrics : Add the ability track and log slow RPCs. Contributed by Anu Engineer. 2016-10-31 11:43:46 -07:00
Arpit Agarwal
c60cbb3396 HADOOP-10597. RPC Server signals backoff to clients when all request queues are full. (Contributed by Ming Ma) 
(cherry picked from commit edbeefdb052bffd0a3ba2f00c8a5a376017fbf33)
 2016-10-31 11:25:08 -07:00
Carlo Curino
2de984ac3d YARN-3432. Cluster metrics have wrong Total Memory when there is reserved memory on CS. (Brahma Reddy Battula via curino) 
(cherry picked from commit 892a8348fceb42069ea9877251c413fe33415e16)
 2016-10-30 23:28:13 +05:30
Jason Lowe
5aa26aa66e MAPREDUCE-6724. Single shuffle to memory must not exceed Integer#MAX_VALUE. (Haibo Chen via gera) 
(cherry picked from commit 0a405c4f71b0697c8ecab6ce7de82a403baafad7)
 2016-10-28 14:43:40 +00:00
Erik Krogen
d002e4d10b HDFS-9500. Fix software version counts for DataNodes during rolling upgrade. Contributed by Erik Krogen. 
(cherry picked from commit f3ac1f41b8fa82a0ac87a207d7afa2061d90a9bd)
 2016-10-27 16:10:26 -07:00
Varun Saxena
edaa37177b YARN-4328. Fix findbugs warnings in resourcemanager (Akira Ajisaka via Varun Saxena) 2016-10-28 03:08:59 +05:30
Kihwal Lee
a49510f697 HDFS-11069. Tighten the authorization of datanode RPC. Contributed by Kihwal Lee 
Updated CHANGES.txt
(cherry picked from commit ae48c496dce8d0eae4571fc64e6850d602bae688)
 2016-10-27 14:23:20 -05:00
Brahma Reddy Battula
616d634525 HADOOP-13201. Print the directory paths when ViewFs denies the rename operation on internal dirs. Contributed by Tianyin Xiu 
(cherry picked from commit 0c837db8a874079dd5db83a7eef9c4d2b9d0e9ff)
 2016-10-27 19:57:00 +05:30
Mingliang Liu
cd07a8858c HDFS-10921. TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode. Contributed by Eric Badger 
(cherry picked from commit 55e1fb8e3221941321e6f5e04b334246c5f23027)
 2016-10-26 14:18:16 -07:00
Kihwal Lee
fdd645be6b HDFS-11053. Unnecessary superuser check in versionRequest(). Contributed by Kihwal Lee. 
Updated CHANGES.txt
(cherry picked from commit e90af4a89ba2741aeca20ead47699587b14f0de8)
 2016-10-26 09:19:45 -05:00