Commit Graph

2271 Commits

Author SHA1 Message Date
Haohui Mai 282b5ed8ec HDFS-7506. Consolidate implementation of setting inode attributes into a single class. Contributed by Haohui Mai. 2014-12-15 10:49:10 -08:00
Colin Patrick Mccabe c9950f00a3 HDFS-7513. HDFS inotify: add defaultBlockSize to CreateEvent (cmccabe)
(cherry picked from commit 6e13fc62e1)
2014-12-15 10:30:50 -08:00
Andrew Wang 6bc65d769b HDFS-7426. Change nntop JMX format to be a JSON blob.
(cherry picked from commit fa7b9248e4)
2014-12-12 17:04:41 -08:00
Jing Zhao 614b4046ba HDFS-7059. Avoid resolving path multiple times. Contributed by Jing Zhao. 2014-12-12 15:14:15 -08:00
arp d15fb57f46 HDFS-7514. TestTextCommand fails on Windows. (Arpit Agarwal) 2014-12-12 14:28:46 -08:00
Haohui Mai d9f31c6472 HDFS-7517. Remove redundant non-null checks in FSNamesystem#getBlockLocations. Contributed by Haohui Mai. 2014-12-12 11:51:29 -08:00
Andrew Wang 7f39cab356 HDFS-7497. Inconsistent report of decommissioning DataNodes between dfsadmin and NameNode webui. Contributed by Yongjun Zhang.
(cherry picked from commit b437f5eef4)
2014-12-11 18:13:14 -08:00
Haohui Mai 5bc3aae6fb HADOOP-11389. Clean up byte to string encoding issues in hadoop-common. Contributed by Haohui Mai. 2014-12-11 16:51:46 -08:00
Haohui Mai c8eb139977 HDFS-7515. Fix new findbugs warnings in hadoop-hdfs. Contributed by Haohui Mai. 2014-12-11 12:36:20 -08:00
arp e4f9ddfdbc HDFS-7503. Namenode restart after large deletions can cause slow processReport (Arpit Agarwal) 2014-12-10 23:37:26 -08:00
Haohui Mai 9e1c059815 HDFS-7463. Simplify FSNamesystem#getBlockLocationsUpdateTimes. Contributed by Haohui Mai. 2014-12-10 23:01:28 -08:00
arp d39809016d HDFS-7475. Make TestLazyPersistFiles#testLazyPersistBlocksAreSaved deterministic. (Contributed by Xiaoyu Yao) 2014-12-10 18:24:50 -08:00
Vinayakumar B 19627e5897 HDFS-7481. Add ACL indicator to the 'Permission Denied' exception. (Contributed by Vinayakumar B )
(cherry picked from commit d93f3b9815)
2014-12-10 08:32:39 +05:30
Jing Zhao e8e86e3ec7 HDFS-7498. Simplify the logic in INodesInPath. Contributed by Jing Zhao. 2014-12-09 11:38:07 -08:00
Colin Patrick Mccabe a037d6030b HDFS-7489. Incorrect locking in FsVolumeList#checkDirs can hang datanodes (Noah Lorang via Colin P. McCabe)
(cherry picked from commit d8352b9b2b)
2014-12-09 10:58:56 -08:00
Haohui Mai 7198232b82 HDFS-7486. Consolidate XAttr-related implementation into a single class. Contributed by Haohui Mai. 2014-12-08 11:55:40 -08:00
cnauroth 059c4a372f HDFS-7473. Document setting dfs.namenode.fs-limits.max-directory-items to 0 is invalid. Contributed by Akira AJISAKA.
(cherry picked from commit d555bb2120)
2014-12-08 11:07:18 -08:00
cnauroth 143a5b67d8 HDFS-7384. getfacl command and getAclStatus output should be in sync. Contributed by Vinayakumar B.
(cherry picked from commit ffe942b82c)
2014-12-08 10:28:25 -08:00
cnauroth 00528ad1ad HDFS-7476. Consolidate ACL-related operations to a single class. Contributed by Haohui Mai.
(cherry picked from commit 9297f980c2)
2014-12-06 14:20:32 -08:00
Haohui Mai b65093c733 HDFS-7459. Consolidate cache-related implementation in FSNamesystem into a single class. Contributed by Haohui Mai. 2014-12-05 18:36:04 -08:00
Jing Zhao 988ef8a462 HDFS-7474. Avoid resolving path in FSPermissionChecker. Contributed by Jing Zhao.
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
2014-12-05 14:20:26 -08:00
Haohui Mai 6afc75f87b HDFS-7472. Fix typo in message of ReplicaNotFoundException. Contributed by Masatake Iwasaki. 2014-12-05 11:23:32 -08:00
Haohui Mai 2caed865e9 HDFS-7478. Move org.apache.hadoop.hdfs.server.namenode.NNConf to FSNamesystem. Contributed by Li Lu. 2014-12-05 10:55:27 -08:00
Haohui Mai b4478f069a HDFS-7454. Reduce memory footprint for AclEntries in NameNode. Contributed by Vinayakumar B. 2014-12-04 20:49:59 -08:00
Haohui Mai 448f925fc0 HDFS-7468. Moving verify* functions to corresponding classes. Contributed by Li Lu. 2014-12-04 14:10:01 -08:00
Steve Loughran 81ad192730 HDFS-7448 TestBookKeeperHACheckpoints fails in trunk (Akira Ajisaka via stevel) 2014-12-03 12:20:01 +00:00
stack fe6ee8a3f1 HDFS-6735. A minor optimization to avoid pread() be blocked by read() inside the same DFSInputStream (Lars Hofhansl via stack)
(cherry picked from commit 7caa3bc98e)
2014-12-02 20:59:45 -08:00
Colin Patrick Mccabe 06552a15d5 HDFS-7446. HDFS inotify should have the ability to determine what txid it has read up to (cmccabe)
(cherry picked from commit 75a326aaff)
2014-12-02 17:15:42 -08:00
Haohui Mai f32af158ed HDFS-7462. Consolidate implementation of mkdirs() into a single class. Contributed by Haohui Mai. 2014-12-02 15:00:19 -08:00
Haohui Mai 9ce77520a8 HDFS-7438. Consolidate the implementation of rename() into a single class. Contributed by Haohui Mai. 2014-12-01 21:51:16 -08:00
Haohui Mai 49122df1c0 HDFS-7450. Consolidate the implementation of GetFileInfo(), GetListings() and GetContentSummary() into a single class. Contributed by Haohui Mai. 2014-12-01 21:37:44 -08:00
Uma Maheswara Rao G f4ab306347 HDFS-7210. Avoid two separate RPC's namenode.append() and namenode.getFileInfo() for an append call from DFSClient. (Vinayakumar B via umamahesh)
(cherry picked from commit 1556f86a31)
2014-11-28 21:13:17 +05:30
Haohui Mai ae04ce29e5 HDFS-7444. convertToBlockUnderConstruction should preserve BlockCollection. Contributed by Haohui Mai. 2014-11-26 10:37:54 -08:00
Uma Maheswara Rao G 6545342a6d HDFS-7310. Mover can give first priority to local DN if it has target storage type available in local DN. (Vinayakumar B via umamahesh)
(cherry picked from commit 058af60c56)
2014-11-26 23:34:21 +05:30
Haohui Mai 3e011f1ec2 HDFS-7440. Consolidate snapshot related operations in a single class. Contributed by Haohui Mai. 2014-11-25 21:03:57 -08:00
Andrew Wang 915176c4e7 HDFS-7097. Allow block reports to be processed during checkpointing on standby name node. (kihwal via wang)
(cherry picked from commit f43a20c529)
2014-11-25 15:37:21 -08:00
Haohui Mai 57a76f71bd HDFS-7303. NN UI fails to distinguish datanodes on the same host. Contributed by Benoy Antony. 2014-11-24 17:46:46 -08:00
Haohui Mai 9d462fb60c HDFS-7436. Consolidate implementation of concat(). Contributed by Haohui Mai. 2014-11-24 15:42:54 -08:00
Haohui Mai 9db888b896 HDFS-7412. Move RetryCache to NameNodeRpcServer. Contributed by Haohui Mai. 2014-11-24 11:11:35 -08:00
Colin Patrick Mccabe 4435ac9af5 HDFS-7419. Improve error messages for DataNode hot swap drive feature (Lei Xu via Colin P. Mccabe)
(cherry picked from commit f636f9d943)
2014-11-24 10:58:05 -08:00
Colin Patrick Mccabe 946df98dce HDFS-4882. Prevent the Namenode's LeaseManager from looping forever in checkLeases (Ravi Prakash via Colin P. McCabe)
(cherry picked from commit daacbc18d7)
2014-11-24 10:55:34 -08:00
yliu 7df0c4722d HDFS-7403. Inaccurate javadoc of BlockUCState#COMPLETE state. (Yongjun Zhang via yliu) 2014-11-24 04:34:13 +08:00
cnauroth 8d8eb8dcec HDFS-7425. NameNode block deletion logging uses incorrect appender. Contributed by Chris Nauroth.
(cherry picked from commit b8c094b075)
2014-11-21 16:56:17 -08:00
Aaron T. Myers 3de3640e4c HDFS-7331. Add Datanode network counts to datanode jmx page. Contributed by Charles Lamb.
(cherry picked from commit ffa8c1a1b437cf0dc6d98a9b29161d12919e5afa)
2014-11-21 16:34:41 -08:00
Haohui Mai b395f58e85 HDFS-7420. Delegate permission checks to FSDirectory. Contributed by Haohui Mai. 2014-11-21 11:01:34 -08:00
Haohui Mai 7f8d5dc802 HDFS-7415. Move FSNameSystem.resolvePath() to FSDirectory. Contributed by Haohui Mai. 2014-11-20 19:21:35 -08:00
Haohui Mai 4b99bde929 HDFS-7413. Some unit tests should use NameNodeProtocols instead of FSNameSystem. Contributed by Haohui Mai. 2014-11-20 10:28:03 -08:00
Andrew Wang 988682ac29 HDFS-7409. Allow dead nodes to finish decommissioning if all files are fully replicated.
(cherry picked from commit 765aecb4e1)
2014-11-19 17:53:25 -08:00
Andrew Wang fbce4df711 HDFS-7373. Allow decommissioning of dead DataNodes. Contributed by Zhe Zhang.
(cherry picked from commit 5bd048e837)
2014-11-18 22:17:04 -08:00
Andrew Wang 2e15754a92 HDFS-7225. Remove stale block invalidation work when DN re-registers with different UUID. (Zhe Zhang and Andrew Wang)
(cherry picked from commit 406c09ad11)
2014-11-18 22:14:17 -08:00