Commit Graph

8394 Commits

Author SHA1 Message Date
Haohui Mai b4478f069a HDFS-7454. Reduce memory footprint for AclEntries in NameNode. Contributed by Vinayakumar B. 2014-12-04 20:49:59 -08:00
Karthik Kambatla aadd0c392b YARN-2189. [YARN-1492] Admin service for cache manager. (Chris Trezzo via kasha)
(cherry picked from commit 78968155d7)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/bin/yarn
2014-12-04 19:48:18 -08:00
Haohui Mai 448f925fc0 HDFS-7468. Moving verify* functions to corresponding classes. Contributed by Li Lu. 2014-12-04 14:10:01 -08:00
Colin Patrick Mccabe a0976152e6 HADOOP-11348. Remove unused variable from CMake error message for finding openssl (Dian Fu via Colin P. McCabe)
(cherry picked from commit 565b0e60a8)
2014-12-04 12:54:59 -08:00
Jian He 1d1e7682c9 YARN-2301. Improved yarn container command. Contributed by Naganarasimha G R
(cherry picked from commit 258623ff8b)
2014-12-04 12:53:52 -08:00
Brandon Li d4e1f12c5f HDFS-7424. Add web UI for NFS gateway. Contributed by Brandon Li
(cherry picked from commit 1bbcc3d032)
2014-12-04 10:47:29 -08:00
Aaron T. Myers 534a021e70 HADOOP-11332. KerberosAuthenticator#doSpnegoSequence should check if kerberos TGT is available in the subject. Contributed by Dian Fu.
(cherry picked from commit 9d1a8f5897)
2014-12-03 18:54:26 -08:00
Jian He 58c971164c YARN-2880. Added a test to make sure node labels will be recovered if RM restart is enabled. Contributed by Rohith Sharmaks
(cherry picked from commit 73fbb3c66b)
2014-12-03 17:17:40 -08:00
Harsh J ee25c0d890 YARN-2891. Failed Container Executor does not provide a clear error message. Contributed by Dustin Cote. (harsh)
(cherry picked from commit 4b13318dea7a1cbbbfc1f84207af829cbe2f720e)
2014-12-04 03:19:01 +05:30
Karthik Kambatla 25be97808b YARN-2874. Dead lock in DelegationTokenRenewer which blocks RM to execute any further apps. (Naganarasimha G R via kasha)
(cherry picked from commit 799353e2c7)
2014-12-03 13:45:03 -08:00
Brandon Li 97b3e2b79b HDFS-7458. Add description to the nfs ports in core-site.xml used by nfs test to avoid confusion. Contributed by Yongjun Zhang
(cherry picked from commit a1e822595c)
2014-12-03 13:32:29 -08:00
Andrew Wang 696e15f0d1 HADOOP-11342. KMS key ACL should ignore ALL operation for default key ACL and whitelist key ACL. Contributed by Dian Fu.
(cherry picked from commit 1812241ee1)
2014-12-03 12:00:29 -08:00
Jason Lowe db723a8499 MAPREDUCE-5932. Provide an option to use a dedicated reduce-side shuffle log. Contributed by Gera Shegalov
(cherry picked from commit 03ab24aa01)

Conflicts:

	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
2014-12-03 17:12:47 +00:00
Steve Loughran 81ad192730 HDFS-7448 TestBookKeeperHACheckpoints fails in trunk (Akira Ajisaka via stevel) 2014-12-03 12:20:01 +00:00
Junping Du 86535ff65f YARN-1156. Enhance NodeManager AllocatedGB and AvailableGB metrics for aggregation of decimal values. (Contributed by Tsuyoshi OZAWA)
(cherry picked from commit e65b7c5ff6)
2014-12-03 04:12:35 -08:00
stack fe6ee8a3f1 HDFS-6735. A minor optimization to avoid pread() be blocked by read() inside the same DFSInputStream (Lars Hofhansl via stack)
(cherry picked from commit 7caa3bc98e)
2014-12-02 20:59:45 -08:00
Andrew Wang c962eef533 HADOOP-11344. KMS kms-config.sh sets a default value for the keystore password even in non-ssl setup. Contributed by Arun Suresh.
(cherry picked from commit 3d48ad7eb4)
2014-12-02 19:04:33 -08:00
Jian He d6f3d4893d YARN-2894. Fixed a bug regarding application view acl when RM fails over. Contributed by Rohith Sharmaks
(cherry picked from commit 392c3aaea8)
2014-12-02 17:17:16 -08:00
Colin Patrick Mccabe 06552a15d5 HDFS-7446. HDFS inotify should have the ability to determine what txid it has read up to (cmccabe)
(cherry picked from commit 75a326aaff)
2014-12-02 17:15:42 -08:00
Haohui Mai f32af158ed HDFS-7462. Consolidate implementation of mkdirs() into a single class. Contributed by Haohui Mai. 2014-12-02 15:00:19 -08:00
Jian He 5067ac098b YARN-2136. Changed RMStateStore to ignore store opearations when fenced. Contributed by Varun Saxena
(cherry picked from commit 52bcefca8b)
2014-12-02 11:02:00 -08:00
stack 6d904985e8 HADOOP-11301. [optionally] update jmx cache to drop old metrics (Maysam Yabandeh via stack)
(cherry picked from commit b36f292982)
2014-12-01 23:08:16 -08:00
stack 76245dfccd Revert "HBASE-11301 [optionally] update jmx cache to drop old metrics (Maysam Yabandeh via stack)"
This reverts commit fd6a801ddb.

Refers to an HBASE rather than HADOOP issue.
2014-12-01 23:02:32 -08:00
stack fd6a801ddb HBASE-11301 [optionally] update jmx cache to drop old metrics (Maysam Yabandeh via stack)
(cherry picked from commit 74f4d8590d)
2014-12-01 22:55:12 -08:00
Andrew Wang 881c77107e HADOOP-11341. KMS support for whitelist key ACLs. Contributed by Arun Suresh.
(cherry picked from commit 31b4d2daa1)
2014-12-01 21:58:21 -08:00
Colin Patrick Mccabe f9c5dec152 CHANGES.txt: add HADOOP-11257
(cherry picked from commit c1f2bb2d31)
2014-12-01 21:58:15 -08:00
Haohui Mai 9ce77520a8 HDFS-7438. Consolidate the implementation of rename() into a single class. Contributed by Haohui Mai. 2014-12-01 21:51:16 -08:00
Haohui Mai 49122df1c0 HDFS-7450. Consolidate the implementation of GetFileInfo(), GetListings() and GetContentSummary() into a single class. Contributed by Haohui Mai. 2014-12-01 21:37:44 -08:00
Andrew Wang 084667aad9 HADOOP-11337. KeyAuthorizationKeyProvider access checks need to be done atomically. Contributed by Dian Fu.
(cherry picked from commit 9fa2990257)
2014-12-01 21:22:03 -08:00
Zhijie Shen d21ef79707 YARN-2890. MiniYARNCluster should start the timeline server based on the configuration. Contributed by Mit Desai.
(cherry picked from commit 51af8d367d)
2014-12-01 19:08:31 -08:00
Jian He d208c90148 YARN-2765. Added leveldb-based implementation for RMStateStore. Contributed by Jason Lowe
(cherry picked from commit a7fba0bc28)
2014-12-01 16:45:17 -08:00
Jason Lowe b6d7b789bd MAPREDUCE-6160. Potential NullPointerException in MRClientProtocol interface implementation. Contributed by Rohith
(cherry picked from commit 0c588904f8)
2014-12-01 22:40:38 +00:00
Jason Lowe 38ea1419f6 YARN-2905. AggregatedLogsBlock page can infinitely loop if the aggregated log file is corrupted. Contributed by Varun Saxena
(cherry picked from commit 0f9528b99a)
2014-12-01 22:30:20 +00:00
Jason Lowe 2bdef5697b MAPREDUCE-6172. TestDbClasses timeouts are too aggressive. Contributed by Varun Saxena
(cherry picked from commit 2b30fb1053)
2014-12-01 21:52:51 +00:00
Colin Patrick Mccabe f6d1bf5ed1 HADOOP-11333. Fix deadlock in DomainSocketWatcher when the notification pipe is full (zhaoyunjiong via cmccabe)
(cherry picked from commit 86e3993def)
2014-12-01 11:48:53 -08:00
Junping Du c7bd22974a YARN-2907. SchedulerNode#toString should print all resource detail instead of only memory. (Contributed by Rohith)
(cherry picked from commit c732ed760e)
2014-12-01 05:41:56 -08:00
Uma Maheswara Rao G f4ab306347 HDFS-7210. Avoid two separate RPC's namenode.append() and namenode.getFileInfo() for an append call from DFSClient. (Vinayakumar B via umamahesh)
(cherry picked from commit 1556f86a31)
2014-11-28 21:13:17 +05:30
Colin Patrick Mccabe 8f98225418 HADOOP-11257. Update "hadoop jar" documentation to warn against using it for launching yarn jars (iwasakims via cmccabe) 2014-11-26 13:42:07 -08:00
Zhijie Shen a9adc1295c YARN-2165. Added the sanity check for the numeric configuration values of the timeline service. Contributed by Vasanth kumar RJ.
(cherry picked from commit 8f1454cc6d)
2014-11-26 12:12:42 -08:00
Haohui Mai ae04ce29e5 HDFS-7444. convertToBlockUnderConstruction should preserve BlockCollection. Contributed by Haohui Mai. 2014-11-26 10:37:54 -08:00
Uma Maheswara Rao G 6545342a6d HDFS-7310. Mover can give first priority to local DN if it has target storage type available in local DN. (Vinayakumar B via umamahesh)
(cherry picked from commit 058af60c56)
2014-11-26 23:34:21 +05:30
Steve Loughran 6a01497d7c HDFS-6803 Document DFSClient#DFSInputStream expectations reading and preading in concurrent context. (stack via stevel) 2014-11-26 11:43:46 +00:00
Haohui Mai 0c8a8ba86e HDFS-7440. Update CHANGES.txt for HDFS-7440. 2014-11-25 21:05:21 -08:00
Haohui Mai 3e011f1ec2 HDFS-7440. Consolidate snapshot related operations in a single class. Contributed by Haohui Mai. 2014-11-25 21:03:57 -08:00
Karthik Kambatla 3d4536af82 YARN-2188. [YARN-1492] Client service for cache manager. (Chris Trezzo and Sangjin Lee via kasha)
(cherry picked from commit 834b3b98e7ecc4bfe93c7dd1a9e928e9653cf138)
2014-11-25 16:22:14 -08:00
Jian He ae35b0e14d YARN-2906. CapacitySchedulerPage shows HTML tags for a queue's Active Users. Contributed by Jason Lowe
(cherry picked from commit 8a7ca13b13)
2014-11-25 16:18:02 -08:00
Andrew Wang 8018d1af58 HADOOP-11173. Improve error messages for some KeyShell commands.
(cherry picked from commit fae266bbf1)
2014-11-25 16:13:37 -08:00
Andrew Wang 915176c4e7 HDFS-7097. Allow block reports to be processed during checkpointing on standby name node. (kihwal via wang)
(cherry picked from commit f43a20c529)
2014-11-25 15:37:21 -08:00
Andrew Wang aad16f8f5c HADOOP-11300. KMS startup scripts must not display the keystore / truststore passwords. Contributed by Arun Suresh.
(cherry picked from commit 56f3eecc12)
2014-11-25 15:12:09 -08:00
Jian He 80e9be2d95 MAPREDUCE-5568. Fixed CompletedJob in JHS to show progress percentage correctly in case the number of mappers or reducers is zero. Contributed by MinJi Kim
(cherry picked from commit 78f7cdbfd6)
2014-11-25 13:03:40 -08:00