Commit Graph

8057 Commits

Author SHA1 Message Date
Karthik Kambatla d02cb9c512 YARN-2927. [YARN-1492] InMemorySCMStore properties are inconsistent. (Ray Chiang via kasha)
(cherry picked from commit 120e1decd7)
2014-12-07 22:28:57 -08:00
cnauroth 308b75571b HADOOP-11313. Adding a document about NativeLibraryChecker. Contributed by Tsuyoshi OZAWA.
(cherry picked from commit 1b3bb9e7a3)
2014-12-06 20:12:56 -08:00
cnauroth 00528ad1ad HDFS-7476. Consolidate ACL-related operations to a single class. Contributed by Haohui Mai.
(cherry picked from commit 9297f980c2)
2014-12-06 14:20:32 -08:00
Haohui Mai b65093c733 HDFS-7459. Consolidate cache-related implementation in FSNamesystem into a single class. Contributed by Haohui Mai. 2014-12-05 18:36:04 -08:00
Andrew Wang dabdd2d746 HADOOP-11343. Overflow is not properly handled in caclulating final iv for AES CTR. Contributed by Jerry Chen.
(cherry picked from commit 0707e4eca9)
2014-12-05 18:20:23 -08:00
Jian He 4cc0abe4fe YARN-2869. CapacityScheduler should trim sub queue names when parse configuration. Contributed by Wangda Tan
(cherry picked from commit e69af836f3)
2014-12-05 17:34:15 -08:00
Jing Zhao 988ef8a462 HDFS-7474. Avoid resolving path in FSPermissionChecker. Contributed by Jing Zhao.
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
2014-12-05 14:20:26 -08:00
Jason Lowe b72fb6c774 YARN-2056. Disable preemption at Queue level. Contributed by Eric Payne
(cherry picked from commit 4b13082199)
2014-12-05 21:08:14 +00:00
Robert Kanter 2ebd1bc654 YARN-2461. Fix PROCFS_USE_SMAPS_BASED_RSS_ENABLED property in YarnConfiguration. (rchiang via rkanter)
(cherry picked from commit 3c72f54ef5)
2014-12-05 12:10:20 -08:00
Andrew Wang b8e4fffa49 HADOOP-11355. When accessing data in HDFS and the key has been deleted, a Null Pointer Exception is shown. Contributed by Arun Suresh.
(cherry picked from commit 9cdaec6a6f)
2014-12-05 12:01:32 -08:00
Haohui Mai 6afc75f87b HDFS-7472. Fix typo in message of ReplicaNotFoundException. Contributed by Masatake Iwasaki. 2014-12-05 11:23:32 -08:00
Haohui Mai 2caed865e9 HDFS-7478. Move org.apache.hadoop.hdfs.server.namenode.NNConf to FSNamesystem. Contributed by Li Lu. 2014-12-05 10:55:27 -08:00
Haohui Mai 4f612f148b HADOOP-11356. Removed deprecated o.a.h.fs.permission.AccessControlException. Contributed by Li Lu. 2014-12-05 10:50:03 -08:00
Haohui Mai b4478f069a HDFS-7454. Reduce memory footprint for AclEntries in NameNode. Contributed by Vinayakumar B. 2014-12-04 20:49:59 -08:00
Karthik Kambatla aadd0c392b YARN-2189. [YARN-1492] Admin service for cache manager. (Chris Trezzo via kasha)
(cherry picked from commit 78968155d7)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/bin/yarn
2014-12-04 19:48:18 -08:00
Haohui Mai 448f925fc0 HDFS-7468. Moving verify* functions to corresponding classes. Contributed by Li Lu. 2014-12-04 14:10:01 -08:00
Colin Patrick Mccabe a0976152e6 HADOOP-11348. Remove unused variable from CMake error message for finding openssl (Dian Fu via Colin P. McCabe)
(cherry picked from commit 565b0e60a8)
2014-12-04 12:54:59 -08:00
Jian He 1d1e7682c9 YARN-2301. Improved yarn container command. Contributed by Naganarasimha G R
(cherry picked from commit 258623ff8b)
2014-12-04 12:53:52 -08:00
Brandon Li d4e1f12c5f HDFS-7424. Add web UI for NFS gateway. Contributed by Brandon Li
(cherry picked from commit 1bbcc3d032)
2014-12-04 10:47:29 -08:00
Aaron T. Myers 534a021e70 HADOOP-11332. KerberosAuthenticator#doSpnegoSequence should check if kerberos TGT is available in the subject. Contributed by Dian Fu.
(cherry picked from commit 9d1a8f5897)
2014-12-03 18:54:26 -08:00
Jian He 58c971164c YARN-2880. Added a test to make sure node labels will be recovered if RM restart is enabled. Contributed by Rohith Sharmaks
(cherry picked from commit 73fbb3c66b)
2014-12-03 17:17:40 -08:00
Harsh J ee25c0d890 YARN-2891. Failed Container Executor does not provide a clear error message. Contributed by Dustin Cote. (harsh)
(cherry picked from commit 4b13318dea7a1cbbbfc1f84207af829cbe2f720e)
2014-12-04 03:19:01 +05:30
Karthik Kambatla 25be97808b YARN-2874. Dead lock in DelegationTokenRenewer which blocks RM to execute any further apps. (Naganarasimha G R via kasha)
(cherry picked from commit 799353e2c7)
2014-12-03 13:45:03 -08:00
Brandon Li 97b3e2b79b HDFS-7458. Add description to the nfs ports in core-site.xml used by nfs test to avoid confusion. Contributed by Yongjun Zhang
(cherry picked from commit a1e822595c)
2014-12-03 13:32:29 -08:00
Andrew Wang 696e15f0d1 HADOOP-11342. KMS key ACL should ignore ALL operation for default key ACL and whitelist key ACL. Contributed by Dian Fu.
(cherry picked from commit 1812241ee1)
2014-12-03 12:00:29 -08:00
Jason Lowe db723a8499 MAPREDUCE-5932. Provide an option to use a dedicated reduce-side shuffle log. Contributed by Gera Shegalov
(cherry picked from commit 03ab24aa01)

Conflicts:

	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
2014-12-03 17:12:47 +00:00
Steve Loughran 81ad192730 HDFS-7448 TestBookKeeperHACheckpoints fails in trunk (Akira Ajisaka via stevel) 2014-12-03 12:20:01 +00:00
Junping Du 86535ff65f YARN-1156. Enhance NodeManager AllocatedGB and AvailableGB metrics for aggregation of decimal values. (Contributed by Tsuyoshi OZAWA)
(cherry picked from commit e65b7c5ff6)
2014-12-03 04:12:35 -08:00
stack fe6ee8a3f1 HDFS-6735. A minor optimization to avoid pread() be blocked by read() inside the same DFSInputStream (Lars Hofhansl via stack)
(cherry picked from commit 7caa3bc98e)
2014-12-02 20:59:45 -08:00
Andrew Wang c962eef533 HADOOP-11344. KMS kms-config.sh sets a default value for the keystore password even in non-ssl setup. Contributed by Arun Suresh.
(cherry picked from commit 3d48ad7eb4)
2014-12-02 19:04:33 -08:00
Jian He d6f3d4893d YARN-2894. Fixed a bug regarding application view acl when RM fails over. Contributed by Rohith Sharmaks
(cherry picked from commit 392c3aaea8)
2014-12-02 17:17:16 -08:00
Colin Patrick Mccabe 06552a15d5 HDFS-7446. HDFS inotify should have the ability to determine what txid it has read up to (cmccabe)
(cherry picked from commit 75a326aaff)
2014-12-02 17:15:42 -08:00
Haohui Mai f32af158ed HDFS-7462. Consolidate implementation of mkdirs() into a single class. Contributed by Haohui Mai. 2014-12-02 15:00:19 -08:00
Jian He 5067ac098b YARN-2136. Changed RMStateStore to ignore store opearations when fenced. Contributed by Varun Saxena
(cherry picked from commit 52bcefca8b)
2014-12-02 11:02:00 -08:00
stack 6d904985e8 HADOOP-11301. [optionally] update jmx cache to drop old metrics (Maysam Yabandeh via stack)
(cherry picked from commit b36f292982)
2014-12-01 23:08:16 -08:00
stack 76245dfccd Revert "HBASE-11301 [optionally] update jmx cache to drop old metrics (Maysam Yabandeh via stack)"
This reverts commit fd6a801ddb.

Refers to an HBASE rather than HADOOP issue.
2014-12-01 23:02:32 -08:00
stack fd6a801ddb HBASE-11301 [optionally] update jmx cache to drop old metrics (Maysam Yabandeh via stack)
(cherry picked from commit 74f4d8590d)
2014-12-01 22:55:12 -08:00
Andrew Wang 881c77107e HADOOP-11341. KMS support for whitelist key ACLs. Contributed by Arun Suresh.
(cherry picked from commit 31b4d2daa1)
2014-12-01 21:58:21 -08:00
Colin Patrick Mccabe f9c5dec152 CHANGES.txt: add HADOOP-11257
(cherry picked from commit c1f2bb2d31)
2014-12-01 21:58:15 -08:00
Haohui Mai 9ce77520a8 HDFS-7438. Consolidate the implementation of rename() into a single class. Contributed by Haohui Mai. 2014-12-01 21:51:16 -08:00
Haohui Mai 49122df1c0 HDFS-7450. Consolidate the implementation of GetFileInfo(), GetListings() and GetContentSummary() into a single class. Contributed by Haohui Mai. 2014-12-01 21:37:44 -08:00
Andrew Wang 084667aad9 HADOOP-11337. KeyAuthorizationKeyProvider access checks need to be done atomically. Contributed by Dian Fu.
(cherry picked from commit 9fa2990257)
2014-12-01 21:22:03 -08:00
Zhijie Shen d21ef79707 YARN-2890. MiniYARNCluster should start the timeline server based on the configuration. Contributed by Mit Desai.
(cherry picked from commit 51af8d367d)
2014-12-01 19:08:31 -08:00
Jian He d208c90148 YARN-2765. Added leveldb-based implementation for RMStateStore. Contributed by Jason Lowe
(cherry picked from commit a7fba0bc28)
2014-12-01 16:45:17 -08:00
Jason Lowe b6d7b789bd MAPREDUCE-6160. Potential NullPointerException in MRClientProtocol interface implementation. Contributed by Rohith
(cherry picked from commit 0c588904f8)
2014-12-01 22:40:38 +00:00
Jason Lowe 38ea1419f6 YARN-2905. AggregatedLogsBlock page can infinitely loop if the aggregated log file is corrupted. Contributed by Varun Saxena
(cherry picked from commit 0f9528b99a)
2014-12-01 22:30:20 +00:00
Jason Lowe 2bdef5697b MAPREDUCE-6172. TestDbClasses timeouts are too aggressive. Contributed by Varun Saxena
(cherry picked from commit 2b30fb1053)
2014-12-01 21:52:51 +00:00
Colin Patrick Mccabe f6d1bf5ed1 HADOOP-11333. Fix deadlock in DomainSocketWatcher when the notification pipe is full (zhaoyunjiong via cmccabe)
(cherry picked from commit 86e3993def)
2014-12-01 11:48:53 -08:00
Junping Du c7bd22974a YARN-2907. SchedulerNode#toString should print all resource detail instead of only memory. (Contributed by Rohith)
(cherry picked from commit c732ed760e)
2014-12-01 05:41:56 -08:00
Uma Maheswara Rao G f4ab306347 HDFS-7210. Avoid two separate RPC's namenode.append() and namenode.getFileInfo() for an append call from DFSClient. (Vinayakumar B via umamahesh)
(cherry picked from commit 1556f86a31)
2014-11-28 21:13:17 +05:30